WO2012149684A1 - Low power and low latency push mode wireless hd video streaming architecture for portable devices - Google Patents

Low power and low latency push mode wireless hd video streaming architecture for portable devices Download PDF

Info

Publication number
WO2012149684A1
WO2012149684A1 PCT/CN2011/073680 CN2011073680W WO2012149684A1 WO 2012149684 A1 WO2012149684 A1 WO 2012149684A1 CN 2011073680 W CN2011073680 W CN 2011073680W WO 2012149684 A1 WO2012149684 A1 WO 2012149684A1
Authority
WO
WIPO (PCT)
Prior art keywords
portable electronic
video data
electronic device
compressed video
video
Prior art date
Application number
PCT/CN2011/073680
Other languages
French (fr)
Inventor
Junfeng Wang
Original Assignee
Panovel Technology Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panovel Technology Corporation filed Critical Panovel Technology Corporation
Priority to PCT/CN2011/073680 priority Critical patent/WO2012149684A1/en
Priority to CN201180070407.6A priority patent/CN103650516A/en
Publication of WO2012149684A1 publication Critical patent/WO2012149684A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]

Definitions

  • the present invention relates to wireless video data streaming technology.
  • Video refers to a technology for electronically capturing, storing, and playing a sequence of still images that represent scenes in motion.
  • High-definition video e.g., "HD” video
  • HD video displays may have display resolutions of 1,280 by 720 pixels (720p), 1,920 by 1,080 pixels (1080i/1080p), or other resolutions.
  • Televisions and other display devices are being manufactured with high definition resolutions in increasing numbers. As such, techniques for providing high definition video data to high definition displays are being developed, including wireless techniques.
  • WiFi wireless local area network
  • UWB ultra- wideband
  • WiHD WirelessHD
  • WHDI wireless home digital interface
  • a portable electronic device initiates and controls the transfer of the HD video to the display device.
  • push mode video streaming is the broadcast video service in cable or satellite networks. In such broadcast video services, a video stream is initiated and transferred by the video source device (e.g., a satellite or cable service).
  • the HD display initiates and controls the transfer of the HD video from the portable electronic device.
  • pull mode video is an HDTV that reads a video file from a USB disk, and plays the video file in real time.
  • Push mode video streaming tends to provide a better user experience because portable devices typically have better user interfaces than do display devices. Due to the convenience of using the user interface of a portable electronic device to control the video streaming process, push mode video streaming has become popular.
  • Portable electronic devices have significant processing and power limitations.
  • Portable electronic devices typically do not have a large amount of processing capacity, and thus processing the large amount of data contained in high definition video streams is difficult if not impossible using portable electronic devices.
  • the high data throughput with low latency needed for high definition video consumes a large amount of battery power.
  • conventional techniques for the streaming of high definition video by portable electronic devices are not practical.
  • improved techniques for enabling high definition video streaming by portable electronic device are desired.
  • Video data is streamed from portable electronic devices in compressed form, without being decoded by the portable electronic devices, enabling reduced power consumption and reduced latency.
  • the streamed compressed video data may be received, decoded, and displayed by a display device, such as a high definition display device.
  • Video corresponding to the streamed compressed video data that is displayed at the display device may be concurrently displayed on a display screen of the portable electronic device if desired, although the video does not have to be concurrently displayed on the display screen of the portable electronic device.
  • a method in a portable electronic device including receiving compressed video data from a compressed video data source, providing the received compressed video data to a transmitter of the portable electronic device in a compressed video data stream without decoding the compressed video data, and wirelessly transmitting the compressed video data stream from the portable electronic device using the transmitter in a push mode.
  • the compressed video data stream is configured to be received at a display device to be decoded and displayed as video in real time.
  • the received compressed video data may be received from a video file stored in storage in the portable electronic device.
  • the video file is parsed.
  • the parsed video file is converted into a common transport format to generate the compressed video data stream.
  • the compressed video data is received by a receiver of the portable electronic device from a real time source.
  • the compressed video data is based on image data captured by a camera in the portable electronic device captured in real time.
  • real time capture of compressed video data received from a remote source is performed to generate the compressed video data stream.
  • a portable electronic device includes a display screen, a transmitter, and a video stream generator.
  • the video stream generator receives compressed video data from a compressed video data source, and is configured to provide the received compressed video data to the transmitter in a compressed video data stream.
  • the transmitter is configured to wirelessly transmit the compressed video data stream from the portable electronic device in a push mode.
  • the transmitted compressed video data stream is configured to be received at a display device to be decoded and displayed as video.
  • the portable electronic device may further include a storage device.
  • the video stream generator receives the compressed video data from a video file stored in the storage device.
  • the video stream generator may include a file parser configured to parse the video file to generate the compressed video data stream and a format converter configured to convert the parsed video file into a common transport format to generate the compressed video data stream.
  • the portable electronic device may be received from a real time source. According to one real time source, the portable electronic device further includes a camera, and the compressed video data is based on image data captured by the camera in real time. According to another real time source, the portable electronic device further includes a receiver that receives the compressed video data from a remote source.
  • the video stream generator includes a real time capture module configured to perform real time capture of the compressed video data received from the camera or real time source to generate the compressed video data stream.
  • Computer program products are also described herein that enable streaming of compressed video data from portable electronic devices, and that enable further embodiments as described herein.
  • Devices in which embodiments may be implemented may include storage, such as storage drives, memory devices, and further types of computer-readable storage media described herein.
  • Such computer-readable storage media may store program modules that include computer program logic for performing the systems, processes, and further embodiments described herein.
  • FIG. 1 shows a block diagram of a video streaming system that includes a portable electronic device and a high definition (HD) display device, according to an example embodiment.
  • FIG. 2 shows a block diagram of concurrent views of a display screen of the portable electronic device of FIG. 1 and a display screen of the HD display device of FIG. 1.
  • FIGS. 3 and 4 show respective block diagrams of example video streaming systems.
  • FIG. 5 shows a block diagram of a video streaming system, according to an example embodiment.
  • FIG. 6 shows a flowchart for streaming video from a portable electronic device, according to an example embodiment.
  • FIG. 7 shows a block diagram of a portable electronic device, according to an example embodiment.
  • FIG. 8 shows a flowchart providing a process for parsing a video file to generate a compressed video data stream, according to an example embodiment.
  • FIG. 9 shows a block diagram of a portable electronic device, according to an example embodiment.
  • FIG. 10 shows a flowchart providing a process for real time capture of video data to generate a compressed video data stream, according to an example embodiment.
  • FIG. 11 shows a block diagram of concurrent views of a display screen of the portable electronic device of FIG. 5 and a display screen of the HD display device of FIG.
  • FIG. 12 shows a block diagram of an example mobile device with video display and processing capability, according to an embodiment.
  • FIGS. 13 and 14 show block diagrams of portable electronic devices, according to example embodiments.
  • references in the specification to "one embodiment,” “an embodiment,” “an example embodiment,” etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
  • Embodiments of the present invention enable the streaming of video, such as high definition (HD) video, from portable electronic devices.
  • a display device may receive the streamed video, and may display the streamed video on a display screen.
  • FIG. 1 shows a block diagram of a video streaming system 100.
  • system 100 includes a portable electronic device 102 and an HD display device 104.
  • portable electronic device 102 includes an antenna 106 and a display screen 110, which displays a video 114.
  • a media player may be used to play video 114 at portable electronic device 102, as would be known to persons skilled in the relevant art(s).
  • Display screen 110 may be any type of display screen, including an LCD display screen, an LED display screen, etc.
  • Display screen 110 displays video 114 to a user of portable electronic device 102.
  • video 114 may be generated from a video file stored in storage of portable electronic device 102, from video information received from external to portable electronic device 102, or other source.
  • Portable electronic device 102 generates a video data stream 116 transmitted from antenna 106 to stream video 114 from portable electronic device 102 to HD display device 104.
  • HD display device 104 includes an antenna 108 and a display screen 112.
  • Antenna 108 of HD display device 104 receives video data stream 116, and HD display device 104 displays video 114 on display screen 112 based on video data stream 112.
  • FIG. 2 shows a block diagram of a concurrent view of display screen
  • display screen 110 displays video 114 imposed on background graphics 202.
  • Background graphics 202 may be visible on display screen 110 when video 114 is displayed in less than full screen, and may include one or more of a background color and/or pattern, one or more icons, one or more other applications being used (e.g., an Internet browser viewing a web page, a document open in a word processor, an email tool, etc.), etc.
  • Portable electronic device 102 is configured to generate video data stream 116 to include all content that is displayed by display screen 110, to replicate the contents of display screen 110 on another display screen.
  • display screen 112 of HD display device 104 displays video 114 imposed on background graphics 202 in a similar manner as display screen 110 of portable electronic device 102.
  • FIG. 3 shows a block diagram of a video streaming system 300.
  • System 300 is an example of system 100 of FIG. 1. As shown in FIG. 3, system 300 includes a portable electronic device 350 and an HD display device 360.
  • Portable electronic device 350 includes a decoder 304, a graphics processing module 308, a full screen graphics processing module 310, a transmitter 312, a battery 326, antenna 106, and display screen 110.
  • HD display device 360 includes a receiver 314, a display driver 316, antenna 108, and display screen 112.
  • decoder 304 receives compressed video data 302.
  • Compressed video data 302 is compressed video data for generating video 114, such as may be received external from portable electronic device 350 or stored in a video file in portable electronic device 350.
  • Decoder 304 is configured to decode compressed video data 302 to generate decoded video data 318.
  • decoder 304 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350.
  • Graphics processing module 308 receives background graphics data 306.
  • Background graphics data 306 includes graphics data corresponding to one or more graphical (e.g., text, image, video, etc.) features of background graphics 202 (FIG. 2).
  • Graphics processing module 308 is configured to perform graphics processing on background graphics data 306 to generate processed background graphics data 306.
  • graphics processing module 308 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350.
  • Full screen graphics processing module 310 receives decoded video data 318 and processed background graphics data 306.
  • Full screen graphics processing module 310 is configured to combine and perform full screen level processing (e.g., scaling, etc.) on decoded video data 318 and processed background graphics data 306 to generate combined decoded video data 322.
  • full screen graphics processing module 310 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350.
  • Transmitter 312 receives and wirelessly transmits combined decoded video data 322 via antenna 106 as raw video data stream 324. Furthermore, display screen 110 of portable electronic device 350 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • receiver 314 of HD display device 360 receives raw video data stream 324 via antenna 108, and outputs combined decoded video data 322.
  • HD display device 360 may optionally include display driver 316 to configure combined decoded video data 322 for display screen 112 (although not shown herein, portable electronic devices described herein may optionally include a display driver to format video data for display).
  • Display driver 316 generates video driver output data 328, which is received by display screen 112.
  • Display screen 112 generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • raw video data stream 324 is streamed wirelessly from portable electronic device 350.
  • Raw video data stream 324 includes uncompressed video data corresponding to the contents of the full screen of portable electronic device 350.
  • the data rate of the full screen raw video transmitted from transmitter 312 is orders of magnitudes higher than that of a compressed video file that may be streamed, such as a file having the compressed video format of MPEG-2 (moving picture experts group), H.264, or other video file standard.
  • transmitter 312 may transmit combined decoded video data 322 at a rate of more than 1 Gbps (e.g., for raw HD video data at 1080P), while an MPEG-2 video stream is typically about 20 Mbps.
  • FIG. 4 shows a block diagram of a video streaming system 400 that is another example of system 100 of FIG. 1.
  • System 400 of FIG. 4 is similar to system 300 of FIG. 3, except that additional encoding and decoding processes are performed.
  • system 400 includes a portable electronic device 420 and an HD display device 430.
  • Portable electronic device 420 includes decoder 304, graphics processing module 308, full screen graphics processing module 310, transmitter 312, battery 326, antenna 106, display screen 110, and an encoder 402.
  • HD display device 430 includes receiver 314, display driver 316, antenna 108, display screen 112, and a decoder 404.
  • Decoder 304, graphics processing module 308, and full screen graphics processing module 310 operate similarly as described above with respect to FIG. 3 to generate combined decoded video data 322 from compressed video data 302 and background graphics data 306.
  • Encoder 402 receives and encodes combined decoded video data 322 to generate encoded combined video data 406.
  • encoder 402 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or graphics processor) of portable electronic device 420.
  • Transmitter 312 receives and wirelessly transmits encoded combined video data 406 via antenna 106 as compressed video data stream 408.
  • display screen 110 of portable electronic device 420 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • receiver 314 of HD display device 430 receives compressed video data stream 408 via antenna 108, and outputs encoded combined video data 406.
  • Decoder 404 receives and decodes encoded combined video data 406 to generate combined decoded video data 322.
  • HD display device 360 may include display driver 316 to format decoded video data 322 for display screen 112.
  • Display driver 316 generates video driver output data 328, which is received by display screen 112.
  • Display screen 112 generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • compressed video data stream 408 is streamed wirelessly from portable electronic device 420. Due to the encoding by encoder 402, compressed video data stream 408 includes compressed video data corresponding to the full screen of portable electronic device 420, and thus may be transmitted at a lower data rate than raw video data stream 324 of FIG. 3. To achieve this, however, encoder 402 must be present in portable electronic device 420 and decoder 404 must be present in HD display device 430, in the datapath for the video data. Encoder 402 dissipates significant power, making it less attractive for portable devices having stringent power budgets.
  • the datapath for video data through portable electronic device 402 and HD display device 430 includes the extra encoding and decoding functions of encoder 402 and decoder 404, introducing significant latency. As such, the techniques of FIGS. 3 and 4 have significant disadvantages.
  • FIG. 5 shows a block diagram of a video streaming system 500, according to an example embodiment.
  • System 500 is an example embodiment of system 100 of FIG. 1.
  • system 300 includes a portable electronic device 502 and an HD display device 520.
  • Portable electronic device 502 includes a video stream generator 504, transmitter 312, antenna 106, and battery 326.
  • HD display device 520 includes receiver 314, display driver 316, antenna 108, display screen 112, and decoder 404.
  • portable electronic device 502 is a video source device enabled to stream HD video with relatively low power dissipation and low latency according to the push mode.
  • HD display device 520 is an example video sink device configured to display the compressed video streamed by portable electronic device 502.
  • System 500 is described as follows with respect to FIG. 6.
  • FIG. 6 shows a flowchart 600 for streaming video from a portable electronic device, according to an example embodiment.
  • portable electronic device 502 of FIG. 5 may operate according to flowchart 600. Further structural and operational embodiments will be apparent to persons skilled in the relevant art(s) based on the following description of flowchart 600 and system 500.
  • step 602 compressed video data is received from a compressed video data source.
  • video stream generator 504 receives compressed video data 302.
  • compressed video data 302 may be received from various sources, such as from storage located in or associated with portable electronic device 502, or from a real time source such as a video camera included in portable electronic device 502 (e.g., mounted to a housing of portable electronic device 502, attached to portable electronic device 502, etc.) or a remote source (e.g., that streams compressed video data 302 to portable electronic device 502 in a wired and/or wireless manner) such as the Internet, or a wireless network of a wireless operator.
  • Received compressed video data 302 may be formatted according to one or more different video compression formats.
  • step 604 the received compressed video data is provided in a compressed video data stream to a transmitter of the portable electronic device without decoding the compressed video data.
  • video stream generator 504 is in a datapath between a source of compressed video data 302 and transmitter 312.
  • Video stream generator 304 receives compressed video data 302 and generates a compressed video data stream 506.
  • Compressed video data stream 506 includes compressed video data 302 converted into the form of a video data stream.
  • video stream generator 504 may receive compressed video data 302 in any of a number of different compressed video data formats, converting the different video compressions into a common format to generate compressed video data stream 506,.
  • Compressed video data stream 506 is received by transmitter 312.
  • Decoding of compressed video data 302 is not performed by video stream generator 504 to generate compressed video data stream 506.
  • portable electronic device 502 does not need to be configured for such decoding, and therefore does not require electronic circuitry for performing decoding and/or does not need to store decoding-related computer code.
  • Battery 326 is present to provide power for electrical components of portable electronic device 502 (e.g., video stream generator 504, transmitter 312, etc.), to enable portability for device 502.
  • a battery life of battery 326 may be extended due to not having to performing decoding, and potentially encoding, of video data at high rates.
  • portable electronic device 502 is enabled to have low latency because decoding, and potentially encoding, of video data is not performed therein. As such, corresponding delays are not introduced into the video data stream.
  • Video stream generator 504 may be configured in various ways to generate compressed video data stream 506.
  • video stream generator 504 may be a video file parser configured to receive a parse a video file.
  • FIG. 7 shows a block diagram of a portable electronic device 702, according to an example embodiment.
  • Portable electronic device 702 is an example of portable electronic device 502 of FIG. 5.
  • portable electronic device 702 includes storage 704, a video file parser 706, a format converter 712, battery 326, and transmitter 312.
  • Video file parser 706 is an example of video stream generator 504 of FIG. 5.
  • Video file parser 706 is configured to parse a video file 710 stored in storage 704 by retrieving and outputting a segment 708 of video file 710.
  • Video file 710 may have any suitable form.
  • video file 710 may be coded according any of video compression standards shown in Table 1 below, or other video compression standard. Table 1 indicates video compression standards for video file 710 and corresponding examples of storage media of storage 704 in which video file 710 may be stored:
  • H.262/MPEG-2 Part 2 DVD digital video disc
  • Blu-Ray Blu-Ray
  • H.264/MPEG-4 AVC advanced video Blu-Ray , Digital Video Broadcasting, iPod coding
  • Video HD DVD
  • Segment 708 may include any portion of video file 710, including a portion of a video frame, a single video frame, multiple video frames, or any other portion of video file 710.
  • Video file parser 706 sequentially retrieves segments 708 of video file 710 in storage 704.
  • Format converter 712 is configured to convert each segment 708 into a common transport format (e.g., in packetized form) to generate compressed video data stream 506.
  • format converter 712 may be configured to convert segments 708 from a video compression format, such as any video compression format shown in Table 1, into a common transport format, such as a transport format described below with respect to step 606 of flowchart 600 (FIG. 6) or other transport format. Configurations for format converter 712 will be known to persons skilled in the relevant art(s) based on the teachings herein.
  • portable electronic device 702 may operate according to a flowchart
  • Flowchart 800 provides a process for parsing a video file to generate a compressed video data stream, according to an example embodiment.
  • Flowchart 800 begins with step 802.
  • compressed video data is stored in storage in the portable electronic device.
  • video file 710 is stored in storage 704 of portable electronic device 702.
  • the compressed video data of the video file is parsed to generate the compressed video data stream.
  • video file parser 706 may parse video file 710 to generate compressed video data stream 506.
  • video stream generator 504 may be configured to perform real time video capture of compressed video data transmitted to portable electronic device 502 in real time.
  • FIG. 9 shows a block diagram of a portable electronic device 902, according to an example embodiment.
  • Portable electronic device 902 is an example of portable electronic device 502 of FIG. 5.
  • portable electronic device 902 includes a receiver 904, a real time capture module 906, an antenna 908, battery 326, and transmitter 312.
  • Real time capture module 906 is an example of video stream generator 504 of FIG. 5.
  • Real time capture module 906 is configured to capture video data in real time that is transmitted to portable electronic device 902 by a remote source 910. For example, as shown in FIG.
  • remote source 910 wirelessly transmits a compressed video data stream 912 to portable electronic device 902.
  • Receiver 904 receives compressed video data stream 912 via antenna 908, an outputs compressed video data 302.
  • Real time capture module 906 is configured to receive and convert compressed video data 302 into compressed video data stream 506 in real time (e.g., with little to no buffering of video data).
  • Compressed video data stream 912 may have any suitable form, and as such, real time capture module 906 may be configured to convert the received form of compressed video data stream 912 (as compressed video data 302) into compressed video data stream 506 having a predetermined format in real time, as described further below.
  • compressed video data stream 912 may be coded according any of the video compression standards shown in Table 2 below, or according to other video compression standard. Table 2 indicates video compression standards for compressed video data stream 912 and corresponding examples of remote source applications for which compressed video data stream 912 may be received:
  • portable electronic device 902 may operate according to a flowchart
  • Flowchart 1000 provides a process for real time capture of video data to generate a compressed video data stream, according to an example embodiment.
  • Flowchart 1000 begins with step 1002.
  • the compressed video data is received using a receiver of the portable electronic device from a remote source.
  • receiver 904 of portable electronic device 902 may receive compressed video data stream 912 (via antenna 908) from remote source 910, outputting compressed video data 302.
  • step 1004 of flowchart 1000 real time capture of the compressed video data received from the remote source is performed to generate the compressed video data stream.
  • real time capture module 906 is configured to receive and convert compressed video data 302 in real time into compressed video data stream 506. Configurations for real time capture module 906 will be known to persons skilled in the relevant art(s) based on the teachings herein (e.g., real time capture module 906 may include a format converter similar to format converter 712 of FIG. 7).
  • Video stream generator 504 may be configured in further ways to generate compressed video data stream 506, as would be known to persons skilled in the relevant art(s) based on the teachings herein.
  • portable electronic device 502 of FIG. 5 may include a camera (e.g., an image sensing device, such as a charge coupled device (CCD) camera).
  • the camera may capture video images, and may output a stream of the video images in compressed form, to generate compressed video data 302.
  • Portable electronic device 502 may include real time capture module 906 of FIG. 9, configured to receive and convert compressed video data 302 in real time into compressed video data stream 506.
  • the compressed video data stream is wirelessly transmitted from the portable electronic device using the transmitter in a push mode.
  • transmitter 312 receives compressed video data stream 506.
  • Transmitter 312 wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508.
  • Portable electronic device 502 streams compressed video data stream 508 according to a push mode, where portable electronic device 502 initiates and controls streaming of compressed video data.
  • Portable electronic device 502 does not stream compressed video data under the control of a display device, which would be streaming according to the pull mode.
  • Compressed video data stream 508 may be received by one or more display devices.
  • transmitted compressed video data stream 508 may be generated by video stream generator 504 and transmitted by transmitter 312 in any video data stream form, proprietary or commercially available.
  • transmitted compressed video data stream 508 may be generated in elementary stream (ES) format, defined by an MPEG communication protocol.
  • ES elementary stream
  • An elementary stream is often referred to as “elementary”, “data”, “audio”, or “video” bitstreams or streams.
  • the format of the elementary stream depends upon the codec or data carried in the stream, but will often carry a common header when packetized into a packetized elementary stream.
  • Packetized elementary stream is a specification in the MPEG-2 Part 1 (Systems) (ISO/IEC 13818-1) and ITU-T H.222.0 that defines carrying of elementary streams in packets within an MPEG program stream and MPEG transport stream.
  • the elementary stream is packetized by encapsulating sequential data bytes from the elementary stream inside PES packet headers.
  • transmitted compressed video data stream 508 may be generated in transport stream (TS) format, a standard format for transmission and storage of audio, video, and data.
  • Transport stream format is used in broadcast systems such as DVB (digital video broadcasting) and ATSC (Advanced Television Systems Committee).
  • Transport stream specifies a container format encapsulating packetized elementary streams, with error correction and stream synchronization features for maintaining transmission integrity when the signal is degraded.
  • transmitted compressed video data stream 508 may be generated according to other video data stream format.
  • Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data.
  • HD display device 520 may receive transmitted compressed video data stream 508.
  • Receiver 314 of HD display device 520 receives transmitted compressed video data stream 508 via antenna 108, and outputs compressed video data stream 510.
  • Decoder 404 receives and decodes compressed video data stream 506 to generate decoded video data stream 512.
  • HD display device 520 may optionally include display driver 316 to configure decoded video data stream 512 for display screen 112.
  • Display driver 316 generates video driver output data 514, which is received by display screen 112.
  • Display screen 112 generates a display of a video corresponding to compressed video data 302.
  • video data corresponding to the background (background graphics data 306) and video (compressed video data 302) displayed on display screen 110 of portable electronic devices 350 and 420 is included in raw video data stream 324 and compressed video data stream 408, respectively.
  • background graphics 202 and video 114 are displayed by display screens 112 of HD display devices 360 and 430 in both cases.
  • compressed video data 302 is included in transmitted compressed video data stream 508, but background graphics data 306 is not included.
  • display screen of HD display device 520 displays video 114 but not background graphics.
  • FIG. 11 shows a block diagram of concurrent views of display screen 110 of portable electronic device 502 and display screen 112 of FID display device 520, according to an example embodiment.
  • display screen 110 displays video 114 and background graphics 202.
  • an application image 1102 may be displayed with background graphics 202 on display screen 110.
  • Application image 1102 may be an image associated with any application that may be executed on portable electronic device 502, such as an email tool, a web browser, a video game, a word processor, etc.
  • Portable electronic device 502 is configured to generate transmitted compressed video data stream 508 to include video data associated with video 114 displayed by display screen 110, but not image data associated with other content displayed by display screen 110, such as background graphics 202, application image 1102, etc.
  • display screen 112 of HD display device 520 displays video 114, but not the remainder of display screen 110 of portable electronic device 502.
  • display screen 112 may display video 114 in full screen, depending on the configuration of display screen 1 12.
  • a user of portable electronic device 502 may interact with an application that generates application image 1102, without application image 1102 being displayed by display screen 112 of HD display device 520. Furthermore, portable electronic device 502 may not even display video 114 on display screen 110 while video 114 is being streamed and displayed by display screen 112 of display device 520. For example, a user of portable electronic device 502 may invoke the streaming of video 114 to display device 520, and then may reduce or iconify a media player tool displaying video 114 at portable electronic device 502 so that video 114 is not displayed on display screen 110 while it is being streamed to display device 520
  • a push mode wireless HD video streaming technique is provided that consumes less power and has less latency that conventional techniques.
  • compressed video data is streamed across a wireless link between a portable electronic device and a display device, and encoding and decoding functions are not present in the video streaming datapath in the portable electronic device.
  • portable electronic device 502 does not require a central processing unit (CPU), graphics processing unit (GPU), and/or other logic to perform the decoding and encoding.
  • Video decoding is performed once, at the display device, which is less sensitive to power usage.
  • decoding is performed in portable electronic device 350, and raw video data is wirelessly streamed, requiring additional processing and consuming more power in portable electronic device 350.
  • encoding and decoding is performed in portable electronic device 420, requiring additional processing in portable electronic device 350, consuming more power, and causing greater latency.
  • power consumption at portable electronic device 502 is significantly lower than in the techniques of FIGS. 3 and 4 described above, with latency lower than the technique of FIG. 4.
  • Embodiments of the present invention relate to the streaming of video data using portable electronic devices to display devices.
  • HD display device 520 may be any type of high definition display device, including an LCD (liquid crystal display) display or monitor, a plasma display or monitor, an LED (light emitting diode) display or monitor, an HD projector, or further type of display device.
  • Portable electronic device 502 may be any type of mobile or portable electronic device, including a smart phone, a handheld computing device (e.g., a personal digital assistant (PDA), a BLACKBERRY device, a PALM device, etc.), a laptop computer, a tablet computer (e.g., an APPLE IP AD), or further type of mobile device.
  • Embodiments include portable electronic devices having limited resources.
  • Such portable electronic devices may include a camera used to capture images, such as still images and video images that are streamed from the portable electronic device in compressed form.
  • Portable electronic devices may include storage that stores compressed video data.
  • portable electronic devices may receive video data from external sources, such as from a cable television provider, a satellite television provider, an Internet, a wireless network of a wireless operator, or other network-based web site, or other remote source.
  • FIG. 12 shows a block diagram of an example portable electronic device 1200 with video capture and processing capability.
  • Portable electronic device 1200 is an example of portable electronic device 502 of FIG. 5.
  • Portable electronic device 1200 may be any portable electronic device described herein or otherwise known.
  • the implementation of portable electronic device 1200 shown in FIG. 12 is provided for purposes of illustration, and is not intended to be limiting. Embodiments of the present invention are intended to cover portable electronic devices having additional and/or alternative features to those shown for portable electronic device 1200 in FIG. 12. [0063] As shown in FIG.
  • portable electronic device 1200 includes a speaker 1202, an audio codec 1204, a central processing unit (CPU) 1206, a radio frequency (RF) transceiver 1208, an antenna 1210, a display screen 1212, battery 326, a storage 1214, a user interface 1216, a camera 1218, and a user interface 1220.
  • CPU central processing unit
  • RF radio frequency
  • Battery 326 provides power to the components of portable electronic device 1200 that require power.
  • Battery 326 may be any type of battery, including one or more rechargeable and/or non-rechargeable batteries.
  • User interface 1216 is a user interface device that enables a user of portable electronic device 1200 to enter data, commands, and/or to otherwise interact with portable electronic device 1200. For example, a user may interact with user interface 1216 to select video content (e.g., from storage, a camera, or a remote source) for streaming.
  • User interface 1216 may include one or more user interface elements, such as a keyboard/keypad, a touch pad, a roller ball, a stick, a click wheel, and/or voice recognition technology.
  • user interface 1216 may include a graphical user interface (GUI) that is displayed by display screen 1212.
  • GUI graphical user interface
  • CPU 1206 is shown in FIG. 12 as coupled to each of audio codec 1204, RF transceiver 1208, display screen 1212, storage 1214, and user interface 1216.
  • CPU 1206 may be individually connected to these components, or one or more of these components may be connected to CPU 1206 in a common bus structure.
  • video stream generator 504 e.g., video file parser 706, format converter 712, and/or real time capture module 906
  • CPU 1206 may include a digital signal processor (DSP). When present, the DSP may apply special effects to the received video data.
  • CPU 1206 may store and/or buffer video and/or audio data in storage 1214.
  • DSP digital signal processor
  • Storage 1214 may include any suitable type of storage in the form of one or more storage devices, including one or more primary or main memory devices (e.g., random access memory (RAM)), one or more secondary storage devices 1410 (e.g., a hard disk drive, a removable storage device or drive, a memory card, a memory stick, a floppy disk drive, a magnetic tape drive, a compact disc (CD) drive for CDs, a digital video disc (DVD) drive for DVDs, an optical storage device), and/or other types of storage.
  • Storage 1214 is an example of storage 704 described above with respect to FIG.7.
  • CPU 1206 may stream the video data to RF transceiver 1208, to be transmitted from portable electronic device 1200.
  • RF transceiver 1208 may be configured to enable wireless communications for mobile device 116.
  • RF transceiver 1208 may enable telephone calls, such as telephone calls according to a cellular protocol.
  • RF transceiver 1208 may include a frequency up-converter (transmitter) (e.g., transmitter 312) and down-converter (receiver) (e.g., receiver 904).
  • RF transceiver 1208 may transmit RF signals to antenna 1210 containing audio information corresponding to voice of a user of portable electronic device 1200.
  • RF transceiver 1208 may enable a wireless local area network (WLAN) link (including an IEEE 802.11 WLAN standard link), and/or other type of wireless communication link.
  • WLAN wireless local area network
  • RF transceiver 1208 may receive RF signals from antenna 1210 corresponding to audio and/or video data received from another device in communication with portable electronic device 1200. RF transceiver 1208 provides the received audio and/or video data to CPU 1206. For example, RF transceiver 1208 may be configured to receive video telephony and/or HD television signals for portable electronic device 1200, to be displayed by display screen 1212, and to be processed by CPU 1206 prior to streaming from portable electronic device 1200.
  • Speaker 1202 and audio codec 1204 may be present in some applications of portable electronic device 1200, such as mobile phone applications and video applications.
  • CPU 1206 provides audio data from storage 1214 or received by RF transceiver 1208 to audio codec 1204.
  • Audio codec 1204 performs bit stream decoding of the received audio data (if needed) and converts the decoded data to an analog signal.
  • Speaker 1202 receives the analog signal, and outputs corresponding sound.
  • Camera 1218 and video codec 1220 may be present in some applications of portable electronic device 1200, such as mobile phone applications and video applications.
  • Camera 1218 may be any type of video camera, including a CCD camera, etc.
  • Camera 1218 captures a stream of images, and outputs video data.
  • Video codec 1220 may be present to encode the video data output by camera 1218, to generate compressed video data.
  • CPU 1206 may receive the compressed video data from video codec 1220.
  • CPU 1206 may process the compressed video data in a real time manner to generate a video data stream that is streamed from portable electronic device 1200, as described above.
  • Audio codec 1204, video codec 1218, and CPU 1206 may be implemented in hardware, software, firmware, and/or any combination thereof.
  • CPU 1206 may be implemented as a proprietary or commercially available processor, such as an ARM (advanced RISC machine) core configuration, that executes code to perform its functions.
  • Portable electronic device 1200 may include a separate graphics processor to process video data, and/or video data may be processed by CPU 1206.
  • Audio codec 1204 may be configured to process (e.g., decode, decompress, etc.) proprietary and/or industry standard audio protocols.
  • Video codec 1220 may be configured to process (e.g., encode, compress, etc.) proprietary and/or industry standard video protocols.
  • Display screen 1212 receives image/video data from CPU 1206, and display images, including video based on video data stored in storage 1214, video data received from camera 1218 (and video codec 1220) and/or received by RF transceiver 1208.
  • Display screen 1212 may include any type of display mechanism, including an LCD (liquid crystal display) panel, LED (light emitting diode), or other display mechanism.
  • portable electronic device 502 of FIG. 5 may be capable of displaying video that is streamed to HD display device 530.
  • FIG. 13 shows a block diagram of a portable electronic device 1302, according to an example embodiment.
  • Portable electronic device 1302 is an example embodiment of portable electronic device 502 of FIG. 5.
  • portable electronic device 1302 includes video stream generator 504, transmitter 312, antenna 106, battery 326, decoder 304, graphics processing module 308, full screen graphics processing module 310, and display screen 110.
  • Portable electronic device 1302 is configured to stream compressed video data to display devices (e.g., HD display device 530) in a similar manner as portable electronic device 502 of FIG. 5, as described above.
  • portable electronic device 1302 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above.
  • video stream generator 504 receives compressed video data 302.
  • Video stream generator 504 is in a datapath between a source of compressed video data 302 and transmitter 312.
  • Video stream generator 304 generates a compressed video data stream 506.
  • Transmitter 312 receives compressed video data stream 506.
  • Transmitter 312 wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508.
  • Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data, such as HD display device 520 of FIG. 5.
  • Display screen 112 of HD display device 520 generates a display of video 114 (e.g., as shown in FIG. 11).
  • decoder 304 receives compressed video data 302. Decoder 304 is configured to decode compressed video data 302 to generate decoded video data 318. Graphics processing module 308 receives background graphics data 306. Graphics processing module 308 is configured to perform graphics processing on background graphics data 306 to generate processed background graphics data 306. Full screen graphics processing module 310 receives decoded video data 318 and processed background graphics data 306. Full screen graphics processing module 310 is configured to combine and perform full screen level processing on decoded video data 318 and processed background graphics data 306 to generate combined decoded video data 322. Display screen 110 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202 (e.g., as shown in FIG. 11).
  • portable electronic device 502 of FIG. 5 may be capable of performing communications in addition to streaming video, including cell phone communications, computer network communications, etc.
  • FIG. 14 shows a block diagram of a portable electronic device 1402, according to an example embodiment.
  • Portable electronic device 1402 is an example embodiment of portable electronic device 502 of FIG. 5.
  • portable electronic device 1402 includes video stream generator 504, transmitter 312, first antenna 106, battery 326, decoder 304, graphics processing module 308, full screen graphics processing module 310, display screen 110, an application module 1404, a transceiver 1406, and a second antenna 1408.
  • Portable electronic device 1402 is configured to stream compressed video data to display devices (e.g., HD display device 530) in a similar manner as portable electronic device 502 of FIG. 5, as described above. Furthermore, portable electronic device 1402 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above. Still further, portable electronic device 1402 is configured to perform additional communications.
  • display devices e.g., HD display device 530
  • portable electronic device 1402 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above. Still further, portable electronic device 1402 is configured to perform additional communications.
  • video stream generator 504 receives compressed video data 302 and generates a compressed video data stream 506.
  • Transmitter 312 receives compressed video data stream 506 and wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508.
  • Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data, such as HD display device 520 of FIG. 5.
  • Display screen 112 of HD display device 520 generates a display of video 114 (e.g., as shown in FIG. 11).
  • decoder 304 receives compressed video data
  • Display screen 110 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202 (e.g., as shown in FIG. 11).
  • application module 1404 executes in portable electronic device 1402.
  • application module 1404 may be implemented as computer code (e.g., executed by a CPU) and/or electronic circuitry.
  • application module 1404 may be a cell phone module that enables cell phone functionality for portable electronic device 1402. Examples of cell phone modules present in portable electronic devices will be known to persons skilled in the relevant art(s).
  • application module 1404 may be a network communication module that enables network communication functionality for portable electronic device 1402.
  • application module 1404 may include web browser functionality for enabling users to interact with a web browser to navigate a network, such as the Internet.
  • application module 1404 may provide alternative functionality, such as an email application, etc.
  • application module 1404 is coupled with transceiver 1406 by a communication link 1412.
  • Application module 1404 communicates with transceiver 1406 over communication link 1412 to transmit and/or receive communication signals 1414 to and from portable electronic device 1402, to communicate with a remote entity.
  • transceiver 1406 may be a cell phone transceiver, a network transceiver (e.g., a wireless local area network (WLAN) transceiver, such as an IEEE 802.11 WLAN standard compliant transceiver), and/or other type of wireless communication transceiver, and communication signals 1414 may be cell phone communication signals, network communication signals, etc.
  • WLAN wireless local area network
  • portable electronic device 1400 is enabled to stream compressed video data to a display device while simultaneously enabling a user of portable electronic device 1400 to perform other communications with remote entities (e.g., to conduct a phone call, to browse the Internet, etc.).
  • transmitter 312 and antenna 106 are used to stream video from portable electronic device 1402
  • transceiver 1406 and antenna 1408 are used to perform other communications.
  • portable electronic device 1402 may include one antenna and/or one transceiver that is/are used to stream video and to perform other communications.
  • time slicing techniques may be used to stream video and perform further communications using a single transceiver and/or single antenna.
  • transceiver 1406 and/or antenna 1408 may be used to transmit transmitted compressed video data stream 508 and communication signals 1414.
  • decoder 404 is shown as included in display device 520.
  • decoder 404 may be located external to display device 520.
  • antenna 108, receiver 314, and decoder 404 may be included in an external device, such as a dongle, having a connector that plugs into a connector of display device 520.
  • the external device may interface with display device 520 according to an UDMI (High-Definition Multimedia Interface), a DVI (Digital Visual Interface), a VGA (Video Graphics Array) interface, or other type of video interface.
  • UDMI High-Definition Multimedia Interface
  • DVI Digital Visual Interface
  • VGA Video Graphics Array
  • embodiments enable the wireless streaming of compressed video by a portable electronic device, from a stored video file or other source, without the need for decoding and/or displaying of the corresponding video by the portable electronic device. Accordingly, power consumption at the portable electronic device is significantly reduced.
  • the real time parsing of a video file may be performed on the portable electronic device to generate the compressed video stream to be transmitted through a wireless link from the portable electronic device.
  • the real time acquisition of the compressed video stream may be performed through software, for example, before the compressed video stream is transmitted through the wireless link.
  • embodiments are described herein as solving the video streaming problem for portable electronic devices, such embodiments may be implemented for streaming video from a set top box (STB) or other non-portable video source device to a high definition display device (e.g., an HDTV) to save power and reduce latency.
  • STB set top box
  • HDTV high definition display device
  • Decoder 304, graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and application module 1404 may be implemented in hardware, software, firmware, or any combination thereof.
  • decoder 304, graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and/or application module 1404 may be implemented as computer program modules or code configured to be executed in one or more processors.
  • decoder 304 graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and/or application module 1404 may be implemented as hardware logic/electrical circuitry.

Abstract

Methods, systems, and apparatuses are described for enabling the streaming of video data from portable electronic devices. In a portable electronic device, compressed video data is received from a compressed video data source. The received compressed video data is provided to a transmitter of the portable electronic device in a compressed video data stream without decoding the compressed video data. The compressed video data stream is wirelessly transmitted from the portable electronic device using the transmitter according to a push mode. The compressed video data stream is configured to be received at a display device to be decoded and displayed as video.

Description

LOW POWER AND LOW LATENCY PUSH MODE WIRELESS HD VIDEO
STREAMING ARCHITECTURE FOR PORTABLE DEVICES
BACKGROUND OF THE INVENTION
Field of the Invention
[0001] The present invention relates to wireless video data streaming technology.
Background Art
[0002] "Video" refers to a technology for electronically capturing, storing, and playing a sequence of still images that represent scenes in motion. Various devices exist that are capable of capturing, storing, and/or playing video. Different resolutions of video are available that provide different levels of viewing quality. High-definition video (e.g., "HD" video) refers to video of higher resolution (e.g., than standard-definition video). For example, HD video displays may have display resolutions of 1,280 by 720 pixels (720p), 1,920 by 1,080 pixels (1080i/1080p), or other resolutions. Televisions and other display devices are being manufactured with high definition resolutions in increasing numbers. As such, techniques for providing high definition video data to high definition displays are being developed, including wireless techniques.
[0003] The demand for wireless video streaming has been increasing in recent years.
Various wireless technologies have been tried for this purpose, including WiFi (according to wireless local area network (WLAN) devices) technology, UWB (ultra- wideband) technology, WiHD (WirelessHD) technology, WHDI (wireless home digital interface), etc. Meanwhile, another important trend is for consumers to capture, store and play HD video using portable electronic devices, such as laptops, smart phones, or portable media players. As such, techniques are desired for streaming HD video wirelessly from portable electronic devices to high definition displays (e.g., HD television, also known as "HDTV").
[0004] Push mode and pull mode video streaming techniques have been used to transport
HD video between portable electronic devices and HD displays. According to push mode streaming, a portable electronic device initiates and controls the transfer of the HD video to the display device. One example of push mode video streaming is the broadcast video service in cable or satellite networks. In such broadcast video services, a video stream is initiated and transferred by the video source device (e.g., a satellite or cable service). According to pull mode streaming, the HD display initiates and controls the transfer of the HD video from the portable electronic device. One example of pull mode video is an HDTV that reads a video file from a USB disk, and plays the video file in real time. Push mode video streaming tends to provide a better user experience because portable devices typically have better user interfaces than do display devices. Due to the convenience of using the user interface of a portable electronic device to control the video streaming process, push mode video streaming has become popular.
[0005] However, portable electronic devices have significant processing and power limitations. Portable electronic devices typically do not have a large amount of processing capacity, and thus processing the large amount of data contained in high definition video streams is difficult if not impossible using portable electronic devices. Furthermore, the high data throughput with low latency needed for high definition video consumes a large amount of battery power. As a result, conventional techniques for the streaming of high definition video by portable electronic devices are not practical. As such, improved techniques for enabling high definition video streaming by portable electronic device are desired.
BRIEF SUMMARY OF THE INVENTION
[0006] Methods, systems, and apparatuses are described for enabling the streaming of video data from portable electronic devices according to the push mode. In implementations, video data is streamed from portable electronic devices in compressed form, without being decoded by the portable electronic devices, enabling reduced power consumption and reduced latency. The streamed compressed video data may be received, decoded, and displayed by a display device, such as a high definition display device. Video corresponding to the streamed compressed video data that is displayed at the display device may be concurrently displayed on a display screen of the portable electronic device if desired, although the video does not have to be concurrently displayed on the display screen of the portable electronic device.
[0007] For instance, in one implementation, a method in a portable electronic device is provided, including receiving compressed video data from a compressed video data source, providing the received compressed video data to a transmitter of the portable electronic device in a compressed video data stream without decoding the compressed video data, and wirelessly transmitting the compressed video data stream from the portable electronic device using the transmitter in a push mode. The compressed video data stream is configured to be received at a display device to be decoded and displayed as video in real time.
[0008] In an implementation, the received compressed video data may be received from a video file stored in storage in the portable electronic device. The video file is parsed. The parsed video file is converted into a common transport format to generate the compressed video data stream. In another implementation, the compressed video data is received by a receiver of the portable electronic device from a real time source. According to one real time source, the compressed video data is based on image data captured by a camera in the portable electronic device captured in real time. According to another real time source, real time capture of compressed video data received from a remote source is performed to generate the compressed video data stream.
[0009] In an implementation, a portable electronic device is provided that includes a display screen, a transmitter, and a video stream generator. The video stream generator receives compressed video data from a compressed video data source, and is configured to provide the received compressed video data to the transmitter in a compressed video data stream. The transmitter is configured to wirelessly transmit the compressed video data stream from the portable electronic device in a push mode. The transmitted compressed video data stream is configured to be received at a display device to be decoded and displayed as video.
[0010] In an implementation, the portable electronic device may further include a storage device. The video stream generator receives the compressed video data from a video file stored in the storage device. The video stream generator may include a file parser configured to parse the video file to generate the compressed video data stream and a format converter configured to convert the parsed video file into a common transport format to generate the compressed video data stream. In another implementation, the portable electronic device may be received from a real time source. According to one real time source, the portable electronic device further includes a camera, and the compressed video data is based on image data captured by the camera in real time. According to another real time source, the portable electronic device further includes a receiver that receives the compressed video data from a remote source. The video stream generator includes a real time capture module configured to perform real time capture of the compressed video data received from the camera or real time source to generate the compressed video data stream.
[0011] Computer program products are also described herein that enable streaming of compressed video data from portable electronic devices, and that enable further embodiments as described herein. Devices in which embodiments may be implemented may include storage, such as storage drives, memory devices, and further types of computer-readable storage media described herein. Such computer-readable storage media may store program modules that include computer program logic for performing the systems, processes, and further embodiments described herein.
[0012] Further features and advantages of the disclosed technologies, as well as the structure and operation of various embodiments, are described in detail below with reference to the accompanying drawings. It is noted that the invention is not limited to the specific embodiments described herein. Such embodiments are presented herein for illustrative purposes only. Additional embodiments will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein.
BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES
[0013] The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate the present invention and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the pertinent art to make and use the invention.
[0014] FIG. 1 shows a block diagram of a video streaming system that includes a portable electronic device and a high definition (HD) display device, according to an example embodiment.
[0015] FIG. 2 shows a block diagram of concurrent views of a display screen of the portable electronic device of FIG. 1 and a display screen of the HD display device of FIG. 1.
[0016] FIGS. 3 and 4 show respective block diagrams of example video streaming systems.
[0017] FIG. 5 shows a block diagram of a video streaming system, according to an example embodiment.
[0018] FIG. 6 shows a flowchart for streaming video from a portable electronic device, according to an example embodiment. [0019] FIG. 7 shows a block diagram of a portable electronic device, according to an example embodiment.
[0020] FIG. 8 shows a flowchart providing a process for parsing a video file to generate a compressed video data stream, according to an example embodiment.
[0021] FIG. 9 shows a block diagram of a portable electronic device, according to an example embodiment.
[0022] FIG. 10 shows a flowchart providing a process for real time capture of video data to generate a compressed video data stream, according to an example embodiment.
[0023] FIG. 11 shows a block diagram of concurrent views of a display screen of the portable electronic device of FIG. 5 and a display screen of the HD display device of FIG.
5, according to an example embodiment.
[0024] FIG. 12 shows a block diagram of an example mobile device with video display and processing capability, according to an embodiment.
[0025] FIGS. 13 and 14 show block diagrams of portable electronic devices, according to example embodiments.
[0026] The present invention will now be described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Additionally, the left-most digit(s) of a reference number identifies the drawing in which the reference number first appears.
DETAILED DESCRIPTION OF THE INVENTION I. Introduction
[0027] The present specification discloses one or more embodiments that incorporate the features of the invention. The disclosed embodiment(s) merely exemplify the invention. The scope of the invention is not limited to the disclosed embodiment(s). The invention is defined by the claims appended hereto.
[0028] References in the specification to "one embodiment," "an embodiment," "an example embodiment," etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
[0029] Furthermore, it should be understood that spatial descriptions (e.g., "above,"
"below," "up," "left," "right," "down," "top," "bottom," "vertical," "horizontal," etc.) used herein are for purposes of illustration only, and that practical implementations of the structures described herein can be spatially arranged in any orientation or manner.
II. Example Embodiments for Streaming Video from Portable Electronic Devices
[0030] Embodiments of the present invention enable the streaming of video, such as high definition (HD) video, from portable electronic devices. A display device may receive the streamed video, and may display the streamed video on a display screen. For instance, FIG. 1 shows a block diagram of a video streaming system 100. As shown in FIG. 1, system 100 includes a portable electronic device 102 and an HD display device 104. As shown in FIG. 1, portable electronic device 102 includes an antenna 106 and a display screen 110, which displays a video 114. For example, a media player may be used to play video 114 at portable electronic device 102, as would be known to persons skilled in the relevant art(s). Display screen 110 may be any type of display screen, including an LCD display screen, an LED display screen, etc. Display screen 110 displays video 114 to a user of portable electronic device 102. For example, video 114 may be generated from a video file stored in storage of portable electronic device 102, from video information received from external to portable electronic device 102, or other source. Portable electronic device 102 generates a video data stream 116 transmitted from antenna 106 to stream video 114 from portable electronic device 102 to HD display device 104. As shown in FIG. 1, HD display device 104 includes an antenna 108 and a display screen 112. Antenna 108 of HD display device 104 receives video data stream 116, and HD display device 104 displays video 114 on display screen 112 based on video data stream 112.
[0031] For example, FIG. 2 shows a block diagram of a concurrent view of display screen
110 of portable electronic device 102 and display screen 112 of HD display device 104. As shown in FIG. 2, display screen 110 displays video 114 imposed on background graphics 202. Background graphics 202 may be visible on display screen 110 when video 114 is displayed in less than full screen, and may include one or more of a background color and/or pattern, one or more icons, one or more other applications being used (e.g., an Internet browser viewing a web page, a document open in a word processor, an email tool, etc.), etc. Portable electronic device 102 is configured to generate video data stream 116 to include all content that is displayed by display screen 110, to replicate the contents of display screen 110 on another display screen. As such, as shown in FIG. 2, display screen 112 of HD display device 104 displays video 114 imposed on background graphics 202 in a similar manner as display screen 110 of portable electronic device 102.
[0032] Different conventional techniques exist for performing push mode streaming of wireless video from portable electronic devices as shown in FIGS. 1 and 2. However, such techniques have difficulties in meeting the stringent low power and low latency requirements for video streaming. Examples of such techniques are described as follows with respect to FIGS. 3 and 4.
[0033] For instance, FIG. 3 shows a block diagram of a video streaming system 300.
System 300 is an example of system 100 of FIG. 1. As shown in FIG. 3, system 300 includes a portable electronic device 350 and an HD display device 360. Portable electronic device 350 includes a decoder 304, a graphics processing module 308, a full screen graphics processing module 310, a transmitter 312, a battery 326, antenna 106, and display screen 110. HD display device 360 includes a receiver 314, a display driver 316, antenna 108, and display screen 112. These elements of FIG. 3 are described as follows.
[0034] With regard to portable electronic device 350, decoder 304 receives compressed video data 302. Compressed video data 302 is compressed video data for generating video 114, such as may be received external from portable electronic device 350 or stored in a video file in portable electronic device 350. Decoder 304 is configured to decode compressed video data 302 to generate decoded video data 318. For instance, decoder 304 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350. Graphics processing module 308 receives background graphics data 306. Background graphics data 306 includes graphics data corresponding to one or more graphical (e.g., text, image, video, etc.) features of background graphics 202 (FIG. 2). Graphics processing module 308 is configured to perform graphics processing on background graphics data 306 to generate processed background graphics data 306. For instance, graphics processing module 308 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350. Full screen graphics processing module 310 receives decoded video data 318 and processed background graphics data 306. Full screen graphics processing module 310 is configured to combine and perform full screen level processing (e.g., scaling, etc.) on decoded video data 318 and processed background graphics data 306 to generate combined decoded video data 322. For example, full screen graphics processing module 310 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350. Transmitter 312 receives and wirelessly transmits combined decoded video data 322 via antenna 106 as raw video data stream 324. Furthermore, display screen 110 of portable electronic device 350 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
[0035] As shown in FIG. 3, receiver 314 of HD display device 360 receives raw video data stream 324 via antenna 108, and outputs combined decoded video data 322. HD display device 360 may optionally include display driver 316 to configure combined decoded video data 322 for display screen 112 (although not shown herein, portable electronic devices described herein may optionally include a display driver to format video data for display). Display driver 316 generates video driver output data 328, which is received by display screen 112. Display screen 112 generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
[0036] Thus, according to system 300 of FIG. 3, raw video data stream 324 is streamed wirelessly from portable electronic device 350. Raw video data stream 324 includes uncompressed video data corresponding to the contents of the full screen of portable electronic device 350. The data rate of the full screen raw video transmitted from transmitter 312 is orders of magnitudes higher than that of a compressed video file that may be streamed, such as a file having the compressed video format of MPEG-2 (moving picture experts group), H.264, or other video file standard. For example, transmitter 312 may transmit combined decoded video data 322 at a rate of more than 1 Gbps (e.g., for raw HD video data at 1080P), while an MPEG-2 video stream is typically about 20 Mbps. Consequently, although the latency of the technique of FIG. 3 may be acceptable (there is little delay introduced due to no encoding performed in portable electronic device 350 and no decoding performed in display device 360), the power consumption by portable electronic device 350 due to the wireless transmission of raw HD video is prohibitive, regardless of the wireless technology used.
[0037] FIG. 4 shows a block diagram of a video streaming system 400 that is another example of system 100 of FIG. 1. System 400 of FIG. 4 is similar to system 300 of FIG. 3, except that additional encoding and decoding processes are performed. As shown in FIG. 4, system 400 includes a portable electronic device 420 and an HD display device 430. Portable electronic device 420 includes decoder 304, graphics processing module 308, full screen graphics processing module 310, transmitter 312, battery 326, antenna 106, display screen 110, and an encoder 402. HD display device 430 includes receiver 314, display driver 316, antenna 108, display screen 112, and a decoder 404. These elements of FIG. 4 are described as follows.
[0038] Decoder 304, graphics processing module 308, and full screen graphics processing module 310 operate similarly as described above with respect to FIG. 3 to generate combined decoded video data 322 from compressed video data 302 and background graphics data 306. Encoder 402 receives and encodes combined decoded video data 322 to generate encoded combined video data 406. For instance, encoder 402 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or graphics processor) of portable electronic device 420. Transmitter 312 receives and wirelessly transmits encoded combined video data 406 via antenna 106 as compressed video data stream 408. Furthermore, display screen 110 of portable electronic device 420 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
[0039] As shown in FIG. 4, receiver 314 of HD display device 430 receives compressed video data stream 408 via antenna 108, and outputs encoded combined video data 406. Decoder 404 receives and decodes encoded combined video data 406 to generate combined decoded video data 322. HD display device 360 may include display driver 316 to format decoded video data 322 for display screen 112. Display driver 316 generates video driver output data 328, which is received by display screen 112. Display screen 112 generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
[0040] Thus, according to system 400 of FIG. 4, compressed video data stream 408 is streamed wirelessly from portable electronic device 420. Due to the encoding by encoder 402, compressed video data stream 408 includes compressed video data corresponding to the full screen of portable electronic device 420, and thus may be transmitted at a lower data rate than raw video data stream 324 of FIG. 3. To achieve this, however, encoder 402 must be present in portable electronic device 420 and decoder 404 must be present in HD display device 430, in the datapath for the video data. Encoder 402 dissipates significant power, making it less attractive for portable devices having stringent power budgets. Furthermore, the datapath for video data through portable electronic device 402 and HD display device 430 includes the extra encoding and decoding functions of encoder 402 and decoder 404, introducing significant latency. As such, the techniques of FIGS. 3 and 4 have significant disadvantages.
[0041] Embodiments of the present invention provide significant power and latency advantages over existing techniques, and are more suitable for push mode portable video streaming applications. For example, FIG. 5 shows a block diagram of a video streaming system 500, according to an example embodiment. System 500 is an example embodiment of system 100 of FIG. 1. As shown in FIG. 5, system 300 includes a portable electronic device 502 and an HD display device 520. Portable electronic device 502 includes a video stream generator 504, transmitter 312, antenna 106, and battery 326. HD display device 520 includes receiver 314, display driver 316, antenna 108, display screen 112, and decoder 404. In system 500, portable electronic device 502 is a video source device enabled to stream HD video with relatively low power dissipation and low latency according to the push mode. HD display device 520 is an example video sink device configured to display the compressed video streamed by portable electronic device 502. System 500 is described as follows with respect to FIG. 6. FIG. 6 shows a flowchart 600 for streaming video from a portable electronic device, according to an example embodiment. In an embodiment, portable electronic device 502 of FIG. 5 may operate according to flowchart 600. Further structural and operational embodiments will be apparent to persons skilled in the relevant art(s) based on the following description of flowchart 600 and system 500.
[0042] Flowchart 600 begins with step 602. In step 602, compressed video data is received from a compressed video data source. For example, as shown in FIG. 5, video stream generator 504 receives compressed video data 302. As further described elsewhere herein, compressed video data 302 may be received from various sources, such as from storage located in or associated with portable electronic device 502, or from a real time source such as a video camera included in portable electronic device 502 (e.g., mounted to a housing of portable electronic device 502, attached to portable electronic device 502, etc.) or a remote source (e.g., that streams compressed video data 302 to portable electronic device 502 in a wired and/or wireless manner) such as the Internet, or a wireless network of a wireless operator. Received compressed video data 302 may be formatted according to one or more different video compression formats.
[0043] In step 604, the received compressed video data is provided in a compressed video data stream to a transmitter of the portable electronic device without decoding the compressed video data. For example, as shown in FIG. 5, video stream generator 504 is in a datapath between a source of compressed video data 302 and transmitter 312. Video stream generator 304 receives compressed video data 302 and generates a compressed video data stream 506. Compressed video data stream 506 includes compressed video data 302 converted into the form of a video data stream. For example, video stream generator 504 may receive compressed video data 302 in any of a number of different compressed video data formats, converting the different video compressions into a common format to generate compressed video data stream 506,. Compressed video data stream 506 is received by transmitter 312.
[0044] Decoding of compressed video data 302 is not performed by video stream generator 504 to generate compressed video data stream 506. As such, portable electronic device 502 does not need to be configured for such decoding, and therefore does not require electronic circuitry for performing decoding and/or does not need to store decoding-related computer code. Battery 326 is present to provide power for electrical components of portable electronic device 502 (e.g., video stream generator 504, transmitter 312, etc.), to enable portability for device 502. A battery life of battery 326 may be extended due to not having to performing decoding, and potentially encoding, of video data at high rates. Still further, portable electronic device 502 is enabled to have low latency because decoding, and potentially encoding, of video data is not performed therein. As such, corresponding delays are not introduced into the video data stream.
[0045] Video stream generator 504 may be configured in various ways to generate compressed video data stream 506. For example, in one embodiment, video stream generator 504 may be a video file parser configured to receive a parse a video file. For instance, FIG. 7 shows a block diagram of a portable electronic device 702, according to an example embodiment. Portable electronic device 702 is an example of portable electronic device 502 of FIG. 5. In the example of FIG. 7, portable electronic device 702 includes storage 704, a video file parser 706, a format converter 712, battery 326, and transmitter 312. Video file parser 706 is an example of video stream generator 504 of FIG. 5. Video file parser 706 is configured to parse a video file 710 stored in storage 704 by retrieving and outputting a segment 708 of video file 710. Video file 710 may have any suitable form. For example, video file 710 may be coded according any of video compression standards shown in Table 1 below, or other video compression standard. Table 1 indicates video compression standards for video file 710 and corresponding examples of storage media of storage 704 in which video file 710 may be stored:
Table 1 Video compression standard Example storage implementations
MPEG-1 Part 2 Video-CD (compact disc)
H.262/MPEG-2 Part 2 DVD (digital video disc) Video , Blu-Ray,
Digital Video Broadcasting, SVCD (Super Video CD)
H.264/MPEG-4 AVC (advanced video Blu-Ray , Digital Video Broadcasting, iPod coding) Video , HD DVD
Segment 708 may include any portion of video file 710, including a portion of a video frame, a single video frame, multiple video frames, or any other portion of video file 710. Video file parser 706 sequentially retrieves segments 708 of video file 710 in storage 704. Format converter 712 is configured to convert each segment 708 into a common transport format (e.g., in packetized form) to generate compressed video data stream 506. For example, format converter 712 may be configured to convert segments 708 from a video compression format, such as any video compression format shown in Table 1, into a common transport format, such as a transport format described below with respect to step 606 of flowchart 600 (FIG. 6) or other transport format. Configurations for format converter 712 will be known to persons skilled in the relevant art(s) based on the teachings herein.
[0046] For example, portable electronic device 702 may operate according to a flowchart
800 shown in FIG. 8, in an embodiment. Flowchart 800 provides a process for parsing a video file to generate a compressed video data stream, according to an example embodiment. Flowchart 800 begins with step 802. In step 802, compressed video data is stored in storage in the portable electronic device. For instance, as shown in FIG. 7, video file 710 is stored in storage 704 of portable electronic device 702. In step 804 of flowchart 800, the compressed video data of the video file is parsed to generate the compressed video data stream. As described above, video file parser 706 may parse video file 710 to generate compressed video data stream 506.
[0047] In another embodiment, video stream generator 504 may be configured to perform real time video capture of compressed video data transmitted to portable electronic device 502 in real time. For instance, FIG. 9 shows a block diagram of a portable electronic device 902, according to an example embodiment. Portable electronic device 902 is an example of portable electronic device 502 of FIG. 5. In the example of FIG. 9, portable electronic device 902 includes a receiver 904, a real time capture module 906, an antenna 908, battery 326, and transmitter 312. Real time capture module 906 is an example of video stream generator 504 of FIG. 5. Real time capture module 906 is configured to capture video data in real time that is transmitted to portable electronic device 902 by a remote source 910. For example, as shown in FIG. 9, remote source 910 wirelessly transmits a compressed video data stream 912 to portable electronic device 902. Receiver 904 receives compressed video data stream 912 via antenna 908, an outputs compressed video data 302. Real time capture module 906 is configured to receive and convert compressed video data 302 into compressed video data stream 506 in real time (e.g., with little to no buffering of video data).
[0048] Compressed video data stream 912 may have any suitable form, and as such, real time capture module 906 may be configured to convert the received form of compressed video data stream 912 (as compressed video data 302) into compressed video data stream 506 having a predetermined format in real time, as described further below. For example, compressed video data stream 912 may be coded according any of the video compression standards shown in Table 2 below, or according to other video compression standard. Table 2 indicates video compression standards for compressed video data stream 912 and corresponding examples of remote source applications for which compressed video data stream 912 may be received:
Table 2
Figure imgf000014_0001
[0049] For example, portable electronic device 902 may operate according to a flowchart
1000 shown in FIG. 10, in an embodiment. Flowchart 1000 provides a process for real time capture of video data to generate a compressed video data stream, according to an example embodiment. Flowchart 1000 begins with step 1002. In step 1002, the compressed video data is received using a receiver of the portable electronic device from a remote source. For instance, as shown in FIG. 9, receiver 904 of portable electronic device 902 may receive compressed video data stream 912 (via antenna 908) from remote source 910, outputting compressed video data 302.
[0050] In step 1004 of flowchart 1000, real time capture of the compressed video data received from the remote source is performed to generate the compressed video data stream. As described above, real time capture module 906 is configured to receive and convert compressed video data 302 in real time into compressed video data stream 506. Configurations for real time capture module 906 will be known to persons skilled in the relevant art(s) based on the teachings herein (e.g., real time capture module 906 may include a format converter similar to format converter 712 of FIG. 7).
[0051] Note that the examples of video stream generator 504 described above with respect to FIGS. 7-10 are provided for purposes of illustration. Video stream generator 504 may be configured in further ways to generate compressed video data stream 506, as would be known to persons skilled in the relevant art(s) based on the teachings herein.
[0052] For example, in an embodiment, portable electronic device 502 of FIG. 5 may include a camera (e.g., an image sensing device, such as a charge coupled device (CCD) camera). The camera may capture video images, and may output a stream of the video images in compressed form, to generate compressed video data 302. Portable electronic device 502 may include real time capture module 906 of FIG. 9, configured to receive and convert compressed video data 302 in real time into compressed video data stream 506.
[0053] Referring back to FIG. 6, in step 606, the compressed video data stream is wirelessly transmitted from the portable electronic device using the transmitter in a push mode. For example, as shown in FIG. 5, transmitter 312 receives compressed video data stream 506. Transmitter 312 wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508. Portable electronic device 502 streams compressed video data stream 508 according to a push mode, where portable electronic device 502 initiates and controls streaming of compressed video data. Portable electronic device 502 does not stream compressed video data under the control of a display device, which would be streaming according to the pull mode. Compressed video data stream 508 may be received by one or more display devices.
[0054] For example, in an embodiment, transmitted compressed video data stream 508 may be generated by video stream generator 504 and transmitted by transmitter 312 in any video data stream form, proprietary or commercially available. For instance, in one embodiment, transmitted compressed video data stream 508 may be generated in elementary stream (ES) format, defined by an MPEG communication protocol. An elementary stream is often referred to as "elementary", "data", "audio", or "video" bitstreams or streams. The format of the elementary stream depends upon the codec or data carried in the stream, but will often carry a common header when packetized into a packetized elementary stream. Packetized elementary stream (PES) is a specification in the MPEG-2 Part 1 (Systems) (ISO/IEC 13818-1) and ITU-T H.222.0 that defines carrying of elementary streams in packets within an MPEG program stream and MPEG transport stream. The elementary stream is packetized by encapsulating sequential data bytes from the elementary stream inside PES packet headers. In another embodiment, transmitted compressed video data stream 508 may be generated in transport stream (TS) format, a standard format for transmission and storage of audio, video, and data. Transport stream format is used in broadcast systems such as DVB (digital video broadcasting) and ATSC (Advanced Television Systems Committee). Transport stream specifies a container format encapsulating packetized elementary streams, with error correction and stream synchronization features for maintaining transmission integrity when the signal is degraded. In further embodiments, transmitted compressed video data stream 508 may be generated according to other video data stream format.
[0055] Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data. For example, as shown in FIG. 5, HD display device 520 may receive transmitted compressed video data stream 508. Receiver 314 of HD display device 520 receives transmitted compressed video data stream 508 via antenna 108, and outputs compressed video data stream 510. Decoder 404 receives and decodes compressed video data stream 506 to generate decoded video data stream 512. HD display device 520 may optionally include display driver 316 to configure decoded video data stream 512 for display screen 112. Display driver 316 generates video driver output data 514, which is received by display screen 112. Display screen 112 generates a display of a video corresponding to compressed video data 302.
[0056] In the configurations of FIGS. 3 and 4, video data corresponding to the background (background graphics data 306) and video (compressed video data 302) displayed on display screen 110 of portable electronic devices 350 and 420 is included in raw video data stream 324 and compressed video data stream 408, respectively. As such, as shown in FIG. 2, background graphics 202 and video 114 are displayed by display screens 112 of HD display devices 360 and 430 in both cases. In the embodiment of FIG. 5, compressed video data 302 is included in transmitted compressed video data stream 508, but background graphics data 306 is not included. As such, in the example of FIG. 5, even though a display screen of portable electronic device 502 may display background graphics and video 114, display screen of HD display device 520 displays video 114 but not background graphics. [0057] For example, FIG. 11 shows a block diagram of concurrent views of display screen 110 of portable electronic device 502 and display screen 112 of FID display device 520, according to an example embodiment. As shown in FIG. 11, display screen 110 displays video 114 and background graphics 202. For instance, an application image 1102 may be displayed with background graphics 202 on display screen 110. Application image 1102 may be an image associated with any application that may be executed on portable electronic device 502, such as an email tool, a web browser, a video game, a word processor, etc. Portable electronic device 502 is configured to generate transmitted compressed video data stream 508 to include video data associated with video 114 displayed by display screen 110, but not image data associated with other content displayed by display screen 110, such as background graphics 202, application image 1102, etc. As such, as shown in FIG. 11, display screen 112 of HD display device 520 displays video 114, but not the remainder of display screen 110 of portable electronic device 502. For example, display screen 112 may display video 114 in full screen, depending on the configuration of display screen 1 12.
[0058] As such, a user of portable electronic device 502 may interact with an application that generates application image 1102, without application image 1102 being displayed by display screen 112 of HD display device 520. Furthermore, portable electronic device 502 may not even display video 114 on display screen 110 while video 114 is being streamed and displayed by display screen 112 of display device 520. For example, a user of portable electronic device 502 may invoke the streaming of video 114 to display device 520, and then may reduce or iconify a media player tool displaying video 114 at portable electronic device 502 so that video 114 is not displayed on display screen 110 while it is being streamed to display device 520
[0059] Thus, according to the embodiment of FIG. 5, a push mode wireless HD video streaming technique is provided that consumes less power and has less latency that conventional techniques. In the embodiment of FIG. 5, compressed video data is streamed across a wireless link between a portable electronic device and a display device, and encoding and decoding functions are not present in the video streaming datapath in the portable electronic device. As such, portable electronic device 502 does not require a central processing unit (CPU), graphics processing unit (GPU), and/or other logic to perform the decoding and encoding. Video decoding is performed once, at the display device, which is less sensitive to power usage. In comparison, in the configuration of FIG. 3, decoding is performed in portable electronic device 350, and raw video data is wirelessly streamed, requiring additional processing and consuming more power in portable electronic device 350. In the configuration of FIG. 4, encoding and decoding is performed in portable electronic device 420, requiring additional processing in portable electronic device 350, consuming more power, and causing greater latency. As such, power consumption at portable electronic device 502 is significantly lower than in the techniques of FIGS. 3 and 4 described above, with latency lower than the technique of FIG. 4.
III. Example Portable Electronic Device and Display Device Embodiments
[0060] Embodiments of the present invention relate to the streaming of video data using portable electronic devices to display devices. For example, HD display device 520 may be any type of high definition display device, including an LCD (liquid crystal display) display or monitor, a plasma display or monitor, an LED (light emitting diode) display or monitor, an HD projector, or further type of display device. Portable electronic device 502 may be any type of mobile or portable electronic device, including a smart phone, a handheld computing device (e.g., a personal digital assistant (PDA), a BLACKBERRY device, a PALM device, etc.), a laptop computer, a tablet computer (e.g., an APPLE IP AD), or further type of mobile device. Embodiments include portable electronic devices having limited resources.
[0061] Such portable electronic devices may include a camera used to capture images, such as still images and video images that are streamed from the portable electronic device in compressed form. Portable electronic devices may include storage that stores compressed video data. Alternatively or additionally, portable electronic devices may receive video data from external sources, such as from a cable television provider, a satellite television provider, an Internet, a wireless network of a wireless operator, or other network-based web site, or other remote source.
[0062] FIG. 12 shows a block diagram of an example portable electronic device 1200 with video capture and processing capability. Portable electronic device 1200 is an example of portable electronic device 502 of FIG. 5. Portable electronic device 1200 may be any portable electronic device described herein or otherwise known. The implementation of portable electronic device 1200 shown in FIG. 12 is provided for purposes of illustration, and is not intended to be limiting. Embodiments of the present invention are intended to cover portable electronic devices having additional and/or alternative features to those shown for portable electronic device 1200 in FIG. 12. [0063] As shown in FIG. 12, portable electronic device 1200 includes a speaker 1202, an audio codec 1204, a central processing unit (CPU) 1206, a radio frequency (RF) transceiver 1208, an antenna 1210, a display screen 1212, battery 326, a storage 1214, a user interface 1216, a camera 1218, and a user interface 1220. These components of device 1200 are typically mounted to or contained in a housing. The housing may further contain a circuit board mounting integrated circuit chips and/or other electrical devices corresponding to these components. Each of these components of portable electronic device 1200 is described as follows.
[0064] Battery 326 provides power to the components of portable electronic device 1200 that require power. Battery 326 may be any type of battery, including one or more rechargeable and/or non-rechargeable batteries.
[0065] User interface 1216 is a user interface device that enables a user of portable electronic device 1200 to enter data, commands, and/or to otherwise interact with portable electronic device 1200. For example, a user may interact with user interface 1216 to select video content (e.g., from storage, a camera, or a remote source) for streaming. User interface 1216 may include one or more user interface elements, such as a keyboard/keypad, a touch pad, a roller ball, a stick, a click wheel, and/or voice recognition technology. In an embodiment, user interface 1216 may include a graphical user interface (GUI) that is displayed by display screen 1212.
[0066] CPU 1206 is shown in FIG. 12 as coupled to each of audio codec 1204, RF transceiver 1208, display screen 1212, storage 1214, and user interface 1216. CPU 1206 may be individually connected to these components, or one or more of these components may be connected to CPU 1206 in a common bus structure. In an embodiment, video stream generator 504 (e.g., video file parser 706, format converter 712, and/or real time capture module 906) may be implemented in computer code executed by CPU 1206. In an embodiment, CPU 1206 may include a digital signal processor (DSP). When present, the DSP may apply special effects to the received video data. CPU 1206 may store and/or buffer video and/or audio data in storage 1214. Storage 1214 may include any suitable type of storage in the form of one or more storage devices, including one or more primary or main memory devices (e.g., random access memory (RAM)), one or more secondary storage devices 1410 (e.g., a hard disk drive, a removable storage device or drive, a memory card, a memory stick, a floppy disk drive, a magnetic tape drive, a compact disc (CD) drive for CDs, a digital video disc (DVD) drive for DVDs, an optical storage device), and/or other types of storage. Storage 1214 is an example of storage 704 described above with respect to FIG.7.
[0067] In an embodiment, CPU 1206 may stream the video data to RF transceiver 1208, to be transmitted from portable electronic device 1200. RF transceiver 1208 may be configured to enable wireless communications for mobile device 116. For example, RF transceiver 1208 may enable telephone calls, such as telephone calls according to a cellular protocol. RF transceiver 1208 may include a frequency up-converter (transmitter) (e.g., transmitter 312) and down-converter (receiver) (e.g., receiver 904). For example, RF transceiver 1208 may transmit RF signals to antenna 1210 containing audio information corresponding to voice of a user of portable electronic device 1200. In another example, RF transceiver 1208 may enable a wireless local area network (WLAN) link (including an IEEE 802.11 WLAN standard link), and/or other type of wireless communication link.
[0068] RF transceiver 1208 may receive RF signals from antenna 1210 corresponding to audio and/or video data received from another device in communication with portable electronic device 1200. RF transceiver 1208 provides the received audio and/or video data to CPU 1206. For example, RF transceiver 1208 may be configured to receive video telephony and/or HD television signals for portable electronic device 1200, to be displayed by display screen 1212, and to be processed by CPU 1206 prior to streaming from portable electronic device 1200.
[0069] Speaker 1202 and audio codec 1204 may be present in some applications of portable electronic device 1200, such as mobile phone applications and video applications. CPU 1206 provides audio data from storage 1214 or received by RF transceiver 1208 to audio codec 1204. Audio codec 1204 performs bit stream decoding of the received audio data (if needed) and converts the decoded data to an analog signal. Speaker 1202 receives the analog signal, and outputs corresponding sound.
[0070] Camera 1218 and video codec 1220 may be present in some applications of portable electronic device 1200, such as mobile phone applications and video applications. Camera 1218 may be any type of video camera, including a CCD camera, etc. Camera 1218 captures a stream of images, and outputs video data. Video codec 1220 may be present to encode the video data output by camera 1218, to generate compressed video data. CPU 1206 may receive the compressed video data from video codec 1220. CPU 1206 may process the compressed video data in a real time manner to generate a video data stream that is streamed from portable electronic device 1200, as described above. [0071] Audio codec 1204, video codec 1218, and CPU 1206 may be implemented in hardware, software, firmware, and/or any combination thereof. For example, CPU 1206 may be implemented as a proprietary or commercially available processor, such as an ARM (advanced RISC machine) core configuration, that executes code to perform its functions. Portable electronic device 1200 may include a separate graphics processor to process video data, and/or video data may be processed by CPU 1206. Audio codec 1204 may be configured to process (e.g., decode, decompress, etc.) proprietary and/or industry standard audio protocols. Video codec 1220 may be configured to process (e.g., encode, compress, etc.) proprietary and/or industry standard video protocols.
[0072] Display screen 1212 receives image/video data from CPU 1206, and display images, including video based on video data stored in storage 1214, video data received from camera 1218 (and video codec 1220) and/or received by RF transceiver 1208. Display screen 1212 may include any type of display mechanism, including an LCD (liquid crystal display) panel, LED (light emitting diode), or other display mechanism.
[0073] As described above, in embodiments, portable electronic device 502 of FIG. 5 may be capable of displaying video that is streamed to HD display device 530. For instance, FIG. 13 shows a block diagram of a portable electronic device 1302, according to an example embodiment. Portable electronic device 1302 is an example embodiment of portable electronic device 502 of FIG. 5. As shown in FIG. 13, portable electronic device 1302 includes video stream generator 504, transmitter 312, antenna 106, battery 326, decoder 304, graphics processing module 308, full screen graphics processing module 310, and display screen 110. Portable electronic device 1302 is configured to stream compressed video data to display devices (e.g., HD display device 530) in a similar manner as portable electronic device 502 of FIG. 5, as described above. Furthermore, portable electronic device 1302 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above.
[0074] For example, as shown in FIG. 13, video stream generator 504 receives compressed video data 302. Video stream generator 504 is in a datapath between a source of compressed video data 302 and transmitter 312. Video stream generator 304 generates a compressed video data stream 506. Transmitter 312 receives compressed video data stream 506. Transmitter 312 wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508. Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data, such as HD display device 520 of FIG. 5. Display screen 112 of HD display device 520 generates a display of video 114 (e.g., as shown in FIG. 11).
[0075] Furthermore, decoder 304 receives compressed video data 302. Decoder 304 is configured to decode compressed video data 302 to generate decoded video data 318. Graphics processing module 308 receives background graphics data 306. Graphics processing module 308 is configured to perform graphics processing on background graphics data 306 to generate processed background graphics data 306. Full screen graphics processing module 310 receives decoded video data 318 and processed background graphics data 306. Full screen graphics processing module 310 is configured to combine and perform full screen level processing on decoded video data 318 and processed background graphics data 306 to generate combined decoded video data 322. Display screen 110 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202 (e.g., as shown in FIG. 11).
[0076] Furthermore, as described above, in embodiments, portable electronic device 502 of FIG. 5 may be capable of performing communications in addition to streaming video, including cell phone communications, computer network communications, etc. For instance, FIG. 14 shows a block diagram of a portable electronic device 1402, according to an example embodiment. Portable electronic device 1402 is an example embodiment of portable electronic device 502 of FIG. 5. As shown in FIG. 14, portable electronic device 1402 includes video stream generator 504, transmitter 312, first antenna 106, battery 326, decoder 304, graphics processing module 308, full screen graphics processing module 310, display screen 110, an application module 1404, a transceiver 1406, and a second antenna 1408. Portable electronic device 1402 is configured to stream compressed video data to display devices (e.g., HD display device 530) in a similar manner as portable electronic device 502 of FIG. 5, as described above. Furthermore, portable electronic device 1402 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above. Still further, portable electronic device 1402 is configured to perform additional communications.
[0077] For example, similarly to portable electronic device 1302 of FIG. 13, as shown in
FIG. 14, video stream generator 504 receives compressed video data 302 and generates a compressed video data stream 506. Transmitter 312 receives compressed video data stream 506 and wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508. Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data, such as HD display device 520 of FIG. 5. Display screen 112 of HD display device 520 generates a display of video 114 (e.g., as shown in FIG. 11).
[0078] Furthermore, as shown in FIG. 14, decoder 304 receives compressed video data
302, and is configured to decode compressed video data 302 to generate decoded video data 318. Graphics processing module 308 receives background graphics data 306, and is configured to perform graphics processing on background graphics data 306 to generate processed background graphics data 306. Full screen graphics processing module 310 receives decoded video data 318 and processed background graphics data 306 and is configured to combine and perform full screen level processing on decoded video data 318 and processed background graphics data 306 to generate combined decoded video data 322. Display screen 110 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202 (e.g., as shown in FIG. 11).
[0079] Still further, application module 1404 executes in portable electronic device 1402.
For example, application module 1404 may be implemented as computer code (e.g., executed by a CPU) and/or electronic circuitry. In an embodiment, application module 1404 may be a cell phone module that enables cell phone functionality for portable electronic device 1402. Examples of cell phone modules present in portable electronic devices will be known to persons skilled in the relevant art(s). In another embodiment, application module 1404 may be a network communication module that enables network communication functionality for portable electronic device 1402. For example, application module 1404 may include web browser functionality for enabling users to interact with a web browser to navigate a network, such as the Internet. In further embodiments, application module 1404 may provide alternative functionality, such as an email application, etc. As shown in FIG. 14, application module 1404 is coupled with transceiver 1406 by a communication link 1412. Application module 1404 communicates with transceiver 1406 over communication link 1412 to transmit and/or receive communication signals 1414 to and from portable electronic device 1402, to communicate with a remote entity. For example, transceiver 1406 may be a cell phone transceiver, a network transceiver (e.g., a wireless local area network (WLAN) transceiver, such as an IEEE 802.11 WLAN standard compliant transceiver), and/or other type of wireless communication transceiver, and communication signals 1414 may be cell phone communication signals, network communication signals, etc.
[0080] As such, portable electronic device 1400 is enabled to stream compressed video data to a display device while simultaneously enabling a user of portable electronic device 1400 to perform other communications with remote entities (e.g., to conduct a phone call, to browse the Internet, etc.). In the embodiment of FIG. 14, transmitter 312 and antenna 106 are used to stream video from portable electronic device 1402, and transceiver 1406 and antenna 1408 are used to perform other communications. In another embodiment, portable electronic device 1402 may include one antenna and/or one transceiver that is/are used to stream video and to perform other communications. For example, time slicing techniques may be used to stream video and perform further communications using a single transceiver and/or single antenna. For example, referring to FIG. 14, transceiver 1406 and/or antenna 1408 may be used to transmit transmitted compressed video data stream 508 and communication signals 1414.
[0081] Note that in the example embodiments provided herein (e.g., FIG. 5), decoder 404 is shown as included in display device 520. In another embodiment, decoder 404 may be located external to display device 520. For instance, antenna 108, receiver 314, and decoder 404 may be included in an external device, such as a dongle, having a connector that plugs into a connector of display device 520. The external device may interface with display device 520 according to an UDMI (High-Definition Multimedia Interface), a DVI (Digital Visual Interface), a VGA (Video Graphics Array) interface, or other type of video interface. In this manner, display device 520 need not include a decoder, or a decoder of display device 520 may be bypassed by the decoder of the external device.
[0082] As such, embodiments enable the wireless streaming of compressed video by a portable electronic device, from a stored video file or other source, without the need for decoding and/or displaying of the corresponding video by the portable electronic device. Accordingly, power consumption at the portable electronic device is significantly reduced. In embodiments, the real time parsing of a video file may be performed on the portable electronic device to generate the compressed video stream to be transmitted through a wireless link from the portable electronic device. In the case of video delivered to the portable electronic device in real time from a camera of the portable electronic device or a remote source (e.g., from an entity on the Internet, a wireless operator, etc.), the real time acquisition of the compressed video stream may be performed through software, for example, before the compressed video stream is transmitted through the wireless link. Furthermore, even though embodiments are described herein as solving the video streaming problem for portable electronic devices, such embodiments may be implemented for streaming video from a set top box (STB) or other non-portable video source device to a high definition display device (e.g., an HDTV) to save power and reduce latency.
[0083] Decoder 304, graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and application module 1404 may be implemented in hardware, software, firmware, or any combination thereof. For example, decoder 304, graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and/or application module 1404 may be implemented as computer program modules or code configured to be executed in one or more processors. Alternatively, decoder 304, graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and/or application module 1404 may be implemented as hardware logic/electrical circuitry.
Conclusion
[0084] While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be apparent to persons skilled in the relevant art that various changes in form and detail can be made therein without departing from the spirit and scope of the invention. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.

Claims

WHAT IS CLAIMED IS:
1. A method in a portable electronic device, comprising:
receiving compressed video data from a compressed video data source;
providing the received compressed video data to a transmitter of the portable electronic device in a compressed video data stream without decoding the compressed video data; and
wirelessly transmitting the compressed video data stream from the portable electronic device using the transmitter according to a push mode;
wherein the compressed video data stream is configured to be received at a display device to be decoded and displayed as video.
2. The method of claim 1, wherein said receiving comprises:
receiving the compressed video data from a video file stored in storage in the portable electronic device.
3. The method of claim 2, wherein said providing comprises:
parsing the video file; and
converting the parsed video file into a common transport format to generate the compressed video data stream.
4. The method of claim 1, wherein said receiving comprises:
receiving the compressed video data using a receiver of the portable electronic device from a remote source.
5. The method of claim 4, wherein said providing comprises:
performing real time capture of the compressed video data received from the remote source to generate the compressed video data stream.
6. The method of claim 1, wherein said receiving comprises:
receiving the compressed video data from image data captured by a camera in the portable electronic device.
7. The method of claim 1, further comprising: enabling a user to interact with the portable electronic device to cause display of an application on a display screen of the portable electronic device, wherein image data for the application is not included in the compressed video data wirelessly transmitted from the portable electronic device .
8. The method of claim 1, wherein the video displayed at the display device based on the compressed video data stream is not concurrently displayed on a display screen of the portable electronic device.
9. The method of claim 1, wherein the video displayed at the display device based on the compressed video data stream is concurrently displayed on a display screen of the portable electronic device, the video displayed at the display device being displayed in full screen, and the video concurrently displayed on the display screen of the portable electronic device being displayed on background graphics or being displayed in full screen.
10. The method of claim 1, further comprising:
wirelessly receiving a second communication signal concurrently with said transmitting.
11. A portable electronic device, comprising:
a display screen;
a transmitter; and
a video stream generator that receives compressed video data from a compressed video data source, and is configured to provide the received compressed video data to the transmitter in a compressed video data stream;
wherein the transmitter is configured to wirelessly transmit the compressed video data stream from the portable electronic device according to a push mode; and
wherein the transmitted compressed video data stream is configured to be received at a display device to be decoded and displayed as video.
12. The portable electronic device of claim 11, further comprising:
a storage device, wherein the video stream generator receives the compressed video data from a video file stored in the storage device.
13. The portable electronic device of claim 12, wherein the video stream generator comprises:
a file parser configured to parse the video file; and
a format converter configured to convert the parsed video file into a common transport format to generate the compressed video data stream.
14. The portable electronic device of claim 11, further comprising:
a receiver that receives the compressed video data from a remote source.
15. The portable electronic device of claim 14, wherein the video stream generator includes a real time capture module configured to perform real time capture of the compressed video data received from the remote source to generate the compressed video data stream.
16. The portable electronic device of claim 11, further comprising:
a camera configured to capture a stream of images, wherein the compressed video data is generated from the captured stream of images.
17. The portable electronic device of claim 11, further comprising:
a user interface configured to enable a user to interact with the portable electronic device to cause display of an application on the display screen of the portable electronic device, wherein image data for the application is not included in the compressed video data wirelessly transmitted from the portable electronic device.
18. The portable electronic device of claim 11, wherein the video displayed at the display device is not concurrently displayed on the display screen of the portable electronic device.
19. The portable electronic device of claim 11, wherein the video displayed at the display device is concurrently displayed on the display screen of the portable electronic device.
20. The portable electronic device of claim 11, further comprising: an application module; and
a transceiver coupled to the application module, the transceiver being configured to wirelessly communicate with a remote entity concurrently with the transmitter wirelessly transmitting the compressed video data stream.
21. The portable electronic device of claim 20, wherein the application module is a web browser, and the transceiver is a wireless local area network (WLAN) transceiver.
22. The portable electronic device of claim 20, wherein the application module is a cell phone module, and the transceiver is a cell phone transceiver.
PCT/CN2011/073680 2011-05-05 2011-05-05 Low power and low latency push mode wireless hd video streaming architecture for portable devices WO2012149684A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2011/073680 WO2012149684A1 (en) 2011-05-05 2011-05-05 Low power and low latency push mode wireless hd video streaming architecture for portable devices
CN201180070407.6A CN103650516A (en) 2011-05-05 2011-05-05 Low power and low latency push mode wireless HD video streaming architecture for portable devices

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/073680 WO2012149684A1 (en) 2011-05-05 2011-05-05 Low power and low latency push mode wireless hd video streaming architecture for portable devices

Publications (1)

Publication Number Publication Date
WO2012149684A1 true WO2012149684A1 (en) 2012-11-08

Family

ID=47107743

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/073680 WO2012149684A1 (en) 2011-05-05 2011-05-05 Low power and low latency push mode wireless hd video streaming architecture for portable devices

Country Status (2)

Country Link
CN (1) CN103650516A (en)
WO (1) WO2012149684A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105898458A (en) * 2015-12-10 2016-08-24 乐视致新电子科技(天津)有限公司 DP (Display Port) based video output wireless adaption method, device and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101247186A (en) * 2007-02-16 2008-08-20 江国庆 Hand-held portable device with wireless data transfer module
CN101291431A (en) * 2007-04-20 2008-10-22 华硕电脑股份有限公司 Portable multimedia play device
US20100278230A1 (en) * 2009-05-01 2010-11-04 Macinnis Alexander G Method And System For Scalable Video Compression And Transmission
CN201682584U (en) * 2009-10-28 2010-12-22 东莞建永数码科技有限公司 Wireless video transmission device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101247186A (en) * 2007-02-16 2008-08-20 江国庆 Hand-held portable device with wireless data transfer module
CN101291431A (en) * 2007-04-20 2008-10-22 华硕电脑股份有限公司 Portable multimedia play device
US20100278230A1 (en) * 2009-05-01 2010-11-04 Macinnis Alexander G Method And System For Scalable Video Compression And Transmission
CN201682584U (en) * 2009-10-28 2010-12-22 东莞建永数码科技有限公司 Wireless video transmission device

Also Published As

Publication number Publication date
CN103650516A (en) 2014-03-19

Similar Documents

Publication Publication Date Title
JP5868997B2 (en) Image transmission device, image transmission method, image reception device, and image reception method
CN102792689B (en) Delta compression can be carried out and for by image, remote display is presented to the amendment of estimation and metadata
US20230232076A1 (en) Remote User Interface
TWI395491B (en) Method and video receiving system for adaptively decoding embedded video bitstream
US9628796B2 (en) System and method to optimize video performance in wireless-dock with ultra-high definition display
KR101283324B1 (en) The realtime duplex image monitoring system using smart module and the method thereof
WO2013018248A1 (en) Image transmission device, image transmission method, image receiving device, and image receiving method
US20110085023A1 (en) Method And System For Communicating 3D Video Via A Wireless Communication Link
US8358918B2 (en) Video processing apparatus and video processing method
WO2012147791A1 (en) Image receiving device and image receiving method
US20130097648A1 (en) Internet-enabled smart television
WO2012149684A1 (en) Low power and low latency push mode wireless hd video streaming architecture for portable devices
WO2012149685A1 (en) Wireless hd video streaming with intermediate bridge
WO2012171156A1 (en) Wireless video streaming using usb connectivity of hd displays
JP6609074B2 (en) Image output apparatus and output method
JP5739262B2 (en) Image transmission device, image transmission method, image reception device, and image reception method
CN219875871U (en) Screen throwing device for horizontal and vertical screen display and electronic equipment
JP2013115456A (en) Image transmission apparatus and image transmission method
JP6472845B2 (en) Image receiving device
WO2012147786A1 (en) Image transmission device and image transmission method
CN101610317A (en) A kind of mobile terminal electronic product
JP6200971B2 (en) Image transmission apparatus and transmission method
KR20160144061A (en) Popular mainboard for ultra-high definition television
KR100928034B1 (en) Method for transmitting data and system for using thereof in heterogeneous system
KR20230025256A (en) Electronic apparatus and method of controlling the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11864713

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 14/04/2014)

122 Ep: pct application non-entry in european phase

Ref document number: 11864713

Country of ref document: EP

Kind code of ref document: A1