WO2012149685A1 - Transmission en continu de données vidéo haute définition sans fil avec un pont intermédiaire - Google Patents

Transmission en continu de données vidéo haute définition sans fil avec un pont intermédiaire Download PDF

Info

Publication number
WO2012149685A1
WO2012149685A1 PCT/CN2011/073683 CN2011073683W WO2012149685A1 WO 2012149685 A1 WO2012149685 A1 WO 2012149685A1 CN 2011073683 W CN2011073683 W CN 2011073683W WO 2012149685 A1 WO2012149685 A1 WO 2012149685A1
Authority
WO
WIPO (PCT)
Prior art keywords
video data
portable electronic
compressed video
display device
electronic device
Prior art date
Application number
PCT/CN2011/073683
Other languages
English (en)
Inventor
Junfeng Wang
Xiaoyan He
Lening SHI
Qinghua Zeng
Original Assignee
Panovel Technology Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panovel Technology Corporation filed Critical Panovel Technology Corporation
Priority to PCT/CN2011/073683 priority Critical patent/WO2012149685A1/fr
Publication of WO2012149685A1 publication Critical patent/WO2012149685A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/18—Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/55—Push-based network services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/1059—End-user terminal functionalities specially adapted for real-time communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6581—Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application

Definitions

  • the present invention relates to wireless video data streaming technology.
  • Video refers to a technology for electronically capturing, storing, and playing a sequence of still images that represent scenes in motion.
  • High-definition video e.g., "HD” video
  • HD video displays may have display resolutions of 1,280 by 720 pixels (720p), 1,920 by 1,080 pixels (1080i/1080p), or other resolutions.
  • Televisions and other display devices are being manufactured with high definition resolutions in increasing numbers. As such, techniques for providing high definition video data to high definition displays are being developed, including wireless techniques.
  • WiFi wireless local area network
  • UWB ultra- wideband
  • WiHD WirelessHD
  • WHDI wireless home digital interface
  • HD video between portable electronic devices and HD displays According to push mode streaming, a portable electronic device initiates and controls the transfer of the HD video to the display device.
  • push mode video streaming is the broadcast video service in cable or satellite networks. In such broadcast video services, a video stream is initiated and transferred by the video source device (e.g., a satellite or cable service).
  • the HD display initiates and controls the transfer of the HD video from the portable electronic device.
  • pull mode video is an HDTV that reads a video file from a USB disk, and plays the video file in real time.
  • push mode video streaming tends to provide a better user experience than pull mode because portable devices (e.g., smart phones, laptops, etc.) typically have better user interfaces for control purposes than do display devices. Due to the convenience of using the user interface of a portable electronic device to control the video streaming process, push mode video streaming has become popular.
  • Portable electronic devices have significant processing and power limitations.
  • Portable electronic devices typically do not have a large amount of processing capacity, and thus processing the large amount of data contained in high definition video streams is difficult if not impossible using portable electronic devices.
  • the high data throughput needed for high definition video consumes a large amount of battery power.
  • conventional techniques for the streaming of high definition video by portable electronic devices are not practical.
  • video data is streamed from portable electronic devices in compressed form according to the push mode of video data streaming.
  • the streamed compressed video data is received by a bridge device.
  • a display device such as a high definition display device, may cause the compressed video data to be streamed to the display device from the bridge device according to the pull mode of video data streaming.
  • Video corresponding to the streamed compressed video data may be displayed at the display device.
  • a method in a bridge device is provided.
  • a compressed video data stream transmitted according to the push mode is wirelessly received by the bridge device from a portable electronic device.
  • a request is received by the bridge device from a display device for video content associated with the compressed video data stream.
  • Compressed video data of the compressed video data stream is transmitted to the display device from the bridge device in response to the request according to the pull mode.
  • the compressed video data is configured to be decoded and displayed by the display device as video.
  • the request from the display device may be received as a file read request.
  • a pre-generated FAT file allocation table
  • the compressed video data may be transmitted to the display device from the bridge device to simulate file data being read from a data file having the pre-generated FAT.
  • a bridge device in another implementation, includes a receiver, a communication interface, and video content bridging logic.
  • the receiver wirelessly receives a compressed video data stream transmitted according to the push mode from a portable electronic device.
  • the communication interface receives a request from a display device for video content associated with the compressed video data stream to be received at the display device according to a pull mode.
  • the video content bridging logic enables the communication interface to transmit compressed video data of the compressed video data stream to the display device in response to the request.
  • the compressed video data is configured to be decoded and displayed by the display device as video.
  • the request may be received as a file read request from the display device.
  • the bridge device may include storage that stores a pre-generated file FAT.
  • the video content bridging logic may be configured to provide the pre-generated FAT to the display device in response to the file read request, and to transmit the compressed video data to the display device in response to the file read request to simulate file data being read from a data file associated with the pre-generated FAT.
  • Computer program products are also described herein that enable streaming of compressed video data through bridge devices, and that enable further embodiments as described herein.
  • Devices in which embodiments may be implemented may include storage, such as storage drives, memory devices, and further types of computer-readable storage media described herein.
  • Such computer-readable storage media may store program modules that include computer program logic for performing the systems, processes, and further embodiments described herein.
  • FIG. 1 shows a block diagram of a video streaming system that includes a portable electronic device and a high definition (HD) display device, according to an example embodiment.
  • FIG. 2 shows a block diagram of concurrent views of a display screen of the portable electronic device of FIG. 1 and a display screen of the HD display device of FIG. 1.
  • FIGS. 3 and 4 show respective block diagrams of example video streaming systems.
  • FIG. 5 shows a block diagram of a video streaming system, according to an example embodiment.
  • FIG. 6 shows a flowchart for streaming video from a portable electronic device, according to an example embodiment.
  • FIG. 7 shows a block diagram of a portable electronic device, according to an example embodiment.
  • FIG. 8 shows a flowchart providing a process for parsing a video file to generate a compressed video data stream, according to an example embodiment.
  • FIG. 9 shows a block diagram of a portable electronic device, according to an example embodiment.
  • FIG. 10 shows a flowchart providing a process for real time capture of video data to generate a compressed video data stream, according to an example embodiment.
  • FIG. 11 shows a block diagram of concurrent views of a display screen of the portable electronic device of FIG. 5 and a display screen of the HD display device of FIG.
  • FIG. 12 shows a block diagram of an example mobile device with video display and processing capability, according to an embodiment.
  • FIGS. 13 and 14 show block diagrams of portable electronic devices, according to example embodiments.
  • FIG. 15 shows a block diagram of a video streaming system that includes a bridge device, according to an example embodiment.
  • FIG. 16 shows a flowchart for streaming video through a bridge device, according to an example embodiment.
  • FIG. 17 shows a block diagram of a video streaming system that is an example of the system of FIG. 15, according to an embodiment.
  • FIG. 18 shows a block diagram of a bridge device connected to an HD display device, according to an example embodiment.
  • FIG. 19 shows a block diagram of storage of a bridge device that stores a dummy file allocation table, according to an example embodiment.
  • FIG. 20 shows a flowchart for providing a compressed video data stream, according to an example embodiment.
  • references in the specification to "one embodiment,” “an embodiment,” “an example embodiment,” etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
  • Embodiments of the present invention enable the streaming of video, such as high definition (HD) video, from portable electronic devices.
  • a display device may receive the streamed video, and may display the streamed video on a display screen.
  • FIG. 1 shows a block diagram of a video streaming system 100.
  • system 100 includes a portable electronic device 102 and an HD display device 104.
  • portable electronic device 102 includes an antenna 106 and a display screen 110, which displays a video 114.
  • a media player may be used to play video 114 at portable electronic device 102, as would be known to persons skilled in the relevant art(s).
  • Display screen 110 may be any type of display screen, including an LCD display screen, an LED display screen, etc.
  • Display screen 110 displays video 114 to a user of portable electronic device 102.
  • video 114 may be generated from a video file stored in storage of portable electronic device 102, from video information received from external to portable electronic device 102, or other source.
  • Portable electronic device 102 generates a video data stream 116 transmitted from antenna 106 to stream video 114 from portable electronic device 102 to HD display device 104.
  • HD display device 104 includes an antenna 108 and a display screen 112.
  • Antenna 108 of HD display device 104 receives video data stream 116, and HD display device 104 displays video 114 on display screen 112 based on video data stream 112.
  • FIG. 2 shows a block diagram of a concurrent view of display screen
  • display screen 110 displays video 114 imposed on background graphics 202.
  • Background graphics 202 may be visible on display screen 110 when video 114 is displayed in less than full screen, and may include one or more of a background color and/or pattern, one or more icons, one or more other applications being used (e.g., an Internet browser viewing a web page, a document open in a word processor, an email tool, etc.), etc.
  • Portable electronic device 102 is configured to generate video data stream 116 to include all content that is displayed by display screen 110, to replicate the contents of display screen 110 on another display screen.
  • display screen 112 of HD display device 104 displays video 114 imposed on background graphics 202 in a similar manner as display screen 110 of portable electronic device 102.
  • FIG. 3 shows a block diagram of a video streaming system 300.
  • System 300 is an example of system 100 of FIG. 1. As shown in FIG. 3, system 300 includes a portable electronic device 350 and an HD display device 360.
  • Portable electronic device 350 includes a decoder 304, a graphics processing module 308, a full screen graphics processing module 310, a transmitter 312, a battery 326, antenna 106, and display screen 110.
  • HD display device 360 includes a receiver 314, a display driver 316, antenna 108, and display screen 112.
  • decoder 304 receives compressed video data 302.
  • Compressed video data 302 is compressed video data for generating video 114, such as may be received external from portable electronic device 350 or stored in a video file in portable electronic device 350.
  • Decoder 304 is configured to decode compressed video data 302 to generate decoded video data 318.
  • decoder 304 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350.
  • Graphics processing module 308 receives background graphics data 306.
  • Background graphics data 306 includes graphics data corresponding to one or more graphical (e.g., text, image, video, etc.) features of background graphics 202 (FIG. 2).
  • Graphics processing module 308 is configured to perform graphics processing on background graphics data 306 to generate processed background graphics data 306.
  • graphics processing module 308 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350.
  • Full screen graphics processing module 310 receives decoded video data 318 and processed background graphics data 306.
  • Full screen graphics processing module 310 is configured to combine and perform full screen level processing (e.g., scaling, etc.) on decoded video data 318 and processed background graphics data 306 to generate combined decoded video data 322.
  • full screen graphics processing module 310 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or a graphics processor) of portable electronic device 350.
  • Transmitter 312 receives and wirelessly transmits combined decoded video data 322 via antenna 106 as raw video data stream 324. Furthermore, display screen 110 of portable electronic device 350 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • receiver 314 of HD display device 360 receives raw video data stream 324 via antenna 108, and outputs combined decoded video data 322.
  • HD display device 360 may optionally include display driver 316 to configure combined decoded video data 322 for display screen 112 (although not shown herein, portable electronic devices described herein may optionally include a display driver to format video data for display).
  • Display driver 316 generates video driver output data 328, which is received by display screen 112.
  • Display screen 112 generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • raw video data stream 324 is streamed wirelessly from portable electronic device 350.
  • Raw video data stream 324 includes uncompressed video data corresponding to the contents of the full screen of portable electronic device 350.
  • the data rate of the full screen raw video transmitted from transmitter 312 is orders of magnitudes higher than that of a compressed video file that may be streamed, such as a file having the compressed video format of MPEG-2 (moving picture experts group), H.264, or other video file standard.
  • transmitter 312 may transmit combined decoded video data 322 at a rate of more than 1 Gbps (e.g., for raw HD video data at 1080P), while an MPEG-2 video stream is typically about 20 Mbps.
  • FIG. 4 shows a block diagram of a video streaming system 400 that is another example of system 100 of FIG. 1.
  • System 400 of FIG. 4 is similar to system 300 of FIG. 3, except that additional encoding and decoding processes are performed.
  • system 400 includes a portable electronic device 420 and an HD display device 430.
  • Portable electronic device 420 includes decoder 304, graphics processing module 308, full screen graphics processing module 310, transmitter 312, battery 326, antenna 106, display screen 110, and an encoder 402.
  • HD display device 430 includes receiver 314, display driver 316, antenna 108, display screen 112, and a decoder 404.
  • Decoder 304, graphics processing module 308, and full screen graphics processing module 310 operate similarly as described above with respect to FIG. 3 to generate combined decoded video data 322 from compressed video data 302 and background graphics data 306.
  • Encoder 402 receives and encodes combined decoded video data 322 to generate encoded combined video data 406.
  • encoder 402 may be implemented in as computer code executed by a processor (e.g., central processing unit and/or graphics processor) of portable electronic device 420.
  • Transmitter 312 receives and wirelessly transmits encoded combined video data 406 via antenna 106 as compressed video data stream 408.
  • display screen 110 of portable electronic device 420 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • receiver 314 of HD display device 430 receives compressed video data stream 408 via antenna 108, and outputs encoded combined video data 406.
  • Decoder 404 receives and decodes encoded combined video data 406 to generate combined decoded video data 322.
  • HD display device 360 may include display driver 316 to format decoded video data 322 for display screen 112.
  • Display driver 316 generates video driver output data 328, which is received by display screen 112.
  • Display screen 112 generates a display of video 114 imposed on background graphics 202, as shown in FIG. 2.
  • compressed video data stream 408 is streamed wirelessly from portable electronic device 420. Due to the encoding by encoder 402, compressed video data stream 408 includes compressed video data corresponding to the full screen of portable electronic device 420, and thus may be transmitted at a lower data rate than raw video data stream 324 of FIG. 3. To achieve this, however, encoder 402 must be present in portable electronic device 420 and decoder 404 must be present in HD display device 430, in the datapath for the video data. Encoder 402 dissipates significant power, making it less attractive for portable devices having stringent power budgets.
  • FIG. 5 shows a block diagram of a video streaming system 500, according to an example embodiment.
  • System 500 is an example embodiment of system 100 of FIG. 1.
  • system 300 includes a portable electronic device 502 and an HD display device 520.
  • Portable electronic device 502 includes a video stream generator 504, transmitter 312, antenna 106, and battery 326.
  • HD display device 520 includes receiver 314, display driver 316, antenna 108, display screen 112, and decoder 404.
  • portable electronic device 502 is a video source device enabled to stream HD video with relatively low power dissipation and low latency according to the push mode.
  • HD display device 520 is an example video sink device configured to display the compressed video streamed by portable electronic device 502.
  • System 500 is described as follows with respect to FIG. 6.
  • FIG. 6 shows a flowchart 600 for streaming video from a portable electronic device, according to an example embodiment.
  • portable electronic device 502 of FIG. 5 may operate according to flowchart 600. Further structural and operational embodiments will be apparent to persons skilled in the relevant art(s) based on the following description of flowchart 600 and system 500.
  • step 602 compressed video data is received from a compressed video data source.
  • video stream generator 504 receives compressed video data 302.
  • compressed video data 302 may be received from various sources, such as from storage located in or associated with portable electronic device 502, or from a real time source such as a video camera included in portable electronic device 502 (e.g., mounted to a housing of portable electronic device 502, attached to portable electronic device 502, etc.) or a remote source (e.g., that streams compressed video data 302 to portable electronic device 502 in a wired and/or wireless manner) such as the Internet, or a wireless network of a wireless operator.
  • Received compressed video data 302 may be formatted according to one or more different video compression formats.
  • step 604 the received compressed video data is provided in a compressed video data stream to a transmitter of the portable electronic device without decoding the compressed video data.
  • video stream generator 504 is in a datapath between a source of compressed video data 302 and transmitter 312.
  • Video stream generator 304 receives compressed video data 302 and generates a compressed video data stream 506.
  • Compressed video data stream 506 includes compressed video data 302 converted into the form of a video data stream.
  • video stream generator 504 may receive compressed video data 302 in any of a number of different compressed video data formats, converting the different video compressions into a common format to generate compressed video data stream 506,.
  • Compressed video data stream 506 is received by transmitter 312.
  • Decoding of compressed video data 302 is not performed by video stream generator 504 to generate compressed video data stream 506.
  • portable electronic device 502 does not need to be configured for such decoding, and therefore does not require electronic circuitry for performing decoding and/or does not need to store decoding-related computer code.
  • Battery 326 is present to provide power for electrical components of portable electronic device 502 (e.g., video stream generator 504, transmitter 312, etc.), to enable portability for device 502.
  • a battery life of battery 326 may be extended due to not having to performing decoding, and potentially encoding, of video data at high rates.
  • portable electronic device 502 is enabled to have low latency because decoding, and potentially encoding, of video data is not performed therein. As such, corresponding delays are not introduced into the video data stream.
  • Video stream generator 504 may be configured in various ways to generate compressed video data stream 506.
  • video stream generator 504 may be a video file parser configured to receive a parse a video file.
  • FIG. 7 shows a block diagram of a portable electronic device 702, according to an example embodiment.
  • Portable electronic device 702 is an example of portable electronic device 502 of FIG. 5.
  • portable electronic device 702 includes storage 704, a video file parser 706, a format converter 712, battery 326, and transmitter 312.
  • Video file parser 706 is an example of video stream generator 504 of FIG. 5.
  • Video file parser 706 is configured to parse a video file 710 stored in storage 704 by retrieving and outputting a segment 708 of video file 710.
  • Video file 710 may have any suitable form.
  • video file 710 may be coded according any of video compression standards shown in Table 1 below, or other video compression standard. Table 1 indicates video compression standards for video file 710 and corresponding examples of storage media of storage 704 in which video file 710 may be stored:
  • Video compression standard Example storage implementations MPEG-1 Part 2 Video-CD (compact disc)
  • H.262/MPEG-2 Part 2 DVD digital video disc
  • Blu-Ray Blu-Ray
  • H.264/MPEG-4 AVC advanced video Blu-Ray , Digital Video Broadcasting, iPod coding
  • Video HD DVD
  • Segment 708 may include any portion of video file 710, including a portion of a video frame, a single video frame, multiple video frames, or any other portion of video file 710.
  • Video file parser 706 sequentially retrieves segments 708 of video file 710 in storage 704.
  • Format converter 712 is configured to convert each segment 708 into a common transport format (e.g., in packetized form) to generate compressed video data stream 506.
  • format converter 712 may be configured to convert segments 708 from a video compression format, such as any video compression format shown in Table 1, into a common transport format, such as a transport format described below with respect to step 606 of flowchart 600 (FIG. 6) or other transport format. Configurations for format converter 712 will be known to persons skilled in the relevant art(s) based on the teachings herein.
  • portable electronic device 702 may operate according to a flowchart
  • Flowchart 800 provides a process for parsing a video file to generate a compressed video data stream, according to an example embodiment.
  • Flowchart 800 begins with step 802.
  • compressed video data is stored in storage in the portable electronic device.
  • video file 710 is stored in storage 704 of portable electronic device 702.
  • the compressed video data of the video file is parsed to generate the compressed video data stream.
  • video file parser 706 may parse video file 710 to generate compressed video data stream 506.
  • video stream generator 504 may be configured to perform real time video capture of compressed video data transmitted to portable electronic device 502 in real time.
  • FIG. 9 shows a block diagram of a portable electronic device 902, according to an example embodiment.
  • Portable electronic device 902 is an example of portable electronic device 502 of FIG. 5.
  • portable electronic device 902 includes a receiver 904, a real time capture module 906, an antenna 908, battery 326, and transmitter 312.
  • Real time capture module 906 is an example of video stream generator 504 of FIG. 5.
  • Real time capture module 906 is configured to capture video data in real time that is transmitted to portable electronic device 902 by a remote source 910. For example, as shown in FIG.
  • remote source 910 wirelessly transmits a compressed video data stream 912 to portable electronic device 902.
  • Receiver 904 receives compressed video data stream 912 via antenna 908, an outputs compressed video data 302.
  • Real time capture module 906 is configured to receive and convert compressed video data 302 into compressed video data stream 506 in real time (e.g., with little to no buffering of video data).
  • Compressed video data stream 912 may have any suitable form, and as such, real time capture module 906 may be configured to convert the received form of compressed video data stream 912 (as compressed video data 302) into compressed video data stream 506 having a predetermined format in real time, as described further below.
  • compressed video data stream 912 may be coded according any of the video compression standards shown in Table 2 below, or according to other video compression standard. Table 2 indicates video compression standards for compressed video data stream 912 and corresponding examples of remote source applications for which compressed video data stream 912 may be received:
  • portable electronic device 902 may operate according to a flowchart
  • Flowchart 1000 provides a process for real time capture of video data to generate a compressed video data stream, according to an example embodiment.
  • Flowchart 1000 begins with step 1002.
  • the compressed video data is received using a receiver of the portable electronic device from a remote source.
  • receiver 904 of portable electronic device 902 may receive compressed video data stream 912 (via antenna 908) from remote source 910, outputting compressed video data 302.
  • step 1004 of flowchart 1000 real time capture of the compressed video data received from the remote source is performed to generate the compressed video data stream.
  • real time capture module 906 is configured to receive and convert compressed video data 302 in real time into compressed video data stream 506. Configurations for real time capture module 906 will be known to persons skilled in the relevant art(s) based on the teachings herein (e.g., real time capture module 906 may include a format converter similar to format converter 712 of FIG. 7).
  • Video stream generator 504 may be configured in further ways to generate compressed video data stream 506, as would be known to persons skilled in the relevant art(s) based on the teachings herein.
  • portable electronic device 502 of FIG. 5 may include a camera (e.g., an image sensing device, such as a charge coupled device (CCD) camera).
  • the camera may capture video images, and may output a stream of the video images in compressed form, to generate compressed video data 302.
  • Portable electronic device 502 may include real time capture module 906 of FIG. 9, configured to receive and convert compressed video data 302 in real time into compressed video data stream 506.
  • the compressed video data stream is wirelessly transmitted from the portable electronic device using the transmitter in a push mode.
  • transmitter 312 receives compressed video data stream 506.
  • Transmitter 312 wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508.
  • Portable electronic device 502 streams compressed video data stream 508 according to a push mode, where portable electronic device 502 initiates and controls streaming of compressed video data.
  • Portable electronic device 502 does not stream compressed video data under the control of a display device, which would be streaming according to the pull mode.
  • Compressed video data stream 508 may be received by one or more display devices.
  • transmitted compressed video data stream 508 may be generated by video stream generator 504 and transmitted by transmitter 312 in any video data stream form, proprietary or commercially available.
  • transmitted compressed video data stream 508 may be generated in elementary stream (ES) format, defined by an MPEG communication protocol.
  • ES elementary stream
  • An elementary stream is often referred to as “elementary”, “data”, “audio”, or “video” bitstreams or streams.
  • the format of the elementary stream depends upon the codec or data carried in the stream, but will often carry a common header when packetized into a packetized elementary stream.
  • Packetized elementary stream is a specification in the MPEG-2 Part 1 (Systems) (ISO/IEC 13818-1) and ITU-T H.222.0 that defines carrying of elementary streams in packets within an MPEG program stream and MPEG transport stream.
  • the elementary stream is packetized by encapsulating sequential data bytes from the elementary stream inside PES packet headers.
  • transmitted compressed video data stream 508 may be generated in transport stream (TS) format, a standard format for transmission and storage of audio, video, and data.
  • Transport stream format is used in broadcast systems such as DVB (digital video broadcasting) and ATSC (Advanced Television Systems Committee).
  • Transport stream specifies a container format encapsulating packetized elementary streams, with error correction and stream synchronization features for maintaining transmission integrity when the signal is degraded.
  • transmitted compressed video data stream 508 may be generated according to other video data stream format.
  • Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data.
  • HD display device 520 may receive transmitted compressed video data stream 508.
  • Receiver 314 of HD display device 520 receives transmitted compressed video data stream 508 via antenna 108, and outputs compressed video data stream 510.
  • Decoder 404 receives and decodes compressed video data stream 506 to generate decoded video data stream 512.
  • HD display device 520 may optionally include display driver 316 to configure decoded video data stream 512 for display screen 112.
  • Display driver 316 generates video driver output data 514, which is received by display screen 112.
  • Display screen 112 generates a display of a video corresponding to compressed video data 302.
  • video data corresponding to the background (background graphics data 306) and video (compressed video data 302) displayed on display screen 110 of portable electronic devices 350 and 420 is included in raw video data stream 324 and compressed video data stream 408, respectively.
  • background graphics 202 and video 114 are displayed by display screens 112 of HD display devices 360 and 430 in both cases.
  • compressed video data 302 is included in transmitted compressed video data stream 508, but background graphics data 306 is not included.
  • display screen of HD display device 520 displays video 114 but not background graphics.
  • FIG. 11 shows a block diagram of concurrent views of display screen 110 of portable electronic device 502 and display screen 112 of FID display device 520, according to an example embodiment.
  • display screen 110 displays video 114 and background graphics 202.
  • an application image 1102 may be displayed with background graphics 202 on display screen 110.
  • Application image 1102 may be an image associated with any application that may be executed on portable electronic device 502, such as an email tool, a web browser, a video game, a word processor, etc.
  • Portable electronic device 502 is configured to generate transmitted compressed video data stream 508 to include video data associated with video 114 displayed by display screen 110, but not image data associated with other content displayed by display screen 110, such as background graphics 202, application image 1102, etc.
  • display screen 112 of HD display device 520 displays video 114, but not the remainder of display screen 110 of portable electronic device 502.
  • display screen 112 may display video 114 in full screen, depending on the configuration of display screen 1 12.
  • a user of portable electronic device 502 may interact with an application that generates application image 1102, without application image 1102 being displayed by display screen 112 of HD display device 520. Furthermore, portable electronic device 502 may not even display video 114 on display screen 110 while video 114 is being streamed and displayed by display screen 112 of display device 520. For example, a user of portable electronic device 502 may invoke the streaming of video 114 to display device 520, and then may reduce or iconify a media player tool displaying video 114 at portable electronic device 502 so that video 114 is not displayed on display screen 110 while it is being streamed to display device 520
  • a push mode wireless HD video streaming technique is provided that consumes less power and has less latency that conventional techniques.
  • compressed video data is streamed across a wireless link between a portable electronic device and a display device, and encoding and decoding functions are not present in the video streaming datapath in the portable electronic device.
  • portable electronic device 502 does not require a central processing unit (CPU), graphics processing unit (GPU), and/or other logic to perform the decoding and encoding.
  • Video decoding is performed once, at the display device, which is less sensitive to power usage.
  • decoding is performed in portable electronic device 350, and raw video data is wirelessly streamed, requiring additional processing and consuming more power in portable electronic device 350.
  • encoding and decoding is performed in portable electronic device 420, requiring additional processing in portable electronic device 350, consuming more power, and causing greater latency.
  • power consumption at portable electronic device 502 is significantly lower than in the techniques of FIGS. 3 and 4 described above, with latency lower than the technique of FIG. 4.
  • Embodiments of the present invention relate to the streaming of video data using portable electronic devices to display devices.
  • HD display device 520 may be any type of high definition display device, including an LCD (liquid crystal display) display or monitor, a plasma display or monitor, an LED (light emitting diode) display or monitor, an HD projector, or further type of display device.
  • Portable electronic device 502 may be any type of mobile or portable electronic device, including a smart phone, a handheld computing device (e.g., a personal digital assistant (PDA), a BLACKBERRY device, a PALM device, etc.), a laptop computer, a tablet computer (e.g., an APPLE IP AD), or further type of mobile device.
  • Embodiments include portable electronic devices having limited resources.
  • Such portable electronic devices may include a camera used to capture images, such as still images and video images that are streamed from the portable electronic device in compressed form.
  • Portable electronic devices may include storage that stores compressed video data.
  • portable electronic devices may receive video data from external sources, such as from a cable television provider, a satellite television provider, an Internet, a wireless network of a wireless operator, or other network-based web site, or other remote source.
  • FIG. 12 shows a block diagram of an example portable electronic device 1200 with video capture and processing capability.
  • Portable electronic device 1200 is an example of portable electronic device 502 of FIG. 5.
  • Portable electronic device 1200 may be any portable electronic device described herein or otherwise known.
  • the implementation of portable electronic device 1200 shown in FIG. 12 is provided for purposes of illustration, and is not intended to be limiting. Embodiments of the present invention are intended to cover portable electronic devices having additional and/or alternative features to those shown for portable electronic device 1200 in FIG. 12. [0069] As shown in FIG.
  • portable electronic device 1200 includes a speaker 1202, an audio codec 1204, a central processing unit (CPU) 1206, a radio frequency (RF) transceiver 1208, an antenna 1210, a display screen 1212, battery 326, a storage 1214, a user interface 1216, a camera 1218, and a user interface 1220.
  • CPU central processing unit
  • RF radio frequency
  • Battery 326 provides power to the components of portable electronic device 1200 that require power.
  • Battery 326 may be any type of battery, including one or more rechargeable and/or non-rechargeable batteries.
  • User interface 1216 is a user interface device that enables a user of portable electronic device 1200 to enter data, commands, and/or to otherwise interact with portable electronic device 1200. For example, a user may interact with user interface 1216 to select video content (e.g., from storage, a camera, or a remote source) for streaming.
  • User interface 1216 may include one or more user interface elements, such as a keyboard/keypad, a touch pad, a roller ball, a stick, a click wheel, and/or voice recognition technology.
  • user interface 1216 may include a graphical user interface (GUI) that is displayed by display screen 1212.
  • GUI graphical user interface
  • CPU 1206 is shown in FIG. 12 as coupled to each of audio codec 1204, RF transceiver 1208, display screen 1212, storage 1214, and user interface 1216.
  • CPU 1206 may be individually connected to these components, or one or more of these components may be connected to CPU 1206 in a common bus structure.
  • video stream generator 504 e.g., video file parser 706, format converter 712, and/or real time capture module 906
  • CPU 1206 may include a digital signal processor (DSP). When present, the DSP may apply special effects to the received video data.
  • CPU 1206 may store and/or buffer video and/or audio data in storage 1214.
  • DSP digital signal processor
  • Storage 1214 may include any suitable type of storage in the form of one or more storage devices, including one or more primary or main memory devices (e.g., random access memory (RAM)), one or more secondary storage devices (e.g., a hard disk drive, a removable storage device or drive, a memory card, a memory stick, a floppy disk drive, a magnetic tape drive, a compact disc (CD) drive for CDs, a digital video disc (DVD) drive for DVDs, an optical storage device), and/or other types of storage.
  • Storage 1214 is an example of storage 704 described above with respect to FIG.7.
  • CPU 1206 may stream the video data to RF transceiver 1208, to be transmitted from portable electronic device 1200.
  • RF transceiver 1208 may be configured to enable wireless communications for mobile device 116.
  • RF transceiver 1208 may enable telephone calls, such as telephone calls according to a cellular protocol.
  • RF transceiver 1208 may include a frequency up-converter (transmitter) (e.g., transmitter 312) and down-converter (receiver) (e.g., receiver 904).
  • RF transceiver 1208 may transmit RF signals to antenna 1210 containing audio information corresponding to voice of a user of portable electronic device 1200.
  • RF transceiver 1208 may enable a wireless local area network (WLAN) link (including an IEEE 802.11 WLAN standard link), and/or other type of wireless communication link.
  • WLAN wireless local area network
  • RF transceiver 1208 may receive RF signals from antenna 1210 corresponding to audio and/or video data received from another device in communication with portable electronic device 1200. RF transceiver 1208 provides the received audio and/or video data to CPU 1206. For example, RF transceiver 1208 may be configured to receive video telephony and/or HD television signals for portable electronic device 1200, to be displayed by display screen 1212, and to be processed by CPU 1206 prior to streaming from portable electronic device 1200.
  • Speaker 1202 and audio codec 1204 may be present in some applications of portable electronic device 1200, such as mobile phone applications and video applications.
  • CPU 1206 provides audio data from storage 1214 or received by RF transceiver 1208 to audio codec 1204.
  • Audio codec 1204 performs bit stream decoding of the received audio data (if needed) and converts the decoded data to an analog signal.
  • Speaker 1202 receives the analog signal, and outputs corresponding sound.
  • Camera 1218 and video codec 1220 may be present in some applications of portable electronic device 1200, such as mobile phone applications and video applications.
  • Camera 1218 may be any type of video camera, including a CCD camera, etc.
  • Camera 1218 captures a stream of images, and outputs video data.
  • Video codec 1220 may be present to encode the video data output by camera 1218, to generate compressed video data.
  • CPU 1206 may receive the compressed video data from video codec 1220.
  • CPU 1206 may process the compressed video data in a real time manner to generate a video data stream that is streamed from portable electronic device 1200, as described above.
  • Audio codec 1204, video codec 1218, and CPU 1206 may be implemented in hardware, software, firmware, and/or any combination thereof.
  • CPU 1206 may be implemented as a proprietary or commercially available processor, such as an ARM (advanced RISC machine) core configuration, that executes code to perform its functions.
  • Portable electronic device 1200 may include a separate graphics processor to process video data, and/or video data may be processed by CPU 1206.
  • Audio codec 1204 may be configured to process (e.g., decode, decompress, etc.) proprietary and/or industry standard audio protocols.
  • Video codec 1220 may be configured to process (e.g., encode, compress, etc.) proprietary and/or industry standard video protocols.
  • Display screen 1212 receives image/video data from CPU 1206, and display images, including video based on video data stored in storage 1214, video data received from camera 1218 (and video codec 1220) and/or received by RF transceiver 1208.
  • Display screen 1212 may include any type of display mechanism, including an LCD (liquid crystal display) panel, LED (light emitting diode), or other display mechanism.
  • portable electronic device 502 of FIG. 5 may be capable of displaying video that is streamed to HD display device 530.
  • FIG. 13 shows a block diagram of a portable electronic device 1302, according to an example embodiment.
  • Portable electronic device 1302 is an example embodiment of portable electronic device 502 of FIG. 5.
  • portable electronic device 1302 includes video stream generator 504, transmitter 312, antenna 106, battery 326, decoder 304, graphics processing module 308, full screen graphics processing module 310, and display screen 110.
  • Portable electronic device 1302 is configured to stream compressed video data to display devices (e.g., HD display device 530) in a similar manner as portable electronic device 502 of FIG. 5, as described above.
  • portable electronic device 1302 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above.
  • video stream generator 504 receives compressed video data 302.
  • Video stream generator 504 is in a datapath between a source of compressed video data 302 and transmitter 312.
  • Video stream generator 304 generates a compressed video data stream 506.
  • Transmitter 312 receives compressed video data stream 506.
  • Transmitter 312 wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508.
  • Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data, such as HD display device 520 of FIG. 5.
  • Display screen 112 of HD display device 520 generates a display of video 114 (e.g., as shown in FIG. 11).
  • decoder 304 receives compressed video data 302. Decoder 304 is configured to decode compressed video data 302 to generate decoded video data 318. Graphics processing module 308 receives background graphics data 306. Graphics processing module 308 is configured to perform graphics processing on background graphics data 306 to generate processed background graphics data 306. Full screen graphics processing module 310 receives decoded video data 318 and processed background graphics data 306. Full screen graphics processing module 310 is configured to combine and perform full screen level processing on decoded video data 318 and processed background graphics data 306 to generate combined decoded video data 322. Display screen 110 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202 (e.g., as shown in FIG. 11).
  • portable electronic device 502 of FIG. 5 may be capable of performing communications in addition to streaming video, including cell phone communications, computer network communications, etc.
  • FIG. 14 shows a block diagram of a portable electronic device 1402, according to an example embodiment.
  • Portable electronic device 1402 is an example embodiment of portable electronic device 502 of FIG. 5.
  • portable electronic device 1402 includes video stream generator 504, transmitter 312, first antenna 106, battery 326, decoder 304, graphics processing module 308, full screen graphics processing module 310, display screen 110, an application module 1404, a transceiver 1406, and a second antenna 1408.
  • Portable electronic device 1402 is configured to stream compressed video data to display devices (e.g., HD display device 530) in a similar manner as portable electronic device 502 of FIG. 5, as described above. Furthermore, portable electronic device 1402 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above. Still further, portable electronic device 1402 is configured to perform additional communications.
  • display devices e.g., HD display device 530
  • portable electronic device 1402 is configured to display video using display screen 110 in a similar manner as portable electronic devices 300 and 400 of FIGS. 3 and 4, as described above. Still further, portable electronic device 1402 is configured to perform additional communications.
  • video stream generator 504 receives compressed video data 302 and generates a compressed video data stream 506.
  • Transmitter 312 receives compressed video data stream 506 and wirelessly transmits compressed video data stream 506 via antenna 106 as transmitted compressed video data stream 508.
  • Transmitted compressed video data stream 508 may be received by a display device that is capable of decoding transmitted compressed video data stream 508, and displaying the resulting decoded video data, such as HD display device 520 of FIG. 5.
  • Display screen 112 of HD display device 520 generates a display of video 114 (e.g., as shown in FIG. 11).
  • decoder 304 receives compressed video data
  • Display screen 110 receives combined decoded video data 322, and generates a display of video 114 imposed on background graphics 202 (e.g., as shown in FIG. 11).
  • application module 1404 executes in portable electronic device 1402.
  • application module 1404 may be implemented as computer code (e.g., executed by a CPU) and/or electronic circuitry.
  • application module 1404 may be a cell phone module that enables cell phone functionality for portable electronic device 1402. Examples of cell phone modules present in portable electronic devices will be known to persons skilled in the relevant art(s).
  • application module 1404 may be a network communication module that enables network communication functionality for portable electronic device 1402.
  • application module 1404 may include web browser functionality for enabling users to interact with a web browser to navigate a network, such as the Internet.
  • application module 1404 may provide alternative functionality, such as an email application, etc.
  • application module 1404 is coupled with transceiver 1406 by a communication link 1412.
  • Application module 1404 communicates with transceiver 1406 over communication link 1412 to transmit and/or receive communication signals 1414 to and from portable electronic device 1402, to communicate with a remote entity.
  • transceiver 1406 may be a cell phone transceiver, a network transceiver (e.g., a wireless local area network (WLAN) transceiver, such as an IEEE 802.11 WLAN standard compliant transceiver), and/or other type of wireless communication transceiver, and communication signals 1414 may be cell phone communication signals, network communication signals, etc.
  • WLAN wireless local area network
  • portable electronic device 1400 is enabled to stream compressed video data to a display device while simultaneously enabling a user of portable electronic device 1400 to perform other communications with remote entities (e.g., to conduct a phone call, to browse the Internet, etc.).
  • transmitter 312 and antenna 106 are used to stream video from portable electronic device 1402
  • transceiver 1406 and antenna 1408 are used to perform other communications.
  • portable electronic device 1402 may include one antenna and/or one transceiver that is/are used to stream video and to perform other communications.
  • time slicing techniques may be used to stream video and perform further communications using a single transceiver and/or single antenna.
  • transceiver 1406 and/or antenna 1408 may be used to transmit transmitted compressed video data stream 508 and communication signals 1414.
  • decoder 404 is shown as included in display device 520.
  • decoder 404 may be located external to display device 520.
  • antenna 108, receiver 314, and decoder 404 may be included in an external device, such as a dongle, having a connector that plugs into a connector of display device 520.
  • the external device may interface with display device 520 according to an UDMI (High-Definition Multimedia Interface), a DVI (Digital Visual Interface), a VGA (Video Graphics Array) interface, or other type of video interface.
  • UDMI High-Definition Multimedia Interface
  • DVI Digital Visual Interface
  • VGA Video Graphics Array
  • embodiments enable the wireless streaming of compressed video by a portable electronic device, from a stored video file or other source, without the need for decoding and/or displaying of the corresponding video by the portable electronic device. Accordingly, power consumption at the portable electronic device is significantly reduced.
  • the real time parsing of a video file may be performed on the portable electronic device to generate the compressed video stream to be transmitted through a wireless link from the portable electronic device.
  • the real time acquisition of the compressed video stream may be performed through software, for example, before the compressed video stream is transmitted through the wireless link.
  • embodiments are described herein as solving the video streaming problem for portable electronic devices, such embodiments may be implemented for streaming video from a set top box (STB) or other non-portable video source device to a high definition display device (e.g., an HDTV) to save power and reduce latency.
  • STB set top box
  • HDTV high definition display device
  • Decoder 304, graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and application module 1404 may be implemented in hardware, software, firmware, or any combination thereof.
  • decoder 304, graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and/or application module 1404 may be implemented as computer program modules or code configured to be executed in one or more processors.
  • decoder 304 graphics processing module 308, full screen graphics processing module 310, display driver 316, encoder 402, decoder 404, video stream generator 504, video file parser 706, format converter 712, real time capture module 906, audio codec 1204, and/or application module 1404 may be implemented as hardware logic/electrical circuitry.
  • embodiments of the present invention relate to the streaming of video data content.
  • video data is streamed directly from a source device (e.g., a portable electronic device) to a sink device (e.g., a display device).
  • a sink device e.g., a display device
  • an intermediate device referred to herein as a "bridge” or “bridge device” may be present.
  • Video data is streamed from the source device through the bridge device to the sink device.
  • the source device may transmit a video data stream according to the push mode.
  • the bridge device may receive the video data stream.
  • the sink device may cause the video data stream to be streamed from the bridge device to the sink device according to the pull mode.
  • compressed video data may be streamed from the source device over a wireless link.
  • an additional pair of encoders and decoders does not need to be inserted into the datapath.
  • Video decoding may be performed once, by the sink device. Therefore, power consumption at the source device is significantly lower than the configurations described above with respect to FIGS. 3 and 4, and overall latency is comparable to that of the configuration of FIG. 3.
  • FIG. 15 shows a block diagram of a video streaming system 1500, according to an example embodiment.
  • system 1500 includes a portable electronic device 1502, an HD display device 1504, and a bridge device 1506.
  • System 1500 is described as follows.
  • portable electronic device 502 is a video source device enabled to stream HD video with relatively low power dissipation and low latency according to the push mode.
  • portable electronic device 1502 may be configured similarly to portable electronic device 502 of FIG. 5, or may be configured as described elsewhere herein or otherwise known.
  • HD display device 520 is an example video sink device configured to display the compressed video streamed by portable electronic device 502.
  • HD display device 1504 may be configured similarly to portable electronic device 520 of FIG. 5, or may be configured as described elsewhere herein or otherwise known.
  • Bridge device 1506 is configured to interface video content between portable electronic device 1502 and HD display device 1504.
  • portable electronic device 1502 may stream compressed video content 1508 to bridge device 1506 that includes video data from a video file stored in storage of portable electronic device 1502, that includes video data received by portable electronic device 1502 from a real time source (e.g., image data captured in real time by a camera of portable electronic device 1502, compressed video data received from a remote source by portable electronic device 1502, etc.), or that include video data from other source described elsewhere herein or otherwise known.
  • bridge device 1506 streams compressed video content 1508 to HD display device 1504 for display as video 114 by display screen 112.
  • FIG. 16 shows a flowchart 1600 for streaming video through a bridge device, according to an example embodiment.
  • bridge device 1506 of FIG. 15 may operate according to flowchart 1600.
  • FIG. 17 shows a block diagram of a video streaming system 1700, according to an example embodiment.
  • Video stream system 1700 is an example of video streaming system 1500 of FIG. 15.
  • system 1700 includes portable electronic device 1502, HD display device 1504, and a bridge device 1702.
  • Bridge device 1702 is an example of bridge device 1506 of FIG. 15.
  • Flowchart 1600 is described as follows with reference to system 1700 for illustrative purposes.
  • Flowchart 1600 begins with step 1602.
  • step 1602 a compressed video data stream that is transmitted according to a push mode is wirelessly received from a portable electronic device.
  • portable electronic device 1502 wirelessly transmits a compressed video data stream 1712.
  • Transmitted compressed video data stream 1712 includes streamed compressed video data (e.g., compressed video data 302 described above) from antenna 106 of portable electronic device 1502).
  • bridge device 1702 includes antenna 108, receiver 1704, video content bridging logic 1706, a communication interface 1708, and storage 1710.
  • Bridge device 1702 receives transmitted compressed video data stream 1712 at receiver 1704 via antenna 108.
  • Receiver 1704 outputs compressed video data stream 1714, which includes the received streamed compressed video data.
  • Portable electronic device 1502 transmits compressed video data stream 1712 according to the push mode. As such, portable electronic device 1502 initiates and controls the streaming of transmitted compressed video data stream 1712.
  • Video content bridging logic 1706 receives compressed video data stream 1714, and may optionally store and/or buffer the streamed compressed video data in storage 1710.
  • Video content bridging logic 1706 may be implemented in hardware, software, firmware, and/or any combination thereof.
  • video content bridging logic 1706 may be implemented as a proprietary or commercially available processor, such as an ARM (advanced RISC machine) core configuration, that executes code to perform its functions.
  • Video content bridging logic 1706 may be implemented as logic in a wireless communication chip, in one or more other types of chips, and/or in other forms.
  • Storage 1710 may include any suitable type of storage in the form of one or more storage devices, including one or more memory devices (e.g., random access memory (RAM)), and/or other types of storage.
  • One or more features of bridge device 1702 may be implemented in one or more chips, such as wireless chips, including one or more of receiver 1704, video content bridging logic 1706, communication interface 1708, and/or storage 1710.
  • a request is received from a display device for video content associated with the compressed video data stream to be received at the display device according to a pull mode.
  • HD display device 1504 may transmit a request 1718, which is a request for video content.
  • Request 1718 is provided according to the pull mode, where HD display device 1504 initiates video streaming by a source device according to request 1718.
  • Request 1718 is received by communication interface 1708 of bridge device 1702.
  • Communication interface 1708 may be any type of communication interface, including a wired communication interface.
  • communication interface 1708 may be a FIDMI (High-Definition Multimedia Interface), a DVI (Digital Visual Interface), a VGA (Video Graphics Array) interface, a USB interface, or other type of communication interface.
  • FIDMI High-Definition Multimedia Interface
  • DVI Digital Visual Interface
  • VGA Video Graphics Array
  • communication interface 1708 provides request 1718 to video content bridging logic 1706.
  • step 1606 compressed video data of the compressed video data stream is transmitted to the display device in response to the request.
  • video content bridging logic 1706 in response to request 1718, video content bridging logic 1706 generates a compressed video data stream 1716.
  • Compressed video data stream 1716 may be generated by video content bridging logic 1706 from compressed video data of compressed video data stream 1714 stored or buffered in storage 1710, or may be compressed video data stream 1714 that is directly forwarded by video content bridging logic 1706 in real time.
  • Communication interface 1708 transmits compressed video data stream 1716 to HD display device 1504.
  • HD display device 1504 may generate video 114 for display on display screen 112 based on compressed video data stream 1716 in any manner, including as described elsewhere herein.
  • bridge device 1506 may wirelessly interface with portable electronic device 1502 according to any suitable wireless communication protocol, and transmitted compressed video data stream 1712 may be transmitted by portable electronic device 1502 in any video data stream form, proprietary or commercially available, including as described above for transmitted compressed video data stream 508.
  • bridge device 1702 and HD display device 1504 may be interfaced together in any manner, including being connected together by proprietary or commercially available connectors.
  • FIG. 18 shows a block diagram of bridge device 1506 and HD display device 1504 connected together, according to an example embodiment. As shown in FIG.
  • bridge device 1506 has a first connector 1802 and HD display device 1504 has a second connector 1804.
  • First and second connector 1802 and 1804 are mated together to connect together bridge device 1506 and HD display device 1504.
  • First and second connectors 1802 and 1804 may be connectors of a commercially available connector type or may be proprietary connectors.
  • first and second connectors 1802 and 1804 may be USB connectors, HDMI connectors, VGA connectors, etc.
  • bridge device 1506 may have the form factor of a dongle, memory stick, or other device.
  • request 1718 may be transmitted by HD display device 1504 to bridge device 1702 through connectors 1802 and 1804, and compressed video data stream 1716 may be transmitted from bridge device 1702 to HD display device 1504 though connectors 1802 and 1804.
  • request 1718 may identify particular video content being requested for display at HD device 1504.
  • Request 1718 may identify the video content in any manner, including by file name, video content identifier, etc. Alternatively, request 1718 may not specify particular video content.
  • HD display device 1504 may process compressed video data stream 1716 as if HD display device 1504 is reading a video file.
  • video content bridging logic 1706 may feed a pre-generated FAT (file allocation table) to HD display device 1504 in response to request 1718.
  • FIG. 19 shows a block diagram of storage 1710 storing a dummy FAT 1902, according to an example embodiment.
  • Dummy FAT 1902 is a pre-generated file allocation table that simulates a real file allocation table, and may contain one or more dummy entries associated with dummy data clusters.
  • HD display device 1504 may receive and use the pre-generated FAT to proceed as if it is reading a video file from a storage device (e.g., U-disk), in a pull mode fashion.
  • bridge device 1506 emulates the simulated storage device, and can feed compressed video data stream 1716 to HD display device 1504 in regular order for a decoder of HD display device 1504 to perform video decoding.
  • FIG. 20 shows a flowchart 2000 for providing a compressed video data stream, according to an example embodiment.
  • bridge device 1506 of FIG. 15 may operate according to flowchart 2000.
  • Further structural and operational embodiments will be apparent to persons skilled in the relevant art(s) based on the following description of flowchart 2000.
  • Flowchart 2000 is described as follows with reference to system 1700 for illustrative purposes.
  • Flowchart 2000 begins with step 2002.
  • a request is received as a file read request from the display device.
  • request 1718 in FIG. 17 may be received by bridge device 1702 from HD display device 1504 as a request to read a file from bridge device 1702.
  • a pre-generated FAT is provided to the display device in response to the file read request.
  • bridge device 1702 may provide dummy FAT 1902 (FIG. 19) to HD display device 1504.
  • dummy FAT 1902 may be pre-stored in portable electronic device 1502 (e.g., in storage 1214 of FIG. 12) and/or in bridge device 1702 (e.g., as shown in FIG. 19) prior to request 1718 being received by bridge device 1702.
  • portable electronic device 1502 may generate and/or store a dummy FAT 1902 corresponding to video content to be provided in compressed video data stream 1712.
  • Dummy FAT 1902 may be transmitted from portable electronic device 1502 to bridge device 1702 prior to or at the time that display device 1504 transmits request 1718 to bridge device 1702.
  • Bridge device 1702 may receive dummy FAT 1902 from portable electronic device 1502, and may transmit dummy FAT 1902 to HD display device 1504 in response to request 1718 being received from HD display device 1504, requesting a FAT from bridge device 1702.
  • compressed video data stream 1712 may be transmitted from portable electronic device 1502 to bridge device 1702 according to the push mode.
  • the compressed video data is transmitted to the display device in response to the file read request to simulate file data being read from a data file having the pre-generated FAT.
  • bridge device 1702 may transmit compressed video data stream 1716 to HD display device 1504.
  • HD display device 1504 may attempt to read a file from bridge device 1702 corresponding to dummy FAT 1902, and in response to the read attempt, bridge device 1702 may transmit compressed video data stream 1716 to HD display device 1504.
  • Compressed video data stream 1716 may be transmitted to simulate file data being read from the data file corresponding to dummy FAT 1902.
  • Embodiments may have one or more advantages compared with current techniques. For instance, in embodiments, raw video is not wirelessly streamed, as in the configuration of FIG. 3 described above. Video content can be decoded once in the whole data path, by HD display device 1504, which is less power sensitive than portable electronic device 1502. GPU or CPU processing is not needed to generate full screen raw video. As such, minimal processing of the video file or video stream is performed by portable electronic device 1502. Furthermore, additional latency is not introduced by adding an encoder/decoder pair, as is needed in the configuration of FIG. 4 described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente invention se rapporte à des procédés, à des systèmes et à des appareils qui permettent la transmission en continu de données vidéo au moyen d'un dispositif de pont. Un flux de données vidéo compressées transmis depuis un dispositif électronique portable selon un mode push est reçu de manière non filaire par un dispositif de pont. Une requête est reçue en provenance d'un dispositif d'affichage pour un contenu vidéo associé au flux de données vidéo compressées qui doit être reçu au niveau du dispositif d'affichage selon un mode pull. Les données vidéo compressées du flux de données vidéo compressées sont transmises au dispositif d'affichage en réponse à la requête. Les données vidéo compressées sont configurées pour être décodées et affichées par le dispositif d'affichage sous la forme d'une vidéo.
PCT/CN2011/073683 2011-05-05 2011-05-05 Transmission en continu de données vidéo haute définition sans fil avec un pont intermédiaire WO2012149685A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/073683 WO2012149685A1 (fr) 2011-05-05 2011-05-05 Transmission en continu de données vidéo haute définition sans fil avec un pont intermédiaire

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/073683 WO2012149685A1 (fr) 2011-05-05 2011-05-05 Transmission en continu de données vidéo haute définition sans fil avec un pont intermédiaire

Publications (1)

Publication Number Publication Date
WO2012149685A1 true WO2012149685A1 (fr) 2012-11-08

Family

ID=47107744

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/073683 WO2012149685A1 (fr) 2011-05-05 2011-05-05 Transmission en continu de données vidéo haute définition sans fil avec un pont intermédiaire

Country Status (1)

Country Link
WO (1) WO2012149685A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10083621B2 (en) 2004-05-27 2018-09-25 Zedasoft, Inc. System and method for streaming video into a container-based architecture simulation

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394490A (zh) * 2007-09-20 2009-03-25 厦门华侨电子股份有限公司 一种无压缩的无线数字高清音视频信号的收发一体显示装置
CN101610317A (zh) * 2009-07-13 2009-12-23 扬州万事通通讯电子发展有限公司 一种移动终端电子产品
CN201733404U (zh) * 2010-06-09 2011-02-02 云南大学 一种高清嵌入式网络音视频解码装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394490A (zh) * 2007-09-20 2009-03-25 厦门华侨电子股份有限公司 一种无压缩的无线数字高清音视频信号的收发一体显示装置
CN101610317A (zh) * 2009-07-13 2009-12-23 扬州万事通通讯电子发展有限公司 一种移动终端电子产品
CN201733404U (zh) * 2010-06-09 2011-02-02 云南大学 一种高清嵌入式网络音视频解码装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10083621B2 (en) 2004-05-27 2018-09-25 Zedasoft, Inc. System and method for streaming video into a container-based architecture simulation

Similar Documents

Publication Publication Date Title
RU2679236C2 (ru) Устройство и способ декодирования и устройство и способ кодирования
US8903451B2 (en) Methods, systems and apparatus for displaying the multimedia information from wireless communication networks
CN102792689B (zh) 能够进行增量压缩以及对运动估计和元数据的修改以用于将图像呈现给远程显示器
JP5868997B2 (ja) 画像伝送装置、画像伝送方法、画像受信装置および画像受信方法
US9300754B2 (en) Information processing system, information processing apparatus, information processing method, and program
CA2737842C (fr) Interface utilisateur eloignee
JP6273383B2 (ja) 超高精細度ディスプレイを用いてワイヤレスドックのビデオ性能を最適化するためのシステムおよび方法
JP2013031024A (ja) 画像伝送装置、画像伝送方法、画像受信装置および画像受信方法
US8358918B2 (en) Video processing apparatus and video processing method
WO2012149685A1 (fr) Transmission en continu de données vidéo haute définition sans fil avec un pont intermédiaire
JP2012231350A (ja) 画像受信装置及び画像受信方法
KR20110025367A (ko) 멀티미디어 트랜스코딩 클라이언트 장치 및 방법
WO2012149684A1 (fr) Architecture de transmission en continu de données vidéo haute définition sans fil en mode push à faible période de latence et à faible niveau de puissance pour des dispositifs portables
US20120106918A1 (en) Interface device and data processing method
CN219875871U (zh) 一种用于横竖屏显示的投屏装置及电子设备
JP2019092183A (ja) 画像出力装置および出力方法
CN101610317A (zh) 一种移动终端电子产品
CN113747099B (zh) 视频传输方法和设备
JP2013031025A (ja) 画像伝送装置、画像伝送方法、画像受信装置および画像受信方法
KR100755849B1 (ko) 다른 형식의 복수개의 압축 포맷 데이터를 저장하는영상기기 및 그 제어방법
JP6472845B2 (ja) 画像受信装置
WO2012147786A1 (fr) Dispositif de transmission d'image et procédé de transmission d'image
KR20160144061A (ko) 초고선명 텔레비전용 보급형 메인보드
JP6200971B2 (ja) 画像伝送装置および伝送方法
KR20230025256A (ko) 전자장치 및 그 제어방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11864853

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 14/04/2014)

122 Ep: pct application non-entry in european phase

Ref document number: 11864853

Country of ref document: EP

Kind code of ref document: A1