TW200820752A - Multi-graphics processor system and method for processing content communicated over a network for display purposes - Google Patents

Abstract

A system and method are provided including a first graphics processor in communication with a content source. In operation, the first graphics processor is adapted for processing content from the content source. Further included is a second graphics processor in communication with the first graphics processor utilizing a network. The second graphics processor is adapted for further processing the content for display purposes.

Description

200820752 IX. DESCRIPTION OF THE INVENTION: TECHNICAL FIELD OF THE INVENTION The present invention relates to digital processing and, more particularly, to graphics/video processing. [Prior Art]

Prior Art Figure 1A illustrates a system 100 for graphics/video processing in accordance with the prior art. As shown, in this prior art system, graphics processor 102 is directly reduced to display (10). For this purpose, all necessary graphics and/or video processing to be displayed are performed by graphics processor 110 and then sent directly to display 104 in a format ready for display.此 This system 100 is ideal for traditional computer systems, but it may not be convenient for 2 other architectures. For example, the prior art is based on the prior art (4) system for performing graphics/video processing in the case of a wireless network. As shown, in this configuration, graphics processor 1〇2 communicates with display 104 via network 1〇6. The network 106 may include wireless network links using overclocking (uwb) technology, wireless multi-function serial bus (WUSB) technology, WiMedia technology, and/or: other desired network related technologies. While this configuration can provide acceptable performance in the context of a particular high speed network, problems can still arise due to any bandwidth limitations associated with network 106. The specific format of the traditional format associated with the content, graphics processing f output: processing architecture, etc. may not help efficient network transmission. For example, the content may be encrypted, compressed, and the like. Therefore, if the bandwidth is not sufficiently large, this can lead to content display difficulties. 123292.doc 200820752 Difficult and may not be displayed. Therefore, this is related to and/or other issues. SUMMARY OF THE INVENTION The present invention provides a system and method, a first diagram comprising a brother (four) communicating with a content source - in operation for processing content from the content source . The m-person Zhou Shi after the m ^ , further includes the use of a network to communicate with the first graphics processor ^ ^ ® ^, the first graphics processor. The second picture

The shape processing is adapted for further processing of the content for display purposes. [Embodiment]: A system 200 for displaying network communication valley processing for display is not according to one embodiment. As shown, the 'inclusion-content source 2〇2 is used to feed the -graphic processor 204 for processing (e.g., graphics processing and/or video processing, etc.) content from the content source 2G2. In the context of this description, 'in this valley source 2〇2 may refer to any content source [eg, a network, a memory having a digitally versatile compact disc (DVD) format, a hard disk, etc.], wherein the content may include Graphical material and/or video that can be processed for display purposes. When in the various embodiments, the content may even include audio and/or metadata. As further shown, one of the second graphics processors 2〇8, which is in communication with the first graphics processing unit 204 via the network 2〇6, is also included. The second graphics processor 202 is also adapted for further processing (eg, graphics processing and/or video processing within the valley for display purposes. As shown, a display can be maintained for this purpose and second The graphics processor 2〇8 communication. It should be noted that although the graphics processor is not directly linked to the remaining components, the links are only for communication. Therefore, the 1st is the same. The system 200 may or may not include additional components for communication between graphics processors. It should be noted that other embodiments are also contemplated in which - or a plurality of processors are employed in place of the aforementioned graphics processor, wherein the processor is capable of Performing loss video processing without necessarily performing any graphics processing 0 It should also be noted that the network 206 can take any form including, but not limited to, an area, a road (LAN), a wireless network, a wide area network such as the Internet ( WAN), peer-to-peer network, etc. In various alternative embodiments, the network write can include a wireless network link that includes any connection associated with the benefit line network in the context of the present description. By way of example only, the wireless network keying may employ ultra-wideband (deletion) technology, a wireless universal serial bus (wc technology, WiMedia technology, etc.) will be described below with reference to the wireless network when referring to subsequent figures. Further information on one possible embodiment of the road. In use, the first graphics processor 204 and the second graphics processor 2〇8 are adapted to process such content. In various embodiments, the first graphics processor 204 And the second graphics processor 2〇8 may be asymmetric or non-asymmetric. For example, in the embodiment, the first number of processes performed by the first graphics processor 204 may be A second number of inverse functions of the processing performed by the second graphics processor 2〇8. Further information on one possible embodiment including this dynamic adaptation will be set forth below when referring to subsequent figures. In an embodiment, the processing performed by the first graphics processor 2〇4 (and/or even the processing performed by the second graphics processor 2〇8 in this regard) may be an adaptive. For example, The execution of the first-level graphics processor can be changed as a function of any of the factors. The processing can be changed as a function of the following factors: bandwidth, desired service quality (QoS) At least one aspect of the content, or display, the type or amount of processing performed by the second graphics process 11208, and/or any other desired factor.

The processing performed by the processor 204 and/or the second graphics processor 208 may include, but is not limited to, decryption, decompression, post-processing, multiplex processing, error correction processing, packetization, solution Encapsulation, graphics rendering, composition, recompression and/or re-encryption. Of course, this processing performed by the graphics processor 204 and/or the second graphics processor 2A8 in the context of this description may include any processing that causes, or at least partially causes, transmission and/or display of content via the network. In still another alternative embodiment, the plurality of first and/or second graphics processors operating in conjunction with each other may comprise one of the graphics processors. An example of this technology is NVIDIA SLITM technology. Further information on one of the examples of the related embodiments can be found by reference to the application Serial No. 10/990,712, filed on Nov. 17, 2011, which is hereby incorporated by reference. Further illustrative information regarding various alternative architectures and features will now be presented, which may be constructed with or without such optional architectures and features as desired by the user. It should be noted that the following information is presented for illustrative purposes only and should not be construed as limiting the way. Any of the following features may be excluded by human or non-personality of other features described. 123292.doc • 9- 200820752 FIG. 3 shows a system for processing content prior to linking communication content over a wireless network, in accordance with an exemplary embodiment. As an option, the system can be implemented under the principles of system 200 of FIG. However, it is of course possible to implement the system in any desired environment. Moreover, the above definitions apply during the following description. As shown, the system 300 includes a graphics processor 326 which, in one embodiment, can function in conjunction with a computer 〇1. The computer can include memory 3〇2 and central processing unit 304 (CPU) in communication with the graphics processor 306. In one embodiment, the graphics processor 302 can include a plurality of modules, as shown. Each of these modules can even be located on a single semiconductor platform to form a graphics processing unit (GPU) [e.g., discrete GPU, integrated GPU (iGPU), etc.]. In the present description, a single semiconductor platform may refer to an integrated circuit or wafer based on a single semiconductor. It should be noted that the term "single semiconductor platform" may also refer to a multi-chip module with increased connectivity, which simulates operation on a wafer and makes substantial improvements by utilizing conventional CPU and busbar implementations. Depending on the needs of the user, the various modules can be individually positioned or positioned using various combinations of semiconductor platforms. ▲, ', ί Referring to Figure 3, the graphics processor 3〇6 includes a plurality of modules, such The module includes a decryption/decompression module 3〇8, a post-processing module, a graphics reproduction module 312, a synthesis module 314, a recompression module 316, a re-encryption module 318, an epoch/error correction/packet module. 320 and interface 322. Although the various combinations of these various modules are used (and not used), it should be noted that 123292.doc 200820752 pays more attention to the content and/or processing related requirements, where appropriate Any one or more of the foregoing modules may or may not be included and/or may be used in the case of a transmitter and/or receiver.

In use, the decryption/decompression module 308 receives content from a content source (e.g., see, for example, the content source 202 of FIG. 2, etc.). In an embodiment of encrypting and/or compressing this content, the decryption/decompression module 3〇8 is used to decrypt and/or decompress the content for further processing. For example, in the case of the video in the MPEG format, the format can be decompressed 4 and 'the module 3 can be used to display any video and graphic data for reasons that will become apparent later. separate. As an option (especially if the content contains video), the post-processing module 3ι can be used for any desired post-processing that may be required. Processing thereafter may include, but is not limited to, pixel processing, video processing (eg, chirp correction, motion estimation or compensation, decompression, color space control, brightness, saturation, color temperature correction, sharpening: overlay processing, scaling, encoding, Deinterlace, scale up/down, etc.). This example is set forth for illustrative purposes only and should not be construed as being performed in any manner, as the post-processing module 3ig can perform any type of post-processing. As an additional option, the content on the right contains graphics data that can be utilized by the graphics processor, and the content can be input to the graphics rendering module 3 12 for use in any type of graphics, including (but not Limited to) pixel shading, texture shading, and the like. For example, Gu Lei;;^ Jσ Electronic Guide (EPG) information can be incorporated into the video, where the EPG 1 is the object of the graphic processing. 123 123292.doc 200820752 Right needs the content to contain Graphical data (if any) and video (eg, in separate streams) and available bandwidth allowable, skip any one or more of the various illustrated modules to bypass to multiplexer/error Correction related processing/packet module 320 (described in more detail later). See path 313. It should be further noted that an operational mode is contemplated in which no post-processing, graphics rendering, etc. are required, so that the decryption/decompression module 308 can only deliver content without performing this processing.

On the other hand, if the combined graphics data and video (e.g., in a single stream format, etc.) are combined, the output of the graphics rendering module 312 can be fed to the composites 2, and 3 14 . As such, the synthesis module 314 can be used to synthesize any uncompressed viewing valleys and resulting graphics data. Although this synthetic content may take any form < in some embodiments, it may include a synthetic National Television Standards Committee (NTSC) format, progressive phase inversion (pAL) format, y/c (sigma , , and L Λ 14 storage color television system (SECAM) format, high definition television (HDTV) format, advanced television system committee (ATSC) format, any digital television format that can be reduced by I, and / or can include video Other formats of graphics data and/or combinations of video and graphics data. For this purpose, the combined graphics data and video can be re-encrypted by the re-encryption module 316 by the re-compression module 316#®^'. This recompression/re-addition can be beneficial in a variety of environments, for example, via a high definition channel (eg, where the throughput is 192 Gxl_x24x6 (four) months 3

In the embodiments of Gb/S), this recompression/re-encryption can be used to ensure that the communication is feasible via the medium. No, the module feeds from this module is still self-decrypting/decompressing 123292.doc -12· 200820752 Module 308/post-processing module 310 directly feeds the insider by multiplex test/torque correction related processing/packet mode Group 320 processes the content. Special - one module 32. Used to perform the use of any available parity information: two positives of any 192 multiplexed packets that are to be processed and the content is encapsulated. "^丨面Γ:

Also included is a transmitter 324 that communicates with the graphics processor 326 to transmit content over the wireless network 325 such that the display 326 can be utilized to display the content. In various embodiments, the transmitter 324 can employ wireless network bonding using technology, WUSB technology, technology, etc. In addition, much information about this display 326 will be set forth in greater detail during the reference to FIG. As mentioned earlier, the processing performed by graphics processor 〇6 can be dynamically adaptable. In addition, this process can be adapted as a function of: the job, the desired quality of service (Q〇S), the type or amount of processing performed by the second graphics processor (described later), and/or any Other desired factors. To facilitate this feature, feedback from transmitter 324 can be communicated back to the appropriate module of graphics processor 3〇6 in the manner shown. For example, if the transmitter 324 detects a change in the available bandwidth, it can deny the recompression module 3 16 and/or the re-encryption module 3 to 8 using a higher-level C-shrink/addition, and different The law adapts to this change. Of course, this change may occur at the expense of more processing cycles and the like. Similar adaptations can be presented in response to changes in the desired q〇s. More information on this dynamic adaptation will be presented in more detail during the reference to Figure 5. Although not shown, the system 3 can also include a secondary storage device. The two 123292.doc -13- 200820752 level storage devices may include, for example, hard disks and/or removable storage devices, which may be embodied as floppy disks, magnetic t, compact disks, DVDs, solid state storage devices (eg, fast) Flash memory) and so on. The removable storage device is read and/or written in a known manner by the time-removable storage device drive. The computer program or computer control logic algorithm can be stored in system memory 302 and/or secondary storage. These computer programs, when executed, enable the system 300 to perform various functions. System memory 3, storage devices, and/or any other storage device are possible examples of computer readable media. In one embodiment, in the CPU 304, a chipset (ie, an integrated circuit group designed to operate and sell as a unit for performing related functions, etc.) and/or any other integrated circuit used in this regard The various functionalities set forth herein are implemented or partially implemented. Moreover, the architecture and/or functionality set forth herein may be implemented in the context of a general purpose computer system, a circuit board system, a game console system dedicated to entertainment purposes, a special application system, and/or any other desired system for use in this regard. . 4 shows a system for processing content after linking communication content over a wireless network, in accordance with another exemplary embodiment. As an option, the system can be implemented under the principles of system 200 of FIG. However, it is of course possible to implement the system in any desired environment. Moreover, the above definitions are applicable during the following description. As shown, a computer system 404 is included that operates to communicate content to system 400 via wireless network 425. In one embodiment, the computer system 404 can include the system 300 of FIG. The system 400 is illustrated as including a graphics processor 408 that communicates with the network 425 via a receiver 406. As with 123292.doc -14 - 200820752 where a graphical option is incorporated, system 400 can take the form of display 4〇2 processor 408. Sabedo sees Figure 4, the graphics processor 4〇8 contains a plurality of modules, the group includes a demultiplexer/error correction related processing/decapsulation module, a picture: a decryption/decompression module 412, a video decompression Module 414, post processing = 416, synthesis module 418, and digital output 42〇. Feeding content to the multiplexer/error school from the receiver 4〇6 in use

The positive correlation processing/decapsulation module 41〇'α is used to perform the functionality complementary to the multiplexer/=correction related processing/packet module 3 paper function of FIG. In particular, the content can be processed to provide error correction capabilities, solved, and processed. In addition, any video may be separated or not separated from any graphics material after being decrypted and/or decompressed via graphics decryption/decompression module 412. As an option, the graphic data and video can be kept combined (for example, in a single capture form, etc.), and the sub-transfer is directly transmitted to the digital output 42 for the purpose. See road control 413. On the other hand, it is possible to continue to decompress any video by using the video de-dusting module 414 to continue to perform any video in various embodiments in which the inner valley is extremely valuable. Compression can be used to support Advanced Access Content System (AACS), Windows Media Digital Rights Management (WM-DRM), DRM compliant with COpPP, and more. Moreover, post processing can be performed by the post processing module 4丨6 as appropriate. Of course, the subsequent processing may include any of the processes mentioned above during the description of the similar module 3 of Figure 3. Moreover, as mentioned first, the first number of locations 123292.doc -15-200820752 performed by the graphics processor 3〇6 of FIG. 3 may be the second number of inverses of the processing performed by graphics processor 408. function. For example, post-processing required may be shared at each of the following: Groups 3i and 416, and may be further adapted to any differences associated with the video being processed. Moreover, the synthesis module 418 can be used to function in a manner similar to the similar module 314 of FIG. As mentioned earlier, any or more of the aforementioned modules of each of the graphics processors of Figures 3 through 4 may or may not be used depending on the content/processing related requirements. Specifically, during use, at least one or more of the graphics processing modules may be selected for supporting communication through the network for subsequent display. More information about this dynamic adaptability will now be presented. FIG. 5 shows a method for dynamic processing of communication content through a link of a benefit line in accordance with an exemplary embodiment. ^ β冯琏 items, available in Figure 2

The implementation of the method under the principle of System 200 of V is advantageous, of course, in any desired environment. For example, it is contemplated that method 5 can be implemented with only one graphics processor (e.g., see, for example, the first of FIG. 2 - graphics processor class and/or first graphics processor 208, etc.). As shown in the figure, the operation 502 is received at a graphics processor including a plurality of modules. For example, in an embodiment in which the graphics processor includes the first = processing H2 〇 4 of FIG. 2 or the like, the various modules can be - or more of the following modules - cryptographic modules, Reduced module, decrypted ^, decompressed module, post-processing module, graphics processing module and / or = group (as stated earlier). In this embodiment, the graphics processor can be integrated or left separate from the associated computer. 123292.doc -16 - 200820752 The second graphics processor 208 or the like may include one or more decapsulation modules, a post-processing module, and another embodiment of the graphics processor including the second embodiment of FIG. Among them, various modules: decryption module, decompression module, demultiplexing module, synthesis module and error # hole only positive correlation processing module (as stated earlier). In this embodiment, the graphics processing is integrated or kept separate from the associated display.

Less m-like 'type or number of processing performed by another-graphics processor (if any) and/or any other desired factor. As an alternative, with continued reference to Figure 5, the recognition affects the insertion 504. The quality of service (QoS), content (such as various feedbacks that can be used to provide the above-mentioned factors for processing to be described, may include bandwidth, desired 'format, size, etc.) or display to

To this end, one or more of the modules of the graphics processor can be dynamically selected for processing the content to support communication over the network and/or subsequent display of the content using the display. & intended to operate 5G6. It should be noted that this process can vary at which end of the network the view processor configuration is configured. For example, in the foregoing embodiment where the graphics processor includes the first graphics processor 2〇4 of FIG. 2, etc., the processing may involve preparing content for transmission over the network. In addition, such processing by selected modules may include decryption, decompression, post-processing, multiplexing, processing to provide error correction, encapsulation, graphics rendering, synthesis, recompression, and/or re-encryption. 2 and the foregoing embodiment of the graphics processor includes the second graphics processor 208 of FIG. 2, etc., the processing may include receiving and preparing content for display using the display. In addition, such processing by the selected module can be performed by 123292.doc -17- 200820752, including decryption, decompression, decapsulation, post-processing, de-multiplexing, synthesis, and/or providing error correction processing. Of course, any type of module and associated processing capable of supporting communication over the network for subsequent display with the display can be provided and dynamically selected in the manner previously described. Therefore, depending on current needs, it can be adapted to various situations. For example, the incoming compressed content may or may not be decrypted/decompressed, and if it is secreted/decompressed, various additional processing may be performed or not performed (eg, % mesh processing, synthesis, etc.) . In addition, all such choices can be implemented as a function of four factors including, but not limited to, q〇S requirements, network restrictions (eg, step width, etc.), content receiving format, content Required for network transmission, user configuration / requirements, etc. In the case of a particular instance, the compressed/encrypted format can be used to receive the internals without any additional processing required (e.g., satisfying all bandwidth, QoS, etc. requirements). In this case, the content may not necessarily be decrypted/decompressed, but only transmitted. In another embodiment, the decrypted/decompressed content may require additional processing and is therefore decrypted/decompressed such that post processing, graphics processing, etc. may be performed. At this point, recompression/decompression can be performed or not performed based on the relevant needs. Various embodiments have been described above, but it should be understood that the various embodiments are presented by way of example and not limitation. Therefore, the scope and scope of the preferred embodiments should not be limited by any of the above-described exemplary embodiments, but should be defined only by the scope of the following claims and their equivalents. [Simple Description of the Drawings] 123292.doc -18- 200820752 Pre-Uranium Technology Figure 1A illustrates a system for graphics/video processing according to the prior art. Prior Art Figure 1B illustrates a system for performing graphics/video processing in the context of a wireless network in accordance with the prior art. 2 shows a system for displaying content processing over a network communication in accordance with one embodiment. 3 shows a system for processing content prior to keying communication content over a wireless network, in accordance with an exemplary embodiment. Figure 4 shows a system for processing content after it is linked through a wireless network, in accordance with another exemplary embodiment. FIG. 5 shows a method for dynamic processing of communication content via a wireless network link for display according to an exemplary embodiment. [Main Component Symbol Description] 100 System 102 Graphics Processing 104 Display 106 Wireless Network 150 System 200 System 202 Content Source 204 First Graphics Processor 206 Network 208 Second Graphics Processor 210 Display 123292.doc -19- 200820752 300 System 301 Computer 302 System Memory 304 Central Processing Unit (CPU) 306 Graphics Processor 308 Decryption/Decompression Module 310 Post Processing Module 312 Graphics Reproduction Module

313 Path 314 Synthesis Module 316 Recompression Module 318 Re-Encryption Module 320 Multiplexer/Error Correction/Packet Module 322 Interface 324 Transmitter 325 Wireless Network 326 Display 400 System 402 Display 404 Computer System 406 Receiver 408 Graphics Processor 410 Demultiplexer/Error Correction Related Processing/Unpacking Module 412 Graphics Decryption/Decompression Module 123292.doc • 20· 200820752 413 Path 414 Video Decompression Module 416 Post Processing Module 418 Synthesis Module 420 Digital Output 425 Wireless Network 500 Method 123292.doc -21

Claims (1)

200820752 X. Patent application scope: 1 . A system comprising: a first graphics processor communicating with a content source, the first graphics processor for processing content from the content source; and a first graphics processing state 'It communicates with the first graphics processing state via the network'. The second graphics processor is used to further process the content for display purposes. The system of claim 1 wherein at least one of the first graphics processor and the second graphics processor comprises a graphics processing unit. / month system of claim 1 wherein the first graphics processor and the second graphics processor are asymmetric. 4. A system of requesters, wherein the network includes a wireless network. 5. The system of claim 4, and further comprising a transmission Is with the first graphics processor I κ for transmitting the content over the wireless network for communication with the second graphics processor receive. The system of the moon long shell 1 'where the processing performed by the first graphics processor is free from the selection of the following components: · decryption, decompression, post-processing, multiplexing, error correction processing, packet, Graphics reproduction, synthesis, recompression and re-encryption. This multiplex is performed by the graphics processor, providing error correction, recompression, and re-encryption. The system of claim 1, wherein the first processing comprises decryption, decompression, post-processing, processing, encapsulation, graphics rendering, synthesis, and the system of claim 1, wherein The first process is dynamically adaptable. 123292.doc 200820752 9. The system of claim i, in which the first processing is from i, ,; nr々t, the composition of the 勹 勹 ^ ^ f, the choice, the decompression, the decompression, Post-processing, solution more than 10, ^. Solution synthesis and provide error correction processing. 10. For the system of the item i, the .w ^ is executed by the second graphics processor, and the processing includes decryption, decompression, and despreading. The name of the U machine is unpacked, post-processed, and demultiplexed. , man-made and provide error correction processing. Port 11 A subsystem comprising: a processor that communicates with a second processor via a network; and - a number of processes performed by the first processor are executed by the processor The processing is one of the inverse functions of the first and the second, and the processing of the first processor and the second processing 5|妒, 佳, 、, 曰+ is sufficient for video processing or graphics processing. 12_ — A method that includes: Receiving content at a graphics processor comprising one of a plurality of modules; and dynamically selecting one or more of the modules of the graphics processor for processing DH's valley to support bonding through a wireless network Communication and subsequent display of the content using a display. 13. The method of claim 12, wherein the graphics processor comprises a graphics processing. 14. The method of claim 12, wherein the modules comprise an encryption module. 15. The method of claim 12, wherein the modules comprise a compression module. The method of claim 12, wherein the modules comprise a decryption module. 17. The method of claim 12, wherein the modules comprise a decompression module. 18. The method of claim 12, wherein the modules comprise a post processing module. The method of claim 12, wherein the modules comprise a graphics processing module. 20. The method of claim 12, wherein the modules comprise a composite module. The method of claim 12, wherein the processing comprises preparing the content for transmission over the wireless network link. A system comprising: a processor capable of performing graphics processing or video processing, the processor comprising a plurality of modules adapted to dynamically select content to support transmission through a wireless network The transmission of the link is performed and the subsequent display of the content is performed using a display. 23. The system of claim 22, wherein the processor is integrated with a computer, and the processing further comprises preparing the content for transmission over the wireless network link. 24. The system of claim 22, wherein the processor is integrated with a display, and the processing further comprises receiving the content via the wireless network link and preparing the content for display using the display. 123292.doc