KR100960164B1 - Multi-graphics processor system and method for processing content communicated over a network for display purposes - Google Patents

Abstract

The system and method are provided comprising a first graphics processor in communication with a content source. In operation, the first graphics processor is adapted to process content from a content source. Also included is a second graphics processor that communicates with the first graphics processor using a network. The second graphics processor is adapted to further process the content for display purposes.

Graphics processor, content, network, graphics processing, video processing

Description

MULTI-GRAPHICS PROCESSOR SYSTEM AND METHOD FOR PROCESSING CONTENT COMMUNICATED OVER A NETWORK FOR DISPLAY PURPOSES}

The present invention relates to digital processing, and more particularly to graphics / video processing.

1A shows a system 100 for graphics / video processing according to the prior art. As shown, the graphics processor 102 is directly connected to the display 104 in this prior art system 100. For this purpose, all necessary graphics and / or video processing of the content to be displayed may be performed by the graphics processor 102 and then sent directly to the display 104 in the format prepared for display. Such a system 100 is ideal for conventional computer systems, but is not necessarily convenient for other frameworks.

For example, FIG. 1B illustrates a system 150 for graphics / video processing in the context of a wireless network 106 according to the prior art. As shown, in this configuration, the graphics processor 102 communicates with the display 104 via the network 106. Such a network 106 may include a wireless network link using ultra wide band (UWB) technology, wireless universal serial bus (WUSB) technology, WiMedia technology, and / or any other desired network related technology.

This configuration provides satisfactory performance in the context of certain high speed networks, but can still cause problems as a result of any bandwidth limitations associated with the network. In particular, conventional formats, graphics processor outputs, processing architectures, etc. related to the content may not be helpful for efficient network transmission. For example, the content can somehow be encrypted, compressed, or the like.

Thus, if the bandwidth is large but insufficient, the display of the content may be difficult and may not be possible. Therefore, there is a need to overcome these and / or other problems associated with the prior art.

The system and method are provided comprising a first graphics processor in communication with a content source. In operation, the first graphics processor is adapted to process content from the content source. Also included is a second graphics processor that communicates with the first graphics processor using a network. The second graphics processor is adapted to further process the content for display purposes.

According to the present invention, the display of content can be effectively improved.

2 illustrates a system 200 for processing content communicated over a network for display purposes, according to one embodiment. As shown, a content source 202 is included, which is a first graphics processor for processing (eg, graphics processing and / or video processing, etc.) content from the content source 202. 204 serves to supply content. In the context of the present description, such content source 202 may refer to any content source (eg, network, memory in the form of a digital versatile disc (DVD), hard disk, etc.), where the content is for display purposes. It may include graphical data and / or video that may be processed. Of course, in various embodiments, the content may even optionally include audio and / or metadata.

As also shown, a second graphics processor 208 is also included in communication with the first graphics processor 204 via the network 206. The second graphics processor 208 is adapted to further process the content (eg, graphics processing and / or video processing, etc.) for display purposes. As shown, the display 210 may be in communication with the second graphics processor 208 for that purpose. It should be noted that while the graphics processors are shown as being directly connected to each of the remaining components, such connections only indicate communication. Thus, system 200 may or may not include additional components that communicate between graphics processors. It should be noted that other embodiments are also contemplated in which a processor (s) capable of video processing without necessarily any graphics processing are employed in place of the graphic processor (s) described above.

The network 206 includes any form including but not limited to a wide area network, such as a local area network, a wireless network, the Internet, a peer-to-peer network, and the like. It should also be noted that can be taken. In various optional embodiments, network 206 may involve, in the context of the present description, a wireless network link that includes any connection associated with the wireless network. By way of example only, such a wireless network link may employ ultra wide band (UWB) technology, wireless universal serial bus (WUSB) technology, WiMedia technology, and the like. More information about one possible embodiment involving a wireless network will be disclosed while referring to the following figures below.

In use, the first graphics processor 204 and the second graphics processor 208 are adapted to process such content. In various embodiments, the first graphics processor 204 and the second graphics processor 208 may or may not be asymmetric. For example, in one exemplary embodiment, the first amount of processing performed by the first graphics processor 204 is a reciprocal function of the second amount of processing performed by the second graphics processor 208. Can be. Also, more information about one possible embodiment involving such dynamic adaptation will be disclosed while referring to the following figures below.

In other embodiments, the processing performed by the first graphics processor 204 (and / or even related to the second graphics processor 208) may be dynamically adaptable. For example, the processing performed by the first graphics processor 204 may vary as a function of any one of a variety of factors. By way of example only, such processing may include bandwidth, desired quality of service (QoS), at least one aspect of content or display, type or amount of processing executed by the second graphics processor 208, and / or any other desired factor. Can change as a function of

In addition, the processing performed by the first graphics processor 204 and / or the second graphics processor 208 may include decryption, decompression, post-processing, multiplexing, May include de-multiplexing, processing to provide error correction, packetization, de-packetization, graphics rendering, compositing, recompression, and / or re-encryption. However, it is not limited thereto. Of course, in the context of this description, such processing performed by the first graphics processor 204 and / or the second graphics processor 208 may, at least in part, cause any content to be transmitted and / or displayed over a network. May include processing of.

In another alternative embodiment, the first and / or second graphics processor may include one of a plurality of graphics processors operating in conjunction with each other. One example of such technology is NVIDIA SLI ™ technology. For more information regarding one example of a related embodiment, reference may be made to application number 10 / 990,712, filed November 17, 2004, which is incorporated herein by reference in its entirety.

More exemplary information will now be disclosed with respect to various optional architectures and features in which the aforementioned framework may or may not be implemented as desired by a user. It should be borne in mind that the following information is disclosed for illustrative purposes and should not be construed in any way as restrictive. Any of the features below may be optionally included with or without the other features described.

3 illustrates a system 300 for processing content prior to being communicated over a wireless network link, according to one exemplary embodiment. Optionally, the system 300 may be implemented under the principles of the system 200 of FIG. 2. However, of course, system 300 may be implemented in any desired environment. In addition, the above definitions may be applied during the following description.

As shown, in one embodiment system 300 includes a graphics processor 306 that can work with computer 301. Such a computer may include a memory 302 and a central processing unit (CPU) 304 in communication with the graphics processor 306.

In one embodiment, graphics processor 306 may include a plurality of modules as shown. Each of such modules may even be located on a single semiconductor platform to form a graphics processing unit (GPU) (eg, an individual GPU, an integrated GPU (iGPU), etc.).

In the present description, a single semiconductor platform may refer to a single single semiconductor based integrated circuit or chip. The term single semiconductor platform may refer to multi-chip modules with increased connectivity, simulating on-chip operation, resulting in significant improvements over using conventional CPU and bus implementations. It should be noted. Of course, various modules may be individually located or various combinations of semiconductor platforms according to a user's desire.

With continued reference to FIG. 3, the graphics processor 306 may include the decryption / decompression module 308, the post processing module 310, the graphics rendering module 312, the synthesis module 314, the recompression module 316, A plurality of modules including a re-encryption module 318, a multiplexer / error correction / packetization module 320, and an interface 322. While various combinations using (and not using) these various modules are disclosed below, depending on the content and / or processing related requirements, any one or more of the aforementioned modules may, where appropriate, be used in the context of the transmitter and / or receiver. It should be borne in mind that it may or may not be included and / or used in the present application.

In use, the decryption / decompression module 308 receives content from the content source (see, for example, content source 202, etc. of FIG. 2). In embodiments in which such content is encrypted and / or compressed, decryption / decompression module 308 functions to decrypt and / or decompress such content for further processing. For example, if the content includes MPEG-formatted video, such formatting may be decompression or the like. In addition, module 308 may function to separate any video from the graphic data for reasons that will soon become apparent.

Optionally (particularly where the content comprises video), the post processing module 310 may function for any desired post processing that may be desirable. Such post-processing may include pixel processing, video processing (e.g., gamma correction, motion estimation or compensation, decompression, color space control, luminance, saturation, color temperature correction, sharpening, overlay processing, scaling, encoding, deinterlacing (de). -interlacing), up / down scaling, etc.), but is not limited thereto. Since any type of post-processing may be performed by the post-processing module 310, these examples are disclosed for illustrative purposes only and should not be construed as limiting in any way.

As an additional option, if the content includes graphics data that can introduce the graphics processing capabilities of the graphics processor 306, the content can be of any type including, but not limited to, pixel shading, texture shading, and the like. It may be input to the graphics rendering module 312 for graphics processing. For example, electronic programming guide (EPG) information may be integrated with video, where such EPG information may be subject to the graphic processing described above.

If it is desired for the content to include separate graphical data (if present) and video (eg in separate streams) and available bandwidth grants, then one or more of the various illustrated modules may be multiplexer / error corrected. It may be skipped to bypass to the associated processing / packetizing module 320 (which will be described in more detail below). See route 313. It should also be noted that no post-processing, graphics rendering, etc. are required or desirable, and thus the mode of operation is considered where the decryption / decompression module 308 can simply pass content without such processing.

On the other hand, if graphics data and video are mixed (eg, in a single stream, etc.), the output of graphics rendering module 312 may be input to synthesis module 314. As such, the compositing module 314 may function to synthesize any uncompressed video content with the resulting graphic data. Such synthesized content may take any form, and in some embodiments, the synthesized National Television System Committee (NTSC) format, phase alternating line (PAL) format, Y / C (S-video) format, SECAM (sequential) couleur avec memoire format, high definition television (HDTV) format, Advanced Television Systems Committee (ATSC) format, any digital television format that can be compressed, and / or video, graphic data, and / or a combination of video and graphic data It may include other formats that may include.

Because of this, the mixed graphic data and video can be recompressed by the recompression module 316 and can also be re-encrypted by the re-encryption module 318. Such recompression / re-encryption may function to benefit various embodiments. For example, in embodiments where content is communicated over a high resolution channel (e.g., where throughput is 1920x1080x24x60 = 3.3 Gb / s), such recompression / re-encryption may cause graphics data or the like to be well communicated through such media. To ensure that it can

In addition, whether content is input from such modules or directly from decryption / decompression module 308 / post-processing module 310, the content is processed by multiplexer / error correction related processing / packetization module 320. do. In particular, such a module 320 provides the ability to provide error correction using any available parity information, packetize the content and perform any desired processing through the interface 322 where the resulting packets can be multiplexed. Do it.

Also included is a transmitter 324 that communicates with the graphics processor 306 to deliver content over the wireless network 325 so that such content can be displayed using the display 326. In various embodiments, such a transmitter 324 may employ a wireless network link using UWB technology, WUSB technology, WiMedia technology, or the like. Also, more information about such display 326 will be disclosed in more detail while referring to FIG. 4.

As described above, the processing performed by the graphics processor 306 may be dynamically adapted. Such processing may also be adapted as a function of bandwidth, desired quality of service (QoS), type or throughput of processing performed by the second graphics processor (to be described later), and / or any other desired factor. To facilitate this feature, feedback from the transmitter 324 may be communicated back to the appropriate module (s) of the graphics processor 306 in the manner shown.

For example, if transmitter 324 detects a change in the available bandwidth, transmitter 324 may use a more advanced compression / encryption algorithm to recompress module 316 and / or re-encryption module 318. You can instruct them to adjust the change. Of course, such a change may result in more processing cycles or the like. Similar adaptation may appear in response to a desired QoS change or the like. More information regarding such dynamic adaptation will be disclosed in more detail while referring to FIG. 5.

Although not shown, system 300 may also include secondary storage. Secondary storage may include, for example, hard disks and / or removable storage (representing floppy disks, magnetic disks, compact disks, DVDs, solid state storage (eg, flash memory), and the like). In use, the removable storage drive reads from and / or writes to the removable storage in known manner.

Computer programs, or computer controlled logic algorithms, may be stored in system memory 302 and / or secondary storage. Such computer programs, when executed, enable the system 300 to perform various functions. System memory 302, storage and / or any other storage device are possible examples of computer-readable media.

In one embodiment, the various functions disclosed herein may include a CPU 304, a chipset (eg, a group of integrated circuits designed and sold to act as a unit for performing related functions, and / or any associated therewith). It may be implemented in part in the context of other integrated circuits. In addition, the architectures and / or functions disclosed herein may be implemented in the context of general computer systems, circuit board systems, entertainment-only game console systems, application specific systems, and / or any other desired system related thereto.

4 illustrates a system 400 for processing content after being communicated over a wireless network link, according to another example embodiment. Optionally, the system 400 may be implemented under the principles of the system 200 of FIG. 2. However, of course, system 400 may be implemented in any desired environment. Still, the above definitions apply during the following description.

As shown, computer system 404 is included that operates to communicate content to system 400 via wireless network 425. In one embodiment, such computer system 404 may include system 300 of FIG. 3. System 400 is illustrated to include a graphics processor 408 in communication with network 425 via receiver 406. Optionally, the system 400 may take the form of a display 402, and the graphics processor 408 may be integrated therein.

With continued reference to FIG. 4, the graphics processor 408 includes a demultiplexer / error correction-related processing / depacketizing module 410, a graphics decryption / decompression module 412, a video decompression module 414, Post-processing module 416, synthesizing module 418, and digital output 420.

In use, the content is transmitted from the receiver 406 to a demultiplexer / error correction-related process / depacket that performs a function complementary to that of the multiplexer / error correction-related process / packetization module 320 of FIG. It is provided to the module 410. Specifically, content can be processed, depacketized, and demultiplexed to provide error correction capabilities. In addition, any video may or may not be separated from any graphics data after decryption and / or decompression via graphics decryption / decompression module 412.

Optionally, the graphics data and video may remain combined (ie, in a single stream, etc.) and may be sent directly to the digital output 420 for display purposes at this point. See route 413. Meanwhile, the processing of any video may proceed by decompressing the video using the video decompression module 414. In various embodiments where the content is advanced in nature, such video decompression may function to support Advanced Access Content System (AACS) / Windows media-digital rights management (WM-DRM), COPPP-compliant DRM, and the like. have.

However, post-processing can optionally be performed using post-processing module 416. Of course, such post processing may include any of the processing mentioned above in the description of similar module 310 of FIG. 3.

Also, as mentioned above, the first amount of processing performed by the graphics processor 306 of FIG. 3 may be an inverse of the second amount of processing performed by the graphics processor 408. For example, the necessary post-processing may be shared between each post-processing modules 310, 416, and may also be adapted for any differences to the video being processed. In addition, the synthesis module 418 may perform a function similar to the similar module 314 of FIG. 3.

As mentioned above, depending on content / processing-related requirements, any one or more of the preceding modules of each of the graphics processors of FIGS. 3 and 4 may or may not be used. Specifically, during use, at least one or more modules of graphics processors may be selected to support communication of content over a network to be subsequently displayed. More information about such dynamic adaptation will now be described.

5 illustrates a method 500 for dynamically processing content communicated over a wireless network link for display purposes, according to one exemplary embodiment. Optionally, the method 500 may be implemented under the principles of the system 200 of FIG. 2. However, of course, the method 500 may be implemented in any desired environment. For example, the method 500 may be implemented only in the context of one graphics processor (see, for example, the first graphics processor 204 and / or the second graphics processor 208, etc. of FIG. 2). Is considered.

As shown, the content is received at a graphics processor that includes a plurality of modules. See operation 502. For example, in one embodiment where the graphics processor includes the first graphics processor 204 of FIG. 2, or the like, the various modules may be a cryptographic module, a compression module, a decryption module, a decompression module (as described above). , Post-processing module, graphics processing module, and / or compositing module. In such embodiments, the graphics processor may be integrated with or separate from the associated computer.

In other embodiments where the graphics processor includes the second graphics processor 208 of FIG. 2, etc., the various modules may be decoded (as described above), decompressed modules, depacketized modules, post-processing modules, One or more of a demultiplexing module, a synthesis module, and an error correction related processing module. In this embodiment, the graphics processor may be integrated with the associated display or may be separate from the associated display.

With continued reference to FIG. 5, factors influencing the process to be described for content are identified. See operation 504. As mentioned above, such factors may be related to bandwidth, desired quality of service (QoS), at least one aspect of content or display (e.g., format, size, etc.), or processing performed by other graphics processors (if present). Type or amount, and / or any other desired factor. Also, as an option, various feedbacks may be used to provide the factors.

To this end, one or more modules of the graphics processor may be dynamically selected to process the content to support subsequent display of the content using communication and / or display over the network. Note the operation 506. Note that such processing may vary depending on which end of the network the graphics processor is present at.

For example, in the above-mentioned embodiment, where the graphics processor includes the first graphics processor 204 of FIG. 2 or the like, processing may involve preparing content for transmission over a network. In addition, such processing performed by selected modules may include decryption, decompression, post-processing, multiplexing, processing to provide error correction, packetization, graphic rendering, compositing, recompression, and / or re-encryption. have.

In addition, in the above-mentioned embodiment, where the graphics processor includes the second graphics processor 208 of FIG. 2 or the like, processing may involve receiving and preparing content for display using a display. In addition, such processing performed by selected modules may include processing to provide decryption, decompression, depacketization, post-processing, demultiplexing, synthesis, and / or error correction.

Of course, any type of module and associated processing that can support the communication of content over a network for subsequent display using a display can be provided and dynamically selected in the manner described above.

Thus, according to current requirements, various scenarios can be envisioned. For example, incoming compressed content may or may not be decrypted / decompressed, in which case various additional processing (eg, graphics processing, compositing, etc.) may or may not be performed. Can be. In addition, all of these choices include, but are not limited to, QoS requirements, network limits (eg, bandwidth, etc.), received content format, desired format of content for network transmission, user configurations / requirements, and the like. May be implemented as a function of any desired factor that is not.

In the context of one particular example, content may be received in a compressed / encrypted format that does not require any desired additional processing (eg, all bandwidth, QoS, etc. requirements are met). In such a case, the content may not necessarily need to be decrypted / decompressed, but simply transmitted. In other embodiments, decrypted / decompressed content may require further processing, and thus may be decrypted / decompressed so that post-processing, graphics processing, and the like can be performed. At that point, recompression / decompression may or may not be performed based on the related needs.

While various embodiments have been described above, it should be understood that these embodiments are provided for purposes of illustration and not of limitation. Therefore, the scope of the preferred embodiment should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.

1A illustrates a system for graphics / video processing, according to the prior art;

1B illustrates a system for graphics / video processing in the context of a wireless network, in accordance with the prior art;

2 illustrates a system for processing content communicated over a network for display purposes, according to one embodiment.

3 illustrates a system for processing content prior to being communicated over a wireless network link, according to one exemplary embodiment.

4 illustrates a system for processing content after being communicated over a wireless network link, in accordance with another exemplary embodiment.

5 illustrates a method of dynamically processing content communicated over a wireless network link for display purposes, in accordance with an exemplary embodiment.

≪ Brief Description of Drawings &

100, 200, 300, 400: system

102: graphics processor

104, 210, 402: display

106, 206, 425: network

202: content source

204: a first graphics processor

208: second graphics processor

302: system memory

404: computer system

406: receiver

408: graphics processor

Claims (24)

As a system, A first graphics processor in communication with a content source and for processing content from the content source; And A second graphics processor in communication with the first graphics processor via a network, the second graphics processor for processing the content for display purposes, Wherein the first throughput performed by the first graphics processor is an inverse of the second throughput performed by the second graphics processor system. The method of claim 1, At least one of the first graphics processor and the second graphics processor includes a graphics processing unit. The method of claim 1, Wherein the first graphics processor and the second graphics processor are asymmetrical in the amounts of processing performed by each of the first graphics processor and the second graphics processor. The method of claim 1, The network includes a wireless network. The method of claim 4, wherein And a transmitter in communication with the first graphics processor for transmitting the content over the wireless network to be received by a receiver in communication with the second graphics processor. The method of claim 1, The processing performed by the first graphics processor may include decryption, decompression, post-processing, multiplexing, processing to provide error correction, packetization, graphics rendering, synthesis, recompression, and System selected from the group consisting of re-encryption. The method of claim 1, The processing performed by the first graphics processor includes decryption, decompression, post-processing, multiplexing, processing to provide error correction, packetization, graphics rendering, synthesis, recompression, and re-encryption. The method of claim 1, The processing performed by the first graphics processor is selected from the group comprising bandwidth, quality of service (QoS), at least one aspect of content or display, type of processing or throughput performed by the second graphics processor. A system that is dynamically adaptable to one or more factors. The method of claim 1, The processing performed by the second graphics processor consists of processing to provide decryption, decompression, de-packetization, post-processing, de-multiplexing, synthesis, and error correction. System selected from the group. The method of claim 1, The processing performed by the second graphics processor includes processing to provide decryption, decompression, depacketization, post-processing, demultiplexing, synthesis, and error correction. As a subsystem, A first processor in communication with the second processor via a network; The first throughput performed by the first processor is an inverse function of the second throughput performed by the second processor, The first processor and the second processor are capable of video processing or graphics processing. delete delete delete delete delete delete delete delete delete delete delete delete delete

Images