The application requires to submit on Dec 16th, 2003, sequence number is the right of priority of 60/530,465 U.S. Provisional Patent Application, and it completely is included in this and is used for all purposes as a reference.
Embodiment
Fig. 1 always illustrates the synoptic diagram according to the image processing system of the first embodiment of the present invention at 10 places.Image processing system 10 comprises and is configured to the display device 12 of watching display image on the face 14.Display device 12 can be the display device of any suitable type.Its example includes but not limited to that LCD (LCD) and digital light are handled (DLP) projector, system for TV set, computer monitor or the like.
Image processing system 10 comprises that also the image related with display device 12 provides equipment 16, and provides equipment 16 to carry out one or more image sources 18 of telecommunication with image.Image provides equipment 16 to be configured to receive the view data that is sent by image source 18, and the view data that processing receives is in order to be shown by display device 12.Image provides equipment 16 can be integrated in the display device 12, or can be used as the independent assembly that can be connected to display device and provide.The example that suitable image provides equipment was submitted on June 2nd, 2003, sequence number is open in 10/453,905 the U.S. Patent application, and it is included in this as a reference.
Display device 12 and image provide in the equipment 16 each can be called " image display " in this article, and can also be called " display system 17 " jointly at this.Therefore, should be understood that and be disclosed as herein at the system and method for realizing on the display system 17 and can on display device 12 and image provide any or both of equipment 16, realize.
Can pass through, or the such image source of other computing equipment provides view data to display device as above-knee or desktop PC, PDA(Personal Digital Assistant).Such display device can be configured to from image source wireless receiving view data, for example by the communication protocol as 802.11b (or other 802.11 agreements), bluetooth etc.These display devices can allow the quick connection layout image source in almost any position in the meeting room, thereby can help single display device is used a plurality of image sources.
Yet, support to use a plurality of image sources may cause all difficulties to single display device.For example, different image sources may have different view data to be handled and transmittability, and may data be sent to display device with different speed.Some image source may send to display device with data can process data into the higher speed of speed that is used to show than display device.This can cause the data input buffer on the display device to be flooded by data, and may cause the mistake in data transmission and the image demonstration.
Image source 18 can comprise any suitable equipment that view data can be provided to display system 17.Its example includes, but not limited to desktop PC and/or server 18a, laptop computer 18b, PDA(Personal Digital Assistant) 18c, mobile phone 18d or the like.In addition, image source 18 can be carried out telecommunication in any suitable manner with display system 17.In described embodiment, each image source 18 is all carried out telecommunication by wireless network 20 and display system 17.Yet image source 18 also can pass through cable network, by wireless or wired direct connection or the like, or their combination in any is communicated by letter with display system 17.
Fig. 2 illustrates the block diagram of a display system 17 and an image source 18.Image source 18 comprises storer 30, processor 32 and input/output end port 34.Storer 30 can comprise that storage also can be by processor 32 execution to send the code of view data to display system 17 by input/output end port 34 and forward channel 36 thereon.Image source 18 can be configured to send view data with form to display system 17 in any suitable manner.For example, image source 18 can comprise the software that is stored in the storer 30, this software can carry out be created on the image source display screen (as, screen of the monitor screen of desktop PC 18a, laptop computer 18b or the like) bitmap of the image that go up to show, compression and this bitmap is sent to display system 17 be used for showing then.In addition, image source 18 can comprise the part that is configured to change in the recognition image, only encodes, compresses and send the software that has changed part in the image then.Should be understood that these methods that send view data are exemplary, and image source 18 can be configured to data are sent to display system 17 with above-mentioned any other suitable mode and/or form outside those.
Next, display system 17 comprises that also input/output end port 40 is used for communicating by letter with image source 18, and comprises that input buffer 44 is used for the compressing image data that interim storage decompresses and handles from remaining of receiving of image source 18.Display system 17 also comprises processor 42 and storer 46, and storer 46 is used for storing and can be carried out with the data of handling impact damper 44 receptions and the code of carrying out other operations of describing herein by processor 42.
As mentioned above, the relative processing power that depends on image source 18 and display system 17, when image source with when from impact damper 44, reading the higher speed of untreated view data is used to handle in this impact damper speed to display system 17 transmit image data, can situation occurred.In order to prevent that display system 17 is by overwhelmed with image data, display system 17 can comprise and is configured to untreated image data amount in the look aside buffer 44, and will represent that by backward channel 48 value of untreated image data amount in the impact damper sends to the software (or firmware or hardware) of image source from display system 17.If image source 18 can be configured to represent that the value of untreated image data amount satisfies the condition of selecting in advance with respect to the threshold value of selecting in advance, then adjust to the image data transmission of image display.
Fig. 3 always illustrates first example embodiment of the method for image data transmission between control chart image source 18 and the display system 17 at 100 places.Fig. 3 also illustrates from image source 18 to display system the processing that 17 image data transmission and display system are carried out view data always at 102 places.The various operations of carrying out on image display system 17 can be carried out by the code that processor 42 execution are stored in the storer 46 as shown in Figure 3, and those operations of carrying out on image source 18 as shown can be carried out by the code that processor 32 execution are stored in the storer 30.Code also can be stored on the computer-readable recording medium, as disk, CD-ROM, hard disk drive, and can be transferred to image source 18 and/or display system 17.
The image data transmission at 102 places and processing are included in 104 view data are sent to display system from image source, receive view data in 106 impact dampers on display system, read view data 108 from impact damper then and are used for being handled by display system.The transmission view data at 104 places can comprise any step in some possible substeps.These possible substeps can include, but not limited to any step or all in the following step; Generation is presented at the bitmap of the image on the image source, filtering the low data that change from this bitmap comes with the compression of computer graphics data compressor reducer improvement to non-cg data, view data is carried out double sampling, and by one or more compression step compressing image datas.These substeps can be carried out on entire image, or only carry out image has the part of pixel of change with respect to the image of next-door neighbour front on.
When the transmission view data at 104 places comprises one or more compression step, can use any suitable compression method.For example, in the application as compression of video data and transmission, wherein need the Real Time Compression view data, suitable compression method includes but not limited to that LZO compress technique, and hierarchical compression techniques are as pyramidal compression.
During image data transmission, reception and the processing at 102 places, display system 17 can 110 detect or look aside buffer in untreated image data amount.Display system 17 can also will represent that the value of untreated image data amount sends to image source 18 in the impact damper 112.The value of untreated image data amount can be any suitable amount that untreated image data amount in the impact damper is had dependence in the expression impact damper.For example, the value of untreated image data amount can be the absolute magnitude of untreated view data in the impact damper in the expression impact damper, maybe can be the storage absolute magnitude that is not occupied by untreated view data in the impact damper.Perhaps, the value of untreated image data amount can be to be occupied or not by its impact damper number percent that occupies by untreated view data in the expression impact damper.
Image source 18 receives the value of representing untreated image data amount in the impact damper 114.Next, the value of image source 18 untreated image data amount in 116 pairs of expression impact dampers compares with the threshold value of selecting in advance, if and the value of untreated image data amount is with respect to the satisfied condition of selecting in advance of this threshold value in the expression impact damper, then image source adjustment image data transmission prevents that display system 17 is by too much overwhelmed with image data.
The condition of Xuan Zeing can meet any suitable relation with respect to predetermined value in advance.In described embodiment, image source 18 determines 118 whether the value of untreated image data amount in the expression impact damper is higher than threshold value.Perhaps, image source 18 can determine whether the value of representing untreated image data amount is greater than or equal to threshold value.The comparison of these replacements can be in the expression impact damper value of untreated image data amount use when being the absolute magnitude of untreated view data in the impact damper or the impact damper number percent that occupies by untreated view data.Perhaps, the value of untreated image data amount is the absolute magnitude that impact damper is not occupied by view data in the expression impact damper, or during number percent, (or replace with, be less than or equal to) threshold value that image source 18 can determine whether this value is lower than.
If image source 18 determines that 118 the value of untreated image data amount in the expression impact damper is not higher than threshold value, then image source 18 continues to send view data with common, higher speed, shown in 120.On the other hand, if image source 18 determines that 118 the value of untreated image data amount in the expression impact damper is higher than threshold value, then image source 18 can begin to send view data with lower speed to display system 17 122, prevents that display system is by overwhelmed with image data.Perhaps, when the value of untreated image data amount is the absolute magnitude of the impact damper that do not occupy or the impact damper number percent that do not occupy in the expression impact damper, then when these values are brought down below the threshold value that (or being less than or equal to) select in advance, can reduce image data transmission rate.
Image source 18 can reduce the speed of image data transmission by any suitable mode.For example, when image source 18 generation transmissions were presented at the bitmap (as mentioned above) of each image on the image source, image source can reduce the speed that generates bitmap.Perhaps, when image source 18 hierarchical coding view data, when the value of untreated image data amount is higher than threshold value in the expression impact damper, to the image the selected part of transmitting layered view data only.In fact this reduced the resolution of the view data that is sent, and increases up to transfer rate.
Shown in arrow 130, display system 17 can be configured to detect and send the value of representing untreated image data amount in the impact damper on the basis of periodicity and repetition.This value can detect and send by any required interval.For example, this value can send by regular time intervals.Reasonable time example at interval includes but not limited to those in the scope between about 0.05 second to 0.2 second.A reasonable time concrete example at interval is about 0.1 second in this scope.Should be understood that the above-mentioned time interval is exemplary, and can use any other reasonable time at interval.In addition, can use the interval of measuring by the amount outside the time.For example, can will represent that when receiving the view data of specified quantitative from image source 18 value of untreated image data amount sends to image source 18.
As mentioned above, in one embodiment, provide a kind of method to be used to control the method for the image data transmission from the image source to the image display, wherein said method comprises view data is sent to image display from image source, receive view data in the impact damper on image display, from impact damper, read view data be used for handling to small part by image display, untreated image data amount in the look aside buffer, the value of untreated image data amount in the expression impact damper is sent to image source from image display, satisfy the condition of selecting in advance if reach the value of representing untreated image data amount, then adjust to the image data transmission of image display by image source.
Though the present invention includes specific embodiment, specific embodiment should not be regarded as having limited significance, because may there be a large amount of variants.Subject content of the present invention comprises various element disclosed herein, feature, function, and/or all novel and the non-combination of easily seeing and sub-portfolios of attribute.Following claim particularly points out and is considered as novel and non-particular combinations of easily seeing and sub-portfolio.These claims may be quoted " one " element or " first " element or its equivalence.Such claim should be understood to include the combination to one or more such elements, rather than requires or get rid of two or more such elements.Other combinations of each feature, function, element and/or attribute and sub-portfolio can be by the modifications of claim of the present invention or by providing new claim to ask for protection in the application or related application.No matter such claim is to require wideer, narrower, equivalence or different than original rights on scope, also should be regarded as being included within the subject content of the present invention.