CN1225218A - Method for transmitting superimposed image data in a radio frequency communication system - Google Patents
Method for transmitting superimposed image data in a radio frequency communication system Download PDFInfo
- Publication number
- CN1225218A CN1225218A CN97196388A CN97196388A CN1225218A CN 1225218 A CN1225218 A CN 1225218A CN 97196388 A CN97196388 A CN 97196388A CN 97196388 A CN97196388 A CN 97196388A CN 1225218 A CN1225218 A CN 1225218A
- Authority
- CN
- China
- Prior art keywords
- image
- receiving unit
- transmitting element
- sends
- detail
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y02B60/50—
Landscapes
- Image Processing (AREA)
Abstract
The present invention relates to a method for transmitting image data for superimposed images via wireless devices in a radio frequency communication system. The original image is transmitted via a communication channel to a receiving unit. The original image is then revised to form a revised image. The revised image is compared to the original image to determine the differences between the revised image and the original image. These differences comprise a difference image which is then transmitted to the receiving party. At the receiving end, the difference image is recombined with the previously-transmitted original image to reform the revised image. In a preferred embodiment, the original images and difference images are preferably decomposed and progressively transmitted to the receiving unit in response to image data requests from the receiving unit.
Description
The present invention relates to wireless communication system, particularly in radio-frequency (RF) communication system, transmit the method for the multi-resolution image data of superimposed image through wireless device.
Multimedia application is just becoming a part in the Wireline Communication System Design.These application concentrate on by same traffic channel image, data and speech.Special care is the image transmission in the multimedia application.Piece image is made up of the 2D signal of object relative brightness in the expression scene.A scene for example can comprise: the radar image of photo, video image, radioscopic image or weather forecast.Two important parameters are picture quality and the definition that obtain from image data transmission.
The typical image of one width of cloth is made up of the matrix of 512 * 512 pixels.For black and white image, describe each pixel and store this information with the memory space of 8 bits with gray scale.Consequently entire image takies the memory space of about 2M bit.For coloured image, each pixel is used 24 bits, and causes piece image approximately to take the memory space of 6M bit.Therefore, the coloured image that a width of cloth details is detailed needs very big memory space, bandwidth and energy consumption usually.
As the natural product of technological progress, given concern to transmitting multi-media signal by radio communication.In the near future, this communications carrier will become the important component part that the radio frequency communication system traffic is required.Yet different with the Wireline communication system, radio system tends to be subjected to spectrum limitations.In addition, charge from the airtime, service fee is too high for consumers.Image can take a large amount of memory space of equipment usually, and the very long transmission time of image signal transmission cost.Therefore, come transmitted image can become very expensive through the radio system such as the mobile cellular wireless network.If need not transmit high-resolution image, need not waste these resources.If revise original transmitted image and must retransfer, use same requirement.Need thus a kind of make through the required airtime of radio system transmitted image minimum so that customer charge reduces to minimum system.
The present invention relates to transmit the multiple resolution image data method of superimposed image by the wireless device in the radio-frequency (RF) communication system.
Use the superimposed image method in the communication system that after original image transmits, can make amendment to it.The main variation of revising is to superpose on original image, makes it to form together the image that a width of cloth is revised.Owing to transmitted original image, more effective way is only to transmit the modification part of original image to the recipient.Therefore, for revising image, the image transmitting element is determined the difference between original image and the modification image, and only transmits this difference as difference images.Difference images only comprise the modification part that is superimposed upon on the original image.
When sending difference images, image receiving unit is superimposed upon difference images on the original picture that had before received.By making up the data of two superimposed images, correct same modification image in the input of image transmitting element.For example, original image may comprise hand-written letter.After letter sends to the recipient, it is made amendment by increasing signature.At this, the difference of two width of cloth images is to form the signature of difference images.Only send signature and replace sending whole letter image.In case the transmission signature section reconfigures itself and unsigned letter to form the letter (promptly revising image) of a signature.Therefore, owing to cancelled the transmission of redundant image data, this superimposed image method has greatly been saved the resource such as bandwidth, internal memory, energy consumption and airtime.
Yet, by itself and multi-resolution image system in combination are used the efficient that can further improve the superimposed image method.The multiresolution system adopts the wavelet technology to decompose image and image is stored in the image transmitting element as the discrete message piece.Block of information comprises the primary image of a presentation video lowest resolution and the one or more image details that increase level of resolution is provided when being added to primary image.The greatest level number of the resolution that can limit by the resolution limiting of image transmitting element or to the image transmitting element of transmit leg artificial to determine that image is broken down into.
Set up after the communication channel, send primary image to image receiving unit.This primary image is the original image or the difference images of lowest resolution grade.Image receiving unit comprises by sending the device that the view data request increases primary image resolution to the image transmitting element.Then, additional image detail is sent to image receiving unit.Then, additional image detail and the primary image combination of adopting the wavelet technology that image receiving unit is received once more are to produce more high-resolution detail pictures.Image receiving unit sends a plurality of requests to additional image detail.All will add image detail and previous image combination, so that more high-resolution new detail pictures to be provided at every turn.
An advantage that picture breakdown is become to increase progressively level of resolution is only to send picture quality and the definition of required resolution grade so that approval to be provided.For example, resemble the image resolution ratio that the such image of hand-written letter can only require understandable medium or lower grade.Save bandwidth, power and transmission time by sending lower resolution.For a side of received communication, resembling signature or the such image of impression of the hand needs high-resolution just effective.In this case, the recipient can ask the resolution of higher level.
When superimposed image system and multi-resolution image system in combination, consequently can customize each resolution that sends image to satisfy recipient's demand.Therefore, then the example above can send original hand-written letter, and utilize the multi-resolution image system to correct original hand-written letter with acceptable resolution at image receiving unit.Then, revise letter by replenishing signature.Because the difference images in the superimposed image system comprise this signature and send in the mode identical with original image, also can carry out the multiresolution transmission to signature.At this, may wish signs has the resolution higher than letter itself.Like this, the user of image receiving unit can ask on primary image than the more additional image detail at original letter request at signature.Therefore, can be by different resolution with original image (letter) and difference images (signature) combination, to form the customized version of revising image.
Utilize the multi-resolution image data system of superimposed image, can by intercommunication mutually either party or limit to determine the required level of resolution of each composition of each image or an image by the resolution of communicator.The typical case of this principle uses and comprises the image transmission that is connected to the laptop computer of hand-held cellular radio device from hand-held cellular radio device or the interface of hanging oneself.
Therefore, can see that the major advantage of this method is to make the airtime relevant with radio communication, bandwidth, energy consumption and other key factor minimum, allow the equipment user to determine to be fit to the required optimized image level of resolution of its needs simultaneously.
Fig. 1 is a summary block diagram of implementing the required system configuration of the inventive method, comprises the image transmitting element that is used for sending to image receiving unit through communication medium image.
Fig. 2 is the block diagram by the image transmitting element of system and method for the invention process, and the interaction between the unit basic element of character has been described.
Fig. 3 is the block diagram by the image receiving unit of system and method for the invention process, and the interaction between the unit basic element of character has been described.
Fig. 4 is the flow chart of explanation image transmitting element operation of the present invention.
Fig. 5 is the flow chart of explanation image receiving unit operation of the present invention.
Fig. 6 is a summary block diagram of implementing the required system configuration of the inventive method, illustrates that an image transmitting element and an image reception are combined into a combination image transmission/receiving element, thereby makes communicating pair can send and receive image.
Fig. 7 is the block diagram that the method according to this invention is used for the combination image transmission/receiving element of image transmission and reception.
Fig. 8 is the flow chart of combination image transmission/receiving element operation of the present invention.
With reference now to accompanying drawing,, Fig. 1 shows the basic embodiment of multiresolution superimposed image data transmission system of the present invention, summarizes with label 10 and represents.Superimposed image transmission system of the present invention is specially adapted to the transmission of a series of associated pictures.Specifically, this superimposed image system allows the follow-up change version of transmission original image and original image.
At first original image is transferred to receiving element as a whole.When later change original image, with the new iteration (iteration) of this image and the previous image comparison that sends to draw its difference.Then, the difference between new iterate and the previous image that sends is sent to receiving element.Owing to only send the difference between the image, this processing has significantly reduced needs the data volume of transmission, thereby more effectively utilizes available bandwidth, reduces the transmission time and reduces transmission cost.
By multi-resolution images image transmission system and superimposed image transmission system of the present invention are made up the further optimization that has obtained the image transmission.The multi-resolution image system allows to control only the resolution of each image that sends to receiving element.This comprises any difference between original image and new iterate and the previous image that sends.
Use the multiresolution performance, image is segmented or resolve into primary image (can be envisioned as the graininess photo) and many image details.If image detail is added to the graininess photo successively, this photo becomes more and more clear.When all images details is added to primary image, reconstitute original photo.Like this, if before an images sends to receiving element with its decomposition, can begin image transmission primary image is dealt into receiving element.Then, the user of receiving element can ask to send and to be added to the additional detail of primary image.Therefore, when the user of receiving element obtains to be suitable for the image resolution ratio of this purpose, do not need to ask again additional detail.
By the multi-resolution image system, can not need the image of full details also not need to send.Therefore, this processing has significantly reduced the data volume that sends for every width of cloth image.Because this processing can be applicable to the original image of superimposed image system and any difference between new iterate and the previous image that sends, and can further more effectively utilize available bandwidth, reduces the transmission time and reduces transmission cost.
The user who it should be noted that image transmitting element 20 can specify the concrete image receiving unit 60 that can receive the multi-resolution image data.In fact, the user that this example of forcing qualification is an image transmitting element 20 in mobile phone communication system is programmed into the telephone number of certain mandate in the device, the result is only to have from those callers with regulation telephone number of image receiving unit 60 and have whole multi-resolution image Data Receiving abilities.The caller of the number those numbers of stipulating to authorize from the user except that image transmitting element 20 can not receive the view data of view data or default level of resolution.Therefore, the blocking-up of all images transfer of data is had confidential nature, receive image to prevent unauthorized party.Only the primary image that can use reluctantly to unwarranted number transmission also has same secret effect.Yet, can set the transmission of any more high-resolution grade by the user of image transmitting element 20, for example with the primary image of many image details combination, with the required airtime of restriction transmission.The user of image transmitting element 20 can determine that all recipients need intermediate resolution also only to send with this grade.Therefore, this option also will help to maintain secrecy and image transfer bandwidth, power and transmission time Parameter Optimization.
Fig. 1 illustrates the basic element of character of multiresolution superimposed image data transmission system 10.The basic element of character comprises that is designated as an image transmitting element of 20, and one is designated as 60 image receiving unit, and the communication medium 110 of communication link is provided between image transmitting element 20 and image receiving unit 60.In its simplest form, image transmitting element 20 is with the image loading system and before communication medium 110 sends it to image receiving unit 60 it is being handled.At this, " manipulation " of image is meant the application of any in superimposed image system and the multi-resolution image system or two kinds.Then, the operation carried out of 60 pairs of image restoration images of image receiving unit transmitting element 20 and it is shown to a side who receives image.
Image receiving unit 60 comprises 85, one displays 95 in 75, one stack combinations unit of 70, one recomposition unit of 65, one decrypting device parts of a communication unit and an image control unit 100.Communication unit 65 allows to receive view data and send view data request and other control signal to image transmitting element 20 from image transmitting element 20.If image is encrypted, decrypting device 70 is deciphered view data before data are sent to recomposition unit 75.Decomposed image before the recomposition unit 75 reorganization transmission.Stack combinations unit 85 is added to previous image with difference images, so that regenerate the image of modification at image receiving unit 60.This image is presented on the display 95.
With reference now to Fig. 2,, illustrates in greater detail image transmitting element 20.Image-input device 22 is used for image is input to system, and for example can comprise, dish reader, scanner, blank (band scanner) or electronic palette pad.In case piece image is input to system, by stack difference unit 25 steers image.The difference between two consecutive images is determined to revise in the sequences in stack difference unit 25, and only forms and comprise modification, or the image of difference images.Stack difference unit 25 is not handled new or original image.The purpose of image of creating a difference is to avoid sending whole modification image when sending previous similar image.Therefore, if only send difference images, can be with it in image receiving unit 60 and the previous image reorganization that sends, to change the image of revising.
Then, from the image of stack difference unit 25, may be that original image or difference images continue by this system to resolving cell 35.The purpose of resolving cell 35 is that picture breakdown is become primary image and one or more image detail.This resolution process is the basis of multiresolution mode of the present invention.The thickest image (primary image) resolution should be the initial image that sends.Then, the recipient can ask additional image detail to strengthen the resolution of primary image.
Resolving cell 35 comprises 38, one counter modules 40 of 36, one image processors of a main storage (ISU) and a Route Selection switch 42.The image that main storage (ISU) 36 storage stack difference unit 25 are sent.Image processor 38 becomes to comprise the discrete message piece of a primary image and one or more detail pictures with picture breakdown.Then with chunk store in main storage (ISU) 36.The quantity of 40 pairs of block of informations corresponding with the specific image of image transmitting element 20 transmissions of usage counter module continues counting.The control signal that Route Selection switch 42 is handled from image receiving unit 60, this control signal can comprise view data request or reset signal.Main storage (ISU) 36 is delivered in the view data request, and the block of information of correspondence is transferred to image receiving unit 60 forward from main storage.Reseting signal reset counter module 40, and notice image-input device 22 image receiving units 60 prepare to receive another width of cloth image.
With reference now to Fig. 3,, image receiving unit 60 is shown.Communication unit 65 by image receiving unit 60 receives the view data that sends.Communication unit 65 comprises a sending module 66 that is used to receive the receiver module 68 of transmission image and is used for sending to image transmitting element 20 view data requests or other control signal such as reset signal.
In case whether receiver module 68 receives view data, is sent to decrypting device 70, must come specified data encrypted by the encrypted code in the search image data at this.Decrypting device 70 comprises decryption device 74 and the Route Selection switch 72 to the enciphered data deciphering.If encrypted code, view data is delivered to decrypting device 74 to its deciphering.Yet, if the image unencryption directly is routed to recomposition unit 75 by switch 72.
The purpose of recomposition unit 75 is images that reconstructed picture transmitting element unit 20 sends.Recomposition unit 75 comprises 78, one additional storages 80 of 76, one main storages of a Route Selection switch (IDU) and an image processor 82.Switch 76 is delivered to main storage (IDU) 78 or additional storage 80 to the view data that receives.Usually, primary image is delivered to main storage (IDU) 78, and any additional image detail is delivered to additional storage 80.Image processor 82 makes up the image of storage in image detail and the main storage (IDU) 78 of storage in the additional storage 80.Then, the detail pictures that obtains is stored in the main storage (IDU) 78 and replaceable wherein previously stored image.Therefore, constitute more high-resolution on the image detail image formerly.Then, resulting image is delivered to stack combinations unit 85.
The startup of resetting means 108 produces and sends reset signal to image transmitting element 20.Reset signal presentation image receiving element 60 prepares to receive another width of cloth image.Second purpose of reset signal is to signal to image transmitting element 20, and the user of image receiving unit 60 is satisfied to the image of previous transmission.Therefore, in general, be the transmission of controlling view data by the recipient.
Operation
Respectively by of the operation of Figure 4 and 5 key diagram as transmitting element 20 and image receiving unit 60.The first step in the communication initialization is the minimum resolution grade of setting up shown in the functional block 120 (Fig. 4) of transmit leg and recipient's functional block 180 (Fig. 5).As described further below, this parameter is used for sending gradually multi-resolution image.Usually, by corresponding user default minimum initial resolution grade in image transmitting element 20 and image receiving unit 60.If the minimum value in the grade difference that every square gauge is fixed, two values is the initial parameter that limits.
It should be noted that transmit leg also can stipulate to offer recipient's ultimate resolution grade except that the minimum level of setting resolution.Can be when being input to system at first by the ultimate resolution grade that transmit leg is set less than the resolution of original picture.For example, picture breakdown can be become a primary image and seven additional image details at first.Transmit leg can be defined as the available resolution of maximum four additional image details.Therefore, it is the primary image that has four additional image details that the recipient only can receive ultimate resolution, rather than whole resolution of original image.It is useful that this characteristic is born the airtime that communication cost and managing limits the image transmission to transmit leg.
After setting up the minimum resolution grade, the image that send is input to image transmitting element (functional block 122).When image is input to system, also determine other essential operating parameter.These operating parameters for example can comprise, this image is an original image or to the modification of previous image, and whether image maintains secrecy.The parameter generating of useable definition is used for the control signal of this system, or available image data is encoded to it.
If it is to revise image (decision block 124) that operating parameter is indicated this image, or in other words is the modification to original image, only Route Selection switch 26 is set to work video memory 28 (functional block 132).Yet before the modification image was stored into work video memory 28, previously stored image was sent to movement images memory 30 (functional block 134) by image processor 32 in the video memory 28 of at first will working.Finish in case transmit, the image of revising is stored in (functional block 138) in the work video memory 28.Then, image processor 32 determines to revise the difference between image and the previous image, to form difference images (functional block 138).Next, difference image is delivered to picture breakdown unit 35, it is stored in (functional block 140) in the main storage (ISU) 36 at this.
Image becomes the discrete message piece to picture breakdown by image processor 38 after storing in the main storage (ISU) 36 of resolving cell 35, is stored in once more (functional block 142) in the main storage (ISU) 36.For example can utilize wavelet technology or other conical image decomposing scheme to come the exploded view picture.These methods are well known to those skilled in the art, therefore do not do description at this.In brief, original image resolves into a primary image S
0With a series of images detail D
1, D
2..., D
nPrimary image S
0With image detail D
1, D
2..., D
nAll be stored in the main storage (ISU) 36 of resolving cell 35.Image detail D
1, D
2..., D
nCan with primary image S
0Reorganization is with the image that gives particulars.For example, with D
1The S of combination
0With the detail pictures that provides than a level of resolution of parent map image height.Equally, with D
1And D
2The S of combination
0With the image detail that provides than two level of resolution of parent map image height.According to this notion, with D
1, D
9... and D
nThe S of combination
0Has the highest image detail that level of resolution is provided with providing, corresponding to the maximum original grade of decomposing.In order to illustrate in greater detail the wavelet technology, see the vol.11 of S.G.Mallat at IEEE Transactions on Pattern Analysis and Machine Intelligence, no.7, pp674-693 (in July, 1989) delivers is entitled as " multi-resolution signals resolution theory: wavelet performance ", is introduced into as a reference at this.
Begin actual image transmission by view data request from image receiving unit 60.When image transmitting element 20 receives the view data request (decision block 144), image transmitting element 20 begins to send image.Usually, can send view data request and reset signal through the Dedicated Control Channel DCC such as quick related control channel (FACCH) or slow associated control channel (SACCH).Should point out,, can be used for the signal transmission to Dedicated Control Channel DCC owing to do not send view data.The additive factor that needs such Dedicated Control Channel DCC is whether carrying out between the image sequence transmission period also has conversation in the process.
When image transmitting element 20 receives the view data request (decision block 144), Route Selection switch 42 is set to main storage (ISU) 36 (functional block 146).Summarize the directions for as functional block 148, the image data processing request is also prepared the transfer of data of request to image-display units 60.When receiving the first view data request, main storage (ISU) 36 passes on the block of information that comprises primary image usually.After the view data request, main storage (ISU) 36 each view data request of response prepare to comprise the block of information of next image detail grade.If receive request to a plurality of block of informations, main storage (ISU) 36 or a plurality of details are combined into single block of information, or with primary image on the corresponding piece number (functional block 148) of detail grade that improves along continuous string combination request.Indicated as functional block 150, when the request that receives view data, counter module 40 increases counting, is no more than with the quantity of guaranteeing block of information and can be the maximum detail grade that this image provides.In fact, image transmitting element 20 also can send appended drawings as details under the situation that does not at first receive the view data request from image receiving unit 60.This is to realize by introducing resolution control device separately to image transmitting element 20.In this case, the user of image transmitting element 20 can respond the additional image detail of oral request transmission from the user of image receiving unit 60.Then, the control code in the view data is to the characteristic of image receiving unit 60 notice input data.
If private data is then carried out image encryption before transmission.Before image data transmission, image transmitting element 20 determines whether it is private data (functional block 152).If private data is set to Route Selection switch 46 encryption device 48 and data is encrypted (functional block 154,156).Secret image for example can comprise that signature, proprietary plan or sender do not want to allow other outer side of direct conversation intercept and capture or the sensitive data of use.If image is not maintained secrecy, set Route Selection switch 46 bypass encryption devices 48 (default mode).No matter the sort of method is delivered to transmitter module 52 with view data, to be transferred to image receiving unit 60 (functional block 158).
Image is sent to image receiving unit 60 one by one by the discrete message piece.When image receiving unit 60 receives the view data request, image transmitting element 20 responds by the request grade that sends view data.Usually, the request of response original data only sends primary image.The order of magnitude that this image is normally little than original image.Yet initial pictures also can be made of primary image and one or more image detail.In this case, send preceding primary image and the detail pictures of in image transmitting element 20, making up.
More details if desired, the recipient can send appended drawings at more details as request of data (real-time).As request of data, image transmitting element 20 responds by the block of information of sending the image detail that comprises next grade for each appended drawings.Refresh counter module 40 when each the transmission is to keep the counting (functional block 150) to the block of information quantity that sends.At image receiving unit 60, the primary image of this image detail and reception and the reorganization of any previous image detail are to improve image resolution ratio.If image transmitting element 20 receives the request of many image details, with previous image reorganization before, the respective amount that will comprise the block of information of next stage image detail sends to image receiving unit 60 successively, so that resolution (functional block 148) further to be provided.
Continue images up to sending last block of information or up to receiving reset signal from image receiving unit 60.Image transmitting element 20 determines whether to receive reset signal in functional block 160.If do not receive reset signal or not end call from image receiving unit 60, main storage (ISU) 36 will continue to handle the view data request from image receiving unit 60, up to the resolution that reaches greatest level.Yet, if the reset signal of receiving shown in functional block 40, is set to image-input device 22/ counter module 40 with Route Selection switch 42.The result is that notice image-input device 22 image receiving units 60 are prepared to receive next image (functional block 166), and reset counter module 40 (functional block 168).The reception of reset signal also can be to show that to image transmitting element 20 user of image receiving unit 60 can accept the sign of previous image resolution ratio.If send another image (decision block 170), then the image input with functional block 122 restarts.
If do not send other image, or end call and end communication, or whether this system wait observation user determines to send another width of cloth image (decision block 172).Should point out,, stop (decision block 162), then reset counter module 40 before end of calling but call out if do not receive reset signal at decision block 160.
With reference now to Fig. 5,, the operation of analysis image receiving element 60 in more detail.Described as previous section, image send to handle with from image receiving unit 60 to image transmitting element 20 transmit image data requests (decision block 182).This realizes that by starting level of resolution control device 102 level of resolution control device 102 can comprise the button of for example being pressed by the recipient.For the first time press the button 102 and be called as the original data request.When receiving element 60 sends the original data request (decision block 184), set the Route Selection switch 76 in the recomposition unit 75, will import data and deliver to main storage (IDU) 78 (functional block 186).In fact, the image or the primary image of image receiving unit 60 request minimum resolutions.
When adding image detail (decision block 184), before sending the successive image request of data, usually Route Selection switch 76 is set to additional storage (functional block 192) by 102 requests that press the button once more.Can notify recomposition unit 75 input image data to be added to the conventional images that has received like this.More particularly, in fact start button 102 causes three kinds of situations for additional image detail: start timer 104, register the increment (functional block 194) corresponding by counter module 106, and Route Selection switch 76 is set to the additional detail (functional block 192) of additional storage 80 with the Route Selection input with the startup quantity of button 102.After the overshoot time, timer 104 command counter modules 106 are sent the corresponding view data request of increment of registering with counter module 106 to image transmitting element 20.For example, same if press button through the request that Dedicated Control Channel DCC sends two block of informations 102 twice, if recipient's start button 102 3 times sends three block of informations that comprise additional image detail with requested image transmitting element 20.In either case, increase counter module 106, to continue counting (functional block 188,194) to the information requested number of blocks.
Then, receive the view data (functional block 190,196) of request at the receiver module 68 of communication unit 65.As describing in the part in front, these data comprise the control information of coding, so that handle particular procedure in image receiving unit 60.For example, view data comprise the indication this image be the original image or the code of difference images.These codes transmit with view data and its route in recomposition unit 75 and decrypting device 70 respectively.
If at image-input device 22 according to the result of transmit leg instruction to this image encryption, then in the code that view data comprises, make such indication.If data are encrypted (decision block 198 of primary data request and the decision block 206 of additional image detail), Route Selection switch 72 is set to decryption device 74, so that to image deciphering (functional block 200,208).Decrypting device has the cryptographic algorithm of restored image transmitting element 20 and makes data return the ability of its original unencrypted state (functional block 202,210).If the view data unencryption is set Route Selection switch 72 to allow view data bypass decryption device 74.No matter the sort of mode is sent to recomposition unit 75 with view data.
Decomposed image before the recomposition unit 75 reorganization transmission.In the operation, will be initial or primary image deliver to main storage (IDU) 78 and be stored in wherein (functional block 204) with as the image that will add additional detail.Any additional image detail of request and reception is delivered to additional storage 80 and is stored in wherein (functional block 212).When receiving image detail, main storage (IDU) 78 and additional storage 80 content in the two is combined into the single image that reconstitutes (functional block 214) by image processor 82.The image that reconstitutes (referred to herein as detail pictures) comprises primary image at least, but can comprise the primary image of recombinating with all available image details (full resolution image).Therefore, in case reconstitute, before detail pictures is delivered to stack combinations unit 85, it is stored in (functional block 216) in the main storage (IDU) 78.
As previously mentioned, the transmission that be superimposed upon the difference images on the image of previous transmission has formed desirable modification image, and needn't send whole modification image to the recipient.Therefore, according to the picture characteristics of transmit leg regulation, set Route Selection switch 86 image is delivered to complete image memory 88 or parts of images memory 90 (decision block 218) from recomposition unit 75.In general, raw image storage is (functional block 220,222) in complete image memory 88, and difference images are stored in (functional block 224,226) in the parts of images memory 90.If difference images are stored in the parts of images memory 90,92 of image processors are with the combination of the image in image in the complete image memory 88 and the partial images memory 90, to correct the image of revising (functional block 228).The image of revising (being also referred to as composograph) is stored in (functional block 230) in the complete image memory 88.In complete image memory 88, stored after original image or the modification image, image has been delivered to display 95 so that watch (functional block 232) by the recipient.
The more important that should point out is: be controlled in each iterate by resolution original image is made up with its final resolution accepted and difference images.Therefore, according to this method, the final modification image that shows on the display 95 can comprise a primary image and a plurality of all be the difference images of different resolution.
After revising image, image receiving unit 60 will remain on static state, and wait for the user or ask additional detail (decision block 182), reset (decision block 234), or end call (decision block 236).If the user selects to reset behind the image of resolution obtaining to accept, image receiving unit 60 reset counter modules 106 are also sent reset signal (functional block 238,240) to image transmitting element 20.Should point out, also can realize resetting greater than the number of times of the maximum detail quantity that can ask simultaneously by button 102 is started.In addition, as previously mentioned, the transmission of reset signal also is a sign from the resolution of previous image to the user of image transmitting element 20 indicating image receiving elements 60 that can accept.Handle and get back to the decision of decision block 182 thus with the user of wait image receiving unit 60.If receive another width of cloth image, this processing is sent the view data request by start button 102 and is restarted.
If call out to stop (decision block 236), reset counter module 106 (functional block 242), and before end of calling, final reset signal sent to image transmitting element 20 (functional block 244).
Superimposed image transmission system of the present invention can be used in combination separately or with aforesaid multiresolution transmission system.In other words, this superimposed image system can be independent of the multi-resolution image system works.Therefore, the superimposed image system accepts original image with its citation form with by previously described device by the image-input device 22 of image transmitting element 20.Then, original image is sent to image receiving unit 60 from the image transmitting element, whole original image is presented on the display 95 at this.By bypass resetting means 108, image receiving unit 60 sends the signal that it prepares to receive difference images to image transmitting element 20.When the modification image was input to image input unit 22, the difference that image transmitting element 20 is determined to revise between images and the original image also formed difference images.Then, difference images are sent to image receiving unit 60, reconfigure at this and the previous original image that sends.In case reconfigure difference images and original image, the image of display update on display 95.
An example of this processing is that the sender imports a unsigned hand-written letter by image input unit 22 and sends to the recipient in system.The sender is searching for the recipient's relevant with the letter content approval.Like this, unsigned hand-written letter is the original image in this process, and it is stored in the work video memory 28.The sender is from the oral approval of recipient's reception to letter.Then, sender adversary writes the letter signature and passes through image input unit 22 once more with its input.Original image (letter of not signing) at first is sent to movement images memory 30, will revise image (signature letter) then and be stored in the work video memory 28.Then, image processor 32 is determined the difference between original image and the modification image.In this example, difference has been to add sender's signature.Therefore, the difference images that formed by image processor 32 only comprise sender's signature.Because letter itself has sent to the recipient, do not need to send once more the part of revising image.Therefore, the purpose of this processing is by only sending signature and then it being revised image with the letter reorganization that has received at image receiving unit 60 with correction and save the image transmission time.
To be key diagram be combined into the functional-block diagram of single combination image transmission/receiving element as transmitting element 20 and image receiving unit 60 to Fig. 6, summarizes expression by label 25, and combination image transmission/receiving element can send and receive the multiresolution superimposed image data.Same device also is as previously mentioned by communication medium 110 links.Fig. 7 illustrates in greater detail combination transmission/receiving element 245.All parts are identical with those parts of describing one by one at the image transmitting element 20 and the image receiving unit 60 of description in the prior figures 1 to 5.Unique synchronous parts are the communication units that are used for the double duty of combination image transmission/receiving element 245, combination image transmission/receiving element 245 comprises independent sending module 252, the Route Selection switch 256 that independent receiver module 254 and the view data of collecting at receiver module 252 for guiding increase.
Fig. 8 understands the operation of the combination image transmission/receiving element 245 of Fig. 6 and 7 in more detail.Describe independent transmission in the Figure 4 and 5 in front and received treatment of picture.Do not repeat the operation of these processing at this.Pool image transmitting element 20 and image receiving unit 60 have caused some interaction between two unit, and these interactions are unwanted for two independent unit.Only further go through these characteristics at this.
As previously described, shown in functional block 260, the resolution of the minimum level by setting up any image that will send or receive begins two callings between the same device.Then, for combination image transmission/receiving element 245, must determine that this unit is to send or receive image (decision block 262,264).If pool image transmission/receiving element 245 will send image (decision block 262), the image in image-input device 22 inputs is stored in (decision block 272 and functional block 276) in work video memory 28 and the complete image memory 88.If input picture is to revise image (decision block 272), previous image is sent to movement images memory 30 by presentation manager 32 in the video memory 28 of at first will working.Then, be stored in (functional block 284) in work video memory 28 and the complete image memory 88 revising image, and obtain difference images (functional block 286).Also is essential by the user in the parameter of image input device 22 definition, so that notice Route Selection switch (S4) 256 will be assigned to the transmission part of combination image transmission/receiving element 245 now by the data of receiver module 254 new inputs.In others, decomposition and encryption function are with previously described identical, do not stop if receive reset signal or do not call out, then continue to handle view data request, up to the resolution that reaches greatest level (in decision block 274 beginnings) from the recipient from the recipient.Receive after the reset signal, give the user one and send another image (decision block 262), receive the selection of image (decision block 264) or end call (decision block 266) from other side.
If send another image, this processing restarts with the image input of functional block 272.If do not send other image, or end call (functional block 266), or whether system wait observation user determines to send another image or receives image.Should point out, if in decision block 310, do not receive reset signal, but also end call (decision block 312).In either case, reset counter module 40 (functional block 268 and 320) before sign off.
If the user of combination image transmission/receiving element 245 plans to receive view data (decision block 264), send view data request (decision block 322) to transmit leg by pressing the button 102.This action also indicates Route Selection switch (S4) 256 view data to be routed to the receiver section (functional block 324) of combination image transmission/receiving element 245.The same way as work of receiver section to describe with Fig. 5.When image finally is presented on the display 95, for any modification that can make and be stored in the work video memory 28, also it is sent back to image-input device 22, so that it is identified as " original " image.If dissatisfied to resolution after receiving initial primary image, the recipient can press the button 102 like before and improve resolution.This is corresponding to the request to additional data as shown in decision block 322.
Continue to increase the processing of tuning image resolution ratio according to the explanation of the preceding paragraph, satisfied or reached utmost sharpness numerical value up to the recipient.Shown in decision block 380 and 382, if the user does not send reset signal or not end call, receiving unit will only show last image and continuation wait user or request additional detail (decision block 322), reset or end call.If the user selects to send reset signal (decision block 380), sending the preceding reset counter module 106 of reset signal (functional block 386).Should point out, also can realize resetting greater than the number of times of the utmost sharpness numerical value that can ask simultaneously by button 102 is started.The sort of mode no matter, reset signal is the counter module 40 that notice transmit leg receiver section prepares to receive the next image and the dispensing device that resets.As previously mentioned, the transmission of reset signal also is to show that the recipient can accept the sign of the resolution of previous image.Handle and to get back to decision block 262 and 264 decisions thus with the user that waits for combination image transmission/receiving element 245.If receive another width of cloth image, this processing is sent the view data request by start button 102 and is restarted.If do not ask other image and do not restart reset button, then end call (decision block 382).In this case, reset counter module 106 (functional block 388), and before end of calling, final reset signal is sent to other communication party.
The described method that is used to send the multi-resolution image data of superimposed image has illustrated the level of efficiency that improves, this method can by make communication determine to transmit superimposed image in many ways the time required optimum resolution grade realize.The interactivity of this method also allows to optimize in many ways the resolution of each image that sends with many image sequences.Therefore, this method will produce faster the image transmission, if all the more so when particularly user's requirement does not need the resolution of highest ranking.In addition, single image can comprise the different piece of the different resolution of respectively doing for oneself.Therefore, when using radio communication, this method plays the effect that improves Image Communication efficient by reducing storage requirement, bandwidth demand, power consumption and airtime.
Certainly, the concrete mode outside also available mode described here under the situation that does not break away from the present invention's spirit and substantive characteristics realizes the present invention.Therefore,, should think that these embodiment are to explanation of the present invention rather than to its restriction, be included in institute in the implication of claims and the equivalency range and change and be included among the present invention no matter from that aspect.
Claims (34)
1. the wireless device in radio-frequency (RF) communication system sends the method for superimposed image data, comprises step:
A) in an image transmitting element, store original image;
B) send original image from this image transmitting element to an image receiving unit;
C) in image receiving unit, store original image;
D) in the image transmitting element, revise original image and revise image to form one;
E) memory modify image in the image transmitting element;
F) compare revising image and original image, and extract difference to form difference images;
G) difference images are sent to image receiving unit;
H) difference images are added to original image, so that regenerate the modification image at image receiving unit; With
I) memory modify image in image receiving unit.
2. method according to claim 1, wherein the modification image of original image and back is stored in the work video memory in the image transmitting element.
3. method according to claim 2, further comprise when the modification image of back is stored in the work video memory the work video memory in last image be sent to the step of the movement images memory in the image transmitting element.
4. method according to claim 3, wherein the image processor in the image transmitting element compares the image in image in the work video memory and the movement images memory, and the difference between definite two images is to form difference images.
5. method according to claim 1, wherein the modification image of original image and back is stored in the complete image memory in the image receiving unit.
6. method according to claim 5, wherein difference images are stored in the parts of images memory in the image receiving unit.
7. method according to claim 6, wherein the image processor in the image receiving unit reconfigures the image in image in the complete image memory and the parts of images memory to regenerate the modification image.
8. method according to claim 7 is wherein revised in the complete image memory that image is stored in image receiving unit.
9. method according to claim 8, the wherein image in image receiving unit demonstration complete image memory.
10. method according to claim 1, the step that wherein sends original image comprises: original image is resolved into a primary image and one or more image detail; The original image that storage is decomposed in the image transmitting element; Send primary image from an image transmitting element to an image receiving unit; Receive one or more additional data requests from this image receiving unit; Send additional image detail from the image transmitting element to image receiving unit as request of data with this appended drawings of response.
11. method according to claim 10 wherein sends appended drawings and comprises as the step of request of data the multiple image details is sent the multiple image data.
12. method according to claim 11, the step that wherein sends additional image detail comprises that response multiple image request of data sends the multiple image details.
13. method according to claim 12, the step that wherein sends the multiple image details is included in and made up the multiple image details before image receiving unit sends.
14. comprising with a string discrete message piece, method according to claim 12, the step that wherein sends the multiple image details send image detail.
15. method according to claim 10 is included in the step that the image transmitting element is stored the quantity of the image detail sum that sends to image receiving unit.
16. method according to claim 15 wherein sends the definite sum that had before sent to the image detail of image receiving unit of the step of adding image detail, sends next image detail and increases sum.
17. a method that transmits superimposed image between image transmitting element and image receiving unit comprises step:
A) original image is resolved into the discrete message piece that comprises a primary image and one or more image details;
B) stored information blocks in the image transmitting element;
C) send first view data request from an image receiving unit to the image transmitting element;
D) the response first view data request sends to image receiving unit to the block of information that comprises primary image from the image transmitting element;
E) show primary image at image receiving unit;
F) send one or more appended drawings as request of data from image receiving unit to the image transmitting element;
G) the response appended drawings sends to image receiving unit to the additional information piece that comprises image detail from the image transmitting element as request of data;
H) at image receiving unit image detail and the primary image that is received by image receiving unit and any previous image detail are made up, to generate than the more high-resolution new detail pictures of previous image;
I) show new detail pictures at image receiving unit;
J) revise original image at the image transmitting element and revise image to form;
K) compare revising image and original image, and the difference between the extraction image is to form difference images;
L) send difference images from the image transmitting element to image receiving unit;
M) at image receiving unit original image and difference images are reconfigured, revise image with improvement; With
N) at image receiving unit display update image.
18. method according to claim 17, wherein the modification image of original image and back is stored in the work video memory in the image transmitting element.
19. method according to claim 18, further comprise when the modification image of back is stored in the work video memory the work video memory in last image be sent to the step of the movement images memory in the image transmitting element.
20. method according to claim 19, wherein the image processor in the image transmitting element compares the image in image in the work video memory and the movement images memory, and the difference between definite two images is to form difference images.
21. method according to claim 17, wherein raw image storage is in a complete image memory of image receiving unit.
22. method according to claim 17, wherein the difference images of back are stored in the parts of images memory of image receiving unit.
23. method according to claim 22, wherein the image processor in the image receiving unit is the previous iterate combination of the image in difference images in the parts of images memory and the complete image memory, new to generate, revise image, and new, modification image are stored in the described complete image memory.
24. method according to claim 23 is wherein at image receiving unit display update image.
25. method according to claim 17 wherein sends appended drawings and is included as the multiple image details as the step of request of data and sends the multiple image data.
26. method according to claim 25, the step that wherein sends additional image detail comprises that response multiple image request of data sends the multiple image details.
27. method according to claim 26, the step that wherein sends the multiple image details is included in and made up the multiple image details before image receiving unit sends.
28. comprising with a string discrete message piece, method according to claim 27, the step that wherein sends the multiple image details send image detail.
29. method according to claim 17 is included in the step that the image transmitting element is stored the quantity of the image detail sum that sends to image receiving unit.
30. method according to claim 29 wherein sends the definite sum that had before sent to the image detail of image receiving unit of the step of adding image detail, sends next image detail and increases sum.
31. a superimposed image data transmission system comprises:
A) image transmitting element with a memory is used to store the subsequent modification of original image and this original image;
B) graphics processing unit in the image transmitting element is used for original image and modification image are compared to generate difference images;
C) image receiving unit that comprises image display;
D) communicator that image transmitting element and image receiving unit are linked is used for original image and difference images are sent to image receiving unit; With
E) image processing apparatus in image receiving unit is used for difference images and original image combination are revised image with improvement.
32. superimposed image data transmission system according to claim 31 further comprises a picture breakdown unit in the image transmitting element, is used for before image sends to image receiving unit its decomposition.
33. superimposed image data transmission system according to claim 32, wherein image receiving unit comprises that being used for handle sends the device that the preceding image that decomposes reconfigures.
34. the multiresolution transmission system of a superimposed image data comprises:
A) the image transmitting element with memory is used to store original image and subsequent modification image;
B) image comparison means in the image transmitting element is used for the difference between definite original image and the subsequent modification image, to generate difference images;
C) image transmitting element with memory is used for chunk store exploded view picture;
D) picture breakdown device is used for picture breakdown is become a primary image and one or more image detail, and this image detail can make up with primary image subsequently, to generate the more and more higher detail pictures of resolution;
E) image receiving unit that comprises image display;
F) communicator that image transmitting element and image receiving unit are linked;
G) request unit, be used for sending the view data request to the image transmitting element from image receiving unit, image transmitting element response image request of data, begin to send view data to image receiving unit with primary image with discrete unit, and progressively make progress by the image detail unit, up to reaching last image detail;
H) image processing apparatus in image receiving unit is used for primary image and image detail combination, so that generate the more and more higher detail pictures of resolution by increasing each image detail;
I) resetting means in image receiving unit is used to send an image transfer sequence and notifies the image transmitting element to enter the standby condition that receives another image; With
J) image processing apparatus in image receiving unit is used for difference images and original image combination are revised image to generate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN97196388A CN1225218A (en) | 1996-07-16 | 1997-07-09 | Method for transmitting superimposed image data in a radio frequency communication system |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/682,044 | 1996-07-16 | ||
| CN97196388A CN1225218A (en) | 1996-07-16 | 1997-07-09 | Method for transmitting superimposed image data in a radio frequency communication system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1225218A true CN1225218A (en) | 1999-08-04 |
Family
ID=5179736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN97196388A Pending CN1225218A (en) | 1996-07-16 | 1997-07-09 | Method for transmitting superimposed image data in a radio frequency communication system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1225218A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100365976C (en) * | 2004-09-15 | 2008-01-30 | 北京中星微电子有限公司 | Electronic white plate image sharing method based on content different comparison |
| CN103414742A (en) * | 2013-07-03 | 2013-11-27 | 百度在线网络技术（北京）有限公司 | Image transmission method and system |
| CN104010215A (en) * | 2014-05-14 | 2014-08-27 | 福州瑞芯微电子有限公司 | Image sharing method based on Miracast, source device, terminal device and system |
-
1997
- 1997-07-09 CN CN97196388A patent/CN1225218A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100365976C (en) * | 2004-09-15 | 2008-01-30 | 北京中星微电子有限公司 | Electronic white plate image sharing method based on content different comparison |
| CN103414742A (en) * | 2013-07-03 | 2013-11-27 | 百度在线网络技术（北京）有限公司 | Image transmission method and system |
| CN103414742B (en) * | 2013-07-03 | 2016-12-28 | 百度在线网络技术（北京）有限公司 | A kind of picture transmission method and system |
| CN104010215A (en) * | 2014-05-14 | 2014-08-27 | 福州瑞芯微电子有限公司 | Image sharing method based on Miracast, source device, terminal device and system |
| CN104010215B (en) * | 2014-05-14 | 2018-03-27 | 福州瑞芯微电子股份有限公司 | A kind of image sharing method, source device, terminal device and system based on Miracast |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5940117A (en) | Method for transmitting multiresolution image data in a radio frequency communication system | |
| US5459482A (en) | Facsimile communication with an active addressing display device | |
| CN1093669C (en) | A histogram equalization apparatus for contrast enhancement of moving image and method therefor | |
| CN106683053B (en) | A kind of GF (26) the progressive secret image sharing of finite field multi-threshold and reconstructing method | |
| CN1695382A (en) | A method and device for transcoding images | |
| CN1625893A (en) | Compression of palettized color images with variable length color codes | |
| CN106530368A (en) | Prime-domain multi-threshold progressive secret image preservation and reconstruction method | |
| CN100571388C (en) | The scalable data sequence of encrypting is gradually carried out the method for stretching | |
| JP2000514969A (en) | Method of transmitting superimposed image data in radio frequency communication device | |
| CN114640523B (en) | Computer data security encryption method and system | |
| CN101032167A (en) | Method for broadcasting digital data to a targeted set of reception terminals | |
| CN1972431A (en) | A video conference image processing system | |
| CN113132418B (en) | Variable-grade encryption method, system and device | |
| CN1533179A (en) | VIsible telephone device and visible telephone system for checking picture validity | |
| US7212974B2 (en) | System and method for compressing and encoding data | |
| CN1225218A (en) | Method for transmitting superimposed image data in a radio frequency communication system | |
| CN1149949A (en) | Method and apparatus for encoding facsimile message | |
| JP3387738B2 (en) | Image pattern converter | |
| CN105704499B (en) | A kind of selective satellite image compression encryption method based on ChaCha20 and CCSDS | |
| CN108668048A (en) | The processing method and system of image data, storage medium, processor | |
| JPH09116759A (en) | Image decoder and image coding decoding system | |
| CN103442233B (en) | Low-bit-rate H.264 video encryption compression transmission method based on ranking permutation | |
| Liu et al. | A grouped-scalable secret image sharing scheme | |
| Nakachi et al. | A Design Method for Golomb Coding in Layered Scrambled JPEG XS Scheme | |
| Kafi et al. | Index assignment optimized for partial encryption |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |