US20140357993A1 - Dynamic adjustment of image compression for high resolution live medical image sharing - Google Patents
Dynamic adjustment of image compression for high resolution live medical image sharing Download PDFInfo
- Publication number
- US20140357993A1 US20140357993A1 US14/291,567 US201414291567A US2014357993A1 US 20140357993 A1 US20140357993 A1 US 20140357993A1 US 201414291567 A US201414291567 A US 201414291567A US 2014357993 A1 US2014357993 A1 US 2014357993A1
- Authority
- US
- United States
- Prior art keywords
- compression
- video stream
- selecting
- network
- quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H04N19/00672—
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/56—Details of data transmission or power supply
- A61B8/565—Details of data transmission or power supply involving data transmission via a network
-
- H04N19/00696—
-
- H04N19/00763—
-
- H04N19/00812—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/164—Feedback from the receiver or from the transmission channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/164—Feedback from the receiver or from the transmission channel
- H04N19/166—Feedback from the receiver or from the transmission channel concerning the amount of transmission errors, e.g. bit error rate [BER]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
- A61B6/56—Details of data transmission or power supply, e.g. use of slip rings
- A61B6/563—Details of data transmission or power supply, e.g. use of slip rings involving image data transmission via a network
Definitions
- the present invention is generally related to techniques for live sharing over the Internet of a video stream composed of high resolution medical images, such as ultrasound images. More particularly, the present invention is directly to dynamically adapting compression techniques for a video stream of medical images to adjust to variable network conditions.
- telemedicine applications there is a need to share medical data between different sites.
- medical imaging applications require a large bandwidth to stream as a live video stream of medical images.
- Illustrative examples include live video streaming of ultrasound imaging, angiography, and endoscopy.
- Many types of medical images are difficult to efficiently compress.
- ultrasound images have a high entropy content and have compression ratios that are dramatically lower than the compression ratios that can be achieved for streaming television and movies.
- An additional complication is that many small clinics have poor IT infrastructure with marginal and time-varying connections to the Internet, due to cost considerations, remote locations, or other reasons.
- image frames typically have a resolution of 512 ⁇ 512 pixels that are acquired at frame rates of 10 to 60 frames per second (fps).
- the frame rate may vary, depending in the u/s frequency of operation.
- the frame size is usually fixed, and the pixel resolution is again determined by the u/s frequency, and can vary from 400 microns at 2 MHz frequency to 80 microns at 10 MHz frequency. It is this pixel resolution that is relevant to the end-user, not the frame size itself.
- the frames at the frame rate are usually concatenated to form a standard video stream.
- JND Just Noticeable Difference
- Ultrasound images have a high entropy content and cannot be compressed with as high a compression ratio as conventional video streams for movies.
- many different compression standards are allowed. Examples of permissible compression standards for ultrasound imaging include Motion JPEG2000 (MJPEG2000), MPEG-4 and H.264.
- Motion JPEG is a video codec in which each frame is separately compressed into a JPEG image. As a result the quality of the video compression is independent of the motion of the image. At low bandwidth availability priority is given to image resolution.
- MPEG-4 is a standard that sends a reference frame and difference data for following frames (I frames, B frames, and P frames).
- each image frame is compressed (either lossy or lossless) and every frame in the 30 fps stream is sent separately.
- Typical lossy compression rates are of the order of 1:10 to 1:15. Further effective compression rates are not possible without losing image quality, since inter-frame data redundancy is not captured in MJPEG2000.
- the compression rates of 1:10 to 1:15 rates of MJPEG2000 are good, there are problems in using MGPEG2000 for data storage or for network transport.
- An ultrasound image typically includes a main ultrasound image 105 (the active sub-image taken by the ultrasound probe) and border regions 110 , 115 which may include labeling or text describing aspects of the image.
- a main ultrasound image 105 the active sub-image taken by the ultrasound probe
- border regions 110 , 115 which may include labeling or text describing aspects of the image.
- an image can often be segmented into strips.
- the image example in FIG. 1 the image can be segmented into three strips—a top stripe having some textual data, a left stripe having textual data and the remaining sub-image which corresponds to the ultrasound image data.
- the top and left stripes are highly compressible, to a few bytes, since inter-frame redundancies are very high.
- the active sub-image will have a lower compression rate, based on the mobility of the organ under exam.
- Image data may be sent via a wired or wireless network.
- a networked environment such as the internet, where these u/s streams are transported in real-time, there are dynamic conditions of the network that can momentarily constrict or disrupt the available bandwidth for u/s stream transport. As a result there can be a severe loss in the quality of the real time transaction and/or a loss in the connection, which is unacceptable in many applications.
- An apparatus, system, method and computer readable medium is disclosed to dynamically adjust compression parameters for a live video stream of medical imaging data in a network having variable network conditions.
- Quality of Service (QOS) metrics are monitored for a network session between at least two sites.
- the QOS metrics are used to predict a minimum expected bit rate.
- the minimum expected bit rate is used to select compression parameters for compressing the live video stream of medical imaging data.
- the compression parameter may include different video compression protocols and selectable parameters within an individual compression protocol.
- the quality of service metrics are also used to select a network transmission protocol for transmitting the video stream.
- FIG. 1 illustrates a conventional ultrasound image with dashed lines superimposed to illustrate aspects of image compression.
- FIG. 2 illustrates a system for dynamically adjusting compression parameters of a video stream of medical imaging data in accordance with an embodiment of the present invention.
- FIG. 3 illustrates a tunable compression engine in accordance with an embodiment of the present invention.
- FIG. 4 illustrates aspects of a network QOS transaction in accordance with an embodiment of the present invention.
- FIG. 5 illustrates prediction of compression rate in accordance with an embodiment of the present invention.
- FIG. 6 illustrates selection of network transmission protocol based on network conditions in accordance with an embodiment of the present invention.
- FIG. 2 illustrates an exemplary system and network environment for sharing a video stream of compressed medical images.
- a patient 207 is examined by a doctor 209 or a medical technician.
- the patient may by a human patient.
- many medical imaging procedures have been adapted for veterinary medicine such that the patient may be cat, dog, horse, etc.
- a medical imaging scanning device 210 generates a live stream of video images that are transmitted over a network to another site 260 , such as local area network 265 of a medical center.
- the live stream may be transmitted to a site of a specialist doctor or a doctor from whom a second opinion is desired. It is also understood that the live stream may also be transmitted simultaneously to other sites.
- An exemplary medical imaging scanning device 210 is an ultrasound imaging device, although more generally other types of live imaging device could be used, such as angiography or endoscopy.
- ultrasound there is high entropy content of the images in the video stream which in turn invokes many tradeoffs in regards to the compression parameters used to compress the images.
- Exemplary imaging technologies may require frame rates of 10-60 fps, 8 bits per pixel gray scale and 12 bits for color images, such as color Doppler ultrasound images.
- image frames may have a resolution of 512 ⁇ 512 pixels at frame rates of 30 fps and 8 bits per pixel, the raw data rate is 63 Mbps.
- Other medical imaging techniques, such as angiography have similar data requirements.
- the present invention is generally directed to the use of dynamically adapting a compression scheme used for transporting a medical image video stream, such as an ultrasound stream, across a network with time varying network session connection quality using feedback from at least one network quality of service agent.
- a live stream of medical images carries a large amount of data.
- certain types of medical data, such as ultrasound images are difficult to efficiently compress.
- the network connection quality between sites may vary dramatically. For example, a doctor at a small clinic may have a poor quality connection to the Internet. As a result of these factors, compressing the live video stream of the medical imaging data is performed to attempt to maintain live connection with minimal degradation of the quality of the live images.
- the network path to a remote viewer at site 260 includes the Internet network cloud 250 and any local networks, such as local network 265 .
- Reporting (R) tools are network agents that provide network metrics at different part of the network communication path. Typically there would be reporting tools configured in at least both ends of the network path. These network metrics may include attributes such as bandwidth, packet loss, and packet corruption.
- the reporting tools may comprise commercial or proprietary reporting tools.
- the frequency with which reports are received may be configured. For example, many commercial network reporting tools permit periodic generation of reports on network conditions such as once every 100 ms, once every second, once every five seconds, etc.
- the network quality of service (QOS) metrics are monitored and used to predict network conditions (in the near future) to determine optimum compression parameters for transmitting a live video stream of medical images to the remote viewer. That is, the QOS metrics provide metrics on past and recent network conditions, which are then used to predict network conditions when a frame of the live video stream is transmitted. For example, suppose the reporting tools provide a report every 5 seconds. In this example, if the last report was received 3 seconds ago, data on the past and most recent report (3 seconds ago) on network conditions may be used to predict network conditions to transmit a video frame. In particular, an expected minimum bit rate may be calculated based on quality of service inputs such as predicted bandwidth, predicted packet loss, and predicted packet latency. This minimum bit rate of the connection session, in turn, implies a compression rate, or compression ratio, for the live stream of medical images.
- QOS quality of service
- Block 240 illustrates an example of modules to dynamically adjust compression parameters as network conditions vary.
- a local computer 249 includes software modules to perform network QOS monitoring 242 , compression rate prediction 244 , a tunable compression engine 246 , and a call management selection module 248 .
- the call management selection module 248 also receives the QOS metrics from network QOS monitoring module 242 and selects the network transmission protocol (e.g., TCP or UDP) based on the network conditions.
- TCP Transmission Control Protocol
- the tunable compression engine 244 has compression parameters that are selectable.
- the selectable parameters may include different compression protocols and/or selectable features within one protocol.
- the tunable compression engine selects the compression technique, based on the predicted compression rate, to optimize the image quality for the medical images of the live video stream. In particular, the tunable compression engine may select the compression technique to minimize distortion of the video images given the constraint of the predicted bit rate and that certain types of medical images, such as ultrasound images, have a high entropy content.
- the compressed live medical image stream is transmitted using a network protocol, which may also be adjusted based on network conditions.
- FIG. 3 is a functional block diagram illustrating additional aspects of the compression engine 246 .
- a rule-based system may select an optimum compression technique to transmit a live video stream of medical images with minimal distortion. That is, certain ranges of parameters, such as bandwidth, loss, and packet corruption, are mapped to specific compression parameters.
- the compression engine in one embodiment selects a compression protocol from a choice of at least two different compression protocols used in transmitting live video streams of medical images.
- the compression engine may also make dynamic adjustments to individual selectable features of an individual compression protocol.
- the compression engine is a flexible engine. Depending on the available bandwidth (predicted bit rate), it can switch dynamically between different video compression protocols. In one embodiment it can dynamically switch between MJPEG2000 compression and standard MPEG-4/H.264 schemes.
- compression rates are adjusted by one or more of:
- an additional storage compression engine 305 may be provided to optimize compression for storage.
- the compression engine for storage may use a constant conservative compression rate applied to the stream that will not compromise the JND threshold guidelines of ACR.
- the compression engine can adapt rapidly to changing network conditions.
- many parts of the world doctor's offices and small clinics may use wireless local networks and/or wireless Internet connections.
- the quality of these connections may depend on the time of day and other factors.
- a clinic close to a train track may experience large changes in the quality of a wireless Internet connection whenever a train travels close to the clinic, due to the reflection from the metal surface of the train.
- the quality of WiFi service may vary based on time of day and number of users.
- Wireless internet connections based on the 802.11 standard may suffer interference and packet drop at times of the day when there are many users on individual wireless networks and on neighboring wireless networks.
- many wireless internet systems in individual portions of a city slow down between the hours of 5 PM to 8 PM as multiple users in the same geographic region attempt to simultaneously access the Internet.
- the compression engine 246 compresses the video stream prior to transmission.
- the network has time-varying quality of service (QOS) characteristics, such as packet loss, bandwidth, and packet corruption. If fixed (non-varying) compression techniques are used then in the worst case the changing network conditions can result in a severe loss in the quality of the real time transaction and a possible loss in connection, which in unacceptable.
- the compression engine reacts to such changing conditions by monitoring network conditions and adapting the compression technique used to compress the video stream.
- the compression scheme is adapted to the dynamic conditions of the network by utilizing a variable rate compression scheme. For the data archival use-case, a fixed rate compression scheme is adequate and the rate is based on the JND metric for the specimen being imaged.
- FIG. 4 illustrates aspects related to the use of Active Network Quality Agents (ANQA) for an ultrasound (u/s) embodiment.
- the ANQA elements 405 serve as the reporting (R) agents.
- R reporting
- the ANQA elements may be based on proprietary software or on commercial solutions.
- commercial products such as the Airwave software of Aruba Networks, Inc., provide network Quality of Service (QOS) metrics, and can be configured to report these statistics to desired locations.
- QOS network Quality of Service
- the ANQA elements may be local and remote reporting elements, although more generally there may be additional ANQA elements at different points in the network. Examples of QOS metrics include current bandwidth (BW) for TCP connections and packet loss rate (PLR) for UDP connections
- the Active Network Quality Agent continually monitors the available QOS metrics for a network session.
- a prediction scheme for determining the available bandwidth is utilized. That, is the current and recent reporting results from the ANQA agents are used to predict the expected bit rate along the transmission path when the video is transmitted.
- the ANQA reporting agent(s) 405 report the QoS metrics to the Compression Rate Predictor (CRP) 410 , which outputs a compression rate to the compression engine 420 .
- the CRP may rely on available metrics for current and immediate past of network Quality of Service (QoS) to predict a compression rate which would be compatible with the network conditions.
- QoS Quality of Service
- the CRP may, for example, utilize linear or non-linear prediction techniques for compression rate prediction. That is, a variety of different well-known prediction algorithms may be modified to take the QOS metrics (e.g., bandwidth, packet loss, and packet corruption) and generate an expected bit rate for the compression engine.
- QOS metrics e.g., bandwidth, packet loss, and packet corruption
- a variety of linear prediction algorithms may, for example, predict network quality (e.g., packet loss, bandwidth) based on regression techniques and, curve fitting based on the measured QOS metrics to predict network characteristics.
- a filter is provided in combination with a forward predictor.
- the current compression rate is an input and the output is a predicated compression rate.
- a Linear Prediction algorithm utilizes Auto-Regressive Moving-Average (ARMA) models that utilize an error correction scheme such that the filter would be an ARMA filter.
- Kalman Prediction KP may also be used by the compression rate predictor.
- any KP scheme Linear or Non-Linear
- HMM Hidden Markov Model
- the monitoring rate of ANQA agents is adjustable. For example, this monitoring can be done every second to about few times a minute. This monitoring rate can also be subject to a prediction scheme, based on the rate of change of QoS, in a manner similar to the compression rate prediction.
- FIG. 6 illustrates an example for the medical image scanner being an ultrasound imager 610 .
- the ANQA are used to support a call management system dynamically switching between different network transmission protocols (e.g., Transmission Control Protocol (TCP) and User Datagram Protocol (UDP) protocols) based on QoS metrics.
- TCP Transmission Control Protocol
- UDP User Datagram Protocol
- TCP for example, provides for retransmission of dropped packets and thus requires higher bandwidth than UDP.
- UDP has lower bandwidth and lower latency requirements but does not guarantee delivery of packets.
- the QOS metrics may different slightly for TCP vs. UDP and thus have to be factored into the compression rate predictor.
- the network transmission protocol may be selected to optimize the quality of the live video stream in view of the QOS metrics. While TCP and UDP are examples of network transmission protocols, it will be noted that other network transmission protocols are contemplated, such as Stream Control Transmission Protocol (SCTP).
- SCTP Stream Control Transmission Protocol
- the QOS statistics during use of the medical image scanner may also be monitored by a service entity to provide recommendations.
- the QOS statistics provide information on the network connection quality.
- the QOS statistics may also be collected over many different sessions. As a result, temporal patterns may be detected.
- a large hospital or clinic may have a dedicated in-house information technology capability. However, small clinics or individual doctor soften lack such capabilities and under-invest in information technology services.
- a rule based system may provide recommendations on how an upgrade in network capabilities (e.g., connection type and/or connection bandwidth) may improve performance.
- the networks metrics monitoring, compression rate predictor, tunable compression engine, and call management may be implemented in different ways. In one embodiment they are implemented as software modules operating on a local computer. Alternatively, it will be understood that some or all of the modules may be implemented within a medical image scanner. It will be understood that the software modules and methodologies may be stored as computer readable instructions stored on a non-transitory computer readable medium.
- the present invention may also be tangibly embodied as a set of computer instructions stored on a computer readable medium, such as a memory device.
Abstract
A video stream of live medical images is generated at a local site having a medical image scanner. A live video stream is transmitted to at least one remote site via a network, which may include wired or wireless Internet connections. Network conditions are monitored during a network session and predictions are made on a predicted bit rate for transmission. The compression parameters for the live video stream are selected based on the predicted bit rate.
Description
- The present application claims the benefit of U.S. Provisional Application No. 61/829,887, filed on May 31, 2013, the contents of which are hereby incorporated by reference.
- The present invention is generally related to techniques for live sharing over the Internet of a video stream composed of high resolution medical images, such as ultrasound images. More particularly, the present invention is directly to dynamically adapting compression techniques for a video stream of medical images to adjust to variable network conditions.
- In telemedicine applications there is a need to share medical data between different sites. However, one problem in the industry is that some medical imaging applications require a large bandwidth to stream as a live video stream of medical images. Illustrative examples include live video streaming of ultrasound imaging, angiography, and endoscopy. Many types of medical images are difficult to efficiently compress. For example, ultrasound images have a high entropy content and have compression ratios that are dramatically lower than the compression ratios that can be achieved for streaming television and movies. An additional complication is that many small clinics have poor IT infrastructure with marginal and time-varying connections to the Internet, due to cost considerations, remote locations, or other reasons.
- As an illustrative example of some of these problems, in ultrasound (u/s) imaging, image frames typically have a resolution of 512×512 pixels that are acquired at frame rates of 10 to 60 frames per second (fps). The frame rate may vary, depending in the u/s frequency of operation. The frame size is usually fixed, and the pixel resolution is again determined by the u/s frequency, and can vary from 400 microns at 2 MHz frequency to 80 microns at 10 MHz frequency. It is this pixel resolution that is relevant to the end-user, not the frame size itself. The frames at the frame rate are usually concatenated to form a standard video stream.
- The stated frame size and rates mentioned above imply a raw data rate of 63 Mbps at 30 fps and 8 bits per pixel, gray scale. Without any compression, the data storage required to store one minute of the u/s stream at 30 fps and 8 bits per pixel is 450 MB. For color Doppler u/s imaging 12 bits per pixel is required, implying a raw data rate of about 95 Mbps at 30 fps and a data storage requirement to store one minute of the Doppler u/stream of 675 MB. Consequently, an image compression scheme has to be employed to reduce the bit rate for real-time network transport of the u/s scheme and to reduce the data storage requirements of the u/s scheme. However, the compression requirements for these two use cases need not be identical.
- In medical imaging, lossless and lossy compression schemes are employed, depending on the imaging modality. Lossy compression may be employed as long as the quality of compressed images does not violate the Just Noticeable Difference (JND) threshold. This threshold is very subjective, but, many standards bodies such as the American College of Radiology (ACR) have established guidelines for compression rates for various medical imaging modalities.
- Ultrasound images have a high entropy content and cannot be compressed with as high a compression ratio as conventional video streams for movies. For ultrasound imaging, many different compression standards are allowed. Examples of permissible compression standards for ultrasound imaging include Motion JPEG2000 (MJPEG2000), MPEG-4 and H.264.
- Motion JPEG is a video codec in which each frame is separately compressed into a JPEG image. As a result the quality of the video compression is independent of the motion of the image. At low bandwidth availability priority is given to image resolution. In contrast, MPEG-4 is a standard that sends a reference frame and difference data for following frames (I frames, B frames, and P frames).
- In the case of MJPEG2000, each image frame is compressed (either lossy or lossless) and every frame in the 30 fps stream is sent separately. Typical lossy compression rates (compression ratios) are of the order of 1:10 to 1:15. Further effective compression rates are not possible without losing image quality, since inter-frame data redundancy is not captured in MJPEG2000. Thus, while the compression rates of 1:10 to 1:15 rates of MJPEG2000 are good, there are problems in using MGPEG2000 for data storage or for network transport.
- In the case of MPEG-4 and H.264, larger compression rates, from 1:20 through 1:80, are possible, since they utilize frame-to-frame redundancies and motion vector compensation schemes. For high entropy content images, such as ultrasound, the compression rates on the order of up to 1:20 to 1:40 are possible. These compression standards also allow for segmenting the images into multiple slices, and apply different compression rates for different schemes. An ultrasound image typically includes a main ultrasound image 105 (the active sub-image taken by the ultrasound probe) and
border regions FIG. 1 , the image can be segmented into three strips—a top stripe having some textual data, a left stripe having textual data and the remaining sub-image which corresponds to the ultrasound image data. - The top and left stripes are highly compressible, to a few bytes, since inter-frame redundancies are very high. The active sub-image will have a lower compression rate, based on the mobility of the organ under exam.
- Image data may be sent via a wired or wireless network. In a networked environment such as the internet, where these u/s streams are transported in real-time, there are dynamic conditions of the network that can momentarily constrict or disrupt the available bandwidth for u/s stream transport. As a result there can be a severe loss in the quality of the real time transaction and/or a loss in the connection, which is unacceptable in many applications.
- An apparatus, system, method and computer readable medium is disclosed to dynamically adjust compression parameters for a live video stream of medical imaging data in a network having variable network conditions. Quality of Service (QOS) metrics are monitored for a network session between at least two sites. In one embodiment the QOS metrics are used to predict a minimum expected bit rate. The minimum expected bit rate is used to select compression parameters for compressing the live video stream of medical imaging data. The compression parameter may include different video compression protocols and selectable parameters within an individual compression protocol. In one embodiment the quality of service metrics are also used to select a network transmission protocol for transmitting the video stream.
-
FIG. 1 illustrates a conventional ultrasound image with dashed lines superimposed to illustrate aspects of image compression. -
FIG. 2 illustrates a system for dynamically adjusting compression parameters of a video stream of medical imaging data in accordance with an embodiment of the present invention. -
FIG. 3 illustrates a tunable compression engine in accordance with an embodiment of the present invention. -
FIG. 4 illustrates aspects of a network QOS transaction in accordance with an embodiment of the present invention. -
FIG. 5 illustrates prediction of compression rate in accordance with an embodiment of the present invention. -
FIG. 6 illustrates selection of network transmission protocol based on network conditions in accordance with an embodiment of the present invention. -
FIG. 2 illustrates an exemplary system and network environment for sharing a video stream of compressed medical images. At a local clinic site 205 apatient 207 is examined by adoctor 209 or a medical technician. The patient may by a human patient. Alternatively, many medical imaging procedures have been adapted for veterinary medicine such that the patient may be cat, dog, horse, etc. A medicalimaging scanning device 210 generates a live stream of video images that are transmitted over a network to anothersite 260, such aslocal area network 265 of a medical center. As an illustrative example, the live stream may be transmitted to a site of a specialist doctor or a doctor from whom a second opinion is desired. It is also understood that the live stream may also be transmitted simultaneously to other sites. - An exemplary medical
imaging scanning device 210 is an ultrasound imaging device, although more generally other types of live imaging device could be used, such as angiography or endoscopy. For the case of ultrasound there is high entropy content of the images in the video stream which in turn invokes many tradeoffs in regards to the compression parameters used to compress the images. Exemplary imaging technologies may require frame rates of 10-60 fps, 8 bits per pixel gray scale and 12 bits for color images, such as color Doppler ultrasound images. In the case of ultrasound imaging, image frames may have a resolution of 512×512 pixels at frame rates of 30 fps and 8 bits per pixel, the raw data rate is 63 Mbps. Other medical imaging techniques, such as angiography, have similar data requirements. - The present invention is generally directed to the use of dynamically adapting a compression scheme used for transporting a medical image video stream, such as an ultrasound stream, across a network with time varying network session connection quality using feedback from at least one network quality of service agent. A live stream of medical images carries a large amount of data. Additionally, certain types of medical data, such as ultrasound images, are difficult to efficiently compress. Moreover, the network connection quality between sites may vary dramatically. For example, a doctor at a small clinic may have a poor quality connection to the Internet. As a result of these factors, compressing the live video stream of the medical imaging data is performed to attempt to maintain live connection with minimal degradation of the quality of the live images.
- The network path to a remote viewer at
site 260 includes theInternet network cloud 250 and any local networks, such aslocal network 265. Reporting (R) tools are network agents that provide network metrics at different part of the network communication path. Typically there would be reporting tools configured in at least both ends of the network path. These network metrics may include attributes such as bandwidth, packet loss, and packet corruption. The reporting tools may comprise commercial or proprietary reporting tools. The frequency with which reports are received may be configured. For example, many commercial network reporting tools permit periodic generation of reports on network conditions such as once every 100 ms, once every second, once every five seconds, etc. - The network quality of service (QOS) metrics are monitored and used to predict network conditions (in the near future) to determine optimum compression parameters for transmitting a live video stream of medical images to the remote viewer. That is, the QOS metrics provide metrics on past and recent network conditions, which are then used to predict network conditions when a frame of the live video stream is transmitted. For example, suppose the reporting tools provide a report every 5 seconds. In this example, if the last report was received 3 seconds ago, data on the past and most recent report (3 seconds ago) on network conditions may be used to predict network conditions to transmit a video frame. In particular, an expected minimum bit rate may be calculated based on quality of service inputs such as predicted bandwidth, predicted packet loss, and predicted packet latency. This minimum bit rate of the connection session, in turn, implies a compression rate, or compression ratio, for the live stream of medical images.
-
Block 240 illustrates an example of modules to dynamically adjust compression parameters as network conditions vary. In one embodiment alocal computer 249 includes software modules to performnetwork QOS monitoring 242,compression rate prediction 244, atunable compression engine 246, and a callmanagement selection module 248. In one embodiment the callmanagement selection module 248 also receives the QOS metrics from networkQOS monitoring module 242 and selects the network transmission protocol (e.g., TCP or UDP) based on the network conditions. - The
tunable compression engine 244 has compression parameters that are selectable. The selectable parameters may include different compression protocols and/or selectable features within one protocol. The tunable compression engine selects the compression technique, based on the predicted compression rate, to optimize the image quality for the medical images of the live video stream. In particular, the tunable compression engine may select the compression technique to minimize distortion of the video images given the constraint of the predicted bit rate and that certain types of medical images, such as ultrasound images, have a high entropy content. The compressed live medical image stream is transmitted using a network protocol, which may also be adjusted based on network conditions. -
FIG. 3 is a functional block diagram illustrating additional aspects of thecompression engine 246. A rule-based system may select an optimum compression technique to transmit a live video stream of medical images with minimal distortion. That is, certain ranges of parameters, such as bandwidth, loss, and packet corruption, are mapped to specific compression parameters. The compression engine in one embodiment selects a compression protocol from a choice of at least two different compression protocols used in transmitting live video streams of medical images. The compression engine may also make dynamic adjustments to individual selectable features of an individual compression protocol. The compression engine is a flexible engine. Depending on the available bandwidth (predicted bit rate), it can switch dynamically between different video compression protocols. In one embodiment it can dynamically switch between MJPEG2000 compression and standard MPEG-4/H.264 schemes. More generally, it is contemplated that other currently implemented and proposed compression standards may be selected. Other examples of video compression protocol standards that may be selected include H.265, VP8, and VP9. Additionally, in one embodiment at least one compression protocol has selectable features that can be turned on or off. In the case of MPEG-4 and H.264, compression rates are adjusted by one or more of: - 1) turning on or off MVC encoding,
- 2) varying the block sizes of frames,
- 3) varying the quantization tables for intra-frame discrete cosine transform (DCT) compression,
- 4) varying motion vector compensation (MVC) for inter-frame compression, and
- 5) reducing the stream frame rate by dropping frames ahead of the compression engine.
- As also illustrated in
FIG. 3 , in one embodiment an additionalstorage compression engine 305 may be provided to optimize compression for storage. In some applications it may be desirable to also store the video stream. Consequently, as illustrated inFIG. 3 , a parallel compression engine for storage of the compressed medical image video stream may be provided that is not subject to such dynamic compression schemes. The compression engine for storage may use a constant conservative compression rate applied to the stream that will not compromise the JND threshold guidelines of ACR. - Note that the compression engine can adapt rapidly to changing network conditions. In many parts of the world doctor's offices and small clinics may use wireless local networks and/or wireless Internet connections. However, the quality of these connections may depend on the time of day and other factors. For example, a clinic close to a train track may experience large changes in the quality of a wireless Internet connection whenever a train travels close to the clinic, due to the reflection from the metal surface of the train. As another example, for the case of a small clinic using a WiFi connection, the quality of WiFi service may vary based on time of day and number of users. Wireless internet connections based on the 802.11 standard may suffer interference and packet drop at times of the day when there are many users on individual wireless networks and on neighboring wireless networks. As an example, many wireless internet systems in individual portions of a city slow down between the hours of 5 PM to 8 PM as multiple users in the same geographic region attempt to simultaneously access the Internet.
- The
compression engine 246 compresses the video stream prior to transmission. In practice the network has time-varying quality of service (QOS) characteristics, such as packet loss, bandwidth, and packet corruption. If fixed (non-varying) compression techniques are used then in the worst case the changing network conditions can result in a severe loss in the quality of the real time transaction and a possible loss in connection, which in unacceptable. In accordance with an embodiment of the present invention, the compression engine reacts to such changing conditions by monitoring network conditions and adapting the compression technique used to compress the video stream. The compression scheme is adapted to the dynamic conditions of the network by utilizing a variable rate compression scheme. For the data archival use-case, a fixed rate compression scheme is adequate and the rate is based on the JND metric for the specimen being imaged. -
FIG. 4 illustrates aspects related to the use of Active Network Quality Agents (ANQA) for an ultrasound (u/s) embodiment. TheANQA elements 405 serve as the reporting (R) agents. In a network session the network can be pictured as anetwork pipe 402 between local and remote sites. The ANQA elements may be based on proprietary software or on commercial solutions. As an example, commercial products, such as the Airwave software of Aruba Networks, Inc., provide network Quality of Service (QOS) metrics, and can be configured to report these statistics to desired locations. The ANQA elements may be local and remote reporting elements, although more generally there may be additional ANQA elements at different points in the network. Examples of QOS metrics include current bandwidth (BW) for TCP connections and packet loss rate (PLR) for UDP connections - In one embodiment, the Active Network Quality Agent (ANQA) continually monitors the available QOS metrics for a network session. In one embodiment a prediction scheme for determining the available bandwidth is utilized. That, is the current and recent reporting results from the ANQA agents are used to predict the expected bit rate along the transmission path when the video is transmitted.
- The ANQA reporting agent(s) 405 report the QoS metrics to the Compression Rate Predictor (CRP) 410, which outputs a compression rate to the
compression engine 420. The CRP may rely on available metrics for current and immediate past of network Quality of Service (QoS) to predict a compression rate which would be compatible with the network conditions. - The CRP may, for example, utilize linear or non-linear prediction techniques for compression rate prediction. That is, a variety of different well-known prediction algorithms may be modified to take the QOS metrics (e.g., bandwidth, packet loss, and packet corruption) and generate an expected bit rate for the compression engine.
- A variety of linear prediction algorithms may, for example, predict network quality (e.g., packet loss, bandwidth) based on regression techniques and, curve fitting based on the measured QOS metrics to predict network characteristics. Referring to
FIG. 5 , in one embodiment, a filter is provided in combination with a forward predictor. The current compression rate is an input and the output is a predicated compression rate. In one embodiment a Linear Prediction algorithm utilizes Auto-Regressive Moving-Average (ARMA) models that utilize an error correction scheme such that the filter would be an ARMA filter. Kalman Prediction (KP) may also be used by the compression rate predictor. As examples, any KP scheme (Linear or Non-Linear) that is modeled in a higher order state space scheme may be used. Additionally, Hidden Markov Model (HMM) Prediction may be used by the compression rate predictor. - In one embodiment the monitoring rate of ANQA agents is adjustable. For example, this monitoring can be done every second to about few times a minute. This monitoring rate can also be subject to a prediction scheme, based on the rate of change of QoS, in a manner similar to the compression rate prediction.
-
FIG. 6 illustrates an example for the medical image scanner being anultrasound imager 610. Referring toFIG. 6 , in one embodiment the ANQA are used to support a call management system dynamically switching between different network transmission protocols (e.g., Transmission Control Protocol (TCP) and User Datagram Protocol (UDP) protocols) based on QoS metrics. To monitor an individual session, at least one ANQA agent is monitored. Preferably at least two ANQA agents (one at either end of the network connection is monitored). Additional ANQA agents in the cloud may also be optionally monitored. There are tradeoffs, in terms of bandwidth and packet loss for different network protocols. TCP, for example, provides for retransmission of dropped packets and thus requires higher bandwidth than UDP. UDP has lower bandwidth and lower latency requirements but does not guarantee delivery of packets. - Additionally, as previously discussed, the QOS metrics may different slightly for TCP vs. UDP and thus have to be factored into the compression rate predictor. Thus, the network transmission protocol may be selected to optimize the quality of the live video stream in view of the QOS metrics. While TCP and UDP are examples of network transmission protocols, it will be noted that other network transmission protocols are contemplated, such as Stream Control Transmission Protocol (SCTP).
- In one embodiment the QOS statistics during use of the medical image scanner may also be monitored by a service entity to provide recommendations. The QOS statistics provide information on the network connection quality. The QOS statistics may also be collected over many different sessions. As a result, temporal patterns may be detected. A large hospital or clinic may have a dedicated in-house information technology capability. However, small clinics or individual doctor soften lack such capabilities and under-invest in information technology services. In one embodiment a rule based system may provide recommendations on how an upgrade in network capabilities (e.g., connection type and/or connection bandwidth) may improve performance.
- It will be understood that the networks metrics monitoring, compression rate predictor, tunable compression engine, and call management may be implemented in different ways. In one embodiment they are implemented as software modules operating on a local computer. Alternatively, it will be understood that some or all of the modules may be implemented within a medical image scanner. It will be understood that the software modules and methodologies may be stored as computer readable instructions stored on a non-transitory computer readable medium.
- While the invention has been described in conjunction with specific embodiments, it will be understood that it is not intended to limit the invention to the described embodiments. On the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims. The present invention may be practiced without some or all of these specific details. In addition, well known features may not have been described in detail to avoid unnecessarily obscuring the invention. In accordance with the present invention, the components, process steps, and/or data structures may be implemented using various types of operating systems, programming languages, computing platforms, computer programs, and/or general purpose machines. In addition, those of ordinary skill in the art will recognize that devices of a less general purpose nature, such as hardwired devices, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), or the like, may also be used without departing from the scope and spirit of the inventive concepts disclosed herein. The present invention may also be tangibly embodied as a set of computer instructions stored on a computer readable medium, such as a memory device.
Claims (25)
1. A method of transmitting over the Internet a live video stream of ultrasound imaging data, comprising:
monitoring a set of quality of service metrics for a network communication session between a local site having an ultrasound imaging scanner and a remote site;
predicting, based on the set of quality of service metrics, a minimum expected bit rate to transmit a compressed video stream including a live ultrasound video stream;
selecting, in response to the expected bit rate, video compression parameters to compress the video stream including the live ultrasound video stream; and
transmitting the compressed video stream to the remote site.
2. The method of claim 1 , wherein the at least one quality of service metric comprises a bandwidth metric, a packet loss metric, a packet latency, and a packet corruption metric.
3. The method of claim 1 , wherein the predicting comprises a prediction technique selected from the group consisting of a linear predication algorithm and a nonlinear prediction algorithm.
4. The method of claim 1 , wherein the predicting comprises a prediction technique selected from the group consisting of a linear prediction algorithm, Kalman prediction, and hidden Markov model prediction.
5. The method of claim 1 , wherein the live medical image video stream comprises one of an ultrasound video stream, an angiography video stream, and an endoscopy video stream.
6. The method of claim 1 , wherein the selecting comprises selecting from at least two different video compression protocols.
7. The method of claim 6 , wherein the at least two different video compression protocol include a MJPEG2000 compression protocol and at least one of MPEG-4, H.264, H.265, VP8, and VP9.
8. The method of claim 1 , wherein the selecting comprises selecting a subset of features of a particular video compression protocol.
9. The method of claim 8 , wherein the selecting a subset of features includes selecting at least one of:
turning on or off the MVC encoding;
varying the block sizes of frames;
varying the quantization tables for intra-frame discrete cosine transform (DCT) compression;
varying motion vector compensation (MVC) for inter-frame compression, and reducing the stream frame rate by dropping frames ahead of the compression engine.
10. The method of claim 1 , further comprising selecting a transmission protocol based on the expected bit rate.
11. The method of claim 1 , further comprising analyzing quality of service metrics for a plurality of sessions and providing a network service recommendation.
12. A method of tuning video compression parameters for a live video stream of medical images in a networked telemedicine environment having variable network quality, comprising:
monitoring at least one quality of service metric for a network session between a local site having a medical imaging scanner and a remote site;
predicting, based on the at least one quality of service metric, a minimum expected bit rate to transmit a compressed live video stream of high resolution medical images from the medical imaging scanner;
selecting, in response to the expected bit rate, video compression parameters for the live video stream of medical images;
compressing the live video stream of high resolution medical image, using the selected video compression parameters; and
transmitting the compressed live video stream to the remote site.
13. The method of claim 12 , wherein the at least one quality of service metric is monitored in at least a local site and remote site.
14. The method of claim 12 , wherein the at least one quality of service metric comprises a bandwidth metric, a packet loss metric, a packet latency, and a packet corruption metric.
15. The method of claim 12 , wherein the predicting comprises a prediction technique selected from the group consisting of a linear predication algorithm and a nonlinear prediction algorithm.
16. The method of claim 12 , wherein the predicting comprises a prediction technique selected from the group consisting of a set of linear prediction algorithms, Kalman prediction, and hidden Markov model prediction.
17. The method of claim 12 , wherein the live medical image video stream comprises one of an ultrasound video stream, an angiography video stream, and an endoscopy video stream.
18. The method of claim 12 , wherein the selecting comprises selecting from at least two different video compression protocols.
19. The method of claim 18 , wherein the at least two different video compression protocol include a MJPEG2000 compression protocol and at least one of MPEG-4, H.264, H.265, VP8, and VP9.
20. The method of claim 12 , wherein the selecting comprises selecting a subset of features of a particular video compression protocol.
21. The method of claim 20 , wherein the selecting a subset of features includes selecting at least one of:
turning on or off the MVC encoding;
varying the block sizes of frames;
varying the quantization tables for intra-frame discrete cosine transform (DCT) compression;
varying motion vector compensation (MVC) for inter-frame compression, and reducing the stream frame rate by dropping frames ahead of the compression engine.
22. The method of claim 21 , further comprising selecting a transmission protocol based on the expected bit rate.
23. The method of claim 12 , further comprising analyzing quality of service metrics for a plurality of sessions and providing a network service recommendation.
24. A non-transitory computer readable medium including instructions which when executed on a processor implement any one of the methods of claim 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , or 23.
25. A system, comprising:
an ultrasound image scanner to generate a live video stream of ultrasonic medical images; and
a computer system to monitor network conditions in a network session to a remote site, predict a minimum bit rate, and select compression parameters to compress the live video stream prior to transmission to the remote site.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/291,567 US20140357993A1 (en) | 2013-05-31 | 2014-05-30 | Dynamic adjustment of image compression for high resolution live medical image sharing |
US14/563,192 US9197899B2 (en) | 2013-05-31 | 2014-12-08 | Dynamic adjustment of image compression for high resolution live medical image sharing |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361829887P | 2013-05-31 | 2013-05-31 | |
US14/291,567 US20140357993A1 (en) | 2013-05-31 | 2014-05-30 | Dynamic adjustment of image compression for high resolution live medical image sharing |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/563,192 Continuation US9197899B2 (en) | 2013-05-31 | 2014-12-08 | Dynamic adjustment of image compression for high resolution live medical image sharing |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140357993A1 true US20140357993A1 (en) | 2014-12-04 |
Family
ID=51985889
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/291,567 Abandoned US20140357993A1 (en) | 2013-05-31 | 2014-05-30 | Dynamic adjustment of image compression for high resolution live medical image sharing |
US14/563,192 Expired - Fee Related US9197899B2 (en) | 2013-05-31 | 2014-12-08 | Dynamic adjustment of image compression for high resolution live medical image sharing |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/563,192 Expired - Fee Related US9197899B2 (en) | 2013-05-31 | 2014-12-08 | Dynamic adjustment of image compression for high resolution live medical image sharing |
Country Status (2)
Country | Link |
---|---|
US (2) | US20140357993A1 (en) |
WO (1) | WO2014194288A1 (en) |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150313578A1 (en) * | 2014-05-05 | 2015-11-05 | Siemens Medical Solutions Usa, Inc. | Multi-user wireless ulttrasound server |
US9197899B2 (en) | 2013-05-31 | 2015-11-24 | Eagleyemed Inc. | Dynamic adjustment of image compression for high resolution live medical image sharing |
WO2016116936A1 (en) * | 2015-01-24 | 2016-07-28 | Valens Semiconductor Ltd. | Dynamic real-time compression |
US20170143313A1 (en) * | 2015-11-23 | 2017-05-25 | Clarius Mobile Health Corp. | Speckle reduction and compression improvement of ultrasound images |
US20170180736A1 (en) * | 2015-12-16 | 2017-06-22 | Dialogic Corporation | Estimation of video quality of experience on media services |
US9729938B2 (en) | 2015-01-24 | 2017-08-08 | Valens Semiconductor Ltd. | Low latency visually lossless switching between different compression ratios |
CN107124596A (en) * | 2017-06-08 | 2017-09-01 | 哈尔滨理工大学 | A kind of B ultrasound video acquisition and mobile terminal shared system and method |
GB2560167A (en) * | 2017-02-28 | 2018-09-05 | Bcf Tech Limited | Ultrasound Imaging apparatus and methods |
US20190268622A1 (en) * | 2015-12-28 | 2019-08-29 | Ati Technologies Ulc | Method and apparatus for determining the severity of corruption in a picture |
US10469846B2 (en) | 2017-03-27 | 2019-11-05 | Vave Health, Inc. | Dynamic range compression of ultrasound images |
US20200153926A1 (en) * | 2018-11-09 | 2020-05-14 | Toyota Motor North America, Inc. | Scalable vehicle data compression systems and methods |
EP3262392B1 (en) | 2015-02-23 | 2020-10-14 | Safran Aircraft Engines | Method and device for remotely inspecting the state of an aircraft engine |
US10856843B2 (en) | 2017-03-23 | 2020-12-08 | Vave Health, Inc. | Flag table based beamforming in a handheld ultrasound device |
WO2021026509A1 (en) * | 2019-08-08 | 2021-02-11 | Intel Corporation | Link performance prediction and media streaming technologies |
WO2021072498A1 (en) * | 2019-10-18 | 2021-04-22 | Immersive Robotics Pty Ltd | Content compression for network transmission |
US11153604B2 (en) | 2017-11-21 | 2021-10-19 | Immersive Robotics Pty Ltd | Image compression for digital reality |
US11151749B2 (en) | 2016-06-17 | 2021-10-19 | Immersive Robotics Pty Ltd. | Image compression method and apparatus |
US11150857B2 (en) | 2017-02-08 | 2021-10-19 | Immersive Robotics Pty Ltd | Antenna control for mobile device communication |
US11159804B1 (en) * | 2012-09-13 | 2021-10-26 | Arris Enterprises Llc | QoE feedback based intelligent video transport stream tuning |
US11438264B2 (en) * | 2020-03-04 | 2022-09-06 | Ottopia Technologies Ltd. | Techniques for improving data transmission in teleoperation systems via dynamic packet routing |
US11446003B2 (en) | 2017-03-27 | 2022-09-20 | Vave Health, Inc. | High performance handheld ultrasound |
US11531096B2 (en) | 2017-03-23 | 2022-12-20 | Vave Health, Inc. | High performance handheld ultrasound |
US11553187B2 (en) | 2017-11-21 | 2023-01-10 | Immersive Robotics Pty Ltd | Frequency component selection for image compression |
EP4365907A1 (en) * | 2022-11-03 | 2024-05-08 | Koninklijke Philips N.V. | Maintaining a teleconferencing connection with a minimum resolution and/or framerate |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2961970A1 (en) * | 2014-09-23 | 2016-03-31 | Surgical Safety Technologies Inc. | Operating room black-box device, system, method and computer readable medium |
CN107615395B (en) * | 2015-03-26 | 2021-02-05 | 外科安全技术公司 | Operating room black box apparatus, system, method and computer readable medium for event and error prediction |
CN104809590B (en) * | 2015-05-05 | 2016-10-12 | 赣州市明豪信息技术有限公司 | A kind of intelligent cloud synchronizes medical information sharing system |
KR102162350B1 (en) * | 2019-02-14 | 2020-10-06 | 국방과학연구소 | Apparatus and method for controlling multi communication |
US11364008B2 (en) * | 2019-09-30 | 2022-06-21 | Turner Imaging Systems, Inc. | Image compression for x-ray imaging devices |
US20220414935A1 (en) * | 2021-06-03 | 2022-12-29 | Nec Laboratories America, Inc. | Reinforcement-learning based system for camera parameter tuning to improve analytics |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080037880A1 (en) * | 2006-08-11 | 2008-02-14 | Lcj Enterprises Llc | Scalable, progressive image compression and archiving system over a low bit rate internet protocol network |
US20140095561A1 (en) * | 2009-09-30 | 2014-04-03 | Samplify Systems, Inc. | Enhanced multi-processor waveform data exchange using compression and decompression |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040015079A1 (en) * | 1999-06-22 | 2004-01-22 | Teratech Corporation | Ultrasound probe with integrated electronics |
WO2003021970A1 (en) * | 2001-09-04 | 2003-03-13 | Faroudja Cognition Systems, Inc. | Low bandwidth video compression |
WO2003052981A1 (en) * | 2001-12-14 | 2003-06-26 | The Texas A & M University System | System for actively controlling distributed applications |
US20140357993A1 (en) | 2013-05-31 | 2014-12-04 | eagleyemed, Inc. | Dynamic adjustment of image compression for high resolution live medical image sharing |
-
2014
- 2014-05-30 US US14/291,567 patent/US20140357993A1/en not_active Abandoned
- 2014-05-30 WO PCT/US2014/040381 patent/WO2014194288A1/en active Application Filing
- 2014-12-08 US US14/563,192 patent/US9197899B2/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080037880A1 (en) * | 2006-08-11 | 2008-02-14 | Lcj Enterprises Llc | Scalable, progressive image compression and archiving system over a low bit rate internet protocol network |
US20140095561A1 (en) * | 2009-09-30 | 2014-04-03 | Samplify Systems, Inc. | Enhanced multi-processor waveform data exchange using compression and decompression |
Cited By (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11159804B1 (en) * | 2012-09-13 | 2021-10-26 | Arris Enterprises Llc | QoE feedback based intelligent video transport stream tuning |
US9197899B2 (en) | 2013-05-31 | 2015-11-24 | Eagleyemed Inc. | Dynamic adjustment of image compression for high resolution live medical image sharing |
US20150313578A1 (en) * | 2014-05-05 | 2015-11-05 | Siemens Medical Solutions Usa, Inc. | Multi-user wireless ulttrasound server |
WO2016116936A1 (en) * | 2015-01-24 | 2016-07-28 | Valens Semiconductor Ltd. | Dynamic real-time compression |
US10887662B2 (en) | 2015-01-24 | 2021-01-05 | Valens Semiconductor Ltd. | Changing visually lossless compression ratio while maintaining parameters related to uncompressed video |
US9729938B2 (en) | 2015-01-24 | 2017-08-08 | Valens Semiconductor Ltd. | Low latency visually lossless switching between different compression ratios |
US10887663B2 (en) | 2015-01-24 | 2021-01-05 | Valens Semiconductor Ltd. | Smooth switching of video sources sharing a common link |
US9860606B2 (en) | 2015-01-24 | 2018-01-02 | Valens Semiconductor Ltd. | Maintaining a fixed delay while switching between light video compression ratios |
US10110967B2 (en) | 2015-01-24 | 2018-10-23 | Valens Semiconductor Ltd. | Increasing visually lossless compression ratio to provide bandwidth for an additional stream |
EP3262392B1 (en) | 2015-02-23 | 2020-10-14 | Safran Aircraft Engines | Method and device for remotely inspecting the state of an aircraft engine |
US10405836B2 (en) * | 2015-11-23 | 2019-09-10 | Clarius Mobile Health Corp. | Speckle reduction and compression improvement of ultrasound images |
US20170143313A1 (en) * | 2015-11-23 | 2017-05-25 | Clarius Mobile Health Corp. | Speckle reduction and compression improvement of ultrasound images |
US20170180736A1 (en) * | 2015-12-16 | 2017-06-22 | Dialogic Corporation | Estimation of video quality of experience on media services |
US10021402B2 (en) * | 2015-12-16 | 2018-07-10 | Dialogic Corporation | Estimation of video quality of experience on media servers |
US20190268622A1 (en) * | 2015-12-28 | 2019-08-29 | Ati Technologies Ulc | Method and apparatus for determining the severity of corruption in a picture |
US10771818B2 (en) * | 2015-12-28 | 2020-09-08 | Ati Technologies, Ulc | Method and apparatus for determining the severity of corruption in a picture |
US11151749B2 (en) | 2016-06-17 | 2021-10-19 | Immersive Robotics Pty Ltd. | Image compression method and apparatus |
US11150857B2 (en) | 2017-02-08 | 2021-10-19 | Immersive Robotics Pty Ltd | Antenna control for mobile device communication |
US11429337B2 (en) | 2017-02-08 | 2022-08-30 | Immersive Robotics Pty Ltd | Displaying content to users in a multiplayer venue |
GB2560167A (en) * | 2017-02-28 | 2018-09-05 | Bcf Tech Limited | Ultrasound Imaging apparatus and methods |
US11026663B2 (en) | 2017-02-28 | 2021-06-08 | Imv Imaging (Uk) Ltd | Ultrasound imaging apparatus and methods |
GB2560167B (en) * | 2017-02-28 | 2021-12-22 | Imv Imaging Uk Ltd | Ultrasound Imaging apparatus and methods |
US11531096B2 (en) | 2017-03-23 | 2022-12-20 | Vave Health, Inc. | High performance handheld ultrasound |
US11553896B2 (en) | 2017-03-23 | 2023-01-17 | Vave Health, Inc. | Flag table based beamforming in a handheld ultrasound device |
US10856843B2 (en) | 2017-03-23 | 2020-12-08 | Vave Health, Inc. | Flag table based beamforming in a handheld ultrasound device |
US11446003B2 (en) | 2017-03-27 | 2022-09-20 | Vave Health, Inc. | High performance handheld ultrasound |
US10681357B2 (en) | 2017-03-27 | 2020-06-09 | Vave Health, Inc. | Dynamic range compression of ultrasound images |
US10469846B2 (en) | 2017-03-27 | 2019-11-05 | Vave Health, Inc. | Dynamic range compression of ultrasound images |
CN107124596A (en) * | 2017-06-08 | 2017-09-01 | 哈尔滨理工大学 | A kind of B ultrasound video acquisition and mobile terminal shared system and method |
US11553187B2 (en) | 2017-11-21 | 2023-01-10 | Immersive Robotics Pty Ltd | Frequency component selection for image compression |
US11153604B2 (en) | 2017-11-21 | 2021-10-19 | Immersive Robotics Pty Ltd | Image compression for digital reality |
US11973979B2 (en) | 2017-11-21 | 2024-04-30 | Immersive Robotics Pty Ltd | Image compression for digital reality |
US20200153926A1 (en) * | 2018-11-09 | 2020-05-14 | Toyota Motor North America, Inc. | Scalable vehicle data compression systems and methods |
WO2021026509A1 (en) * | 2019-08-08 | 2021-02-11 | Intel Corporation | Link performance prediction and media streaming technologies |
WO2021072498A1 (en) * | 2019-10-18 | 2021-04-22 | Immersive Robotics Pty Ltd | Content compression for network transmission |
US11438264B2 (en) * | 2020-03-04 | 2022-09-06 | Ottopia Technologies Ltd. | Techniques for improving data transmission in teleoperation systems via dynamic packet routing |
US11646965B2 (en) | 2020-03-04 | 2023-05-09 | Ottopia Technologies Ltd. | Techniques for improving data transmission in teleoperation systems |
EP4365907A1 (en) * | 2022-11-03 | 2024-05-08 | Koninklijke Philips N.V. | Maintaining a teleconferencing connection with a minimum resolution and/or framerate |
Also Published As
Publication number | Publication date |
---|---|
US9197899B2 (en) | 2015-11-24 |
WO2014194288A1 (en) | 2014-12-04 |
US20150092838A1 (en) | 2015-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9197899B2 (en) | Dynamic adjustment of image compression for high resolution live medical image sharing | |
US11503307B2 (en) | System and method for automatic encoder adjustment based on transport data | |
US20160055305A1 (en) | Video enhancements for live sharing of medical images | |
Panayides et al. | A tutorial for emerging wireless medical video transmission systems [Wireless Corner] | |
AU2021200428C1 (en) | System and method for automatic encoder adjustment based on transport data | |
Adeyemi-Ejeye et al. | Packet loss visibility across SD, HD, 3D, and UHD video streams | |
JP4539018B2 (en) | Transmission control apparatus and method, recording medium, and program | |
Arun Raj et al. | Adaptive video streaming over HTTP through 4G wireless networks based on buffer analysis | |
Liu et al. | Real-time video quality monitoring | |
US9363574B1 (en) | Video throttling based on individual client delay | |
Moretti et al. | Content/context-aware multiple camera selection and video adaptation for the support of m-health services | |
Cycon et al. | A temporally scalable video codec and its applications to a video conferencing system with dynamic network adaption for mobiles | |
Kumar et al. | Double sarsa based machine learning to improve quality of video streaming over HTTP through wireless networks | |
KR101795958B1 (en) | Adaptive control method, apparatus and user device for providing video in real time network cameras | |
KR20140072668A (en) | Network camera server and method for processing video stream thereof | |
Chaabouni et al. | Quality assessment of MPEG-4 AVC/H. 264 and HEVC compressed video in a telemedicine context | |
Istepanian et al. | Provisioning of medical quality of services for HSDPA and mobile WiMAX in healthcare applications | |
Peroni et al. | An End-to-End Pipeline Perspective on Video Streaming in Best-Effort Networks: A Survey and Tutorial | |
Cycon et al. | Adaptive temporal scalability of H. 264-compliant video conferencing in heterogeneous mobile environments | |
Vohra | Streaming low-bandwidth real-time video using video super-resolution | |
KR100808982B1 (en) | Classified media quality of experience | |
Raj et al. | A Survey on Telemedicine Approach Using Cross Layer Design in Video Streaming | |
Philip | Medical quality of service for optimized ultrasound streaming in wireless robotic tele-ultrasonography system | |
Tappayuthpijarn | Adaptive Streaming of Scalable Video in Mobile Networks | |
Sánchez-Hernández et al. | Improved JPIP-compatible architecture for video streaming of JPEG 2000 image sequences |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: EAGLEYEMED, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HIRIYANNAIAH, HARISH P.;SHAHID, MUHAMMAD ZAFAR JAVED;REEL/FRAME:033092/0301 Effective date: 20140606 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |