CN106060080B - A kind of medical video signal acquisition trans-coding system - Google Patents
A kind of medical video signal acquisition trans-coding system Download PDFInfo
- Publication number
- CN106060080B CN106060080B CN201610544843.7A CN201610544843A CN106060080B CN 106060080 B CN106060080 B CN 106060080B CN 201610544843 A CN201610544843 A CN 201610544843A CN 106060080 B CN106060080 B CN 106060080B
- Authority
- CN
- China
- Prior art keywords
- module
- agglomerate
- deformation
- video
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000033001 locomotion Effects 0.000 claims abstract description 93
- 230000006835 compression Effects 0.000 claims abstract description 15
- 238000007906 compression Methods 0.000 claims abstract description 15
- 239000013598 vector Substances 0.000 claims description 24
- 238000007689 inspection Methods 0.000 claims description 4
- 230000000717 retained effect Effects 0.000 claims description 4
- 241000208340 Araliaceae Species 0.000 claims 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 1
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 1
- 238000004873 anchoring Methods 0.000 claims 1
- 230000003139 buffering effect Effects 0.000 claims 1
- 235000008434 ginseng Nutrition 0.000 claims 1
- 230000005540 biological transmission Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 7
- 239000003814 drug Substances 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000000034 method Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 239000013307 optical fiber Substances 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
It successively include video acquisition unit, video processing unit, video compression coding unit and the streaming media service unit being connected by I/O bus the present invention relates to a kind of medical video signal acquisition trans-coding system；Medical video signal acquisition trans-coding system in the present invention is used for the technical issues of being broadcast live after solving how the various standards of Medical Devices various in hospital output or non-standard video are acquired and be handled, so that user can watch that multichannel has the video pictures of different content in a terminal.User can carry out momentarily " movement " in mobile phone terminal by 4G network and watch, and improve user experience.
Description
Technical field
The present invention relates to the transmission of video images technical fields for tele-medicine, and in particular to a kind of medical video signal
Acquire trans-coding system.
Background technique
In China, the application of the video capture devices such as all kinds of video frequency collection cards, hard disk video recorder is so that tele-medicine efficiency
It greatly improves.What many medical treatment R&D teams let slip no opportunity seeks various technological means.To realize that medical imaging, video etc. are various
Medical signal high-efficiency transfer, the compatibility of all kinds of video capture devices, efficiently also therefore, it has become focus of attention.
In practical application, we are, it can be seen that the video output formats of all kinds of Medical Devices are multifarious, convention video
Acquisition equipment more tends to nonstandard format.When all kinds of various in face of hospital, when the different Medical Devices of brand, previous way is
The engineer for inquiring the producer understands video output interface and signal format, parameter of the equipment etc..It is needed for the equipment
It is equipped with special acquisition equipment.And when hospital needs to receive the signal of other equipment, equipment before this is likely to not match.
Work before thus needing to repeat again, buys new equipment again.Such result first is that fund waste, second is that by
In these equipment due to not customizing production, can only be scattered be placed in by the service of connection devices can not be fixedly mounted, not only take up
Space, and a possibility that damaging, also greatly improves.
In addition, in practical application, it has been found that the video image used in tele-medicine there is field (back) scape to fix,
The small feature of picture dynamic, also high, the high and low delay of stability the requirement with clarity.At present towards the straight of consumer level market
The characteristics of demand of tele-medicine cannot be well adapted for by broadcasting system and its coding, coding/decoding method.In transmission and format transformation
There is the factors such as poor definition, incompatible, easy decaying, so that in signal in the image after transmitting at a distance, view
Frequency quality becomes blurred, shakes, and strong influence uses.Especially transmitted under the more severe communication environment such as wireless network
When, often because the reasons such as packet loss cause picture stuck or fuzzy, level required for tele-medicine cannot be reached.
Summary of the invention
The technical problem to be solved in the present invention (one) is: proposing a kind of all kinds of views of solution based on high-definition video signal processing
Frequency acquires the medical video signal acquisition trans-coding system of hardware compatibility problem.
The technical problem to be solved in the present invention (two) is: how to provide under severe communication environment more stable and compared with high-resolution
Spend video-transmission problems.
The present invention technical solution that (one) proposes to solve above-mentioned technical problem is: a kind of medical video signal acquisition transcoding
System successively includes video acquisition unit, video processing unit, video compression coding unit and the stream being connected by I/O bus
Media services unit；
The video acquisition unit includes acquisition module and output module, and the acquisition module is existing various for being connected to
The video output terminals of Medical Devices simultaneously carry out multichannel video-on-demand signal acquisition, and the output module is used for will be by the acquisition mould
Block instantaneous acquiring to every road raw video signal video processing is transferred in a manner of real-time streaming after timing arranges
Unit；
The video processing unit is used to be changed into HD-SDI after carrying out parameter processing to the raw video signal
Format, including and sequentially form signal connection video resolution adjustment module, video frame rate adjustment module, code rate adjustment module
With HD-SDI transcoding module；
The video compression coding unit is used to carry out compressed encoding to aforementioned HD-SDI format video signal to form video
Streaming video；
The streaming media service unit is used to pass through cable network or wireless network connection to live streaming decoding terminal.
Further, the coding standard of the streaming video is H.265 standard.
Further, the output video resolution of the video resolution adjustment module is that 1280 pixels multiply 720 pixels, institute
The adjustment frame per second for stating video frame rate adjustment module is 50 Hz -60Hz, and the adjustment bit rate output of the code rate adjustment module is 1
Mbps -2Mbps。
The present invention technical solution that (two) propose to solve above-mentioned technical problem is: further, the video compress is compiled
Code unit includes primitive frame memory module, reference frame handling module, takes off module, agglomerate caching with reference to frame buffer module, agglomerate
Module, agglomerate interframe movement trend cache module, present frame reconstructed module, the second present frame reconstructed module, agglomerate motion compensation
Computing module, agglomerate interframe deformation prediction module, agglomerate deformation compensation calculation module, coding module and buffer zone module.
Further, the primitive frame image being pre-stored in the primitive frame memory module under pure background scene；
Reference frame handling module grabs a frame image as reference frame after being used for each interval N frame, and the value range of N is 0-
60；
Agglomerate takes off module for taking off the agglomerate image for providing actual content in reference frame image and by the agglomerate
The information input of pattern is kept in into agglomerate cache module；
Agglomerate interframe movement prediction module, which is used to acquire the image after being located at reference frame and finds wherein, meets reference
The lumpy pattern of lumpy pattern feature in frame, and then motion vector of the lumpy pattern with respect in reference frame when is calculated, and
It sends the motion vector in present frame reconstructed module as agglomerate motion prediction vectors；
Present frame reconstructed module contains virtual agglomerate figure in virtual current frame image for constructing virtual current frame image
Case；
Agglomerate motion compensation calculations module for acquiring practical current frame image, and by practical current frame image with virtually work as
Inspection is compared in previous frame, calculates alternate position spike and knot in virtual lumpy pattern and practical current frame image between lumpy pattern
It closes agglomerate motion prediction vectors and calculates agglomerate motion compensation difference；
Agglomerate interframe deformation prediction module, which is used to acquire the image after being located at reference frame and finds wherein, meets reference
The lumpy pattern of lumpy pattern feature in frame, and then calculate agglomerate deformation tendency of the lumpy pattern with respect in reference frame when
Parameter, and the agglomerate deformation tendency parameter is output to the second present frame reconstructed module, second reconstructed module is used for structure
Virtual current frame image is built out, virtual lumpy pattern, the acquisition of agglomerate deformation compensation calculation module are contained in virtual current frame image
Practical current frame image is simultaneously compared with lumpy pattern in aforementioned virtual current frame image, calculates the group about lumpy pattern
Block deformation compensates residual value；
Buffer zone module is used to store the lumpy pattern information of primitive frame image and encoded module coding, agglomerate fortune
Dynamic compensation difference and agglomerate deformation compensate residual value.
Further, live streaming decoding terminal has buffer location and decoding unit, and decoding unit includes decoder module, the
Two primitive frame memory modules, the second agglomerate cache module, agglomerate motion compensation feedback module, agglomerate deformation Compensation Feedback module,
Second agglomerate interframe movement prediction module, agglomerate interframe movement trend cache module, the second agglomerate interframe deformation prediction module, group
Block interframe deformation tendency cache module and third present frame reconstructed module.
Further, the second primitive frame memory module reads primitive frame image from buffer location, and in this, as
First frame image when video playing；
Decoder module is used to read lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation from buffer location
Compensation residual value is simultaneously separately sent to the second agglomerate cache module, agglomerate motion compensation feedback module and agglomerate deformation benefit after the decoding
Repay feedback module；
Second agglomerate cache module, agglomerate motion compensation feedback module and agglomerate deformation Compensation Feedback module will receive respectively
To lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation compensation residual value be loaded into third present frame reconstructed module；
The agglomerate motion prediction vectors of second agglomerate interframe movement prediction module and the second agglomerate interframe deformation prediction module
It is also loaded respectively with agglomerate deformation tendency parameter calculated result and gives third present frame reconstructed module, the prediction of the second agglomerate interframe movement
Module and the second agglomerate interframe deformation prediction module also input agglomerate motion prediction vectors and agglomerate deformation tendency parameter respectively
To agglomerate interframe movement trend cache module and agglomerate interframe deformation tendency cache module；
Third present frame reconstructed module is suitable for reconstructing when the current frame, first reads original in the second primitive frame memory module
Frame image, then the lumpy pattern information in the second agglomerate cache module is read, by combining agglomerate motion prediction vectors and agglomerate
The picture that deformation tendency and agglomerate motion compensation difference and agglomerate deformation compensation residual value carry out present frame is reconstructed and is exported.
Further, when the agglomerate takes off module and takes off agglomerate in reference frame image, first by reference frame image and
Primitive frame image resolves into several macro blocks and several microliths of different levels all in accordance with the coloration of image and brightness, then will refer to
Frame image and primitive frame image overlapping contrast remove repeatable block, retain difference block, and the set of the difference block retained is defined as rolling into a ball
Block includes coordinate, coloration, luminance parameter of the aforementioned differences block in reference frame in lumpy pattern information.
Further, the agglomerate interframe deformation prediction module and the second agglomerate interframe deformation prediction module are calculating agglomerate
The chroma luminance parameter of each microlith in the deformation parameter and lumpy pattern of agglomerate pattern edge profile is investigated when deformation tendency parameter.
The beneficial effects of the present invention are:
Medical video signal acquisition trans-coding system in the present invention is solved first how by Medical Devices various in hospital
The various standards or non-standard video of output are used for the technical issues of being broadcast live after being acquired and being handled, so that user is one
A terminal can watch that multichannel has the video pictures of different content.User can be carried out at any time by 4G network in mobile phone terminal
Ground " movement " viewing, improves user experience.
Next also solves how to meet the requirement of medical video transmission stability and in more severe network communications environment
Under the conditions of the technical issues of can still provide for the transmission of high-quality video, the medical video signal acquisition trans-coding system in the present invention is only
Wound develops a kind of compressed encoding unit, which has scene fixed and the lesser spy of dynamic using medical video
Point is then superimposed with the means of lumpy pattern on clean background frames, has reached reduction by first intercepting " agglomerate " of movement
Transmission of video data volume.
It is another it is worth mentioning that: identical motion prediction and deformation prediction module are used in local side and decoding end, at this
Ground terminal, which carries out prediction result meeting, is transferred to decoding end for adjusting parameter after the adjustment of real image.Decoding end passes through the adjustment
Parameter is adjusted its prediction result, and the image for showing that it finally is identical as the acquired image of local side.Guaranteeing
Transmission of video data volume (only needing transmission adjusting parameter) is further reduced under the premise of video quality.
Detailed description of the invention
Medical video signal acquisition trans-coding system of the invention is described further with reference to the accompanying drawing.
Fig. 1 is the overall structure diagram of medical video signal collection trans-coding system in the present invention；
Fig. 2 is the structure and working principle schematic diagram of video compression coding unit in the present invention；
Fig. 3 is the decomposition diagram that agglomerate takes off module to reference frame image；
Fig. 4 is the structure and working principle schematic diagram that decoding terminal is broadcast live.
Specific embodiment
Embodiment one
According to Fig. 1, Fig. 2, the present invention in medical video signal acquisition trans-coding system, successively include by I/O it is total
Line connected video acquisition unit, video processing unit, video compression coding unit and streaming media service unit.
Video acquisition unit includes acquisition module and output module.Acquisition module is that the hardware of buying is adopted in the present embodiment
Truck, multichannel input interface is provided on hardware capture card, and hardware capture card passes through coaxial cable, optical fiber cable or other wired lines
Cable is connected on the video output terminals of various Medical Devices, and the video-on-demand signal for carrying out multichannel acquires.Output module is
The output port for adding the processing chip on hardware capture card and being connected with the processing chip, being used for will be instant by acquisition module
Collected every road raw video signal is transferred to video processing unit after timing arranges, and transmits the road Shi Mei raw video signal
For continuous frame.
Video processing unit is used to be changed into HD-SDI format after carrying out parameter processing to raw video signal.Wherein
Video resolution adjustment module, video frame rate adjustment module, code rate adjustment module and HD- including sequentially forming signal connection
SDI transcoding module.
Video resolution adjusts module and the resolution ratio of every frame image of every road raw video signal is adjusted to 1280 pictures
Element multiplies 720 pixels.When the resolution ratio of the frame image of original signal is less than the resolution ratio, interpolation calculation is carried out, it is expanded to
1280 pixels multiply 720 pixels, when the resolution ratio of the frame image of original signal is greater than the resolution ratio, carries out resolution compression, make
It is reduced to 1280 pixels and multiplies 720 pixels.Video frame rate adjusts module and is used to believe the original video after resolution adjustment
Number frame per second be adjusted, make it have the frame per second of 50HZ-60HZ, code rate adjusts module to the code rate of entire raw video signal
Parameter is adjusted the preset value of 1Mps-2Mps.
HD-SDI transcoding module is used to carry out transcoding to whole raw video signals, becomes the view of HD-SDI format
Frequency evidence.
Video compression coding unit is used to carry out compressed encoding to aforementioned HD-SDI format video signal to form video streaming
Media.
Since video sequence spatially has certain redundancy, between the adjacent pixel of the especially same the video object
Correlation is extremely strong.Secondly, unless occurrence scene switches, otherwise time upper subsequent frame usually contains for video sequence
With front close to the identical background of frame and object, here it is the time redundancies of video sequence.Before keeping certain video quality
It puts, the original video that original data amount can be made huge is reduced as far as possible after compressed encoding, so that it is more suitable for network limited
The transmission of bandwidth is more favorable to quick repeats when packet loss occurs.
Since the acquisition video that medical video has the characteristics of scene hardly happens variation, especially Medical Instruments is even more such as
This, therefore can use the feature and carry out video compress to the maximum extent.In the present embodiment about video compression coding unit
A kind of preferred scheme is provided, in the present embodiment: video compression coding unit includes primitive frame memory module, reference frame crawl
Module takes off module, agglomerate cache module, agglomerate interframe movement trend cache module, present frame with reference to frame buffer module, agglomerate
Reconstructed module, agglomerate motion compensation calculations module, agglomerate interframe deformation prediction module, agglomerate deformation compensation calculation module, coding
Module and buffer zone module.
Wherein, the primitive frame image being pre-stored in primitive frame memory module under pure background scene.
Reference frame handling module for grab the second frame image (" the second frame " is only described with reference to the drawings for convenience,
In concrete application, " the second frame " is actually X+1 frame, similarly hereinafter) as reference frame, it is preset in grabbed reference frame in the present embodiment
Containing the substantial image (parameter curve or the indoor actual scene of operation in such as electrocardiogram indicator) other than having powerful connections, reference frame
Handling module grabs after being preset to interval N frame, can also be preset to continuously grab, view network transmission environment and to view
Depending on the demand of frequency quality, when network environment preferably or to video quality requirement it is higher when can be set into edge crawl or N value
Become small, the value range of N is 0-60.Reference frame after crawl is deposited in reference to spare in frame buffer module.
Agglomerate takes off module by that will refer to the reference frame image in frame buffer module and the original in primitive frame memory module
Beginning frame image carries out overlapping contrast, and then takes off the agglomerate image for providing actual content.
When taking off as shown in figure 3, first by reference frame image and primitive frame image according to the coloration of image and brightness point
Solution is at several macro blocks and several microliths of different levels, and then overlapping contrast removes repeatable block, retains difference block, the difference retained
Different piece of set is defined as agglomerate, includes coordinate, coloration, brightness etc. of the aforementioned differences block in reference frame in lumpy pattern information
Relevant parameter.By lumpy pattern information temporary storage for calling in agglomerate cache module.As shown in Figure 3, it is rolled into a ball in the present embodiment
Block is five-pointed star case.
It is special that agglomerate interframe movement prediction module acquisition third frame image and wherein searching meet aforementioned lumpy pattern information
The lumpy pattern of sign, and then calculate agglomerate in third frame with respect to the motion vector in the second frame, and by the motion vector
It is sent in present frame reconstructed module as agglomerate motion prediction vectors, for constructing virtual current frame image (the 4th frame),
Contain virtual agglomerate in virtual current frame image.
Agglomerate motion compensation calculations module acquires practical current frame image, and by practical current frame image and virtual present frame
Inspection is compared, calculate the alternate position spike in virtual agglomerate and practical current frame image between agglomerate and combines agglomerate movement pre-
Direction finding meter calculates agglomerate motion compensation difference.
It is special that agglomerate interframe deformation prediction module acquisition third frame image and wherein searching meet aforementioned lumpy pattern information
The lumpy pattern of sign calculates in third frame lumpy pattern with respect to the agglomerate deformation of the lumpy pattern information in agglomerate cache module
Trend parameter is investigated each micro- in the deformation parameter and lumpy pattern of agglomerate pattern edge profile when calculating agglomerate deformation tendency parameter
The chroma luminance parameter of block.Agglomerate deformation tendency parameter is output to the second present frame reconstruct mould by agglomerate interframe deformation prediction module
Block, by the second present frame reconstructed module according to deformation tendency parameter prediction reconstruct the shape of lumpy pattern in present frame, coloration and
Brightness.
Agglomerate deformation compensation calculation module acquires practical current frame image and carries out with lumpy pattern in the present frame of prediction
It compares, calculates and compensate residual value about the agglomerate deformation of lumpy pattern.
Original frame image information is sent buffer zone module by primitive frame memory module, and the agglomerate cache module is by agglomerate
Pattern-information is immediately sent to coding module, and agglomerate motion compensation calculations module and agglomerate deformation compensation calculation module respectively will
Agglomerate motion compensation difference and agglomerate deformation compensation residual value are immediately sent to coding module.Coding module believes lumpy pattern
Breath, agglomerate motion compensation difference and agglomerate deformation compensation residual value are output to buffer zone module after being encoded.
Streaming media service unit is used for through cable network or wireless network connection to live streaming decoding terminal, when terminal has directly
When broadcasting demand, streaming media server is by original frame image information and encoded lumpy pattern information, agglomerate motion compensation difference
Live streaming decoding terminal is sent to through network from buffer zone module with agglomerate deformation compensation residual value.
To match with aforementioned video compressed encoding unit, as shown in figure 4, live streaming decoding terminal include buffer location and
Decoding unit, decoding unit include decoder module, the second primitive frame memory module, the second agglomerate cache module, agglomerate movement benefit
Repay feedback module, agglomerate deformation Compensation Feedback module, the second agglomerate interframe movement prediction module, agglomerate interframe movement trend caching
Module, the second agglomerate interframe deformation prediction module, agglomerate interframe deformation tendency cache module and third present frame reconstructed module.
Second primitive frame memory module reads primitive frame image from buffer location, and when in this, as video playing
First frame image, decoder module reads lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation from buffer location
Compensation residual value is simultaneously separately sent to agglomerate cache module, agglomerate motion compensation feedback module and agglomerate deformation compensation instead after the decoding
Present module.
Second agglomerate cache module, agglomerate motion compensation feedback module and agglomerate deformation Compensation Feedback module will receive respectively
To lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation compensation residual value be loaded into present frame reconstructed module for weight
Structure current frame image.
The agglomerate motion prediction vectors of second agglomerate interframe movement prediction module and the second agglomerate interframe deformation prediction module
It also loads respectively to third present frame reconstructed module with agglomerate deformation tendency parameter calculated result for reconstructing current frame image.The
Two agglomerate interframe movement prediction modules and the second agglomerate interframe deformation prediction module are also by agglomerate motion prediction vectors and agglomerate shape
Change trend parameter is separately input to agglomerate interframe movement trend cache module and agglomerate interframe deformation tendency cache module, in case
Occur packet loss, frame losing when can previous frame trend continue reconstructed image.
Also constantly acquisition reconstructs for second agglomerate interframe movement prediction module and the second agglomerate interframe deformation prediction module
The frame image come, it is defeated when movement or deformation tendency can not be calculated after initial light is with acquisition primitive frame image and the second frame image
It is out sky.
Third present frame reconstructed module in decoding unit first reads the original in the second primitive frame memory module in reconstruct
Beginning frame image, then the lumpy pattern information in the second agglomerate cache module is read, by combining agglomerate motion prediction vectors and group
The picture that block deformation tendency and agglomerate motion compensation difference and agglomerate deformation compensation residual value carry out present frame is reconstructed and is exported.
Embodiment two
The present embodiment proposes a kind of medical video image live broadcasting method carried out on the basis of embodiment one, including following step
It is rapid:
Step 1 acquires the instant raw video signal of multichannel from the video output terminals of various Medical Devices.
It can be used as preferably: being acquired when acquisition by video acquisition unit.Video acquisition unit includes acquisition
Module and output module.Acquisition module is the hardware capture card of buying in the present embodiment, is provided with multichannel on hardware capture card
Input interface, hardware capture card are connected to the video of various Medical Devices by coaxial cable, optical fiber cable or other wireline cables
On output end, the video-on-demand signal for carrying out multichannel is acquired.Output module is the processing core added on hardware capture card
Piece and the output port being connected with the processing chip, for by by acquisition module instantaneous acquiring to every road raw video signal pass through
Timing is transferred to video processing unit after arranging, the transmission road Shi Mei raw video signal is continuous frame.
Step 2, by the instant raw video signal of multichannel after the adjustment of video resolution, video frame rate and video code rate
The transformation of ownership is at HD-SDI format.
It can be used as preferably: being when being adjusted to video resolution, video frame rate and video code rate and the transformation of ownership
It is carried out by video processing unit.Video processing unit include sequentially form signal connection video resolution adjustment module,
Video frame rate adjusts module, code rate adjustment module and HD-SDI transcoding module.
It can be used as it is further preferred that video resolution adjusts module for every frame image of every road raw video signal
Resolution ratio is adjusted to 1280 pixels and multiplies 720 pixels.When the resolution ratio of the frame image of original signal is less than the resolution ratio, carry out
Interpolation calculation makes it expand to 1280 pixels and multiplies 720 pixels, when the resolution ratio of the frame image of original signal is greater than the resolution ratio
When, resolution compression is carried out, so that it is reduced to 1280 pixels and multiplies 720 pixels.Video frame rate adjusts module and is used for by differentiating
The frame per second of rate raw video signal adjusted is adjusted, and makes it have the frame per second of 50HZ-60HZ, and code rate adjusts module to whole
The code rate parameter of a raw video signal is adjusted the preset value of 1Mps-2Mps.
Step 3 carries out compressed encoding to the instant raw video signal of the multichannel of the HD-SDI format, becomes more
Road is suitable for the streaming video of Internet communication.
Can be used as preferably: compressed encoding is carried out by video compression coding unit, video compression coding list
Member include primitive frame memory module, reference frame handling module, take off with reference to frame buffer module, agglomerate module, agglomerate cache module,
Agglomerate interframe movement trend cache module, present frame reconstructed module, agglomerate motion compensation calculations module, agglomerate interframe deformation prediction
Module, agglomerate deformation compensation calculation module, coding module and buffer zone module.
Wherein, the primitive frame image being pre-stored in primitive frame memory module under pure background scene, reference frame handling module
For grabbing the second frame image, (" the second frame " is only described with reference to the drawings for convenience, and in a particular application, " the second frame " is practical
For X+1 frame, similarly hereinafter) as reference frame, preset reference frame includes the substantial image other than having powerful connections (in such as electrocardiogram indicator
Parameter curve or the indoor actual scene of operation), reference frame handling module grabs after being preset to interval N frame, can also be with
Be preset to continuously grab, view network transmission environment and to the demand of video quality depending on, when network environment preferably or to video
Edge crawl can be set into quality requirement when higher or N value becomes small.Reference frame after crawl is deposited in reference to frame buffer module
In it is spare.
Agglomerate takes off module by that will refer to the reference frame image in frame buffer module and the original in primitive frame memory module
Beginning frame image carries out overlapping contrast, and then takes off the agglomerate image for providing actual content.
When taking off as shown in figure 3, first by reference frame image and primitive frame image according to the coloration of image and brightness point
Solution is at several macro blocks and several microliths of different levels, and then overlapping contrast removes repeatable block, retains difference block, the difference retained
Different piece of set is defined as agglomerate, includes coordinate, coloration, brightness etc. of the aforementioned differences block in reference frame in lumpy pattern information
Relevant parameter.By lumpy pattern information temporary storage for calling in agglomerate cache module.
It is special that agglomerate interframe movement prediction module acquisition third frame image and wherein searching meet aforementioned lumpy pattern information
The lumpy pattern of sign, and then calculate agglomerate in third frame with respect to the motion vector in the second frame, and by the motion vector
It is sent in present frame reconstructed module as agglomerate motion prediction vectors, for constructing virtual current frame image (the 4th frame),
Contain virtual agglomerate in virtual current frame image, agglomerate motion compensation calculations module acquires practical current frame image, and will be practical
Inspection is compared with virtual present frame in current frame image, calculates in virtual agglomerate and practical current frame image between agglomerate
Alternate position spike simultaneously calculates agglomerate motion compensation difference in conjunction with agglomerate motion prediction vectors.
It is special that agglomerate interframe deformation prediction module acquisition third frame image and wherein searching meet aforementioned lumpy pattern information
The lumpy pattern of sign calculates in third frame lumpy pattern with respect to the agglomerate deformation of the lumpy pattern information in agglomerate cache module
Trend parameter is investigated each micro- in the deformation parameter and lumpy pattern of agglomerate pattern edge profile when calculating agglomerate deformation tendency parameter
The chroma luminance parameter of block.Agglomerate interframe deformation prediction module by agglomerate deformation tendency parameter be output to present frame reconstructed module by
Present frame reconstructed module reconstructs shape, coloration and the brightness of lumpy pattern in present frame according to deformation tendency parameter prediction.
Agglomerate deformation compensation calculation module acquires practical current frame image and carries out with lumpy pattern in the present frame of prediction
It compares, calculates and compensate residual value about the agglomerate deformation of lumpy pattern.
Original frame image information is sent buffer zone module by primitive frame memory module, and the agglomerate cache module is by agglomerate
Pattern-information is immediately sent to coding module, and agglomerate motion compensation calculations module and agglomerate deformation compensation calculation module respectively will
Agglomerate motion compensation difference and agglomerate deformation compensation residual value are immediately sent to coding module.Coding module believes lumpy pattern
Breath, agglomerate motion compensation difference and agglomerate deformation compensation residual value are output to buffer zone module after being encoded, and are formed to be sent
Streaming media data.
Aforementioned streaming media data is transferred to live streaming decoding eventually by streaming media server and communication network by step 4
End.
Aforementioned communications network can be WIFI or 4G cordless communication network.When terminal has live streaming demand, streaming media server
Original frame image information and encoded lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation compensation residual value are postponed
It rushes area's module and is sent to live streaming decoding terminal through network.
Of the invention is not limited to the above embodiment, and the technical solution of above-mentioned each embodiment of the invention can be handed over each other
Fork combination form new technical solution, in addition it is all using equivalent replacement formed technical solution, all fall within the present invention claims guarantor
It protects in range.
Claims (5)
1. a kind of medical video signal acquisition trans-coding system, it is characterised in that: successively include being adopted by the video that I/O bus is connected
Collect unit, video processing unit, video compression coding unit and streaming media service unit；
The video acquisition unit includes acquisition module and output module, and the acquisition module is for being connected to existing various medical treatment
The video output terminals of equipment simultaneously carry out multichannel video-on-demand signal acquisition, and the output module for that will be by the acquisition module
When collected every road raw video signal the video processing unit is transferred in a manner of real-time streaming after timing arranges；
The video processing unit is used to be changed into HD-SDI format after carrying out parameter processing to the raw video signal,
Including and sequentially form the video resolution adjustment module, video frame rate adjustment module, code rate adjustment module and HD- of signal connection
SDI transcoding module；
The video compression coding unit is used to carry out compressed encoding to aforementioned HD-SDI format video signal to form video streaming
Media；
The streaming media service unit is used to pass through cable network or wireless network connection to live streaming decoding terminal；
The video compression coding unit includes primitive frame memory module, reference frame handling module, with reference to frame buffer module, agglomerate
Take off module, agglomerate cache module, agglomerate interframe movement prediction module, present frame reconstructed module, the second present frame reconstructed module,
Agglomerate motion compensation calculations module, agglomerate interframe deformation prediction module, agglomerate deformation compensation calculation module, coding module and buffering
Area's module；
The primitive frame image being pre-stored in the primitive frame memory module under pure background scene；
Reference frame handling module grabs a frame image as reference frame after being used for each interval N frame, and the value range of N is 0-60；
Agglomerate takes off module for taking off the agglomerate image for providing actual content in reference frame image and by the lumpy pattern
Information input into agglomerate cache module keep in；
Agglomerate interframe movement prediction module is used to acquire the image after being located at reference frame and meets in reference frame wherein finding
The lumpy pattern of lumpy pattern feature, and then motion vector of the lumpy pattern with respect in reference frame when is calculated, and should
Motion vector is sent in present frame reconstructed module as agglomerate motion prediction vectors；
Present frame reconstructed module contains virtual lumpy pattern in virtual current frame image for constructing virtual current frame image；
Agglomerate motion compensation calculations module is for acquiring practical current frame image, and by practical current frame image and virtual present frame
Inspection is compared, calculates alternate position spike and anchoring group in virtual lumpy pattern and practical current frame image between lumpy pattern
Block motion prediction vectors calculate agglomerate motion compensation difference；
Agglomerate interframe deformation prediction module is used to acquire the image after being located at reference frame and meets in reference frame wherein finding
The lumpy pattern of lumpy pattern feature, and then calculate agglomerate deformation tendency ginseng of the lumpy pattern with respect in reference frame when
Number, and the agglomerate deformation tendency parameter is output to the second present frame reconstructed module, the second present frame reconstructed module is used
In constructing virtual current frame image, contain virtual lumpy pattern, agglomerate deformation compensation calculation module in virtual current frame image
It acquires practical current frame image and is compared with lumpy pattern in aforementioned virtual current frame image, calculated about lumpy pattern
Agglomerate deformation compensate residual value；
Coding module is defeated after being used to be encoded lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation compensation residual value
Buffer zone module is arrived out；
Buffer zone module is used to store the lumpy pattern information of primitive frame image and encoded module coding, agglomerate movement is mended
Repay difference and agglomerate deformation compensation residual value.
2. medical video signal acquisition trans-coding system according to claim 1, it is characterised in that: live streaming decoding terminal has slow
Rush area's unit and decoding unit, decoding unit include decoder module, the second primitive frame memory module, the second agglomerate cache module,
Agglomerate motion compensation feedback module, agglomerate deformation Compensation Feedback module, the second agglomerate interframe movement prediction module, agglomerate interframe fortune
Dynamic trend cache module, the second agglomerate interframe deformation prediction module, agglomerate interframe deformation tendency cache module and third present frame
Reconstructed module.
3. medical video signal acquisition trans-coding system according to claim 2, it is characterised in that: the second primitive frame memory module
Primitive frame image is read from buffer location, and first frame image when in this, as video playing；
Decoder module is used to read lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation compensation from buffer location
Residual value is simultaneously separately sent to the second agglomerate cache module, agglomerate motion compensation feedback module and agglomerate deformation compensation instead after the decoding
Present module；
Second agglomerate cache module, agglomerate motion compensation feedback module and agglomerate deformation Compensation Feedback module will receive respectively
Lumpy pattern information, agglomerate motion compensation difference and agglomerate deformation compensation residual value are loaded into third present frame reconstructed module；
The agglomerate motion prediction vectors and group of second agglomerate interframe movement prediction module and the second agglomerate interframe deformation prediction module
Block deformation tendency parameter calculated result also loads respectively gives third present frame reconstructed module, the second agglomerate interframe movement prediction module
Also agglomerate motion prediction vectors and agglomerate deformation tendency parameter are separately input to roll into a ball with the second agglomerate interframe deformation prediction module
Block interframe movement trend cache module and agglomerate interframe deformation tendency cache module；
Third present frame reconstructed module is suitable for reconstructing when the current frame, first reads the primitive frame figure in the second primitive frame memory module
Picture, then the lumpy pattern information in the second agglomerate cache module is read, by combining agglomerate motion prediction vectors and agglomerate deformation
The picture that trend and agglomerate motion compensation difference and agglomerate deformation compensation residual value carry out present frame is reconstructed and is exported.
4. medical video signal acquisition trans-coding system according to claim 3, it is characterised in that: the agglomerate takes off module and exists
When taking off agglomerate in reference frame image, reference frame image and primitive frame image are decomposed all in accordance with the coloration of image and brightness first
At several macro blocks and several microliths of different levels, then reference frame image and primitive frame image overlapping contrast are removed and repeated
Block retains difference block, and it includes that aforementioned differences block is being joined in lumpy pattern information that the set of the difference block retained, which is defined as agglomerate,
Examine coordinate, coloration, the luminance parameter in frame.
5. medical video signal acquisition trans-coding system according to claim 4, it is characterised in that: the agglomerate interframe deformation is pre-
It surveys module and the second agglomerate interframe deformation prediction module investigates agglomerate pattern edge profile when calculating agglomerate deformation tendency parameter
Deformation parameter and lumpy pattern in each microlith chroma luminance parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610544843.7A CN106060080B (en) | 2016-07-12 | 2016-07-12 | A kind of medical video signal acquisition trans-coding system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610544843.7A CN106060080B (en) | 2016-07-12 | 2016-07-12 | A kind of medical video signal acquisition trans-coding system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106060080A CN106060080A (en) | 2016-10-26 |
| CN106060080B true CN106060080B (en) | 2019-07-12 |
Family
ID=57186753
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610544843.7A Active CN106060080B (en) | 2016-07-12 | 2016-07-12 | A kind of medical video signal acquisition trans-coding system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106060080B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110022452B (en) * | 2019-05-16 | 2021-04-30 | 深圳市芯动电子科技有限公司 | Video frame extraction method and system suitable for holographic display device |
| CN110856006A (en) * | 2019-11-12 | 2020-02-28 | 深圳市瑞讯云技术有限公司 | Low-delay live broadcast method and device, storage medium and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1976429A (en) * | 2006-12-15 | 2007-06-06 | 北京华纬讯电信技术有限公司 | Video frequency transmitting system and method based on PC and high-resolution video signal collecting card |
| CN101841704A (en) * | 2009-01-14 | 2010-09-22 | 北京中星微电子有限公司 | Method and device for compressing and decompressing video bit stream |
| CN105430537A (en) * | 2015-11-27 | 2016-03-23 | 刘军 | Method and server for synthesis of multiple paths of data, and music teaching system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102136848B1 (en) * | 2013-07-15 | 2020-07-22 | 삼성전자 주식회사 | Image Processing Device, Image Processing System and Image Processing Method |
-
2016
- 2016-07-12 CN CN201610544843.7A patent/CN106060080B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1976429A (en) * | 2006-12-15 | 2007-06-06 | 北京华纬讯电信技术有限公司 | Video frequency transmitting system and method based on PC and high-resolution video signal collecting card |
| CN101841704A (en) * | 2009-01-14 | 2010-09-22 | 北京中星微电子有限公司 | Method and device for compressing and decompressing video bit stream |
| CN105430537A (en) * | 2015-11-27 | 2016-03-23 | 刘军 | Method and server for synthesis of multiple paths of data, and music teaching system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106060080A (en) | 2016-10-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8320693B2 (en) | Encoding device and method, decoding device and method, and transmission system | |
| CA2737728C (en) | Low latency video encoder | |
| US8184636B2 (en) | Information processing device and method, and computer readable medium for packetizing and depacketizing data | |
| CN101690163B (en) | Shutter time compensation | |
| JP5726919B2 (en) | Enabling delta compression and motion prediction and metadata modification to render images on a remote display | |
| JP2828379B2 (en) | Video codec | |
| US11044437B2 (en) | Method and system for combining multiple area-of-interest video codestreams into a combined video codestream | |
| US20130156113A1 (en) | Video signal processing | |
| CN105472442B (en) | Compressibility is cached outside a kind of piece for ultra high-definition frame rate up-conversion | |
| AU731506B2 (en) | Method for the transmission of video images | |
| CN106060080B (en) | A kind of medical video signal acquisition trans-coding system | |
| CN106157213B (en) | A kind of medical video image live broadcasting method | |
| FI109394B (en) | Method and apparatus for encoding and decoding a video image | |
| EP2429192A1 (en) | Video signal processing | |
| CN105519108B (en) | The weight predicting method and device of quantization matrix coding | |
| CN106027991B (en) | Medical video image live broadcast all-in-one | |
| CN106454355A (en) | Video encoding method and apparatus | |
| US8767831B2 (en) | Method and system for motion compensated picture rate up-conversion using information extracted from a compressed video stream | |
| CN116320465A (en) | Video compression and transmission method, device, gateway and storage medium | |
| JP4693096B2 (en) | Multipoint conference device | |
| CN115643406A (en) | Video decoding method, video encoding device, storage medium, and storage apparatus | |
| US8208555B2 (en) | Image capturing and transmission device and image receiving and reconstruction device | |
| CN205987159U (en) | Live all -in -one of medical treatment video | |
| Yoo et al. | Enhanced compression of integral images by combined use of residual images and MPEG-4 algorithm in three-dimensional integral imaging | |
| JP2004222262A (en) | Built-in memory device for motion picture compression |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190308 Address after: 210028 Yinchun Road, No. 18-X809, Science and Technology Research Base of Maigaoqiao Pioneer Park, Qixia District, Nanjing City, Jiangsu Province Applicant after: Nanjing New Guangyun Information Technology Co.,Ltd. Address before: Room 1032, Building 1, Deying International Plaza, Yuhuatai District, Nanjing, Jiangsu Province, 210000 Applicant before: Li Wei |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Room 1006, 1007, 1008, and 1009, Building 3, No. 30 Fengzhan Road, Yuhuatai District, Nanjing City, Jiangsu Province, 210028 Patentee after: Nanjing Xinguang Digital Medical Technology Co.,Ltd. Country or region after: China Address before: 210028, No. 18 Yinchun Road, Science and Technology Research and Development Base, Maigaoqiao Entrepreneurship Park, Qixia District, Nanjing City, Jiangsu Province - X809 Patentee before: Nanjing New Guangyun Information Technology Co.,Ltd. Country or region before: China |
|
| CP03 | Change of name, title or address |