CN113810739B - Image transmission method, terminal and computer readable storage medium - Google Patents
Image transmission method, terminal and computer readable storage medium Download PDFInfo
- Publication number
- CN113810739B CN113810739B CN202010768116.5A CN202010768116A CN113810739B CN 113810739 B CN113810739 B CN 113810739B CN 202010768116 A CN202010768116 A CN 202010768116A CN 113810739 B CN113810739 B CN 113810739B
- Authority
- CN
- China
- Prior art keywords
- data
- region
- channel
- interest
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 91
- 238000000034 method Methods 0.000 title claims abstract description 27
- 239000012634 fragment Substances 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/188—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a video data packet, e.g. a network abstraction layer [NAL] unit
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/37—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability with arrangements for assigning different transmission priorities to video input data or to video coded data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/164—Feedback from the receiver or from the transmission channel
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Transition And Organic Metals Composition Catalysts For Addition Polymerization (AREA)
- Burglar Alarm Systems (AREA)
- Radar Systems Or Details Thereof (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
An image transmission method applied to a transmission terminal, the method comprising: establishing a first channel, a second channel and a third channel; acquiring an image of a video, and cutting the image into an interested region and a background region; acquiring first data of an interested region and second data of a background region, and obtaining third data after fountain coding the first data; the first channel, the second channel and the third channel are used for respectively transmitting the first data, the second data and the third data to a receiving end; receiving the network condition transmitted back by the receiving end, and judging whether the network condition meets a preset condition or not; and if so, compensating the first data according to a first preset algorithm. The invention can protect the integrity of the content of the interested region of the image and avoid the loss of the content of the interested region caused by the loss of the content of the interested region of the user.
Description
Technical Field
The present invention relates to data transmission technologies, and in particular, to an image transmission method, a terminal, and a computer readable storage medium.
Background
With the progress of video and audio technology, the demand for high-quality video transmission has increased. However, due to the requirement of high-quality video transmission, the amount of data to be transmitted is greatly increased, which easily causes the online quality problems such as data loss, delay or jitter under the limited network bandwidth.
When the video is data lost, the image or region of interest (Region of interesting, ROI) in the video is not clear, so that the user's sense is affected. Loss of ROI data may cause the camera to fail to preserve visual evidence, resulting in loss to the user.
Disclosure of Invention
In view of the foregoing, it is desirable to provide an image transmission method, a terminal and a computer readable storage medium, which can protect the integrity of the content of a region of interest of an image and avoid the loss of the content of the region of interest caused by the loss of the content of the region of interest.
The embodiment of the invention provides an image transmission method, which is applied to a terminal and comprises the following steps: establishing three data transmission channels, wherein the three data transmission channels are a first channel, a second channel and a third channel respectively; acquiring an image of a video, and cutting the image into an interested region and a background region; acquiring first data of an interested region and second data of a background region, and obtaining third data after fountain coding the first data; the first channel, the second channel and the third channel are used for respectively transmitting the first data, the second data and the third data to a receiving end; receiving the network condition transmitted back by the receiving end, and judging whether the network condition meets a preset condition or not; when the network condition reaches a preset condition, compensating the first data according to a first preset algorithm; and restoring the first data according to a second preset algorithm, and broadcasting the restored image.
Optionally, the segmenting the image into the region of interest and the background region includes: and cutting the image into an interested region and a background region according to the importance degree of the content, wherein the part with high importance degree of the image content is the interested region, and the part with low importance degree of the image content is the background region.
Optionally, the transmitting the first data through a first channel, a second channel, and a third channel, where the second data and the third data are respectively transmitted to a receiving end, includes: the first data of the region of interest is encoded into m fragments through H264 and transmitted through the first channel; the second data of the background area is encoded into n fragments through H264 and transmitted through the second channel; and obtaining third data through fountain coding on m fragments of the region of interest, and transmitting the third data through the third channel, wherein the third data are k pieces of compensation data.
Optionally, the compensating the first data according to a first preset algorithm includes: reducing the bit rate and the resolution level of the video, and encoding according to the reduced bit rate and resolution level of the video; adjusting the magnitude of the k value; and reducing the data amount of the second data of the background area.
Optionally, the restoring the first data according to the second preset algorithm includes: counting packet loss rates of first data in the first channel and third data in the third channel; decoding the first data of the first channel and the second data of the second channel; judging whether the first data of the region of interest is lost or not; when the first data of the region of interest is lost, the third data and the first data of the region of interest are subjected to fountain decoding operation, and the lost data of the region of interest is decoded; and decoding the first data of the region of interest and the second data of the background region through H264 to obtain the restored image.
The embodiment of the invention also provides a terminal, which comprises a memory, a processor and an image transmission program stored in the memory and capable of running on the processor, wherein the image transmission program is executed by the processor to realize the following steps: establishing a first channel, a second channel and a third channel; acquiring an image of a video, and cutting the image into an interested region and a background region; acquiring first data of an interested region and second data of a background region, and obtaining third data after fountain coding the first data; the first channel, the second channel and the third channel are used for respectively transmitting the first data, the second data and the third data to a receiving end; receiving the network condition transmitted back by the receiving end, and judging whether the network condition meets a preset condition or not; when the network condition reaches a preset condition, compensating the first data according to a first preset algorithm; and restoring the first data according to a second preset algorithm, and broadcasting the restored image.
Optionally, the segmenting the image into the region of interest and the background region includes: and cutting the image into an interested region and a background region according to the importance degree of the content, wherein the part with high importance degree of the image content is the interested region, and the part with low importance degree of the image content is the background region.
Optionally, the transmitting the first data through a first channel, a second channel, and a third channel, where the second data and the third data are respectively transmitted to a receiving end, includes: the first data of the region of interest is encoded into m fragments through H264 and transmitted through the first channel; the second data of the background area is encoded into n fragments through H264 and transmitted through the second channel; and obtaining third data through fountain coding on m fragments of the region of interest, and transmitting the third data through the third channel, wherein the third data are k pieces of compensation data.
The embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program realizes the steps of the image transmission method when being executed by a processor.
Compared with the prior art, the image transmission method, the image transmission device and the computer readable storage medium divide the image into the region of interest and the background region, the region of interest is important data, and when packet loss occurs, the data of the region of interest only need to be compensated by compensation data, so that the image of the region of interest can be completely restored, and the important data can be completely restored. On the one hand, the integrity of the content of the region of interest of the image can be protected, and the loss of the content of the region of interest caused by the loss of a user can be avoided. In addition, since the compensation data is additionally generated, in order to maintain the consistency of the overall data volume, only the data volume of the background area needs to be reduced, so that the overall data volume is consistent. In the invention, the loss of a small amount of unimportant area is used for replacing the complete important image content of the interested area, and no extra bandwidth pressure is generated.
Drawings
FIG. 1 is a diagram of an operating environment for video image transmission in accordance with a preferred embodiment of the present invention.
FIG. 2 is a diagram of the operating environment of the first image transmission system according to the preferred embodiment of the present invention.
FIG. 3 is a diagram of the operating environment of a second image transmission system according to a preferred embodiment of the present invention.
Fig. 4 is a block diagram of a first embodiment of the image transmission system according to the present invention.
Fig. 5 is a block diagram of a second image transmission system according to a preferred embodiment of the present invention.
FIG. 6 is a schematic diagram of an image cut into a region of interest and a background region according to a preferred embodiment of the present invention.
FIG. 7 is a flowchart of an image transmission method according to a preferred embodiment of the present invention.
FIG. 8 is a flowchart of an image transmission method according to another preferred embodiment of the present invention.
Description of the main reference signs
Detailed Description
Referring to fig. 1, a diagram of an embodiment of video image transmission is shown. The video image is transmitted from the transmitting terminal 1 to the receiving terminal 2. The first image transmission system 10 operates in the transmission terminal 1. The second image transmission system 20 operates in the receiving terminal 2.
Referring to FIG. 2, a diagram of an exemplary system environment for a first image transmission system 10 according to an embodiment of the present invention is shown. The transmission terminal 1 further includes a memory 30, a processor 40, and the like.
Referring to FIG. 3, a diagram of an exemplary system for operating a second image transmission system 20 according to an embodiment of the present invention is shown. The receiving terminal 2 further includes a memory 30, a processor 40, and the like.
The memory 30 includes at least one type of readable storage medium including flash memory, hard disk, multimedia card, card memory (e.g., SD or DX memory, etc.), random Access Memory (RAM), static Random Access Memory (SRAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), programmable Read Only Memory (PROM), magnetic memory, magnetic disk, optical disk, etc. The processor 40 may be a central processing unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor, or other data processing chip, or the like.
Referring to fig. 4, a block diagram of a first image transmission system 10 according to a preferred embodiment of the present invention is shown.
The first image transmission system 10 includes a first establishing module 101, a cutting module 102, a transmission module 103, a first receiving module 104 and a compensation module 105. The modules are configured to be executed by one or more processors (one processor 30 in this embodiment) to carry out the invention. The modules referred to herein are computer program segments that perform a particular instruction. The memory 30 is used for storing data such as program codes of the first image transmission system 10. The processor 40 is configured to execute program code stored in the memory 30.
The first establishing module 101 is configured to establish three data transmission channels, where the three data transmission channels are a first channel, a second channel, and a third channel.
In this embodiment, the first channel, the second channel and the third channel established by the first establishing module 101 are three independent channels, and are used for respectively transmitting data, and are not mutually affected.
And the cutting module 102 is used for acquiring the image of the video and cutting the image into the region of interest and the background region.
Specifically, the transmission terminal 1 cuts the image into a region of interest (region of interest, ROI) and a background region according to the content importance level, wherein a portion of the image with high importance level is the region of interest, and a portion of the image with low importance level is the background region. For example, as shown in fig. 6, in fig. 6-1, a person is a region of interest having a high importance, and other regions other than the person are background regions having a low importance. In 6-2, the cutting module 102 first searches the person part in the image content according to the face recognition technology, and the region where the person is located is the ROI region. Further, in 6-3, the cutting module 102 performs macroblock (macroblock) coding on the ROI area and the background area, and further divides the ROI area and the background area into a plurality of macroblocks with the same size. In 6-4, the region represented by the dark macro block is the ROI region, and the region represented by the light macro block is the background region.
The cutting module 102 is further configured to obtain first data of the region of interest and second data of the background region, and obtain third data after fountain encoding the first data.
In this embodiment, after the first data is fountain-coded, the obtained third data is used as compensation data, and when the first data is lost, compensation is performed through the third data.
And the transmission module 103 is configured to transmit the first data, the second data and the third data to a receiving end through the first channel, the second channel and the third channel respectively.
Specifically, the transmission module 103 encodes the first data of the region of interest into m segments via H264, and transmits the m segments via the first channel.
In this embodiment, the transmission module 103 encodes the multiple macro blocks of the region of interest by H264 to obtain m slices, and transmits the m slices in the form of network abstraction layer units (Network Abstract Layer units, NAL units) on the first channel.
Further, the second data of the background region is encoded into n segments via H264 and transmitted via the second channel.
In this embodiment, the transmission module 103 encodes the plurality of macro blocks in the background area by H264 to obtain n slices, and transmits the n slices in the form of network abstraction layer units (Network Abstract Layer units, NAL units) on the second channel.
Further, the m segments of the region of interest are fountain coded to obtain the third data, and the third data are transmitted through the third channel, wherein the third data are k pieces of compensation data.
In a preferred embodiment, the k value may be preset to be a preset proportion of the data size of the image, for example, 10%. Illustrating: the data size (also called picture size) of a picture is p bytes, where k= [ p (m/(m+n)) × 10%/slice_size ], where slice_size is the number of bytes occupied by each Slice.
The first receiving module 104 is configured to receive the network condition returned by the receiving end, and determine whether the network condition meets a preset condition.
Specifically, the preset condition is preset by a developer, for example, in this embodiment, the receiving module 104 determines whether the packet loss rate of the feedback packet sent back by the receiving terminal 2 is greater than 0, and in a preferred embodiment, the feedback packet is transmitted using Real-time control protocol (Real-time Transport Control Protocol, RTCP). Wherein, the RTCP feedback packet returned by the receiving terminal 2 at least includes: the bandwidths and packet loss rates of the first channel and the third channel.
And the compensation module 105 is configured to compensate the first data according to a first preset algorithm when the network condition reaches a preset condition.
Specifically, in this embodiment, when the network condition satisfies a preset condition, for example, when the packet loss rate of the feedback packet returned by the receiving terminal 2 is greater than 0, the first data is compensated according to a first preset algorithm. Specifically, compensating the first data according to a first preset algorithm includes:
first, the bit rate and the resolution level of the video are reduced, and coding is performed according to the reduced bit rate and resolution level of the video.
Specifically, the compensation module 105 may pre-establish a level table including a correspondence between resolution and bit rate, set an initial level, play a video image according to the resolution and bit rate corresponding to the initial level in the level table, and when the packet loss rate of the feedback packet returned by the receiving end is greater than 0, drop the initial level in the level table by one level, and play the video image according to the resolution and bit rate corresponding to the dropped level in the level table. Therefore, the total data volume in the transmission process can be reduced, and the packet loss rate of the packets is reduced.
Second, the magnitude of the k value is adjusted.
Specifically, the magnitude of the k value is adjusted by the formula k= [ p (m/(m+n)) × y%/slice_size. Wherein m is the number of segments of the first data of the region of interest after H264 encoding, n is the number of segments of the second data of the background region after H264 encoding, k is the number of compensation data obtained by fountain encoding the m segments of the region of interest, p is the data size of the current image, and y% is the packet loss rate of the feedback packet transmitted back by the receiving terminal 2. The data amount of the first data of the region of interest is p (m/(m+n)), and the data amount of the third data, that is, the data amount of the compensation data is p (m/(m+n))xy ", and the number of the compensation data is k=k= [ p (m/(m+n))xy%/slice_size ].
In this embodiment, by adjusting the k value, the data compensation amount of the region of interest is increased during the packet loss process, so as to maintain the picture integrity of the region of interest in the video.
In a preferred embodiment, the k value may be preset to be a preset proportion of the data size of the image, for example, 10%. Thus, when y is less than or equal to 10, the value of the compensation data k is kept unchanged, and when y is more than 10, the preset compensation data k cannot meet the compensation data required by the packet loss of the region of interest, so that the magnitude of the k value is adjusted according to the formula k= [ p (m/(m+n))%y/slice_size ].
Again, the data amount of the second data of the background area is reduced.
Specifically, the compensation module 105 reduces the data amount of the second data of the background area according to the data amount of the third data, that is, reduces the data amount of the second data of the background area according to the data amount of the compensation data. In this embodiment, since the amount of compensation data increases, in order to maintain the overall transmission amount unchanged, the amount of data of the second data in the background area is reduced, and further, the amount of data of the same byte number as the amount of compensation data in the background area is reduced, so that the overall transmission amount is ensured to be unchanged, and the image of the region of interest is not affected.
For example: the interested area has m=10 fragments, the background area has n=26 fragments, the image size is 50kbytes, the packet loss rate y% of the feedback packet transmitted by the receiving terminal 2 is 30%, and the number of bytes slice_size occupied by each fragment is 1.4kbytes. The data amount of the first data of the region of interest is p× (m/(m+n))=50×10/(10+26)) kbytes=13.89 Kbytes, and the data amount of the third data, that is, the data amount of the compensation data is p× (m/(m+n))×y% =50×10/(10+26))×30% kbytes= 4.167Kbytes, and the number of the compensation data is k= [ p×10/(m+n))×y%/slice_size ] = [50×10/(10+26))×30% Kbytes/1.4Kbytes ] =3. Thus, in this embodiment, 50Kbytes of data is calculated according to a 30% packet loss rate, when 15Kbytes are lost, the data integrity of the region of interest can be maintained by only reducing the background area 4.167Kbytes, and the benefit is very high.
Referring to fig. 5, a block diagram of a second image transmission system 20 according to a preferred embodiment of the present invention is shown.
The second image transmission system 20 includes a second establishing module 201, a second receiving module 202, a sending module 203, and a restoring module 204. The modules are configured to be executed by one or more processors (one processor 40 in this embodiment) to carry out the invention. The modules referred to herein are computer program segments that perform a particular instruction. The memory 30 is used for storing data such as program codes of the second image transmission system 20. The processor 40 is configured to execute program code stored in the memory 30.
The second establishing module 201 is configured to establish three data transmission channels, where the three data transmission channels are a first channel, a second channel and a third channel.
The second receiving module 202 is configured to receive, via the first channel, the second channel, and the third channel, the first data, the second data, and the third data, respectively.
The video image is cut into an interested region and a background region by the cutting module 102 of the receiving terminal, the first data is data of the interested region, the second data is data of the background region, and the third data is data obtained by fountain coding the first data.
And the sending module 203 is configured to count the current network status and report the current network status to the transmitting end.
And the restoring module 204 restores the first data according to a second preset algorithm and plays the restored image.
Specifically, the restoring the first data according to the second preset algorithm includes: the restoration module 204 counts packet loss rates of the first data in the first channel and the third data in the third channel; decoding the first data of the first channel and the second data of the second channel; judging whether the first data of the region of interest is lost or not; when the first data of the region of interest is lost, fountain decoding operation is carried out on the third data and the first data of the region of interest, the lost data of the region of interest is decoded, and when the first data of the region of interest is not lost, the third data is discarded; and decoding the first data of the region of interest and the second data of the background region through H264 to obtain the restored image.
In this embodiment, the image is divided into the region of interest and the background region, the region of interest is the important data, and when packet loss occurs, the data of the region of interest is only compensated by the compensation data, so that the image of the region of interest can be completely restored, and the important data can be completely restored. In addition, since the compensation data is additionally generated, in order to maintain the consistency of the overall data volume, only the data volume of the background area needs to be reduced, so that the overall data volume is consistent. In this embodiment, the loss of a small amount of unimportant region (background region) is used to replace the whole important image content of the interested region, so that no extra bandwidth pressure is generated.
In this embodiment, the integrity of the content of the region of interest of the image can be protected, and the loss of the content of the region of interest caused by the loss of the user can be avoided.
Referring to fig. 7, a flowchart of an image transmission method according to a preferred embodiment of the invention is shown. The image transmission method is applied to the transmission terminal 1, and can be implemented by the processor 30 executing the modules 101 to 105 shown in fig. 4.
In step S300, three data transmission channels are established, wherein the three data transmission channels are a first channel, a second channel and a third channel respectively.
In this embodiment, the first channel, the second channel and the third channel established by the transmission terminal 1 are three independent channels, and are used for respectively transmitting data, and are not mutually affected.
Step S302, obtaining an image of a video, and cutting the image into a region of interest and a background region.
Specifically, the transmission terminal 1 cuts the image into a region of interest (region of interest, ROI) and a background region according to the content importance level, wherein a portion of the image with high importance level is the region of interest, and a portion of the image with low importance level is the background region. For example, as shown in fig. 6, in fig. 6-1, a person is a region of interest having a high importance, and other regions other than the person are background regions having a low importance. In 6-2, the transmission terminal 1 first searches the person part in the image content according to the face recognition technology, and the region where the person is located is the ROI region. Further, in 6-3, the transmission terminal 1 performs macroblock (macroblock) coding on the ROI area and the background area, and further divides the ROI area and the background area into a plurality of macroblocks of the same size. In 6-4, the region represented by the dark macro block is the ROI region, and the region represented by the light macro block is the background region.
Step S304, first data of the region of interest and second data of the background region are obtained, and third data are obtained after fountain coding is carried out on the first data.
In this embodiment, after the first data is fountain-coded, the obtained third data is used as compensation data, and when the first data is lost, compensation is performed through the third data.
Step S306, transmitting the first data, the second data and the third data to the receiving terminal through the first channel, the second channel and the third channel respectively.
Specifically, the transmission terminal 1 encodes the first data of the region of interest into m segments via H264, and transmits the m segments via the first channel.
In this embodiment, the transmission terminal 1 encodes the multiple macro blocks of the region of interest by H264 to obtain m slices, and transmits the m slices in the form of network abstraction layer units (Network Abstract Layer units, NAL units) on the first channel.
Further, the second data of the background region is encoded into n segments via H264 and transmitted via the second channel.
In this embodiment, the transmission terminal 1 encodes the plurality of macro blocks in the background area by H264 to obtain n slices, and transmits the n slices in the form of network abstraction layer units (Network Abstract Layer units, NAL units) on the second channel.
Further, the m segments of the region of interest are fountain coded to obtain the third data, and the third data are transmitted through the third channel, wherein the third data are k pieces of compensation data.
In a preferred embodiment, the k value may be preset to be a preset proportion of the data size of the image, for example, 10%. Illustrating: the data size (also called picture size) of a picture is p bytes, where k= [ p (m/(m+n)) × 10%/slice_size ], where slice_size is the number of bytes occupied by each Slice.
Step S308, receiving the network status returned by the receiving terminal 2, and determining whether the network status meets a preset condition.
Specifically, the preset condition is preset by a developer, for example, in this embodiment, the transmission terminal 1 determines whether the packet loss rate of the feedback packet sent back by the receiving end is greater than 0, and in a preferred embodiment, the feedback packet is transmitted using Real-time control protocol (Real-time Transport Control Protocol, RTCP). Wherein, the RTCP feedback packet returned by the receiving terminal at least comprises: the bandwidths and packet loss rates of the first channel and the third channel.
In step S310, when the network condition reaches a preset condition, the first data is compensated according to a first preset algorithm.
Specifically, in this embodiment, when the network condition satisfies a preset condition, for example, when the packet loss rate of the feedback packet sent back by the receiving end is greater than 0, the first data is compensated according to a first preset algorithm. Specifically, compensating the first data according to a first preset algorithm includes:
first, the bit rate and the resolution level of the video are reduced, and coding is performed according to the reduced bit rate and resolution level of the video.
Specifically, the transmission terminal 1 may pre-establish a level table including a correspondence between resolution and bit rate, set an initial level, play a video image according to the resolution and bit rate corresponding to the initial level in the level table, and when the packet loss rate of the feedback packet returned by the receiving end is greater than 0, drop the initial level in the level table by one level, and play the video image according to the resolution and bit rate corresponding to the dropped level in the level table. Therefore, the total data volume in the transmission process can be reduced, and the packet loss rate of the packets is reduced.
Second, the magnitude of the k value is adjusted.
Specifically, the magnitude of the k value is adjusted by the formula k= [ p (m/(m+n)) × y%/slice_size. Wherein m is the number of segments of the first data of the region of interest after H264 encoding, n is the number of segments of the second data of the background region after H264 encoding, k is the number of compensation data obtained by fountain encoding the m segments of the region of interest, p is the data size of the current image, and y% is the packet loss rate of the feedback packet transmitted back by the receiving end. The data amount of the first data of the region of interest is p (m/(m+n)), and the data amount of the third data, that is, the data amount of the compensation data is p (m/(m+n))xy ", and the number of the compensation data is k=k= [ p (m/(m+n))xy%/slice_size ].
In this embodiment, by adjusting the k value, the data compensation amount of the region of interest is increased during the packet loss process, so as to maintain the picture integrity of the region of interest in the video.
In a preferred embodiment, the k value may be preset to be a preset proportion of the data size of the image, for example, 10%. Thus, when y is less than or equal to 10, the value of the compensation data k is kept unchanged, and when y is more than 10, the preset compensation data k cannot meet the compensation data required by the packet loss of the region of interest, so that the magnitude of the k value is adjusted according to the formula k= [ p (m/(m+n))%y/slice_size ].
Again, the data amount of the second data of the background area is reduced.
Specifically, the data amount of the second data of the background area is reduced according to the data amount of the third data, i.e., the data amount of the second data of the background area is reduced according to the data amount of the compensation data. In this embodiment, since the amount of compensation data increases, in order to maintain the overall transmission amount unchanged, the amount of data of the second data in the background area is reduced, and further, the amount of data of the same byte number as the amount of compensation data in the background area is reduced, so that the overall transmission amount is ensured to be unchanged, and the image of the region of interest is not affected.
For example: the interested area has m=10 fragments, the background area has n=26 fragments, the image size is 50kbytes, the packet loss rate y% of the feedback packet transmitted back by the receiving end is 30%, and the number of bytes slice_size occupied by each fragment is 1.4kbytes. The data amount of the first data of the region of interest is p× (m/(m+n))=50×10/(10+26)) kbytes=13.89 Kbytes, and the data amount of the third data, that is, the data amount of the compensation data is p× (m/(m+n))×y% =50×10/(10+26))×30% kbytes= 4.167Kbytes, and the number of the compensation data is k= [ p×10/(m+n))×y%/slice_size ] = [50×10/(10+26))×30% Kbytes/1.4Kbytes ] =3. Thus, in this embodiment, 50Kbytes of data is calculated according to a 30% packet loss rate, when 15Kbytes are lost, the data integrity of the region of interest can be maintained by only reducing the background area 4.167Kbytes, and the benefit is very high.
Referring to fig. 8, a flowchart of an image transmission method according to a preferred embodiment of the invention is shown. The image transmission method is applied to the receiving terminal 2, and can be implemented by the processor 30 executing the modules 201 to 204 shown in fig. 5.
Step S400, three data transmission channels are established, wherein the three data transmission channels are a first channel, a second channel and a third channel respectively;
step S402, the first channel, the second channel, and the third channel receive the first data, the second data, and the third data, respectively.
The method comprises the steps of cutting an image of a video into a region of interest and a background region, wherein first data are data of the region of interest, second data are data of the background region, and third data are data obtained by fountain coding the first data.
Step S404, counting the current network status and reporting to the transmitting end.
Step S406, the first data is restored according to a second preset algorithm, and the restored image is played.
Specifically, the restoring the first data according to the second preset algorithm includes: counting packet loss rates of first data in the first channel and third data in the third channel; decoding the first data of the first channel and the second data of the second channel; judging whether the first data of the region of interest is lost or not; when the first data of the region of interest is lost, fountain decoding operation is carried out on the third data and the first data of the region of interest, the lost data of the region of interest is decoded, and when the first data of the region of interest is not lost, the third data is discarded; and decoding the first data of the region of interest and the second data of the background region through H264 to obtain the restored image.
In this embodiment, the image is divided into the region of interest and the background region, the region of interest is the important data, and when packet loss occurs, the data of the region of interest is only compensated by the compensation data, so that the image of the region of interest can be completely restored, and the important data can be completely restored. In addition, since the compensation data is additionally generated, in order to maintain the consistency of the overall data volume, only the data volume of the background area needs to be reduced, so that the overall data volume is consistent. In this embodiment, the loss of a small amount of unimportant region (background region) is used to replace the whole important image content of the interested region, so that no extra bandwidth pressure is generated.
By applying the method to the system, the integrity of the content of the region of interest of the image can be protected, and the loss of the content of the region of interest caused by the loss of a user can be avoided.
It should be noted that the above embodiments are only for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present invention may be modified or substituted without departing from the spirit and scope of the technical solution of the present invention.
Claims (10)
1. An image transmission method applied to a transmission terminal, the method comprising:
establishing three data transmission channels, wherein the three data transmission channels are a first channel, a second channel and a third channel respectively;
acquiring an image of a video, and cutting the image into an interested region and a background region;
acquiring first data of an interested region and second data of a background region, and obtaining third data after fountain coding the first data;
the first channel, the second channel and the third channel are used for respectively transmitting the first data, the second data and the third data to a receiving terminal;
receiving a network condition transmitted back by the receiving terminal, and judging whether the network condition meets a preset condition;
when the network condition reaches a preset condition, compensating the first data according to a first preset algorithm;
wherein the transmitting the first data, the second data and the third data to the receiving terminal through the first channel, the second channel and the third channel respectively includes:
the first data of the region of interest is encoded into m fragments through H264 and transmitted through the first channel;
the second data of the background area is encoded into n fragments through H264 and transmitted through the second channel;
the m segments of the region of interest are fountain coded to obtain third data, and the third data are transmitted through the third channel, wherein the third data are k pieces of compensation data, and m, n and k are positive integers greater than 0;
the compensating the first data according to a first preset algorithm includes:
reducing the bit rate and the resolution level of the video, and encoding according to the reduced bit rate and resolution level of the video;
adjusting the magnitude of the k value; and
And reducing the data amount of the second data of the background area.
2. The image transmission method according to claim 1, wherein the dividing the image into the region of interest and the background region comprises:
and cutting the image into an interested region and a background region according to the importance degree of the content, wherein the part with high importance degree of the image content is the interested region, and the part with low importance degree of the image content is the background region.
3. The image transmission method according to claim 1, wherein the k value is adjusted by the formula k= [ p (m/(m+n))%y/slice_size ];
wherein m is the number of segments of the first data of the region of interest after H264 encoding, n is the number of segments of the second data of the background region after H264 encoding, k is the number of compensation data obtained by fountain encoding the m segments of the region of interest, p is the data size of the current image, y% is the packet loss rate of the feedback packet transmitted back by the receiving end, and slice_size is the number of bytes occupied by each segment.
4. An image transmission method applied to a receiving terminal, the method comprising:
establishing three data transmission channels, wherein the three data transmission channels are a first channel, a second channel and a third channel respectively;
the first channel, the second channel and the third channel respectively receive first data, second data and third data, wherein an image of a video is cut into an interested region and a background region, the first data is data of the interested region, the second data is data of the background region, and the third data is data obtained by fountain coding the first data;
receiving a network condition transmitted back by the receiving terminal, and judging whether the network condition meets a preset condition;
when the network condition reaches a preset condition, compensating the first data according to a first preset algorithm;
wherein compensating the first data according to a first preset algorithm comprises:
a grade table containing the corresponding relation between the resolution and the bit rate is established in advance, and video images are played according to the resolution and the bit rate corresponding to the initial grade in the grade table;
when the packet loss rate of the feedback packet of the receiving terminal is greater than 0, the initial grade in the grade table is reduced by one grade, and video images are played according to the resolution and the bit rate corresponding to the reduced grade in the grade table;
compensating the first data according to a formula k= [ p (m/(m+n))%y/slice_size ], wherein m is the number of segments of the first data of the region of interest after H264 encoding, n is the number of segments of the second data of the background region after H264 encoding, k is the number of compensation data obtained by fountain encoding m segments of the region of interest, p is the data size of the current image, y% is the packet loss rate of a feedback packet transmitted by a receiving end, and slice_size is the number of bytes occupied by each segment; and
Restoring the first data according to a second preset algorithm, and broadcasting the restored image;
wherein the restoring the first data according to the second preset algorithm includes:
counting packet loss rates of first data in the first channel and third data in the third channel;
decoding the first data of the first channel and the second data of the second channel;
judging whether the first data of the region of interest is lost or not;
when the first data of the region of interest is lost, fountain decoding operation is carried out on the third data and the first data of the region of interest, the lost data of the region of interest is decoded, and when the first data of the region of interest is not lost, the third data is discarded;
and decoding the first data of the region of interest and the second data of the background region through H264 to obtain the restored image.
5. A transmission terminal, comprising a memory, a processor, and an image transmission program stored on the memory and operable on the processor, the image transmission program when executed by the processor implementing the steps of:
establishing a first channel, a second channel and a third channel;
acquiring an image of a video, and cutting the image into an interested region and a background region;
acquiring first data of an interested region and second data of a background region, and obtaining third data after fountain coding the first data;
the first channel, the second channel and the third channel are used for respectively transmitting the first data, the second data and the third data to a receiving end;
receiving the network condition transmitted back by the receiving end, and judging whether the network condition meets a preset condition or not;
when the network condition reaches a preset condition, compensating the first data according to a first preset algorithm;
wherein the transmitting the first data, the second data and the third data to the receiving terminal through the first channel, the second channel and the third channel respectively includes:
the first data of the region of interest is encoded into m fragments through H264 and transmitted through the first channel;
the second data of the background area is encoded into n fragments through H264 and transmitted through the second channel;
the m segments of the region of interest are fountain coded to obtain third data, and the third data are transmitted through the third channel, wherein the third data are k pieces of compensation data, and m, n and k are positive integers greater than 0;
the compensating the first data according to a first preset algorithm includes:
reducing the bit rate and the resolution level of the video, and encoding according to the reduced bit rate and resolution level of the video;
adjusting the magnitude of the k value; and
And reducing the data amount of the second data of the background area.
6. The transmission terminal of claim 5, wherein the dividing the image into the region of interest and the background region comprises:
and cutting the image into an interested region and a background region according to the importance degree of the content, wherein the part with high importance degree of the image content is the interested region, and the part with low importance degree of the image content is the background region.
7. The transmission terminal according to claim 5, wherein the magnitude of the k value is adjusted by the formula k= [ p (m/(m+n))%y/slice_size ];
wherein m is the number of segments of the first data of the region of interest after H264 encoding, n is the number of segments of the second data of the background region after H264 encoding, k is the number of compensation data obtained by fountain encoding the m segments of the region of interest, p is the data size of the current image, y% is the packet loss rate of the feedback packet transmitted back by the receiving end, and slice_size is the number of bytes occupied by each segment.
8. A receiving terminal comprising a memory, a processor, and an image transmission program stored on the memory and operable on the processor, the image transmission program when executed by the processor implementing the steps of:
establishing three data transmission channels, wherein the three data transmission channels are a first channel, a second channel and a third channel respectively;
the first channel, the second channel and the third channel respectively receive first data, second data and third data, wherein an image of a video is cut into an interested region and a background region, the first data is data of the interested region, the second data is data of the background region, and the third data is data obtained by fountain coding the first data;
receiving a network condition transmitted back by the receiving terminal, and judging whether the network condition meets a preset condition;
when the network condition reaches a preset condition, compensating the first data according to a first preset algorithm;
wherein compensating the first data according to a first preset algorithm comprises:
a grade table containing the corresponding relation between the resolution and the bit rate is established in advance, and video images are played according to the resolution and the bit rate corresponding to the initial grade in the grade table;
when the packet loss rate of the feedback packet of the receiving terminal is greater than 0, the initial grade in the grade table is reduced by one grade, and video images are played according to the resolution and the bit rate corresponding to the reduced grade in the grade table;
compensating the first data according to a formula k= [ p (m/(m+n))%y/slice_size ], wherein m is the number of fragments of the first data of the region of interest after H264 encoding, n is the number of fragments of the second data of the background region after H264 encoding, k is the number of compensation data obtained by fountain encoding m fragments of the region of interest, p is the data size of the current image, y% is the packet loss rate of a feedback packet transmitted back by a receiving end, and slice_size is the number of bytes occupied by each fragment; and
Restoring the first data according to a second preset algorithm, and broadcasting the restored image;
wherein the restoring the first data according to the second preset algorithm includes:
counting packet loss rates of first data in the first channel and third data in the third channel;
decoding the first data of the first channel and the second data of the second channel;
judging whether the first data of the region of interest is lost or not;
when the first data of the region of interest is lost, fountain decoding operation is carried out on the third data and the first data of the region of interest, the lost data of the region of interest is decoded, and when the first data of the region of interest is not lost, the third data is discarded;
and decoding the first data of the region of interest and the second data of the background region through H264 to obtain the restored image.
9. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, which when executed by a processor, implements the steps of the image transmission method according to any one of claims 1 to 3.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, implements the steps of the image transmission method as claimed in claim 4.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/903653 | 2020-06-17 | ||
| US16/903,653 US11082705B1 (en) | 2020-06-17 | 2020-06-17 | Method for image transmitting, transmitting device and receiving device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113810739A CN113810739A (en) | 2021-12-17 |
| CN113810739B true CN113810739B (en) | 2024-02-09 |
Family
ID=77063611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010768116.5A Active CN113810739B (en) | 2020-06-17 | 2020-08-03 | Image transmission method, terminal and computer readable storage medium |
Country Status (3)
| Country | Link |
|---|---|
| US (3) | US11082705B1 (en) |
| CN (1) | CN113810739B (en) |
| TW (1) | TWI792155B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11082705B1 (en) * | 2020-06-17 | 2021-08-03 | Ambit Microsystems (Shanghai) Ltd. | Method for image transmitting, transmitting device and receiving device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6263021B1 (en) * | 1998-09-18 | 2001-07-17 | Sarnoff Corporation | Treating non-zero quantized transform coefficients as zeros during video compression processing |
| CN101262604A (en) * | 2008-04-23 | 2008-09-10 | 哈尔滨工程大学 | A telescopic video coding method for optimized transmission of interested area |
| CN101742289A (en) * | 2008-11-14 | 2010-06-16 | 北京中星微电子有限公司 | Method, system and device for compressing video code stream |
| CN101810006A (en) * | 2007-09-28 | 2010-08-18 | 摩托罗拉公司 | Be used for the method and apparatus that vision signal is handled |
| CN102348116A (en) * | 2010-08-03 | 2012-02-08 | 株式会社理光 | Video processing method, video processing device and video processing system |
| CN102420668A (en) * | 2010-09-28 | 2012-04-18 | 国基电子（上海）有限公司 | Modem and method for processing packets by same |
| CN103248883A (en) * | 2012-02-13 | 2013-08-14 | 联想(北京)有限公司 | Transmission method and electronic equipment |
| CN105553618A (en) * | 2015-12-22 | 2016-05-04 | 西安交通大学 | Secure image transmission method based on fountain code and self-adaptive resource distribution |
| WO2018103243A1 (en) * | 2016-12-09 | 2018-06-14 | 武汉斗鱼网络科技有限公司 | Bandwidth conserving method, system, live-streaming terminal, and readable storage medium |
| KR101978922B1 (en) * | 2017-11-30 | 2019-05-15 | 광운대학교 산학협력단 | FoV on the background frame streaming method of high quality 360 degree video data by separately transmitting the region of interest and the background frame |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2004233453B2 (en) * | 2003-12-03 | 2011-02-17 | Envysion, Inc. | Recording a sequence of images |
| US8250618B2 (en) * | 2006-09-18 | 2012-08-21 | Elemental Technologies, Inc. | Real-time network adaptive digital video encoding/decoding |
| CN101453639B (en) | 2007-11-29 | 2012-05-30 | 展讯通信（上海）有限公司 | Encoding, decoding method and system for supporting multi-path video stream of ROI region |
| GB201318653D0 (en) * | 2013-10-22 | 2013-12-04 | Microsoft Corp | Adapting a jitter buffer |
| US20150181168A1 (en) * | 2013-12-20 | 2015-06-25 | DDD IP Ventures, Ltd. | Interactive quality improvement for video conferencing |
| TWI508531B (en) * | 2014-06-04 | 2015-11-11 | Hon Hai Prec Ind Co Ltd | Video encoding device and method |
| US20180278852A1 (en) * | 2017-03-24 | 2018-09-27 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. | Object tracking system and method |
| US10785511B1 (en) * | 2017-11-14 | 2020-09-22 | Amazon Technologies, Inc. | Catch-up pacing for video streaming |
| US10839594B2 (en) * | 2018-12-11 | 2020-11-17 | Canon Kabushiki Kaisha | Method, system and apparatus for capture of image data for free viewpoint video |
| US11217020B2 (en) * | 2020-03-16 | 2022-01-04 | Snap Inc. | 3D cutout image modification |
| US11082705B1 (en) * | 2020-06-17 | 2021-08-03 | Ambit Microsystems (Shanghai) Ltd. | Method for image transmitting, transmitting device and receiving device |
-
2020
- 2020-06-17 US US16/903,653 patent/US11082705B1/en active Active
- 2020-08-03 CN CN202010768116.5A patent/CN113810739B/en active Active
-
2021
- 2021-01-14 TW TW110101509A patent/TWI792155B/en active
- 2021-04-28 US US17/243,349 patent/US11539964B2/en active Active
-
2022
- 2022-11-08 US US17/983,108 patent/US11812036B2/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6263021B1 (en) * | 1998-09-18 | 2001-07-17 | Sarnoff Corporation | Treating non-zero quantized transform coefficients as zeros during video compression processing |
| CN101810006A (en) * | 2007-09-28 | 2010-08-18 | 摩托罗拉公司 | Be used for the method and apparatus that vision signal is handled |
| CN101262604A (en) * | 2008-04-23 | 2008-09-10 | 哈尔滨工程大学 | A telescopic video coding method for optimized transmission of interested area |
| CN101742289A (en) * | 2008-11-14 | 2010-06-16 | 北京中星微电子有限公司 | Method, system and device for compressing video code stream |
| CN102348116A (en) * | 2010-08-03 | 2012-02-08 | 株式会社理光 | Video processing method, video processing device and video processing system |
| CN102420668A (en) * | 2010-09-28 | 2012-04-18 | 国基电子（上海）有限公司 | Modem and method for processing packets by same |
| CN103248883A (en) * | 2012-02-13 | 2013-08-14 | 联想(北京)有限公司 | Transmission method and electronic equipment |
| CN105553618A (en) * | 2015-12-22 | 2016-05-04 | 西安交通大学 | Secure image transmission method based on fountain code and self-adaptive resource distribution |
| WO2018103243A1 (en) * | 2016-12-09 | 2018-06-14 | 武汉斗鱼网络科技有限公司 | Bandwidth conserving method, system, live-streaming terminal, and readable storage medium |
| KR101978922B1 (en) * | 2017-11-30 | 2019-05-15 | 광운대학교 산학협력단 | FoV on the background frame streaming method of high quality 360 degree video data by separately transmitting the region of interest and the background frame |
Also Published As
| Publication number | Publication date |
|---|---|
| TWI792155B (en) | 2023-02-11 |
| CN113810739A (en) | 2021-12-17 |
| US11812036B2 (en) | 2023-11-07 |
| US11082705B1 (en) | 2021-08-03 |
| US20230069743A1 (en) | 2023-03-02 |
| TW202201962A (en) | 2022-01-01 |
| US11539964B2 (en) | 2022-12-27 |
| US20210400281A1 (en) | 2021-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100989222B1 (en) | Streaming multimedea data over a network having variable bandwidth | |
| KR100889745B1 (en) | Method defining NAL unit type and system of trasmission bitstream and redundant slice coding | |
| CN101742289B (en) | Method, system and device for compressing video code stream | |
| US9264737B2 (en) | Error resilient transmission of random access frames and global coding parameters | |
| CN113810739B (en) | Image transmission method, terminal and computer readable storage medium | |
| KR100363162B1 (en) | Method and apparatus for transmitting and recovering video signal | |
| CN111064962B (en) | Video transmission system and method | |
| US20160316211A1 (en) | Video Data Coding and Decoding Methods and Apparatuses | |
| US9106915B2 (en) | Video coding and decoding devices and methods and systems thereof | |
| US20180270507A1 (en) | Method for encoding streams of video data based on groups of pictures (gop) | |
| WO2023071469A1 (en) | Video processing method, electronic device and storage medium | |
| CN114827617B (en) | Video coding and decoding method and system based on perception model | |
| KR20140028059A (en) | On-demand intra-refresh for end-to-end coded video transmission systems | |
| US8505060B2 (en) | Use of a feedback channel for image broadcasting | |
| US6909450B2 (en) | Video encoding and decoding method of mitigating data losses in an encoded video signal transmitted through a channel | |
| CN107995502A (en) | Realize the method and apparatus and system of adaptive stream media | |
| CN111245566A (en) | Method and device for preventing packet loss of unreliable network, storage medium and electronic equipment | |
| CN113473228B (en) | Transmission control method, device, storage medium and equipment for 8K recorded and played video | |
| US8040945B1 (en) | System and method for encoding a single video stream at a plurality of encoding rates | |
| Kimata et al. | A study of key-frame reference picture selection method for error resilient multiple video objects distribution | |
| JP2004328353A (en) | Correction method and apparatus for inverted stream packet | |
| CN114286098A (en) | Video encoding and decoding method, system, device and storage medium | |
| JP4343913B2 (en) | Image communication system, image distribution system, image communication method, image distribution system control program, and program recording medium | |
| CN117749322A (en) | Data transmission method and device | |
| Lin et al. | An error resilient scheme for MPEG-4 FGS video over packet erasure channel that exhibits graceful degradation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 201613 No. 1925, Nanle Road, Songjiang Industrial Zone, Songjiang District, Shanghai Applicant after: Fulian Guoji (Shanghai) Electronics Co.,Ltd. Address before: 201613 Shanghai Songjiang District Songjiang Export Processing Zone South Le road 1925 Applicant before: Ambit Microsystems (Shanghai) Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |