CN109874013A - Network bandwidth adaptive hierarchical transmission image method based on content erotic line clipping - Google Patents
Network bandwidth adaptive hierarchical transmission image method based on content erotic line clipping Download PDFInfo
- Publication number
- CN109874013A CN109874013A CN201910079070.3A CN201910079070A CN109874013A CN 109874013 A CN109874013 A CN 109874013A CN 201910079070 A CN201910079070 A CN 201910079070A CN 109874013 A CN109874013 A CN 109874013A
- Authority
- CN
- China
- Prior art keywords
- image
- network bandwidth
- bandwidth
- line
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The network bandwidth adaptive hierarchical transmission image method based on content erotic line clipping that the invention proposes a kind of, its step are as follows: reception needs to transmit image and converts image array for image；Default grid reference bandwidth and network bandwidth section at different levels, and set corresponding image cropping amount；The network bandwidth in transmission process is obtained, determines current network belonging network bandwidth section；Determine image cropping amount；Line clipping is carried out to image to be transmitted using the line clipping method based on content erotic and is transmitted.The present invention is adapted to network bandwidth when transmitting image, cut down visual redundancy or the unconspicuous part of vision significance while the very important visual content for retaining image and significant visual signature based on the analysis to picture material, reduce the data volume of image transmitting, both guaranteed image transmitting rapidly and efficiently, improve image transmitting timeliness, also so that transmission objectives end is obtained high quality graphic, provide support for fast and high quality, the efficient network transmission of image.
Description
Technical field
The present invention relates to the technical fields more particularly to a kind of based on the adaptive of content erotic line clipping of image network transmission
Answer network bandwidth hierarchical transmission image method.
Background technique
The real-time Transmission that image is carried out under limited network bandwidth environments is that conventional images transmission is often faced and needed
The important problem solved.Both at home and abroad for the real-time Transmission of image mainly for the feelings for not changing image size and depth-width ratio
Shape is analyzed and is studied, and reducing conventional method used by transmitted data amount is to compress to image.It is compiled using compression
The mode of code handles image, reduces the data volume and time loss of image transmitting, but to keep the clarity of image
Etc. quality be then not easy to, excessively high compression ratio is often easy to that image is made blocking artifact and blurring effect occur.Generally speaking, this
A little methods usually neither consider the actual conditions of network bandwidth, also do not consider the particular content for including in image.
Summary of the invention
Method for compressing image is utilized for conventional images transmission, the actual conditions of transmission network bandwidth is not considered, is easy to make
There is the technical issues of blocking artifact and blurring effect in image, and the present invention proposes a kind of adaptive net based on content erotic line clipping
Network bandwidth hierarchical transmission image method, had both considered the actual conditions of network bandwidth, it is also considered that include in image is specific interior
Hold, provides support for the network transmission of Efficient image high quality.
In order to achieve the above object, the technical scheme of the present invention is realized as follows: a kind of be based on content erotic line clipping
Network bandwidth adaptive hierarchical transmission image method, its step are as follows:
Step 1: transmitting terminal receives the image needed through network transmission, identifies the size of image, and convert image to
Image array；
Step 2: grid reference bandwidth is preset according to the averaging network bandwidth under current technical status, with reference to default network
Reference bandwidth is classified network bandwidth, presets four networks bandwidth section, sets for each network bandwidth section corresponding
Image cropping amount；
Step 3: the network bandwidth in transmission process is obtained, according to network bandwidth sections pair at different levels preset in step 2
The network bandwidth of acquisition is classified, and determines current network belonging network bandwidth section；
Step 4: it is determined according to the corresponding image cropping amount in network bandwidth at different levels in step 2 section and step 3 current
Network belonging broadband network section determines the image cropping amount of image to be transmitted；
Step 5: the image cropping amount obtained according to step 4, using the line clipping method based on content erotic to be passed
Defeated image carries out line clipping；
Step 6: being exported by current network bandwidth and transmits the image after line clipping.
The implementation method of the step 2 is:
S21: grid reference bandwidth default grid reference bandwidth: is preset according to the averaging network bandwidth under current technical status
BWBench；
S22: network bandwidth sections at different levels are preset: default grid reference bandwidth BW Bench is referred to, using human assistance
Setting or the mode that sets automatically in proportion as classification foundation, preset network bandwidth sections at different levels be respectively BR1 [B1, B2),
BR2 [B2, B3), BR3 [B3, B4), BR4 [B4, B5), wherein B1 < B2 < B3 < B4 < B5；Network bandwidth interval B R1, BR2 at different levels,
BR3 and BR4 is distributed in the two sides of grid reference bandwidth BW Bench.
S23: the corresponding image cropping amount in network bandwidth sections at different levels is arranged: the corresponding line in the lower section of network bandwidth is cut out
It is higher to cut ratio setting, compares original image to be transmitted in this way, the data volume occupied by line clipping treated image will contract
It is small more；Conversely, network bandwidth it is higher the corresponding line clipping ratio setting in section it is lower, in this way compare original figure to be transmitted
Picture, the data volume occupied by line clipping treated image do not reduce diminution less, even.
The line clipping ratio of described network bandwidth interval B R1, BR2, BR3 and BR4 is typically respectively set to 30%,
20%, 10% and 0%.
It is by Linux command speedtest- that the method for the network bandwidth in transmission process is obtained in the step 3
Cli come test network speed and obtain network bandwidth, worked as according to network bandwidth at different levels in step S22 section facilities to judge to obtain
Which grade network bandwidth section preceding network bandwidth is in.
Determine that the image cropping amount of image to be transmitted is according to the current network institute obtained in step 3 in the step 4
Belong to classification, compare in step S23 and the corresponding image cropping amount in network bandwidth sections at different levels is set, determines that current network bandwidth is corresponding
Image cropping amount.
Line clipping method in the step 5 based on content erotic is by removing the sanction on either vertically or horizontally direction
Trimming reduces the data volume of image, and the pixel being located on cutting wires is all smaller by the calculated energy value of energy function
, be not easy to cause the pixel of visible change.The specific steps of this method are as follows:
First, the energy of image is calculated by gradient function；
Second, the smallest cutting wires of energy, that is, optimal crop line is found in horizontal or vertical direction；
Third after finding optimal crop line, deletes the optimal crop line from image, and the image of generation is middle graph
Picture；
4th, according to the corresponding line amount of the cutting proportion requirement in network bandwidth section, handed over repeatedly with vertical direction from horizontal direction
For execution second step and third step, that is, for the operation of the content erotic line clipping of image or intermediate image, so that middle graph
As both horizontally and vertically reaching cutting proportion requirement, that is, obtains and be finally completed the result images after line clipping.
The gradient function is calculated by Sobel operator, the image A for being n × m for size, the energy computation function of image
Are as follows:Wherein, e (I) indicates that the energy of image A, I indicate different size of image A；The pixel energy of image
Amount is horizontally and vertically the sum of upper gradient absolute value；Pixel is in that edge energy value is big, and pixel is in non-edge
It is small to locate energy value；
The vertical cutting wires of image A are as follows:
Wherein, SxIt indicates the vertical cutting wires deleted, is made of n row pixel,Indicate vertical cutting wires SxOn picture
Vegetarian refreshments；X is a mapping x:[1 ..., n] → [1 ..., m], vertical cutting wires are that the pixel of an eight connectivity is logical
Road, from top to bottom every a line all represent a pixel；X (i), x (i-1) respectively indicate the i-th column and the corresponding row of the (i-1)-th column is sat
Mark；
The horizontal cutting wires of image A are as follows:
Wherein, SyIt indicates the horizontal cutting wires deleted, is made of m column pixel,Indicate horizontal cutting wires SyOn picture
Vegetarian refreshments；Wherein y is a mapping y:[1 ..., m] → [1 ..., n], each column all represent a pixel from left to right
Point；Y (j), (j-1) respectively indicate jth row and the corresponding row coordinate of -1 row of jth.
The method for solving of the optimal crop line is:
By taking vertical direction as an example, the energy value of every cutting wires can be calculated by energy function are as follows:Wherein, E (s) indicates the energy value of cutting wires, by the energy of each pixel on the cutting wires
Value e (I (si)) be formed by stacking；Optimal vertical cutting wires are the smallest cutting wires s of energy in vertical direction*:Wherein, s*It indicates optimal crop line, is to take the smallest pixel group of energy in vertical direction
At the optimal crop line of image；
In vertical direction find optimal crop line when, since the second row of image line by line recursion to image last
Row, for each pixel (i, j), calculates a cumulative minimum energy value M (i, j), it may be assumed that
M (i, j)=e (i, j)+min (M (i-1, j-1), M (i-1, j), M (i-1, j+1)),
Wherein, e (i, j) indicates the energy value of pixel (i, j)；M (i-1, j-1), M (i-1, j), M (i-1, j+1) are respectively
Indicate the cumulative minimum energy value with pixel (i, j) adjacent each pixel of lastrow, take three's minimum value and pixel (i,
J) energy value at place is added；
It is current optimal vertical cutting wires that cutting wires corresponding to minimum M are had in last line.
A kind of transmission picture system of the network bandwidth adaptive hierarchical transmission image method based on content erotic line clipping,
It obtains and is classified really including reception image module to be transmitted, network bandwidth classification and corresponding cutting amount setting module, network bandwidth
Cover half block, image cropping amount determining module, image line clipping module and output simultaneously transmit image module, network bandwidth classification and it is right
Should the amount of cutting setting module and network bandwidth obtain and classification determining module is connected with image cropping amount determining module, image
Cutting amount determining module and receive image module to be transmitted and be connected with image line clipping module, image line clipping module with it is defeated
Out and transmits image module and be connected；Image module to be transmitted is received for receiving the image needed through network transmission, network
Bandwidth is classified and corresponds to cutting amount setting module and presets grid reference bandwidth according to the averaging network bandwidth under current technical status,
As classification foundation in such a way that human assistance is set or is set automatically in proportion, bandwidth sections at different levels are preset, to Netowrk tape
Width is classified and is respectively set corresponding image cropping amount, and network bandwidth obtains and classification determining module is used to obtain transmission
The current actual bandwidth of network simultaneously determines belonging network bandwidth section, and image cropping amount determining module is according to belonging to current network
Bandwidth section, the classification of control network bandwidth and the classification of corresponding cutting amount setting module and cutting standard, determine corresponding image
Cutting amount, image line clipping module carry out content erotic line clipping to image according to determining image cropping amount, export and transmit
Image module is used to export and transmit the image of the adaptive bandwidth requirement after cutting.
The network bandwidth classification and corresponding cutting amount setting module include grid reference bandwidth setup unit, network bandwidth
Section setup unit and image cropping amount setup unit, grid reference bandwidth setup unit and network bandwidth section setup unit phase
Connection, network bandwidth section setup unit are connected with image cropping amount setup unit.
Compared with existing technology, the invention has the benefit that by image line clipping and transmission image based on content erotic
Network bandwidth be combined together, by test network bandwidth carry out progressive operation, for different grades of network bandwidth carry out
Different degrees of picture material sensitive line trimming operation is realized and image is adaptively cut and passed based on network bandwidth classification
It is defeated.The present invention, can be in the very important visual content and significant view for retaining image based on the analysis to picture material when transmitting image
Cut down visual redundancy or the unconspicuous part of vision significance while feeling feature, thus reduce image data amount, according to
Network bandwidth classification is adapted to different image cropping amounts, is retaining the same of image very important visual feature and its transmission quality
When, the data volume of transmission image is reduced, transmission time is shortened, guarantees transmission timeliness, transmission objectives end is enable to be quickly obtained
High quality graphic realizes the high efficiency of transmission to image.The present invention can show device resolution combination Netowrk tape according to target side
Width setting transmits the cutting amount of transmitting terminal image level and vertical direction, changes image size and depth-width ratio is adapted to target side
It shows in equipment.The present invention does not need to carry out compression coding reduction to image in target side, simultaneously because in image very important visual
Hold the clarity and quality that is not cut and ensure that them with the pixel in feature, avoids image and blocking artifact occur and obscure
Effect.The present invention had both considered the actual conditions of network bandwidth, it is also considered that the particular content for including in image is Efficient image
The network transmission of high quality provides support.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the general frame of the invention.
Fig. 2 is the flow chart that image cropping amount is determined in the specific embodiment of the invention.
Fig. 3 is to be directed to five width image adaptive heterogeneous networks bandwidth in the specific embodiment of the invention, correspond to image
Classification line clipping after the result images that obtain.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under that premise of not paying creative labor
Embodiment shall fall within the protection scope of the present invention.
Embodiment 1
As shown in Figure 1, a kind of network bandwidth adaptive hierarchical transmission image method based on content erotic line clipping, step
It is rapid as follows:
Step 1: transmitting terminal receives the image needed through network transmission, identifies the size of image, and convert image to
Image array.
The reception image module to be transmitted of transmitting terminal identifies to be transmitted for receiving the image needed through network transmission
Image size converts image array for image, subsequent digitation is facilitated to handle.
Step 2: grid reference bandwidth is preset according to the averaging network bandwidth under current technical status, with reference to default network
Reference bandwidth is classified network bandwidth to obtain four network bandwidth sections, sets corresponding figure for each network bandwidth section
As cutting amount.
Network bandwidth classification and corresponding cutting amount setting module are default according to the averaging network bandwidth under current technical status
Grid reference bandwidth presets bandwidth at different levels as classification foundation in such a way that human assistance is set or is set automatically in proportion
Section is classified network bandwidth and corresponding image cropping amount is respectively set.
S21: default grid reference bandwidth.Grid reference bandwidth is preset according to the averaging network bandwidth under current technical status
BWBench, for example below in specific example, grid reference bandwidth BW Bench is arranged to 1000kbps.
S22: network bandwidth sections at different levels are preset.With reference to default grid reference bandwidth BW Bench, using human assistance
Setting or the mode that sets automatically in proportion as classification foundation, preset network bandwidth sections at different levels be respectively BR1 [B1, B2),
BR2 [B2, B3), BR3 [B3, B4), BR4 [B4, B5), wherein B1 < B2 < B3 < B4 < B5.Such as below in specific example, net
Network bandwidth section is set as four section grades by human assistance, wherein bandwidth lower than 150kbps be it is poor, bandwidth is in 150kbps
To be between 550kbps it is normal, bandwidth is in 550kbps to preferably, it is that grade is excellent that band, which is wider than 2000kbps, between 2000kbps.
Network bandwidth sections i.e. at different levels are distributed in the two sides of grid reference bandwidth BW Bench.
S23: the corresponding image cropping amount in network bandwidth sections at different levels is set.The corresponding line in the lower section of network bandwidth is cut out
It is higher to cut ratio setting, compares original image to be transmitted in this way, the data volume occupied by line clipping treated image will contract
It is small more；Conversely, network bandwidth it is higher the corresponding line clipping ratio setting in section it is lower, in this way compare original figure to be transmitted
Picture, the data volume occupied by line clipping treated image do not reduce diminution less, even.
Typically be directed to network bandwidth interval B R1, BR2, BR3 and BR4, can be respectively set line clipping ratio be 30%,
20%, 10% and 0%.Such as in the example shown below, it is classified, is arranged at different levels for the network bandwidth section of step S23
The corresponding image cropping amount in section.In view of excessively high line clipping be easy to cause the deformation of image, (bandwidth is lower than by poor
150kbps), normal (bandwidth is in 150kbps between 550kbps), good (bandwidth is in 550kbps between 2000kbps) this three
A network bandwidth classification section respectively corresponds 30%, 20%, 10% line clipping, when network bandwidth section is in the excellent (band of grade
It is wider than 2000kbps) when, original image is transmitted without line clipping.
Step 3: the network bandwidth in transmission process is obtained, according to network bandwidth sections pair at different levels preset in step 2
The network bandwidth of acquisition is classified, and determines current network bandwidth section.
Network bandwidth obtains and classification determining module is used to obtain the current actual bandwidth of transmission network and determines affiliated net
Network bandwidth section.In a specific embodiment of the present invention, network bandwidth obtains and classification determining module is to pass through Linux command
Speedtest-cli come test network speed and obtain network bandwidth, then according to network bandwidth at different levels in step S22 section be arranged feelings
Condition judges which grade network bandwidth section is obtained current network be in.
Step 4: it is determined according to the corresponding image cropping amount in network bandwidth at different levels in step 2 section and step 3 current
Network bandwidth section determines the image cropping amount of image to be transmitted.
Image cropping amount determining module compares network bandwidth classification and corresponding cutting according to the affiliated bandwidth section of current network
It measures the classification of setting module and cuts standard, determine corresponding image cropping amount.Referring to FIG. 2, in a kind of implementation of the invention
In example, the determination of image cropping amount is according to belonging to the current network that network bandwidth in step 3 obtains and classification determining module obtains
It is classified, compares the network bandwidth sections at different levels and corresponding cutting of network bandwidth classification and corresponding cutting amount setting module in step 2
Amount, determines corresponding image cropping amount.
Step 5: the image cropping amount obtained according to step 4, using the line clipping method based on content erotic to be passed
Defeated image carries out line clipping.
In an embodiment of the present invention, image line clipping module is to be passed to receiving according to determining image cropping amount
The image that defeated image module transmits carries out the line clipping based on content erotic, specific steps are as follows:
First, the energy of image is calculated by gradient function.Wherein gradient function is calculated by Sobel operator, reflects image
The information at edge.Assuming that piece image A, size is n × m, the energy computation function of the image are as follows:
Wherein, e (I) indicates that the energy of image, I indicate that the image array of different size of image, x, y respectively indicate horizontal direction and erect
Histogram to.Energy computation function in the level of image and vertical direction respectively to seeking partial derivative and take absolute value to obtain the ladder of image
Spend absolute value.The pixel energy of image is level with the sum of gradient absolute value in vertical direction.Pixel is in edge energy value
Greatly, it is small to be in energy value at non-edge for pixel.
Second, the smallest cutting wires of energy, that is, optimal crop line is found in horizontal or vertical direction.In order to be carried out to image
Line clipping does not cause image fault again, it is necessary to search out an optimal crop line.For image A, vertical cutting wires is defined as:
Wherein, SxIt indicates the vertical cutting wires deleted, is made of n row pixel.X is a mapping x:[1 ...,
N] → [1 ..., m], vertical cutting wires are the pixel paths of an eight connectivity, and from top to bottom every a line all represents a picture
Vegetarian refreshments.Indicate vertical cutting wires SxOn pixel；X (i), x (i-1) respectively indicate the i-th column and the corresponding row of the (i-1)-th column is sat
Mark.
Similarly, horizontal cutting wires is defined as:
Wherein, SyIt indicates the horizontal cutting wires deleted, is made of m column pixel.Wherein y is a mapping y:
[1 ..., m] → [1 ..., n], each column all represent a pixel from left to right.Indicate horizontal cutting wires SyOn
Pixel；Y (j), (j-1) respectively indicate jth row and the corresponding row coordinate of -1 row of jth.
By taking vertical direction as an example, the energy value that can calculate every cutting wires by energy function is as follows:Wherein, E (s) indicates the energy value of cutting wires, by the energy of each pixel on the cutting wires
Magnitude e (I (si)) be formed by stacking.IsPixel where indicating cutting wires on image array, siIndicate the pixel on cutting wires
Point.And optimal crop line is that the smallest cutting wires of vertical direction energy.If optimal crop line is s*,Wherein, s*It indicates optimal crop line, takes the smallest pixel of energy, group in vertical direction
At the optimal crop line of image.When finding optimal crop line in this direction, since the second row of image line by line recursion to
The last line of image calculates a cumulative minimum energy value M (i, j), it may be assumed that M (i, j) for each pixel (i, j)
=e (i, j)+min (M (i-1, j-1), M (i-1, j), M (i-1, j+1)), wherein e (i, j) indicates the energy of pixel (i, j)
Value.M (i-1, j-1), M (i-1, j), M (i-1, j+1) are respectively indicated and each pixel of pixel (i, j) adjacent lastrow
Cumulative minimum energy value takes the energy value at three's minimum value and pixel (i, j) to be added, in this way, with most in last line
Cutting wires corresponding to small value M are current optimal vertical cutting wires.
When specific operation, the energy value of each pixel is sought using Sobel operator to image array, then according to energy
Magnitude calculation adds up minimum energy value, finds the minimum value in last row or column, each row or column in obtained minimum value
Pixel composition line be optimal vertical cutting wires or optimal level cutting wires.
Third after finding optimal crop line, deletes the optimal crop line from image array, during the image of generation is
Between image.Optimal crop line is optimal vertical cutting wires or optimal level cutting wires.
4th, according to the corresponding line amount of the cutting proportion requirement in network bandwidth section, handed over repeatedly with vertical direction from horizontal direction
For execution second step and third step, that is, for the operation of the content erotic line clipping of image or intermediate image, so that middle graph
As both horizontally and vertically reaching cutting proportion requirement, that is, obtains and be finally completed the result images after line clipping.Based on interior
The data volume of image transmitting is greatly decreased in the line clipping of appearance to some extent.
Step 6: being exported by current network bandwidth and transmits image after line clipping.
It exports and transmits image module for exporting and transmitting the image of the adaptive bandwidth requirement after cutting.Such as Fig. 3 institute
Show, in an embodiment of the present invention, the image line clipping in step 5, for five width image adaptive heterogeneous networks bands
Width obtains result images after carrying out corresponding classification line clipping to image, the transmission for step S6.Each image is tested respectively
It is transmitted under different network bandwidth environments, the line that network bandwidth adaptive has carried out different cutting amounts in the transmission is cut out
It cuts.
From the figure 3, it may be seen that five width images are substantially all under the operation of different degrees of content erotic line clipping remains significant spy
Sign.There is slight deformation after the operation of 30% line clipping in only the 3rd width and the 4th width image, but have no effect on automobile with
The significant visual signature of sunflower.In addition to keeping picture quality, guaranteeing that image very important visual content and significant visual signature are clear
Except performing well in terms of clear transmission, the present invention adapts to heterogeneous networks bandwidth, and the data volume of each image has obtained in various degree
Reduction, also have very big reduction in terms of image transmission data amount.Table 1 is to five width image adaptives to heterogeneous networks bandwidth
The comparative analysis of the lower original graph and result images data volume for carrying out line clipping.As can be seen from Table 1, five width images are different
Different degrees of line clipping has been carried out under network bandwidth respectively, when network bandwidth be in grade it is excellent when, without cut.Work as bandwidth
In well, normally, these three poor grades when, carried out 10%, 20% and 30% line clipping, all different degrees of reduction respectively
The data volume of image transmitting, both ensure that image transmitting rapidly and efficiently, and had improved the timeliness of image transmitting, also make to transmit
Target side can obtain high quality graphic, realize the high efficiency of transmission to the fast and high quality of image.The present invention, will when transmitting image
Network bandwidth is effectively combined with content erotic image line clipping, has both considered network bandwidth actual conditions, it is contemplated that wrapping in image
The particular content contained.
The original image of 1 image adaptive network bandwidth line clipping of table and the comparative analysis of result images data volume
Embodiment 2
As shown in Figure 1, a kind of network bandwidth adaptive based on content erotic line clipping is classified image delivering system, including
Image module to be transmitted, network bandwidth classification and corresponding cutting amount setting module, network bandwidth is received to obtain and be classified and determine mould
Block, image cropping amount determining module, image line clipping module and output simultaneously transmit image module, network bandwidth classification and corresponding sanction
The amount of cutting setting module and network bandwidth obtain and classification determining module is connected with image cropping amount determining module, image cropping
Amount determining module and reception image module to be transmitted are connected with image line clipping module, and image line clipping module and output are simultaneously
Transmission image module is connected.Image module to be transmitted is received for receiving the image needed through network transmission, network bandwidth
Classification and corresponding cutting amount setting module are used according to the default grid reference bandwidth of averaging network bandwidth under current technical status
Human assistance is set or the mode that sets automatically in proportion is as classification foundation, presets bandwidth sections at different levels, to network bandwidth into
Row is classified and is respectively set corresponding image cropping amount, and network bandwidth obtains and classification determining module is used to obtain transmission network
Current actual bandwidth simultaneously determines belonging network bandwidth section, and image cropping amount determining module is according to the affiliated bandwidth of current network
Section, the classification of control network bandwidth and the classification of corresponding cutting amount setting module and cutting standard, determine corresponding image cropping
Amount, image line clipping module carry out content erotic line clipping to image according to determining image cropping amount, export and transmit image
Module is used to export and transmit the image of the adaptive bandwidth requirement after cutting.
The network bandwidth classification and corresponding cutting amount setting module include grid reference bandwidth setup unit, network bandwidth
Section setup unit and image cropping amount setup unit, grid reference bandwidth setup unit and network bandwidth section setup unit phase
Connection, network bandwidth section setup unit are connected with image cropping amount setup unit.Grid reference bandwidth setup unit is used for
Default grid reference bandwidth, network bandwidth section setup unit is according to the preset grid reference band of grid reference bandwidth setup unit
Network bandwidth sections at different levels are arranged in width, and image cropping amount setup unit is true according to the section that network bandwidth section setup unit is arranged
Determine the corresponding image cropping amount in sections at different levels.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Within mind and principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of network bandwidth adaptive hierarchical transmission image method based on content erotic line clipping, which is characterized in that by base
It is combined together in the image line clipping and the network bandwidth of transmission image of content erotic, bandwidth is carried out by test network bandwidth
Section classification determines, different degrees of picture material sensitive line trimming operation is carried out for different grades of network bandwidth, realizes
Image is adaptively cut and is supported based on the classification of network bandwidth the network transmission of rapidly and efficiently high quality, step is such as
Under:
Step 1: transmitting terminal receives the image needed through network transmission, identifies the size of image, and convert image for image
Matrix；
Step 2: grid reference bandwidth is preset according to the averaging network bandwidth under current technical status, with reference to default grid reference
Bandwidth is classified network bandwidth, presets four networks bandwidth section, sets corresponding image for each network bandwidth section
Cutting amount；
Step 3: the network bandwidth in transmission process is obtained, according to network bandwidth sections at different levels preset in step 2 to acquisition
Network bandwidth be classified, determine current network belonging network bandwidth section；
Step 4: the current network determined according to the corresponding image cropping amount in network bandwidth at different levels in step 2 section and step 3
Affiliated broadband network section determines the image cropping amount of image to be transmitted；
Step 5: the image cropping amount obtained according to step 4, using the line clipping method based on content erotic to figure to be transmitted
As carrying out line clipping；
Step 6: being exported by current network bandwidth and transmits the image after line clipping.
2. the network bandwidth adaptive hierarchical transmission image method according to claim 1 based on content erotic line clipping,
It is characterized in that, the implementation method of the step 2 is:
S21: grid reference bandwidth default grid reference bandwidth: is preset according to the averaging network bandwidth under current technical status
BWBench；
S22: network bandwidth sections at different levels are preset: refers to default grid reference bandwidth BW Bench, is set using human assistance
Or the mode that sets automatically in proportion is as classification foundation, preset network bandwidth sections at different levels be respectively BR1 [B1, B2), BR2
[B2, B3), BR3 [B3, B4), BR4 [B4, B5), wherein B1 < B2 < B3 < B4 < B5；Network bandwidth interval B R1, BR2, BR3 at different levels
The two sides of grid reference bandwidth BW Bench are distributed in BR4；
S23: the corresponding image cropping amount in network bandwidth sections at different levels: the corresponding line clipping ratio in the lower section of network bandwidth is set
Example setting is higher, and the corresponding line clipping ratio setting in the higher section of network bandwidth is lower.
3. the network bandwidth adaptive hierarchical transmission image method according to claim 2 based on content erotic line clipping,
It is characterized in that, the line clipping ratio of described network bandwidth interval B R1, BR2, BR3 and BR4 are respectively set to 30%, 20%,
10% and 0%.
4. the network bandwidth adaptive hierarchical transmission image method according to claim 1 based on content erotic line clipping,
It is characterized in that, the method for obtaining the network bandwidth in transmission process in the step 3 is to pass through Linux command
Speedtest-cli come test network speed and obtain network bandwidth, according to network bandwidth at different levels in step S22 section facilities come
Judge which grade network bandwidth section obtained current network bandwidth is in.
5. the network bandwidth adaptive hierarchical transmission image method according to claim 1 based on content erotic line clipping,
It is characterized in that, the classification according to belonging to the current network obtained in step 3, compares in step S23 and network bandwidth areas at different levels is arranged
Between corresponding image cropping amount, determine the corresponding image cropping amount of current network bandwidth.
6. the network bandwidth adaptive hierarchical transmission image method according to claim 1 based on content erotic line clipping,
It is characterized in that, the step of line clipping method in the step 5 based on content erotic are as follows:
First, the energy of image is calculated by gradient function；
Second, the smallest cutting wires of energy, that is, optimal crop line is found in horizontal or vertical direction；
Third after finding optimal crop line, deletes the optimal crop line from image, and the image of generation is intermediate image；
4th, according to the corresponding line amount of the cutting proportion requirement in network bandwidth section, alternately and repeatedly held with vertical direction from horizontal direction
Row second step and third step, that is, for the operation of the content erotic line clipping of image or intermediate image, so that intermediate image exists
Both horizontally and vertically reach cutting proportion requirement, that is, obtains and be finally completed the result images after line clipping.
7. the network bandwidth adaptive hierarchical transmission image method according to claim 6 based on content erotic line clipping,
It is characterized in that, the gradient function is calculated by Sobel operator, and the image A for being n × m for size, the energy balane letter of image
Number are as follows:Wherein, e (I) indicates that the energy of image A, I indicate the image array of different size of image A；
The pixel energy of image is horizontally and vertically the sum of upper gradient absolute value；It is big that pixel is in edge energy value, as
Element is small in energy value at non-edge；
The vertical cutting wires of image A are as follows:
Wherein, SxIt indicates the vertical cutting wires deleted, is made of n row pixel,Indicate vertical cutting wires SxOn pixel
Point；X is a mapping x:[1 ..., n] → [1 ..., m], vertical cutting wires are the pixel paths of an eight connectivity,
From top to bottom every a line all represents a pixel；X (i), x (i-1) respectively indicate the i-th column and the corresponding row coordinate of the (i-1)-th column；
The horizontal cutting wires of image A are as follows:
Wherein, SyIt indicates the horizontal cutting wires deleted, is made of m column pixel；Indicate horizontal cutting wires SyOn pixel
Point；Wherein y is a mapping y:[1 ..., m] → [1 ..., n], each column all represent a pixel from left to right
Point, y (j), (j-1) respectively indicate jth row and the corresponding row coordinate of -1 row of jth.
8. the network bandwidth adaptive hierarchical transmission image method according to claim 7 based on content erotic line clipping,
It is characterized in that, the method for solving of the optimal crop line is:
By taking vertical direction as an example, the energy value of every cutting wires can be calculated by energy function are as follows:Wherein, E (s) indicates the energy value of cutting wires, by the energy of each pixel on the cutting wires
Value e (I (si)) be formed by stacking；Optimal vertical cutting wires are the smallest cutting wires s of energy in vertical direction*:Wherein, s*It indicates optimal crop line, is to take the smallest pixel group of energy in vertical direction
At the optimal crop line of image；
In vertical direction find optimal crop line when, since the second row of image line by line recursion to image last line,
For each pixel (i, j), a cumulative minimum energy value M (i, j) is calculated, it may be assumed that
M (i, j)=e (i, j)+min (M (i-1, j-1), M (i-1, j), M (i-1, j+1)),
Wherein, e (i, j) indicates the energy value of pixel (i, j)；M (i-1, j-1), M (i-1, j), M (i-1, j+1) are respectively indicated
The cumulative minimum energy value of each pixel of adjacent lastrow with pixel (i, j) takes at three's minimum value and pixel (i, j)
Energy value be added；
It is current optimal vertical cutting wires that cutting wires corresponding to minimum M are had in last line.
9. the network bandwidth adaptive hierarchical transmission image method according to claim 1 based on content erotic line clipping
Transmit picture system, which is characterized in that set mould including receiving image module, network bandwidth classification and corresponding cutting amount to be transmitted
Block, network bandwidth obtain and are classified determining module, image cropping amount determining module, image line clipping module and output and transmit figure
As module, network bandwidth classification and corresponding cutting amount setting module and network bandwidth are obtained and classification determining module is cut out with image
The amount of cutting determining module is connected, image cropping amount determining module and receive image module to be transmitted with image line clipping module phase
Connection, image line clipping module and output simultaneously transmit image module and are connected；Receive image module to be transmitted for receive needs
By the image of network transmission, network bandwidth classification and corresponding cutting amount setting module are according to the average net under current technical status
Network bandwidth presets grid reference bandwidth, as classification foundation in such a way that human assistance is set or is set automatically in proportion, in advance
If bandwidth sections at different levels, corresponding image cropping amount is classified and is respectively set to network bandwidth, and network bandwidth obtains and divides
Grade determining module is used to obtain the current actual bandwidth of transmission network and determines belonging network bandwidth section, and image cropping amount is true
Cover half root tuber compares the classification and sanction of network bandwidth classification and corresponding cutting amount setting module according to the affiliated bandwidth section of current network
Standard is cut, determines that corresponding image cropping amount, image line clipping module carry out content to image according to determining image cropping amount
Sensitive line clipping exports and transmits image module for exporting and transmitting the image of the adaptive bandwidth requirement after cutting.
10. the network bandwidth adaptive hierarchical transmission picture system according to claim 9 based on content erotic line clipping,
It is characterized in that, the network bandwidth classification and corresponding cutting amount setting module include grid reference bandwidth setup unit, network
Bandwidth section setup unit and image cropping amount setup unit, grid reference bandwidth setup unit and the setting of network bandwidth section are single
Member is connected, and network bandwidth section setup unit is connected with image cropping amount setup unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079070.3A CN109874013B (en) | 2019-01-28 | 2019-01-28 | Adaptive network bandwidth hierarchical image transmission method based on content sensitive line cutting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079070.3A CN109874013B (en) | 2019-01-28 | 2019-01-28 | Adaptive network bandwidth hierarchical image transmission method based on content sensitive line cutting |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109874013A true CN109874013A (en) | 2019-06-11 |
| CN109874013B CN109874013B (en) | 2023-02-03 |
Family
ID=66918145
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910079070.3A Active CN109874013B (en) | 2019-01-28 | 2019-01-28 | Adaptive network bandwidth hierarchical image transmission method based on content sensitive line cutting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109874013B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004194187A (en) * | 2002-12-13 | 2004-07-08 | Canon Inc | Image transmission device, image receiver, and image-transmitting/receiving system |
| CN1845596A (en) * | 2005-04-06 | 2006-10-11 | 上海迪比特实业有限公司 | Video transmission system and its method for self-adaptive adjusting video image |
| US7215345B1 (en) * | 1999-04-09 | 2007-05-08 | Sun Microsystems, Inc. | Method and apparatus for clipping video information before scaling |
| US20120281926A1 (en) * | 2011-05-06 | 2012-11-08 | Altek Corporation | Image file processing method |
-
2019
- 2019-01-28 CN CN201910079070.3A patent/CN109874013B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7215345B1 (en) * | 1999-04-09 | 2007-05-08 | Sun Microsystems, Inc. | Method and apparatus for clipping video information before scaling |
| JP2004194187A (en) * | 2002-12-13 | 2004-07-08 | Canon Inc | Image transmission device, image receiver, and image-transmitting/receiving system |
| CN1845596A (en) * | 2005-04-06 | 2006-10-11 | 上海迪比特实业有限公司 | Video transmission system and its method for self-adaptive adjusting video image |
| US20120281926A1 (en) * | 2011-05-06 | 2012-11-08 | Altek Corporation | Image file processing method |
Non-Patent Citations (3)
| Title |
|---|
| SHAI AVIDAN等: "Seam carving for content-aware image resizing", 《ACM TRANSACTIONS ON GRAPHICS》 * |
| 匿名: "视频带宽控制与视频压缩技术", 《中国安防产品信息》 * |
| 朱瑜坚等: "一种面向多租户的Linux容器集群组网方法", 《计算机科学》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109874013B (en) | 2023-02-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE69815689T2 (en) | TRANSMISSION METHOD AND DEVICE FOR ADAPTIVE SIGNAL PROCESSING BASED ON MOBILITY PROPERTIES | |
| DE69921955T2 (en) | Receive diversity arrangement and method | |
| DE60203766T2 (en) | An apparatus and method for error correction for transport format indicators (TFI) in a W-CDMA communication system | |
| CN1290057C (en) | Improved spatial resolution of video images | |
| DE69735437T2 (en) | IMAGE CODERS AND IMAGE DECODERS | |
| CN103369349B (en) | A kind of digital video-frequency quality control method and device thereof | |
| DE69735624T2 (en) | Method and device for further execution in a spread spectrum communication method | |
| CN106060564B (en) | Inter-frame predicated reference pixel point filtering control method, device and encoder | |
| CN104159119A (en) | Super-resolution reconstruction method and system for video images during real-time sharing playing | |
| DE69731609T2 (en) | BASIC STATION RECEIVER AND METHOD OF SIGNAL RECEPTION | |
| CN106056638B (en) | A kind of low complexity compression perceptual image coding method of adaptive texture contrast | |
| CN102843572A (en) | Phase-based stereo image quality objective evaluation method | |
| CN110288535A (en) | A kind of image rain removing method and device | |
| CN102903107A (en) | Three-dimensional picture quality objective evaluation method based on feature fusion | |
| CN109874013A (en) | Network bandwidth adaptive hierarchical transmission image method based on content erotic line clipping | |
| DE60120158T2 (en) | DETECTOR FOR HARMFUL ERRORS AND CONTROLS USING CHANNEL QUALITY AND ITERATIVE SYNTHESIS | |
| CN102999911B (en) | Three-dimensional image quality objective evaluation method based on energy diagrams | |
| DE69825274T2 (en) | BIT DETECTION METHOD IN A RADIO COMMUNICATION SYSTEM | |
| DE602004009092T2 (en) | INDICATOR FOR INCORRECT FRAME IN A GSM MOBILE SYSTEM | |
| DE60316202T2 (en) | METHOD, SYSTEM AND RECEIVER FOR RECEIVING A MULTI-TRANSFER TRANSMISSION | |
| CN110620874B (en) | Image processing method for parallel driving | |
| DE60304520T2 (en) | Coding / decoding apparatus and method | |
| CN108573509A (en) | Self-adapting compressing perceptual image coding method based on the notable detection model of measurement field | |
| EP1166448B1 (en) | Method for coding channels | |
| Sinha et al. | Performance analysis of high resolution images using interpolation techniques in multimedia communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |