CN115103234A - Image remote transmission method based on RTP - Google Patents
Image remote transmission method based on RTP Download PDFInfo
- Publication number
- CN115103234A CN115103234A CN202210652515.4A CN202210652515A CN115103234A CN 115103234 A CN115103234 A CN 115103234A CN 202210652515 A CN202210652515 A CN 202210652515A CN 115103234 A CN115103234 A CN 115103234A
- Authority
- CN
- China
- Prior art keywords
- image data
- image
- transmission
- terminal
- source terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 301
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000003993 interaction Effects 0.000 claims abstract description 17
- 230000008569 process Effects 0.000 claims description 13
- 238000011084 recovery Methods 0.000 claims description 10
- 238000012544 monitoring process Methods 0.000 claims description 9
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 238000009825 accumulation Methods 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000009467 reduction Effects 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 9
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides an image remote transmission method based on RTP, which analyzes an image transmission request from a transmission source terminal and determines a terminal address of a target terminal corresponding to the image transmission of the transmission source terminal; acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal so as to control whether a sending source terminal is allowed to send the image data to the target terminal; when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is instructed to convert the image data to be sent into a plurality of image data packets matched with a real-time transmission protocol and form an image data transmission queue; then indicating the target terminal to restore the received image data transmission queue; the transmission method converts the image data to be transmitted into the plurality of image data packets matched with the real-time transmission protocol, so that the block transmission of the image data to be transmitted can be realized, and the situations that the image data to be transmitted is tampered and data packet loss occurs are avoided.
Description
Technical Field
The invention relates to the technical field of image data transmission, in particular to an image remote transmission method based on RTP.
Background
The image data generally has a large data volume, and if the image data is directly transmitted between different terminals without any transformation, the transmission rate of the image data is easily reduced, and the image data is easily tampered and lost in the transmission process. In order to ensure the compatibility of image data transmission between different terminals, the existing terminals implement real-time transmission of image data between different terminals based on a real-time transport protocol RTP, but the above-mentioned image data transmission method cannot effectively implement fast, safe and complete transmission of image data, and reduces the reliability and stability of image data transmission.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides an image remote transmission method based on RTP, which analyzes an image transmission request from a transmission source terminal and determines the terminal address of a target terminal corresponding to the image transmission of the transmission source terminal; acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal so as to control whether a sending source terminal is allowed to send the image data to the target terminal; when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is instructed to convert the image data to be sent into a plurality of image data packets matched with a real-time transmission protocol and form an image data transmission queue; after the image data transmission queue is transmitted to the target terminal, indicating the target terminal to restore the received image data transmission queue; according to the transmission method, the image data to be transmitted is converted into the plurality of image data packets matched with the real-time transmission protocol, so that the block transmission of the image data to be transmitted can be realized, the transmission efficiency of the image data to be transmitted is ensured, the human situations that the image data to be transmitted is falsified and data packet is lost are avoided, and the safety, reliability and stability of image data transmission are improved.
The invention provides an image remote transmission method based on RTP, which comprises the following steps:
step S1, obtaining the image sending request from the sending source terminal, analyzing the image sending request, and determining the terminal address of the destination terminal corresponding to the image sending of the sending source terminal;
step S2, acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal; then controlling whether the sending source terminal is allowed to send the image data to the target terminal or not according to the image data interaction state;
step S3, when the sending source terminal is allowed to send image data to the target terminal, the sending source terminal is instructed to convert the image data to be sent into a plurality of image data packets matched with the real-time transmission protocol; forming an image data transmission queue by the plurality of image data packets;
step S4, monitoring the transmission progress of the image data transmission queue to the target terminal, so as to instruct the target terminal to restore the received image data transmission queue after the image data transmission queue completes transmission.
Further, before the step S1, the method further includes:
according to the terminal address of the sending source terminal, carrying out authentication processing on the sending source terminal, and determining whether the sending source terminal has the image data sending authority;
if the sending source terminal does not have the image data sending authority, the sending source terminal is immediately prohibited from sending an image sending request to the outside;
if the sending source terminal has the image data sending authority, then acquiring the image data sending history of the sending source terminal; determining the number of times of interruption of image data transmission in the process of transmitting historical image data by a transmission source terminal according to the image data transmission history record;
if the image data transmission interruption times are smaller than a preset time threshold, allowing the transmission source terminal to send an image transmission request outwards; otherwise, the transmission source terminal is prohibited from transmitting the image transmission request to the outside.
Further, in step S1, the acquiring an image transmission request from a transmission source terminal, analyzing the image transmission request, and determining a terminal address of a destination terminal corresponding to the transmission source terminal performing image transmission specifically includes:
extracting a request-to-send destination IP address contained in an image transmission request from a transmission source terminal;
and sending the destination IP address according to the request, thereby positioning a matched target terminal in the target terminal cluster network, and taking the destination IP address sent by the request as the terminal address of the target terminal determined by the positioning.
Further, in step S2, the acquiring, according to the terminal address of the target terminal, the current image data interaction state of the target terminal specifically includes:
and acquiring the size of the image data transmitted in the image data transmission channel currently accessed by the target terminal and the image data transmission rate according to the terminal address of the target terminal.
Further, in step S2, the controlling whether to allow the transmission source terminal to transmit the image data to the destination terminal according to the image data interaction state specifically includes:
estimating the time length required by the target terminal to finish receiving the currently transmitted image data according to the size of the transmitted image data in the image data transmission channel currently accessed by the target terminal and the image data transmission rate;
if the time length exceeds a preset time length threshold, the sending source terminal is not allowed to send the image data to the target terminal; otherwise, the transmission source terminal is allowed to transmit the image data to the destination terminal.
Further, in the step S3, when the transmission source terminal is allowed to transmit the image data to the destination terminal, the transmission source terminal is instructed to convert the image data to be transmitted into a plurality of image data packets matching the real-time transport protocol; and the image data transmission queue formed by a plurality of image data packets specifically comprises:
when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is indicated to convert each image frame contained in the image data to be sent into a conversion image frame matched with a real-time transmission protocol;
sequentially packaging all the converted image frames within a preset time range to form an image data packet according to the image display time sequence of image data to be transmitted;
and then according to the sequence of the data volume of each image data packet from small to large, all the image data packets form an image transmission queue.
Further, in step S3, sequentially packaging all the transformed image frames within a preset time range according to an image display time sequence of the image data to be transmitted to form an image data packet, and converting the image display time sequence of the image data to be transmitted into numerical data to be dispersedly arranged on each line and each column of the image frames to form the image data packet; then, in step S4, the target terminal is instructed to decode all image data packets contained in the received image data transmission queue, and extract an image display timing sequence of each decoded image data to complete the stitching process, thereby completing the restoration and recovery of the image data transmission queue, where the process is as follows:
step S301, using the following formula (1), converting the image display time sequence of the image data to be transmitted into numerical data to be dispersedly arranged on each row and each column of the image frame to form an image data packet,
in the above formula (1), D a (i, m +1) represents a numerical value added to the (i) th row and (m +1) th column position on the a-th frame image; d a (n +1, j) represents a numerical value added to the jth column position of the (n +1) th row on the a-th frame image; d a (n +1, m +1) represents a numerical value added to the (n +1) th row and (m +1) th column position on the a-th frame image; m represents the number value of each row of pixel points of the a frame image; n represents the numerical value of each row of pixel points of the a-th frame image, and the a-th frame image data satisfies n ≧ 2 and m ≧ 2; t is a (1,1) indicating a display time of a first pixel point in an image display timing of the a-th frame image data; t is a unit of a (n, m) represents the display time of the last pixel point in the image display timing sequence of the a-th frame of image data; means integer data quoting, i.e. according to divisionAfter the division by the method, only the quotient is taken and the remainder is not taken;
converting the image display time sequence of the image data to be transmitted into numerical data according to the formula (1), dispersedly arranging the numerical data on each row and each column of an image frame to form image data packets, forming an image transmission queue by all the image data packets according to the sequence of the data volume of each image data packet from small to large, and transmitting the image data packets to the target terminal;
step S302, using the following formula (2), decoding all image data packets contained in the received image data transmission queue, and extracting the image display time sequence,
in the above formula (2), F b (x, y) represents the pixel value of the pixel point of the x row and the y column in the image data obtained by decoding the b-th data in the received image data transmission queue; d b (x, y) represents a value at the x row and y column position in the b data in the received image data transmission queue; m represents the number of elements of each row in the b-th data in the received image data transmission queue; n represents the number of elements in each column in the b-th data in the received image data transmission queue; d b (x, M) represents a value at an xth row and mth column position in the b-th data in the received image data transmission queue; d is a radical of b (N, y) represents a value at the nth row and the yth column position in the b-th data in the received image data transmission queue; t is t 0 (b) The image display time sequence initial time of the image data obtained by decoding the b-th data in the received image data transmission queue is represented; t is t e (b) Representing the end time of the image display time sequence of the image data obtained by decoding the b-th data in the received image data transmission queue;
step S303, using the following formula (3), according to the image display timing extracted in step S302, performing a stitching process on each decoded image data, thereby completing the restoration and restoration of the image data transmission queue,
in the above formula (3), e (b) represents a reduction value of the image data obtained by decoding the b-th data in the received image data transmission queue; k represents an integer variable; g represents the total number of data in the image data transmission queue;
expressing a judgment accumulation function, and obtaining the number of k values when an arithmetic expression in brackets is established by taking the value of k from 1 to G;
and (c) sorting the image data corresponding to the E (b) according to the sequence from small to large, and displaying the image data according to the display time sequence initial time and the display time sequence end time of each image data obtained in the step (S302) after the sorting is finished, so as to finish the restoration and recovery of the image data transmission queue.
Further, in the step S4, the monitoring the transmission progress of the image data transmission queue to the target terminal specifically includes:
monitoring the transmission completion percentage of all image data packets contained in the image data transmission queue to a target terminal; and when the transmission of all the image data packets to the target terminal is completed by one hundred percent, interrupting an image data transmission channel between the sending source terminal and the target terminal.
Further, in step S4, after the image data transmission queue completes transmission, the instructing the target terminal to restore the received image data transmission queue specifically includes:
and after the image data transmission queue finishes transmission, indicating the target terminal to decode and splice all image data packets contained in the received image data transmission queue, thereby finishing restoration and recovery of the image data transmission queue.
Compared with the prior art, the image remote transmission method based on the RTP analyzes the image transmission request from the transmission source terminal, and determines the terminal address of the target terminal corresponding to the image transmission of the transmission source terminal; acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal so as to control whether a sending source terminal is allowed to send the image data to the target terminal; when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is indicated to convert the image data to be sent into a plurality of image data packets matched with a real-time transmission protocol and form an image data transmission queue; after the image data transmission queue is transmitted to the target terminal, indicating the target terminal to restore the received image data transmission queue; according to the transmission method, the image data to be transmitted is converted into the plurality of image data packets matched with the real-time transmission protocol, so that the block transmission of the image data to be transmitted can be realized, the transmission efficiency of the image data to be transmitted is ensured, the human situations that the image data to be transmitted is falsified and data packet is lost are avoided, and the safety, reliability and stability of image data transmission are improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flow chart of an RTP-based image remote transmission method provided in the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart of an RTP-based image remote transmission method according to an embodiment of the present invention. The RTP-based image remote transmission method comprises the following steps:
step S1, obtaining the image transmission request from the transmission source terminal, analyzing the image transmission request, and determining the terminal address of the destination terminal corresponding to the image transmission performed by the transmission source terminal;
step S2, acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal; then according to the image data interaction state, controlling whether the sending source terminal is allowed to send the image data to the target terminal;
step S3, when the sending source terminal is allowed to send image data to the target terminal, the sending source terminal is instructed to convert the image data to be sent into a plurality of image data packets matched with the real-time transmission protocol; forming an image data transmission queue by the plurality of image data packets;
step S4, monitoring the transmission progress of the image data transmission queue to the target terminal, so as to instruct the target terminal to restore the received image data transmission queue after the image data transmission queue completes transmission.
The beneficial effects of the above technical scheme are: the RTP-based image remote transmission method analyzes an image transmission request from a transmission source terminal and determines a terminal address of a target terminal corresponding to the image transmission of the transmission source terminal; acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal so as to control whether a sending source terminal is allowed to send the image data to the target terminal; when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is indicated to convert the image data to be sent into a plurality of image data packets matched with a real-time transmission protocol and form an image data transmission queue; after the image data transmission queue is transmitted to the target terminal, indicating the target terminal to restore the received image data transmission queue; according to the transmission method, the image data to be transmitted is converted into the plurality of image data packets matched with the real-time transmission protocol, so that the block transmission of the image data to be transmitted can be realized, the transmission efficiency of the image data to be transmitted is ensured, the human situations that the image data to be transmitted is falsified and data packet is lost are avoided, and the safety, reliability and stability of image data transmission are improved.
Preferably, before this step S1, the method further includes:
according to the terminal address of the sending source terminal, performing authentication processing on the sending source terminal to determine whether the sending source terminal has the image data sending authority;
if the sending source terminal does not have the image data sending authority, the sending source terminal is immediately prohibited from sending an image sending request to the outside;
if the sending source terminal has the image data sending authority, then acquiring the image data sending history of the sending source terminal; determining the number of times of interruption of image data transmission in the process of transmitting the history image data by the transmission source terminal according to the image data transmission history record;
if the image data transmission interruption times are smaller than a preset time threshold, allowing the transmission source terminal to send an image transmission request outwards; otherwise, the transmission source terminal is prohibited from transmitting the image transmission request to the outside.
The beneficial effects of the above technical scheme are: by means of the method, the identity of the sending source terminal and the image data sending history are authenticated, so that the sending source terminal without the image data sending authority and the sending source terminal with more image data history sending interruption times are forbidden to send the image data, and the situations of potential safety hazards of data transmission and unstable data transmission in the subsequent image data sending process are avoided.
Preferably, in step S1, the acquiring an image transmission request from a transmission source terminal, analyzing the image transmission request, and determining a terminal address of a destination terminal corresponding to the transmission source terminal performing image transmission specifically includes:
extracting a request transmission destination IP address contained in an image transmission request from a transmission source terminal;
and sending the destination IP address according to the request, thereby positioning a matched target terminal in the target terminal cluster network, and taking the destination IP address sent by the request as the terminal address of the target terminal determined by the positioning.
The beneficial effects of the above technical scheme are: by the method, the correct target terminal can be accurately screened from the target terminal cluster network, and the situation of image data error transmission is avoided.
Preferably, in step S2, the acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal specifically includes:
and acquiring the size of the image data transmitted in the image data transmission channel currently accessed by the target terminal and the image data transmission rate according to the terminal address of the target terminal.
The beneficial effects of the above technical scheme are: according to the terminal address of the target terminal, the image data transmission channel which is accessed by the target terminal at present can be accurately calibrated, and the transmission data state in the image data transmission channel is periodically sampled, so that the size of the image data transmitted by the target terminal and the transmission rate of the image data are determined.
Preferably, in step S2, the controlling whether to allow the transmission source terminal to transmit the image data to the destination terminal according to the image data interaction state specifically includes:
estimating the time length required by the target terminal to finish receiving the currently transmitted image data according to the size of the transmitted image data in the image data transmission channel currently accessed by the target terminal and the image data transmission rate;
if the time length exceeds a preset time length threshold, the sending source terminal is not allowed to send the image data to the target terminal; otherwise, the transmission source terminal is allowed to transmit the image data to the destination terminal.
The beneficial effects of the above technical scheme are: and estimating and obtaining the length of time required by the target terminal to finish receiving the currently transmitted image data according to the ratio of the size of the image data transmitted in the image data transmission channel currently accessed by the target terminal to the image data transmission rate. If the time length exceeds the preset time length threshold, the target terminal cannot receive the image data of the sending source terminal in time at present, and the sending source terminal is not allowed to send the image data to the target terminal at the moment, so that the situation that the sending source terminal waits for sending the image data for too long time is avoided.
Preferably, in this step S3, when the transmission source terminal is allowed to transmit image data to the destination terminal, the transmission source terminal is instructed to convert the image data to be transmitted into a number of image data packets matching the real-time transport protocol; the step of forming an image data transmission queue by the plurality of image data packets specifically comprises:
when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is indicated to convert each image frame contained in the image data to be sent into a conversion image frame matched with a real-time transmission protocol;
sequentially packaging all the converted image frames within a preset time range to form an image data packet according to the image display time sequence of image data to be transmitted;
and then according to the sequence of the data volume of each image data packet from small to large, all the image data packets form an image transmission queue.
The beneficial effects of the above technical scheme are: by the mode, the image data to be sent is transmitted in the block mode, so that the condition that the data to be sent is integrally transmitted to the target terminal to cause data transmission congestion can be avoided, meanwhile, each image data packet obtained in the block mode can be safely transmitted, and the image data packet is prevented from being sent and lost in the transmission process.
Preferably, in step S3, sequentially packaging all the transformed image frames within a preset time range according to the image display time sequence of the image data to be transmitted to form an image data packet, converting the image display time sequence of the image data to be transmitted into numerical data, and dispersedly arranging the numerical data on each row and each column of the image frames to form the image data packet; in step S4, the target terminal is instructed to decode all image data packets contained in the received image data transmission queue, and extract an image display timing sequence of each decoded image data to complete the stitching process, thereby completing the restoration and recovery of the image data transmission queue, which includes the following steps:
step S301, using the following formula (1), converting the image display time sequence of the image data to be transmitted into numerical data to be dispersedly arranged on each row and each column of the image frame to form an image data packet,
in the above formula (1), D a (i, m +1) represents a value added to the (i) th row/m +1 th column position on the a-th frame image; d a (n +1, j) represents a value added to the jth column position of the (n +1) th row on the a-th frame image; d a (n +1, m +1) represents a numerical value added to the (n +1) th row and (m +1) th column position on the a-th frame image; m represents the numerical value of each line of pixel points of the a-th frame image; n represents the number value of each column of pixel points of the a-th frame image, and the a-th frame image data satisfies n ≧ 2 and m ≧ 2; t is a (1,1) indicating the display time of the first pixel point in the image display time sequence of the a-th frame of image data; t is a unit of a (n, m) represents the display time of the last pixel point in the image display time sequence of the a-th frame of image data; the integer data is divided by division, and only the quotient is taken without the remainder;
converting the image display time sequence of the image data to be transmitted into numerical data according to the formula (1), dispersedly arranging the numerical data on each row and each column of an image frame to form an image data packet, forming an image transmission queue by all the image data packets according to the sequence of the data volume of each image data packet from small to large, and transmitting the image data packets to the target terminal;
step S302, using the following formula (2), decoding all image data packets contained in the received image data transmission queue, and extracting the image display time sequence,
in the above formula (2), F b (x, y) represents the pixel value of the pixel point of the x row and the y column in the image data obtained by decoding the b-th data in the received image data transmission queue; d b (x, y) represents a value at the x row and y column position in the b data in the received image data transmission queue; m represents the number of elements of each row in the b-th data in the received image data transmission queue; n represents the number of elements in each column in the b-th data in the received image data transmission queue; d b (x, M) represents a value at an xth row and mth column position in the b-th data in the received image data transmission queue; d b (N, y) represents a value at the nth row and the yth column position in the b-th data in the received image data transmission queue; t is t 0 (b) Representing the initial time of image display time sequence of image data obtained by decoding the b-th data in the received image data transmission queue; t is t e (b) Representing the end time of the image display time sequence of the image data obtained by decoding the b-th data in the received image data transmission queue;
step S303, using the following formula (3), according to the image display timing extracted in step S302, performing a stitching process on each decoded image data, thereby completing the restoration and restoration of the image data transmission queue,
in the above formula (3), e (b) represents a reduction value of the image data obtained by decoding the b-th data in the received image data transmission queue; k represents an integer variable; g represents the total number of data in the image data transmission queue;
representing a judgment accumulation function, and obtaining the number of k values when an arithmetic expression in brackets is established by taking the value of k from 1 to G;
and (c) sorting the image data corresponding to the E (b) according to the sequence from small to large, and displaying the image data according to the display time sequence initial time and the display time sequence end time of each image data obtained in the step (S302) after the sorting is finished, so as to finish the restoration and recovery of the image data transmission queue.
The beneficial effects of the above technical scheme are: the image display time sequence of the image data to be sent is converted into numerical data by the formula (1) and the numerical data is dispersedly arranged on each row and each column of the image frame to form an image data packet, wherein the display time sequence is dispersedly arranged to play a role of data encryption transmission to ensure the transmission safety, and the display time sequence is dispersedly arranged on each row and each column of the image frame to ensure that the data still keeps the form of matrix data, so that the subsequent calculation analysis and control are facilitated, and the time for analyzing the data and analyzing the data is saved; then, decoding all image data packets contained in the received image data transmission queue by using the formula (2), and extracting an image display time sequence, so that the decoding of the data and the extraction of the image display time sequence are completed by using the formula (2), the image analysis process is completely automated and intelligentized, the analysis time is saved, and the working efficiency is improved; and finally, splicing each decoded image data according to the extracted image display time sequence by using the formula (3), and then accurately completing restoration and recovery of the image data transmission queue by using the formula, and displaying according to the image display time sequence to obtain a corresponding video, so that the reliability and the accuracy of the system are reflected.
Preferably, in step S4, the monitoring the progress of transmission of the image data transmission queue to the target terminal specifically includes:
monitoring the transmission completion percentage of all image data packets contained in the image data transmission queue to a target terminal; and when the transmission of all the image data packets to the target terminal is completed by one hundred percent, interrupting an image data transmission channel between the sending source terminal and the target terminal.
The beneficial effects of the above technical scheme are: and when the transmission of all the image data packets to the target terminal is completed by one hundred percent, interrupting an image data transmission channel between the sending source terminal and the target terminal, thereby preventing the sending source terminal from subsequently sending the image data to the target terminal without authentication and improving the data security of the terminal.
Preferably, in step S4, after the image data transmission queue completes transmission, the instructing the target terminal to restore the received image data transmission queue specifically includes:
and after the image data transmission queue finishes transmission, indicating the target terminal to decode and splice all image data packets contained in the received image data transmission queue, thereby finishing restoration and recovery of the image data transmission queue.
The beneficial effects of the above technical scheme are: by the method, the target terminal is used for decoding and splicing all image data packets contained in the received image data transmission queue, and the content integrity and authenticity of the image data can be ensured.
As can be seen from the contents of the above embodiments, the RTP-based image remote transmission method analyzes an image transmission request from a transmission source terminal, and determines a terminal address of a destination terminal corresponding to the transmission source terminal performing image transmission; acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal so as to control whether a sending source terminal is allowed to send the image data to the target terminal; when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is instructed to convert the image data to be sent into a plurality of image data packets matched with a real-time transmission protocol and form an image data transmission queue; after the image data transmission queue is transmitted to the target terminal, indicating the target terminal to restore the received image data transmission queue; according to the transmission method, the image data to be transmitted is converted into the plurality of image data packets matched with the real-time transmission protocol, so that the block transmission of the image data to be transmitted can be realized, the transmission efficiency of the image data to be transmitted is ensured, the human situations that the image data to be transmitted is falsified and data packet is lost are avoided, and the safety, reliability and stability of image data transmission are improved.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (9)
1. The image remote transmission method based on RTP is characterized by comprising the following steps:
step S1, obtaining the image sending request from the sending source terminal, analyzing the image sending request, and determining the terminal address of the destination terminal corresponding to the image sending of the sending source terminal;
step S2, acquiring the current image data interaction state of the target terminal according to the terminal address of the target terminal; then controlling whether the sending source terminal is allowed to send the image data to the target terminal or not according to the image data interaction state;
step S3, when the sending source terminal is allowed to send image data to the target terminal, the sending source terminal is instructed to convert the image data to be sent into a plurality of image data packets matched with the real-time transmission protocol; forming an image data transmission queue by the plurality of image data packets;
step S4, monitoring the transmission progress of the image data transmission queue to the target terminal, so as to instruct the target terminal to restore the received image data transmission queue after the image data transmission queue completes transmission.
2. The RTP-based image remote transmission method according to claim 1, wherein:
before the step S1, the method further includes:
according to the terminal address of the sending source terminal, performing authentication processing on the sending source terminal to determine whether the sending source terminal has the image data sending authority;
if the sending source terminal does not have the image data sending authority, the sending source terminal is immediately prohibited from sending an image sending request to the outside;
if the sending source terminal has the image data sending authority, then acquiring the image data sending history of the sending source terminal; determining the number of times of interruption of image data transmission in the process of transmitting historical image data by a transmission source terminal according to the image data transmission history record;
if the image data transmission interruption times are smaller than a preset time threshold, allowing the transmission source terminal to send an image transmission request outwards; otherwise, the transmission source terminal is prohibited from transmitting the image transmission request to the outside.
3. The RTP-based image remote transmission method according to claim 2, wherein:
in step S1, the acquiring an image transmission request from a transmission source terminal, analyzing the image transmission request, and determining a terminal address of a destination terminal corresponding to the transmission source terminal performing image transmission specifically includes:
extracting a request-to-send destination IP address contained in an image transmission request from a transmission source terminal;
and sending the destination IP address according to the request, thereby positioning a matched target terminal in the target terminal cluster network, and taking the destination IP address sent by the request as the terminal address of the target terminal determined by the positioning.
4. The RTP-based image remote transmission method according to claim 1, wherein:
in step S2, the acquiring, according to the terminal address of the target terminal, the current image data interaction state of the target terminal specifically includes:
and acquiring the size of the image data transmitted in the image data transmission channel currently accessed by the target terminal and the image data transmission rate according to the terminal address of the target terminal.
5. The RTP-based image remote transmission method according to claim 1, wherein:
in step S2, the controlling whether to allow the transmission source terminal to transmit the image data to the destination terminal according to the image data interaction state specifically includes:
estimating the time length required by the target terminal to finish receiving the currently transmitted image data according to the size of the image data transmitted in the image data transmission channel currently accessed by the target terminal and the image data transmission rate;
if the time length exceeds a preset time length threshold, the sending source terminal is not allowed to send the image data to the target terminal; otherwise, the transmission source terminal is allowed to transmit the image data to the destination terminal.
6. The RTP-based image remote transmission method according to claim 1, wherein:
in step S3, when the transmission source terminal is allowed to transmit image data to the destination terminal, instructing the transmission source terminal to convert the image data to be transmitted into a plurality of image data packets matching the real-time transport protocol; the step of forming an image data transmission queue by the plurality of image data packets specifically comprises:
when the sending source terminal is allowed to send the image data to the target terminal, the sending source terminal is indicated to convert each image frame contained in the image data to be sent into a conversion image frame matched with a real-time transmission protocol;
sequentially packaging all the converted image frames within a preset time range to form an image data packet according to the image display time sequence of image data to be transmitted;
and then according to the sequence of the data volume of each image data packet from small to large, all the image data packets form an image transmission queue.
7. The RTP-based image remote transmission method according to claim 6, wherein:
in step S3, sequentially packaging all the transformed image frames within a preset time range according to the image display time sequence of the image data to be transmitted to form an image data packet, and converting the image display time sequence of the image data to be transmitted into numerical data to be dispersedly arranged on each line and each column of the image frames to form the image data packet; then, in step S4, the target terminal is instructed to decode all image data packets contained in the received image data transmission queue, and extract an image display timing sequence of each decoded image data to complete the stitching process, thereby completing the restoration and recovery of the image data transmission queue, where the process is as follows:
step S301, using the following formula (1), converting the image display time sequence of the image data to be transmitted into numerical data to be dispersedly arranged on each row and each column of the image frame to form an image data packet,
in the above formula (1), D a (i, m +1) represents a numerical value added to the (i) th row/m +1 th column position on the a-th frame image; d a (n +1, j) represents a numerical value added to the jth column position of the (n +1) th row on the a-th frame image; d a (n +1, m +1) represents a numerical value added to the (n +1) th row and (m +1) th column position on the a-th frame image; m represents the numerical value of each line of pixel points of the a-th frame image; n represents the numerical value of each row of pixel points of the a-th frame image, and the a-th frame image data satisfies n ≧ 2 and m ≧ 2; t is a (1,1) indicating a display time of a first pixel point in an image display timing of the a-th frame image data; t is a (n, m) represents the display time of the last pixel point in the image display time sequence of the a-th frame image dataSpacing; the integer data is divided by division, and only the quotient is taken without the remainder;
converting the image display time sequence of the image data to be transmitted into numerical data according to the formula (1), dispersedly arranging the numerical data on each row and each column of an image frame to form an image data packet, forming an image transmission queue by all the image data packets according to the sequence of the data volume of each image data packet from small to large, and transmitting the image data packets to the target terminal;
step S302, using the following formula (2), decoding all image data packets contained in the received image data transmission queue, and extracting the image display time sequence,
in the above formula (2), F b (x, y) represents the pixel value of the pixel point of the x row and the y column in the image data obtained by decoding the b-th data in the received image data transmission queue; d is a radical of b (x, y) represents a value at the x row and y column position in the b data in the received image data transmission queue; m represents the number of elements of each row in the b-th data in the received image data transmission queue; n represents the number of elements in each column in the b-th data in the received image data transmission queue; d b (x, M) represents a value at an xth row and mth column position in the b-th data in the received image data transmission queue; d b (N, y) represents a value at the nth row and the yth column position in the b-th data in the received image data transmission queue; t is t 0 (b) The image display time sequence initial time of the image data obtained by decoding the b-th data in the received image data transmission queue is represented; t is t e (b) Representing the end time of the image display time sequence of the image data obtained by decoding the b-th data in the received image data transmission queue;
step S303, using the following formula (3), according to the image display timing extracted in step S302, performing a stitching process on each decoded image data, thereby completing the restoration and restoration of the image data transmission queue,
in the above formula (3), e (b) represents a reduction value of the image data obtained by decoding the b-th data in the received image data transmission queue; k represents an integer variable; g represents the total number of data in the image data transmission queue;
representing a judgment accumulation function, and obtaining the number of k values when an arithmetic expression in brackets is established by taking the value of k from 1 to G;
and (c) sorting the image data corresponding to the E (b) according to the sequence from small to large, and displaying the image data according to the display time sequence initial time and the display time sequence end time of each image data obtained in the step (S302) after the sorting is finished, so as to finish the restoration and recovery of the image data transmission queue.
8. The RTP-based image remote transmission method according to claim 1, wherein:
in step S4, the monitoring the transmission progress of the image data transmission queue to the target terminal specifically includes:
monitoring the transmission completion percentage of all image data packets contained in the image data transmission queue to a target terminal; and when the transmission of all the image data packets to the target terminal is completed by one hundred percent, interrupting an image data transmission channel between the sending source terminal and the target terminal.
9. The RTP-based image remote transmission method according to claim 8, wherein:
in step S4, after the image data transmission queue completes transmission, the instructing the target terminal to restore the received image data transmission queue specifically includes:
and after the image data transmission queue finishes transmission, indicating the target terminal to decode and splice all image data packets contained in the received image data transmission queue, thereby finishing restoration and recovery of the image data transmission queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210652515.4A CN115103234B (en) | 2022-06-07 | 2022-06-07 | Image remote transmission method based on RTP |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210652515.4A CN115103234B (en) | 2022-06-07 | 2022-06-07 | Image remote transmission method based on RTP |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115103234A true CN115103234A (en) | 2022-09-23 |
| CN115103234B CN115103234B (en) | 2023-03-24 |
Family
ID=83291764
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210652515.4A Active CN115103234B (en) | 2022-06-07 | 2022-06-07 | Image remote transmission method based on RTP |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115103234B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116302508A (en) * | 2023-02-27 | 2023-06-23 | 中国科学院空间应用工程与技术中心 | High-speed distributed image synthesis method and system for space application |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130163580A1 (en) * | 2009-10-06 | 2013-06-27 | Adobe Systems, Inc. | Client-server architecture for audio-video communications |
| CN104980819A (en) * | 2015-06-26 | 2015-10-14 | 安徽四创电子股份有限公司 | Video transmission method and device |
| CN108156150A (en) * | 2017-12-21 | 2018-06-12 | 北京明朝万达科技股份有限公司 | A kind of data transmission method and device |
| CN108833932A (en) * | 2018-07-19 | 2018-11-16 | 湖南君瀚信息技术有限公司 | A kind of method and system for realizing the ultralow delay encoding and decoding of HD video and transmission |
| CN109660549A (en) * | 2018-12-29 | 2019-04-19 | 贵阳朗玛信息技术股份有限公司 | A kind of video requency frame data packet sending, receiving method and device |
| CN112565919A (en) * | 2021-02-18 | 2021-03-26 | 北京远度互联科技有限公司 | Data sending processing method, data receiving processing device and unmanned aerial vehicle |
| CN112822521A (en) * | 2020-12-30 | 2021-05-18 | 百果园技术(新加坡)有限公司 | Code rate control method, device and equipment for audio and video transmission and storage medium |
-
2022
- 2022-06-07 CN CN202210652515.4A patent/CN115103234B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130163580A1 (en) * | 2009-10-06 | 2013-06-27 | Adobe Systems, Inc. | Client-server architecture for audio-video communications |
| CN104980819A (en) * | 2015-06-26 | 2015-10-14 | 安徽四创电子股份有限公司 | Video transmission method and device |
| CN108156150A (en) * | 2017-12-21 | 2018-06-12 | 北京明朝万达科技股份有限公司 | A kind of data transmission method and device |
| CN108833932A (en) * | 2018-07-19 | 2018-11-16 | 湖南君瀚信息技术有限公司 | A kind of method and system for realizing the ultralow delay encoding and decoding of HD video and transmission |
| CN109660549A (en) * | 2018-12-29 | 2019-04-19 | 贵阳朗玛信息技术股份有限公司 | A kind of video requency frame data packet sending, receiving method and device |
| CN112822521A (en) * | 2020-12-30 | 2021-05-18 | 百果园技术(新加坡)有限公司 | Code rate control method, device and equipment for audio and video transmission and storage medium |
| CN112565919A (en) * | 2021-02-18 | 2021-03-26 | 北京远度互联科技有限公司 | Data sending processing method, data receiving processing device and unmanned aerial vehicle |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116302508A (en) * | 2023-02-27 | 2023-06-23 | 中国科学院空间应用工程与技术中心 | High-speed distributed image synthesis method and system for space application |
| CN116302508B (en) * | 2023-02-27 | 2023-12-22 | 中国科学院空间应用工程与技术中心 | High-speed distributed image synthesis method and system for space application |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115103234B (en) | 2023-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110225417B (en) | Data processing method and server, and method and server for detecting stuck state | |
| US11363346B2 (en) | Video service quality assessment method and apparatus | |
| CN115103234B (en) | Image remote transmission method based on RTP | |
| CN110351281B (en) | Universal data frame analysis method, device and equipment | |
| US20030031202A1 (en) | Aligning data packets/frames for transmission over a network channel | |
| EP3605881A1 (en) | Method and device for transmitting and receiving network management information, transmitting apparatus and receiving apparatus | |
| JPH05122282A (en) | Data transmission system | |
| CN111818632A (en) | Method, device, equipment and storage medium for equipment synchronization | |
| CN116527382A (en) | Cloud computing-based data security transmission system | |
| WO2021134418A1 (en) | Data checking method and apparatus | |
| CN114567506A (en) | File uploading method and device, computer equipment and storage medium | |
| JPH05160815A (en) | Error recovery processing method in consecutive transmission system | |
| JP5440272B2 (en) | Push signal transmission status determination method, program, and apparatus | |
| CN113568587A (en) | Smart city real-time data processing method, system and storage medium | |
| US9246631B2 (en) | Communication devices that encode and transmit data, methods of controlling such communication devices, and computer-readable storage media storing instructions for controlling such communication devices | |
| US8259609B2 (en) | Modem and packet processing method | |
| CN110855510A (en) | Data transmission optimization method, device, equipment and medium | |
| CN115604052B (en) | Vehicle communication interaction method and system and electronic equipment | |
| CN114338270B (en) | Data communication method, device, electronic equipment and storage medium | |
| EP3447986B1 (en) | Information processing device, information processing system, and information processing method | |
| CN116828044A (en) | Remote sensing transmission method and system for message queue based on data plane development suite | |
| CN115604089A (en) | Network fault positioning method and device | |
| CN116471002B (en) | Industrial Internet data transmission method and system | |
| CN114401460B (en) | Remote measurement image playing processing method and device | |
| RU98267U1 (en) | DEVICE FOR PROTECTION AGAINST COMPUTER ATTACKS IN AUTOMATED SYSTEMS |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |