CN114785456A

CN114785456A - Data transmission method and device, equipment and storage medium

Info

Publication number: CN114785456A
Application number: CN202210373990.8A
Authority: CN
Inventors: 严靖琳
Original assignee: Shenzhen Sensetime Technology Co Ltd
Current assignee: Shenzhen Sensetime Technology Co Ltd
Priority date: 2022-04-11
Filing date: 2022-04-11
Publication date: 2022-07-22

Abstract

The embodiment of the application discloses a data transmission method, a device, equipment and a storage medium, wherein the method comprises the following steps: in response to a first real-time data transmission failure, storing the first real-time data; retransmitting the first real-time data according to a specific period; in response to the first real-time data being retransmitted successfully, determining a real-time transmission task according to a preset rate threshold; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point.

Description

Data transmission method and device, equipment and storage medium

Technical Field

The present application relates to the field of computer vision, and relates to, but is not limited to, a data transmission method and apparatus, a device, and a storage medium.

Background

In the field of computer vision, the transmission of real-time data is commonly involved. Therefore, the real-time performance and integrity of the real-time data have more important significance. The Transmission of real-time data is based on TCP/IP (Transmission Control Protocol/Internet Protocol ) or network communication Protocol, which is a common scheme in the industry. The transmission of data has a great dependence on the stability of the network. Under the conditions of large data volume, equipment factors, hardware factors or uncontrollable force factors (server power failure) and the like, network faults or server faults inevitably occur, and real-time data transmission is interrupted.

Disclosure of Invention

The embodiment of the application provides a data transmission method, a data transmission device, data transmission equipment and a storage medium.

The technical scheme of the embodiment of the application is realized as follows:

in a first aspect, an embodiment of the present application provides a data transmission method, where the method includes:

in response to a first real-time data transmission failure, storing the first real-time data; retransmitting the first real-time data according to a specific period; in response to the first real-time data being retransmitted successfully, determining a real-time transmission task according to a preset rate threshold; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point.

In some possible embodiments, the storing the first real-time data in response to a failure in transmission of the first real-time data includes: acquiring a storage threshold value of the data sending end; in response to a first real-time data transmission failure, storing the first real-time data in a time stamp order based on the storage threshold.

In this way, by determining the storage threshold of the real-time data and storing the first real-time data in time sequence, the failure of data storage due to the overrun of the storage capacity during the overlong network failure duration is prevented.

In some possible embodiments, the storing the first real-time data in a time stamp order based on a storage threshold includes: determining the total amount of data stored by the data sending end; in response to the total amount of data being greater than the storage threshold, deleting historical data having the timestamp earlier than a particular time to store the first real-time data.

Therefore, under the condition that the total amount of data stored by the data sending end exceeds the storage upper limit, the earlier historical data is removed to store the latest real-time data, and the first real-time data is stored according to the time sequence, so that only the latest real-time data is stored in the failure period, and the data backlog is reduced.

In some possible embodiments, the first real-time data is a snapshot of a video source, and the deleting historical data with the timestamp earlier than a specific time to store the first real-time data in response to the total amount of data being greater than the storage threshold includes: determining a full capacity cycle N of the data sending end based on a preset number of captured images per second, an image storage size and the storage threshold; and in response to the fact that the total data amount is larger than the storage threshold, deleting the snapshot image stored on the first day in each full-capacity period to store the snapshot image on the (N + 1) th day.

Therefore, the full-capacity period corresponding to the storage threshold value of the data sending end is estimated through the corresponding snapshot storage rules of the video source equipment, such as the preset number of snapshots per second, the image storage size and the like, so that the snapshot image stored in the earliest day of the timestamp can be directly deleted under the condition that the fault duration is greater than the full-capacity period, the latest snapshot image in the latest day can be stored, and the storage faults can be reduced under the condition that the data are not lost as much as possible.

In some possible embodiments, the determining, in response to the first real-time data being retransmitted successfully, the real-time transmission task according to a preset rate threshold includes: responding to the first real-time data being retransmitted successfully, and acquiring the second real-time data at the current time point; determining a priority order of the first real-time data and the second real-time data; and determining the real-time transmission task according to the preset rate threshold and the priority sequence.

Thus, under the limited preset speed threshold value, the priority sequence between the first real-time data and the second real-time data is determined, and the real-time transmission task is determined, so that the stable transmission of the real-time data after the fault is recovered is quickly recovered.

In some possible embodiments, the priority order is that the priority of the second real-time data is greater than or equal to the priority of the first real-time data; determining the real-time transmission task according to the preset rate threshold and the priority sequence comprises: determining a second transmission rate corresponding to the second real-time data; and responding to the second transmission rate being larger than or equal to the preset rate threshold, and transmitting the second real-time data according to the preset rate threshold.

In this way, the second transmission rate of the first real-time data is limited according to the preset rate threshold, and the transmission is carried out at the smaller one of the second transmission rate and the preset rate threshold, so that the transmission of the second real-time data at the current time point is preferentially ensured.

In some possible embodiments, the determining the real-time transmission task according to the preset rate threshold and the priority order includes: determining a second transmission rate corresponding to the second real-time data; in response to the second transmission rate being less than the preset rate threshold, determining a first transmission rate of the first real-time data based on the second transmission rate and the preset rate threshold; and simultaneously transmitting the corresponding first real-time data and the second real-time data according to the first transmission rate and the second transmission rate.

Therefore, on the premise that the transmission of the second real-time data does not reach the limited preset rate threshold value at the current time point, the first transmission rate corresponding to the first real-time data is limited according to the preset rate threshold value and the second transmission rate, and the corresponding real-time data is simultaneously transmitted at the respective transmission rates. The method and the device realize the transmission of the first real-time data under the historical time point while the second real-time data under the current time point is transmitted preferentially.

In some possible embodiments, the method further comprises: and responding to the completion of the transmission of the first real-time data, and transmitting the second real-time data according to the second transmission rate.

Therefore, when the transmission of the first real-time data stored in the fault period is completed, namely the fault processing is completed, the second real-time data is recovered to be transmitted at the corresponding second transmission rate, so that the normal transmission process is recovered, and the stable transmission of the new real-time data is ensured.

In a second aspect, an embodiment of the present application provides a data transmission apparatus, including:

the storage module is used for responding to the transmission failure of the first real-time data and storing the first real-time data;

a retry module, configured to retransmit the first real-time data according to a specific period;

the determining module is used for determining a real-time transmission task according to a preset speed threshold value in response to the fact that the first real-time data is successfully retransmitted; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point.

In a third aspect, an embodiment of the present application provides a data transmission device, which includes a memory and a processor, where the memory stores a computer program that is executable on the processor, and the processor implements the steps in the data transmission method when executing the program.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the data transmission method.

The beneficial effects that technical scheme that this application embodiment brought include at least:

in the embodiment of the present application, first; in response to a first real-time data transmission failure, storing the first real-time data; then, retransmitting the first real-time data according to a specific period; finally, responding to the fact that the first real-time data is retransmitted successfully, and determining a real-time transmission task according to a preset speed threshold value; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point; therefore, the first real-time data is stored after the data transmission fails, and the automatic recovery pushing after the fault recovery is realized by regularly retrying the data transmission; meanwhile, the peak speed of data pushing can be controlled in a mode of data transmission according to a preset rate threshold, so that secondary faults caused by too fast transmission are avoided.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the technical aspects of the present application.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the disclosure, in which:

fig. 1 is an exemplary architecture diagram of a data transmission method provided in an embodiment of the present application;

fig. 2 is an alternative flow chart of a data transmission method according to an embodiment of the present disclosure;

fig. 3 is an alternative flow chart of a data transmission method according to an embodiment of the present application;

fig. 4 is an alternative flow chart of a data transmission method according to an embodiment of the present application;

fig. 5 is an alternative flow chart of a data transmission method according to an embodiment of the present application;

fig. 6 is a logic flow diagram of a data transmission method according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a data transmission device according to an embodiment of the present application;

fig. 8 is a hardware entity schematic diagram of a data transmission device according to an embodiment of the present application.

It is obvious that the figures in the above description are only some embodiments of the application, and that for a person skilled in the art, other figures can also be derived from them without inventive effort.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

It should be noted that the terms "first \ second \ third" referred to in the embodiments of the present application are only used for distinguishing similar objects and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may be interchanged under the permission of a specific order or sequence, so that the embodiments of the present application described herein can be implemented in an order other than that shown or described herein.

The term 'and/or' herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. Additionally, 'at least one' herein means any combination of at least two of any one or more of the plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which embodiments of the present application belong. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

Fig. 1 shows an exemplary system architecture 100 to which embodiments of the data transmission method or data transmission apparatus of the present application may be applied. As shown in fig. 1, system architecture 100 may include a sending end device 101, a network 102, and a receiving end device 103. Network 102 is the medium used to provide a communication link between sending end device 101 and receiving end device 103. Network 102 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

A user may use the sending end device 101 to interact with the receiving end device 103 over the network 102 to receive or send messages or the like. The sending end device 101 and the receiving end device may both be terminal devices or servers, where the terminal devices may be installed with various communication client applications, such as a web browser application, a shopping application, a search application, an instant messaging tool, a mailbox client, social platform software, and the like, and the servers may be servers providing various services.

The terminal device may be an electronic device having an electronic screen, including but not limited to a smart phone, a tablet computer, an e-book reader, an MP3(Moving Picture Experts Group Audio Layer III, motion Picture Experts compression standard Audio Layer 3) player, an MP4(Moving Picture Experts Group Audio Layer IV, motion Picture Experts compression standard Audio Layer 4) player, a laptop portable computer, a desktop computer, and the like.

In implementation, the sending end device 101 and the receiving end device 103 establish a connection supporting full duplex communication through the network 102. The sending end device 101 transmits real-time data to the receiving end device 103, for example, the sending end device 101 sends a data push request to the receiving end device 103 according to a transmission cycle, where the push request carries information such as real-time data, data size, and data acquisition time and place; the sink device 103 performs computer vision analysis based on the received real-time data.

It should be noted that the real-time data transmission method provided in the embodiment of the present application is generally executed by a data sending end, and accordingly, the real-time data transmission apparatus is generally disposed in the sending end device 101.

It should be understood that the number of sending end devices, networks, and receiving end devices in fig. 1 is merely illustrative. There may be any number of sending end devices, networks, and receiving end devices, as desired for implementation.

In practical implementations, the transmission of real-time data has a greater dependence on the stability of the network. Under the conditions of large data volume, equipment factors, hardware factors or uncontrollable force factors (server power failure) and the like, network faults or server faults inevitably occur, and real-time data transmission is interrupted. In this case, the related art countermeasures are: 1) discarding data during the failure, and resuming transmission of the latest (real-time) data after the failure is recovered; 2) and stopping transmission during the fault, saving the data, and recovering transmission from the original position after the fault is recovered.

The solution 1 is the simplest, but the disadvantage is obvious, namely, data loss is caused during the fault period, and the integrity of the data cannot be ensured; although the scheme 2 maximally guarantees data integrity, there are relatively large requirements on hardware (data backlog during failure, a data storage manner with a large enough capacity is required), and in the case of data backlog, once transmission is resumed, a transmission data request may be excessively large in a short time, resulting in a secondary failure. In addition, after the failure is recovered, the current real-time data cannot be immediately recovered for transmission, because the data is first recovered to the backlogged portion during the failure. Therefore, after the failure is recovered, the real-time data at the current time point cannot be recovered immediately, and the user feels that a period of time is required to recover the normal state.

The embodiment of the application provides a data transmission method which is applied to a server, terminal equipment or other equipment. The terminal device includes, but is not limited to, a mobile phone, a notebook computer, a tablet computer, a handheld internet device, a multimedia device, a streaming media device, a mobile internet device, a wearable device, or other types of devices.

Fig. 2 is an optional schematic flow chart of a data transmission method provided in an embodiment of the present application, and as shown in fig. 2, the method at least includes the following steps:

step S210, responding to the transmission failure of first real-time data, and storing the first real-time data;

here, the first real-time data may be snapshot data, such as a face image collected by a camera; it is also possible to provide JSON (Java Script Object notification, lightweight data exchange format based on JavaScript language) data requested by a client from a server. The embodiment of the present application does not limit the form of the real-time data.

In some embodiments, it may be determined whether a response returned by the receiving end is received within a specified time by sending a push request to the receiving end, so as to determine that the first real-time data transmission fails; in other embodiments, the transmission rates of the multiple sets of real-time data are compared, and it is determined that the transmission of the first real-time data fails when the transmission rate of the first real-time data is determined to be significantly decreased or almost zero. In case that real-time data cannot be normally transmitted, the real-time data needs to be saved in order to prevent the real-time data from being lost.

It is noted that the transmission of real-time data is highly dependent on the stability of the network. Under the conditions of large data volume, equipment factors, hardware factors or uncontrollable force factors (server power failure) and the like, network faults or server faults inevitably occur, so that transmission failure or interruption of real-time data is caused. By storing real-time data during network failure, data integrity can be guaranteed to the maximum extent, and data loss is reduced.

It should be noted that the real-time data is usually stored in a database, for example, a Redis database. The Redis database is an open-source network-supported, memory-based and persistent journaling, key-value store (Key-value store) database, and provides an API (Application Programming Interface) for multiple languages.

Step S220, retransmitting the first real-time data according to a specific period;

here, the specific period is configured by a service requirement, and may also be determined according to a set retry frequency and retry number.

For example, the specific period may be 10 minutes, and the transmission is retried every 10 minutes after the data transmission fails, so that it is ensured that the transmission of the real-time data is resumed within 10 minutes of the failure recovery.

In some embodiments, the above process may be implemented by: acquiring a current time point; judging whether the time difference between the current time point and the time point retried last time is integral multiple of a specific period or not; and under the condition that the judgment result is yes, retransmitting the first real-time data.

In some embodiments, the above process may also be implemented by: determining at least one transmission thread running in a current service system; judging whether a specific thread for retransmitting the first real-time data is started or not based on at least one transmission thread; and if the judgment result is yes, retransmitting the first real-time data.

Step S230, in response to that the first real-time data is retransmitted successfully, determining a real-time transmission task according to a preset rate threshold;

here, the first real-time data is retransmitted successfully, which indicates fault recovery, and at this time, the real-time transmission task is determined according to the preset rate threshold, that is, the transmission rate of the real-time data is limited, so that the problems of concurrence of instantaneous data pushing requests and overlarge instantaneous data transmission during fault recovery caused by data backlog can be solved, and occurrence of secondary faults is reduced.

The real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point. That is, it is prioritized to ensure real-time data transmission at the current point in time after failure recovery. In this way, the user can experience that the data transmission process is resumed immediately.

In the embodiment of the present application, first; in response to a first real-time data transmission failure, storing the first real-time data; then, retransmitting the first real-time data according to a specific period; finally, responding to the first real-time data being retransmitted successfully, and determining a real-time transmission task according to a preset rate threshold value; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point; therefore, the first real-time data is stored after the data transmission fails, and the automatic recovery pushing after the failure recovery is realized by regularly retrying the data transmission; meanwhile, the peak speed of data pushing can be controlled in a mode of data transmission according to a preset rate threshold, so that secondary faults caused by too fast transmission are avoided.

Fig. 3 is an optional schematic flow chart of the data transmission method provided in the embodiment of the present application, and as shown in fig. 3, the method at least includes the following steps:

step S310, acquiring a storage threshold value of the data sending end;

here, the storage threshold is an upper limit of a storage capacity of the data transmitting end for the real-time data, and if the duration of the network failure is too long and the real-time data stored therein exceeds the storage threshold, the subsequent real-time data storage fails.

Step S320, responding to the transmission failure of the first real-time data, and storing the first real-time data according to the time stamp sequence based on the storage threshold value;

here, in order to prevent loss of real-time data during a failure and failure of excess data storage, the first real-time data is stored in chronological order.

That is, if the storage threshold is limited, the real-time data generated during the failure period only stores the latest real-time data whose timestamp is the latest, i.e., the latest real-time data whose timestamp is the earliest is deleted, and the latest real-time data whose timestamp is the latest is added.

In some embodiments, the step S320 is implemented by: determining the fault duration of data transmission of the data transmitting terminal; and in response to the full capacity cycle corresponding to the storage threshold value, deleting the historical data of which the time stamp is earlier than the earliest time point corresponding to the full capacity cycle so as to store the first real-time data.

Therefore, under the condition that the fault duration of data transmission of the data sending end exceeds the full capacity cycle, the early historical data is removed to store the latest real-time data, the first real-time data is stored according to the time sequence, only the latest real-time data is stored in the fault period, and data overstock is reduced.

Exemplarily, the storage capacity (corresponding to the storage threshold) of the sending end device can only store real-time data for 7 days (corresponding to a full capacity cycle), and data loss is not caused when the failure period is less than 7 days; if the failure period exceeds 7 days, the real-time data of the last 7 days can be saved preferentially, so that the storage failure is avoided.

In some embodiments, the step S320 is implemented by: determining the total amount of data stored by the data sending end; and in response to the total data amount being larger than the storage threshold value, deleting the historical data with the time stamp earlier than a specific time to store the first real-time data.

In some possible embodiments, the first real-time data is a snapshot of a video source, and the deleting historical data with the timestamp earlier than a specific time to store the first real-time data in response to the total amount of data being greater than the storage threshold includes: determining a full capacity cycle N of the data sending end based on a preset number of captured images per second, an image storage size and the storage threshold; and in response to the fact that the total data amount is larger than the storage threshold value, deleting the snapshot image stored on the first day in each full-capacity period so as to store the snapshot image on the (N + 1) th day.

The preset number of beats per second can be based on the calculation standard in the industry, and the number of portrait data of each video per second is two; in practical implementation, the accumulated capture rate of a plurality of video source positions in a plurality of days can be counted according to practical situations and due to the difference of the flow of people at different positions, and the average capture rate per second can be calculated. The image storage size is generally 100k, and the snapshot image of the important video source can also be stored as image data with higher definition according to actual needs, which is not limited in the embodiment of the present application.

Step S330, retransmitting the first real-time data according to a specific period;

step S340, in response to the first real-time data being retransmitted successfully, determining a real-time transmission task according to a preset rate threshold;

here, the real-time transmission task includes at least transmission of second real-time data; the second real-time data is acquired at the current time point.

In the embodiment of the application, the storage threshold value of the real-time data is determined, and the first real-time data is stored according to the time sequence, so that the data storage failure caused by the storage capacity overrun during the overlong network failure duration is prevented. Further, under the condition that the total amount of data stored by the data sending end exceeds the storage upper limit, earlier historical data is removed to store the latest real-time data, and the first real-time data is stored according to the time sequence, so that only the latest real-time data is stored in the failure period, and the data backlog is reduced.

Fig. 4 is an optional schematic flow chart of the data transmission method provided in the embodiment of the present application, and as shown in fig. 4, the method at least includes the following steps:

step S410, responding to the failure of the transmission of the first real-time data, and storing the first real-time data;

step S420, retransmitting the first real-time data according to a specific period;

step S430, in response to that the first real-time data is retransmitted successfully, acquiring the second real-time data at the current time point;

here, the first real-time data is retransmitted successfully, which indicates that the failure is recovered, and at this time, the failure recovery processing procedure is entered, and the first real-time data stored at the historical time point and the second real-time data to be transmitted at the current time point need to be considered at the same time.

Step S440, determining a priority order of the first real-time data and the second real-time data;

here, the priority levels of the first real-time data and the second real-time data may be set in advance so that the priority order is quickly determined at the instant of failure recovery.

And step S450, determining the real-time transmission task according to the preset rate threshold and the priority sequence.

Here, the real-time transmission task is determined according to the preset rate threshold, that is, the transmission rate of the real-time data is limited, so that the problems of concurrence of the instant data pushing request for fault recovery and overlarge instant data transmission caused by data backlog can be solved, and the occurrence of secondary faults is reduced.

In the embodiment of the application, under a limited preset rate threshold, a real-time transmission task is determined by determining a priority sequence between first real-time data and second real-time data, so that stable transmission of quick recovery real-time data after fault recovery is realized.

In some embodiments, the priority order is that the second real-time data has a priority greater than or equal to the priority of the first real-time data. Based on fig. 4, fig. 5 is an optional flowchart of the data transmission method provided in the embodiment of the present application, and as shown in fig. 5, the step S450 may be implemented by the following steps:

step S510, determining a second transmission rate corresponding to the second real-time data;

here, the second real-time data is data to be transmitted at a current time point.

In some embodiments, taking a video capture device as an example, the second real-time data is a currently captured face image, and the second transmission rate may be determined by a calculation standard in the related art. For example, for a video device accessing 1000 channels, the number of face images per second of each video channel is 2, so that the second transmission rate of the video device for the current real-time data is 2000 pieces/second.

In other embodiments, the second transmission rate is determined according to the service requirement and the position of the video source, for example, the video capture device is installed in a scenic spot or an amusement place with a large traffic volume, and the second transmission rate for the face image captured in real time is larger based on the requirement of video analysis. Therefore, the average transmission rate of the real-time transmission of the face images in a fixed time period can be counted as the second transmission rate, for example, the number of the face images obtained by accumulation for a plurality of consecutive days and the number of days are calculated, and then the average number of the face images transmitted per second is obtained as the second transmission rate.

Step S520, responding to the second transmission rate being greater than or equal to the preset rate threshold, and transmitting the second real-time data according to the preset rate threshold;

here, in order to avoid a secondary failure caused by an excessively large number of concurrent data push requests when the second transmission rate of the data at the instant of failure recovery, that is, at the current time point, is too high, transmission of the second real-time data is limited according to a preset rate threshold.

Step S530, in response to the second transmission rate being less than the preset rate threshold, determining a first transmission rate of the first real-time data based on the second transmission rate and the preset rate threshold;

here, on the premise that the transmission of the second real-time data at the current time point does not reach the defined preset rate threshold, the transmission of the backlogged first real-time data during the fault period is started, and the first transmission rate of the first real-time data is calculated through the second transmission rate and the preset rate threshold.

Step S540, transmitting the corresponding first real-time data and the second real-time data according to the first transmission rate and the second transmission rate;

here, the first real-time data is transmitted at the first transmission rate while the second real-time data is transmitted at the second transmission rate. Therefore, the second real-time data transmission of the current time point is guaranteed to be guaranteed in priority at the moment of fault recovery, meanwhile, the first real-time data of the historical time point are transmitted together with the preset rate threshold value as the limit, and the problem that the instantaneous push request is too large in concurrence is solved.

For example, the snapshot data generated at night, that is, the second real-time data is less, and accordingly the second transmission rate is less, and the historical time point, for example, the backlog of the first real-time data in the daytime, may be transmitted according to the difference between the preset rate threshold and the second transmission rate.

Illustratively, the preset speed threshold is set to be 100/second, and the snapshot data such as the face images transmitted per second does not exceed 100. Under the condition that the transmission rate of the snapshot data at the current time point is only 30/second (second transmission rate), because the 30/second is less than 100/second, the data sending end can start the transmission of the historical snapshot data at the transmission rate (first transmission rate) which is not more than 70/second, and ensure that the transmission speed of the historical snapshot data and the real-time snapshot data does not exceed 100 sheets/second.

Step S550, in response to the completion of the transmission of the first real-time data, transmitting the second real-time data according to the second transmission rate.

Here, when the transmission of the first real-time data stored during the failure is completed, that is, when the failure processing is completed, the transmission of the second real-time data at the corresponding second transmission rate is resumed, thereby resuming the normal transmission process and ensuring stable transmission of new real-time data.

In the embodiment of the application, the first transmission rate of the first real-time data is limited according to the preset rate threshold, and the transmission is performed at the smaller one of the second transmission rate and the preset rate threshold, so that the transmission of the second real-time data at the current time point is preferentially ensured. In addition, on the premise that the second transmission rate of the second real-time data does not reach the limited preset rate threshold value at the current time point, the first transmission rate corresponding to the first real-time data is limited according to the preset rate threshold value and the second transmission rate, and the corresponding real-time data is transmitted at the same time at the respective transmission rates. The transmission of the first real-time data under the historical time point is recovered while the second real-time data under the current time point is preferentially transmitted.

The foregoing data transmission method is described below with reference to a specific embodiment, but it should be noted that the specific embodiment is only for better describing the present application and is not to be construed as limiting the present application.

A specific example of the present application is described by taking a primary failure process as an example, and fig. 6 is a logic flow chart of a data transmission method provided in the embodiment of the present application, where as shown in fig. 6, the method includes the following steps:

step S610, responding to the transmission failure of the first snapshot data, and saving the first snapshot data;

here, the first snapshot data is equivalent to the first real-time data, and when a network failure occurs, the real-time snapshot data cannot be transmitted.

It should be noted that, during a period when the data sending end encounters a network failure, the data receiving end still receives data, and at the same time, a timing retry thread is started at the data sending end, so as to push the first snapshot data that is failed to be transmitted to the data receiving end at a timing. That is, to achieve automated recovery, a timed retry task is initiated to resume transmission of saved data upon failure recovery.

Step S620, in response to the fact that the total amount of stored data exceeds a storage threshold value, deleting the historical snapshot data with the earliest time stamp and replacing the historical snapshot data with the first snapshot data with the latest time stamp;

here, the history snapshot data with the earliest time stamp corresponds to the history data. When the network fault lasts for too long time and the real-time data storage during the period is out of limit, the earliest historical data can be deleted automatically, and the latest first snapshot data can be added.

Compared with the prior art, the data storage is over-limited and fails due to direct real-time data loss or data backlog during the fault period; the embodiment of the application provides a data storage mechanism during fault, real-time data are stored according to a time sequence, and when storage exceeds a limit, the oldest historical data are removed, and the newest real-time data are added.

Step S630, responding to the successful retransmission of the first snapshot data, preferentially transmitting the second snapshot data at the current time point;

here, the successful retransmission of the first snapshot data indicates that the retry task is completed and the failure is recovered, and at this time, the failure recovery processing is performed, so that the transmission of the real-time snapshot data at the current time point is preferentially ensured, and the user can immediately perceive the recovery of the real-time data in terms of experience.

Step S640, based on the configured preset rate threshold, simultaneously transmitting first snapshot data;

here, the peak speed of data transmission is controlled by setting a preset rate threshold, i.e., a maximum transmission rate, so that a secondary failure caused by too fast transmission is avoided. On the premise that the transmission rate of the second snapshot data does not reach a specific speed, pushing of the backlog first snapshot data in the fault period is started, and the formula is satisfied: the transmission rate of the first snapshot data + the transmission rate of the second snapshot data < > is equal to a preset rate threshold.

Compared with the prior art that the first snapshot data stored in the fault period is recorded in advance or the first snapshot data is directly discarded, the data recording accumulated in the historical time point is recovered according to the preset speed threshold value on the premise that the transmission of the second snapshot data at the current time point is guaranteed, and the phenomenon that secondary faults are possibly caused due to the fact that the data accumulation is caused and the instantaneous data transmission is overlarge is avoided.

And step S650, responding to the completion of the transmission of the first snapshot data, and completing the fault processing process.

Here, when the transmission of the backlogged first snapshot data is completed, the failure processing and recovery process is completed.

The embodiment of the application predefines the storage threshold value of the fault snapshot data, starts the data retry task when the transmission of the snapshot data fails,

the embodiment of the application provides a fault recovery mechanism which preferentially ensures transmission of real-time snapshot data and recovers the supplementary recording of historical data according to speed. Therefore, the user can experience that the data is recovered from the data immediately. Meanwhile, more historical data are added and recorded when fewer snapshots are taken at night, so that the problem of large instantaneous transmission quantity is solved, and normal transmission of data in the daytime is not influenced.

The method and the device for real-time image transmission can be suitable for various application scenes relating to image real-time transmission, such as face recognition products, comprehensive analysis products of real-time video streams and the like.

The foregoing description of the various embodiments is intended to highlight different aspects of the various embodiments that are the same or similar, which can be referenced with one another and therefore are not repeated herein for brevity.

It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.

Based on the foregoing embodiments, an embodiment of the present application further provides a data transmission apparatus, where the apparatus includes each included module, a sub-module included in each module, and each unit included in each sub-module, and may be implemented by a processor in a device; of course, the implementation can also be realized through a specific logic circuit; in the implementation process, the Processor may be a Central Processing Unit (CPU), a microprocessor Unit (MPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or the like.

Fig. 7 is a schematic structural diagram of a data transmission device according to an embodiment of the present application, and as shown in fig. 7, the device 700 includes: a storage module 710, a retry module 720, and a determination module 730, wherein:

the storage module 710 is configured to store the first real-time data in response to a failure of transmission of the first real-time data;

the retry module 720 is configured to retransmit the first real-time data according to a specific period;

the determining module 730, configured to determine, in response to that the first real-time data is retransmitted successfully, a real-time transmission task according to a preset rate threshold; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point.

In some possible embodiments, the storage module 710 includes an acquisition submodule and a storage submodule, where: the acquisition submodule is used for acquiring a storage threshold value of the data transmitting end; and the storage submodule is used for responding to the transmission failure of the first real-time data and storing the first real-time data according to the time stamp sequence based on the storage threshold value.

In some possible embodiments, the storage submodule includes a first determining unit and a storage unit, wherein: the first determining unit is configured to determine a total amount of data stored by the data sending end; and in response to the total data amount being larger than the storage threshold value, deleting the historical data with the time stamp earlier than a specific time to store the first real-time data.

In some possible embodiments, the determining module 730 includes an obtaining sub-module, a first determining sub-module, and a second determining sub-module, wherein: the obtaining submodule is used for responding to the first real-time data being retransmitted successfully and obtaining the second real-time data at the current time point; the first determining submodule is used for determining the priority order of the first real-time data and the second real-time data; and the second determining submodule is used for determining the real-time transmission task according to the preset rate threshold and the priority sequence.

In some possible embodiments, the priority order is that the priority of the second real-time data is greater than or equal to the priority of the first real-time data; the second determination submodule includes a second determination unit and a transmission unit, wherein: the second determining unit is configured to determine a second transmission rate corresponding to the second real-time data; and responding to the second transmission rate being larger than or equal to the preset rate threshold, and transmitting the second real-time data according to the preset rate threshold.

In some possible embodiments, the second determining submodule includes a third determining unit, a fourth determining unit, and a transmitting unit, wherein: the third determining unit is configured to determine a second transmission rate corresponding to the second real-time data; the fourth determining unit is configured to determine, in response to the second transmission rate being less than the preset rate threshold, a first transmission rate of the first real-time data based on the second transmission rate and the preset rate threshold; the transmission unit is configured to transmit the first real-time data and the second real-time data simultaneously according to the first transmission rate and the second transmission rate.

In some possible embodiments, the apparatus further includes a transmission module configured to transmit the second real-time data at the second transmission rate in response to completion of the transmission of the first real-time data.

It is to be noted here that: the above description of the apparatus embodiments, similar to the above description of the method embodiments, has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.

It should be noted that, in the embodiment of the present application, if the data transmission method is implemented in the form of a software functional module and is sold or used as an independent product, the data transmission method may also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application or portions thereof that contribute to the related art may be embodied in the form of a software product, where the computer software product is stored in a storage medium and includes several instructions for enabling a device (which may be a smartphone with a camera, a tablet computer, or the like) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.

Correspondingly, the embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps in the data transmission method in any one of the above embodiments. Correspondingly, in an embodiment of the present application, a chip is further provided, where the chip includes a programmable logic circuit and/or program instructions, and when the chip runs, the chip is configured to implement the steps in any of the data transmission methods in the foregoing embodiments. Correspondingly, in an embodiment of the present application, there is also provided a computer program product, which is used to implement the steps in the data transmission method in any of the above embodiments when the computer program product is executed by a processor of a device.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Based on the same technical concept, the embodiments of the present application provide a data transmission device, which is used for implementing the data transmission method described in the above method embodiments. Fig. 8 is a hardware entity diagram of a data transmission device according to an embodiment of the present application, and as shown in fig. 8, the device 800 includes a memory 810 and a processor 820, where the memory 810 stores a computer program that can run on the processor 820, and the processor 820 implements steps in a data transmission method according to any one of the embodiments of the present application when executing the program.

The Memory 810 is configured to store instructions and applications executable by the processor 820, and may also buffer data (e.g., image data, audio data, voice communication data, and video communication data) to be processed or already processed by the processor 820 and modules in the device, which may be implemented by a FLASH Memory (FLASH) or a Random Access Memory (RAM).

The processor 820, when executing the program, implements the steps of any of the data transmission methods described above. The processor 820 generally controls the overall operation of the device 800.

The Processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic device implementing the above-mentioned processor function may be other electronic devices, and the embodiments of the present application are not particularly limited.

The computer storage medium/Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic Random Access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM), etc.; or a variety of devices, such as mobile phones, computers, tablet devices, personal digital assistants, etc., that include one or any combination of the above memories.

Here, it should be noted that: the above description of the storage medium and device embodiments is similar to the description of the method embodiments above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium and apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are merely for description, and do not represent the advantages and disadvantages of the embodiments.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element identified by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the scheme of the embodiment of the application.

In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit may be implemented in the form of hardware, or in the form of hardware plus a software functional unit.

Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing an automatic test line of a device to perform all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code.

The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.

The features disclosed in the several method or apparatus embodiments provided herein may be combined in any combination to arrive at a new method or apparatus embodiment without conflict.

The above description is only for the embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A data transmission method is characterized in that the method is applied to a data sending end, and the method comprises the following steps:

in response to a first real-time data transmission failure, storing the first real-time data;

retransmitting the first real-time data according to a specific period;

in response to the first real-time data being retransmitted successfully, determining a real-time transmission task according to a preset rate threshold; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point.

2. The method of claim 1, wherein said storing the first real-time data in response to a failure of the first real-time data transmission comprises:

acquiring a storage threshold value of the data sending end;

in response to a first real-time data transmission failure, storing the first real-time data in a time stamp order based on the storage threshold.

3. The method of claim 2, wherein storing the first real-time data in a time-stamped order based on a storage threshold comprises:

determining the total amount of data stored by the data sending end;

in response to the total amount of data being greater than the storage threshold, deleting historical data having the timestamp earlier than a particular time to store the first real-time data.

4. The method of claim 3, wherein the first real-time data is a snapshot of a video source, and wherein deleting historical data having the timestamp earlier than a particular time in response to the total amount of data being greater than the storage threshold to store the first real-time data comprises:

determining a full capacity cycle N of the data sending end based on a preset capturing number per second, an image storage size and the storage threshold;

and in response to the fact that the total data amount is larger than the storage threshold, deleting the snapshot image stored on the first day in each full-capacity period to store the snapshot image on the (N + 1) th day.

5. The method of any of claims 1 to 4, wherein said determining real-time transmission tasks according to a preset rate threshold in response to said first real-time data being retransmitted successfully comprises:

responding to the first real-time data being retransmitted successfully, and acquiring the second real-time data at the current time point;

determining a priority order of the first real-time data and the second real-time data;

and determining the real-time transmission task according to the preset rate threshold and the priority sequence.

6. The method of claim 5, wherein the priority order is that the second real-time data has a priority greater than or equal to a priority of the first real-time data;

determining the real-time transmission task according to the preset rate threshold and the priority sequence comprises:

determining a second transmission rate corresponding to the second real-time data;

and responding to the second transmission rate being larger than or equal to the preset rate threshold, and transmitting the second real-time data according to the preset rate threshold.

7. The method of claim 5 or 6, wherein said determining said real-time transport tasks according to said preset rate threshold and said priority order comprises:

in response to the second transmission rate being less than the preset rate threshold, determining a first transmission rate of the first real-time data based on the second transmission rate and the preset rate threshold;

and simultaneously transmitting the corresponding first real-time data and the second real-time data according to the first transmission rate and the second transmission rate.

8. The method of claim 7, wherein the method further comprises:

and responding to the completion of the transmission of the first real-time data, and transmitting the second real-time data according to the second transmission rate.

9. A data transmission apparatus, characterized in that the apparatus comprises:

the determining module is used for responding to the fact that the first real-time data is retransmitted successfully, and determining a real-time transmission task according to a preset rate threshold value; the real-time transmission task at least comprises transmission of second real-time data; the second real-time data is acquired at the current time point.

10. A data transmission device comprising a memory and a processor, the memory storing a computer program operable on the processor, wherein the processor implements the steps of the method of any one of claims 1 to 8 when executing the program.

11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.