CN114257820A - Data transmission method and related device - Google Patents

Data transmission method and related device Download PDF

Info

Publication number
CN114257820A
CN114257820A CN202011027401.8A CN202011027401A CN114257820A CN 114257820 A CN114257820 A CN 114257820A CN 202011027401 A CN202011027401 A CN 202011027401A CN 114257820 A CN114257820 A CN 114257820A
Authority
CN
China
Prior art keywords
data
remote
code rate
equipment
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011027401.8A
Other languages
Chinese (zh)
Inventor
孙伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202011027401.8A priority Critical patent/CN114257820A/en
Priority to PCT/CN2021/114112 priority patent/WO2022062799A1/en
Publication of CN114257820A publication Critical patent/CN114257820A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23608—Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H04N21/23655—Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385—Channel allocation; Bandwidth allocation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the application discloses a data transmission method, which comprises the following steps: the remote equipment collects shooting data, carries out priority sequencing on the collected shooting data, and sends the shooting data to the local equipment according to the priority sequencing. When the multi-camera streams are transmitted in parallel, the multi-camera streams are sequentially transmitted based on the real-time requirements of the camera streams, and the data with high priority are transmitted first, so that the camera streams with high real-time requirements are transmitted preferentially, the camera streams with low real-time requirements are transmitted in a delayed and delayed mode, the cross-equipment time delay of the camera streams with high real-time requirements is reduced, and the user experience is improved.

Description

Data transmission method and related device
Technical Field
The present disclosure relates to the field of communications, and in particular, to a data transmission method and a related apparatus.
Background
With the rapid development of multi-device interconnection technology and the vigorous consumer demand, more and more consumer electronic devices have distributed access capability. The distributed camera refers to a camera on a remote device accessed or controlled by a local device through a network, so that the purpose of using the camera across devices is achieved.
The camera is a scene for acquiring data and consuming the data in real time, and has a very high requirement on real-time performance, but the service real-time performance requirements of data streams of the cameras are different. For example, the preview is presented to the user in real time, the real-time requirement is high, the preview data is presented to the user as soon as possible, the data frame is stable, and the jamming probability is reduced; and the photographed large image is generally directly stored with files, so that the user does not directly perceive the large image, and the requirement on real-time performance is relatively low.
Therefore, a transmission mechanism adaptive to network bandwidth is needed, which not only ensures smooth and stable output of camera stream data and reduces the blocking probability, but also meets the real-time requirement of each service stream of a distributed camera, and achieves good user experience.
Disclosure of Invention
A first aspect of the embodiments of the present application provides a data transmission method, including:
the remote device collects shooting data, the shooting data are data obtained by a camera of the remote device, the number of the cameras of the remote device can be one or more, the remote device determines priority ordering of the shooting data and sends the shooting data to the local device based on the priority ordering, and the mode of determining the priority ordering by the remote device is various, for example, the remote device identifies the data type of the shooting data and determines the priority ordering according to the data type, or the remote device determines according to the priority ordering sent by the local device.
When the multi-camera streams are transmitted in parallel, the multi-camera streams are sequentially transmitted based on the real-time requirements of the camera streams, and the data with high priority are transmitted first, so that the camera streams with high real-time requirements are transmitted preferentially, the camera streams with low real-time requirements are transmitted in a delayed and delayed mode, the cross-equipment time delay of the camera streams with high real-time requirements is reduced, and the user experience is improved.
Based on the first aspect of the embodiment of the present application, in the first implementation manner of the first aspect of the embodiment of the present application, the rule of priority ranking is that the smaller the time delay threshold of the shot data is, the higher the priority of the shot data is.
In the embodiment of the application, a priority ranking scheme for determining the priority according to the time delay threshold of the shooting data is provided.
Based on the first aspect of the present application, in a second implementation manner of the first aspect of the present application, the priority ranking rule is that the priorities are sequentially decreased according to the preview data, the photographing thumbnail data, the video call data, the video recording data, and the photographing thumbnail data.
Based on any implementation manner of the first aspect to the second implementation manner of the first aspect of the embodiment of the present application, in a third implementation manner of the first aspect of the embodiment of the present application, the remote device calculates a transmission code rate required for the remote device to send shooting data to the local device, so that the local device configures a bandwidth resource for the remote device according to the transmission code rate.
A second aspect of the embodiments of the present application provides a data transmission method, including:
the method comprises the steps that local equipment receives a transmission code rate sent by remote equipment, wherein the transmission code rate is a code rate required by the remote equipment for sending shooting data to the local equipment, the shooting data is data acquired by a camera of the remote equipment, the camera of the remote equipment can comprise one or more than one camera, and the local equipment is connected with two or more than two remote equipment; and the local equipment allocates bandwidth resources for each remote equipment according to the transmission code rate.
By the embodiment, the local device can dynamically allocate the network transmission bandwidth of each remote device and the data stream of each remote device, ensure smooth and stable output of the data frame of the camera stream of the remote device, and meet the service real-time requirement of each camera stream of the distributed camera.
Based on the second aspect of the present embodiment, in the first implementation manner of the second aspect of the present embodiment, the configuring, by the local device, bandwidth resources for each remote device according to the transmission code rate includes:
BWx＝BWtotal*(Bx/Btotal)；
BWxis the bandwidth quota of the xth remote device, the xth remote device belongs to any one of the remote devices connected with the local device, BWtotalTotal bandwidth allocable for local equipment, BxTransmission code rate for the xth remote device, BtotalThe total transmission code rate required for all remote devices.
A third aspect of embodiments of the present application provides a remote device, which performs the method of any one of the foregoing first aspect and first aspect.
A fourth aspect of the embodiments of the present application provides a local device, where the local device executes the method of any one of the foregoing second aspects and second aspects.
A fifth aspect of embodiments of the present application provides a computer storage medium having instructions stored therein, which when executed on a computer, cause the computer to perform the method of any one of the foregoing first aspect and first aspect embodiments or any one of the foregoing second aspect and second aspect embodiments.
A sixth aspect of embodiments of the present application provides a computer software product which, when executed on a computer, causes the computer to perform the method of any of the foregoing first aspect and first aspect embodiments or any of the foregoing second aspect and second aspect embodiments.
Drawings
FIG. 1 is a schematic diagram of a network architecture according to an embodiment of the present application;
fig. 2 is a schematic flow chart of a data transmission method in an embodiment of the present application;
FIG. 3 is a logic diagram illustrating dynamic allocation of network bandwidth resources by a local device in an embodiment of the present application;
FIG. 4 is a diagram illustrating data transmission based on priority ordering according to an embodiment of the present application;
FIG. 5 is a diagram illustrating an embodiment of a dynamic control data transmission;
FIG. 6 is a schematic structural diagram of a local device in an embodiment of the present application;
FIG. 7 is a schematic diagram of a remote device according to an embodiment of the present application;
fig. 8 is another schematic structural diagram of a local device in the embodiment of the present application;
FIG. 9 is a schematic diagram of another configuration of a remote device in an embodiment of the present application;
fig. 10 is another schematic structural diagram of a local device in the embodiment of the present application;
fig. 11 is another schematic structural diagram of a remote device in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the present application, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone, wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b and c can be single or multiple. It is to be noted that "at least one item" may also be interpreted as "one or more item(s)".
It is noted that, in the present application, words such as "exemplary" or "for example" are used to mean exemplary, illustrative, or descriptive. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
The descriptions of the first, second, etc. appearing in the embodiments of the present application are only for illustrating and differentiating the objects, and do not represent the order or the particular limitation of the number of the devices in the embodiments of the present application, and do not constitute any limitation to the embodiments of the present application.
Referring to fig. 1, a network architecture according to an embodiment of the present application includes:
the number of the remote devices is not limited in this embodiment, and this embodiment only takes two remote devices as an example for description (the remote device 1 and the remote device 2).
The multi-camera bandwidth cooperative allocation module of the local device can cooperate and dynamically allocate the network bandwidth quota of each remote device based on the real-time performance and the real-time transmission code rate of the data stream service of each cross-device camera; the multi-camera stream dynamic sending module of the remote device may dynamically control sending of the camera stream data, smooth transmission code rate, and meet the real-time requirement based on the bandwidth quota and the service real-time requirement of each camera stream.
The local device and the remote device in this embodiment may both be terminal devices, which are referred to as a camera in this embodiment, and also referred to as User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), and the like in this embodiment, and are devices that provide voice and/or data connectivity to a user. Such as a handheld device, a vehicle-mounted device, etc., having a wireless connection function. Currently, some examples of terminals are: a mobile phone (mobile phone), a tablet computer, a notebook computer, a palm top computer, a Mobile Internet Device (MID), a wearable device, a Virtual Reality (VR) device, an Augmented Reality (AR) device, a wireless terminal in industrial control (industrial control), a wireless terminal in self driving (self driving), a wireless terminal in remote surgery (remote medical supply), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation safety (smart security), a wireless terminal in city (smart city), a wireless terminal in home (smart home), and the like.
The embodiment of the application provides a data transmission method, which is used in a distributed camera use scene, namely, a local device controls one or more remote devices through a network, and camera data acquired by the remote devices needs to be transmitted back to the local device for use. For example, the mobile phone performs a video call by using a large-screen camera, the local mobile phone controls the remote mobile phone camera/remote unmanned aerial vehicle camera to realize multi-device collaborative shooting micro recording (Vlog), live broadcast and the like, and a specific application scene is not limited here.
The technical scheme provided by the embodiment of the application can be applied to various communication systems, such as: a Long Term Evolution (LTE) system, a fifth generation (5G) mobile communication system, a wireless fidelity (WiFi) system, a future communication system, or a system in which multiple communication systems are integrated, which is not limited in the embodiments of the present application. Among them, 5G may also be referred to as New Radio (NR).
The technical scheme provided by the embodiment of the application can be applied to various communication scenes, for example, one or more of the following communication scenes: enhanced mobile broadband (eMBB), ultra-reliable low-latency communication (URLLC), Machine Type Communication (MTC), large-scale Machine Type Communication (MTC), device-to-device (D2D), vehicle-to-evolution (V2X), vehicle-to-vehicle (V2V), and internet of things (IoT), among others.
Referring to fig. 2, a data transmission method according to an embodiment of the present application includes:
201. each remote device collects shooting data;
the number of the remote devices in this embodiment of the present application is not limited, and this embodiment is described by taking only two remote devices as an example, that is, a first remote device and a second remote device.
The method includes the steps that shooting data are collected by first remote equipment and second remote equipment, the shooting data of the first remote equipment are data obtained by a camera of the first remote equipment, the shooting data of the second remote equipment are data obtained by a camera of the second remote equipment, the data obtained by the camera can be image data, view screen data and the like, and specific limitations are not provided herein. The cameras of the remote devices may include one or more cameras, for example, the camera of the first remote device may include two cameras, a wide-angle camera and a telephoto camera, and the specific types and numbers of the cameras are determined according to an actual application scenario, which is not limited herein.
202. Each remote device calculates a transmission code rate;
the first remote equipment and the second remote equipment respectively calculate respective transmission code rates, wherein the transmission code rates are code rates required by the remote equipment for sending shooting data to the local equipment.
The shooting data has two types of data streams, a Stream (Stream) type and an Image type. Stream type is a persistent camera data Stream, such as a preview Stream or a video Stream. The Image type is a data stream collected according to needs, such as a large picture and a scaled picture during photographing, and corresponding data can be generated only when a user triggers a photographing operation each time.
1. Stream type code rate calculation:
in view of bandwidth limitations, the shot data may be compressed and then transmitted across the devices. In order to ensure the quality of the compressed image, a dynamic bit rate (VBR) is generally adopted for compression, that is, the code rate is dynamically adjusted according to the complexity of the image, so that the quality of each frame of the compressed camera stream is ensured to be at a higher level. Therefore, dynamic real-time prediction of Stream bitrate of Stream type camera is required.
The calculation method of the Stream code rate B of the one-way Stream type camera can be as follows:
when t is<At T time: b ═ Bsize；
When T is more than or equal to T:
Figure BDA0002702529530000041
that is, when the calculation time is less than one unit, the code rate is calculated by the actual data amount in the calculation time of 1 to n units.
Wherein t is the time length of the camera stream data output by the data compression module of the remote device; t is unit calculation time, namely an integral number of I frame interval time of video stream compression, and one I frame interval time is generally taken; b is the Stream code rate of the one-way Stream type camera; b issizeConfiguring a default transmission code rate for xml, wherein the default transmission code rate is related to the resolution, namely the size (size), of the camera stream; dnCalculating the data volume output by a data compression module of the remote equipment in the nth unit; wnIs DnThe weight occupied in calculating the code rate is generally Wn-1≥WnAnd n is a positive integer greater than or equal to 1.
2. The calculation method of the Image type camera stream code rate B can be as follows:
the Image type camera stream is not a continuous data stream, single-frame compression is carried out during transmission, and the code stream calculation mode is as follows:
Figure BDA0002702529530000051
b is the stream code rate of the single-path Image type camera; dsizeConfiguring a default data volume after single-frame image compression for xml, wherein the data volume is related to the resolution of a camera stream, namely size; t islatencyIs the delay threshold of the camera stream, i.e. the maximum delay of the camera stream data acceptable for the service.
For a common camera stream, referring to table 1, an example of a latency threshold configuration is as follows:
TABLE 1
Flow of Type of stream Delay threshold
Preview, analyze stream STREAM 0ms
Thumbnail image IMAGE 0ms
Video call streaming STREAM 100ms
Video recording stream STREAM 300ms
Big picture for taking picture IMAGE 3000ms
The camera flow delay threshold supports active configuration of service applications to meet different requirements of services on real-time performance.
The transmission code rate calculation method of the xth remote device may be:
Bx＝∑Bi
wherein, BxFor the transmission code rate of the xth remote device, it can be understood that the value range of x is equal to the number of the remote devices; b isiAnd the transmission code rate of the ith path flow of the xth remote equipment, wherein i is a positive integer not less than 1.
203. The local equipment receives the transmission code rate of each remote equipment;
referring to fig. 3, a schematic diagram of an implementation logic is shown below, where data transmission between the local device and the remote device may be in a wired manner or in a wireless manner, and is not limited herein.
204. The local equipment allocates bandwidth resources for each remote equipment according to the transmission code rate;
and the local equipment dynamically allocates the network bandwidth quota of each remote equipment according to the transmission code rate of each remote equipment. The configuration mode is as follows:
BWx＝BWtotal*(Bx/Btotal)；
wherein, BWxA bandwidth quota for the xth remote device; BW (Bandwidth)totalA total bandwidth allocable for the local device; b isxThe transmission code rate of the xth remote device; b istotalThe total transmission code rate required for all remote devices.
The conditions for triggering the local device to perform the bandwidth quota update may be: when there is a camera stream stop or a new camera stream start, or the local device configures the bandwidth resources of each remote device according to a fixed preset period T, and the specific times are not limited.
It is understood that steps 202 to 204 may not be performed, such as when only one remote device is, the remote device and the local device may occupy the entire bandwidth available in the network for data transmission, i.e. the local device is not required to configure the bandwidth.
205. Each remote device determines the priority sequence of the shooting data;
when the multi-camera streams are transmitted in parallel, the multi-camera streams are sequentially transmitted based on the real-time requirement of the camera streams, the priority ranking rule is that the smaller the time delay threshold of the shooting data is, the higher the priority of the shooting data is, the data is transmitted first, so that the camera streams with high real-time requirement are transmitted preferentially, the camera streams with low real-time requirement are transmitted in a delayed and delayed manner, the cross-equipment time delay of the camera streams with high real-time requirement is reduced, and the user experience is improved.
A common prioritization rule may be: the priority is decreased progressively according to preview data, photographing thumbnail data, video call data, video recording data and photographing thumbnail data. It is to be understood that the rule is not the only rule, and the specific sorting rule may also be obtained by user setting or the like.
206. And each remote device sends the shooting data to the local device, and the sending sequence is sorted based on the priority.
Referring to fig. 4, for an example of data transmission based on priority ordering, preview data is sent preferentially to ensure a delay experience visible to a user. The remaining bandwidth is used to preferentially transmit thumbnail data and video data. The photographed big image data can be seen to be broken into small blocks and sent for multiple times, so that the real-time performance of previewing, thumbnails and video recording is not influenced.
Fig. 5 is a schematic diagram of dynamic control data transmission in an embodiment of the present application, and a specific implementation manner of dynamic transmission of multiple data types (including preview data and video recording data) by using a camera stream is as follows:
1. determine the real-time Stream (the Stream with the smallest delay, usually the preview) and take its frame rate interval TsendIs a unit transmission time. There can be multiple real-time streams, taking the T with the largest frame rate intervalsendIs a unit of transmission time, typically a preview.
2. Sending time per unit TsendControl data transmission, TsendThe amount of data that can be transmitted in time does not exceed Dsend：
Dsend＝BWx*Tsend；
Wherein D issendAs a unit of transmission time TsendThe amount of data that can be sent; BW (Bandwidth)xA bandwidth quota for the xth remote device; t issendIs a unit transmission time, typically a preview frame interval (e.g., 33.3 ms).
3. Shooting data are collected and then sent to respective buffer areas to be sent, and the data sending module fetches data from the corresponding buffer areas according to the real-time priority of the camera stream and sends the data. Only when the high-priority camera stream transmission buffer is empty, the camera stream data of the next priority is transmitted.
Remote device at TsendThe amount of data that can be transmitted in time does not exceed DsendIf there is no data in all buffers, wait for the next TsendThe time of transmission. Sending time T by remote device according to unitsendThe sending data is grouped into small blocks for sending for a plurality of times for the oversized camera data frame.
A frame reassembly module of the local device reassembles the camera data into a complete camera frame. The frame rate stabilizing module of the local device only performs frame rate stabilizing control on the real-time stream, because the real-time stream is generally directly sent to the display and needs smooth and stable output. And the data of other camera streams are sent to the consumption end of the camera stream directly after the frames are recombined.
According to the embodiment, based on the real-time requirements and real-time network bandwidths of the camera streams with different service attributes, the network transmission bandwidths of the cross-device cameras and the camera data streams are dynamically allocated, the data frames of the camera streams are ensured to be smoothly and stably output, and the service real-time requirements of the camera streams of the distributed cameras are met.
As described above with respect to the data transmission method in the embodiment of the present application, and as described below with reference to fig. 6, the local device may include one or more of a processor, a display unit, a transceiver unit (e.g., a wireless bandwidth (WiFi) unit, a wired transmission unit), a power supply, a storage unit, a video decoder, and the like; referring to fig. 7, the remote device may include one or more of a processor, a camera unit, a transceiver unit (e.g., a wireless bandwidth (WiFi) unit, a wired transmission unit), a power source, a video encoder, a picture encoder, and the like.
Referring to fig. 8, an embodiment of a local device in the embodiment of the present application includes:
the receiving unit 801 is configured to receive a transmission code rate sent by a remote device, where the transmission code rate is a code rate required by the remote device to send shooting data to a local device, and the shooting data is data acquired by a camera of the remote device, where the camera of the remote device includes one or more cameras, and the local device is connected to two or more remote devices.
A configuring unit 802, configured to configure bandwidth resources for each remote device according to the transmission code rate.
In this embodiment, operations performed by each unit are similar to those described in the embodiment shown in fig. 2, and are not described herein again.
Referring to fig. 9, an embodiment of a remote device in an embodiment of the present application includes:
the collecting unit 901 is configured to collect shooting data, where the shooting data is data obtained by a camera of a remote device, and the camera of the remote device includes one or more cameras.
The calculating unit 902 is configured to calculate a transmission code rate, so that the local device configures bandwidth resources for the remote device according to the transmission code rate, where the transmission code rate is a code rate required by the sending unit to send the shooting data to the local device.
A determination unit 903 for determining the priority ranking of the shot data.
A sending unit 904, configured to send the shooting data to the local device, where a sending order of the shooting data is sorted based on the priority.
In this embodiment, operations performed by each unit are similar to those described in the previous embodiment shown in fig. 2, and are not described herein again.
Fig. 10 is a schematic structural diagram of a local device according to an embodiment of the present application, where the local device 1000 may include one or more processors 1001 and a memory 1005, and one or more applications or data are stored in the memory 1005.
The memory 1005 may be volatile memory or persistent storage, among others. The program stored in the memory 1005 may include one or more modules, each of which may include a sequence of instructions for operating on the local device 1000. Still further, the processor 1001 may be configured to communicate with the memory 1005 to execute a sequence of instruction operations in the memory 1005 on the local device 1000.
The local apparatus 1000 may also include one or more power supplies 1002, one or more wired or wireless network interfaces 1003, one or more input-output interfaces 1004, and/or one or more operating systems, such as: any one of the microsoft operating system (Windows), the Android operating system (Android), the apple operating system (Mac OS), the uinex operating system (Unix), the linax operating system (Linux).
The processor 1001 may perform operations performed by the local device in any of the foregoing embodiments, which are not described herein again.
Fig. 11 is a schematic structural diagram of a remote device provided in an embodiment of the present application, where the remote device 1100 may include one or more processors 1101 and a memory 1105, where the memory 1105 stores one or more application programs or data.
Memory 1105 may be volatile storage or persistent storage, among other things. The program stored in memory 1105 may include one or more modules that each may include a sequence of instructions for operating on remote device 1100. Still further, the processor 1101 may be configured to communicate with the memory 1105 to execute a sequence of instruction operations in the memory 1105 on the remote device 1100.
The remote device 1100 may also include one or more power supplies 1102, one or more wired or wireless network interfaces 1103, one or more input-output interfaces 1104, and/or one or more operating systems, such as: any one of the microsoft operating system (Windows), the Android operating system (Android), the apple operating system (Mac OS), the uinex operating system (Unix), the linax operating system (Linux).
The processor 1101 may perform operations performed by the remote device in any of the foregoing embodiments, and details thereof are not repeated herein.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and the like.

Claims (14)

1. A method of data transmission, comprising:
the method comprises the steps that shooting data are collected by a far-end device, the shooting data are obtained by a camera of the far-end device, and the camera of the far-end device comprises one or more cameras;
the remote equipment determines the priority sequence of the shooting data;
and the far-end equipment transmits the shooting data to local equipment, and the transmission sequence of the shooting data is based on the priority sequence.
2. The method according to claim 1, wherein the priority ranking rule is that the smaller the delay threshold of the shot data is, the higher the priority of the shot data is.
3. The method according to claim 1, wherein the priority ordering rule is that the priority is sequentially decreased according to preview data, photo thumbnail data, video call data, video recording data and photo thumbnail data.
4. The method according to any one of claims 1 to 3, further comprising:
the remote equipment calculates a transmission code rate to enable the local equipment to configure bandwidth resources for the remote equipment according to the transmission code rate, wherein the transmission code rate is a code rate required by the remote equipment to send shooting data to the local equipment.
5. A method of data transmission, comprising:
the method comprises the steps that local equipment receives a transmission code rate sent by remote equipment, wherein the transmission code rate is a code rate required by the remote equipment for sending shooting data to the local equipment, the shooting data is data obtained by a camera of the remote equipment, the camera of the remote equipment comprises one or more than one camera, and the local equipment is connected with two or more than two remote equipment;
and the local equipment allocates bandwidth resources for each remote equipment according to the transmission code rate.
6. The method of claim 5, wherein the configuring, by the local device, the bandwidth resources for each remote device according to the transmission code rate comprises:
BWx＝BWtotal*(Bx/Btotal)；
the BWxA bandwidth quota for an xth remote device, the xth remote device belonging to any one of remote devices connected to the local device, and the BWtotalTotal bandwidth allocable for said local device, said BxA transmission code rate for the xth remote device, BtotalFor all that isThe total transmission code rate required by all remote devices.
7. A remote device, comprising:
the acquisition unit is used for acquiring shooting data, wherein the shooting data is acquired by a camera of the remote equipment, and the camera of the remote equipment comprises one or more cameras;
a determination unit configured to determine a priority ranking of the shot data;
and the sending unit is used for sending the shooting data to local equipment, and the sending sequence of the shooting data is sorted based on the priority.
8. The apparatus according to claim 7, wherein the priority ranking rule is that the smaller the delay threshold of the shot data is, the higher the priority of the shot data is.
9. The apparatus according to claim 7, wherein the priority ordering rule is that the priority is sequentially decreased according to preview data, photo thumbnail data, video call data, video recording data and photo thumbnail data.
10. The apparatus of any of claims 7 to 9, wherein the remote apparatus further comprises:
and the calculating unit is used for calculating a transmission code rate so that the local equipment configures bandwidth resources for the remote equipment according to the transmission code rate, and the transmission code rate is a code rate required by the sending unit for sending the shooting data to the local equipment.
11. A local device, comprising:
the system comprises a receiving unit, a sending unit and a processing unit, wherein the receiving unit is used for receiving a transmission code rate sent by a remote device, the transmission code rate is a code rate required by the remote device to send shooting data to a local device, the shooting data is data acquired by a camera of the remote device, the camera of the remote device comprises one or more than one local device, and the local device is connected with two or more than two remote devices;
and the configuration unit is used for configuring bandwidth resources for each remote device according to the transmission code rate.
12. The apparatus according to claim 11, wherein the configuration unit is configured in a manner including:
BWx＝BWtotal*(Bx/Btotal)；
the BWxA bandwidth quota for an xth remote device, the xth remote device belonging to any one of remote devices connected to the local device, and the BWtotalTotal bandwidth allocable for said local device, said BxA transmission code rate for the xth remote device, BtotalThe total transmission code rate required for all remote devices.
13. A computer storage medium having stored therein instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 6.
14. A computer program product, characterized in that the computer program product, when executed on a computer, causes the computer to perform the method according to any of claims 1 to 6.
CN202011027401.8A 2020-09-25 2020-09-25 Data transmission method and related device Pending CN114257820A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202011027401.8A CN114257820A (en) 2020-09-25 2020-09-25 Data transmission method and related device
PCT/CN2021/114112 WO2022062799A1 (en) 2020-09-25 2021-08-23 Data transmission method and related apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011027401.8A CN114257820A (en) 2020-09-25 2020-09-25 Data transmission method and related device

Publications (1)

Publication Number Publication Date
CN114257820A true CN114257820A (en) 2022-03-29

Family

ID=80789406

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011027401.8A Pending CN114257820A (en) 2020-09-25 2020-09-25 Data transmission method and related device

Country Status (2)

Country Link
CN (1) CN114257820A (en)
WO (1) WO2022062799A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115442408B (en) * 2022-09-13 2023-06-02 脉冲视觉(北京)科技有限公司 Image data transmission processing method, device, medium and electronic equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1538309A (en) * 2003-09-02 2004-10-20 竺红卫 Non-homogeneous multi media flow transmission regulation method based on priority regulation
US20070204316A1 (en) * 2006-02-24 2007-08-30 Kabushiki Kaisha Toshiba Video surveillance system
US20090164638A1 (en) * 2007-12-24 2009-06-25 Electronics And Telecommunications Research Institute System and method for uplink resource allocation in mobile internet
CN103986666A (en) * 2013-02-07 2014-08-13 华为技术有限公司 Data processing method and device and system
CN104994590A (en) * 2015-06-29 2015-10-21 上海华为技术有限公司 Data transmission method and device
CN106302254A (en) * 2016-07-29 2017-01-04 山东大学苏州研究院 A kind of internet of things data forwarding system based on SDN
CN109495326A (en) * 2018-12-28 2019-03-19 北京东土科技股份有限公司 Internet wide band distribution and system
CN109962760A (en) * 2019-04-09 2019-07-02 湖南智领通信科技有限公司 A kind of business scheduling method suitable for wireless TDMA ad hoc network
CN111279690A (en) * 2019-01-30 2020-06-12 深圳市大疆创新科技有限公司 Multi-load graph transmission method, control system, control terminal, unmanned aerial vehicle and server

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10347102B2 (en) * 2016-03-22 2019-07-09 Sensormatic Electronics, LLC Method and system for surveillance camera arbitration of uplink consumption
CN107995017B (en) * 2016-10-27 2021-08-24 杭州萤石网络股份有限公司 Uplink bandwidth allocation method, device and system
CN108093209B (en) * 2016-11-21 2024-04-12 松下知识产权经营株式会社 Image transmission system and mobile camera device
CN106682644B (en) * 2017-01-11 2019-08-27 同观科技（深圳）有限公司 A kind of double acting state vehicle monitoring management system and method based on dollying equipment
CN109040674B (en) * 2018-07-23 2021-01-29 华为技术有限公司 Data transmission method and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1538309A (en) * 2003-09-02 2004-10-20 竺红卫 Non-homogeneous multi media flow transmission regulation method based on priority regulation
US20070204316A1 (en) * 2006-02-24 2007-08-30 Kabushiki Kaisha Toshiba Video surveillance system
US20090164638A1 (en) * 2007-12-24 2009-06-25 Electronics And Telecommunications Research Institute System and method for uplink resource allocation in mobile internet
CN103986666A (en) * 2013-02-07 2014-08-13 华为技术有限公司 Data processing method and device and system
CN104994590A (en) * 2015-06-29 2015-10-21 上海华为技术有限公司 Data transmission method and device
CN106302254A (en) * 2016-07-29 2017-01-04 山东大学苏州研究院 A kind of internet of things data forwarding system based on SDN
CN109495326A (en) * 2018-12-28 2019-03-19 北京东土科技股份有限公司 Internet wide band distribution and system
CN111279690A (en) * 2019-01-30 2020-06-12 深圳市大疆创新科技有限公司 Multi-load graph transmission method, control system, control terminal, unmanned aerial vehicle and server
CN109962760A (en) * 2019-04-09 2019-07-02 湖南智领通信科技有限公司 A kind of business scheduling method suitable for wireless TDMA ad hoc network

Also Published As

Publication number Publication date
WO2022062799A1 (en) 2022-03-31

Similar Documents

Publication Publication Date Title
CN108769646B (en) Three-dimensional video communication method and system, electronic device, server and readable storage medium
US20230276430A1 (en) Resource scheduling method and apparatus, communication device and storage medium
EP4115591B1 (en) Offering media services through network edge
CN108632597B (en) Three-dimensional video communication method and system, electronic device and readable storage medium
US20230262273A1 (en) Video stream processing method, apparatus, device, storage medium, and program product
CN113068001B (en) Data processing method, device, equipment and medium based on cascade camera
CN112989894B (en) Target detection method, task processing method, device, equipment and storage medium
WO2022062799A1 (en) Data transmission method and related apparatus
CN114828039A (en) Data transmission method, terminal and network side equipment
CN110784731A (en) Data stream transcoding method, device, equipment and medium
CN110637475A (en) Communication link adjusting method, communication equipment and unmanned aerial vehicle
JP4329429B2 (en) Image transfer apparatus, image transfer method, and image transfer program
CN109922318B (en) Multi-channel video transmission scheduling method and device, storage medium and electronic terminal
CN115484382A (en) Parameter control method, electronic device, computer storage medium, and program product
CN115362672A (en) Method and apparatus for volumetric three-dimensional session service using network edge
CN111064894A (en) Image processing method, terminal device and computer-readable storage medium
CN112789806B (en) Data transmission method, device and storage medium
CN113228774A (en) Communication connection configuration method, communication connection configuration device, communication equipment and storage medium
KR102279730B1 (en) MULTI-TRANSMISSION STREAMING METHOD OF IMAGES WITH META INFORMATION BASED ON REAL-TIME IoT, RECORDING MEDIUM, DEVICE AND SYSTEM FOR PERFORMING THE METHOD
CN106331591B (en) The method for synchronously switching and device of monitored picture
CN114666477B (en) Video data processing method, device, equipment and storage medium
CN113287364B (en) Data transmission method and device and communication equipment
CN112929297B (en) Resource allocation method, resource allocation device and storage medium
CN115334053B (en) Method for realizing associated screen projection in cloud conference and related products
WO2024120309A1 (en) Rendering method, apparatus and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination