CN108495112B - Data transmission method, terminal and computer storage medium - Google Patents
Data transmission method, terminal and computer storage medium Download PDFInfo
- Publication number
- CN108495112B CN108495112B CN201810443886.5A CN201810443886A CN108495112B CN 108495112 B CN108495112 B CN 108495112B CN 201810443886 A CN201810443886 A CN 201810443886A CN 108495112 B CN108495112 B CN 108495112B
- Authority
- CN
- China
- Prior art keywords
- dimensional video
- video data
- access channel
- network
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention discloses a data transmission method, a terminal and a computer storage medium, wherein the method comprises the following steps: acquiring three-dimensional video data, wherein the three-dimensional video data comprises two-dimensional video data and depth data; determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data; and transmitting the two-dimensional video data by using the first access channel, and transmitting the depth data by using the second access channel.
Description
Technical Field
The present invention relates to data transmission technologies, and in particular, to a method and a terminal for transmitting three-dimensional video data, and a computer storage medium.
Background
With the continuous development of the mobile communication network, the transmission rate of the mobile communication network is rapidly improved, thereby providing powerful technical support for the generation and development of the three-dimensional video service. The three-dimensional video data includes two-dimensional video data (e.g., RGB data) and Depth data (Depth data). At present, video content transmitted between terminals is limited to two-dimensional video data, where two-dimensional video data is collected at a collection side of a terminal and two-dimensional video data is also presented at a presentation side of the terminal. The terminals only support the transmission of two-dimensional video data and do not contain depth information.
In consideration of the introduction of three-dimensional video data, a terminal side needs to transmit the three-dimensional video data to other terminals through a network, if the existing video data transmission mode is also used, the way for the terminal to transmit the three-dimensional video data to the network side is single, and the two-dimensional video data and the depth data are often transmitted through an access network, so that the transmission efficiency of the three-dimensional video data is low.
Disclosure of Invention
The embodiment of the invention provides a data transmission method, a terminal and a computer storage medium, which can solve the problem of low transmission efficiency of three-dimensional video data.
The data transmission method provided by the embodiment of the invention comprises the following steps:
acquiring three-dimensional video data, wherein the three-dimensional video data comprises two-dimensional video data and depth data;
determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data;
and transmitting the two-dimensional video data by using the first access channel, and transmitting the depth data by using the second access channel.
In this embodiment of the present invention, after the three-dimensional video data is obtained, the method further includes:
encrypting the two-dimensional video data and the depth data respectively;
adding first identification information to the encrypted two-dimensional video data, and adding second identification information to the encrypted depth data;
the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
In this embodiment of the present invention, the determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data includes:
determining a first access channel corresponding to the two-dimensional video data based on a first transmission condition which needs to be met by the two-dimensional video data;
and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data.
In the embodiment of the invention, a first access channel corresponding to the two-dimensional video data is determined based on a first transmission condition which needs to be met by the two-dimensional video data; determining a second access channel corresponding to the depth data based on a second transmission condition that the depth data needs to satisfy, including:
detecting network state parameters of each network, wherein different networks correspond to different access channels;
determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data;
and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data.
In the embodiment of the present invention, the method further includes:
and determining a first transmission condition which needs to be met by the two-dimensional video data and a second transmission condition which needs to be met by the depth data based on the service type of the three-dimensional video data.
In the embodiment of the invention, the first access channel corresponds to a first mobile network, and the second access channel corresponds to a second mobile network; or, the first access channel corresponds to a wireless local area network, and the second access channel corresponds to a third mobile network;
wherein the first mobile network and the second mobile network are the same type of access network or different types of access networks.
The terminal provided by the embodiment of the invention comprises:
an acquisition unit configured to acquire three-dimensional video data including two-dimensional video data and depth data;
the determining unit is used for determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data;
and the communication unit is used for transmitting the two-dimensional video data by using the first access channel and transmitting the depth data by using the second access channel.
In the embodiment of the present invention, the terminal further includes:
an encryption unit configured to encrypt the two-dimensional video data and the depth data, respectively;
the identification unit is used for adding first identification information on the encrypted two-dimensional video data and adding second identification information on the encrypted depth data;
the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
In an embodiment of the present invention, the determining unit is configured to determine, based on a first transmission condition that needs to be met by the two-dimensional video data, a first access channel corresponding to the two-dimensional video data; and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data.
In the embodiment of the present invention, the determining unit is configured to detect a network state parameter of each network, where different networks correspond to different access channels; determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data; and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data.
In this embodiment of the present invention, the determining unit is further configured to determine, based on a service type to which the three-dimensional video data belongs, a first transmission condition that the two-dimensional video data needs to satisfy, and a second transmission condition that the depth data needs to satisfy.
In the embodiment of the invention, the first access channel corresponds to a first mobile network, and the second access channel corresponds to a second mobile network; or, the first access channel corresponds to a wireless local area network, and the second access channel corresponds to a third mobile network;
wherein the first mobile network and the second mobile network are the same type of access network or different types of access networks.
The terminal provided by the embodiment of the invention comprises: a processor and a memory for storing a computer program operable on the processor, wherein the processor is configured to perform the above-described data transmission method when the computer program is executed.
The computer storage medium provided by the embodiment of the invention stores a computer program, and the computer program realizes the data transmission method when being executed by a processor.
According to the technical scheme of the embodiment of the invention, three-dimensional video data is obtained, wherein the three-dimensional video data comprises two-dimensional video data and depth data; determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data; and transmitting the two-dimensional video data by using the first access channel, and transmitting the depth data by using the second access channel. By adopting the technical scheme of the embodiment of the invention, as the two-dimensional video data and the depth data have difference, when the three-dimensional video data is transmitted, the first access channel is adaptively selected for the two-dimensional video data and the second access channel is adaptively selected for the depth data, so that the two-dimensional video data and the depth data can be transmitted through the optimal access channel, and the transmission efficiency of the three-dimensional video data is improved.
Drawings
Fig. 1 is a schematic diagram of a system architecture to which a data transmission method according to an embodiment of the present invention is applied; (ii) a
Fig. 2 is a schematic flow chart of a data transmission method according to an embodiment of the present invention;
fig. 3 is a first schematic structural component diagram of a terminal according to an embodiment of the present invention;
fig. 4 is a schematic structural composition diagram of a terminal according to an embodiment of the present invention.
Detailed Description
Before the technical solution of the embodiment of the present invention is explained in detail, a system architecture applied to the data transmission method of the embodiment of the present invention is first briefly explained. The data transmission method of the embodiment of the invention is applied to related services of three-dimensional video data, such as services for sharing three-dimensional video data, live broadcast services based on three-dimensional video data, and the like. In this case, since the data amount of the three-dimensional video data is large, the depth data and the two-dimensional video data transmitted respectively need high technical support in the data transmission process, and thus the mobile communication network is required to have a high data transmission rate and a stable data transmission environment.
Fig. 1 is a schematic diagram of a system architecture to which a data transmission method according to an embodiment of the present invention is applied; as shown in fig. 1, the system may include a terminal, a base station, a Mobile Edge Computing (MEC) server, a service processing server, a core network, the Internet (Internet), and the like; and a high-speed channel is established between the MEC server and the service processing server through a core network to realize data synchronization.
Taking an application scenario of interaction between two terminals shown in fig. 1 as an example, the MEC server a is an MEC server deployed near the terminal a, and the core network a is a core network in an area where the terminal a is located; correspondingly, the MEC server B is an MEC server deployed close to the terminal B, and the core network B is a core network of an area where the terminal B is located; the MEC server A and the MEC server B can establish a high-speed channel with the service processing server through the core network A and the core network B respectively to realize data synchronization.
After three-dimensional video data sent by a terminal A are transmitted to an MEC server A, the MEC server A synchronizes the data to a service processing server through a core network A; and then, the MEC server B acquires the three-dimensional video data sent by the terminal A from the service processing server and sends the three-dimensional video data to the terminal B for presentation.
Here, if the terminal B and the terminal a realize transmission through the same MEC server, the terminal B and the terminal a directly realize transmission of three-dimensional video data through one MEC server at this time without participation of a service processing server, and this mode is called a local backhaul mode. Specifically, suppose that the terminal B and the terminal a realize transmission of three-dimensional video data through the MEC server a, and after the three-dimensional video data sent by the terminal a is transmitted to the MEC server a, the MEC server a sends the three-dimensional video data to the terminal B for presentation.
Here, the terminal may select an evolved node b (eNB) accessing the 4G network and/or a next generation evolved node b (gNB) accessing the 5G network based on a network situation, a configuration situation of the terminal itself, or an algorithm of the self configuration, so that the eNB is connected with the MEC server through a Long Term Evolution (LTE) access network and the gNB is connected with the MEC server through a next generation access network (NG-RAN). It should be noted that the 4G network and the 5G network are only exemplary, and the terminal may access the internet through other types of access methods, such as a wireless local area network — WiFi.
Here, the MEC server is deployed on the network edge side near the terminal or the data source, that is, near the terminal or near the data source, not only in a logical location but also in a geographical location. Unlike the existing mobile communication network in which the main service processing servers are deployed in several large cities, the MEC server can be deployed in a plurality of cities. For example, in an office building, there are many users, and a MEC server may be deployed near the office building.
The MEC server serves as an edge computing gateway with the core capabilities of network convergence, computing, storage and application, and provides platform support comprising an equipment domain, a network domain, a data domain and an application domain for edge computing. The intelligent connection and data processing system is connected with various intelligent devices and sensors, provides intelligent connection and data processing services nearby, enables different types of applications and data to be processed in the MEC server, achieves key intelligent services such as real-time service, intelligent service, data aggregation and interoperation, safety and privacy protection and the like, and effectively improves intelligent decision efficiency of the service.
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Fig. 2 is a schematic flow chart of a data transmission method according to an embodiment of the present invention, and as shown in fig. 2, the data transmission method includes the following steps:
step 201: three-dimensional video data is acquired, wherein the three-dimensional video data comprises two-dimensional video data and depth data.
Here, the three-dimensional video data is acquired by a terminal, and the terminal may be a mobile terminal such as a mobile phone and a tablet computer, or may be a type of terminal such as a computer. The manner of acquiring the three-dimensional video data by the terminal can be, but is not limited to, the following:
the first method is as follows: the terminal collects three-dimensional video data through the stereo camera.
The second method comprises the following steps: and the terminal acquires the three-dimensional video data from the local storage module.
The third method comprises the following steps: and the terminal downloads the three-dimensional video data from the network.
Taking the above manner as an example, the terminal obtains three-dimensional video data from the acquisition component capable of acquiring at least depth information. Specifically, because the acquisition component capable of acquiring the depth information is relatively expensive, the terminal does not have the function of acquiring the three-dimensional video data, acquires the three-dimensional video data through the acquisition component independent of the terminal, and establishes a communication link through the acquisition component and a communication component in the terminal, so that the terminal acquires the three-dimensional video data acquired by the acquisition component. The acquisition assembly can be specifically realized by at least one of the following components: the camera comprises a depth camera, a binocular camera, a 3D structured light camera module and a Time Of Flight (TOF) camera module.
As another embodiment, the terminal has a function of acquiring three-dimensional video data, and it can be understood that the terminal is provided with an acquisition component capable of acquiring at least depth information, for example, at least one of the following components: degree of depth camera, binocular camera, 3D structured light module of making a video recording, TOF module of making a video recording to gather three-dimensional video data.
The obtained three-dimensional video data comprises two-dimensional video data and depth data; the two-dimensional video data is used for representing a planar image, and can be RGB data for example; the depth data characterizes a distance between a surface of an acquisition object for which the acquisition assembly is directed and the acquisition assembly.
Step 202: and determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data.
After the terminal acquires the three-dimensional video data, the three-dimensional video data is transmitted to other terminals as required so as to display the three-dimensional video data on other terminals. For example, a video conference scene, a live broadcast scene, and the like, three-dimensional video data acquired by a local terminal needs to be transmitted to one or more other terminals in real time.
Taking the example of transmitting three-dimensional video data between the terminal 1 and the terminal 2, the transmission path between the terminal 1 and the terminal 2 is: terminal 1 → access network 1 → MEC1 → (for the user the middle path is a black box, the user does not care about nor has to know the middle path) → MEC2 → access network 2 → terminal 2. The MEC1 and MEC2 are synchronized through a virtual tunnel (high speed channel) and thus the latency is very low. Here, only two MECs are taken as an example for explanation, in a specific implementation, a cluster may be further formed by a greater number of MECs, the MECs in the cluster form a local area network through a virtual high-speed tunnel to implement high-speed synchronization of each MEC, and one MEC may be connected to multiple terminals. In addition, the physical connection mode between the MECs may be through private network connection, or through a core network connection (such as the architecture shown in fig. 1) through a network of a lease operator, or through other ways. It should be understood that the MEC described above refers to an MEC server.
Based on this, after the terminal acquires the three-dimensional video data, the first transmission step is to transmit the three-dimensional video data to the MEC through the access network. In order to ensure the safety of the three-dimensional video data on the transmission path, the two-dimensional video data and the depth data need to be encrypted respectively; in addition, adding first identification information on the encrypted two-dimensional video data, and adding second identification information on the encrypted depth data; the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
In one example, the MD5 algorithm may be used to encrypt the two-dimensional video data and the depth data, respectively, but is not limited thereto, and other algorithms may be used to implement the encryption process.
In the embodiment of the invention, three-dimensional video data is divided into two paths of data, which are respectively: two-dimensional video data and depth data. Each frame of RGB image in the two-dimensional video data needs to be aligned with each frame of depth image in the depth data, and one frame of RGB image corresponds to one frame of depth image, so that the corresponding RGB image and depth image can be finally synthesized into a correct three-dimensional image.
In the embodiment of the invention, the transmission of the three-dimensional video data is realized by transmitting the two-dimensional video data and the depth data. Considering that there may be multiple access manners between the endpoint and the MEC, and as the performance of the terminal is continuously improved, the terminal may simultaneously communicate with the MEC through multiple access manners, such as a WiFi access manner, an LTE access manner, a 5G NR access manner, an independent network deployment (SA) access manner, a non-independent network deployment (NSA) access manner, and the like. Each access mode has respective advantages, for example, the WiFi access mode has a fast network transmission speed, the LTE access mode has a low error rate, and safety is guaranteed, and the 5G NR access mode has both the fast network transmission speed and the low error rate.
In the embodiment of the invention, the terminal supports multiple access modes to transmit data simultaneously, and in order to transmit three-dimensional video data with higher efficiency, a first access channel corresponding to the two-dimensional video data and a second access channel corresponding to the depth data need to be determined. In one embodiment, a first access channel corresponding to the two-dimensional video data is determined based on a first transmission condition that the two-dimensional video data needs to satisfy; and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data. The transmission condition may be, for example, a delay, a packet loss rate, an error rate, or the like. In general, the two-dimensional video data has a large data amount relative to the depth data, but the depth data has a high importance, and thus the two-dimensional video data can be transmitted using an access channel with a high transmission speed, and the depth data can be transmitted using an access channel with guaranteed security.
In one embodiment, in consideration of the fact that the states of different networks may change, network state parameters (such as network speed, idle/busy state, congestion degree, and the like) of each network may be detected, and different networks correspond to different access channels; determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data; and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data. In this way, an access channel with higher transmission efficiency can be adaptively selected for the two-dimensional video data, and an access channel with higher transmission efficiency can be adaptively selected for the depth data.
In the above scheme, the first transmission condition that the two-dimensional video data needs to satisfy and the second transmission condition that the depth data needs to satisfy may also refer to a service type to which the three-dimensional video data belongs, and taking a 5G scene as an example, the service types are roughly classified into the following categories: enhanced Mobile Broadband (eMBB) service, Low-Latency high-reliability Communication (URLLC) service, and large-scale Machine Type Communication (mMTC) service, wherein the eMBB service aims at obtaining multimedia contents, services and data by a user, and the service demand thereof is rapidly increased. Because the eMBB may be deployed in different scenarios, such as indoor, urban, rural, etc., and the difference between the service capability and the requirement is relatively large, the service must be analyzed in combination with the specific deployment scenario. Typical applications of URLLC include: industrial automation, electric power automation, remote medical operation, traffic safety guarantee, and the like. Typical features of URLLC include: high connection density, small data volume, time delay insensitive service, low cost of the module, long service life and the like.
In one embodiment, Artificial Intelligence (AI) techniques may be introduced to intelligently select a first access channel corresponding to two-dimensional video data and a second access channel corresponding to depth data, for example: after selecting the corresponding access channel for the two paths of data, the terminal records the transmission efficiency (such as average network speed, average bit error rate and the like) of the access channel, records whether a user can manually switch off the access channel to other access channels, feeds back the operation to the MEC or records the operation to the local, and intelligently updates the selection strategy by referring to the historical record when selecting the access channel again, thereby selecting the access channel with the highest user satisfaction degree and providing more humanized service. For another example: the MEC may periodically issue a routing policy for the terminal, the terminal determines how to select an access channel based on the routing policy, and the routing policy on the MEC side may be configured based on, but not limited to, the following multiple dimensions: APP, network state, historical access data of the terminal and priority information of the terminal. And the MEC performs learning optimization on data of each dimension, and continuously updates the data to provide an optimal routing strategy for the terminal.
In one embodiment, the same access channel corresponding to the two-dimensional video data and the depth data is intelligently selected through an AI technique, for example: after selecting an access channel for two paths of data, the terminal records the transmission efficiency (such as average network speed, average bit error rate and the like) of the access channel, records whether a user can manually disconnect the access channel to switch to other access channels, feeds the operation back to the MEC or records the operation to the local, and intelligently updates a selection strategy by referring to historical records when selecting the access channel again, so that the access channel with the highest user satisfaction is selected, and more humanized service is provided. For another example: the MEC may periodically issue a routing policy for the terminal, the terminal determines how to select an access channel based on the routing policy, and the routing policy on the MEC side may be configured based on, but not limited to, the following multiple dimensions: APP, network state, historical access data of the terminal and priority information of the terminal. And the MEC performs learning optimization on data of each dimension, and continuously updates the data to provide an optimal routing strategy for the terminal.
Step 203: and transmitting the two-dimensional video data by using the first access channel, and transmitting the depth data by using the second access channel.
Specifically, the terminal sends the two-dimensional video data to the MEC by using the first access channel, and sends the depth data to the MEC by using the second access channel.
In one embodiment, the first access channel corresponds to a first mobile network, and the second access channel corresponds to a second mobile network; or, the first access channel corresponds to a wireless local area network, and the second access channel corresponds to a third mobile network; wherein the first mobile network and the second mobile network are the same type of access network or different types of access networks. For example: the first access channel corresponds to a WiFi network, and the second access channel corresponds to an LTE network. For another example: the first access channel corresponds to a 5G network, and the second access channel corresponds to a 4G network. After receiving the two-dimensional video data and the depth data through two access channels (corresponding to two access modes), the MEC decrypts the two-dimensional video data and the depth data, respectively, so as to restore the two-dimensional video data and the depth data into public data for subsequent processing, for example, synchronizing the three-dimensional video data to a service processing server or locally returning the three-dimensional video data to other terminals.
In order to implement the method of the embodiment of the invention, the embodiment of the invention also provides a terminal. Fig. 3 is a first schematic structural component diagram of a terminal according to an embodiment of the present invention, and as shown in fig. 3, the terminal includes:
an obtaining unit 301, configured to obtain three-dimensional video data, where the three-dimensional video data includes two-dimensional video data and depth data;
a determining unit 302, configured to determine a first access channel corresponding to the two-dimensional video data, and determine a second access channel corresponding to the depth data;
a communication unit 303, configured to send the two-dimensional video data by using the first access channel, and send the depth data by using the second access channel.
In one embodiment, the terminal further includes:
an encrypting unit 304, configured to encrypt the two-dimensional video data and the depth data respectively;
an identification unit 305 configured to add first identification information to the encrypted two-dimensional video data and add second identification information to the encrypted depth data;
the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
In an embodiment, the determining unit 302 is configured to determine a first access channel corresponding to the two-dimensional video data based on a first transmission condition that needs to be met by the two-dimensional video data; and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data.
In an embodiment, the determining unit 302 is configured to detect a network status parameter of each network, where different networks correspond to different access channels; determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data; and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data.
In an embodiment, the determining unit 302 is further configured to determine, based on a service type to which the three-dimensional video data belongs, a first transmission condition that the two-dimensional video data needs to satisfy, and a second transmission condition that the depth data needs to satisfy.
In one embodiment, the first access channel corresponds to a first mobile network, and the second access channel corresponds to a second mobile network; or, the first access channel corresponds to a wireless local area network, and the second access channel corresponds to a third mobile network;
wherein the first mobile network and the second mobile network are the same type of access network or different types of access networks.
In the embodiment of the present invention, the determining Unit, the encrypting Unit, and the identifying Unit in the terminal may be implemented by a Processor in the terminal, such as a Central Processing Unit (CPU), a Digital Signal Processor (DSP), a Micro Control Unit (MCU), or a Programmable Gate Array (FPGA) in practical application; the communication unit in the terminal can be realized by a communication module (comprising a basic communication suite, an operating system, a communication module, a standardized interface, a protocol and the like) and a transceiving antenna in practical application; the acquisition unit in the terminal can be realized by a stereo camera, a binocular camera or a structured light camera in practical application, or can be realized by a communication module (comprising a basic communication suite, an operating system, a communication module, a standardized interface, a protocol and the like) and a transmitting-receiving antenna.
It should be noted that: in the terminal provided in the foregoing embodiment, when data transmission is performed, only the division of the program modules is described as an example, and in practical applications, the processing distribution may be completed by different program modules according to needs, that is, the internal structure of the terminal is divided into different program modules to complete all or part of the processing described above. In addition, the terminal and the data transmission method provided by the above embodiments belong to the same concept, and the specific implementation process thereof is described in the method embodiments, which is not described herein again.
Based on the hardware implementation of the above device, an embodiment of the present invention further provides a terminal, fig. 4 is a schematic diagram of a hardware composition structure of the terminal according to the embodiment of the present invention, as shown in fig. 4, the terminal includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor; as a first implementation, the processor at the terminal, when executing the program, implements: acquiring three-dimensional video data, wherein the three-dimensional video data comprises two-dimensional video data and depth data; determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data; and transmitting the two-dimensional video data by using the first access channel, and transmitting the depth data by using the second access channel.
In one embodiment, the processor at the terminal implements, when executing the program: encrypting the two-dimensional video data and the depth data respectively; adding first identification information to the encrypted two-dimensional video data, and adding second identification information to the encrypted depth data; the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
In one embodiment, the processor at the terminal implements, when executing the program: determining a first access channel corresponding to the two-dimensional video data based on a first transmission condition which needs to be met by the two-dimensional video data; and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data.
In one embodiment, the processor at the terminal implements, when executing the program: detecting a first parameter of a transmission channel; and inquiring a mapping relation between a plurality of groups of pre-configured parameters and configuration information based on the first parameter to obtain first configuration information matched with the first parameter.
In one embodiment, the processor at the terminal implements, when executing the program: detecting network state parameters of each network, wherein different networks correspond to different access channels; determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data; and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data.
In one embodiment, the processor at the terminal implements, when executing the program: and determining a first transmission condition which needs to be met by the two-dimensional video data and a second transmission condition which needs to be met by the depth data based on the service type of the three-dimensional video data.
It is understood that the terminal also includes a communication interface; the various components in the terminal are coupled together by a bus system. It will be appreciated that a bus system is used to enable communications among the components. The bus system includes a power bus, a control bus, and a status signal bus in addition to a data bus.
It will be appreciated that the memory in this embodiment can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The described memory for embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.
The method disclosed by the embodiment of the invention can be applied to a processor or realized by the processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The processor described above may be a general purpose processor, a DSP, or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. The processor may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium having a memory and a processor reading the information in the memory and combining the hardware to perform the steps of the method.
The embodiment of the invention also provides a computer storage medium, in particular to a computer readable storage medium. As a first embodiment, when the computer storage medium is located in a terminal, the computer instructions, when executed by the processor, implement: acquiring three-dimensional video data, wherein the three-dimensional video data comprises two-dimensional video data and depth data; determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data; and transmitting the two-dimensional video data by using the first access channel, and transmitting the depth data by using the second access channel.
In one embodiment, the computer instructions, when executed by the processor, implement: encrypting the two-dimensional video data and the depth data respectively; adding first identification information to the encrypted two-dimensional video data, and adding second identification information to the encrypted depth data; the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
In an embodiment, the computer instructions, when executed by a processor, implement determining a first access channel corresponding to the two-dimensional video data based on a first transmission condition that needs to be satisfied by the two-dimensional video data; and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data.
In one embodiment, the computer instructions, when executed by the processor, implement: detecting network state parameters of each network, wherein different networks correspond to different access channels; determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data; and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data.
In one embodiment, the computer instructions, when executed by the processor, implement: and determining a first transmission condition which needs to be met by the two-dimensional video data and a second transmission condition which needs to be met by the depth data based on the service type of the three-dimensional video data.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as one unit, or at least two units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
It should be noted that: the technical schemes described in the embodiments of the present invention can be combined arbitrarily without conflict.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (14)
1. A method of data transmission, the method comprising:
acquiring three-dimensional video data, wherein the three-dimensional video data comprises two-dimensional video data and depth data;
determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data; wherein, different networks correspond to different access channels;
sending the two-dimensional video data by using the first access channel and sending the depth data by using the second access channel, wherein the two-dimensional video data and the depth data are received by a first mobile edge computing server and then are synchronized to a second mobile edge computing server through a virtual tunnel; wherein each frame of RGB image in the two-dimensional video data is aligned with each frame of depth image in the depth data, one frame of RGB image corresponds to one frame of depth image, and the corresponding RGB image and depth image can be synthesized into a three-dimensional image.
2. The method of claim 1, wherein after the acquiring three-dimensional video data, the method further comprises:
encrypting the two-dimensional video data and the depth data respectively;
adding first identification information to the encrypted two-dimensional video data, and adding second identification information to the encrypted depth data;
the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
3. The method of claim 1, wherein determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data comprises:
determining a first access channel corresponding to the two-dimensional video data based on a first transmission condition which needs to be met by the two-dimensional video data;
and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data.
4. The method according to claim 3, wherein the first access channel corresponding to the two-dimensional video data is determined based on a first transmission condition that needs to be satisfied by the two-dimensional video data; determining a second access channel corresponding to the depth data based on a second transmission condition that the depth data needs to satisfy, including:
detecting network state parameters of each network, wherein different networks correspond to different access channels;
determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data;
and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data.
5. The method according to claim 3 or 4, characterized in that the method further comprises:
and determining a first transmission condition which needs to be met by the two-dimensional video data and a second transmission condition which needs to be met by the depth data based on the service type of the three-dimensional video data.
6. The method of claim 1, wherein the first access channel corresponds to a first mobile network and the second access channel corresponds to a second mobile network; or, the first access channel corresponds to a wireless local area network, and the second access channel corresponds to a third mobile network;
wherein the first mobile network and the second mobile network are the same type of access network or different types of access networks.
7. A terminal, characterized in that the terminal comprises:
an acquisition unit configured to acquire three-dimensional video data including two-dimensional video data and depth data;
the determining unit is used for determining a first access channel corresponding to the two-dimensional video data and determining a second access channel corresponding to the depth data; wherein, different networks correspond to different access channels;
a communication unit, configured to send the two-dimensional video data through the first access channel and send the depth data through the second access channel, where the two-dimensional video data and the depth data are received by a first mobile edge computing server and then synchronized to a second mobile edge computing server through a virtual tunnel; wherein each frame of RGB image in the two-dimensional video data is aligned with each frame of depth image in the depth data, one frame of RGB image corresponds to one frame of depth image, and the corresponding RGB image and depth image can be synthesized into a three-dimensional image.
8. The terminal of claim 7, further comprising:
an encryption unit configured to encrypt the two-dimensional video data and the depth data, respectively;
the identification unit is used for adding first identification information on the encrypted two-dimensional video data and adding second identification information on the encrypted depth data;
the first identification information is used for identifying that the two-dimensional video data is carried in the first access channel, and the second identification information is used for identifying that the depth data is carried in the second access channel.
9. The terminal according to claim 7, wherein the determining unit is configured to determine a first access channel corresponding to the two-dimensional video data based on a first transmission condition that needs to be satisfied by the two-dimensional video data; and determining a second access channel corresponding to the depth data based on a second transmission condition which needs to be met by the depth data.
10. The terminal according to claim 9, wherein the determining unit is configured to detect network status parameters of each network, and different networks correspond to different access channels; determining a first network meeting the first transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the first network as a first access channel corresponding to the two-dimensional video data; and determining a second network meeting the second transmission condition based on the network state parameters of the networks, and taking an access channel corresponding to the second network as a second access channel corresponding to the depth data.
11. The terminal according to claim 9 or 10, wherein the determining unit is further configured to determine a first transmission condition that the two-dimensional video data needs to satisfy and a second transmission condition that the depth data needs to satisfy based on a service type to which the three-dimensional video data belongs.
12. The terminal of claim 7, wherein the first access channel corresponds to a first mobile network, and wherein the second access channel corresponds to a second mobile network; or, the first access channel corresponds to a wireless local area network, and the second access channel corresponds to a third mobile network;
wherein the first mobile network and the second mobile network are the same type of access network or different types of access networks.
13. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
14. A terminal, characterized in that the terminal comprises: a processor and a memory for storing a computer program capable of running on the processor,
wherein the processor is adapted to perform the steps of the method of any one of claims 1 to 6 when running the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810443886.5A CN108495112B (en) | 2018-05-10 | 2018-05-10 | Data transmission method, terminal and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810443886.5A CN108495112B (en) | 2018-05-10 | 2018-05-10 | Data transmission method, terminal and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108495112A CN108495112A (en) | 2018-09-04 |
| CN108495112B true CN108495112B (en) | 2020-12-22 |
Family
ID=63352775
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810443886.5A Active CN108495112B (en) | 2018-05-10 | 2018-05-10 | Data transmission method, terminal and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108495112B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109413494A (en) * | 2018-09-30 | 2019-03-01 | Oppo广东移动通信有限公司 | Data processing method, terminal, server and storage medium |
| CN112672132B (en) * | 2018-09-30 | 2023-12-26 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN109413409B (en) * | 2018-09-30 | 2020-12-22 | Oppo广东移动通信有限公司 | Data processing method, MEC server and terminal equipment |
| CN109274976B (en) * | 2018-09-30 | 2021-07-20 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN109345623B (en) * | 2018-09-30 | 2023-12-08 | Oppo广东移动通信有限公司 | Model verification method, server and computer storage medium |
| CN109257588A (en) * | 2018-09-30 | 2019-01-22 | Oppo广东移动通信有限公司 | A kind of data transmission method, terminal, server and storage medium |
| CN109257609B (en) * | 2018-09-30 | 2021-04-23 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN109389674B (en) * | 2018-09-30 | 2021-08-13 | Oppo广东移动通信有限公司 | Data processing method and device, MEC server and storage medium |
| CN109495938B (en) * | 2018-12-21 | 2020-02-21 | 西安电子科技大学 | Network switching method based on multi-access edge calculation |
| CN111225219B (en) * | 2019-11-26 | 2021-12-14 | 深圳英伦科技股份有限公司 | Light field three-dimensional immersion experience information transmission method and system based on 5G network |
| CN115868207A (en) * | 2020-05-28 | 2023-03-28 | 高通股份有限公司 | Method for establishing protocol data unit conversation |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2409008C2 (en) * | 2005-06-23 | 2011-01-10 | Конинклейке Филипс Электроникс Н.В. | Combined transfer of image and appropriate data on depth |
| CN103795996B (en) * | 2012-11-01 | 2016-08-03 | 上海贝尔股份有限公司 | 3D delivery of video method and apparatus |
| CN105992201A (en) * | 2016-04-01 | 2016-10-05 | 努比亚技术有限公司 | Data transmission terminal, method and system |
| CN106027492A (en) * | 2016-04-29 | 2016-10-12 | 努比亚技术有限公司 | Data transmission terminal and method |
| CN107396416B (en) * | 2017-06-21 | 2020-06-19 | 深圳市盛路物联通讯技术有限公司 | Communication control method and system based on data type |
-
2018
- 2018-05-10 CN CN201810443886.5A patent/CN108495112B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108495112A (en) | 2018-09-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108495112B (en) | Data transmission method, terminal and computer storage medium | |
| US11902090B2 (en) | Data packaging protocols for communications between IoT devices | |
| CN109600246B (en) | Network slice management method and device | |
| CN113596191B (en) | Data processing method, network element equipment and readable storage medium | |
| CN107071039B (en) | A kind of private data cloud storage system and private data cloud storage method | |
| CN106789526B (en) | method and device for connecting multiple system networks | |
| CN111277543A (en) | Information synchronization method, authentication method and device | |
| CN104619040A (en) | Method and system for quickly connecting WIFI equipment | |
| CN114339719B (en) | DPI data acquisition method and related device | |
| WO2020063170A1 (en) | Data processing method, terminal, server and storage medium | |
| CN109410319B (en) | Data processing method, server and computer storage medium | |
| Priya et al. | Mobile edge communication an overview of MEC in 5G | |
| CN105656978A (en) | Resource sharing method and device | |
| WO2020063171A1 (en) | Data transmission method, terminal, server and storage medium | |
| CN109413405B (en) | Data processing method, terminal, server and computer storage medium | |
| CN108632376B (en) | Data processing method, terminal, server and computer storage medium | |
| WO2020063168A1 (en) | Data processing method, terminal, server and computer storage medium | |
| CN116708358A (en) | P2P traversing method, device and storage medium | |
| CN109147043B (en) | Data processing method, server and computer storage medium | |
| WO2020062919A1 (en) | Data processing method, mec server and terminal device | |
| CN109246409B (en) | Data processing method, terminal, server and computer storage medium | |
| CN109151435B (en) | Data processing method, terminal, server and computer storage medium | |
| CN114039946A (en) | Message transmission method and device, electronic device and storage medium | |
| CN108737807B (en) | Data processing method, terminal, server and computer storage medium | |
| EP2922338A1 (en) | Method and apparatus for providing content according to type of communication network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |