CN109257588A - Data transmission method, terminal, server and storage medium - Google Patents
Data transmission method, terminal, server and storage medium Download PDFInfo
- Publication number
- CN109257588A CN109257588A CN201811162929.9A CN201811162929A CN109257588A CN 109257588 A CN109257588 A CN 109257588A CN 201811162929 A CN201811162929 A CN 201811162929A CN 109257588 A CN109257588 A CN 109257588A
- Authority
- CN
- China
- Prior art keywords
- data
- depth data
- depth
- dimensional video
- difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 92
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000004891 communication Methods 0.000 claims description 41
- 238000004590 computer program Methods 0.000 claims description 7
- 230000002194 synthesizing effect Effects 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 10
- 238000010295 mobile communication Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/222—Secondary servers, e.g. proxy server, cable television Head-end
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Description
技术领域technical field
本申请涉及数据传输技术,涉及但不限于一种数据传输方法、终端、服务器和存储介质。This application relates to data transmission technology, and relates to, but is not limited to, a data transmission method, terminal, server and storage medium.
背景技术Background technique
随着移动通信网络的不断发展,移动通信网络的传输速率飞速提高,从而给三维视频业务的产生和发展提供了有力的技术支持。三维视频数据包括二维视频数据(例如RGB数据)和深度数据(Depth 数据),而三维视频数据的传输是分别传输二维视频数据和深度数据。在三维视频数据的传输过程中由于对于每帧图像,都需要传输Depth 数据,这个数据量是非常大。所以对于如此大量的数据全部传输时,势必会对传输速度、传输的正确率造成影响。With the continuous development of the mobile communication network, the transmission rate of the mobile communication network is rapidly increasing, thus providing strong technical support for the generation and development of the 3D video service. The three-dimensional video data includes two-dimensional video data (eg, RGB data) and depth data (Depth data), and the transmission of the three-dimensional video data is to transmit the two-dimensional video data and the depth data respectively. In the transmission process of 3D video data, since each frame of image needs to transmit Depth data, the amount of this data is very large. Therefore, when such a large amount of data is fully transmitted, it will inevitably affect the transmission speed and the accuracy of transmission.
发明内容SUMMARY OF THE INVENTION
为解决上述技术问题,本申请实施例提供了一种数据传输方法、终端、服务器和存储介质。To solve the above technical problems, embodiments of the present application provide a data transmission method, a terminal, a server, and a storage medium.
本申请实施例的技术方案是这样实现的:The technical solutions of the embodiments of the present application are implemented as follows:
本申请实施例提供一种数据传输方法,所述方法包括:The embodiment of the present application provides a data transmission method, the method includes:
获取待传输的三维视频数据中的深度数据和二维视频数据;Acquiring depth data and two-dimensional video data in the three-dimensional video data to be transmitted;
针对每帧的深度数据,将深度数据和预设的深度数据进行比对,确定所述深度数据与所述预设的深度数据之间的差异数据;For the depth data of each frame, compare the depth data with the preset depth data, and determine the difference data between the depth data and the preset depth data;
向移动边缘计算(Mobile Edge Computing,MEC)服务器发送待传输的三维视频数据中的二维视频数据,并发送所述差异数据。The two-dimensional video data in the three-dimensional video data to be transmitted is sent to a mobile edge computing (Mobile Edge Computing, MEC) server, and the difference data is sent.
在上述方案中,所述针对每帧的深度数据,将深度数据和预设的深度数据进行比对,确定深度数据与所述预设的深度数据之间的差异数据,包括:In the above solution, the depth data for each frame is compared with the preset depth data, and the difference data between the depth data and the preset depth data is determined, including:
针对所述每帧的深度数据,将当前帧的深度数据和所述当前帧的前一帧的深度数据进行比对,确定所述当前帧的深度数据和所述前一帧的深度数据之间的差异数据;For the depth data of each frame, compare the depth data of the current frame with the depth data of the previous frame of the current frame, and determine the difference between the depth data of the current frame and the depth data of the previous frame difference data;
对应地,所述向移动边缘计算服务器发送待传输的三维视频数据中的二维视频数据,并发送所述差异数据,包括:Correspondingly, the sending of the two-dimensional video data in the three-dimensional video data to be transmitted to the mobile edge computing server, and sending the difference data, includes:
向所述MEC服务器发送每一帧的二维视频数据和所述差异数据。The two-dimensional video data of each frame and the difference data are sent to the MEC server.
在上述方案中,在所述输出所述差异数据之后,所述方法还包括:In the above solution, after the outputting the difference data, the method further includes:
获取所述差异数据对应的下一帧的深度数据;obtaining the depth data of the next frame corresponding to the difference data;
如果所述下一帧的深度数据与所述差异数据对应的深度数据不同,传输所述下一帧的深度数据。If the depth data of the next frame is different from the depth data corresponding to the difference data, the depth data of the next frame is transmitted.
本申请实施例还提供了一种数据传输方法,应用与MEC服务器,所述方法包括:The embodiment of the present application also provides a data transmission method, which is applied to the MEC server, and the method includes:
接收终端发送的差异数据和二维视频数据;Receive the difference data and two-dimensional video data sent by the terminal;
根据所述差异数据恢复待传输的三维视频数据中的深度数据;Restoring the depth data in the 3D video data to be transmitted according to the difference data;
将所述深度数据和二维视频数据合成为三维视频数据。The depth data and the two-dimensional video data are synthesized into three-dimensional video data.
在上述方案中,在所述将所述深度数据和二维视频数据合成为三维视频数据之前,所述方法还包括:In the above solution, before synthesizing the depth data and the two-dimensional video data into three-dimensional video data, the method further includes:
接收差异数据和二维视频数据;Receive difference data and 2D video data;
根据所述差异数据至少恢复出当前帧的深度数据;At least restore the depth data of the current frame according to the difference data;
将所述当前帧的深度数据、预设的深度数据和所述二维视频数据合成为三维视频数据。The depth data of the current frame, the preset depth data and the two-dimensional video data are synthesized into three-dimensional video data.
本申请实施例还提供了一种终端,所述终端包括:获取单元、第一数据传输单元和第一通信单元;其中,An embodiment of the present application further provides a terminal, where the terminal includes: an acquisition unit, a first data transmission unit, and a first communication unit; wherein,
所述获取单元,用于获取待传输的三维视频数据中的深度数据和二维视频数据;The acquisition unit is used to acquire depth data and two-dimensional video data in the three-dimensional video data to be transmitted;
所述第一数据传输单元,用于针对每帧的深度数据,将深度数据和预设的深度数据进行比对,确定所述深度数据与所述预设的深度数据之间的差异数据;The first data transmission unit is configured to compare the depth data with the preset depth data for the depth data of each frame, and determine the difference data between the depth data and the preset depth data;
所述第一通信单元,用于向移动边缘计算MEC服务器发送待传输的三维视频数据中的二维视频数据,并发送所述差异数据。The first communication unit is configured to send the two-dimensional video data in the three-dimensional video data to be transmitted to the mobile edge computing MEC server, and send the difference data.
在上述方案中,所述第一数据传输单元,用于针对所述每帧的深度数据,将当前帧的深度数据和所述当前帧的前一帧的深度数据进行比对,确定所述当前帧的深度数据和所述前一帧的深度数据之间的差异数据;In the above solution, the first data transmission unit is configured to compare the depth data of the current frame with the depth data of the previous frame of the current frame for the depth data of each frame, and determine the current frame. difference data between the depth data of the frame and the depth data of the previous frame;
对应地,所述第一通信单元,用于向所述MEC服务器发送每一帧的二维视频数据和所述差异数据。Correspondingly, the first communication unit is configured to send the two-dimensional video data of each frame and the difference data to the MEC server.
在上述方案中,所述获取单元,还用于获取所述差异数据对应的下一帧的深度数据;In the above solution, the obtaining unit is further configured to obtain the depth data of the next frame corresponding to the difference data;
所述第一通信单元,还用于如果所述下一帧的深度数据与所述差异数据对应的深度数据不同,传输所述下一帧的深度数据。The first communication unit is further configured to transmit the depth data of the next frame if the depth data of the next frame is different from the depth data corresponding to the difference data.
本申请实施例还提供了一种MEC服务器,所述服务器包括第二通信单元和第二数据传输单元;其中,An embodiment of the present application further provides an MEC server, where the server includes a second communication unit and a second data transmission unit; wherein,
所述第二通信单元,用于接收终端发送的差异数据和二维视频数据;The second communication unit is used for receiving difference data and two-dimensional video data sent by the terminal;
所述第二数据传输单元,用于根据所述差异数据恢复待传输的三维视频数据中的深度数据;还用于将所述深度数据和二维视频数据合成为三维视频数据。The second data transmission unit is configured to restore the depth data in the three-dimensional video data to be transmitted according to the difference data; and is further configured to synthesize the depth data and the two-dimensional video data into three-dimensional video data.
在上述方案中,所述第二通信单元,还用于接收差异数据和二维视频数据;In the above solution, the second communication unit is further configured to receive difference data and two-dimensional video data;
所述第二数据传输单元,还用于根据所述差异数据至少恢复出当前帧的深度数据;还用于将所述当前帧的深度数据、预设的深度数据和所述二维视频数据合成为三维视频数据。The second data transmission unit is also used to restore at least the depth data of the current frame according to the difference data; and is also used to synthesize the depth data of the current frame, the preset depth data and the two-dimensional video data for 3D video data.
本申请实施例还提供了一种计算机存储介质,其上存储有计算机指令,该指令被处理器执行时实现本申请实施例所述的应用于终端的数据传输方法的步骤;或者,该指令被处理器执行时实现本申请实施例所述的应用于MEC服务器的数据传输方法的步骤。The embodiments of the present application further provide a computer storage medium, on which computer instructions are stored, and when the instructions are executed by the processor, implement the steps of the data transmission method applied to the terminal described in the embodiments of the present application; or, the instructions are When executed by the processor, the steps of the data transmission method applied to the MEC server described in the embodiments of the present application are implemented.
本申请实施例还提供了一种终端,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现本申请实施例所述的应用于终端的数据传输方法的步骤。Embodiments of the present application further provide a terminal, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the applications described in the embodiments of the present application when the processor executes the program Steps of a data transmission method for a terminal.
本申请实施例还提供了一种MEC服务器,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现本申请实施例所述的应用于MEC服务器的数据传输方法的步骤。Embodiments of the present application further provide an MEC server, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the methods described in the embodiments of the present application when the processor executes the program. Steps of the data transfer method applied to the MEC server.
本申请实施例提供一种数据传输方法、终端、服务器和存储介质,其中,首先,获取待传输的三维视频数据中的深度数据和二维视频数据;然后,针对每帧的深度数据,将深度数据和预设的深度数据进行比对,确定所述深度数据与所述预设的深度数据之间的差异数据;最后,向移动边缘计算MEC服务器发送待传输的三维视频数据中的二维视频数据,并发送所述差异数据。采用本申请实施例的技术方案,通过从终端仅传输有差异的深度数据,从而大大减少了深度数据的传输量,提高了网络的流畅度。Embodiments of the present application provide a data transmission method, terminal, server, and storage medium, wherein, first, depth data and two-dimensional video data in three-dimensional video data to be transmitted are acquired; then, for the depth data of each frame, the depth The data is compared with the preset depth data, and the difference data between the depth data and the preset depth data is determined; finally, the two-dimensional video in the three-dimensional video data to be transmitted is sent to the mobile edge computing MEC server. data, and send the difference data. By adopting the technical solutions of the embodiments of the present application, by transmitting only different depth data from the terminal, the transmission amount of the depth data is greatly reduced, and the fluency of the network is improved.
附图说明Description of drawings
图1为本申请实施例的数据传输方法应用的系统架构示意图;1 is a schematic diagram of a system architecture to which a data transmission method according to an embodiment of the present application is applied;
图2为本申请实施例的数据传输方法的实现流程示意图;FIG. 2 is a schematic flowchart of an implementation of a data transmission method according to an embodiment of the present application;
图3为本申请实施例的数据传输方法的实现交互图;FIG. 3 is an implementation interaction diagram of a data transmission method according to an embodiment of the present application;
图4为本申请实施例的终端的一种组成结构示意图;FIG. 4 is a schematic diagram of a composition structure of a terminal according to an embodiment of the present application;
图5为本申请实施例的服务器的组成结构示意图;5 is a schematic diagram of a composition structure of a server according to an embodiment of the present application;
图6为本申请实施例的数据传输设备的硬件组成结构示意图。FIG. 6 is a schematic structural diagram of a hardware composition of a data transmission device according to an embodiment of the present application.
具体实施方式Detailed ways
在对本申请实施例的技术方案进行详细说明之前,首先对本申请实施例的数据传输方法应用的系统架构进行简单说明。本申请实施例的数据传输方法应用于三维视频数据的相关业务,该业务例如是三维视频数据分享的业务,或者基于三维视频数据的直播业务等等。在这种情况下,由于三维视频数据的数据量较大,分别传输的深度数据和二维视频数据在数据传输过程中需要较高的技术支持,因此需要移动通信网络具有较快的数据传输速率,以及较稳定的数据传输环境。Before the technical solutions of the embodiments of the present application are described in detail, the system architecture to which the data transmission methods of the embodiments of the present application are applied is briefly described first. The data transmission method in the embodiment of the present application is applied to a service related to 3D video data, such as a 3D video data sharing service, or a live broadcast service based on 3D video data, and the like. In this case, due to the large amount of 3D video data, the depth data and 2D video data transmitted respectively require high technical support in the data transmission process, so the mobile communication network needs to have a faster data transmission rate , and a more stable data transmission environment.
图1为本申请实施例的数据传输方法应用的系统架构示意图;如图1所示,系统可包括终端、基站、MEC服务器、业务处理服务器、核心网和互联网(Internet)等;MEC服务器与业务处理服务器之间通过核心网建立高速通道以实现数据同步。FIG. 1 is a schematic diagram of a system architecture of the application of the data transmission method according to the embodiment of the application; as shown in FIG. 1 , the system may include a terminal, a base station, an MEC server, a service processing server, a core network, and the Internet (Internet), etc.; the MEC server and the service A high-speed channel is established between the processing servers through the core network to achieve data synchronization.
以图1所示的两个终端交互的应用场景为例,MEC服务器A为部署于靠近终端A(发送端)的MEC服务器,核心网A为终端A所在区域的核心网;相应的,MEC服务器B为部署于靠近终端B(接收端)的MEC服务器,核心网B为终端B所在区域的核心网;MEC 服务器A和MEC服务器B可与业务处理服务器之间分别通过核心网 A和核心网B建立高速通道以实现数据同步。Taking the application scenario of the interaction between two terminals shown in Figure 1 as an example, the MEC server A is the MEC server deployed near the terminal A (sender), and the core network A is the core network in the area where the terminal A is located; correspondingly, the MEC server B is the MEC server deployed near the terminal B (receiving end), and the core network B is the core network in the area where the terminal B is located; Establish high-speed channels for data synchronization.
其中,终端A发送的三维视频数据传输到MEC服务器A后,由 MEC服务器A通过核心网A将数据同步至业务处理服务器;再由 MEC服务器B从业务处理服务器获取终端A发送的三维视频数据,并发送至终端B进行呈现。Wherein, after the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A synchronizes the data to the service processing server through core network A; and then MEC server B obtains the 3D video data sent by terminal A from the service processing server, and sent to terminal B for presentation.
这里,如果终端B与终端A通过同一个MEC服务器来实现传输,此时终端B和终端A直接通过一个MEC服务器实现三维视频数据的传输,不需要业务处理服务器的参与,这种方式称为本地回传方式。具体地,假设终端B与终端A通过MEC服务器A实现三维视频数据的传输,终端A发送的三维视频数据传输到MEC服务器A后,由 MEC服务器A发送三维视频数据至终端B进行呈现。Here, if terminal B and terminal A realize transmission through the same MEC server, then terminal B and terminal A directly realize the transmission of 3D video data through an MEC server without the participation of the service processing server. This method is called local return method. Specifically, it is assumed that terminal B and terminal A transmit 3D video data through MEC server A. After the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A sends the 3D video data to terminal B for presentation.
这里,终端可基于网络情况、或者终端自身的配置情况、或者自身配置的算法选择接入4G网络的演进型基站(eNB),或者接入5G 网络的下一代演进型基站(gNB),从而使得eNB通过长期演进(Long Term Evolution,LTE)接入网与MEC服务器连接,使得gNB通过下一代接入网(NG-RAN)与MEC服务器连接。Here, the terminal may select an evolved base station (eNB) to access the 4G network, or a next-generation evolved base station (gNB) to access the 5G network based on the network conditions, or the configuration of the terminal itself, or an algorithm configured by itself, so that the The eNB is connected to the MEC server through a Long Term Evolution (Long Term Evolution, LTE) access network, so that the gNB is connected to the MEC server through a Next Generation Access Network (NG-RAN).
这里,MEC服务器部署于靠近终端或数据源头的网络边缘侧,所谓靠近终端或者靠近数据源头,不仅是逻辑位置上,还在地理位置上靠近终端或者靠近数据源头。区别于现有的移动通信网络中主要的业务处理服务器部署于几个大城市中,MEC服务器可在一个城市中部署多个。例如在某写字楼中,用户较多,则可在该写字楼附近部署一个MEC服务器。Here, the MEC server is deployed on the edge of the network close to the terminal or data source. The so-called close to the terminal or close to the data source is not only logically located, but also geographically close to the terminal or close to the data source. Different from the existing mobile communication network where the main service processing servers are deployed in several large cities, multiple MEC servers can be deployed in one city. For example, in an office building with many users, an MEC server can be deployed near the office building.
其中,MEC服务器作为具有融合网络、计算、存储、应用核心能力的边缘计算网关,为边缘计算提供包括设备域、网络域、数据域和应用域的平台支撑。其联接各类智能设备和传感器,就近提供智能联接和数据传输业务,让不同类型的应用和数据在MEC服务器中进行处理,实现业务实时、业务智能、数据聚合与互操作、安全与隐私保护等关键智能服务,有效提升业务的智能决策效率。Among them, the MEC server, as an edge computing gateway with core capabilities of integrating network, computing, storage and application, provides platform support for edge computing including device domain, network domain, data domain and application domain. It connects various smart devices and sensors, provides smart connection and data transmission services nearby, and allows different types of applications and data to be processed in the MEC server to achieve real-time business, business intelligence, data aggregation and interoperability, security and privacy protection, etc. Key intelligent services can effectively improve the efficiency of intelligent business decision-making.
下面结合附图及具体实施例对本申请作进一步详细的说明。The present application will be described in further detail below with reference to the accompanying drawings and specific embodiments.
本申请实施例提供了一种数据传输方法,应用于终端中,终端可以是例如手机、平板电脑等移动终端,也可以是电脑等类型的终端。图2为本申请实施例的数据传输方法的实现流程示意图;如图2所示,所述方法包括以下步骤:The embodiment of the present application provides a data transmission method, which is applied to a terminal, and the terminal may be a mobile terminal such as a mobile phone and a tablet computer, or a terminal of a type such as a computer. FIG. 2 is a schematic flowchart of the implementation of a data transmission method according to an embodiment of the present application; as shown in FIG. 2 , the method includes the following steps:
步骤S201,获取待传输的三维视频数据中的深度数据和二维视频数据。Step S201, acquiring depth data and two-dimensional video data in the three-dimensional video data to be transmitted.
这里,可以是采集待传输的三维视频数据中的深度数据,还可以是接收到其他设备发送的该深度数据。Here, the depth data in the 3D video data to be transmitted may be collected, or the depth data sent by other devices may be received.
步骤S202,针对每帧的深度数据,将深度数据和预设的深度数据进行比对,确定所述深度数据与所述预设的深度数据之间的差异数据。Step S202, for the depth data of each frame, compare the depth data with the preset depth data, and determine the difference data between the depth data and the preset depth data.
这里,在三维视频数据中包含M帧深度数据,逐个比较每一帧的深度数据与预设的深度数据是否相同,如果不同,即确定二者之间的差异数据;然后将该差异数据传输给MEC服务器。如果深度数据与预设的深度数据相同,那么将不传输该深度数据,或者是仅传输一个用于表明二者相同的信息,不会增加数据的传输量。Here, M frames of depth data are included in the 3D video data, and the depth data of each frame is compared with the preset depth data one by one. If they are different, the difference data between the two is determined; then the difference data is transmitted to MEC server. If the depth data is the same as the preset depth data, the depth data will not be transmitted, or only one piece of information to indicate that the two are the same will not be transmitted, and the amount of data transmission will not be increased.
步骤S203,向移动边缘计算MEC服务器发送待传输的三维视频数据中的二维视频数据,并发送所述差异数据。Step S203: Send the two-dimensional video data in the three-dimensional video data to be transmitted to the mobile edge computing MEC server, and send the difference data.
这里,仅将二维视频数据传输给MEC服务器和差异数据传输给 MEC服务器。所述差异数据可以理解为是深度数据对应的像素与预设的深度数据对应的像素之间的差异。Here, only two-dimensional video data and difference data are transmitted to the MEC server. The difference data can be understood as the difference between the pixels corresponding to the depth data and the pixels corresponding to the preset depth data.
也就是说,终端向MEC服务器传输深度数据时,并不是将每一帧深度数据都完整的传输到MEC服务器,仅仅将与预设的深度数据有差异的差异数据,传输给MEC服务器,如此,MEC服务器可以根据差异数据恢复出对应的深度数据,然后根据深度数据和二维视频数据合成三维视频数据。That is to say, when the terminal transmits the depth data to the MEC server, it does not transmit the complete depth data of each frame to the MEC server, but only transmits the difference data that is different from the preset depth data to the MEC server. In this way, The MEC server can recover the corresponding depth data according to the difference data, and then synthesize the 3D video data according to the depth data and the 2D video data.
在实施例中,仅将深度数据之间的差异数据传输给MEC服务器,减少了深度数据的传输量,提升了网络流畅度。In the embodiment, only the difference data between the depth data is transmitted to the MEC server, which reduces the transmission amount of the depth data and improves the network fluency.
本实施例中,作为一种实施方式,所述获得三维视频数据,包括:所述终端从至少能够采集深度数据的采集组件获得三维视频数据;所述采集组件能够与至少一个终端建立通信链路以使对应终端获得所述三维视频数据。In this embodiment, as an implementation manner, the obtaining of 3D video data includes: the terminal obtains 3D video data from a collection component capable of collecting at least depth data; the collection component can establish a communication link with at least one terminal so that the corresponding terminal obtains the three-dimensional video data.
本实施方式中,由于能够采集深度数据的采集组件相对比较昂贵,终端并不具备三维视频数据的采集功能,而是通过独立于终端的采集组件采集三维视频数据,再通过采集组件和终端中的通信组件建立通信链路,使得终端获得采集组件采集的三维视频数据。其中,所述采集组件具体可通过以下至少之一实现:深度摄像头、双目摄像头、3D 结构光摄像模组、飞行时间(TOF,Time Of Flight)摄像模组。In this embodiment, since the acquisition component capable of collecting depth data is relatively expensive, the terminal does not have the function of collecting 3D video data, but collects the 3D video data through the acquisition component independent of the terminal, and then collects the 3D video data through the acquisition component and the terminal in the terminal. The communication component establishes a communication link, so that the terminal obtains the three-dimensional video data collected by the collection component. Wherein, the acquisition component can be specifically implemented by at least one of the following: a depth camera, a binocular camera, a 3D structured light camera module, and a Time Of Flight (TOF, Time Of Flight) camera module.
这里,采集组件能够与至少一个终端建立通信链路以将采集得到的三维视频数据传输至所述至少一个终端,以使对应终端获得三维视频数据,这样能够实现一个采集组件采集的三维视频数据共享给至少一个终端,从而实现采集组件的共享。Here, the collection component can establish a communication link with at least one terminal to transmit the collected 3D video data to the at least one terminal, so that the corresponding terminal can obtain the 3D video data, so that the 3D video data collected by one collection component can be shared. To at least one terminal, so as to realize the sharing of acquisition components.
作为另一种实施方式,终端自身具备三维视频数据的采集功能,可以理解,终端设置有至少能够采集深度数据的采集组件,例如设置有以下组件至少之一:深度摄像头、双目摄像头、3D结构光摄像模组、TOF摄像模组,以采集三维视频数据。As another embodiment, the terminal itself has the function of collecting 3D video data. It can be understood that the terminal is provided with a collection component capable of collecting depth data at least, for example, at least one of the following components is provided: a depth camera, a binocular camera, a 3D structure Optical camera module and TOF camera module to collect 3D video data.
其中,获得的三维视频数据包括二维视频数据和深度数据;所述二维视频数据用于表征平面图像,例如可以是RGB数据;深度数据表征采集组件所针对的采集对象的表面与采集组件之间的距离。Wherein, the obtained three-dimensional video data includes two-dimensional video data and depth data; the two-dimensional video data is used to represent a plane image, such as RGB data; distance between.
本申请实施例又提供一种数据传输方法,图3为本申请实施例的数据传输方法的实现交互图,如图3所示,所述方法包括以下步骤:An embodiment of the present application further provides a data transmission method. FIG. 3 is an implementation interaction diagram of the data transmission method according to an embodiment of the present application. As shown in FIG. 3 , the method includes the following steps:
步骤S301,终端获取待传输的三维视频数据中的深度数据和二维视频数据。Step S301, the terminal acquires depth data and two-dimensional video data in the three-dimensional video data to be transmitted.
这里,所述步骤S301可以是,终端通过结构光采集待传输的三维视频数据中的深度数据,也可以是其他设备将所述深度数据传输给所述终端。Here, the step S301 may be that the terminal collects the depth data in the 3D video data to be transmitted through structured light, or another device transmits the depth data to the terminal.
步骤S302,终端针对所述每帧的深度数据,将当前帧的深度数据和所述当前帧的前一帧的深度数据进行比对,确定所述当前帧的深度数据和所述前一帧的深度数据之间的差异数据。Step S302, the terminal compares the depth data of the current frame with the depth data of the previous frame of the current frame for the depth data of each frame, and determines the depth data of the current frame and the depth data of the previous frame. Difference data between depth data.
这里,比如,深度数据一共有100帧,针对其中的每一帧,先将第一帧深度数据完整的传输给MEC服务器,然后,将第二帧深度数据与第一帧深度数据进行比对,并确定二者之间的差异数据,将该差异数据传输给MEC服务器,也就是说,在本实施例中,传输第二帧深度数据时,其实传输的是第二帧深度数据与第一帧深度数据之间的差异数据。Here, for example, there are a total of 100 frames of depth data. For each frame, the first frame of depth data is completely transmitted to the MEC server, and then the second frame of depth data is compared with the first frame of depth data. And determine the difference data between the two, and transmit the difference data to the MEC server, that is, in this embodiment, when transmitting the depth data of the second frame, what is actually transmitted is the depth data of the second frame and the first frame. Difference data between depth data.
步骤S303,终端向所述MEC服务器发送每一帧的二维视频数据和所述差异数据。Step S303, the terminal sends the two-dimensional video data of each frame and the difference data to the MEC server.
这里,终端将每一帧的二维视频数据都发送给MEC服务器,并且将每相邻两帧之间的差异数据发送给MEC服务器。在步骤S303 之后,本申请实施例还包括:获取所述差异数据对应的下一帧的深度数据;如果所述下一帧的深度数据与所述差异数据对应的深度数据不同,传输所述下一帧的深度数据。也就是说,在第二帧深度数据与第一帧深度数据不同,向MEC服务器传输了二者之间差异数据的基础上,如果第三帧深度数据与第二帧深度数据也不同,可以是直接传输完整的第三帧深度数据,还可以是传输第三帧深度数据与第二帧深度数据之间的差异数据。Here, the terminal sends the two-dimensional video data of each frame to the MEC server, and sends the difference data between each adjacent two frames to the MEC server. After step S303, the embodiment of the present application further includes: acquiring the depth data of the next frame corresponding to the difference data; if the depth data of the next frame is different from the depth data corresponding to the difference data, transmitting the next frame. One frame of depth data. That is to say, on the basis that the depth data of the second frame is different from the depth data of the first frame, and the difference data between the two is transmitted to the MEC server, if the depth data of the third frame is also different from the depth data of the second frame, it can be The complete third frame of depth data may be directly transmitted, or difference data between the third frame of depth data and the second frame of depth data may be transmitted.
步骤S304,MEC服务器接收差异数据和二维视频数据。Step S304, the MEC server receives the difference data and the two-dimensional video data.
这里,所述差异数据即为当前帧的深度数据与前一帧的深度数据之间的差异数据。所述差异数据可以理解为当前帧的深度数据对应的像素与前一帧的深度数据对应的像素的差。Here, the difference data is the difference data between the depth data of the current frame and the depth data of the previous frame. The difference data can be understood as the difference between the pixels corresponding to the depth data of the current frame and the pixels corresponding to the depth data of the previous frame.
步骤S305,MEC服务器根据所述差异数据恢复待传输的三维视频数据中的深度数据。Step S305, the MEC server restores the depth data in the 3D video data to be transmitted according to the difference data.
步骤S306,MEC服务器将所述深度数据和二维视频数据合成为三维视频数据。Step S306, the MEC server synthesizes the depth data and the two-dimensional video data into three-dimensional video data.
在本申请实施例中,终端将二维视频数据和当前帧的深度数据与前一帧的深度数据之间的差异数据,而不是完整的两帧深度数据,传输给MEC服务器,从而大大减少了数据传输量,提升了网络传输速度。In the embodiment of the present application, the terminal transmits the two-dimensional video data and the difference data between the depth data of the current frame and the depth data of the previous frame to the MEC server, instead of the complete depth data of the two frames, thereby greatly reducing the The amount of data transmission increases the network transmission speed.
在相关技术中传输三维视频数据时,分别传输的深度数据和二维视频数据在数据传输过程中需要较高的技术支持,因此需要移动通信网络具有较快的数据传输速率,以及较稳定的数据传输环境。但是由于对于每帧图像,都需要传输Depth数据,这个数据量是非常大,导致网络数据传输量过大,网络拥堵等。When transmitting 3D video data in the related art, the depth data and 2D video data transmitted respectively require high technical support in the data transmission process, so the mobile communication network is required to have a fast data transmission rate and a relatively stable data transmission rate. transmission environment. However, since each frame of image needs to transmit Depth data, the amount of data is very large, resulting in excessive network data transmission and network congestion.
基于此,本申请实施例提供一种数据传输方法,适用与较低速,静态建模的场景中,在将二维视频数据和深度数据从终端传输到 MEC服务器之前,对深度数据进行的预处理,非压缩的方式通过比较三维视频数据中当前帧的深度数据的像素和前一帧的深度数据的像素之间的差异,并得到该差异数据,然后将该差异数据通过高速传输的网络传输到MEC服务器,然后由MEC服务器将该差异数据和获取到的二维视频数据结合为三维视频数据。比如,将三维视频数据分成很多帧,B代表一帧深度数据,I代表紧邻B的下一帧的深度数据的像素与B对应的像素之间的差异数据,在本实施例中,传输所述深度数据的方式可以包括多种方式(这里,为了避免冗余和重复,仅解释两种传输所述深度数据的方式):Based on this, an embodiment of the present application provides a data transmission method, which is suitable for a relatively low-speed, static modeling scenario. Before transmitting the two-dimensional video data and depth data from the terminal to the MEC server, the pre-processing of the depth data is performed. Processing, the non-compression method compares the difference between the pixels of the depth data of the current frame and the pixels of the depth data of the previous frame in the three-dimensional video data, and obtains the difference data, and then transmits the difference data through the high-speed transmission network. to the MEC server, and then the MEC server combines the difference data and the acquired two-dimensional video data into three-dimensional video data. For example, the three-dimensional video data is divided into many frames, B represents one frame of depth data, and I represents the difference data between the pixels of the depth data of the next frame immediately adjacent to B and the pixels corresponding to B. In this embodiment, the transmission of the The ways of depth data can include various ways (here, in order to avoid redundancy and repetition, only two ways of transmitting the depth data are explained):
第一种传输所述深度数据的方式:首先,传输一个完整的一帧深度数据;其次,分析第一帧深度数据与下一帧深度数据之间的差异数据,接下来传输该差异数据(即传输第二帧的时候,其实是传输的差异数据);再次,传输第三帧的时候,传输该差异数据对应的下一帧的完整的一帧深度数据;最后,传输第四帧的时候,与传输第二帧的方法类似,先分析第三帧的深度数据对应的像素与第四帧的深度数据对应的像素之间的差异数据,传输该差异数据(即B-I-B-I-B-I,在传输的过程中,传输完整帧的深度数据与传输差异数据的比例为 1:1)。The first method of transmitting the depth data: first, transmit a complete frame of depth data; secondly, analyze the difference data between the depth data of the first frame and the depth data of the next frame, and then transmit the difference data (ie When the second frame is transmitted, it is actually the difference data transmitted); again, when the third frame is transmitted, a complete frame of depth data of the next frame corresponding to the difference data is transmitted; finally, when the fourth frame is transmitted, Similar to the method of transmitting the second frame, first analyze the difference data between the pixels corresponding to the depth data of the third frame and the pixels corresponding to the depth data of the fourth frame, and transmit the difference data (that is, B-I-B-I-B-I, during the transmission process, The ratio of depth data transmitted for a full frame to transmitted difference data is 1:1).
第一种传输所述深度数据的方式:首先,传输一个完整的一帧深度数据;其次,分析第一帧深度数据与下一帧深度数据之间的差异数据,接下来传输该差异数据(即传输第二帧的时候,其实是传输的差异数据);再次,分析第二帧深度数据与下一帧深度数据之间的差异数据,接下来传输该差异数据(即传输第三帧的时候,其实是传输的差异数据);再次,传输第四帧的时候,传输第三帧对应的差异数据对应的下一帧的完整的一帧深度数据;然后,传输第五帧的时候,又是传输第四帧的深度数据与第五帧的深度数据之间的差异数据,···(即,B-I1-I2-B-I1-I2-B-I1-I2,在传输的过程中,传输完整帧的深度数据与传输差异数据的比例为1:2)。显然,在本实施例中,在传输深度数据的过程中,传输完整帧的深度数据与传输差异数据的比例不仅仅可以是1:1或者1:2,还可以是任意的其他比例。The first method of transmitting the depth data: first, transmit a complete frame of depth data; secondly, analyze the difference data between the depth data of the first frame and the depth data of the next frame, and then transmit the difference data (ie When the second frame is transmitted, it is actually the difference data transmitted); again, analyze the difference data between the depth data of the second frame and the depth data of the next frame, and then transmit the difference data (that is, when transmitting the third frame, In fact, it is the difference data transmitted); again, when the fourth frame is transmitted, a complete frame of depth data of the next frame corresponding to the difference data corresponding to the third frame is transmitted; then, when the fifth frame is transmitted, it is transmitted again. The difference data between the depth data of the fourth frame and the depth data of the fifth frame, ... (ie, B-I1-I2-B-I1-I2-B-I1-I2, in the process of transmission, the transmission The ratio of depth data to transmission difference data for a full frame is 1:2). Obviously, in this embodiment, in the process of transmitting depth data, the ratio of the transmitted depth data of the complete frame to the transmitted difference data may not only be 1:1 or 1:2, but also any other ratio.
在本申请实施例中,传输三维视频数据的深度数据时,仅传输当前帧和前一帧有差异像素的深度数据,不仅大大减少网络数据传输,而且有效的提升了网络传输的流畅度。In the embodiment of the present application, when transmitting the depth data of the 3D video data, only the depth data of the pixels with difference between the current frame and the previous frame is transmitted, which not only greatly reduces the network data transmission, but also effectively improves the smoothness of the network transmission.
为实现本申请实施例终端侧的方法,本申请实施例还提供了一种终端。图4为本申请实施例的终端的一种组成结构示意图;如图4所示,所述终端包括:获取单元41、第一数据传输单元42和第一通信单元43;其中,In order to implement the method on the terminal side of the embodiment of the present application, the embodiment of the present application further provides a terminal. FIG. 4 is a schematic diagram of a composition structure of a terminal according to an embodiment of the application; as shown in FIG. 4 , the terminal includes: an acquisition unit 41, a first data transmission unit 42 and a first communication unit 43; wherein,
所述获取单元41,用于获取待传输的三维视频数据中的深度数据和二维视频数据;The acquisition unit 41 is used to acquire depth data and two-dimensional video data in the three-dimensional video data to be transmitted;
所述第一数据传输单元42,用于针对每帧的深度数据,将深度数据和预设的深度数据进行比对,确定所述深度数据与所述预设的深度数据之间的差异数据;The first data transmission unit 42 is configured to compare the depth data with the preset depth data for the depth data of each frame, and determine the difference data between the depth data and the preset depth data;
所述第一通信单元43,用于向移动边缘计算MEC服务器发送待传输的三维视频数据中的二维视频数据,并发送所述差异数据。The first communication unit 43 is configured to send the two-dimensional video data in the three-dimensional video data to be transmitted to the mobile edge computing MEC server, and send the difference data.
在一实施例中,所述第一数据传输单元42,用于针对所述每帧的深度数据,将当前帧的深度数据和所述当前帧的前一帧的深度数据进行比对,确定所述当前帧的深度数据和所述前一帧的深度数据之间的差异数据;In one embodiment, the first data transmission unit 42 is configured to compare the depth data of the current frame with the depth data of the previous frame of the current frame for the depth data of each frame, and determine the depth data of the current frame. Difference data between the depth data of the current frame and the depth data of the previous frame;
对应地,所述第一通信单元43,用于向所述MEC服务器发送每一帧的二维视频数据和所述差异数据。Correspondingly, the first communication unit 43 is configured to send the two-dimensional video data of each frame and the difference data to the MEC server.
在一实施例中,如图4所示,所述终端还包括:所述获取单元 41,还用于获取所述差异数据对应的下一帧的深度数据;In one embodiment, as shown in FIG. 4 , the terminal further includes: the obtaining unit 41, further configured to obtain the depth data of the next frame corresponding to the difference data;
所述第一通信单元43,还用于如果所述下一帧的深度数据与所述差异数据对应的深度数据不同,传输所述下一帧的深度数据。The first communication unit 43 is further configured to transmit the depth data of the next frame if the depth data of the next frame is different from the depth data corresponding to the difference data.
本申请实施例中,所述终端中的第一数据传输单元33,在实际应用中可由所述终端中的处理器,比如中央处理器(CPU,Central Processing Unit)、数字信号处理器(DSP,Digital Signal Processor)、微控制单元(MCU,Microcontroller Unit)或可编程门阵列(FPGA, Field-Programmable Gate Array)等实现;所述终端中的第一通信单元32,在实际应用中可通过通信模组(包含:基础通信套件、操作系统、通信模块、标准化接口和协议等)及收发天线实现;所述终端中的获取单元31,在实际应用中可通过立体摄像头、双目摄像头或结构光摄像头实现,或者可通过通信模组(包含:基础通信套件、操作系统、通信模块、标准化接口和协议等)及收发天线实现;所述终端中的检测单元34,在实际应用中可由处理器比如CPU、DSP、MCU 或FPGA等结合通信模组实现。In this embodiment of the present application, the first data transmission unit 33 in the terminal can be implemented by a processor in the terminal, such as a central processing unit (CPU, Central Processing Unit), a digital signal processor (DSP, Digital Signal Processor), Microcontroller Unit (MCU, Microcontroller Unit) or Programmable Gate Array (FPGA, Field-Programmable Gate Array), etc.; the first communication unit 32 in the terminal, in practical applications, can be implemented through a communication model group (including: basic communication suite, operating system, communication module, standardized interface and protocol, etc.) and transceiver antenna implementation; the acquisition unit 31 in the terminal can be realized by a stereo camera, a binocular camera or a structured light camera in practical applications It can be realized, or can be realized by a communication module (including: basic communication suite, operating system, communication module, standardized interface and protocol, etc.) and a transceiver antenna; the detection unit 34 in the terminal can be realized by a processor such as a CPU in practical applications , DSP, MCU or FPGA, etc. are implemented in combination with communication modules.
需要说明的是:上述实施例提供的终端在进行数据传输时,仅以上述各程序模块的划分进行举例说明,实际应用中,可以根据需要而将上述处理分配由不同的程序模块完成,即将终端的内部结构划分成不同的程序模块,以完成以上描述的全部或者部分处理。另外,上述实施例提供的终端与数据传输方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that: when the terminal provided in the above embodiment performs data transmission, only the division of the above program modules is used as an example for illustration. In practical applications, the above processing can be allocated to different program modules according to needs. The internal structure is divided into different program modules to complete all or part of the processing described above. In addition, the terminal and the data transmission method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.
相应地,为实现本申请实施例服务器侧的方法,本申请实施例还提供了一种服务器,具体为MEC服务器。图5为本申请实施例的服务器的组成结构示意图;如图5所示,所述服务器包括第二通信单元 51和第二数据传输单元52;其中,Correspondingly, in order to implement the method on the server side of the embodiment of the present application, the embodiment of the present application further provides a server, which is specifically an MEC server. Fig. 5 is a schematic diagram of the composition structure of a server according to an embodiment of the application; as shown in Fig. 5, the server includes a second communication unit 51 and a second data transmission unit 52; wherein,
所述第二通信单元51,用于接收终端发送的差异数据和二维视频数据;The second communication unit 51 is used for receiving difference data and two-dimensional video data sent by the terminal;
所述第二数据传输单元52,用于根据所述差异数据恢复待传输的三维视频数据中的深度数据;还用于将所述深度数据和二维视频数据合成为三维视频数据。The second data transmission unit 52 is configured to restore the depth data in the three-dimensional video data to be transmitted according to the difference data; and is further configured to synthesize the depth data and the two-dimensional video data into three-dimensional video data.
在一实施例中,所述第二通信单元51,还用于接收差异数据和二维视频数据;In one embodiment, the second communication unit 51 is further configured to receive difference data and two-dimensional video data;
所述第二数据传输单元52,还用于根据所述差异数据至少恢复出当前帧的深度数据;还用于将所述当前帧的深度数据、预设的深度数据和所述二维视频数据合成为三维视频数据。The second data transmission unit 52 is also used to restore at least the depth data of the current frame according to the difference data; and is also used to convert the depth data of the current frame, the preset depth data and the two-dimensional video data. Synthesized into 3D video data.
本申请实施例中,所述服务器中的第二数据传输单元52,在实际应用中可由所述服务器中的处理器,比如CPU、DSP、MCU或FPGA 等实现;所述服务器中的第二通信单元51,在实际应用中可通过通信模组(包含:基础通信套件、操作系统、通信模块、标准化接口和协议等)及收发天线实现。In this embodiment of the present application, the second data transmission unit 52 in the server may be implemented by a processor in the server, such as a CPU, DSP, MCU, or FPGA, in practical applications; the second communication in the server The unit 51 can be implemented by a communication module (including: a basic communication suite, an operating system, a communication module, standardized interfaces and protocols, etc.) and a transceiver antenna in practical applications.
需要说明的是:上述实施例提供的服务器在进行数据传输时,仅以上述各程序模块的划分进行举例说明,实际应用中,可以根据需要而将上述传输分配由不同的程序模块完成,即将服务器的内部结构划分成不同的程序模块,以完成以上描述的全部或者部分处理。另外,上述实施例提供的服务器与数据传输方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that: when the server provided in the above embodiment performs data transmission, only the division of the above program modules is used as an example for illustration. In practical applications, the above transmission can be allocated to different program modules according to needs. The internal structure is divided into different program modules to complete all or part of the processing described above. In addition, the server provided by the above embodiments and the data transmission method embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.
基于上述设备的硬件实现,本申请实施例还提供了一种数据传输设备,图6为本申请实施例的数据传输设备的硬件组成结构示意图,如图6所示,数据传输装置60,包括存储器61、处理器62及存储在存储器上并可在处理器上运行的计算机程序。作为第一种实施方式,数据传输设备为终端时,位于终端的处理器执行所述程序时实现:获取待传输的三维视频数据中的深度数据和二维视频数据;针对每帧的深度数据,将深度数据和预设的深度数据进行比对,确定所述深度数据与所述预设的深度数据之间的差异数据;向移动边缘计算(Mobile Edge Computing,MEC)服务器发送待传输的三维视频数据中的二维视频数据,并发送所述差异数据。Based on the hardware implementation of the above device, an embodiment of the present application further provides a data transmission device. FIG. 6 is a schematic structural diagram of the hardware composition of the data transmission device according to the embodiment of the present application. As shown in FIG. 6 , the data transmission device 60 includes a memory 61. A processor 62 and a computer program stored on a memory and executable on the processor. As a first embodiment, when the data transmission device is a terminal, when the processor located in the terminal executes the program, it realizes: acquiring the depth data and the two-dimensional video data in the three-dimensional video data to be transmitted; for the depth data of each frame, Compare the depth data with the preset depth data, and determine the difference data between the depth data and the preset depth data; send the three-dimensional video to be transmitted to the Mobile Edge Computing (Mobile Edge Computing, MEC) server 2D video data in the data, and send the difference data.
在一实施例中,位于终端的处理器执行所述程序时实现:针对所述每帧的深度数据,将当前帧的深度数据和所述当前帧的前一帧的深度数据进行比对,确定所述当前帧的深度数据和所述前一帧的深度数据之间的差异数据;向所述MEC服务器发送每一帧的二维视频数据和所述差异数据。In one embodiment, when the processor at the terminal executes the program, it is realized: for the depth data of each frame, compare the depth data of the current frame with the depth data of the previous frame of the current frame, and determine Difference data between the depth data of the current frame and the depth data of the previous frame; send the two-dimensional video data of each frame and the difference data to the MEC server.
在一实施例中,位于终端的处理器执行所述程序时实现:获取所述差异数据对应的下一帧的深度数据;如果所述下一帧的深度数据与所述差异数据对应的深度数据不同,传输所述下一帧的深度数据。In one embodiment, when the processor located in the terminal executes the program, it realizes: acquiring the depth data of the next frame corresponding to the difference data; if the depth data of the next frame and the depth data corresponding to the difference data Otherwise, the depth data of the next frame is transmitted.
作为第二种实施方式,数据传输设备为服务器时,位于服务器的处理器执行所述程序时实现:接收终端发送的差异数据和二维视频数据;根据所述差异数据恢复待传输的三维视频数据中的深度数据;将所述深度数据和二维视频数据合成为三维视频数据。As a second embodiment, when the data transmission device is a server, when the processor located in the server executes the program, it realizes: receiving the difference data and two-dimensional video data sent by the terminal; recovering the three-dimensional video data to be transmitted according to the difference data and synthesizing the depth data and the two-dimensional video data into three-dimensional video data.
在一实施例中,位于服务器的处理器执行所述程序时实现:接收差异数据和二维视频数据;根据所述差异数据至少恢复出当前帧的深度数据;将所述当前帧的深度数据、预设的深度数据和所述二维视频数据合成为三维视频数据。In one embodiment, when the processor at the server executes the program, it realizes: receiving difference data and two-dimensional video data; restoring at least the depth data of the current frame according to the difference data; converting the depth data of the current frame, The preset depth data and the two-dimensional video data are synthesized into three-dimensional video data.
可以理解,数据传输设备(终端或服务器)还包括通信接口63;数据传输设备(终端或服务器)中的各个组件通过总线系统耦合在一起。可理解,总线系统用于实现这些组件之间的连接通信。总线系统除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。It can be understood that the data transmission device (terminal or server) further includes a communication interface 63; various components in the data transmission device (terminal or server) are coupled together through a bus system. It can be understood that the bus system is used to realize the connection communication between these components. In addition to the data bus, the bus system also includes a power bus, a control bus and a status signal bus.
本申请实施例还提供了一种计算机存储介质,其上存储有计算机指令,该指令被处理器执行时实现本申请实施例所述的应用于终端的数据传输方法的步骤;或者,该指令被处理器执行时实现本申请实施例所述的应用于MEC服务器的数据传输方法的步骤。The embodiments of the present application further provide a computer storage medium, on which computer instructions are stored, and when the instructions are executed by the processor, implement the steps of the data transmission method applied to the terminal described in the embodiments of the present application; or, the instructions are When executed by the processor, the steps of the data transmission method applied to the MEC server described in the embodiments of the present application are implemented.
本申请实施例还提供了一种终端,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现本申请实施例所述的应用于终端的数据传输方法的步骤。Embodiments of the present application further provide a terminal, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the applications described in the embodiments of the present application when the processor executes the program Steps of a data transmission method for a terminal.
本申请实施例还提供了一种MEC服务器,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现本申请实施例所述的应用于MEC服务器的数据传输方法的步骤。Embodiments of the present application further provide an MEC server, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the methods described in the embodiments of the present application when the processor executes the program. Steps of the data transfer method applied to the MEC server.
在本申请所提供的几个实施例中,应该理解到,所揭露的方法和智能设备,可以通过其它的方式实现。以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。In the several embodiments provided in this application, it should be understood that the disclosed method and smart device may be implemented in other manners. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms. of.
上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元,即可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。The unit described above as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外,在本申请各实施例中的各功能单元可以全部集成在一个第二处理单元中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may all be integrated into one second processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; The above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by program instructions related to hardware, the aforementioned program can be stored in a computer-readable storage medium, and when the program is executed, execute It includes the steps of the above method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other media that can store program codes.
或者,本申请上述集成的单元如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者手机等)执行本申请各个实施例所述方法的全部或部分。而前述的存储介质包括:移动存储设备、 ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence or in the parts that make contributions to the prior art. The computer software products are stored in a storage medium and include several instructions for A computer device (which may be a personal computer, a server, or a mobile phone, etc.) is caused to execute all or part of the methods described in the various embodiments of the present application. The aforementioned storage medium includes various media that can store program codes, such as a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk.
需要说明的是:本申请实施例所记载的技术方案之间,在不冲突的情况下,可以任意组合。It should be noted that the technical solutions described in the embodiments of the present application may be combined arbitrarily unless there is a conflict.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application.
Claims (13)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811162929.9A CN109257588A (en) | 2018-09-30 | 2018-09-30 | Data transmission method, terminal, server and storage medium |
PCT/CN2019/100647 WO2020063171A1 (en) | 2018-09-30 | 2019-08-14 | Data transmission method, terminal, server and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811162929.9A CN109257588A (en) | 2018-09-30 | 2018-09-30 | Data transmission method, terminal, server and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109257588A true CN109257588A (en) | 2019-01-22 |
Family
ID=65045349
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811162929.9A Pending CN109257588A (en) | 2018-09-30 | 2018-09-30 | Data transmission method, terminal, server and storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN109257588A (en) |
WO (1) | WO2020063171A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020063171A1 (en) * | 2018-09-30 | 2020-04-02 | Oppo广东移动通信有限公司 | Data transmission method, terminal, server and storage medium |
CN113993104A (en) * | 2021-10-26 | 2022-01-28 | 中汽创智科技有限公司 | Data transmission method, device, equipment and storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101990107A (en) * | 2009-07-31 | 2011-03-23 | 廖礼士 | Encoding system and method, decoding system and method, and display system and method |
CN102868899A (en) * | 2012-09-06 | 2013-01-09 | 华映光电股份有限公司 | Method for processing three-dimensional image |
CN104221385A (en) * | 2012-04-16 | 2014-12-17 | 高通股份有限公司 | View synthesis based on asymmetric texture and depth resolutions |
CN105847777A (en) * | 2016-03-24 | 2016-08-10 | 湖南拓视觉信息技术有限公司 | Method and device for transmitting three-dimensional depth images |
CN107241563A (en) * | 2017-06-16 | 2017-10-10 | 深圳天珑无线科技有限公司 | Method, intelligent mobile terminal and the device with store function of transmission of video |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN203416351U (en) * | 2013-05-31 | 2014-01-29 | 江西省电力设计院 | A power station workshop video monitoring system |
CN108495112B (en) * | 2018-05-10 | 2020-12-22 | Oppo广东移动通信有限公司 | Data transmission method and terminal, and computer storage medium |
CN109257588A (en) * | 2018-09-30 | 2019-01-22 | Oppo广东移动通信有限公司 | Data transmission method, terminal, server and storage medium |
-
2018
- 2018-09-30 CN CN201811162929.9A patent/CN109257588A/en active Pending
-
2019
- 2019-08-14 WO PCT/CN2019/100647 patent/WO2020063171A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101990107A (en) * | 2009-07-31 | 2011-03-23 | 廖礼士 | Encoding system and method, decoding system and method, and display system and method |
CN104221385A (en) * | 2012-04-16 | 2014-12-17 | 高通股份有限公司 | View synthesis based on asymmetric texture and depth resolutions |
CN102868899A (en) * | 2012-09-06 | 2013-01-09 | 华映光电股份有限公司 | Method for processing three-dimensional image |
CN105847777A (en) * | 2016-03-24 | 2016-08-10 | 湖南拓视觉信息技术有限公司 | Method and device for transmitting three-dimensional depth images |
CN107241563A (en) * | 2017-06-16 | 2017-10-10 | 深圳天珑无线科技有限公司 | Method, intelligent mobile terminal and the device with store function of transmission of video |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020063171A1 (en) * | 2018-09-30 | 2020-04-02 | Oppo广东移动通信有限公司 | Data transmission method, terminal, server and storage medium |
CN113993104A (en) * | 2021-10-26 | 2022-01-28 | 中汽创智科技有限公司 | Data transmission method, device, equipment and storage medium |
CN113993104B (en) * | 2021-10-26 | 2023-12-26 | 中汽创智科技有限公司 | Data transmission method, device, equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
WO2020063171A1 (en) | 2020-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108495112B (en) | Data transmission method and terminal, and computer storage medium | |
CN112672132B (en) | Data processing method and device, electronic equipment and storage medium | |
CN109194946B (en) | Data processing method and device, electronic device and storage medium | |
CN109410319B (en) | Data processing method, server and computer storage medium | |
US12008393B2 (en) | Method for remotely accessing data of a USB device by a virtual machine | |
CN109871189A (en) | A method and device for multi-terminal screen sharing based on network file system | |
WO2020063170A1 (en) | Data processing method, terminal, server and storage medium | |
CN109274976B (en) | Data processing method and device, electronic device and storage medium | |
CN108600728A (en) | Data transmission method and terminal, computer storage medium | |
JP2021531688A (en) | Data processing methods and devices, electronic devices and storage media | |
CN108667936B (en) | Data processing method, terminal, mobile edge computing server and storage medium | |
CN109257588A (en) | Data transmission method, terminal, server and storage medium | |
WO2020063168A1 (en) | Data processing method, terminal, server and computer storage medium | |
CN109413405B (en) | A data processing method, terminal, server and computer storage medium | |
CN108632376B (en) | A data processing method, terminal, server and computer storage medium | |
WO2020062919A1 (en) | Data processing method, mec server and terminal device | |
CN109151435B (en) | A data processing method, terminal, server and computer storage medium | |
CN109246408B (en) | Data processing method, terminal, server and computer storage medium | |
CN109147043B (en) | Data processing method, server and computer storage medium | |
CN109246409B (en) | Data processing method, terminal, server and computer storage medium | |
CN109389674B (en) | Data processing method and device, MEC server and storage medium | |
CN109389675B (en) | Data processing method and device, terminal and storage medium | |
CN108737807B (en) | A data processing method, terminal, server and computer storage medium | |
CN114928715A (en) | Data transmission method and system | |
CN109299323B (en) | Data processing method, terminal, server and computer storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190122 |
|
RJ01 | Rejection of invention patent application after publication |