CN109413405B - Data processing method, terminal, server and computer storage medium - Google Patents

Data processing method, terminal, server and computer storage medium Download PDF

Info

Publication number
CN109413405B
CN109413405B CN201811163283.6A CN201811163283A CN109413405B CN 109413405 B CN109413405 B CN 109413405B CN 201811163283 A CN201811163283 A CN 201811163283A CN 109413405 B CN109413405 B CN 109413405B
Authority
CN
China
Prior art keywords
video data
dimensional video
terminal
model
indication information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811163283.6A
Other languages
Chinese (zh)
Other versions
CN109413405A (en
Inventor
夏炀
李虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201811163283.6A priority Critical patent/CN109413405B/en
Publication of CN109413405A publication Critical patent/CN109413405A/en
Application granted granted Critical
Publication of CN109413405B publication Critical patent/CN109413405B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The embodiment of the invention discloses a data processing method, a terminal, a server and a computer storage medium. The method comprises the following steps: obtaining three-dimensional video data; and when the condition that the three-dimensional video data meet the preset condition is detected, storing the three-dimensional video data, processing the three-dimensional video data according to a preset rule, and sending the processed three-dimensional video data to a Mobile Edge Computing (MEC) server.

Description

Data processing method, terminal, server and computer storage medium
Technical Field
The present invention relates to data processing technologies, and in particular, to a data processing method, a terminal, a server, and a computer storage medium.
Background
With the continuous development of the mobile communication network, the transmission rate of the mobile communication network is rapidly improved, thereby providing powerful technical support for the generation and development of the three-dimensional video service. The three-dimensional video data includes two-dimensional image data (e.g., RGB data) and Depth data (Depth data), and the two-dimensional video data and the Depth data are required separately during transmission of the three-dimensional video data. However, the data acquisition amount of the three-dimensional video data is very large, so the data amount to be transmitted is also very large, and a mobile communication network is required to have a faster data transmission rate and a more stable data transmission environment because higher technical support is required in the data transmission process. Also, the Mobile Edge Computing (MEC) server modeling takes a long time due to the large amount of data.
Disclosure of Invention
To solve the above technical problem, embodiments of the present invention provide a data processing method, a terminal, a server, and a computer storage medium.
The embodiment of the invention provides a data processing method, which is applied to a terminal; the method comprises the following steps:
obtaining three-dimensional video data;
and when the condition that the three-dimensional video data meet the preset condition is detected, storing the three-dimensional video data, processing the three-dimensional video data according to a preset rule, and sending the processed three-dimensional video data to a mobile edge computing MEC server.
In the foregoing solution, the detecting that the predetermined condition is satisfied includes: detecting transmission quality information of a communication channel between the MEC server and the MEC server, and determining that a preset condition is met when the transmission quality information does not meet a preset transmission standard.
In the foregoing solution, the processing the three-dimensional video data according to a preset rule and sending the processed three-dimensional video data to a mobile edge computing MEC server includes:
segmenting the three-dimensional video data according to a preset rule to obtain a plurality of subdata, and sending the plurality of subdata to the MEC server; alternatively, the first and second electrodes may be,
and compressing the three-dimensional video data according to a preset rule, and sending the compressed three-dimensional video data to an MEC server.
The method in the above scheme further comprises: receiving first indication information from the MEC server; the first indication information is used for indicating the terminal to continue to transmit other three-dimensional video data;
and obtaining other three-dimensional video data based on the first indication information, and sending the other three-dimensional video data to the MEC server.
In the above scheme, the method further comprises: receiving second indication information from the MEC server; the second indication information is used for indicating the terminal to resend the three-dimensional video data;
and retransmitting the three-dimensional video data based on the second indication information.
The embodiment of the invention also provides a data processing method, which is applied to the MEC server; the method comprises the following steps: receiving three-dimensional video data from a terminal, and establishing an initial model based on the three-dimensional video data;
matching the initial model with models in a preset model set; the preset model set comprises integral models of a plurality of target objects;
and sending indication information to the terminal based on the matching result.
In the above scheme, the method further comprises: obtaining a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target objects;
establishing an integral model of the target object based on the plurality of sample data; or, local models of different parts of the target object are established based on the plurality of sample data, and an overall model of different target objects is generated based on the local models of different parts of different target objects.
In the foregoing solution, the sending the indication information to the terminal based on the matching result includes:
and when the matching result is that the initial model is matched with a model in a preset model set, sending first indication information to the terminal, wherein the first indication information is used for indicating the terminal to continuously transmit other three-dimensional video data.
In the above scheme, when the matching result is that the initial model matches a model in a preset model set, the method further includes: a first model corresponding to the three-dimensional video data is built based on the three-dimensional video data and the model.
In the foregoing solution, the sending the indication information to the terminal based on the matching result includes: and when the matching result is that the initial model is not matched with the model in the preset model set, sending second indication information to the terminal, wherein the second indication information is used for indicating the terminal to resend the three-dimensional video data.
In the above scheme, when the matching result is that the initial model matches a model in a preset model set, the method further includes: updating the matched model based on the three-dimensional video data.
An embodiment of the present invention further provides a terminal, where the terminal includes: the device comprises an acquisition unit, a detection unit, a storage unit, a processing unit and a first communication unit; wherein the content of the first and second substances,
the acquisition unit is used for acquiring three-dimensional video data;
the detection unit is used for detecting whether a preset condition is met;
the storage unit is used for storing the three-dimensional video data when the detection unit detects that a preset condition is met
The processing unit is used for processing the three-dimensional video data according to a preset rule when the detection unit detects that a preset condition is met;
the first communication unit is used for sending the three-dimensional video data processed by the processing unit to the MEC server.
In the foregoing solution, the detecting unit is configured to detect transmission quality information of a communication channel between the detecting unit and the MEC server, and determine that a predetermined condition is satisfied when the transmission quality information does not reach a preset transmission standard.
In the above scheme, the processing unit is configured to segment the three-dimensional video data according to a preset rule to obtain a plurality of sub-data;
the first communication unit is configured to send the plurality of sub-data to the MEC server; alternatively, the first and second electrodes may be,
the processing unit is used for compressing the three-dimensional video data according to a preset rule;
and the first communication unit is used for sending the compressed three-dimensional video data to the MEC server.
In the above scheme, the first communication unit is further configured to receive first indication information from the MEC server; the first indication information is used for indicating the terminal to continue to transmit other three-dimensional video data;
the acquisition unit is further used for acquiring other three-dimensional video data based on the first indication information;
the first communication unit is further configured to send the other three-dimensional video data to the MEC server.
In the above scheme, the first communication unit is further configured to receive second indication information from the MEC server; the second indication information is used for indicating the terminal to resend the three-dimensional video data;
the first communication unit is further configured to resend the three-dimensional video data stored in the storage unit based on the second indication information.
The embodiment of the invention also provides an MEC server, which comprises a second communication unit, a modeling unit and a matching unit; wherein the content of the first and second substances,
the second communication unit is used for receiving the three-dimensional video data from the terminal;
the modeling unit is used for establishing an initial model based on the three-dimensional video data received by the second communication unit;
the matching unit is used for matching the initial model with models in a preset model set; the preset model set comprises integral models of a plurality of target objects;
and the second communication unit is also used for sending indication information to the terminal based on the matching result obtained by the matching unit.
In the foregoing solution, the modeling unit is further configured to obtain a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target objects; establishing an integral model of the target object based on the plurality of sample data; or, local models of different parts of the target object are established based on the plurality of sample data, and an overall model of different target objects is generated based on the local models of different parts of different target objects.
In the foregoing solution, the second communication unit is further configured to send first indication information to the terminal when the matching result obtained by the matching unit is that the initial model matches a model in a preset model set, where the first indication information is used to indicate the terminal to continue to transmit other three-dimensional video data.
In the foregoing solution, the modeling unit is further configured to, when the matching result is that the initial model matches a model in a preset model set, establish a first model corresponding to the three-dimensional video data based on the three-dimensional video data and the model.
In the foregoing solution, the second communication unit is further configured to send second indication information to the terminal when the matching result obtained by the matching unit is that the initial model is not matched with a model in a preset model set, where the second indication information is used to indicate the terminal to resend the three-dimensional video data.
In the foregoing solution, the modeling unit is further configured to update the matched model based on the three-dimensional video data when the matching result obtained by the matching unit is that the initial model matches a model in a preset model set.
The embodiment of the invention also provides a computer storage medium, which stores computer instructions, and the instructions are executed by a processor to realize the steps of the data processing method applied to the terminal in the embodiment of the invention; or, the instructions, when executed by the processor, implement the steps of the data processing method applied to the MEC server according to the embodiment of the present invention.
The embodiment of the invention also provides a terminal, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the program to realize the steps of the data processing method applied to the terminal.
The embodiment of the invention also provides an MEC server, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the steps of the data processing method applied to the MEC server are realized.
An embodiment of the present invention further provides a chip, including: a processor, configured to call and run a computer program from a memory, so that a device on which the chip is installed executes the steps of the data processing method applied to the terminal according to the embodiment of the present invention; or, the steps of the data processing method applied to the MEC server according to the embodiment of the present invention are executed.
The embodiment of the invention also provides a computer program product, which comprises computer program instructions, wherein the computer program instructions enable a computer to execute the steps of the data processing method applied to the terminal; alternatively, the computer program instructions may cause a computer to execute the steps of the data processing method applied to the MEC server according to the embodiment of the present invention.
The embodiment of the invention also provides a computer program, which enables a computer to execute the steps of the data processing method applied to the terminal; alternatively, the computer program may cause a computer to execute the steps of the data processing method applied to the MEC server according to the embodiment of the present invention.
The data processing method, the terminal, the server and the computer storage medium provided by the embodiment of the invention are applied to the terminal, and the method applied to the terminal comprises the following steps: obtaining three-dimensional video data; and when the fact that the preset conditions are met is detected, the three-dimensional video data are stored, the three-dimensional video data are processed according to preset rules, and the processed three-dimensional video data are sent to an MEC server. The method applied to the MEC server comprises the following steps: receiving three-dimensional video data from a terminal, and establishing an initial model based on the three-dimensional video data; matching the initial model with models in a preset model set; the preset model set comprises integral models of a plurality of target objects; and sending indication information to the terminal based on the matching result. By adopting the technical scheme of the embodiment of the invention, the server can be matched with the preset model based on the obtained three-dimensional video data of one frame through the integral model of the plurality of target objects preset in the server, and the model of the target object can be quickly established based on the matched model, so that the modeling time is greatly shortened; on the other hand, because the model is preset in the server, the requirement of technical support required in the data transmission process is reduced, namely, a faster data transmission rate and a stable data transmission environment are not required, and the method is suitable for various communication scenes; in addition, because the model is preset in the server, the modeling can be carried out without transmitting all three-dimensional video data acquired by the terminal, and the data volume needing to be transmitted is reduced to a certain extent. In addition, the present embodiment stores the three-dimensional video data sent out by the terminal, and is suitable for scenes satisfying a predetermined condition (for example, poor transmission quality).
Drawings
FIG. 1 is a schematic diagram of a system architecture for applying a data processing method according to an embodiment of the present invention;
FIG. 2 is a first flowchart illustrating a data processing method according to an embodiment of the present invention;
FIG. 3 is a second flowchart illustrating a data processing method according to an embodiment of the present invention;
FIG. 4 is a third flowchart illustrating a data processing method according to an embodiment of the present invention;
FIG. 5 is a fourth flowchart illustrating a data processing method according to an embodiment of the present invention;
FIG. 6 is a fifth flowchart illustrating a data processing method according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a component structure of a server according to an embodiment of the present invention;
fig. 9 is a schematic diagram of a hardware configuration of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
Before the technical solution of the embodiment of the present invention is explained in detail, a system architecture to which the data processing method of the embodiment of the present invention is applied is first briefly explained. The data processing method of the embodiment of the invention is applied to related services of three-dimensional video data, such as services for sharing three-dimensional video data, live broadcast services based on three-dimensional video data and the like. In this case, since the data amount of the three-dimensional video data is large, the depth data and the two-dimensional video data transmitted respectively need high technical support in the data transmission process, and thus the mobile communication network is required to have a high data transmission rate and a stable data transmission environment.
FIG. 1 is a schematic diagram of a system architecture for applying a data processing method according to an embodiment of the present invention; as shown in fig. 1, the system may include a terminal, a base station, an MEC server, a service processing server, a core network, the Internet (Internet), and the like; and a high-speed channel is established between the MEC server and the service processing server through a core network to realize data synchronization.
Taking an application scenario of interaction between two terminals shown in fig. 1 as an example, an MEC server a is an MEC server deployed near a terminal a (a sending end), and a core network a is a core network in an area where the terminal a is located; correspondingly, the MEC server B is an MEC server deployed near the terminal B (receiving end), and the core network B is a core network of an area where the terminal B is located; the MEC server A and the MEC server B can establish a high-speed channel with the service processing server through the core network A and the core network B respectively to realize data synchronization.
After three-dimensional video data sent by a terminal A are transmitted to an MEC server A, the MEC server A synchronizes the data to a service processing server through a core network A; and then, the MEC server B acquires the three-dimensional video data sent by the terminal A from the service processing server and sends the three-dimensional video data to the terminal B for presentation.
Here, if the terminal B and the terminal a realize transmission through the same MEC server, the terminal B and the terminal a directly realize transmission of three-dimensional video data through one MEC server at this time without participation of a service processing server, and this mode is called a local backhaul mode. Specifically, suppose that the terminal B and the terminal a realize transmission of three-dimensional video data through the MEC server a, and after the three-dimensional video data sent by the terminal a is transmitted to the MEC server a, the MEC server a sends the three-dimensional video data to the terminal B for presentation.
Here, the terminal may select an evolved node b (eNB) accessing the 4G network or a next generation evolved node b (gNB) accessing the 5G network based on a network situation, or a configuration situation of the terminal itself, or an algorithm of the self-configuration, so that the eNB is connected with the MEC server through a Long Term Evolution (LTE) access network, and the gNB is connected with the MEC server through a next generation access network (NG-RAN).
Here, the MEC server is deployed on the network edge side near the terminal or the data source, that is, near the terminal or near the data source, not only in a logical location but also in a geographical location. Unlike the existing mobile communication network in which the main service processing servers are deployed in several large cities, the MEC server can be deployed in a plurality of cities. For example, in an office building, there are many users, and a MEC server may be deployed near the office building.
The MEC server serves as an edge computing gateway with the core capabilities of network convergence, computing, storage and application, and provides platform support comprising an equipment domain, a network domain, a data domain and an application domain for edge computing. The intelligent connection and data processing system is connected with various intelligent devices and sensors, provides intelligent connection and data processing services nearby, enables different types of applications and data to be processed in the MEC server, achieves key intelligent services such as real-time service, intelligent service, data aggregation and interoperation, safety and privacy protection and the like, and effectively improves intelligent decision efficiency of the service.
The embodiment of the invention provides a data processing method, which is applied to a terminal, wherein the terminal can be a mobile terminal such as a mobile phone, a tablet personal computer and the like, and can also be a computer and other types of terminals. FIG. 2 is a first flowchart illustrating a data processing method according to an embodiment of the present invention; as shown in fig. 2, the method includes:
step 101: three-dimensional video data is obtained.
Step 102: and when the condition that the three-dimensional video data meet the preset condition is detected, storing the three-dimensional video data, processing the three-dimensional video data according to a preset rule, and sending the processed three-dimensional video data to a mobile edge computing MEC server.
In this embodiment, as an implementation manner, the obtaining three-dimensional video data includes: the terminal obtains three-dimensional video data from a collection assembly capable of collecting at least depth data; the acquisition component can establish a communication link with at least one terminal so that the corresponding terminal can obtain the three-dimensional video data.
Specifically, in this embodiment, since the acquisition component capable of acquiring the depth data is relatively expensive, the terminal does not have the function of acquiring the three-dimensional video data, but acquires the three-dimensional video data through the acquisition component independent of the terminal, and then establishes a communication link through the acquisition component and the communication component in the terminal, so that the terminal acquires the three-dimensional video data acquired by the acquisition component. The acquisition assembly can be specifically realized by at least one of the following components: the camera comprises a depth camera, a binocular camera, a 3D structured light camera module and a Time Of Flight (TOF) camera module.
Here, the acquisition component can establish a communication link with at least one terminal to transmit acquired three-dimensional video data to the at least one terminal, so that the corresponding terminal can acquire the three-dimensional video data, and thus, the three-dimensional video data acquired by one acquisition component can be shared with at least one terminal, thereby realizing the sharing of the acquisition component.
As another embodiment, the terminal has a function of acquiring three-dimensional video data, and it can be understood that the terminal is provided with an acquisition component capable of acquiring at least depth data, for example, at least one of the following components: degree of depth camera, binocular camera, 3D structured light module of making a video recording, TOF module of making a video recording to gather three-dimensional video data.
The obtained three-dimensional video data comprises two-dimensional video data and depth data; the two-dimensional video data is used for representing a planar image, and can be RGB data for example; the depth data characterizes a distance between a surface of an acquisition object for which the acquisition assembly is directed and the acquisition assembly.
In this embodiment, the detecting that the predetermined condition is satisfied includes: detecting transmission quality information of a communication channel between the MEC server and the MEC server, and determining that a preset condition is met when the transmission quality information does not meet a preset transmission standard.
Here, the transmission quality information includes a transmission rate and/or a packet loss rate; when the transmission rate is lower than a first preset threshold value, the transmission quality information can be shown to be not up to a preset transmission standard; and/or, when the packet loss rate is higher than a second preset threshold, it may also be indicated that the transmission quality information does not reach the preset transmission standard.
The embodiment is suitable for an application scenario where the quality of a communication channel between a terminal and an MEC server is poor, that is, a scenario where the transmission rate and/or the transmission stability of the communication channel do not meet a preset condition, for example, the transmission rate of the communication channel is lower than a first preset threshold, and the packet loss rate of data transmission is higher than a second preset threshold. Under the low-speed and/or high-delay scene, the terminal transmits the processed three-dimensional video data after processing the three-dimensional video data on one hand, and locally stores the three-dimensional video data on the other hand, so that errors occur in the transmission process of the three-dimensional video data, and the stored three-dimensional video data can be retransmitted.
As an embodiment, the processing the three-dimensional video data according to a preset rule and sending the processed three-dimensional video data to a mobile edge computing MEC server includes: segmenting the three-dimensional video data according to a preset rule to obtain a plurality of subdata, and sending the plurality of subdata to the MEC server; or compressing the three-dimensional video data according to a preset rule, and sending the compressed three-dimensional video data to an MEC server.
In this embodiment, because the transmission quality of the communication channel is not good (not meeting the preset transmission standard), before the three-dimensional video data to be transmitted is sent, the three-dimensional video data is processed to reduce the amount of transmitted data. As an embodiment, the three-dimensional video data may be segmented to obtain a plurality of sub-data; one subdata is transmitted during each transmission, so that the transmission quality of the current communication channel can be met, and the successful transmission of data is ensured by reducing the data transmission quantity. Here, as an example, the division of the three-dimensional video data may be division by areas, that is, each sub data corresponds to two-dimensional video data and depth data of one area. As another embodiment, the three-dimensional video data may be compressed according to a preset compression algorithm, so as to reduce the data volume of the three-dimensional video data.
In an embodiment, as shown in fig. 3, the method further comprises:
step 103 a: receiving first indication information from the MEC server; the first indication information is used for indicating the terminal to continue to transmit other three-dimensional video data; and obtaining other three-dimensional video data based on the first indication information, and sending the other three-dimensional video data to the MEC server.
In this embodiment, if the MEC server successfully builds the model based on the first data, that is, successfully builds the model, the MEC server sends first indication information to the terminal, where the first indication information indicates that the previously transmitted three-dimensional video data is successfully built, and may continue to acquire and transmit other three-dimensional video data.
In an embodiment, as shown in fig. 3, the method further comprises:
step 103 b: receiving second indication information from the MEC server; the second indication information is used for indicating the terminal to resend the three-dimensional video data; and retransmitting the three-dimensional video data based on the second indication information.
In this embodiment, if the MEC server fails to perform modeling based on the three-dimensional video data, second indication information is sent to the terminal, where the second indication information indicates that the previously transmitted three-dimensional video data cannot be successfully modeled and needs to be retransmitted for the stored three-dimensional video data.
In practical application, the amount of stored data can be determined based on the storage capacity of the terminal; it is understood that, upon receiving the first indication information of the MEC server, whether to delete the stored three-dimensional video data may be decided based on the storage capability of the terminal. As an embodiment, the stored three-dimensional video data may be deleted after receiving the first indication information. As another embodiment, the remaining storage space of the terminal may be detected; and if the residual storage space is smaller than the preset threshold value, deleting the stored three-dimensional video data according to the sequence of the storage time of the three-dimensional video data.
By adopting the technical scheme of the embodiment of the invention, the server can be matched with the preset model based on the obtained three-dimensional video data of one frame through the integral model of the plurality of target objects preset in the server, and the model of the target object can be quickly established based on the matched model, so that the modeling time is greatly shortened; on the other hand, because the model is preset in the server, the requirement of technical support required in the data transmission process is reduced, namely, a faster data transmission rate and a stable data transmission environment are not required, and the method is suitable for various communication scenes; in addition, because the model is preset in the server, the modeling can be carried out without transmitting all three-dimensional video data acquired by the terminal, and the data volume needing to be transmitted is reduced to a certain extent. In addition, the present embodiment stores the three-dimensional video data sent out by the terminal, and is suitable for scenes satisfying a predetermined condition (for example, poor transmission quality).
The embodiment of the invention also provides a data processing method, which is applied to a server, wherein the server is specifically the MEC server shown in FIG. 1. FIG. 4 is a third flowchart illustrating a data processing method according to an embodiment of the present invention; as shown in fig. 4, the method includes:
step 201: receiving three-dimensional video data from a terminal, and establishing an initial model based on the three-dimensional video data.
Step 202: matching the initial model with models in a preset model set; the preset model set comprises integral models of a plurality of target objects.
Step 203: and sending indication information to the terminal based on the matching result.
In this embodiment, as an implementation manner, the received three-dimensional video data includes two-dimensional video data and depth data; as another embodiment, only depth data may be included in the received three-dimensional video data. The server performs modeling based on the depth data in the received three-dimensional video data to obtain an initial model.
In this embodiment, the server sets a model set in advance, where the model set includes an entire model of a plurality of target objects. The target object may be a real person, a virtual person, a real animal, a virtual animal, and the like, and the category of the target object is not limited in this embodiment. In practical applications, the model set may include a plurality of sub-model sets, and each sub-model set may be for a category of target objects. For example, a corresponding sub-model set is preset for the real person; for a certain kind of real animals, such as dogs, a corresponding set of submodels may be preset, and so on.
In one embodiment, as shown in fig. 5, the method further comprises:
step 204: obtaining a plurality of sample data; the plurality of sample data are global data corresponding to different target objects and/or local data corresponding to different parts of the target objects.
Step 205: establishing an integral model of the target object based on the plurality of sample data; or, local models of different parts of the target object are established based on the plurality of sample data, and an overall model of different target objects is generated based on the local models of different parts of different target objects.
In this embodiment, the server establishes an overall model according to the obtained multiple sample data. As a first embodiment, the obtained sample data is whole data corresponding to the target object. For example, if the target object is a real person, the sample data is the entire data of the real person. As another embodiment, the obtained sample data is local data corresponding to different parts of the target object. For example, the target object is a real person which may include a head region, a trunk region (the trunk region may also be specifically divided into a shoulder region, a chest region, a waist region, and the like), and an extremity region (the extremity region may also be specifically divided into an arm region, a hand region, a leg region, a foot region, and the like), and the like, the sample data may be local regions for the above-described different parts of the real person.
It should be noted that, a plurality of sample data of the present embodiment correspond to different target objects, and even correspond to different parts of different target objects; it can be understood that the overall model is established for different target objects in the present embodiment.
In one embodiment, when the sample data is whole data corresponding to the target object, a whole model of the corresponding target object is established based on the whole data.
As another embodiment, when the sample data is local data corresponding to different parts of the target object, a corresponding local model of the target object is established based on the local data; further, the permutation and combination can be performed based on the local models of different parts of different target objects, such as the obtained local model a1 and local model a2 of the target object A; obtaining the local model B1 and the local model B2 of the target object B, on one hand, the overall model of the target object a can be established based on the local model a1 and the local model a2, and the overall model of the target object B can be established based on the local model B1 and the local model B2, on the other hand, one overall model can be established based on the local model a1 and the local model B2, and the other overall model can be established based on the local model B1 and the local model a 2. The present embodiment can obtain a larger number of overall models of the target object based on the local model, thereby facilitating model matching.
In this embodiment, the sample data may include only depth data; or may also include depth data and two-dimensional video data. Any data that can be modeled in three dimensions is within the scope of the embodiments of the present invention.
It is to be understood that step 204 and step 205 are performed before step 202, i.e. before the initial model is matched with the models in the preset model set, the building of the overall model in the model set is performed.
In this embodiment, the server matches the initial model with a model in a preset model set.
As one embodiment, the server matches the initial model to the overall model in a pre-set of models. The embodiment is applicable to a scene in which the received three-dimensional video data is whole data corresponding to the target object, that is, as an example, the terminal transmits all the acquired three-dimensional video data corresponding to the whole target object to the server, so that the three-dimensional video data received by the server is the three-dimensional video data corresponding to the whole target object, and an initial model established by the server based on the three-dimensional video data is an initial model corresponding to the whole target object.
In another embodiment, the server matches the initial model with the local models that make up the global model in a pre-set of models. The present embodiment is applicable to a scene in which the received three-dimensional video data is local data of a part corresponding to the target object, that is, as an example, the terminal transmits the acquired three-dimensional video data of each part corresponding to the target object to the server, and the server needs to perform modeling processing on the received three-dimensional video data of each part, that is, the initial model obtained here is an initial model of each part corresponding to the target object.
In this embodiment, the matching the initial model with the models in the preset model set includes: and extracting the characteristic parameters of the initial model, and matching the characteristic parameters of the initial model with the characteristic parameters of the models in the model set to obtain the matching rate.
Specifically, in the process of matching the initial model with the models in the preset model set, regardless of the initial model corresponding to the whole target object or the initial models corresponding to the parts of the target object, as an embodiment, the characteristic parameters of the initial model are extracted, and the extracted characteristic parameters are matched with the characteristic parameters of the models in the model set; if the matching rate of the extracted characteristic parameters and the characteristic parameters of a certain model exceeds a preset threshold value, the matching success can be indicated; correspondingly, if the matching rate of the extracted characteristic parameters and the characteristic parameters of any model in the model set does not exceed the preset threshold, the matching failure can be indicated. The characteristic parameters may be parameters characterizing feature points of the contour and/or key points of the bone.
In an embodiment, as shown in fig. 6, the method further comprises:
step 203 a: and when the matching result is that the initial model is matched with a model in a preset model set, sending first indication information to the terminal, wherein the first indication information is used for indicating the terminal to continuously transmit other three-dimensional video data.
In this embodiment, if the MEC server determines that the initial model matches a model in a preset model set, that is, a model corresponding to the three-dimensional video data is successfully established, the MEC server sends first indication information to the terminal, where the first indication information indicates that the previously transmitted three-dimensional video data can be successfully modeled, and the MEC server can continue to transmit the next three-dimensional video data.
In one embodiment of the present invention, when the matching result is that the initial model matches a model in a preset model set, a first model is generated based on the three-dimensional video data and the matched model.
In this embodiment, when the matching result is that the initial model matches a model in a preset model set, it indicates that an integral model of a corresponding target object has been stored in the server; however, the integral model is often not completely consistent with the target object corresponding to the three-dimensional video data; the matching model is adjusted and optimized based on the three-dimensional video data (including the two-dimensional video data and the depth data), and it can be understood that the first model corresponding to the target object can be obtained only by performing corresponding adjustment on the basis of the matching model; compared with a mode of generating a model by referring to three-dimensional video data, the method and the device can greatly shorten the time consumed by establishing the model.
In an embodiment of the present invention, when the matching result is that the initial model matches a model in a preset model set, the method further includes: updating the matched model based on the three-dimensional video data. The embodiment can optimize the matched model (namely, the integral model corresponding to a certain target object), and particularly optimize the model based on the depth data and the two-dimensional video data in the obtained three-dimensional video data; the optimization method can adjust the characteristic parameters of the model which are not matched with the characteristic parameters of the initial model by referring to the characteristic parameters of the initial model parameters so as to enable the model to be more accurate and closer to the target object.
In an embodiment, as shown in fig. 6, the method further comprises: step 203 b: and when the matching result is that the initial model is not matched with the model in the preset model set, sending second indication information to the terminal, wherein the second indication information is used for indicating the terminal to resend the three-dimensional video data.
In this embodiment, if the MEC server determines that the initial model is not matched with the models in the preset model set, it may be understood that the server has not successfully built the model corresponding to the three-dimensional video data, and then send second indication information to the terminal, where the second indication information indicates that the previously transmitted three-dimensional video data cannot be successfully modeled and needs to be retransmitted corresponding three-dimensional video data.
By adopting the technical scheme of the embodiment of the invention, the server can be matched with the preset model based on the obtained three-dimensional video data of one frame through the integral model of the plurality of target objects preset in the server, and the model of the target object can be quickly established based on the matched model, so that the modeling time is greatly shortened; on the other hand, because the model is preset in the server, the requirement of technical support required in the data transmission process is reduced, namely, a faster data transmission rate and a stable data transmission environment are not required, and the method is suitable for various communication scenes; in addition, because the model is preset in the server, the modeling can be carried out without transmitting all three-dimensional video data acquired by the terminal, and the data volume needing to be transmitted is reduced to a certain extent. In addition, the present embodiment stores the three-dimensional video data sent out by the terminal, and is suitable for scenes satisfying a predetermined condition (for example, poor transmission quality).
In order to implement the method of the terminal side in the embodiment of the invention, the embodiment of the invention also provides the terminal. Fig. 7 is a schematic structural diagram of a terminal according to an embodiment of the present invention; as shown in fig. 7, the terminal includes: the acquisition unit 31, the detection unit 32, the storage unit 33, the processing unit 34 and the first communication unit 35; wherein the content of the first and second substances,
the acquiring unit 31 is configured to acquire three-dimensional video data;
the detection unit 32 is configured to detect whether a predetermined condition is satisfied;
the storage unit 33 is configured to store the three-dimensional video data when the detection unit 32 detects that a predetermined condition is satisfied;
the processing unit 34 is configured to, when the detecting unit 32 detects that a predetermined condition is met, process the three-dimensional video data according to a preset rule;
the first communication unit 35 is configured to send the three-dimensional video data processed by the processing unit 34 to an MEC server.
In this embodiment, the detecting unit 32 is configured to detect transmission quality information of a communication channel between the MEC server and the MEC server, and determine that a predetermined condition is met when the transmission quality information does not meet a preset transmission standard.
In an embodiment, the processing unit 34 is configured to perform segmentation processing on the three-dimensional video data according to a preset rule to obtain a plurality of sub-data;
the first communication unit 35 is configured to send the plurality of sub-data to the MEC server; alternatively, the first and second electrodes may be,
the processing unit 34 is configured to perform compression processing on the three-dimensional video data according to a preset rule;
the first communication unit 35 is configured to send the compressed three-dimensional video data to an MEC server.
As an embodiment, the first communication unit 35 is further configured to receive first indication information from the MEC server; the first indication information is used for indicating the terminal to continue to transmit other three-dimensional video data;
the obtaining unit 31 is further configured to obtain other three-dimensional video data based on the first indication information;
the first communication unit 35 is further configured to send the other three-dimensional video data to the MEC server.
As another embodiment, the first communication unit 35 is further configured to receive second indication information from the MEC server; the second indication information is used for indicating the terminal to resend the three-dimensional video data;
the first communication unit 35 is further configured to resend the three-dimensional video data stored in the storage unit 33 based on the second indication information.
In the embodiment of the present invention, the obtaining Unit 31, the detecting Unit 32, and the Processing Unit 34 in the terminal may be implemented by a Processor in the terminal, such as a Central Processing Unit (CPU), a Digital Signal Processor (DSP), a Micro Control Unit (MCU), or a Programmable Gate Array (FPGA); the first communication unit 35 in the terminal can be implemented by a communication module (including a basic communication suite, an operating system, a communication module, a standardized interface, a protocol and the like) and a transceiving antenna in practical application; the storage unit 33 in the terminal can be implemented by a memory in practical applications.
It should be noted that: in the terminal provided in the above embodiment, when performing data processing, only the division of each program module is illustrated, and in practical applications, the processing distribution may be completed by different program modules according to needs, that is, the internal structure of the terminal is divided into different program modules to complete all or part of the processing described above. In addition, the terminal and the data processing method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.
Correspondingly, in order to implement the method at the server side in the embodiment of the invention, the embodiment of the invention also provides a server, in particular an MEC server. FIG. 8 is a schematic diagram of a component structure of a server according to an embodiment of the present invention; as shown in fig. 8, the server includes a second communication unit 41, a modeling unit 42, and a matching unit 43; wherein the content of the first and second substances,
the second communication unit 41 is configured to receive three-dimensional video data from a terminal;
the modeling unit 42 is configured to establish an initial model based on the three-dimensional video data received by the second communication unit 41;
the matching unit 43 is configured to match the initial model with a model in a preset model set; the preset model set comprises integral models of a plurality of target objects;
the second communicating unit 41 is further configured to send instruction information to the terminal based on the matching result obtained by the matching unit 43.
In an embodiment, the modeling unit 42 is further configured to obtain a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target objects; establishing an integral model of the target object based on the plurality of sample data; or, local models of different parts of the target object are established based on the plurality of sample data, and an overall model of different target objects is generated based on the local models of different parts of different target objects.
As an embodiment, the second communication unit 41 is further configured to send, to the terminal, first indication information when the matching result obtained by the matching unit 43 is that the initial model matches a model in a preset model set, where the first indication information is used to instruct the terminal to continue to transmit other three-dimensional video data.
In an embodiment, the modeling unit 42 is further configured to build a first model corresponding to the three-dimensional video data based on the three-dimensional video data and the model when the matching result is that the initial model matches with a model in a preset model set.
In an embodiment, the modeling unit 42 is further configured to update the matched model based on the three-dimensional video data when the matching result obtained by the matching unit 43 is that the initial model matches a model in a preset model set.
As another embodiment, the second communicating unit 41 is further configured to send second indication information to the terminal when the matching result obtained by the matching unit 43 is that the initial model does not match a model in a preset model set, where the second indication information is used to indicate that the terminal retransmits the three-dimensional video data.
In the embodiment of the present invention, the modeling unit 42 and the matching unit 43 in the server may be implemented by a processor in the server, such as a CPU, a DSP, an MCU, or an FPGA, in practical application; the second communication unit 41 in the server can be implemented by a communication module (including a basic communication suite, an operating system, a communication module, a standardized interface, a protocol, etc.) and a transceiver antenna in practical application.
It should be noted that: in the above embodiment, when performing data processing, the server is only exemplified by the division of the program modules, and in practical applications, the above processing may be distributed to different program modules according to needs, that is, the internal structure of the server is divided into different program modules to complete all or part of the above-described processing. In addition, the server and the data processing method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.
Based on the hardware implementation of the above device, an embodiment of the present invention further provides a data processing device, fig. 9 is a schematic diagram of a hardware structure of the data processing device according to the embodiment of the present invention, as shown in fig. 9, the data processing device includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor; as a first implementation manner, when the data processing device is a terminal, the processor located in the terminal executes the program to implement: obtaining three-dimensional video data; and when the fact that the preset conditions are met is detected, the three-dimensional video data are stored, the three-dimensional video data are processed according to preset rules, and the processed three-dimensional video data are sent to an MEC server.
In one embodiment, the processor at the terminal implements, when executing the program: detecting transmission quality information of a communication channel between the MEC server and the MEC server, and determining that a preset condition is met when the transmission quality information does not meet a preset transmission standard.
In one embodiment, the processor at the terminal implements, when executing the program: segmenting the three-dimensional video data according to a preset rule to obtain a plurality of subdata, and sending the plurality of subdata to the MEC server; or compressing the three-dimensional video data according to a preset rule, and sending the compressed three-dimensional video data to an MEC server.
In one embodiment, the processor at the terminal implements, when executing the program: receiving first indication information from the MEC server; the first indication information is used for indicating the terminal to continue to transmit other three-dimensional video data; and obtaining other three-dimensional video data based on the first indication information, and sending the other three-dimensional video data to the MEC server.
In one embodiment, the processor at the terminal implements, when executing the program: receiving second indication information from the MEC server; the second indication information is used for indicating the terminal to resend the three-dimensional video data; and retransmitting the three-dimensional video data based on the second indication information.
As a second embodiment, when the data processing apparatus is an MEC server, the processor located in the server executes the program to implement: receiving three-dimensional video data from a terminal, and establishing an initial model based on the three-dimensional video data; matching the initial model with models in a preset model set; the preset model set comprises integral models of a plurality of target objects; and sending indication information to the terminal based on the matching result.
In one embodiment, the processor located in the MEC server, when executing the program, implements: obtaining a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target objects; establishing an integral model of the target object based on the plurality of sample data; or, local models of different parts of the target object are established based on the plurality of sample data, and an overall model of different target objects is generated based on the local models of different parts of different target objects.
In one embodiment, the processor located in the MEC server, when executing the program, implements: and when the matching result is that the initial model is matched with a model in a preset model set, sending first indication information to the terminal, wherein the first indication information is used for indicating the terminal to continuously transmit other three-dimensional video data.
In one embodiment, the processor located in the MEC server, when executing the program, implements: and when the matching result is that the initial model is matched with a model in a preset model set, establishing a first model corresponding to the three-dimensional video data based on the three-dimensional video data and the model.
In one embodiment, the processor located in the MEC server, when executing the program, implements: and when the matching result is that the initial model is not matched with the model in the preset model set, sending second indication information to the terminal, wherein the second indication information is used for indicating the terminal to resend the three-dimensional video data.
In one embodiment, the processor located in the MEC server, when executing the program, implements: and when the matching result is that the initial model is matched with the model in the preset model set, updating the matched model based on the three-dimensional video data.
It will be appreciated that the data processing apparatus (terminal or server) also comprises a communications interface; the various components in a data processing device (terminal or server) are coupled together by a bus system. It will be appreciated that a bus system is used to enable communications among the components. The bus system includes a power bus, a control bus, and a status signal bus in addition to a data bus.
It will be appreciated that the memory in this embodiment can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a magnetic random access Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. The volatile Memory may be a Random Access Memory (RAM) which serves as an external cache. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The described memory for embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.
The method disclosed by the embodiment of the invention can be applied to a processor or realized by the processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The processor described above may be a general purpose processor, a DSP, or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. The processor may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium having a memory and a processor reading the information in the memory and combining the hardware to perform the steps of the method.
The embodiment of the present invention further provides a chip, which includes a processor, and the processor may call and run a computer program from a memory, so as to implement the method in the embodiment of the present application.
Optionally, the chip may also include a memory. From which a processor may invoke and execute a computer program to implement the methods of the embodiments of the present application.
The memory may be a separate device from the processor or may be integrated into the processor.
Optionally, the chip may further comprise an input interface. The processor may control the input interface to communicate with other devices or chips, and specifically, may obtain information or data sent by other devices or chips.
Optionally, the chip may further include an output interface. The processor may control the output interface to communicate with other devices or chips, and in particular, may output information or data to the other devices or chips.
Optionally, the chip may be applied to the MEC server in the embodiment of the present application, and the chip may implement a corresponding process implemented by the MEC server in each method in the embodiment of the present application, and for brevity, details are not described here again.
Optionally, the chip may be applied to the terminal in the embodiment of the present application, and the chip may implement the corresponding process implemented by the terminal in each method in the embodiment of the present application, and for brevity, details are not described here again.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip or a system-on-chip, etc.
The embodiment of the invention also provides a computer storage medium, in particular to a computer readable storage medium. The data processing method applied to the terminal or the MEC server in the embodiments of the present invention is implemented by storing computer instructions thereon, and the computer instructions are not described herein again for brevity.
Embodiments of the present application also provide a computer program product comprising computer program instructions.
Optionally, the computer program product may be applied to the MEC server in the embodiment of the present application, and the computer program instructions enable the computer to execute the corresponding processes implemented by the MEC server in the methods in the embodiment of the present application, which are not described herein again for brevity.
Optionally, the computer program product may be applied to a terminal in the embodiment of the present application, and the computer program instructions enable the computer to execute corresponding processes implemented by the terminal in the methods in the embodiment of the present application, which are not described herein again for brevity.
The embodiment of the application also provides a computer program.
Optionally, the computer program may be applied to the MEC server in the embodiment of the present application, and when the computer program runs on a computer, the computer is enabled to execute the corresponding process implemented by the MEC server in each method in the embodiment of the present application, and details are not described herein for brevity.
Optionally, the computer program may be applied to the terminal in the embodiment of the present application, and when the computer program runs on the computer, the computer is enabled to execute the corresponding process implemented by the terminal in each method in the embodiment of the present application, and for brevity, details are not described here again.
The embodiment of the invention also provides a data processing system, which comprises the MEC server and a terminal; the terminal may be configured to implement the corresponding function implemented by the terminal in the foregoing method, and the MEC server may be configured to implement the corresponding function implemented by the MEC server in the foregoing method, which is not described herein again for brevity.
In the embodiments provided in the present invention, it should be understood that the disclosed method and apparatus may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one second processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
It should be noted that: the technical schemes described in the embodiments of the present invention can be combined arbitrarily without conflict.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.

Claims (26)

1. A data processing method is characterized in that the method is applied to a terminal; the method comprises the following steps:
obtaining three-dimensional video data;
when the fact that a preset condition is met is detected, the three-dimensional video data are stored, one frame of three-dimensional video data in the three-dimensional video data are processed according to a preset rule, and the processed frame of three-dimensional video data are sent to a mobile edge computing MEC server; the frame of three-dimensional video data is used for the MEC server to establish an initial model used for matching with a preset model;
receiving indication information from the MEC server, wherein the indication information is used for indicating the terminal to continue to transmit other three-dimensional video data or retransmit the stored frame of three-dimensional video data; the indication information is sent by the MEC server based on a matching result of the initial model and a preset model.
2. The method of claim 1, wherein the detecting that a predetermined condition is satisfied comprises:
detecting transmission quality information of a communication channel between the MEC server and the MEC server, and determining that a preset condition is met when the transmission quality information does not meet a preset transmission standard.
3. The method according to claim 1, wherein the processing the three-dimensional video data according to the preset rule and sending the processed three-dimensional video data to a mobile edge computing MEC server comprises:
segmenting the three-dimensional video data according to a preset rule to obtain a plurality of subdata, and sending the plurality of subdata to the MEC server; alternatively, the first and second electrodes may be,
and compressing the three-dimensional video data according to a preset rule, and sending the compressed three-dimensional video data to an MEC server.
4. The method of claim 1, further comprising:
receiving first indication information from the MEC server; the first indication information is used for indicating the terminal to continue to transmit other three-dimensional video data;
and obtaining other three-dimensional video data based on the first indication information, and sending the other three-dimensional video data to the MEC server.
5. The method of claim 1, further comprising:
receiving second indication information from the MEC server; the second indication information is used for indicating the terminal to resend the three-dimensional video data;
and retransmitting the three-dimensional video data based on the second indication information.
6. A data processing method is applied to an MEC server; the method comprises the following steps:
receiving a frame of three-dimensional video data from a terminal, and establishing an initial model based on the frame of three-dimensional video data; the frame of three-dimensional video data is obtained after the terminal processes one frame of three-dimensional video data in the obtained three-dimensional video data;
matching the initial model with models in a preset model set; the preset model set comprises integral models of a plurality of target objects;
and sending indication information to the terminal based on the matching result, wherein the indication information is used for indicating the terminal to continue to transmit other three-dimensional video data or retransmit the stored frame of three-dimensional video data.
7. The method of claim 6, further comprising:
obtaining a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target objects;
establishing an integral model of the target object based on the plurality of sample data; or, local models of different parts of the target object are established based on the plurality of sample data, and an overall model of different target objects is generated based on the local models of different parts of different target objects.
8. The method according to claim 6, wherein the sending the indication information to the terminal based on the matching result comprises:
and when the matching result is that the initial model is matched with a model in a preset model set, sending first indication information to the terminal, wherein the first indication information is used for indicating the terminal to continuously transmit other three-dimensional video data.
9. The method of claim 8, wherein when the matching result is that the initial model matches a model in a preset model set, the method further comprises:
and establishing a first model corresponding to the three-dimensional video data based on the three-dimensional video data and the model matched with the initial model in the preset model set.
10. The method according to claim 6, wherein the sending the indication information to the terminal based on the matching result comprises:
and when the matching result is that the initial model is not matched with the model in the preset model set, sending second indication information to the terminal, wherein the second indication information is used for indicating the terminal to resend the three-dimensional video data.
11. The method of claim 8, wherein when the matching result is that the initial model matches a model in a preset model set, the method further comprises:
updating the matched model based on the three-dimensional video data.
12. A terminal, characterized in that the terminal comprises: the device comprises an acquisition unit, a detection unit, a storage unit, a processing unit and a first communication unit; wherein the content of the first and second substances,
the acquisition unit is used for acquiring three-dimensional video data;
the detection unit is used for detecting whether a preset condition is met;
the storage unit is used for storing the three-dimensional video data when the detection unit detects that a preset condition is met;
the processing unit is used for processing one frame of three-dimensional video data in the three-dimensional video data according to a preset rule when the detection unit detects that a preset condition is met;
the first communication unit is used for sending the frame of three-dimensional video data processed by the processing unit to an MEC server; the frame of three-dimensional video data is used for the MEC server to establish an initial model used for matching with a preset model; the MEC server is further used for receiving indication information from the MEC server, wherein the indication information is used for indicating the terminal to continue to transmit other three-dimensional video data or retransmit the stored frame of three-dimensional video data; the indication information is sent by the MEC server based on a matching result of the initial model and a preset model.
13. The terminal of claim 12, wherein the detecting unit is configured to detect transmission quality information of a communication channel with the MEC server, and determine that the predetermined condition is satisfied when the transmission quality information does not meet a preset transmission standard.
14. The terminal according to claim 12, wherein the processing unit is configured to perform segmentation processing on the three-dimensional video data according to a preset rule to obtain a plurality of sub-data;
the first communication unit is configured to send the plurality of sub-data to the MEC server; alternatively, the first and second electrodes may be,
the processing unit is used for compressing the three-dimensional video data according to a preset rule;
and the first communication unit is used for sending the compressed three-dimensional video data to the MEC server.
15. The terminal of claim 12, wherein the first communication unit is further configured to receive first indication information from the MEC server; the first indication information is used for indicating the terminal to continue to transmit other three-dimensional video data;
the acquisition unit is further used for acquiring other three-dimensional video data based on the first indication information;
the first communication unit is further configured to send the other three-dimensional video data to the MEC server.
16. The terminal of claim 12, wherein the first communication unit is further configured to receive second indication information from the MEC server; the second indication information is used for indicating the terminal to resend the three-dimensional video data;
the first communication unit is further configured to resend the three-dimensional video data stored in the storage unit based on the second indication information.
17. An MEC server, characterized in that the server comprises a second communication unit, a modeling unit and a matching unit; wherein the content of the first and second substances,
the second communication unit is used for receiving a frame of three-dimensional video data from the terminal;
the modeling unit is used for establishing an initial model based on the frame of three-dimensional video data received by the second communication unit; the frame of three-dimensional video data is obtained after the terminal processes one frame of three-dimensional video data in the obtained three-dimensional video data;
the matching unit is used for matching the initial model with models in a preset model set; the preset model set comprises integral models of a plurality of target objects;
the second communication unit is further configured to send, to the terminal, indication information based on the matching result obtained by the matching unit, where the indication information is used to indicate the terminal to continue to transmit other three-dimensional video data or retransmit the stored frame of three-dimensional video data.
18. The server according to claim 17, wherein the modeling unit is further configured to obtain a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target objects; establishing an integral model of the target object based on the plurality of sample data; or, local models of different parts of the target object are established based on the plurality of sample data, and an overall model of different target objects is generated based on the local models of different parts of different target objects.
19. The server according to claim 17, wherein the second communication unit is further configured to send first indication information to the terminal when the matching result obtained by the matching unit is that the initial model matches a model in a preset model set, and the first indication information is used to instruct the terminal to continue to transmit other three-dimensional video data.
20. The server according to claim 19, wherein the modeling unit is further configured to build a first model corresponding to the three-dimensional video data based on the three-dimensional video data and a model in the preset model set matching with the initial model when the matching result is that the initial model matches with a model in a preset model set.
21. The server according to claim 17, wherein the second communicating unit is further configured to send second indication information to the terminal when the matching result obtained by the matching unit is that the initial model does not match a model in a preset model set, and the second indication information is used to instruct the terminal to resend the three-dimensional video data.
22. The server according to claim 19, wherein the modeling unit is further configured to update the matched model based on the three-dimensional video data when the matching result obtained by the matching unit is that the initial model matches a model in a preset model set.
23. A computer-readable storage medium having stored thereon computer instructions, characterized in that the instructions, when executed by a processor, implement the steps of the data processing method according to any one of claims 1 to 5; alternatively, the instructions when executed by the processor implement the steps of the data processing method of any of claims 6 to 11.
24. A terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the data processing method according to any of claims 1 to 5 are implemented when the processor executes the program.
25. An MEC server comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the data processing method according to any one of claims 6 to 11 are implemented when the program is executed by the processor.
26. A chip, comprising: a processor for calling and running a computer program from a memory so that a device on which the chip is installed performs the steps of the data processing method according to any one of claims 1 to 5; or to perform the steps of the data processing method of any of claims 6 to 11.
CN201811163283.6A 2018-09-30 2018-09-30 Data processing method, terminal, server and computer storage medium Active CN109413405B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811163283.6A CN109413405B (en) 2018-09-30 2018-09-30 Data processing method, terminal, server and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811163283.6A CN109413405B (en) 2018-09-30 2018-09-30 Data processing method, terminal, server and computer storage medium

Publications (2)

Publication Number Publication Date
CN109413405A CN109413405A (en) 2019-03-01
CN109413405B true CN109413405B (en) 2020-07-03

Family

ID=65466775

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811163283.6A Active CN109413405B (en) 2018-09-30 2018-09-30 Data processing method, terminal, server and computer storage medium

Country Status (1)

Country Link
CN (1) CN109413405B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111371874B (en) * 2020-02-28 2021-10-08 腾讯科技(深圳)有限公司 Industrial data transmission method and device, storage medium and electronic equipment
CN112419483A (en) * 2020-11-24 2021-02-26 中电科新型智慧城市研究院有限公司 Three-dimensional model data transmission method and server

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101106410B (en) * 2006-07-13 2011-05-18 华为技术有限公司 A data retransfer method of multi-input and multi-output system and data transmission terminal device
CN101552660B (en) * 2008-04-01 2012-06-27 中国移动通信集团公司 Method as well as device and communication system for retransmitting streaming media data
KR101632076B1 (en) * 2009-04-13 2016-06-21 삼성전자주식회사 Apparatus and method for transmitting stereoscopic image data according to priority
US8156238B2 (en) * 2009-05-13 2012-04-10 Stmicroelectronics, Inc. Wireless multimedia transport method and apparatus
CN101588595B (en) * 2009-07-07 2012-01-25 董志 Method for dynamically regulating data transfer rate in wireless application service system
CN105681002B (en) * 2015-12-30 2019-03-29 海能达通信股份有限公司 Transfer control method, device, system and the communication equipment of multicast packet
CN108111259A (en) * 2017-12-28 2018-06-01 北京航天晨信科技有限责任公司 One kind is used for narrow band data method for reliable transmission

Also Published As

Publication number Publication date
CN109413405A (en) 2019-03-01

Similar Documents

Publication Publication Date Title
CN108495112B (en) Data transmission method, terminal and computer storage medium
US9774642B2 (en) Method and device for pushing multimedia resource and display terminal
US11146288B2 (en) Technologies for applying a redundancy encoding scheme to segmented network packets
CN109410319B (en) Data processing method, server and computer storage medium
CN109413405B (en) Data processing method, terminal, server and computer storage medium
US10271218B2 (en) Enable access point availability prediction
CN109151430B (en) Data processing method, terminal, server and computer storage medium
CN108632376B (en) Data processing method, terminal, server and computer storage medium
WO2020063171A1 (en) Data transmission method, terminal, server and storage medium
CN109246409B (en) Data processing method, terminal, server and computer storage medium
CN109147043B (en) Data processing method, server and computer storage medium
CN109345623B (en) Model verification method, server and computer storage medium
CN109302598B (en) Data processing method, terminal, server and computer storage medium
CN109299323B (en) Data processing method, terminal, server and computer storage medium
CN109151435B (en) Data processing method, terminal, server and computer storage medium
WO2020062919A1 (en) Data processing method, mec server and terminal device
CN109325997B (en) Model checking method, server and computer storage medium
CN108737807B (en) Data processing method, terminal, server and computer storage medium
US10564601B2 (en) Method and system for image processing and data transmission in network-based multi-camera environment
CN109120912B (en) Data processing method, MEC server, terminal equipment and device
RU2800627C2 (en) Method of data processing, server and computer storage medium
EP4220494A1 (en) Information processing apparatus, information processing method, and non-transitory storage medium
CN116420423A (en) Communication method, device and system
KR20220007172A (en) Image synchronization method and device, device, computer storage medium
CN116170840A (en) Model-based channel state information acquisition method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant