CN114727083A - Data processing method, device, terminal and network side equipment - Google Patents

Data processing method, device, terminal and network side equipment Download PDF

Info

Publication number
CN114727083A
CN114727083A CN202110001458.9A CN202110001458A CN114727083A CN 114727083 A CN114727083 A CN 114727083A CN 202110001458 A CN202110001458 A CN 202110001458A CN 114727083 A CN114727083 A CN 114727083A
Authority
CN
China
Prior art keywords
transmission condition
point cloud
cloud data
data processing
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110001458.9A
Other languages
Chinese (zh)
Inventor
王凯悦
李可
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Communications Ltd Research Institute
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Communications Ltd Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Communications Ltd Research Institute filed Critical China Mobile Communications Group Co Ltd
Priority to CN202110001458.9A priority Critical patent/CN114727083A/en
Publication of CN114727083A publication Critical patent/CN114727083A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04—Protocols for data compression, e.g. ROHC
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/62—Semi-transparency

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Computer Security & Cryptography (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention provides a data processing method, a data processing device, a terminal and network side equipment, and relates to the technical field of communication. The method comprises the following steps: acquiring compressed point cloud data, wherein the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and a preset transmission condition; and rendering the compressed point cloud data according to the relation between the transmission condition information and the preset transmission condition. According to the scheme, the network side equipment acquires the compressed point cloud data, and performs medium rendering on the compressed point cloud data according to the relation between the transmission condition information and the preset transmission condition, for example, high-precision three-dimensional reconstruction and rendering operation is performed when the transmission condition is good, and low-precision three-dimensional reconstruction and rendering operation is performed when the transmission condition is not good, so that the rendering process of the point cloud data can adapt to the change condition of resource transmission, and the influence on user experience caused by the poor resource transmission condition can be reduced.

Description

Data processing method, device, terminal and network side equipment
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data processing method, an apparatus, a terminal, and a network device.
Background
At present, the technology of Augmented Reality (AR) is developed rapidly, and the characteristics of low delay and large bandwidth of a 5G network bring a huge opportunity for the deep development of the AR technology. The cloud AR technology enables real world information and virtual world information content to be fused, and the virtual information content is effectively applied to the real world, so that the real world information and the virtual world information content can be perceived by human senses in the process, and the sense experience beyond reality is achieved. In order to simulate the environment change situation as truly as possible, special effects are often required to be added in a specific scene. The special effect is an effect of making an object look like a medium to which smoke, rain, fog, or the like is superimposed in a direction away from the user's angle of view. In the related technology, the point cloud data acquired by the terminal is firstly subjected to three-dimensional reconstruction, and then the medium rendering operation is directly performed on the three-dimensional reconstructed scene, so that the point cloud data rendering process is difficult to adapt to the change condition of resource transmission.
Disclosure of Invention
The invention aims to provide a data processing method, a data processing device, a terminal and network side equipment, and aims to solve the problem that the existing point cloud data rendering process is difficult to adapt to the change condition of resource transmission.
To achieve the above object, an embodiment of the present invention provides a data processing method, executed by a terminal, including:
acquiring transmission state information between a terminal and network side equipment;
compressing point cloud data according to the relation between the transmission condition information and a preset transmission condition;
and sending the compressed point cloud data to network side equipment.
Optionally, compressing the point cloud data according to the relationship between the transmission condition information and a preset transmission condition includes:
under the condition that the transmission condition information does not meet the preset transmission condition, performing first compression processing on the point cloud data to obtain first point cloud data;
or under the condition that the transmission condition information meets the preset transmission condition, performing second compression processing on the point cloud data to obtain second point cloud data.
Optionally, the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
Optionally, the performing a first compression process on the point cloud data includes:
determining an area of interest in an image corresponding to the point cloud data according to the depth information and curvature features of the point cloud data;
compressing the region of interest according to a first compression ratio, and compressing the non-region of interest except the region of interest according to a second compression ratio;
wherein the first compression ratio is less than the second compression ratio.
Optionally, the point cloud data within the region of interest satisfies at least one of:
the depth value corresponding to the depth information is smaller than a first threshold value;
the curvature feature corresponds to a curvature value greater than a second threshold.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
The embodiment of the invention also provides a data processing method, which is executed by network side equipment and comprises the following steps:
acquiring compressed point cloud data, wherein the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and a preset transmission condition;
and rendering the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition.
Acquiring compressed point cloud data, wherein the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and a preset transmission condition;
and rendering the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition.
Optionally, the rendering the compressed point cloud data according to the relationship between the transmission condition information and a preset transmission condition includes:
performing three-dimensional reconstruction operation on the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition to obtain a target scene;
and performing media rendering in the target scene according to the relation between the transmission condition information and a preset transmission condition.
Optionally, the performing, according to the relationship between the transmission condition information and a preset transmission condition, a three-dimensional reconstruction operation on the compressed point cloud data to obtain a target scene includes:
under the condition that the transmission condition information meets a preset transmission condition, performing three-dimensional reconstruction operation with first precision on the compressed point cloud data to obtain a first target scene;
or, under the condition that the transmission condition information does not meet the preset transmission condition, performing three-dimensional reconstruction operation with second precision on the compressed point cloud data to obtain a second target scene.
Optionally, the first precision is greater than the second precision.
Optionally, the performing, according to the relationship between the transmission condition information and a preset transmission condition, media rendering in the target scene includes:
setting a medium with third precision in the target scene under the condition that the transmission condition information does not meet the preset transmission condition;
or, setting a medium with a fourth precision in the target scene when the transmission condition information meets a preset transmission condition.
Optionally, the third precision is greater than the fourth precision.
Optionally, the performing media rendering in the target scene further includes:
setting a medium with transparency as a first numerical value for an area with a curvature value larger than a preset curvature threshold value in the target scene;
and/or setting a medium with transparency of a second value for an area with the curvature value smaller than or equal to a preset curvature value in the target scene.
Optionally, the first value is less than the second value.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
The embodiment of the invention also provides a data processing device, which is applied to a terminal and comprises the following components:
the first acquisition module is used for acquiring transmission state information between the terminal and the network side equipment;
the first processing module is used for compressing the point cloud data according to the relation between the transmission condition information and a preset transmission condition;
and the first transmission module is used for sending the compressed point cloud data to the network side equipment.
Optionally, the first processing module is configured to perform first compression processing on the point cloud data to obtain first point cloud data when the transmission condition information does not meet a preset transmission condition;
or under the condition that the transmission condition information meets the preset transmission condition, performing second compression processing on the point cloud data to obtain second point cloud data.
Optionally, the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
Optionally, the first processing module includes:
the first determining submodule is used for determining an interesting region in an image corresponding to the point cloud data according to the depth information and the curvature characteristics of the point cloud data;
the first processing sub-module is used for compressing the region of interest according to a first compression ratio and compressing the non-region of interest except the region of interest according to a second compression ratio;
wherein the first compression ratio is less than the second compression ratio.
The embodiment of the present invention further provides a data processing apparatus, which is applied to a network side device, and includes:
the second acquisition module is used for acquiring compressed point cloud data, and the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and the preset transmission condition;
and the rendering module is used for rendering the compressed point cloud data according to the relation between the transmission condition information and the preset transmission condition.
Optionally, the rendering module comprises:
the first rendering submodule is used for performing three-dimensional reconstruction operation on the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition to obtain a target scene;
and the second rendering submodule is used for performing medium rendering in the target scene according to the relation between the transmission condition information and a preset transmission condition.
Optionally, the first rendering sub-module is configured to perform a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene when the transmission condition information meets a preset transmission condition;
or, under the condition that the transmission condition information does not meet the preset transmission condition, performing three-dimensional reconstruction operation with second precision on the compressed point cloud data to obtain a second target scene.
Optionally, the first precision is greater than the second precision.
Optionally, the second rendering sub-module is configured to set a medium of a third precision in the target scene when the transmission condition information does not satisfy a preset transmission condition;
or, setting a medium with a fourth precision in the target scene when the transmission condition information meets a preset transmission condition.
Optionally, the third precision is greater than the fourth precision.
Optionally, the second rendering sub-module is further configured to set a medium with a transparency as a first value for an area in the target scene where the curvature value is greater than a preset curvature threshold;
and/or setting a medium with transparency of a second value for an area with the curvature value smaller than or equal to a preset curvature value in the target scene.
Optionally, the first value is less than the second value.
An embodiment of the present invention further provides a terminal, including: a transceiver and a processor:
the transceiver is used for acquiring transmission state information between the terminal and the network side equipment;
the processor is used for compressing the point cloud data according to the relation between the transmission condition information and a preset transmission condition;
and the transceiver is used for sending the compressed point cloud data to network side equipment.
An embodiment of the present invention further provides a network side device, including: a transceiver and a processor:
the transceiver is used for acquiring compressed point cloud data, and the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and the preset transmission condition;
and the processor is used for rendering the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition.
An embodiment of the present invention further provides a data processing apparatus, including: a transceiver, a processor, a memory, and a program or instructions stored on the memory and executable on the processor; the processor, when executing the program or instructions, implements the steps in the data processing method as described above.
Embodiments of the present invention further provide a readable storage medium, on which a program or instructions are stored, and when the program or instructions are executed by a processor, the program or instructions implement the steps in the data processing method as described above.
The technical scheme of the invention has the following beneficial effects:
in the embodiment of the invention, the network side equipment acquires the compressed point cloud data, and performs medium rendering on the compressed point cloud data according to the relation between the transmission condition information and the preset transmission condition, for example, high-precision three-dimensional reconstruction and rendering operation is performed when the transmission condition is good, and low-precision three-dimensional reconstruction and rendering operation is performed when the transmission condition is not good, so that the rendering process of the point cloud data can adapt to the change condition of resource transmission, and the influence on user experience caused by the poor resource transmission condition can be reduced.
Drawings
Fig. 1 is a schematic interaction diagram of a terminal and a network-side device in an embodiment of the present invention;
FIG. 2 is a flow chart of a data processing method according to an embodiment of the present invention;
FIG. 3 is a second flowchart illustrating a data processing method according to an embodiment of the present invention;
FIG. 4 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
FIG. 5 is a second block diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 6 is a block diagram of a terminal according to an embodiment of the present invention;
fig. 7 is a block diagram of a network device according to an embodiment of the present invention;
FIG. 8 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 9 is a second block diagram of a data processing apparatus according to an embodiment of the invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
In various embodiments of the present invention, it should be understood that the sequence numbers of the following processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
In addition, the terms "system" and "network" are often used interchangeably herein.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B can be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may be determined from a and/or other information.
An embodiment of the present invention provides a data processing method, which is executed by a terminal, and as shown in fig. 1, the terminal may include an acquisition module, a data compression module, and a display module, where the acquisition module may acquire a set of object surface data points, and may acquire the set of object surface data points through a scanning instrument such as a laser radar, and may include, in addition to a three-dimensional position coordinate, information that includes a color, an intensity value, time, and the like. The terminal has a light weight feature and can perform simple motion capture and screen display. The terminal may also include a computing module that may implement computing functions of lower processing power.
As shown in fig. 2, the method includes:
step 201: and acquiring the transmission state information between the terminal and the network side equipment.
Optionally, the transmission status information includes a transmission delay.
In this step, the network side device may be specifically a base station, and an edge cloud or a center cloud is disposed in the base station. Optionally, the transmission status information between the terminal and the network side device is detected by the edge cloud, and the transmission status information is sent to the terminal. Namely, the terminal acquires the transmission condition information from the edge cloud. Of course, the terminal itself may have a defect, and the transmission status information between the terminal and the network side device may also be used.
Step 202: and compressing the point cloud data according to the relation between the transmission condition information and the preset transmission condition.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
The point cloud data is a set of object surface data points collected by a terminal.
The current transmission condition is indicated to be good when the transmission condition information meets the preset transmission condition, the current transmission condition is indicated to be not good when the transmission condition information does not meet the preset transmission condition, and the terminal can perform different compression processing on the point cloud data according to different transmission conditions. For example, when the transmission condition is good, the point cloud data is compressed to a smaller extent, and when the transmission condition is not good, the point cloud data is compressed to a larger extent, so as to reduce the influence on the user experience when the resource transmission condition is not good.
Step 203: and sending the compressed point cloud data to network side equipment.
And the compressed point cloud data is sent to network side equipment, such as edge cloud, and the compressed point cloud data is rendered by the edge cloud according to the relation between the transmission condition information and the preset transmission condition, so that the rendering process of the point cloud data can adapt to the change condition of resource transmission, and the influence on user experience when the resource transmission condition is not good can be reduced.
Optionally, compressing the point cloud data according to the relationship between the transmission condition information and a preset transmission condition includes:
under the condition that the transmission condition information does not meet the preset transmission condition, performing first compression processing on the point cloud data to obtain first point cloud data;
or under the condition that the transmission condition information meets the preset transmission condition, performing second compression processing on the point cloud data to obtain second point cloud data, wherein the precision of the second point cloud data is greater than that of the first point cloud data.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
The accuracy of the second point cloud data is higher than that of the first point cloud data, which can be understood as that the data amount of the image corresponding to the second point cloud data is larger than that of the image corresponding to the first point cloud data.
Optionally, the performing a first compression process on the point cloud data includes:
determining an area of interest in an image corresponding to the point cloud data according to the depth information and curvature features of the point cloud data;
compressing the region of interest according to a first compression ratio, and compressing the non-region of interest except the region of interest according to a second compression ratio;
wherein the first compression ratio is less than the second compression ratio.
In the embodiment of the invention, when the transmission condition is not good, the depth information and the curvature characteristic of the point cloud data are combined to determine the region of interest, the region of interest is compressed to a lower degree so as to ensure the accurate reconstruction effect, the characteristic of the region of interest is highlighted, and the region of non-interest is compressed to a higher degree so as to reduce the rendering load and the power consumption and ensure the user experience.
Optionally, the point cloud data within the region of interest satisfies at least one of:
the depth value corresponding to the depth information is smaller than a first threshold value;
the curvature feature corresponds to a curvature value greater than a second threshold.
That is to say, in the embodiment of the present invention, the region of interest refers to a region where the depth corresponding to the depth information is less than the first threshold, and/or the curvature value corresponding to the curvature feature is greater than the second threshold.
According to the data processing method provided by the embodiment of the invention, when the transmission condition is not good, the terminal determines the region of interest by combining the depth information and the curvature characteristic of the point cloud data, and compresses the region of interest to a lower degree so as to ensure an accurate reconstruction effect, highlights the characteristic of the region of interest, and compresses the region of no interest to a higher degree so as to reduce the rendering load and power consumption and ensure the user experience.
The embodiment of the invention also provides a data processing method, which is executed by network side equipment, wherein the network side equipment is a base station, and specifically comprises an edge cloud, and the edge cloud has a server with high running speed, so that the rendering with huge calculation amount and the complex three-dimensional reconstruction operation can be performed. As shown in fig. 1, the edge cloud includes a resource management module, a data processing module, and a display processing module, the resource management module is configured to manage resources for data transmission, the data processing module is configured to transmit point cloud data with a terminal, and the display processing module is configured to perform three-dimensional reconstruction and media rendering.
As shown in fig. 3, the method includes:
step 301: and acquiring compressed point cloud data, wherein the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and the preset transmission condition.
Here, the terminal compresses the point cloud data according to the relationship between the transmission status information and the preset transmission condition, and sends the point cloud data to the network side device, and a specific compression process is described in detail in the method embodiment of the terminal side, and is not described here again.
Step 302: and performing medium rendering on the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition.
Optionally, the transmission status information includes a transmission delay. The preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
Specifically, when the transmission condition information meets the preset transmission condition, high-precision three-dimensional reconstruction and rendering operation is performed on the compressed point cloud data, and when the transmission condition information does not meet the preset transmission condition, low-precision three-dimensional reconstruction and rendering operation is performed on the compressed point cloud data.
According to the data processing method, the compressed point cloud data is obtained, medium rendering is carried out on the compressed point cloud data according to the relation between the transmission condition information and the preset transmission condition, for example, high-precision three-dimensional reconstruction and rendering operation is carried out when the transmission condition is good, and low-precision three-dimensional reconstruction and rendering operation is carried out when the transmission condition is not good, so that the rendering process of the point cloud data can adapt to the change condition of resource transmission, and the influence on user experience caused by the poor resource transmission condition can be reduced.
Optionally, the rendering the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition includes:
performing three-dimensional reconstruction operation on the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition to obtain a target scene;
and performing media rendering in the target scene according to the relation between the transmission condition information and a preset transmission condition.
Further optionally, the performing, according to the relationship between the transmission condition information and a preset transmission condition, a three-dimensional reconstruction operation on the compressed point cloud data to obtain a target scene includes:
under the condition that the transmission condition information meets a preset transmission condition, performing three-dimensional reconstruction operation with first precision on the compressed point cloud data to obtain a first target scene;
or, under the condition that the transmission condition information does not meet the preset transmission condition, performing three-dimensional reconstruction operation with second precision on the compressed point cloud data to obtain a second target scene;
wherein the first precision is greater than the second precision.
In the embodiment of the invention, when the transmission condition is good, high-precision three-dimensional reconstruction operation is carried out to obtain a high-precision target scene, and when the transmission condition is poor, low-precision three-dimensional reconstruction operation is carried out to obtain a low-precision target scene, namely the precision of the second target scene is smaller than that of the first target scene.
Further optionally, the performing, according to the relationship between the transmission condition information and a preset transmission condition, media rendering in the target scene includes:
setting a medium with third precision in the target scene under the condition that the transmission condition information does not meet the preset transmission condition;
or, setting a medium with a fourth precision in the target scene under the condition that the transmission condition information meets a preset transmission condition;
wherein the third precision is greater than the fourth precision.
In the embodiment of the invention, data processing of media such as smoke, cloud, fog and the like is carried out by combining the transmission conditions of the terminal and the base station. When the transmission condition is good, because the precision of the three-dimensional reconstructed target scene is high, a low-precision superposition medium is set; when the transmission condition is not good, the accuracy of the three-dimensional reconstructed target scene is low, high-accuracy superposed media are adopted, and the user experience is fully guaranteed through the media with different accuracies.
Further optionally, the performing media rendering in the target scene further includes:
setting a medium with transparency as a first numerical value for an area with a curvature value larger than a preset curvature threshold value in the target scene;
and/or setting a medium with transparency as a second numerical value for an area with a curvature value smaller than or equal to a preset curvature value in the target scene;
wherein the first value is less than the second value.
First, the transparency will be explained below.
When transparency mixing of media such as smoke, cloud and fog is carried out, the method is to mix RGB values (represented by R1, G1 and B1) of a foreground (media) and RGB values (represented by R2, G2 and B2) of a target scene (background) respectively according to a proportion, wherein the transparency alpha is 0-1, the transparency alpha is 0 to represent full transparency, the transparency alpha is 1 to represent opacity, and finally the mixed RGB values are obtained. The formula is as follows:
R3＝R1*alpha+R2*(1-alpha)；
G3＝G1*alpha+G2*(1-alpha)；
B3＝B1*alpha+B2*(1-alpha)。
in the embodiment of the invention, the transparency values of the medium such as smoke, cloud, fog and the like are set according to the curvature information of the stored three-dimensional point cloud data. For regions with large curvature values (e.g., steep hills, human faces, and body contours), a clearer display effect is required; and the area with smaller curvature value (such as a flat mountain and a flat back) has low requirement on the visual display effect. Thus, the transparency value of the medium can be set according to the curvature characteristics. And setting a smaller medium transparency value for the area with a larger curvature value and a larger medium transparency value for the area with a smaller curvature value, so that key areas (such as human faces and limb outlines) are clearly shown, and the simulation reality sense is improved.
According to the data processing method, the compressed point cloud data is obtained, medium rendering is carried out on the compressed point cloud data according to the relation between the transmission condition information and the preset transmission condition, for example, high-precision three-dimensional reconstruction and rendering operation is carried out when the transmission condition is good, and low-precision three-dimensional reconstruction and rendering operation is carried out when the transmission condition is not good, so that the rendering process of the point cloud data can adapt to the change condition of resource transmission, and the influence on user experience caused by the poor resource transmission condition can be reduced.
As shown in fig. 4, an embodiment of the present invention further provides a data processing apparatus 400, applied to a terminal, including:
a first obtaining module 401, configured to obtain transmission status information between a terminal and a network side device;
a first processing module 402, configured to compress point cloud data according to a relationship between the transmission condition information and a preset transmission condition;
and a first transmission module 403, configured to send the compressed point cloud data to a network side device.
Optionally, the first processing module is configured to perform first compression processing on the point cloud data to obtain first point cloud data when the transmission condition information does not meet a preset transmission condition;
or under the condition that the transmission condition information meets the preset transmission condition, performing second compression processing on the point cloud data to obtain second point cloud data, wherein the precision of the second point cloud data is greater than that of the first point cloud data.
Optionally, the first processing module includes:
the first determining submodule is used for determining an interesting region in an image corresponding to the point cloud data according to the depth information and the curvature characteristics of the point cloud data;
the first processing sub-module is used for compressing the region of interest according to a first compression ratio and compressing the non-region of interest except the region of interest according to a second compression ratio;
wherein the first compression ratio is less than the second compression ratio.
Optionally, the point cloud data within the region of interest satisfies at least one of:
the depth value corresponding to the depth information is smaller than a first threshold value;
the curvature feature corresponds to a curvature value greater than a second threshold.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
The data processing apparatus can implement all implementation manners in the above data processing method embodiments, and details are not described here to avoid repetition.
As shown in fig. 5, an embodiment of the present invention further provides a data processing apparatus 500, which is applied to a network device, and includes:
a second obtaining module 501, configured to obtain compressed point cloud data, where the compressed point cloud data is obtained by compressing according to a relationship between transmission condition information between a terminal and a network side device and a preset transmission condition;
a rendering module 502, configured to render the compressed point cloud data according to a relationship between the transmission condition information and a preset transmission condition.
Optionally, the rendering module comprises:
the first rendering submodule is used for performing three-dimensional reconstruction operation on the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition to obtain a target scene;
and the second rendering submodule is used for performing medium rendering in the target scene according to the relation between the transmission condition information and a preset transmission condition.
Optionally, the first rendering sub-module is configured to perform a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene when the transmission condition information meets a preset transmission condition;
or, under the condition that the transmission condition information does not meet the preset transmission condition, performing three-dimensional reconstruction operation with second precision on the compressed point cloud data to obtain a second target scene;
wherein the first precision is greater than the second precision.
Optionally, the second rendering sub-module is configured to set a medium of a third precision in the target scene when the transmission condition information does not satisfy a preset transmission condition;
or, setting a medium with a fourth precision in the target scene under the condition that the transmission condition information meets a preset transmission condition;
wherein the third precision is greater than the fourth precision.
Optionally, the second rendering sub-module is further configured to set, for an area in the target scene where the curvature value is greater than a preset curvature threshold, a medium whose transparency is a first value;
and/or setting a medium with transparency as a second numerical value for an area with a curvature value smaller than or equal to a preset curvature value in the target scene;
wherein the first value is less than the second value.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
The data processing apparatus can implement all implementation manners in the data processing method embodiment applied to the network side device, and details are not described here to avoid repetition.
As shown in fig. 6, an embodiment of the present invention further provides a terminal 600, including: transceiver 620 and processor 610:
the transceiver 620 is configured to acquire transmission status information between a terminal and a network device;
the processor 610 is configured to compress point cloud data according to a relationship between the transmission condition information and a preset transmission condition;
the transceiver 620 is configured to send the compressed point cloud data to a network side device.
Optionally, the processor 610 is configured to perform a first compression process on the point cloud data to obtain first point cloud data when the transmission condition information does not satisfy a preset transmission condition;
or under the condition that the transmission condition information meets the preset transmission condition, performing second compression processing on the point cloud data to obtain second point cloud data, wherein the precision of the second point cloud data is greater than that of the first point cloud data.
Optionally, the processor 610 is configured to determine a region of interest in an image corresponding to the point cloud data according to the depth information and the curvature feature of the point cloud data;
compressing the region of interest according to a first compression ratio, and compressing the non-region of interest except the region of interest according to a second compression ratio;
wherein the first compression ratio is less than the second compression ratio.
Optionally, the point cloud data within the region of interest satisfies at least one of:
the depth value corresponding to the depth information is smaller than a first threshold value;
the curvature feature corresponds to a curvature value greater than a second threshold.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
The data processing apparatus can implement all implementation manners in the above data processing method embodiments, and details are not described herein to avoid repetition.
An embodiment of the present invention further provides a network side device 700, as shown in fig. 7, including: transceiver 720 and processor 710:
the transceiver 720 is configured to obtain compressed point cloud data, where the compressed point cloud data is obtained by compressing according to a relationship between transmission condition information between a terminal and a network side device and a preset transmission condition;
the processor 710 is configured to render the compressed point cloud data according to a relationship between the transmission condition information and a preset transmission condition.
Optionally, the processor 710 is configured to perform a three-dimensional reconstruction operation on the compressed point cloud data according to a relationship between the transmission condition information and a preset transmission condition, so as to obtain a target scene; and performing media rendering in the target scene according to the relation between the transmission condition information and a preset transmission condition.
Optionally, the processor 710 is configured to perform a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene when the transmission condition information satisfies a preset transmission condition;
or, under the condition that the transmission condition information does not meet the preset transmission condition, performing three-dimensional reconstruction operation with second precision on the compressed point cloud data to obtain a second target scene;
wherein the first precision is greater than the second precision.
Optionally, the processor 710 is configured to set a medium of a third precision in the target scene if the transmission condition information does not satisfy a preset transmission condition;
or, setting a medium with a fourth precision in the target scene under the condition that the transmission condition information meets a preset transmission condition;
wherein the third precision is greater than the fourth precision.
Optionally, the processor 710 is further configured to set a medium with a first transparency value for an area in the target scene where the curvature value is greater than a preset curvature threshold;
and/or setting a medium with transparency as a second numerical value for an area with a curvature value smaller than or equal to a preset curvature value in the target scene;
wherein the first value is less than the second value.
Optionally, the preset transmission condition includes that the transmission delay is smaller than a preset delay threshold.
Another embodiment of the present invention further provides a data processing apparatus, as shown in fig. 8, including a transceiver 810, a processor 800, a memory 820, and a program or instructions stored in the memory 820 and executable on the processor 800; the processor 800 implements the steps of the data processing method applied to the terminal when executing the program or the instructions.
The transceiver 810 is used for receiving and transmitting data under the control of the processor 800.
Where in fig. 8, the bus architecture may include any number of interconnected buses and bridges, with various circuits being linked together, particularly one or more processors represented by processor 800 and memory represented by memory 820. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver 810 may be a number of elements including a transmitter and a receiver that provide a means for communicating with various other apparatus over a transmission medium. The user interface 830 may also be an interface capable of interfacing with a desired device for different user devices, including but not limited to a keypad, a display, a speaker, a microphone, a joystick, etc.
The processor 800 is responsible for managing the bus architecture and general processing, and the memory 820 may store data used by the processor 800 in performing operations.
An embodiment of the present invention provides a data processing apparatus, as shown in fig. 9, including a transceiver 910, a processor 900, a memory 920, and a program or instructions stored on the memory 920 and executable on the processor 900; the processor 900 implements the data processing method applied to the network side device when executing the program or the instructions.
The transceiver 910 is used for receiving and transmitting data under the control of the processor 900.
In fig. 9, among other things, the bus architecture may include any number of interconnected buses and bridges, with one or more processors, represented by processor 900, and various circuits, represented by memory 920, being linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver 910 may be a number of elements including a transmitter and a receiver that provide a means for communicating with various other apparatus over a transmission medium. The processor 900 is responsible for managing the bus architecture and general processing, and the memory 920 may store data used by the processor 900 in performing operations.
The embodiment of the present invention further provides a readable storage medium, on which a program or an instruction is stored, where the program or the instruction is executed by a processor to implement the steps in the data processing method described above, and the same technical effects can be achieved, and are not described herein again to avoid repetition.
Wherein, the processor is a processor in the data processing device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It is further noted that the terminals described in this specification include, but are not limited to, smart phones, tablets, etc., and that many of the functional components described are referred to as modules in order to more particularly emphasize their implementation independence.
In embodiments of the present invention, modules may be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be constructed as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different bits which, when joined logically together, comprise the module and achieve the stated purpose for the module.
Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Likewise, operational data may be identified within the modules and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
When a module can be implemented by software, considering the level of existing hardware technology, a module implemented by software may build a corresponding hardware circuit to implement a corresponding function, without considering cost, and the hardware circuit may include a conventional Very Large Scale Integration (VLSI) circuit or a gate array and an existing semiconductor such as a logic chip, a transistor, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.
The exemplary embodiments described above are described with reference to the drawings, and many different forms and embodiments of the invention may be made without departing from the spirit and teaching of the invention, therefore, the invention is not to be construed as limited to the exemplary embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In the drawings, the size and relative sizes of elements may be exaggerated for clarity. The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Unless otherwise indicated, a range of values, when stated, includes the upper and lower limits of the range and any subranges therebetween.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (31)

1. A data processing method, performed by a terminal, comprising:
acquiring transmission state information between a terminal and network side equipment;
compressing point cloud data according to the relation between the transmission condition information and a preset transmission condition;
and sending the compressed point cloud data to network side equipment.
2. The data processing method according to claim 1, wherein compressing the point cloud data according to the relationship between the transmission condition information and a preset transmission condition comprises:
under the condition that the transmission condition information does not meet the preset transmission condition, performing first compression processing on the point cloud data to obtain first point cloud data;
or under the condition that the transmission condition information meets the preset transmission condition, performing second compression processing on the point cloud data to obtain second point cloud data.
3. The data processing method of claim 2, wherein the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
4. The data processing method of claim 2, wherein the first compressing the point cloud data comprises:
determining an area of interest in an image corresponding to the point cloud data according to the depth information and curvature features of the point cloud data;
compressing the region of interest according to a first compression ratio, and compressing the non-region of interest except the region of interest according to a second compression ratio;
wherein the first compression ratio is less than the second compression ratio.
5. The data processing method of claim 4, wherein the point cloud data within the region of interest satisfies at least one of:
the depth value corresponding to the depth information is smaller than a first threshold value;
the curvature feature corresponds to a curvature value greater than a second threshold.
6. The data processing method of claim 1, wherein the predetermined transmission condition comprises a transmission delay being less than a predetermined delay threshold.
7. A data processing method executed by a network side device is characterized by comprising the following steps:
acquiring compressed point cloud data, wherein the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and a preset transmission condition;
and rendering the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition.
8. The data processing method of claim 7, wherein the rendering the compressed point cloud data according to the relationship between the transmission condition information and a preset transmission condition comprises:
performing three-dimensional reconstruction operation on the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition to obtain a target scene;
and performing media rendering in the target scene according to the relation between the transmission condition information and a preset transmission condition.
9. The data processing method of claim 8, wherein the performing a three-dimensional reconstruction operation on the compressed point cloud data according to the relationship between the transmission condition information and a preset transmission condition to obtain a target scene comprises:
under the condition that the transmission condition information meets a preset transmission condition, performing three-dimensional reconstruction operation with first precision on the compressed point cloud data to obtain a first target scene;
or, under the condition that the transmission condition information does not meet the preset transmission condition, performing three-dimensional reconstruction operation with second precision on the compressed point cloud data to obtain a second target scene.
10. The data processing method of claim 9,
the first precision is greater than the second precision.
11. The data processing method according to claim 8, wherein said performing media rendering in the target scene according to the relationship between the transmission condition information and a preset transmission condition comprises:
setting a medium with third precision in the target scene under the condition that the transmission condition information does not meet the preset transmission condition;
or, setting a medium with a fourth precision in the target scene when the transmission condition information meets a preset transmission condition.
12. The data processing method of claim 11,
the third precision is greater than the fourth precision.
13. The data processing method of claim 11, wherein the performing media rendering in the target scene further comprises:
setting a medium with transparency as a first numerical value for an area with a curvature value larger than a preset curvature threshold value in the target scene;
and/or setting a medium with transparency of a second value for an area with the curvature value smaller than or equal to a preset curvature value in the target scene.
14. The data processing method of claim 13,
the first value is less than the second value.
15. The data processing method of claim 7, wherein the predetermined transmission condition comprises a transmission delay being less than a predetermined delay threshold.
16. A data processing device applied to a terminal is characterized by comprising:
the first acquisition module is used for acquiring transmission state information between the terminal and the network side equipment;
the first processing module is used for compressing the point cloud data according to the relation between the transmission condition information and a preset transmission condition;
and the first transmission module is used for sending the compressed point cloud data to the network side equipment.
17. The data processing apparatus according to claim 16, wherein the first processing module is configured to perform a first compression process on the point cloud data to obtain first point cloud data when the transmission status information does not satisfy a preset transmission condition;
or under the condition that the transmission condition information meets the preset transmission condition, performing second compression processing on the point cloud data to obtain second point cloud data.
18. The data processing apparatus of claim 17, wherein the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
19. The data processing apparatus of claim 17, wherein the first processing module comprises:
the first determining submodule is used for determining an interesting region in an image corresponding to the point cloud data according to the depth information and the curvature characteristics of the point cloud data;
the first processing sub-module is used for compressing the region of interest according to a first compression ratio and compressing the non-region of interest except the region of interest according to a second compression ratio;
wherein the first compression ratio is less than the second compression ratio.
20. A data processing device applied to a network side device is characterized by comprising:
the second acquisition module is used for acquiring compressed point cloud data, and the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and the preset transmission condition;
and the rendering module is used for rendering the compressed point cloud data according to the relation between the transmission condition information and the preset transmission condition.
21. The data processing apparatus of claim 20, wherein the rendering module comprises:
the first rendering sub-module is used for performing three-dimensional reconstruction operation on the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition to obtain a target scene;
and the second rendering submodule is used for performing medium rendering in the target scene according to the relation between the transmission condition information and a preset transmission condition.
22. The data processing apparatus of claim 21, wherein the first rendering sub-module is configured to perform a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene when the transmission condition information satisfies a preset transmission condition;
or, under the condition that the transmission condition information does not meet the preset transmission condition, performing three-dimensional reconstruction operation with second precision on the compressed point cloud data to obtain a second target scene.
23. The data processing apparatus of claim 22,
the first precision is greater than the second precision.
24. The data processing apparatus according to claim 21, wherein the second rendering sub-module is configured to set a medium of a third precision in the target scene if the transmission condition information does not satisfy a preset transmission condition;
or, setting a medium with a fourth precision in the target scene when the transmission condition information meets a preset transmission condition.
25. The data processing apparatus of claim 24,
the third precision is greater than the fourth precision.
26. The data processing apparatus according to claim 24, wherein the second rendering sub-module is further configured to set a medium with a first transparency value for an area of the target scene where the curvature value is greater than a preset curvature threshold value;
and/or setting a medium with transparency of a second value for an area with the curvature value smaller than or equal to a preset curvature value in the target scene.
27. The data processing apparatus of claim 26,
the first value is less than the second value.
28. A terminal, comprising: a transceiver and a processor:
the transceiver is used for acquiring transmission state information between the terminal and the network side equipment;
the processor is used for compressing the point cloud data according to the relation between the transmission condition information and a preset transmission condition;
and the transceiver is used for sending the compressed point cloud data to network side equipment.
29. A network-side device, comprising: a transceiver and a processor:
the transceiver is used for acquiring compressed point cloud data, and the compressed point cloud data is obtained by compressing according to the relation between the transmission condition information between the terminal and the network side equipment and the preset transmission condition;
and the processor is used for rendering the compressed point cloud data according to the relation between the transmission condition information and a preset transmission condition.
30. A data processing apparatus comprising: a transceiver, a processor, a memory, and a program or instructions stored on the memory and executable on the processor; characterised in that the processor, when executing the program or instructions, carries out the steps in the data processing method according to any one of claims 1 to 6 or carries out the steps in the data processing method according to any one of claims 7 to 15.
31. A readable storage medium on which a program or instructions are stored, which program or instructions, when executed by a processor, carry out the steps in the data processing method according to any one of claims 1 to 6, or carry out the steps in the data processing method according to any one of claims 7 to 15.
CN202110001458.9A 2021-01-04 2021-01-04 Data processing method, device, terminal and network side equipment Pending CN114727083A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110001458.9A CN114727083A (en) 2021-01-04 2021-01-04 Data processing method, device, terminal and network side equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110001458.9A CN114727083A (en) 2021-01-04 2021-01-04 Data processing method, device, terminal and network side equipment

Publications (1)

Publication Number Publication Date
CN114727083A true CN114727083A (en) 2022-07-08

Family

ID=82233549

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110001458.9A Pending CN114727083A (en) 2021-01-04 2021-01-04 Data processing method, device, terminal and network side equipment

Country Status (1)

Country Link
CN (1) CN114727083A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130307847A1 (en) * 2010-12-06 2013-11-21 The Regents Of The University Of California Rendering and encoding adaptation to address computation and network
CN106331676A (en) * 2016-08-31 2017-01-11 贾岳杭 Three-dimensional data processing and transmission method based on virtual reality environment
CN109801353A (en) * 2019-01-16 2019-05-24 北京七鑫易维信息技术有限公司 A kind of method of image rendering, server and terminal
CN110971906A (en) * 2018-09-29 2020-04-07 上海交通大学 Hierarchical point cloud code stream packaging method and system
CN111243072A (en) * 2020-01-10 2020-06-05 北京腾文科技有限公司 WebVR three-dimensional display method, device and system and readable storage medium
CN111901635A (en) * 2020-06-17 2020-11-06 北京视博云信息技术有限公司 Video processing method, device, storage medium and equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130307847A1 (en) * 2010-12-06 2013-11-21 The Regents Of The University Of California Rendering and encoding adaptation to address computation and network
CN106331676A (en) * 2016-08-31 2017-01-11 贾岳杭 Three-dimensional data processing and transmission method based on virtual reality environment
CN110971906A (en) * 2018-09-29 2020-04-07 上海交通大学 Hierarchical point cloud code stream packaging method and system
CN109801353A (en) * 2019-01-16 2019-05-24 北京七鑫易维信息技术有限公司 A kind of method of image rendering, server and terminal
CN111243072A (en) * 2020-01-10 2020-06-05 北京腾文科技有限公司 WebVR three-dimensional display method, device and system and readable storage medium
CN111901635A (en) * 2020-06-17 2020-11-06 北京视博云信息技术有限公司 Video processing method, device, storage medium and equipment

Similar Documents

Publication Publication Date Title
CN109903366B (en) Virtual model rendering method and device, storage medium and electronic equipment
CN102186067B (en) Image frame transmission method, device, display method and system
CN110765620A (en) Aircraft visual simulation method, system, server and storage medium
CN112258610B (en) Image labeling method and device, storage medium and electronic equipment
CN113296865B (en) Cloud desktop mouse position sensing and mouse operation event management method
CN111028279A (en) Point cloud data processing method and device, electronic equipment and storage medium
CN112634414A (en) Map display method and device
US20230125255A1 (en) Image-based lighting effect processing method and apparatus, and device, and storage medium
WO2023207379A1 (en) Image processing method and apparatus, device and storage medium
CN116205069A (en) Scene injection method, system and device based on intelligent driving domain controller
CN115496845A (en) Image rendering method and device, electronic equipment and storage medium
CN116897541A (en) Mapping architecture for Immersive Technology Media Format (ITMF) specification using a rendering engine
CN111798554A (en) Rendering parameter determination method, device, equipment and storage medium
CN116385622B (en) Cloud image processing method, cloud image processing device, computer and readable storage medium
CN114727083A (en) Data processing method, device, terminal and network side equipment
CN116415652A (en) Data generation method and device, readable storage medium and terminal equipment
CN115861510A (en) Object rendering method, device, electronic equipment, storage medium and program product
CN115330925A (en) Image rendering method and device, electronic equipment and storage medium
CN111785229B (en) Display method, device and system
CN111223105B (en) Image processing method and device
Ikedo High-speed techniques for a 3-D color graphics terminal
CN115272542A (en) Three-dimensional imaging method, device, equipment and storage medium
CN111524240A (en) Scene switching method and device and augmented reality equipment
CN112258435A (en) Image processing method and related product
CN111340924B (en) Image rendering method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination