WO2022068430A1 - 一种显示处理方法和装置 - Google Patents
一种显示处理方法和装置 Download PDFInfo
- Publication number
- WO2022068430A1 WO2022068430A1 PCT/CN2021/112658 CN2021112658W WO2022068430A1 WO 2022068430 A1 WO2022068430 A1 WO 2022068430A1 CN 2021112658 W CN2021112658 W CN 2021112658W WO 2022068430 A1 WO2022068430 A1 WO 2022068430A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- coordinate information
- information
- display
- vertices
- model
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 29
- 239000000463 material Substances 0.000 claims abstract description 72
- 210000000988 bone and bone Anatomy 0.000 claims description 50
- 238000004364 calculation method Methods 0.000 claims description 24
- 238000000034 method Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 9
- 210000000887 face Anatomy 0.000 description 36
- 230000009466 transformation Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 239000003550 marker Substances 0.000 description 8
- 230000008859 change Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000003068 static effect Effects 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000002688 persistence Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
Definitions
- the present disclosure relates to the field of display technology, and in particular, to a display processing method and device.
- a rotating stereoscopic display device refers to a display device that uses the high-speed rotation of the display panel, combined with the visual persistence effect of the human eye, to form a three-dimensional display space to achieve a three-dimensional display effect.
- it is necessary to determine the displayed model. Data displayed for each phase.
- the display data processing is relatively complicated, and more resources are required to complete the display data processing.
- Embodiments of the present disclosure provide a display processing method and apparatus, so as to solve the problem that the existing display data processing is complicated and requires more resources.
- an embodiment of the present disclosure provides a display processing method, which is applied to a rotating stereoscopic display device, where the rotating stereoscopic display device includes a display panel, and the display panel can be rotatably arranged; the display processing method includes:
- model information of an image model in the image to be displayed wherein the image model includes at least one attribute set, and each attribute set includes a plurality of triangular faces constituting the image model;
- the property combination is a material combination, and the material properties of the triangular faces in each of the material sets are the same.
- the image model includes N attribute sets, where N is a positive integer
- the traversing coordinate information of the vertices of each triangular face in each of the attribute sets includes:
- the image model in the to-be-displayed image is a dynamic model, and the image model has multiple joint nodes;
- the traversing the coordinate information of the vertices of each triangular face in each of the attribute sets further includes:
- the model coordinates of the vertices of each triangular face are calculated according to the coordinate information of the joint nodes.
- the image model further includes bones and skins, each of the bones is located between two adjacent joint nodes, the skins are bound to the bones, and the skins are composed of at least two joint nodes.
- a set of said attributes consists of;
- the calculation of the model coordinates of the vertices of each triangular surface according to the coordinate information of the joint nodes includes:
- the coordinate information of each vertex of the triangular surface is calculated according to the coordinate information of the bone.
- the traversing coordinate information of the vertices of each triangular face in each of the attribute sets includes:
- the device coordinates being the coordinates in the device coordinate system established based on the rotating stereoscopic display device;
- Marking information of each vertex is generated according to the phase information of the display panel and the device coordinates, where the marking information is used to mark the position between the fixed point of the triangular surface and each phase during the rotation of the display panel relation.
- the determining the device coordinates of the vertices of each of the triangular faces includes:
- model coordinates of the vertex of each of the triangular faces are the coordinates in the image model coordinate system
- the device coordinates of the vertices of each of the triangular faces are calculated according to the scene coordinates.
- generating the display data of the display panel at each phase according to the coordinate information of the vertexes of each of the triangular faces including
- the display data of the display panel at the corresponding phase is generated according to the phase intersection line.
- an embodiment of the present disclosure provides a display processing device for controlling a rotating stereoscopic display device, the rotating stereoscopic display device includes a display panel, and the display panel can be rotatably arranged; the display processing device includes:
- a model information acquisition module configured to acquire model information of an image model in an image to be displayed, wherein the image model includes at least one attribute set, and each attribute set includes a plurality of triangular faces constituting the image model;
- a coordinate information traversal module used for traversing the coordinate information of the vertices of each triangular face in each of the attribute sets according to the association relationship of the attribute sets;
- a display data generation module configured to generate display data of the display panel at each phase according to the coordinate information of the vertexes of each of the triangular faces
- the display module is used for displaying a picture according to the display data of each phase when the display panel is located in each phase.
- the image model includes N attribute sets, where N is a positive integer;
- the coordinate information traversal module includes:
- a root node determination submodule for determining the root node of the image model
- Index submodule for indexing the first attribute set according to the index relationship between the root node and the first attribute set, and obtains the coordinate information of the vertex of the triangular face in the first attribute set;
- the indexing submodule is further configured to index the Mth attribute set according to the index information contained in the M-1th attribute set when N is greater than 1, and obtain the triangular surface of the Mth attribute set. Coordinate information of vertices, and so on, until the coordinate information of vertices of each triangular face in all attribute sets is obtained, where M is a positive integer less than or equal to N and greater than 1.
- the image model in the to-be-displayed image is a dynamic model, and the image model has multiple joint nodes; the coordinate information traversal module further includes:
- a coordinate information calculation submodule configured to calculate the coordinate information of each joint node in each of the animation frames according to the animation frame information
- the model coordinate calculation sub-module is configured to calculate the model coordinates of the vertices of each triangular face according to the coordinate information of the joint nodes.
- the image model further includes bones and skins, each of the bones is located between two adjacent joint nodes, the skins are bound to the bones, and the skins are composed of at least two joint nodes.
- a set of said attributes consists of;
- the model coordinate calculation submodule includes:
- a bone coordinate calculation unit configured to determine the coordinate information of the bone according to the coordinate information of the joint node
- the vertex coordinate calculation unit is configured to calculate the coordinate information of each vertex of the triangular surface according to the coordinate information of the bone based on the binding relationship between the skin and the bone.
- the coordinate information traversal module includes:
- a device coordinate calculation submodule configured to determine the device coordinates of the vertices of each of the triangular faces, the device coordinates being the coordinates in the device coordinate system established based on the rotating stereoscopic display device;
- a marker information generation sub-module is used to generate marker information of each vertex according to the phase information of the display panel and the device coordinates, and the marker information is used to mark the fixed point of the triangular surface and the rotation process of the display panel The positional relationship between the phases in .
- embodiments of the present disclosure provide an electronic device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor When implementing the steps of the display processing method according to any one of the first aspects.
- an embodiment of the present disclosure provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of the display processing method described in any one of the first aspects. .
- an embodiment of the present disclosure provides a display system, including a rotating stereoscopic display device and the display processing device according to any one of the second aspect, wherein the rotating stereoscopic display device includes a display panel, and the display panel can A rotation setting, the display processing device is used to control the rotating stereoscopic display device to display an image.
- the embodiment of the present disclosure can obtain the phase angle of the image in each phase, that is, the display data of the display panel in each phase, as long as the image model is meshed once, which is helpful for Reduce the amount of data processing and improve the efficiency of display data processing.
- FIG. 1 is a schematic structural diagram of a rotating stereoscopic display device according to an embodiment of the present disclosure
- FIG. 2 is a flowchart of a display processing method in an embodiment of the present disclosure
- FIG. 3 is a schematic diagram of the intersection of the phase and the image model in an embodiment of the present disclosure
- 4A is another flowchart of a display processing method in an embodiment of the present disclosure.
- 4B is another flowchart of a display processing method according to an embodiment of the present disclosure.
- 5A is a schematic diagram of an image model in an embodiment of the present disclosure.
- 5B is a schematic diagram of yet another image model in an embodiment of the present disclosure.
- 5C is a schematic diagram of an association relationship between joints in an embodiment of the present disclosure.
- 6A is a schematic diagram of a scene of a display state in an embodiment of the present disclosure.
- FIG. 6B is a schematic diagram of another scene of a display state in an embodiment of the present disclosure.
- FIG. 7 is a structural diagram of a display processing apparatus according to an embodiment of the present disclosure.
- the present disclosure provides a display processing method. As shown in FIG. 1 , the display processing method is applied to a rotating stereoscopic display device.
- the rotating stereoscopic display device includes a display panel, and the display panel can be rotatably arranged.
- one end of the display panel is fixed on a rotating shaft.
- the display panel can be driven to rotate around the rotating shaft.
- the display panel can also be driven to rotate in other ways, for example, by fixing the display panel on a rotatable base, etc., the rotation of the display panel can also be controlled.
- the rotating shaft is located on one side of the display panel as an example.
- the screen is driven by the rotating shaft to rotate around the rotating shaft, which is equivalent to forming a cylindrical display space.
- Each rotation of the screen is equivalent to refreshing one frame of image. Since the image presents a three-dimensional effect, each frame of image is referred to as a volume frame in this embodiment.
- the visual persistence effect of human eyes requires that the frame rate of the body frame is not less than 24Hz, so the display panel needs to refresh at least 24 body frames per second, that is to say, the rotation speed of the display panel is not less than 24 cycles per second (24r /s).
- the contents displayed by the display panel at different positions are different, therefore, multiple phases need to be defined, and the display panel displays different contents at different phases.
- the specific number of phases can be increased or decreased accordingly, and the rotation speed of the display panel can also be adaptively adjusted. Further, the refresh rate of the display panel can be determined according to the rotation speed of the display panel and the number of phases.
- the resolution of the screen is width ⁇ height, where width is the horizontal resolution, height is the vertical resolution, the center distance of adjacent pixels is pitch, and the pixel side length is side.
- the inventor of the present disclosure found in the process of implementing the technical solution of the present application that in order to generate display data, the size of the display space of the rotating stereoscopic display device can be determined first.
- the display panel rotates around one end of the display panel as an example.
- its display area forms a two-dimensional display plane.
- the rotation range of the display panel forms a cylindrical display space.
- the radius of the cylindrical display space is the width of the display panel
- the height of the cylindrical display space is the height of the display panel.
- the image displayed by the display panel in each phase is determined according to the image model, and the image can be displayed when the display panel moves to the corresponding phase.
- each animation frame needs to perform multiple model meshes, and the workload is large.
- the inventors of the present disclosure further propose the following technical solutions.
- the display processing method includes the following steps:
- Step 201 Obtain model information of an image model in an image to be displayed.
- the image to be displayed may be a static image or a dynamic image.
- the display model may be a static image model or a dynamic image model, and the image model includes at least one attribute set.
- the attribute set refers to a set of triangular faces divided according to the same attribute.
- the embodiment of the present disclosure further uses the material of the triangular face as the feature of dividing the attribute set for further description.
- each attribute set is also called a set of materials, and the same material
- the triangular faces in the collection are of the same material.
- attributes such as the color of the triangular face, the position of the triangular face, and other attributes may also be considered to divide the attribute set.
- Each material set includes a plurality of triangular surfaces that constitute the image model. It can be understood that each image model is actually composed of a plurality of small-sized triangular surfaces. In this embodiment, one or more material sets are set. in order to manage these triangular faces.
- a material set can be set to accommodate these triangles; if the triangles that make up an image model include two or more materials, then you can Set up multiple collections accordingly, and divide the triangular faces with the same material into the same material collection.
- the data in the material collection may also include other data related to the attributes of the triangular surface, specifically, including but not limited to the name of the material collection, material-related parameters, coordinate-related parameters, etc.
- material-related parameters may include ambient light coefficient, material diffuse reflection coefficient, specular reflection coefficient, natural light coefficient, smooth coefficient, map file, etc.
- Coordinate-related parameters may include vertex coordinate-related parameters of triangular faces, vertex normal-related parameters, Texture related parameters, surface normal related parameters, etc.
- Step 202 Traverse the coordinate information of the vertices of each triangular face in each of the material sets according to the association relationship of the material sets.
- the data structure of the model information in this embodiment further includes an association relationship of material sets, and the association relationship is used to implement an index to the material sets, so as to realize traversing the data in each material set, and specifically, to track the triangles contained in the material set. Coordinate information of the vertices of the face
- Step 203 Generate display data of the display panel in each phase according to the coordinate information of the vertices of each of the triangular faces.
- the display data of each phase of the real panel can be obtained.
- this step 203 specifically includes
- the display data of the display panel at the corresponding phase is generated according to the phase intersection line.
- the pixels on the display panel are discrete, it may be difficult for the image displayed according to the pixels on the display panel to be completely consistent with the ideal intersection line. Therefore, it is necessary to further fit the ideal intersection line according to the pixel distribution on the display panel, and the fitting result That is, the actual display effect, which is called an approximate line of intersection in this embodiment.
- Step 204 When the display panel is located in each phase, display a picture according to the display data of each phase.
- Fig. 3 after determining the approximate intersection line corresponding to each phase, arrange the approximate intersection lines of all phases in sequence according to the phase order, that is, the order of the rotation angle, and when the display panel is in the specified phase, the corresponding For example, when the display panel rotates to the first phase, control the display panel to display the image corresponding to the phase, and when the display panel rotates to the second phase, control the display panel to display the image corresponding to the second phase , and so on, the three-dimensional image can be displayed by rotating the display device.
- the phase order that is, the order of the rotation angle
- the embodiment of the present disclosure can obtain the phase angle of the image in each phase, that is, the display data of the display panel in each phase, as long as the image model is meshed once, which is helpful for Reduce the amount of data processing and improve the efficiency of display data processing.
- the image model includes N material sets, where N is a positive integer.
- step 202 includes:
- N index the Mth material set according to the index information contained in the M-1th material set, and obtain the coordinate information of the vertices of the triangular faces in the Mth material set, and so on, Until the coordinate information of the vertices of each triangular face in all material sets is obtained, where M is a positive integer less than or equal to N and greater than 1.
- the association relationship of the material collection includes the association relationship between the root node and the material collection.
- the first material collection is indexed by the root node, so as to obtain the content of the first material collection.
- the coordinate information of the vertices of each triangular face of , the first material set refers to the material set directly associated with the root node.
- the association relationship of material sets also includes the association relationship between different material sets. Specifically, each material set It has a node pointer to the next material set, where the node pointer of the last material set is empty.
- this embodiment realizes that the first material collection is indexed by the root node according to the association relationship of material collections, and further completes the indexing of all material collections, which helps to reduce workload and improve data processing efficiency.
- the image model in the image to be displayed is also a static model.
- the images displayed by the display panel at the same position are the same. Therefore, , when the display panel moves to the specified phase, it only needs to display a specific image.
- the image to be displayed is a dynamic image
- the image model in the image to be displayed is also a dynamic model.
- the images displayed on the same position of the display panel may be different, so it is necessary to further adjust the display panel displayed image.
- the image model has a plurality of joint nodes
- the traversing the coordinate information of the vertices of each triangular face in each of the attribute sets further includes:
- the model coordinates of the vertices of each triangular face are calculated according to the coordinate information of the joint nodes.
- animation frame information is further obtained, and the image model in each animation frame can be understood as a static model.
- the image model in each animation frame can be understood as a static model.
- the vertex coordinates of each triangular face are calculated according to the relationship between the joint nodes and the vertices of the triangular face, and the model coordinates of the vertices of the triangular face are further determined.
- the image model in the image to be displayed is a dynamic model
- the image model includes bones and skins, each of the bones is located between two adjacent joint nodes, and the skins are bound to the bones.
- the skin consists of at least one material collection.
- the calculation of the model coordinates of the vertices of each triangular surface according to the coordinate information of the joint nodes includes:
- the coordinate information of each vertex of the triangular surface is calculated according to the coordinate information of the bone.
- the material collection is first indexed by the root node, and the relevant information of the triangular surface is further obtained. Further, in this embodiment, joint nodes are also required to be indexed, and animation frame information is further obtained, and the position of each joint node is calculated according to the animation frame information. . Next, the degree of influence of the joints on the vertices of the triangular face is determined according to the relationship between the joints, the bones and the triangular faces, so as to update the coordinate information of the vertices of the triangular face in combination with the influence of the joints on the vertex positions of the triangular face.
- the animation frame information should at least include the time, sequence number, joint nodes in the animation frame, the transformation relationship T_anim between adjacent joints, and the animation frame pointer to the next animation frame, where, when the animation frame is the last frame , the animation frame pointer is null.
- a bone can be understood as a frame with fixed attributes between two joint nodes. Therefore, after the coordinate information of each joint node is determined, the position of the bone between the joint nodes can also be determined accordingly. change information.
- the skin is bound to the bone. Therefore, after the position change information of the bone is determined, the position change information of the skin can be further obtained according to the motion information of the bone.
- the position change information of the skin can be further obtained according to the motion information of the bone.
- the joint information in the display data includes at least joint node information, a joint name, and a joint serial number. Further, there may be a certain relationship and master-slave relationship between the joints.
- the joint When the joint has an upper-level joint, or when there is a parent joint, it can further include the signal of the parent joint and the transformation between the joint and the parent joint.
- the relationship is recorded as T_pc; since the skin and bones are bound, that is to say, there is a certain binding relationship between the vertex coordinates of the triangular surface and the joints, and the transformation relationship is recorded as T_cv; the transformation relationship between the joints and the model coordinates Denoted as T_mc.
- a total of three joints including joint0 to joint2 are used as an example for illustration. These three joints are related in sequence.
- the transformation relationship between adjacent joints is first updated according to the transformation relationship T_anim between adjacent joints.
- the values of T_pc0, T_pc1 and T_pc2 and further obtain the change relationship between the joint and the model coordinates as shown in formula (1).
- the coordinate transformation parameter T_cv from the vertex to the joint and the coordinate transformation parameter T_mc from the joint to the model are extracted to complete the update of the vertex position in combination with formula (1).
- the skin includes a triangular surface ABC
- the joint index joint_indices bound to vertex A is [1, 2], that is, joint1 and joint2 in FIG. 5C
- the weight joint_weights is [m, n ], where the weight refers to the influence of the joint on the vertex, which is specifically determined by the relationship between the joint and the vertex.
- the two transformation matrices of joint joint1 are T_mc1 and T_cv1 respectively
- the two transformation matrices of joint joint2 are T_mc2 and T_cv2 then the following formula (2) can be used to further realize the tracking and updating of the model coordinates of vertex A.
- p_model0 and p_model1 are the model coordinates of vertex A before and after updating, respectively.
- the coordinate information includes model coordinates, scene coordinates, device coordinates, and marker information.
- the above step 202 includes:
- the device coordinates being the coordinates in the device coordinate system established based on the rotating stereoscopic display device;
- the label information of each vertex is generated according to the phase information of the display panel and the device coordinates.
- the relative positional relationship between the phase and the image model of the display panel is determined by the device coordinate system established based on the rotating stereoscopic display device. Therefore, in this embodiment, the device coordinates of the triangular surface are first determined, and then according to the display panel.
- the step of determining the device coordinates of the vertices of each said triangular face comprises:
- model coordinates of the vertex of each of the triangular faces are the coordinates in the image model coordinate system
- the device coordinates of the vertices of each of the triangular faces are calculated according to the scene coordinates.
- the model coordinates are the coordinates in the image model coordinate system, that is, the coordinates in the coordinate system established separately based on the image model are mainly reflected in the relative position in the image model;
- the scene coordinates are the image scene coordinate system The coordinates in , reflect the relative position of the image model in the scene;
- the device coordinates are the coordinates in the device coordinate system established based on the rotating stereo display device, and reflect the relative position with the display panel or with the hardware devices such as the rotating shaft. Specifically, it can be calculated by the following formula.
- p_model is the model coordinate
- T_sm is the conversion relationship between the model coordinate and the scene coordinate
- p_scene is the scene coordinate
- T_ds is the conversion relationship between the scene coordinate and the device coordinate
- p_devece is the device coordinate.
- marker information is further generated based on the device coordinates. As shown in FIG. 6A and FIG. 6B , the marking information is used to mark the positional relationship between the fixed point of the triangular surface and each phase during the rotation process of the display panel.
- Fig. 6A ABC is a triangular surface, and only the adjacent phase i and phase i+1 are shown in the figure. Please continue to refer to Fig. 6A and Fig. 6B.
- the vertex B is located between the phase i and the phase i+1, that is Say, in this embodiment, it is marked as B(i,1+1), and similarly, vertex A can be marked as A(i-1,1), and vertex C is marked as C(i+1,1+2) .
- the label information of each vertex can be determined.
- the deflection angle ⁇ of the vertex is calculated by the above formula (4), and then the sign information p_sign is calculated according to the deflection angle ⁇ .
- p_decive.y and p_device.x are the scene coordinates y and the scene coordinates x in the coordinate system xoy shown in FIG. 6B respectively; sections represent the total number of phases, for example, in this embodiment, every 2° is a phase, A total of 180 phases are included, and the value of sections is 180; the floor() function is a round-down function. In this way, the label information of each vertex can be calculated by the above formula.
- the phase information intersecting with the triangular face can also be determined.
- the labeling information of the vertices of the triangular face ABC is A(i-1,1), B(i,1+1), C(i+1,1+2). Therefore, it can be determined that the triangular face
- the edge AB of ABC passes through phase i
- AC passes through phase i and phase i+1
- BC passes through phase i+1.
- edge of triangular face ABC and phase i have two intersection points, denoted as D and E, There are two intersection points between the edge of the triangular face ABC and the phase i+1, denoted as M and N, then it can be further determined that the ideal intersection of the triangular face and the phase i is the line segment DE, and the ideal intersection of the phase i+1 is MN.
- An embodiment of the present disclosure further provides a display processing device, which is applied to a rotary stereoscopic display device, where the rotary stereoscopic display device includes a display panel and a rotating shaft, the display panel is disposed on the rotating shaft and can rotate around the rotating shaft .
- the display processing apparatus 700 includes:
- a model information acquisition module 701 configured to acquire model information of an image model in an image to be displayed, wherein the image model includes at least one attribute set, and each attribute set includes a plurality of triangular faces constituting the image model to obtain the to-be-displayed Model information of an image model in an image, wherein the image model includes at least one attribute set, and each attribute set includes a plurality of triangular faces constituting the image model;
- the coordinate information traversal module 702 is configured to traverse the coordinate information of the vertices of each triangular face in each attribute set according to the association relationship of the attribute set;
- a display data generation module 703, configured to generate display data of the display panel at each phase according to the coordinate information of the vertices of each of the triangular faces;
- the display module 704 is configured to display a picture according to the display data of each phase when the display panel is located in each phase.
- the properties are combined into a material set, and the material properties of the triangular faces in each of the material sets are the same.
- the image model includes N attribute sets, where N is a positive integer
- the coordinate information traversal module 702 includes:
- a root node determination submodule for determining the root node of the image model
- an indexing submodule configured to index the first attribute set according to the index relationship between the root node and the first attribute set, and obtain the coordinate information of the vertices of the triangular face in the first attribute set;
- the indexing submodule is further configured to index the Mth attribute set according to the index information contained in the M-1th attribute set when N is greater than 1, and obtain the triangular surface of the Mth attribute set. Coordinate information of vertices, and so on, until the coordinate information of vertices of each triangular face in all attribute sets is obtained, where M is a positive integer less than or equal to N and greater than 1.
- the image model in the to-be-displayed image is a dynamic model, and the image model has multiple joint nodes;
- the coordinate information traversal module 702 further includes:
- a coordinate information calculation submodule configured to calculate the coordinate information of each joint node in each of the animation frames according to the animation frame information
- the model coordinate calculation sub-module is configured to calculate the model coordinates of the vertices of each triangular face according to the coordinate information of the joint nodes.
- the image model further includes bones and skins, each of the bones is located between two adjacent joint nodes, the skins are bound to the bones, and the skins are composed of at least two joint nodes.
- a set of said attributes consists of;
- the model coordinate calculation submodule includes:
- a bone coordinate calculation unit configured to determine the coordinate information of the bone according to the coordinate information of the joint node
- the vertex coordinate calculation unit is configured to calculate the coordinate information of each vertex of the triangular surface according to the coordinate information of the bone based on the binding relationship between the skin and the bone.
- the coordinate information traversal module 702 includes:
- a device coordinate calculation submodule configured to determine the device coordinates of the vertices of each of the triangular faces, the device coordinates being the coordinates in the device coordinate system established based on the rotating stereoscopic display device;
- a marker information generation sub-module is used to generate marker information of each vertex according to the phase information of the display panel and the device coordinates, and the marker information is used to mark the fixed point of the triangular surface and the rotation process of the display panel The positional relationship between the phases in .
- the device coordinate calculation submodule includes:
- model coordinate obtaining unit used for obtaining the model coordinates of the vertex of each of the triangular faces, the model coordinates being the coordinates in the image model coordinate system;
- a scene coordinate calculation unit configured to calculate scene coordinates of the vertices of each of the triangular faces according to the model coordinates, where the scene coordinates are coordinates in an image scene coordinate system;
- a device coordinate calculation unit configured to calculate the device coordinates of the vertices of each of the triangular faces according to the scene coordinates.
- the display data generation module 703 includes
- phase intersection determination sub-module configured to determine the phase intersection between the display panel and the triangular surface at each phase according to the marking information of the triangular surface
- a display data generating sub-module is configured to generate display data of the display panel at the corresponding phase according to the phase intersection line.
- Embodiments of the present disclosure also provide an electronic device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor to achieve the following: The steps of any one of the above display processing methods.
- An embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any one of the display processing methods described above.
- An embodiment of the present disclosure provides a display system, including a rotating stereoscopic display device and the display processing device 700 described in any one of the above, wherein the rotating stereoscopic display device includes a display panel, the display panel can be rotatably arranged, and the display The processing device is used for controlling the rotating stereoscopic display device to display an image.
- the disclosed apparatus and method may be implemented in other manners.
- the apparatus embodiments described above are only illustrative.
- the division of the units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
- the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solutions in the embodiments of the present invention.
- each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
- the functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium.
- the technical solution of the present invention can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution.
- the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention.
- the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk and other mediums that can store program codes.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Claims (16)
- 一种显示处理方法,应用于旋转立体显示装置,所述旋转立体显示装置包括显示面板,所述显示面板可转动设置;所述显示处理方法包括:获取待显示图像中的图像模型的模型信息,其中,所述图像模型包括至少一个属性集合,每一属性集合包括构成所述图像模型的多个三角面;根据属性集合的关联关系,遍历每一所述属性集合中各三角面的顶点的坐标信息;根据每一所述三角面的顶点的坐标信息生成所述显示面板在每一相位的显示数据;在所述显示面板位于各相位时,根据各相位的显示数据显示画面。
- 如权利要求1所述的显示处理方法,其中,所述属性结合为材质集合,每一所述材质集合内的各三角面的材质属性相同。
- 如权利要求1所述的显示处理方法,其中,所述图像模型包括N个属性集合,N为正整数;所述遍历每一所述属性集合中各三角面的顶点的坐标信息,包括:确定所述图像模型的根节点;根据所述根节点与第一个属性集合之间的索引关系索引第一个属性集合,并获取所述第一个属性集合中三角面的顶点的坐标信息;在N大于1的情况下,根据第M-1个属性集合中包含的索引信息索引第M个属性集合,并获取所述第M个属性集合中三角面的顶点的坐标信息,依此类推,直至获取全部属性集合中各三角面的顶点的坐标信息,其中,M为小于或等于N,且大于1的正整数。
- 如权利要求1所述的显示处理方法,其中,所述待显示图像中的图像模型为动态模型,所述图像模型多个关节节点;所述遍历每一所述属性集合中各三角面的顶点的坐标信息,还包括:获取所述图像模型的动画帧信息;根据所述动画帧信息计算各关节节点在每一所述动画帧内的坐标信息;根据所述关节节点的坐标信息计算各三角面的顶点的模型坐标。
- 如权利要求4所述的显示处理方法,其中,所述图像模型还包括骨骼和蒙皮,每一所述骨骼位于相邻两个关节节点之间,所述蒙皮与所述骨骼相绑定,所述蒙皮由至少一个所述属性集合构成;所述根据所述关节节点的坐标信息计算各三角面的顶点的模型坐标,包括:根据所述关节节点的坐标信息确定所述骨骼的坐标信息;基于所述蒙皮和所述骨骼的绑定关系,根据所述骨骼的坐标信息计算各所述三角面的顶点的坐标信息。
- 如权利要求3至5中任一项所述的显示处理方法,其中,所述遍历每一所述属性集合中各三角面的顶点的坐标信息,包括:确定每一所述三角面的顶点的设备坐标,所述设备坐标为所述基于所述旋转立体显示装置建立的设备坐标系中的坐标;根据所述显示面板的相位信息和所述设备坐标生成各所述顶点的标记信息,所述标记信息用于标记所述三角面的定点与所述显示面板旋转过程中的各相位之间的位置关系。
- 如权利要求6所述的显示处理方法,其中,所述确定每一所述三角面的顶点的设备坐标,包括:获取每一所述三角面的顶点的模型坐标,所述模型坐标为图像模型坐标系中的坐标;根据所述模型坐标计算各所述三角面的顶点的场景坐标,所述场景坐标为图像场景坐标系中的坐标;根据所述场景坐标计算各所述三角面的顶点的设备坐标。
- 如权利要求7所述的显示处理方法,其中,所述根据每一所述三角面的顶点的坐标信息生成所述显示面板在每一相位的显示数据,包括根据所述三角面的标记信息确定所述显示面板在各相位与所述三角面的相位交线;根据所述相位交线生成所述显示面板在相应相位的显示数据。
- 一种显示处理装置,用于控制旋转立体显示装置,所述旋转立体显示装置包括显示面板,所述显示面板可转动设置;所述显示处理装置包括:模型信息获取模块,用于获取待显示图像中的图像模型的模型信息,其中,所述图像模型包括至少一个属性集合,每一属性集合包括构成所述图像模型的多个三角面;坐标信息遍历模块,用于根据属性集合的关联关系,遍历每一所述属性集合中各三角面的顶点的坐标信息;显示数据生成模块,用于根据每一所述三角面的顶点的坐标信息生成所述显示面板在每一相位的显示数据;显示模块,用于在所述显示面板位于各相位时,根据各相位的显示数据显示画面。
- 如权利要求9所述的装置,其中,所述图像模型包括N个属性集合,N为正整数;所述坐标信息遍历模块包括:根节点确定子模块,用于确定所述图像模型的根节点;索引子模块,用于根据所述根节点与第一个属性集合之间的索引关系索引第一个属性集合,并获取所述第一个属性集合中三角面的顶点的坐标信息;所述索引子模块,还用于在N大于1的情况下,根据第M-1个属性集合中包含的索引信息索引第M个属性集合,并获取所述第M个属性集合中三角面的顶点的坐标信息,依此类推,直至获取全部属性集合中各三角面的顶点的坐标信息,其中,M为小于或等于N,且大于1的正整数。
- 如权利要求9所述的装置,其中,所述待显示图像中的图像模型为动态模型,所述图像模型多个关节节点;所述坐标信息遍历模块还包括:获取子模块,用于获取所述图像模型的动画帧信息;坐标信息计算子模块,用于根据所述动画帧信息计算各关节节点在每一所述动画帧内的坐标信息;模型坐标计算子模块,用于根据所述关节节点的坐标信息计算各三角面的顶点的模型坐标。
- 如权利要求11所述的装置,其中,所述图像模型还包括骨骼和蒙皮,每一所述骨骼位于相邻两个关节节点之间,所述蒙皮与所述骨骼相绑定,所述蒙皮由至少一个所述属性集合构成;所述模型坐标计算子模块包括:骨骼坐标计算单元,用于根据所述关节节点的坐标信息确定所述骨骼的坐标信息;顶点坐标计算单元,用于基于所述蒙皮和所述骨骼的绑定关系,根据所述骨骼的坐标信息计算各所述三角面的顶点的坐标信息。
- 如权利要求10至12中任一项所述的显示处理装置,其中,所述坐标信息遍历模块,包括:设备坐标计算子模块,用于确定每一所述三角面的顶点的设备坐标,所述设备坐标为所述基于所述旋转立体显示装置建立的设备坐标系中的坐标;标记信息生成子模块,用于根据所述显示面板的相位信息和所述设备坐标生成各所述顶点的标记信息,所述标记信息用于标记所述三角面的定点与所述显示面板旋转过程中的各相位之间的位置关系。
- 一种电子设备,包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如权利要求1至8中任一项所述的显示处理方法的步骤。
- 一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现权利要求1至8中任一项所述的显示处理方法的步骤。
- 一种显示系统,包括旋转立体显示装置和权利要求9至13中任一项所述的显示处理装置,所述旋转立体显示装置包括显示面板,所述显示面板可转动设置,所述电子设备用于控制所述旋转立体显示装置显示图像。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011061769.6A CN112200892A (zh) | 2020-09-30 | 2020-09-30 | 一种显示处理方法和装置 |
CN202011061769.6 | 2020-09-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022068430A1 true WO2022068430A1 (zh) | 2022-04-07 |
Family
ID=74013545
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/112658 WO2022068430A1 (zh) | 2020-09-30 | 2021-08-16 | 一种显示处理方法和装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112200892A (zh) |
WO (1) | WO2022068430A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116385652A (zh) * | 2023-04-11 | 2023-07-04 | 广州图石科技有限公司 | 一种参数化几何多线程离散方法及系统 |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112200892A (zh) * | 2020-09-30 | 2021-01-08 | 京东方科技集团股份有限公司 | 一种显示处理方法和装置 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103295260A (zh) * | 2013-06-08 | 2013-09-11 | 华东师范大学 | 一种基于旋转体三维显示器的实时体三维数据生成方法 |
US20150262419A1 (en) * | 2014-03-13 | 2015-09-17 | Shalong Maa | Stereoscopic 3D display model and mobile device user interface systems and methods |
CN108986157A (zh) * | 2018-07-12 | 2018-12-11 | 李慧勤 | 一种基于双目相机的虚拟发型交互装置及使用方法 |
CN109872390A (zh) * | 2017-12-04 | 2019-06-11 | 星际空间(天津)科技发展有限公司 | 一种海量三维模型的组织方法 |
CN112200892A (zh) * | 2020-09-30 | 2021-01-08 | 京东方科技集团股份有限公司 | 一种显示处理方法和装置 |
-
2020
- 2020-09-30 CN CN202011061769.6A patent/CN112200892A/zh active Pending
-
2021
- 2021-08-16 WO PCT/CN2021/112658 patent/WO2022068430A1/zh active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103295260A (zh) * | 2013-06-08 | 2013-09-11 | 华东师范大学 | 一种基于旋转体三维显示器的实时体三维数据生成方法 |
US20150262419A1 (en) * | 2014-03-13 | 2015-09-17 | Shalong Maa | Stereoscopic 3D display model and mobile device user interface systems and methods |
CN109872390A (zh) * | 2017-12-04 | 2019-06-11 | 星际空间(天津)科技发展有限公司 | 一种海量三维模型的组织方法 |
CN108986157A (zh) * | 2018-07-12 | 2018-12-11 | 李慧勤 | 一种基于双目相机的虚拟发型交互装置及使用方法 |
CN112200892A (zh) * | 2020-09-30 | 2021-01-08 | 京东方科技集团股份有限公司 | 一种显示处理方法和装置 |
Non-Patent Citations (1)
Title |
---|
ZHANG JUN: "Research on True 3D Volumetric Display Technique Based on the Rotation of a Display Panel", MASTER THESIS, TIANJIN POLYTECHNIC UNIVERSITY, CN, 15 December 2011 (2011-12-15), CN , XP055920231, ISSN: 1674-0246 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116385652A (zh) * | 2023-04-11 | 2023-07-04 | 广州图石科技有限公司 | 一种参数化几何多线程离散方法及系统 |
CN116385652B (zh) * | 2023-04-11 | 2024-02-20 | 广州图石科技有限公司 | 一种参数化几何多线程离散方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
CN112200892A (zh) | 2021-01-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10096157B2 (en) | Generation of three-dimensional imagery from a two-dimensional image using a depth map | |
JP4555722B2 (ja) | 立体映像生成装置 | |
US6525731B1 (en) | Dynamic view-dependent texture mapping | |
US8884947B2 (en) | Image processing apparatus and image processing method | |
WO2022068430A1 (zh) | 一种显示处理方法和装置 | |
US7382374B2 (en) | Computerized method and computer system for positioning a pointer | |
US9754398B1 (en) | Animation curve reduction for mobile application user interface objects | |
JPH08315171A (ja) | アニメーションデータの作成方法および作成装置 | |
JP2020173529A (ja) | 情報処理装置、情報処理方法、及びプログラム | |
Penaranda et al. | Real-time correction of panoramic images using hyperbolic Möbius transformations | |
KR100381817B1 (ko) | 제트버퍼를 이용한 입체영상 생성방법 및 기록매체 | |
US5793372A (en) | Methods and apparatus for rapidly rendering photo-realistic surfaces on 3-dimensional wire frames automatically using user defined points | |
JP6719596B2 (ja) | 画像生成装置、及び画像表示制御装置 | |
EP3871037B1 (en) | Efficiency enhancements to construction of virtual reality environments | |
CN111047674A (zh) | 一种动画渲染方法及装置 | |
CN115841539A (zh) | 一种基于可视外壳的三维光场生成方法和装置 | |
JP2001222723A (ja) | 立体視画像の生成方法及び同装置 | |
LaMar et al. | A multilayered image cache for scientific visualization | |
Harish et al. | Designing perspectively correct multiplanar displays | |
EP4318403A2 (en) | Improving image reconstruction with view-dependent surface irradiance | |
US10453247B1 (en) | Vertex shift for rendering 360 stereoscopic content | |
JPH11175758A (ja) | 立体表示方法および装置 | |
JP2022067171A (ja) | 生成装置、生成方法、及び、プログラム | |
Anderson | 3d engine for immersive virtual environments | |
Lu | Efficient simulation of lens distortion in OpenGL |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21874092 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 17907090 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21874092 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11.07.2023) |