CN102693065A - Stereoscopic image visual effect processing method - Google Patents

Abstract

The present invention discloses a method for processing stereoscopic image visual effects, which includes the following steps: providing a stereoscopic image, the stereoscopic image is composed of multiple objects, each of which has an object coordinate value; providing a cursor, the cursor has a cursor coordinate value; judging whether the cursor coordinate value coincides with the object coordinate value of one of the multiple objects; if the cursor coordinate value coincides with the object coordinate value of one of the multiple objects, then changing a depth coordinate parameter corresponding to the object coordinate value of the multiple objects; and redrawing the image of the object that matches the cursor value. Thus, the stereoscopic image of the object corresponding to the cursor can be highlighted to enhance the visual effect and increase the sense of interaction.

Description

Stereoscopic image visual effect processing method

technical field

The invention relates to an image processing method, in particular to a stereoscopic image visual effect processing method.

Background technique

In the past two decades, computer graphics have become the most important data display method in the human-machine interface, and are widely used in various applications. Such as three-dimensional (three dimensional, 3-D) computer graphics. And multimedia (multimedia) and virtual reality (virtual reality) products are becoming more and more popular. They are not only a major breakthrough in the human-machine interface, but also play an important role in entertainment applications. Most of the above applications are based on low-cost real-time 3-D computer graphics technology. In general, 2-D computer graphics are a common representation of data and content, especially in interactive applications. 3-D computer graphics, on the other hand, is a growing branch of computer graphics that uses 3-D models and various image processing to produce images that are realistic in three-dimensional space.

The construction process of 3D computer graphics can be divided into three basic stages according to their sequence:

1: Modeling (modeling): The modeling stage can be described as the process of "determining the shape of the object to be used in the subsequent scene", and has a variety of modeling techniques, such as constructing solid geometry, NURBS modeling, polygonal modeling or detailed surface, etc. In addition, the modeling process can include editing the object's surface or material properties, adding texture, bump correspondence, and other features.

2: Scene layout and animation generation (layout & animation): Scene setting involves arranging the position and size of virtual objects, lights, cameras and other entities in a scene, and can be used to make a static picture or an animation. Animation generation can use key frame (key frame) and other technologies to establish complex motion relationships in the scene.

3: Rendering: Rendering is the final stage of creating an actual 2D image or animation from a prepared scene, comparable to the real-world process of photographing or filming a scene after the set is complete.

In the prior art, in interactive media, such as games or various application programs, the drawn three-dimensional objects usually cannot change the coordinates of the cursor when the user operates the mouse, touch panel or touch panel. The corresponding changes are generated in real time to highlight its visual effect, resulting in the inability to give users a sufficient sense of scene interaction.

In addition, there are prior technologies for converting 2D images into 3D images. Usually, a main object is selected in the 2D image, and the main object is set as the foreground, and the rest of the objects are set as the background, and these objects are given different Depth of field (Depth of field), and then form a 3D image, but the user's operation mouse usually has the same depth of field as the display screen, and the position where the user operates the mouse is usually where the vision stays. If the depth of field is different, there will be spatial visual confusion.

Contents of the invention

The main purpose of the present invention is to provide a method for processing stereoscopic image visual effects, which can highlight the corresponding object stereoscopic image according to the coordinate position of the cursor, so as to enhance human-computer interaction.

In order to achieve the above object, the stereoscopic image visual effect processing method of the present invention includes the following steps: first, a stereoscopic image is provided, the stereoscopic image is composed of a plurality of objects, and each of the plurality of objects has an object coordinate value ; Then, provide a cursor, the cursor has a cursor coordinate value; then, judge whether the cursor coordinate value coincides with the object coordinate value of one of the plurality of objects; then, if the cursor coordinate value coincides with one of the multiple objects When the object coordinate values of the plurality of objects coincide, a depth coordinate parameter corresponding to the object coordinate values of the plurality of objects is changed; finally, the image of the object corresponding to the cursor coordinate value is redrawn.

Wherein, if the coordinate value of the cursor changes, it is re-judged whether the coordinate value of the cursor coincides with the object coordinate value of one of the plurality of objects.

Wherein, the plurality of object coordinate values are coordinate values corresponding to local coordinates, world coordinates, viewing angle coordinates or projection coordinates.

Wherein, the cursor coordinate value is generated by a mouse, a touch pad or a touch panel.

Wherein, the stereoscopic image is sequentially produced by computer graphics steps such as modeling, scene layout and animation generation (layout & animation), and rendering.

Wherein, the depth coordinate values of the object coordinate values of the plurality of objects are determined by methods such as Z buffer method (Z buffer), painter's depth sorting method, plane normal determination method, surface normal determination method, and maximum and minimum method.

Description of drawings

FIG. 1A is a flow chart of the steps of a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

FIG. 1B is a stereoscopic image formed by using a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

Fig. 2 is a three-dimensional drawing flowchart of a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

FIG. 3A is a schematic diagram of modeling using a union logical operator in the stereoscopic image visual effect processing method of the present invention;

FIG. 3B is a schematic diagram of modeling using intersection logic operators in the stereoscopic image visual effect processing method of the present invention;

FIG. 3C is a schematic diagram of using complementary set modeling in the stereoscopic image visual effect processing method of the present invention;

FIG. 4A is a schematic diagram of using NURBS curve modeling in the stereoscopic image visual effect processing method of the present invention;

FIG. 4B is a schematic diagram of using NURBS surface modeling in the stereoscopic image visual effect processing method of the present invention;

Fig. 5 is a schematic diagram of polygonal grid modeling used in the stereoscopic image visual effect processing method of the present invention;

6A is a first schematic diagram of using subdivision surface modeling in the stereoscopic image visual effect processing method of the present invention;

6B is a second schematic diagram of using subdivision surface modeling in the stereoscopic image visual effect processing method of the present invention;

6C is a third schematic diagram of using subdivision surface modeling in the stereoscopic image visual effect processing method of the present invention;

6D is a fourth schematic diagram of using subdivision surface modeling in the stereoscopic image visual effect processing method of the present invention;

6E is a fifth schematic diagram of using subdivision surface modeling in the stereoscopic image visual effect processing method of the present invention;

7 is a schematic diagram of a standard drawing and coloring pipeline used in the stereoscopic image visual effect processing method of the present invention;

8 is a first schematic diagram of image display in a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

9 is a second schematic diagram of image display in a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

10 is a third schematic diagram of image display in a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

11A is a fourth schematic diagram of image display in a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

11B is a fifth schematic diagram of image display in a preferred embodiment of the stereoscopic image visual effect processing method of the present invention;

12A is a first schematic diagram of drawing an object using a Z buffer in the stereoscopic image visual effect processing method of the present invention;

12B is a second schematic diagram of drawing an object using a Z buffer in the stereoscopic image visual effect processing method of the present invention;

FIG. 13A is a first schematic diagram of drawing objects using the painter's depth sorting method in the stereoscopic image visual effect processing method of the present invention;

13B is a second schematic diagram of drawing objects using the painter's depth sorting method in the stereoscopic image visual effect processing method of the present invention;

13C is a third schematic diagram of drawing objects using the painter's depth sorting method in the stereoscopic image visual effect processing method of the present invention;

14 is a schematic diagram of drawing an object using a plane normal determination method in the stereoscopic image visual effect processing method of the present invention;

FIG. 15 is a schematic diagram of drawing objects using the max-min method in the stereoscopic image visual effect processing method of the present invention.

Description of reference signs: 11-stereoscopic image; 12-object; 21-application program; 22-operating system; 23-application program interface; 24-geometric conversion subsystem; 25-shading subsystem; 31-geometric conversion subsystem; 32-shading subsystem; 41-local coordinate space; 42-world coordinate space; 43-viewpoint coordinate space; 44-3D screen coordinate space; 45-display space; 51-definition object; 52-definition scene, reference view angle and light source ;53-selection and pruning to the 3D viewing angle range; 54-hidden surface elimination, coloring and shadow processing; 61-model conversion; 62-perspective conversion; 700-union geometry; 701-intersection geometry; Set geometry; 703-NURBS curve; 704-NURBS surface; 705-polygon modeling object; 706-cube; 707-first type sphere; 708-second type sphere; ; 711-Z buffer stereo image; 712-Z buffer schematic image; 713-first painter depth sort image; 714-second painter depth sort image; 715-third painter depth sort image; 716-viewable plane; 717- Hidden surface; 718-stereoscopic depth image; S11-S17-step process.

Detailed ways

In order to enable your examiners to clearly understand the content of the present invention, the following descriptions are provided together with the drawings, please refer to them.

Please refer to Fig. 1A, Fig. 1B and Fig. 2, which are the flow chart of steps of a preferred embodiment of the stereoscopic image visual effect processing method of the present invention, a stereoscopic image and a three-dimensional image formed by using the stereoscopic image visual effect processing method of the present invention Drawing flowchart. Among them, the stereoscopic image 11 is composed of a plurality of objects 12, which in turn consists of an application program 21 (Application), an operating system 22 (Operation System), an application programming interface 23 (Application programming interface, API), and a geometric conversion subsystem 24. (Geometric Subsystem) and shading subsystem 25 (Raster subsystem). And the stereoscopic image visual effect processing method comprises the following steps:

S11: Provide a stereoscopic image, the stereoscopic image is composed of multiple objects, and each of the objects has an object coordinate value.

S12: Provide a cursor, the cursor has a cursor coordinate value.

S13: Determine whether the cursor coordinates coincide with the object coordinates of one of the plurality of objects.

S14: If the cursor coordinate value coincides with the object coordinate value of one of the plurality of objects, change a depth coordinate parameter corresponding to the object coordinate value of the plurality of objects.

S15: Redraw the image of the object that matches the coordinate value of the cursor.

S16: If the coordinate value of the cursor changes, re-determine whether the coordinate value of the cursor coincides with the object coordinate value of one of the plurality of objects.

In addition, if the coordinate value of the cursor does not coincide with the coordinate value of the object, then re-judging whether the coordinate value of the cursor coincides with the object coordinate value of one of the plurality of objects after each preset cycle time, as in step Shown in S17.

Wherein, the cursor coordinate value can be generated by a mouse, a touch panel or a touch panel, or any Human-Computer interaction for the user to interact with the electronic device.

Wherein, the three-dimensional image 11 is drawn in a three-dimensional computer graphics (3D computer graphic) manner. The stereoscopic image can be sequentially generated by computer graphics steps such as modeling, scene layout and animation generation (layout & animation), and rendering.

Among them, the modeling stage can be roughly divided into the following categories:

1: Constructive solid geometry (CSG), in constructing solid geometry, you can use logical operators (logical operators) to combine different objects (such as cubes, cylinders, prisms, pyramids, spheres, cones, etc.) Combining sets, intersections, and complements to form complex surfaces, thereby forming a union geometry 700, intersection geometry 701, and complement geometry 702, which can be used to construct complex models or surfaces. As shown in Figure 3A, Figure 3B and Figure 3C.

2: Non uniform rational B-spline (NURBS): It can be used to generate and represent curves and surfaces, a NURBS curve 703, which is controlled by an order and a group of weights Point and a node vector (knot vector) determined. Among them, NURBS is a generalized concept of both B-spline (B spline), Bezier curve (Bézier curves) and surface. By estimating the s and t parameters of a NURBS surface 704, the surface can be expressed in spatial coordinates. As shown in Figure 4A and Figure 4B.

3: Polygon modeling: Polygon modeling is an object modeling method represented by a polygon mesh or used to approximate the surface of an object. Usually, a mesh (mesh) is a polygonal modeling object 705 composed of triangles, quadrilaterals or other simple convex polygons. As shown in Figure 5.

4: Subdivision surface: also known as subdivision surface, which is used to create a smooth surface from an arbitrary grid. By repeatedly refining the initial polygonal grid, a series of grids approaching to infinite subdivisions can be generated. surface, and each subdivision produces more polygonal elements and smoother meshes, and can be approximated by a cube 706 into a first-type sphere 707, a second-type sphere 708, and a third-type sphere 709 and a sphere 710 . As shown in Figures 6A, 6B, 6C, 6D and 6E.

In the modeling step, you can also edit the surface or material properties of the object according to your needs, and add texture, concave-convex correspondence, or other features.

The scene layout and animation generation are used for arranging virtual objects, lights, cameras or other entities in a scene for making static images or animations. The scene layout is used to define the spatial relationship of the position and size of objects in the scene. Animation generation is used to describe an object instantaneously, as it moves or deforms over time, which can be achieved using key framing, inverse kinematic, and motion capture.

Rendering is the final stage of creating an actual two-dimensional scene or animation from the prepared scene, which can be divided into non-real time or real time.

The non-real-time method is to use the model to simulate light transport to obtain a real effect such as photo realistic, which can usually be achieved by ray tracing or radiosity.

The real time method uses non-photorealistic rendering methods to obtain real-time drawing speed, and can use flat shading, Phong shading, Gouraud shading, bitmap texture (bit map texture), bump mapping, shading, motion blur, depth of field, etc., such as images for interactive media such as games or simulation programs Drawing needs to be calculated and displayed in time, and its speed is about 20 to 120 frames (frame) per second.

For a clearer understanding of the 3D rendering method, please also refer to FIG. 7 , which is a schematic diagram of a standard 3D rendering rendering pipeline. in the figure. The shading pipeline is divided into several parts according to different coordinate systems, and generally includes a geometry transformation subsystem 31 and a shading subsystem 32 . The objects defined in the definition object 51 are defined for the description of the three-dimensional model, which uses a coordinate system to refer to its own reference point, which is called a local coordinate space 41 (local coordinate space). When synthesizing a three-dimensional image, various objects are read from the database and converted to a unified world coordinate space 42 (world coordinate space), and the scene, reference angle and light source 52 are defined in the world coordinate space 42, The process of transforming from body coordinate space 41 to world coordinate space 42 is called modeling transformation 61 . Next, the position of the observation point (view) must be defined. Due to the limitation of the hardware resolution of the graphics system, the continuous coordinates must be converted to a three-dimensional screen space containing X and Y coordinates, and depth coordinates (also known as Z coordinates), as hidden surface removal (hidden surface removal) and Objects are drawn in pixels, and transformed from the world coordinate space 42 to the view coordinate space 43 for the steps of picking out and trimming to the 3D view range 53 , this process is also called view conversion 62 . Then, transform from the view coordinate space 43 to the 3D screen coordinate space 44 to perform hidden surface elimination, coloring and shadow processing 54 . Afterwards, the frame buffer (frame buffer) outputs the image of the final result to the screen, and transforms from the three-dimensional screen coordinate space to the display space 45 . In this embodiment, in the steps of the geometry conversion subsystem and the shading subsystem, it can be completed by a microprocessor, or it can be completed with a hardware acceleration device, such as a graphics processing unit (Graphic processing unit, GPU) or 3D Graphics accelerator card, etc.

Please refer to Fig. 8, Fig. 9, Fig. 10, Fig. 11A and Fig. 11B, which are the first schematic diagram, the second schematic diagram, the third schematic diagram, the fourth schematic diagram and Fifth schematic diagram. When the user moves the cursor by operating the mouse, touch pad, touch panel or any man-machine interface to change the coordinate value of the cursor, it is re-judged whether the coordinate value of the cursor is consistent with that of one of the plurality of objects 12 The object coordinate values coincide. If they do not overlap, the stereoscopic image 11 of the original display frame is maintained without redrawing. If the cursor value coincides with the object coordinate values of one of the plurality of objects 12, then change the depth coordinate parameter corresponding to the object coordinate values of the plurality of objects, and re-render the stereoscopic image 11 through the above-mentioned 3D rendering pipeline steps. If when the coordinate value of the cursor changes to match other objects 12, the original depth coordinate parameter of the selected object 12 will be restored, and another selected object 12 will change its depth coordinate parameter. When the overall stereoscopic image 11 is redrawn The stereoscopic visual effect of the selected object 12 is highlighted. Therefore, the user can operate the mouse and other man-machine interface tools to generate a certain interactive effect with the stereoscopic image. In addition, when one of the objects 12 changes its depth coordinate position according to the cursor coordinate position, the coordinate parameters of other objects 12 can also change accordingly with the cursor coordinate position, which can further highlight its visual experience and interactive effect.

Wherein, the depth coordinate parameter of the object coordinate of the object can be determined in the following manner:

1: Z buffering method (Z buffering), also known as depth buffering method, when rendering an object, the depth (ie Z coordinate) of each generated pixel is stored in a buffer, which is also called Z buffer Or a depth buffer that forms an x-y two-dimensional set that stores the depth of each screen pixel. If another object in the scene also generates a rendering result at the same pixel, compare the depth values of the two, and keep the object closer to the observer, and store the depth of this object in the depth buffer, and finally, according to the depth buffer The area correctly perceives the effect of depth, and closer objects block farther objects. This process is also called Z culling. A Z-buffer stereoscopic image 711 and a Z-buffer schematic image 712 are shown in FIG. 12A and FIG. 12B .

2: Painter's algorithm (Painter's algorithm): It first draws objects that are farther away, and then draws objects that are closer to cover parts of objects that are farther away. It first sorts each object according to depth, and then in order Rendering is performed to sequentially form a first painter's depth-sorted image 713 , a second painter's depth-sorted image 714 and a third painter's depth-sorted image 715 . As shown in Figure 13A, Figure 13B and Figure 13C.

3: Plane normal determination method: It is suitable for convex polyhedrons without concave lines, such as regular polyhedrons or crystal balls. The principle is to find the normal vector of each surface. If the Z component of the normal vector is greater than 0 (ie, the surface If the Z component of the normal vector is less than 0, then it is determined to be the hidden surface 717 and no drawing is required. As shown in Figure 14

4: Judgment method of surface normal: use the surface equation as the basis of judgment, if it is used to find the object is illuminated, then put the coordinate value of each point into the equation, obtain the normal vector and perform inner product operation with the light vector to obtain To be illuminated, draw from the farthest point when drawing. Points that are so close will mask far points when drawing to deal with depth issues.

5: Maximum and minimum method: when drawing, start drawing from the maximum Z coordinate, and the maximum and minimum points determine which points are to be drawn according to the value of the Y coordinate, so as to form a three-dimensional depth image 718 . As shown in Figure 15.

The effect of the method for processing the visual effect of the stereoscopic image of the present invention is that by operating the cursor to move, the corresponding object can change its depth coordinate position to highlight its visual effect. In addition, other objects also change their relative coordinate positions accordingly, so as to further highlight the visual changes of the image.

The above description is only illustrative, rather than restrictive, to the present invention. Those of ordinary skill in the art understand that many modifications and changes can be made without departing from the spirit and scope defined by the following appended claims. Or equivalent, but all will fall within the protection scope of the present invention.

Claims (6)

1. a stereoscopic image visual effect processing method, is characterized in that, comprises the following steps: providing a stereoscopic image, the stereoscopic image is composed of a plurality of objects, and each of the plurality of objects has an object coordinate value; providing a cursor with a cursor coordinate value; judging whether the cursor coordinate value coincides with the object coordinate value of one of the plurality of objects; If the cursor coordinate value coincides with the object coordinate value of one of the plurality of objects, changing a depth coordinate parameter corresponding to the object coordinate value of the plurality of objects; and Redraws the image of the object that matches the cursor coordinate values. 2. The stereoscopic image visual effect processing method according to claim 1, wherein if the coordinate value of the cursor changes, it is re-judged whether the coordinate value of the cursor coincides with the object coordinate value of one of the plurality of objects . 3. The stereoscopic image visual effect processing method according to claim 1, wherein the plurality of object coordinate values are coordinate values corresponding to local coordinates, world coordinates, viewing angle coordinates or projection coordinates. 4 . The stereoscopic image visual effect processing method according to claim 1 , wherein the cursor coordinate value is generated by a mouse, a touch panel or a touch panel. 5. The method for processing stereoscopic image visual effects according to claim 1, wherein the stereoscopic image is sequentially generated by computer graphics steps of modeling, scene layout and animation generation, and rendering. 6. The stereoscopic image visual effect processing method according to claim 1, characterized in that, the depth coordinate parameters of the object coordinate values of the plurality of objects are determined by the Z buffer method, the painter's depth sorting method, and the plane normal determination method. , surface normal determination method, and maximum and minimum method.

Images