WO2023197860A1

WO2023197860A1 - Highlight rendering method and apparatus, medium, and electronic device

Info

Publication number: WO2023197860A1
Application number: PCT/CN2023/084540
Authority: WO
Inventors: 罗汉铭
Original assignee: 北京字跳网络技术有限公司
Priority date: 2022-04-13
Filing date: 2023-03-28
Publication date: 2023-10-19
Also published as: CN114693860A

Abstract

The present invention relates to a highlight rendering method and apparatus, a medium, and an electronic device. The method comprises: obtaining a highlight image to be rendered, and drawing, in the highlight image, a highlight shape to be rendered; according to a light source direction in a world space, determining a light source vector in a target coordinate space corresponding to a hair model; for each pixel point to be rendered in the hair model, according to a sight line direction in the world space, determining a sight line vector corresponding to the pixel point in the target coordinate space; for each pixel point, according to the light source vector and the sight line vector corresponding to the pixel point, determining a texture offset of the pixel point in a vertical direction corresponding to a horizontal direction in the highlight image; and sampling from the highlight image according to the texture offset corresponding to each pixel point so as to render the pixel points to obtain a rendered highlight rendered image. Therefore, a rendering effect of anisotropic highlight can be achieved while the highlight shape of rendering is ensured.

Description

Highlight rendering methods, devices, media and electronic equipment

Related application cross-references

This disclosure claims priority to the Chinese patent application with application number 202210386625.0 and titled "Highlight Rendering Method, Device, Medium and Electronic Equipment" filed on April 13, 2022, the entire content of which is incorporated herein by reference.

Technical field

The present disclosure relates to the field of image processing, and specifically, to a highlight rendering method, device, medium, electronic equipment, computer program product, and program.

Background technique

In the rendering of cartoon characters' hair, it is different from the highlight rendering of realistic hair. It usually has a blocky highlight shape. As shown at A in Figure 1, it is the highlight image of realistic hair, as shown at B in Figure 1. Highlighted image of hair rendered for cartoon.

In a realistic hair scene, when light from different angles shines on the hair, different highlights will be displayed in the line of sight. In related technologies, anisotropic algorithms are usually used to render hair highlights, so that the hair highlights in the rendered cartoon animation can change with changes in the light source and line of sight. However, through the above rendering method, the highlight is calculated in real time by superimposing the disturbance texture on the lighting model, making it difficult to guarantee the highlight shape in highlight rendering.

Contents of the invention

This Summary is provided to introduce in a simplified form concepts that are further described in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to be used to limit the scope of the claimed technical solution.

In a first aspect, the present disclosure provides a highlight rendering method, which method includes:

Obtain a highlight image to be rendered, wherein a highlight shape to be rendered is drawn in the highlight image;

Determine the light source vector in the target coordinate space corresponding to the hair model based on the light source direction in world space;

For each pixel to be rendered in the hair model, determine the line of sight vector corresponding to the pixel in the target coordinate space according to the line of sight direction in the world space;

For each pixel, the image is determined based on the light source vector and the line of sight vector corresponding to the pixel. The texture offset of the pixel in the vertical direction corresponding to the horizontal direction in the highlight image;

Sampling is performed from the highlight image according to the texture offset corresponding to each pixel point to render the pixel point to obtain a rendered highlight rendering image.

In a second aspect, the present disclosure provides a highlight rendering device, which includes:

An acquisition module, configured to acquire a highlight image to be rendered, wherein a highlight shape to be rendered is drawn in the highlight image;

The first processing module is used to determine the light source vector in the target coordinate space corresponding to the hair model based on the light source direction in the world space;

The second processing module is used to determine, for each pixel to be rendered in the hair model, the line of sight vector corresponding to the pixel in the target coordinate space according to the line of sight direction in the world space;

A determination module configured to determine, for each pixel point, the texture bias of the pixel point in the vertical direction corresponding to the horizontal direction in the highlight image according to the light source vector and the line of sight vector corresponding to the pixel point. displacement;

A rendering module, configured to sample from the highlight image according to the texture offset corresponding to each pixel point to render the pixel point to obtain a rendered highlight rendering image.

In a third aspect, the present disclosure provides a computer-readable medium having a computer program stored thereon, which implements the steps of the method described in the first aspect when executed by a processing device.

In a fourth aspect, the present disclosure provides an electronic device, including:

a storage device having a computer program stored thereon;

A processing device, configured to execute the computer program in the storage device to implement the steps of the method described in the first aspect.

In a fifth aspect, the present disclosure provides a computer program product, including a computer program that implements the steps of the method described in the first aspect when executed by a processing device.

In a sixth aspect, the present disclosure provides a computer program that, when executed by a processing device, implements the steps of the method described in the first aspect.

Other features and advantages of the present disclosure will be described in detail in the detailed description that follows.

Description of the drawings

The above and other features, advantages, and aspects of various embodiments of the present disclosure will become more apparent with reference to the following detailed description taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It is to be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale. In the attached picture:

Figure 1 is a comparison diagram of highlight images of realistic hair and cartoon hair;

Figure 2 is a flow chart of a highlight rendering method based on an embodiment of the present disclosure;

Figure 3 is a schematic diagram of a highlight image provided based on an embodiment of the present disclosure;

Figures 4 and 5 are schematic diagrams of highlight rendering images provided based on embodiments of the present disclosure;

Figure 6 is a block diagram of a highlight rendering device provided based on an embodiment of the present disclosure;

FIG. 7 shows a schematic structural diagram of an electronic device suitable for implementing embodiments of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, which rather are provided for A more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that various steps described in the method implementations of the present disclosure may be executed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performance of illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "include" and its variations are open-ended, ie, "including but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below.

It should be noted that concepts such as “first” and “second” mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modifications of "one" and "plurality" mentioned in this disclosure are illustrative and not restrictive. Those skilled in the art will understand that unless the context clearly indicates otherwise, it should be understood as "one or Multiple”.

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

All actions to obtain signals, information or data in this disclosure are carried out in compliance with the corresponding data protection regulations and policies of the country where they are located, and with the authorization given by the owner of the corresponding device.

Figure 2 shows a flow chart of a highlight rendering method based on an embodiment of the present disclosure. The method may include:

In step 11, a highlight image to be rendered is obtained, wherein a highlight shape to be rendered is drawn in the highlight image.

For example, when performing highlight rendering on a hair model based on a highlight image, the correspondence between the pixels in the hair model and the sampling positions in the highlight image is usually implemented based on UV coordinates. The UV coordinates can be the percentage of the highlight image. Coordinates, the horizontal direction can be recorded as U, and the vertical direction can be recorded as V, as shown in the highlight image in Figure 3. Among them, the white icon part is the highlight shape to be rendered. When rendering on the hair model based on the highlight image, the highlight image is mapped on the surface of the hair model to achieve highlight rendering.

In step 12, the light source vector in the target coordinate space corresponding to the hair model is determined according to the light source direction in the world space.

In step 13, for each pixel to be rendered in the hair model, the line of sight vector corresponding to the pixel in the target coordinate space is determined according to the line of sight direction in the world space.

Among them, rendering can be performed based on the rendering models commonly used in this field, such as Unity Shader for highlight rendering. In the rendering model, parameters such as the light source direction and line of sight direction in the world space can be obtained. In this embodiment, the above parameters can be converted from the world space to the model space corresponding to the hair model, that is, the target coordinate space, so as to express the impact of changes in the light source direction and the line of sight direction on the highlight position. It should be noted that the execution sequence shown in Figure 2 is an exemplary illustration. Step 12 and step 13 can be executed one after another or in parallel, and this disclosure does not limit this.

In step 14, for each pixel, the texture offset of the pixel in the vertical direction corresponding to the horizontal direction in the highlight image is determined based on the light source vector and the line of sight vector corresponding to the pixel.

Among them, in the anisotropic highlight changes, when the light source direction or the line of sight direction moves up, down, left, and right relative to the hair model, the position of the highlight usually moves up, down, left, and right accordingly, making it difficult to ensure the smoothness of the highlight changes. Highlight shape. Based on this, in this embodiment, in order to ensure the fixation of the highlight shape on the hair, when the light source direction and the line of sight direction change, only the texture corresponding to the highlight shape can be position-shifted in the vertical direction to ensure the highlight shape. while achieving anisotropic change effects.

In step 15, samples are sampled from the highlight image according to the texture offset corresponding to each pixel point to render the pixel points to obtain a rendered highlight rendering image.

As shown above, the offset effect on the position of the highlight shape in the vertical direction can be determined based on changes in the viewing direction and the light source direction, so that the position after the offset can be sampled from the highlight image based on the texture offset, That is, based on the offset position, the color value of the corresponding position is sampled from the highlight image for rendering, so that the color rendered at this time matches the current light source direction and line of sight direction.

Therefore, in the above technical solution, the light source direction and line of sight direction in the world space can be converted to the hair model The corresponding target coordinate space allows the influence of the line of sight direction and the light source direction on the highlight position to be determined in the same model space. Moreover, in the embodiment of the present disclosure, only the offset of the highlight position in the vertical direction corresponding to the horizontal direction is considered, and the same pixel in the hair model can be changed from the highlight image based on the line of sight direction and the light source direction. The texture sampling position can change the rendering color value obtained by sampling the same pixel, so that on the basis of ensuring the highlight shape, the highlight position can be offset to achieve anisotropic highlight rendering effects and simplify the process of highlight rendering. The process not only improves the efficiency of highlight rendering, but also improves the accuracy of animation highlight rendering and improves the user's viewing experience of the rendered animation.

In a possible embodiment, an exemplary implementation of determining the light source vector in the target coordinate space corresponding to the hair model based on the light source direction in the world space is as follows, including:

Obtain the light source direction in world space and perform conversion based on the transformation matrix to obtain the light source vector in the target coordinate space. For example, it can be determined by the following formula:
lightDir_O＝mul((float3×3)unity_WorldToObject,LightDirection.xyz)

Among them, mul(M,v) is used to represent the matrix multiplication of the calculation matrix M and the vector v for matrix conversion. unity_WorldToObject is used to represent the matrix converted from world space to object space (ie, target coordinate space). LightDirection.xyz uses Used to represent the coordinates of the light source direction in world space, lightDir_O is used to represent the light source vector in the target coordinate space. Among them, the calculation of the above mul() function and unity_WorldToObject is a conventional calculation method in this field, and will not be described again here.

In a possible embodiment, for each pixel to be rendered in the hair model, an exemplary implementation of determining the line of sight vector corresponding to the pixel in the target coordinate space according to the line of sight direction in the world space is as follows: This step can include:

Determine the camera position coordinates of the camera position in the world space and the camera position coordinates in the target coordinate space.

Among them, the camera position in the world space can be obtained through _WorldSpaceCameraPos(). Similarly, the camera position can be converted to the target coordinate space based on the transformation matrix. The formula is as follows:
mul(unity_WorldToObject,float4(_WorldSpaceCameraPos.xyz,1))

Among them, unity_WorldToObject represents the transformation matrix corresponding to the conversion from world space to target coordinate space, and _WorldSpaceCameraPos.xyz represents the coordinates of the camera position in world space.

For each pixel point, the vector obtained by subtracting the position coordinates of the pixel point from the camera position coordinates is normalized and the vector is used as the line of sight vector corresponding to the pixel point.

For example, vector subtraction can be used to determine the direction from the camera position to the pixel point, that is, the line of sight direction. The standardization process can be a normalization process. Correspondingly, the line of sight vector corresponding to the pixel can be determined through the following formula:
viewDir_O=
normalize(mul(unity_WorldToObject,
float4(_WorldSpaceCameraPos.xyz,1)).xyz-v.vertex.xyz)

Among them, v.vertex.xyz represents the position coordinates of the pixel vertex in the hair model v, and normalize is used to normalize the vector. viewDir_O is used to represent the line of sight vector corresponding to the pixel.

Therefore, through the above technical solution, the sight direction of each pixel in the hair model can be determined in the space corresponding to the hair model, thereby converting the representation of the hair model and the representation of the sight direction into the same space. In order to obtain the influence of the line of sight direction on highlight reflection based on the same spatial standard, it can provide reliable data support for subsequent highlight texture sampling.

In a possible embodiment, for each pixel point, the vertical direction corresponding to the horizontal direction of the pixel point in the highlight image is determined based on the light source vector and the line of sight vector corresponding to the pixel point. An exemplary implementation of the texture offset on is as follows. This step may include:

Determine the light source component of the light source vector in the vertical direction.

For each pixel point, the line of sight component of the line of sight vector corresponding to the pixel point in the vertical direction is determined.

As mentioned above, in the present disclosure, when the light source direction or the line of sight direction changes, it will only affect the shift of the highlight shape in the vertical direction. Therefore, in this embodiment, it is only necessary to determine the vertical direction of the light source vector and the line of sight vector. on the weight. According to the target coordinate space corresponding to the hair model, it can be known that the component in the vertical direction is the y component corresponding to the vector in the target coordinate space. Therefore, in this embodiment, the y component of the determined light source vector can be determined as the light source component, and the y component of each line of sight vector is determined as the corresponding line of sight component.

According to the light source component and the line of sight component corresponding to each pixel point, the texture offset corresponding to the pixel point is determined.

Among them, the light source component and the line of sight component can be corresponding to the texture offset according to the preset correspondence relationship. As an example, for each pixel, the average value of the light source component and the line of sight component corresponding to the pixel can be determined as the texture offset corresponding to the pixel, that is:
speTexUVOffset＝0.5*(lightDir_O.y+viewDir_O.y)

Among them, speTexUVOffset represents the texture offset, lightDir_O.y represents the light source component, and viewDir_O.y represents the line of sight component.

As another example, the offset influence parameters of the light source direction and the line of sight direction on the highlight position offset can be set according to the actual application scenario, so that the light source component and the line of sight component can be weighted based on their corresponding offset influence parameters to obtain the corresponding Texture offset.

Therefore, through the above technical solution, the offset effect of the light source direction on the highlight position and the offset effect of the line of sight direction on the highlight position can be determined respectively, thereby determining the direction in which the highlight should be offset under the current light source direction and line of sight direction. and offset, so that the highlight shape is offset and matches the direction of the line of sight and the direction of the light source. Anisotropic effects are achieved based on controlling the highlight position, improving the accuracy of highlight rendering in animation, and simplifying the highlight rendering process. , improve highlight rendering efficiency.

In a possible embodiment, sampling is performed from the highlight image according to the texture offset corresponding to each pixel point to render the pixel point, and obtain the rendered highlight rendering image. An exemplary implementation is as follows. This step may include:

Obtain the basic texture coordinate value corresponding to each pixel point in the highlight image, wherein the based texture coordinate value is the coordinate value corresponding to when there is no offset between the light source vector and the line of sight vector.

The basic texture coordinate value corresponding to each pixel in the highlight image can be obtained in advance. For example, it can be the UV value obtained by sampling based on the texture sampler when the y component of the light source vector and the line of sight vector is determined to be 0.

Then, according to the texture offset corresponding to each pixel point and the basic texture coordinate value, the texture sampling coordinate value corresponding to the pixel point is determined.

After the texture offset corresponding to the pixel is determined, the offset can be performed based on the basic texture coordinate value according to the texture offset, so as to control the offset of the highlight shape.

After that, the texture color value corresponding to the texture sampling coordinate value is sampled from the highlight image as the color value corresponding to the pixel point.

After the texture sampling coordinate value corresponding to the pixel point is determined, the sampler can be used to sample from the corresponding position in the highlight image according to the texture sampling coordinate value to obtain the color value corresponding to the texture sampling coordinate value. The sampling method of the sampler from the highlight image can be set based on the actual application scenario, such as constant interpolation method, linear interpolation method, etc. to handle the situation of image enlargement and reduction, which is not limited by the present disclosure.

Render the pixels based on the color value corresponding to each pixel point to obtain the highlight rendering image.

For example, as shown in Figures 4 and 5, they are highlight rendering images rendered based on different sight directions and light source directions, in which the positions of the highlight shapes G are different to achieve an anisotropic rendering effect.

Therefore, through the above technical solution, the texture sampling coordinate value of the pixel in the hair model sampled from the highlight image can be determined based on the texture offset, so as to obtain the corresponding color value from the highlight image to render the pixel. For the same pixel in the hair model, the texture sampling coordinate value in the highlight image is determined in real time, so that the rendering color value obtained by sampling the same pixel changes to achieve the mobility of the surface texture of the hair model, that is, the highlight shape. Rendered scene with animated highlights.

In a possible embodiment, an exemplary implementation of determining the texture sampling coordinate value corresponding to each pixel point based on the texture offset corresponding to the pixel point and the basic texture coordinate value is as follows: Steps can include:

Determine the sub-coordinate value of the basic texture coordinate value of each pixel point in the vertical direction. For example, the sub-coordinate value in the vertical direction may be the value in the V direction in the basic texture coordinate value (UV coordinate).

For each pixel point, the coordinate value obtained by subtracting the texture offset corresponding to the pixel point from the sub-coordinate value corresponding to the pixel point is used as the updated coordinate value in the vertical direction, and The sub-coordinate value corresponding to the pixel point is updated to the updated coordinate value to obtain the texture sampling coordinate value corresponding to the pixel point.

As shown above, in the embodiment of the present disclosure, it is necessary to ensure the fixity of the highlight shape, so during the process of shifting the highlight, only the highlight is shifted in the vertical direction. Correspondingly, when the texture sampling coordinate value corresponding to the pixel point is determined based on the texture offset, the texture offset only adjusts the vertical component of the basic texture coordinate value.

As an example, the texture offset can be directly superimposed on the sub-coordinate value in the vertical direction of the basic texture coordinate value to realize the movement of the coordinates of the highlight in the vertical direction, and the updated coordinate value can be replaced in the basic texture coordinate value. The coordinate value in the vertical direction to generate the current corresponding texture sampling coordinate value. As a result, the color obtained by sampling based on the texture sampling coordinate value can be determined according to the real-time line of sight direction and light source direction, so that the same pixel in the hair model can be changed in color by adjusting the sampling texture coordinate value, and the coloring of the same pixel can be realized. Control of highlight movement.

In a possible embodiment, another exemplary implementation of determining the texture sampling coordinate value corresponding to the pixel point based on the texture offset corresponding to the pixel point and the basic texture coordinate value is as follows: , this step can include:

Determine the sub-coordinate value of the basic texture coordinate value of each pixel point in the vertical direction. Similarly, the sub-coordinate value in the vertical direction may be the value of the V direction in the basic texture coordinate value (UV coordinate). .

For each pixel, the target offset corresponding to the pixel is determined according to the texture offset corresponding to the pixel and the preset offset adjustment parameter.

Among them, the preset offset adjustment parameters can be set according to actual application scenarios. For example, the offset adjustment parameters may include an offset degree parameter and an offset position parameter, where the offset degree parameter controls the amplitude of the offset, and the offset position parameter is used to control the readjustment of the offset position, such as the target offset. The displacement is expressed as follows:
speTexUVOffset'=_DisScale*speTexUVOffset+_SpecularShift

Among them, speTexUVOffset' is used to represent the target offset, _DisScale is used to represent the offset degree parameter, speTexUVOffset is used to represent the texture offset, and _SpecularShift is used to represent the offset position parameter.

For each pixel point, the coordinate value obtained by subtracting the target offset corresponding to the pixel point from the sub-coordinate value corresponding to the pixel point is used as the updated coordinate value in the vertical direction, and The sub-pixel corresponding to the pixel point The coordinate value is updated to the updated coordinate value to obtain the texture sampling coordinate value corresponding to the pixel point.

Among them, the method of generating the texture sampling coordinate value based on the basic texture coordinate value after the target offset is determined is similar to the above, and will not be described again here.

After the texture sampling coordinate values are determined, sampling can be performed from the highlight image based on the texture sampling coordinate values. For example, sampling can be performed through the following algorithm:
specularTex＝
SAMPLE_TEXTURE2D(_ShadingTex,sampler_ShadingTex,
i.uv.xy-float2(0,_DisScale*speTexUVOffset+_SpecularShift))

Among them, the texture sampling syntax SAMPLE_TEXTURE2D (Tex, sampler_Tex, uv), the parameters are the texture (that is, the highlight image), the texture sampler, and the UV corresponding to the sampled texture (that is, the texture sampling coordinate value),

i.uv.xy represents the basic texture coordinate value;

float2(0,_DisScale*speTexUVOffset+_SpecularShift) represents the target offset. As mentioned above, only the offset of the highlight in the vertical direction is considered, that is, the offset in the V direction, that is, the offset in the U direction is 0.

Therefore, through the above technical solution, when determining the offset of the highlight position, the offset position can be further controlled based on the offset adjustment parameter, so that the offset movement of the highlight is more suitable for the rendering scene to which it is applied, and can improve The diversity of highlight rendering further broadens the application scenarios of the highlight rendering method.

The present disclosure also provides a highlight rendering device. As shown in Figure 6, the device 10 includes:

The acquisition module 100 is used to acquire a highlight image to be rendered, wherein a highlight shape to be rendered is drawn in the highlight image;

The first processing module 200 is used to determine the light source vector in the target coordinate space corresponding to the hair model according to the light source direction in the world space;

The second processing module 300 is used to determine, for each pixel to be rendered in the hair model, the line of sight vector corresponding to the pixel in the target coordinate space according to the line of sight direction in the world space;

The determination module 400 is configured to determine, for each pixel point, the texture of the pixel point in the vertical direction corresponding to the horizontal direction in the highlight image according to the light source vector and the line of sight vector corresponding to the pixel point. Offset;

The rendering module 500 is configured to sample from the highlight image according to the texture offset corresponding to each pixel point to render the pixel point to obtain a rendered highlight rendering image.

Optionally, the determining module includes:

The first determination sub-module is used to determine the light source component of the light source vector in the vertical direction;

The second determination sub-module is used to determine, for each pixel point, the line of sight component of the line of sight vector corresponding to the pixel point in the vertical direction;

The third determination sub-module is used to determine the texture offset corresponding to the pixel point based on the light source component and the line of sight component corresponding to each pixel point.

Optionally, the second processing module includes:

The fourth determination sub-module is used to determine the camera position coordinates of the camera position in the world space and the camera position coordinates in the target coordinate space;

The processing submodule is configured to normalize the vector obtained by subtracting the position coordinates of the pixel from the camera position coordinates for each of the pixels, and use the vector as the line of sight vector corresponding to the pixel.

Optionally, the rendering module includes:

Obtaining sub-module, used to obtain the basic texture coordinate value corresponding to each pixel point in the highlight image, wherein the based on texture coordinate value is the corresponding basic texture coordinate value when there is no offset between the light source vector and the line of sight vector. coordinate value;

The fifth determination sub-module is used to determine the texture sampling coordinate value corresponding to each pixel point based on the texture offset corresponding to the pixel point and the basic texture coordinate value;

A sampling submodule, configured to sample the texture color value corresponding to the texture sampling coordinate value from the highlight image as the color value corresponding to the pixel point;

A rendering sub-module is used to render the pixel based on the color value corresponding to each pixel to obtain the highlight rendering image.

Optionally, the fifth determination sub-module includes:

The sixth determination sub-module is used to determine the sub-coordinate value of the basic texture coordinate value of each pixel point in the vertical direction;

The seventh determination sub-module is used to, for each pixel point, subtract the coordinate value obtained by subtracting the texture offset corresponding to the pixel point from the sub-coordinate value corresponding to the pixel point as the vertical direction. on the updated coordinate value, and update the sub-coordinate value corresponding to the pixel point to the updated coordinate value to obtain the texture sampling coordinate value corresponding to the pixel point.

Optionally, the fifth determination sub-module includes:

The eighth determination sub-module is used to determine the sub-coordinate value of the basic texture coordinate value of each pixel point in the vertical direction;

The ninth determination sub-module is used for determining, for each pixel point, the target offset amount corresponding to the pixel point according to the texture offset amount corresponding to the pixel point and the preset offset adjustment parameter;

The tenth determination sub-module is configured to, for each pixel point, subtract the coordinate value obtained by subtracting the target offset corresponding to the pixel point from the sub-coordinate value corresponding to the pixel point as the vertical direction. update coordinate values on the The sub-coordinate value corresponding to the pixel point is updated to the updated coordinate value to obtain the texture sampling coordinate value corresponding to the pixel point.

Referring now to FIG. 7 , a schematic structural diagram of an electronic device 600 suitable for implementing embodiments of the present disclosure is shown. Terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDA (Personal Digital Assistant, personal digital assistant), PAD (tablet computer), PMP (Portable Multimedia Player, portable multimedia player), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TV (Television, television), desktop computers, etc. The electronic device shown in FIG. 7 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in Figure 7, the electronic device 600 may include a processing device (such as a central processing unit, a graphics processor, etc.) 601, which may process data according to a program stored in a read-only memory (Read Only Memory, ROM) 602 or from a storage device 608 The program loaded into the random access memory (Random Access Memory, RAM) 603 performs various appropriate actions and processes. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, ROM 602 and RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.

Generally, the following devices can be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a Liquid Crystal Display (LCD) , an output device 607 such as a speaker, a vibrator, etc.; a storage device 608 including a magnetic tape, a hard disk, etc.; and a communication device 609. Communication device 609 may allow electronic device 600 to communicate wirelessly or wiredly with other devices to exchange data. Although FIG. 7 illustrates electronic device 600 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication device 609, or from storage device 608, or from ROM 602. When the computer program is executed by the processing device 601, the above functions defined in the method of the embodiment of the present disclosure are performed.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: electrical connections having one or more conductors, Portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), electrical programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (Compact Disc Read Only Memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program codes contained on computer-readable media can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency, Radio Frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. Communications (e.g., communications network) interconnections. Examples of communication networks include Local Area Networks (LANs), Wide Area Networks (WANs), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any current network for knowledge or future research and development.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.

The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains a highlight image to be rendered, wherein the highlight image to be rendered is drawn Highlight shape; determine the light source vector in the target coordinate space corresponding to the hair model according to the light source direction in the world space; for each pixel to be rendered in the hair model, determine the target coordinate space according to the line of sight direction in the world space The line of sight vector corresponding to the pixel point; for each pixel point, determine the vertical direction corresponding to the horizontal direction of the pixel point in the highlight image according to the light source vector and the line of sight vector corresponding to the pixel point. The texture offset amount is sampled from the highlight image according to the texture offset amount corresponding to each pixel point to render the pixel point to obtain a rendered highlight rendering image.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as "C" or similar programming languages. program The code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In situations involving remote computers, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider). connected via the Internet).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.

The modules involved in the embodiments of the present disclosure can be implemented in software or hardware. Among them, the name of the module does not constitute a limitation on the module itself under certain circumstances. For example, the acquisition module can also be described as "a module that acquires the highlight image to be rendered."

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: field programmable gate array (Field Programmable Gate Array, FPGA), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), application specific standard product (Application Specific Standard Product, ASSP), System On Chip (SOC), Complex Programmable Logic Device (CPLD), etc.

According to one or more embodiments of the present disclosure, Example 1 provides a highlight rendering method, wherein the method includes:

According to one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, wherein for each pixel point, the light source vector and the line of sight vector corresponding to the pixel point are determined. The texture offset of pixels in the vertical direction corresponding to the horizontal direction in the highlight image includes:

Determine the light source component of the light source vector in the vertical direction;

For each pixel point, determine the line of sight component of the line of sight vector corresponding to the pixel point in the vertical direction;

According to one or more embodiments of the present disclosure, Example 3 provides the method of Example 1, wherein for each pixel to be rendered in the hair model, the target coordinate space is determined according to the line of sight direction in the world space. The line of sight vector corresponding to the pixel below includes:

Determine the camera position coordinates of the camera position in the world space and the camera position coordinates in the target coordinate space;

According to one or more embodiments of the present disclosure, Example 4 provides the method of Example 1, wherein the sampling is performed from the highlight image according to the texture offset corresponding to each pixel point, so as to Render pixels to obtain the rendered highlight rendering image, including:

Obtain the basic texture coordinate value corresponding to each pixel in the highlight image, wherein the texture-based coordinate value is the corresponding coordinate value when there is no offset between the light source vector and the line of sight vector;

According to the texture offset corresponding to each pixel point and the basic texture coordinate value, determine the texture sampling coordinate value corresponding to the pixel point;

Sample the texture color value corresponding to the texture sampling coordinate value from the highlight image as the color value corresponding to the pixel point;

According to one or more embodiments of the present disclosure, Example 5 provides the method of Example 4, wherein, according to the texture offset corresponding to each pixel point and the basic texture coordinate value, it is determined that the pixel point corresponds to The texture sampling coordinate values include:

Determine the sub-coordinate value of the basic texture coordinate value of each pixel point in the vertical direction;

According to one or more embodiments of the present disclosure, Example 6 provides the method of Example 4, wherein, according to the texture offset corresponding to each pixel point and the basic texture coordinate value, it is determined that the pixel point corresponds to The texture sampling coordinate values include:

For each pixel, determine the target offset corresponding to the pixel according to the texture offset corresponding to the pixel and the preset offset adjustment parameter;

For each pixel point, the coordinate value obtained by subtracting the target offset corresponding to the pixel point from the sub-coordinate value corresponding to the pixel point is used as the updated coordinate value in the vertical direction, and The sub-coordinate value corresponding to the pixel point is updated to the updated coordinate value to obtain the texture sampling coordinate value corresponding to the pixel point.

According to one or more embodiments of the present disclosure, Example 7 provides a highlight rendering device, wherein the device includes:

According to one or more embodiments of the present disclosure, Example 8 provides the apparatus of Example 7, wherein the determining module includes:

According to one or more embodiments of the present disclosure, Example 9 provides a computer-readable medium having a computer program stored thereon, and when the computer program is executed by a processing device, the method of any one of Examples 1-6 is implemented. step.

According to one or more embodiments of the present disclosure, Example 10 provides an electronic device, including:

a storage device having a computer program stored thereon;

A processing device, configured to execute the computer program in the storage device to implement the steps of the method in any one of Examples 1-6.

According to one or more embodiments of the present disclosure, Example 11 provides a computer program product, including a computer program that, when executed by a processing device, implements the steps of the method in any one of Examples 1-6.

According to one or more embodiments of the present disclosure, Example 12 provides a computer program that, when executed by a processing device, implements the steps of the method in any one of Examples 1-6.

The above description is only a description of the preferred embodiments of the present disclosure and the technical principles applied. Those skilled in the art should understand that the disclosure scope involved in the present disclosure is not limited to technical solutions composed of specific combinations of the above technical features, but should also cover solutions composed of the above technical features or without departing from the above disclosed concept. Other technical solutions formed by any combination of equivalent features. For example, a technical solution is formed by replacing the above features with technical features with similar functions disclosed in this disclosure (but not limited to).

Furthermore, although operations are depicted in a specific order, this should not be understood as requiring that these operations be performed in the specific order shown or performed in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims. Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

Claims

A highlight rendering method, wherein the method includes:

Obtain a highlight image to be rendered, wherein a highlight shape to be rendered is drawn in the highlight image;

Determine the light source vector in the target coordinate space corresponding to the hair model based on the light source direction in world space;

For each pixel to be rendered in the hair model, determine the line of sight vector corresponding to the pixel in the target coordinate space according to the line of sight direction in the world space;

For each pixel, determine the texture offset of the pixel in the vertical direction corresponding to the horizontal direction in the highlight image according to the light source vector and the line of sight vector corresponding to the pixel;

Sampling is performed from the highlight image according to the texture offset corresponding to each pixel point to render the pixel point to obtain a rendered highlight rendering image.
The method according to claim 1, wherein for each pixel point, according to the light source vector and the line of sight vector corresponding to the pixel point, it is determined whether the pixel point is in the horizontal direction in the highlight image. The corresponding texture offset in the vertical direction, including:

Determine the light source component of the light source vector in the vertical direction;

For each pixel point, determine the line of sight component of the line of sight vector corresponding to the pixel point in the vertical direction;

According to the light source component and the line of sight component corresponding to each pixel point, the texture offset corresponding to the pixel point is determined.
The method according to claim 1 or 2, wherein for each pixel to be rendered in the hair model, the line of sight vector corresponding to the pixel in the target coordinate space is determined according to the line of sight direction in the world space, include:

Determine the camera position coordinates of the camera position in the world space and the camera position coordinates in the target coordinate space;

For each pixel point, the vector obtained by subtracting the position coordinates of the pixel point from the camera position coordinates is normalized and the vector is used as the line of sight vector corresponding to the pixel point.
The method according to any one of claims 1-3, wherein the sampling is performed from the highlight image according to the texture offset corresponding to each pixel point to render the pixel point, Obtain the rendered highlight rendering image, including:

Obtain the basic texture coordinate value corresponding to each pixel in the highlight image, wherein the texture-based coordinate value is the corresponding coordinate value when there is no offset between the light source vector and the line of sight vector;

According to the texture offset corresponding to each pixel point and the basic texture coordinate value, the pixel point pair is determined The corresponding texture sampling coordinate value;

Sample the texture color value corresponding to the texture sampling coordinate value from the highlight image as the color value corresponding to the pixel point;

Render the pixels based on the color value corresponding to each pixel point to obtain the highlight rendering image.
The method according to claim 4, wherein determining the texture sampling coordinate value corresponding to each pixel point based on the texture offset corresponding to the pixel point and the basic texture coordinate value includes:

Determine the sub-coordinate value of the basic texture coordinate value of each pixel point in the vertical direction;

For each pixel point, the coordinate value obtained by subtracting the texture offset corresponding to the pixel point from the sub-coordinate value corresponding to the pixel point is used as the updated coordinate value in the vertical direction, and The sub-coordinate value corresponding to the pixel point is updated to the updated coordinate value to obtain the texture sampling coordinate value corresponding to the pixel point.
The method according to claim 4, wherein determining the texture sampling coordinate value corresponding to each pixel point based on the texture offset corresponding to the pixel point and the basic texture coordinate value includes:

Determine the sub-coordinate value of the basic texture coordinate value of each pixel point in the vertical direction;

For each pixel, determine the target offset corresponding to the pixel according to the texture offset corresponding to the pixel and the preset offset adjustment parameter;

For each pixel point, the coordinate value obtained by subtracting the target offset corresponding to the pixel point from the sub-coordinate value corresponding to the pixel point is used as the updated coordinate value in the vertical direction, and The sub-coordinate value corresponding to the pixel point is updated to the updated coordinate value to obtain the texture sampling coordinate value corresponding to the pixel point.
A highlight rendering device, wherein the device includes:

An acquisition module, configured to acquire a highlight image to be rendered, wherein a highlight shape to be rendered is drawn in the highlight image;

The first processing module is used to determine the light source vector in the target coordinate space corresponding to the hair model based on the light source direction in the world space;

The second processing module is used to determine, for each pixel to be rendered in the hair model, the line of sight vector corresponding to the pixel in the target coordinate space according to the line of sight direction in the world space;

A determination module configured to determine, for each pixel point, the texture bias of the pixel point in the vertical direction corresponding to the horizontal direction in the highlight image according to the light source vector and the line of sight vector corresponding to the pixel point. displacement;

A rendering module, configured to extract data from the highlight image according to the texture offset corresponding to each pixel. In this way, the pixel points are rendered to obtain a rendered highlight rendering image.
The device according to claim 7, wherein the determining module includes:

The first determination sub-module is used to determine the light source component of the light source vector in the vertical direction;

The second determination sub-module is used to determine, for each pixel point, the line of sight component of the line of sight vector corresponding to the pixel point in the vertical direction;

The third determination sub-module is used to determine the texture offset corresponding to the pixel point based on the light source component and the line of sight component corresponding to each pixel point.
A computer-readable medium having a computer program stored thereon, wherein the computer program implements the steps of the method of any one of claims 1-6 when executed by a processing device.
An electronic device including:

a storage device having a computer program stored thereon;

A processing device, configured to execute the computer program in the storage device to implement the steps of the method according to any one of claims 1-6.
A computer program product, comprising a computer program that implements the steps of the method according to any one of claims 1-6 when executed by a processing device.
A computer program, wherein the steps of the method of any one of claims 1-6 are implemented when the computer program is executed by a processing device.