WO2019034142A1 - 三维虚拟形象的显示方法、装置、终端及存储介质 - Google Patents
三维虚拟形象的显示方法、装置、终端及存储介质 Download PDFInfo
- Publication number
- WO2019034142A1 WO2019034142A1 PCT/CN2018/101028 CN2018101028W WO2019034142A1 WO 2019034142 A1 WO2019034142 A1 WO 2019034142A1 CN 2018101028 W CN2018101028 W CN 2018101028W WO 2019034142 A1 WO2019034142 A1 WO 2019034142A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- model
- map
- terminal
- dimensional avatar
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/50—Lighting effects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
- G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/50—Lighting effects
- G06T15/503—Blending, e.g. for anti-aliasing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/50—Lighting effects
- G06T15/506—Illumination models
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/012—Dimensioning, tolerancing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2021—Shape modification
Definitions
- the embodiments of the present invention relate to the field of virtual reality technologies, and in particular, to a method, an apparatus, a terminal, and a storage medium for displaying a three-dimensional virtual image.
- 3D display technology has been widely used. By creating a 3D virtual environment and creating a user's 3D avatar, it is possible to accurately simulate the real scene and bring people an immersive experience.
- the torso model can be generated in advance, the head model is generated according to the facial image of the current user, and the head model and the trunk model are combined to form a complete three-dimensional image. Virtual image.
- the torso model is used to display the trunk movements of the human body, and the head model is used to display facial facial expressions or head movements.
- the embodiment of the present application provides a method, an apparatus, a terminal, and a storage medium for displaying a three-dimensional virtual image.
- the technical solution is as follows:
- a method for displaying a three-dimensional avatar comprising:
- the second model map includes texture data of each pixel in the second model;
- a target area of the three-dimensional avatar Determining a target area of the three-dimensional avatar, the target area being an interface area of the first model and the second model;
- the shader is configured to set illumination environment data of each pixel in the three-dimensional avatar, the illumination environment data includes at least brightness;
- the first model map and the second model map are rendered by the shader such that the brightness of each pixel of the target area displayed after rendering is equal.
- a display device for a three-dimensional avatar comprising:
- a map obtaining module configured to acquire a first model map and a second model map of the three-dimensional avatar, the three-dimensional avatar including a first model and a second model, the first model map including each of the first models Texture data of a pixel, the second model map including texture data of each pixel in the second model;
- a region determining module configured to determine a target area of the three-dimensional avatar, where the target area is an interface area of the first model and the second model;
- a setting module configured to set a brightness value of each pixel in the target area in the shader to an equal value, the shader is configured to set illumination environment data of each pixel in the three-dimensional avatar,
- the lighting environment data includes at least light brightness
- a rendering module configured to render the first model map and the second model map by the shader, so that the brightness of each pixel of the target area displayed after rendering is equal.
- a terminal comprising a processor and a storage medium, wherein the storage medium stores at least one instruction loaded by the processor and executed to implement display of the three-dimensional avatar method.
- a computer readable storage medium having stored therein at least one instruction loaded by a processor and executed to implement a display method of the three-dimensional avatar described above.
- the method, the device, the terminal, and the storage medium provided by the embodiments of the present application determine the target area of the three-dimensional virtual image by acquiring the first model map and the second model map of the three-dimensional virtual image, and the target in the shader is displayed when displaying the three-dimensional virtual image.
- the brightness of each pixel in the area is set to an equal value and then rendered to ensure that the brightness of the pixels in the target area is equal.
- the transition between the first model and the second model is natural and will not occur.
- the seam enhances the display effect, and can better meet the display requirements of the three-dimensional virtual image, improve the authenticity of the three-dimensional virtual image, and bring the immersive feeling to the user.
- FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application.
- FIG. 2 is a schematic diagram of a three-dimensional avatar provided by the related art
- 3A is a flowchart of a method for displaying a three-dimensional avatar according to an embodiment of the present application
- FIG. 3B is a schematic diagram of a torso model selection interface according to an embodiment of the present application.
- 3C is a schematic diagram of a three-dimensional model provided by an embodiment of the present application.
- FIG. 3D is a schematic diagram of a two-dimensional picture obtained after displaying a three-dimensional model according to an embodiment of the present application.
- 3E is a schematic diagram of a target area provided by an embodiment of the present application.
- FIG. 4 is a flowchart of another method for displaying a three-dimensional avatar according to an embodiment of the present application.
- FIG. 5 is a schematic structural diagram of a three-dimensional avatar display device according to an embodiment of the present application.
- FIG. 6 is a schematic structural diagram of a terminal according to an embodiment of the present application.
- the implementation environment includes: a terminal 101 and a server 102.
- the terminal 101 can be connected to the server 102 through a wired or wireless network.
- the terminal 101 may be a terminal such as a mobile phone, a tablet computer, a desktop computer or an e-reader
- the server 102 refers to a server that provides background services for the terminal 101, and may be a server or a server composed of multiple servers. Cluster.
- server 102 can be a background server for a client installed in terminal 101.
- the terminal 101 is a terminal that supports a three-dimensional avatar generation function.
- a client may be installed in the terminal 101, and the client supports a three-dimensional avatar generation function, and the client may be a social application client or a game client.
- the three-dimensional avatar refers to an image formed by combining the first model and the second model, wherein the first model and the second model are two-part models required to form an overall three-dimensional avatar.
- the first model is a head model
- the second model is a torso model
- the first model is a body model
- the second model is a limb model.
- the server After the server generates the three-dimensional avatar, the first model map and the second model map may be acquired and sent to the terminal 101, so that the terminal 101 performs rendering to display the three-dimensional avatar.
- the terminal 101 may have a photographing function, and after acquiring the facial image of the user through the photographing function, the image is sent to the server 102, and the server 102 generates a corresponding image according to the facial image.
- the head model combines the head model with the torso model to form a three-dimensional avatar, and acquires corresponding head model maps and torso model maps, and sends them to the terminal 101 for the terminal 101 to render to display the three-dimensional avatar.
- the wireless or wired network described above uses standard communication techniques and/or protocols.
- the network is usually the Internet, and can be any network, including but not limited to a Local Area Network (LAN), a Metropolitan Area Network (MAN), a Wide Area Network (WAN), a mobile, a wired or a wireless network. Any combination of private networks or virtual private networks.
- data exchanged over a network is represented using techniques and/or formats including Hyper Text Markup Language (HTML), Extensible Markup Language (XML), and the like.
- HTTP Hyper Text Markup Language
- XML Extensible Markup Language
- you can use such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Network (VPN), Internet Protocol Security (IPsec).
- Regular encryption techniques are used to encrypt all or some of the links.
- the above described data communication techniques may also be replaced or supplemented using custom and/or dedicated data communication techniques.
- the embodiment of the present application is applied to an application scenario for displaying a three-dimensional virtual image.
- each user may set a three-dimensional virtual image, or the user may set a three-dimensional image in the social application client.
- the display effect of the joint region between the head model and the trunk model is as shown in FIG. 2, and as shown in FIG. 2, an obvious appears on the neck of the three-dimensional avatar.
- the seams are very different from the human body image in reality, resulting in poor display performance and affecting the user experience.
- the surface of the connecting area when displaying the three-dimensional avatar, by controlling the lighting environment data of the connecting area and then rendering, the surface of the connecting area can be ensured to be uniform, seams are avoided, and the display effect is improved.
- the specific process can be seen in the following examples.
- FIG. 3A is a flowchart of a method for displaying a three-dimensional avatar according to an embodiment of the present application.
- the execution body of the embodiment of the present application is the terminal 101 shown in FIG. 1 .
- the method includes:
- the three-dimensional avatar includes a first model and a second model, and is composed of a combination of the first model and the second model.
- the terminal can acquire the three-dimensional avatar sent by the other device, and the first model map and the second model map.
- a three-dimensional avatar may be generated from the face image of the current user.
- the first model is a head model
- the second model is a torso model
- the terminal acquires a facial image
- the facial image can be obtained by the terminal capturing the face of the user, and the face of the first model is matched with the facial image provided by the user, so that the generated three-dimensional virtual image can represent the user and bring an immersive feeling to the user.
- the terminal opens the shooting interface, and the reference line of the preset portion is displayed in the shooting interface, and the reference line is used to prompt to adjust the preset portion in the preview image to the position where the reference line is located; optionally, in the shooting interface It may also include text prompt information for prompting to adjust the preset portion to the position where the baseline is located.
- the terminal can display the eye and nose reference line and the text prompt message “Align the eyes and nose to the baseline and click to take a picture” in the shooting interface.
- the terminal can shoot the user from different shooting angles with the cooperation of the user, and obtain multiple facial images, such as the front of the face image, left
- the side image, the right image, and the like when the terminal sends a three-dimensional avatar generation request to the server, the three-dimensional avatar generation request may include a plurality of facial images, and the server may generate the first model based on the plurality of facial images.
- the facial image may also be selected by the user from the pictures stored in the gallery, or obtained by other means.
- the facial image can be beautified.
- the facial image is subjected to feature recognition to obtain a plurality of feature points, the facial image is displayed, and the identified feature points are displayed on the facial image, and the user can adjust the position of any one of the plurality of feature points.
- the adjusted facial image is obtained, thereby achieving the effect of adjusting the position of a certain part of the face.
- the plurality of feature points may include feature points such as an eye, a nose, an eyebrow, a mouth or a face contour, and the adjustment process may be implemented by an operation of the user dragging the feature point.
- the second model may be predetermined by the terminal, or a plurality of second models may be preset.
- a plurality of torso models such as a human body model and an animal model can be set.
- the human body model includes a male model and a female model
- the animal model includes a cat model, a dog model, etc.
- the user can Choose any model as the torso model used to generate the 3D avatar.
- the terminal displays a torso model selection interface in which a male model and a female model and two model selection buttons are displayed, and the user can select a corresponding model by clicking a selection button of any model.
- the terminal may further determine, according to the user information, a second model that matches the user information, where the user information may include the information information filled in when the user registers, and the operation information determined by collecting the operation behavior of the user. For example, taking the second model as the trunk model as an example, and determining the gender of the user as a female according to the user information, the female model is selected as the torso model used in generating the three-dimensional virtual image.
- the first model map includes texture data for each pixel in the first model
- the second model map includes texture data for each pixel in the second model.
- a map is a model map for drawing a surface texture of a three-dimensional avatar, and may be in a TGA (Targa) format, a PNG (Portable Network Graphic) format, or a TIF (Tag Image File) format.
- TGA Tumita
- PNG Portable Network Graphic
- TIF Tag Image File
- a three-dimensional vector representing the normal direction of the pixel is determined at each pixel, and the three-dimensional vector is stored as the value of three colors in RGB (red, green, and blue), and each component is mapped to The range of [-1,1], thus determining the RGB value of each pixel, and expressing the normal direction by RGB value.
- RGB red, green, and blue
- the normal direction of each pixel can be expressed by The light and dark changes caused by the bumps make people feel that the three-dimensional avatar is rugged and enhances the display effect.
- the texture data of the pixel can determine the texture of the area where the corresponding pixel is located.
- the texture may include coordinate data of the pixel points and corresponding texture data.
- the three-dimensional model may be expanded to form a two-dimensional image, and the pixels in the two-dimensional image.
- the point corresponds one-to-one with the pixel points in the three-dimensional model, and a two-dimensional coordinate system is established according to the two-dimensional image, and the coordinate data of each pixel point is determined according to the position of each pixel point in the two-dimensional coordinate system.
- the coordinate data may be UV coordinates (U in the horizontal direction and V in the vertical direction).
- the three-dimensional avatar may further include other image data, such as accessory information and image beautification information, and the accessory information may include a hat, a scarf, and a clothing. , hair style, etc., picture beautification information can include whitening, microdermabrasion, skin color and so on.
- the second point to be explained is that after the terminal receives the three-dimensional virtual image returned by the server, the three-dimensional virtual image can be stored, and the stored three-dimensional virtual image can be directly read and displayed in the subsequent process without sending the three-dimensional image to the server again.
- the avatar generates a request.
- the target area is an interface area between the first model and the second model.
- the area where the seam is located is determined as the target area.
- the first model is located above the second model, and the first preset size area at the lower edge of the first model and the second preset size area at the upper edge of the second model are determined as target area.
- the area of the first preset size refers to an area where the lower edge line of the first model is the area lower edge line, the upper edge line and the lower edge line have the same shape and the height is the first preset height, and the second preset size
- the first preset size and the second preset size may be pre-defined with the upper edge line of the second model as the upper edge line, the upper edge line and the lower edge line having the same shape and the height being the second preset height. Determined based on accuracy.
- the target area (the area between the two broken lines) as shown in FIG. 3E can be determined according to the position and shape of the edges of the first model and the second model in the three-dimensional avatar. .
- a shader is used to set the lighting environment data of each pixel in the 3D avatar.
- the shader can simulate a certain direction under certain lighting conditions. The effect of the three-dimensional avatar to illuminate, thereby enhancing the authenticity of the three-dimensional avatar during rendering.
- Shaders can include vertex shaders, fragment shaders, and many other shaders. Different shaders involve different functions, such as vertex shaders for rendering vertices of models, and fragment shaders for rendering textures on model surfaces.
- the lighting environment data of the shader includes at least lightness, and the brightness is used to indicate the brightness of the surface of the three-dimensional avatar, and can describe the brightness of the light perceived by the observer when viewing the three-dimensional avatar.
- the illumination environment data of the shader may further include luminous flux, luminous intensity, etc., the luminous flux is the amount of light emitted by the light source per unit time, and the luminous intensity refers to the luminous flux emitted by the light source in a unit solid angle of a specified direction.
- the embodiment of the present application does not directly render through the shader, but first sets the brightness of each pixel in the target area in the shader to an equal value, which ensures After rendering the three-dimensional avatar, the brightness of each pixel of the displayed target area is equal, and the user does not see the shadow when viewing the realistic three-dimensional avatar.
- the terminal can obtain the brightness of each pixel in the target area, calculate the average value of the brightness of the target area, and set the brightness of each pixel in the target area to the average value. The value of the set brightness.
- the terminal may further locate the pixel in the target region in the first model map and the second model map in the target region.
- the texture data of the pixels is set to equal texture data, which ensures that the texture of each pixel of the displayed target area is the same after rendering the three-dimensional avatar.
- the terminal may obtain texture data of each pixel in the target area, calculate an average value of the texture data of the target area, and set texture data of each pixel in the target area to the average value, and may also be determined by other means.
- the texture data to be set may be set.
- step 304 is an optional step, and the terminal may not perform step 304, or may perform step 304 to further improve the display effect.
- the texture data of each pixel has been set in the first model map and the second model map, and the shader has also set the lighting environment data of each pixel point, and the first model map and the second model map are performed by the shader.
- Rendering can display a 3D avatar.
- the first model map, the second model map, and the lighting environment data set by the shader are stored together to form a material, and the material is written into the cache, and then can be rendered.
- the device extracts the material from the cache and renders the material to display a three-dimensional avatar.
- Material-based shaders can be applied to 3D avatars using textures of specific materials to achieve a more realistic display of reflective material objects with uniform surface shading.
- the method provided by the embodiment of the present application determines the target area of the three-dimensional virtual image by acquiring the first model map and the second model map of the three-dimensional virtual image, and each pixel in the target area in the shader is displayed when displaying the three-dimensional virtual image. After the brightness is set to an equal value and then rendered, the brightness of the pixels in the target area is equal, and the transition effect between the first model and the second model is natural, no seams appear, and the display effect is improved. It can better meet the display requirements of 3D avatars, improve the authenticity of 3D avatars, and bring users an immersive experience.
- FIG. 4 is a flowchart of another method for displaying a three-dimensional avatar according to an embodiment of the present application.
- the execution body of the application embodiment is the terminal 101 and the server 102 shown in FIG. 1. Referring to FIG. 4, the method includes:
- the terminal acquires a facial image of the three-dimensional avatar to be generated.
- the terminal sends a three-dimensional avatar generation request to the server.
- the terminal after acquiring the facial image, the terminal sends a three-dimensional avatar generation request including the facial image to the server, and the server generates a corresponding three-dimensional virtual image.
- the facial image may be obtained by the terminal capturing the user's face or selected from the pictures stored in the gallery. After the terminal obtains the facial image, it can also perform beautification processing, such as adjusting the position of a certain part of the face by dragging the feature point, and then sending it to the server.
- the server receives the three-dimensional avatar generation request, the first model is generated according to the facial image, and the first model and the second model are combined to form a three-dimensional avatar.
- the server sends the first model map and the second model map of the three-dimensional avatar to the terminal.
- the first model is generated according to a facial image of the user
- the second model may be predetermined by the server, or the server may also provide a plurality of second models for the terminal, and the terminal displays the plurality of second models for the user to select when acquiring
- the server may combine the first model with the second model selected by the user to form a three-dimensional virtual image, and generate a first model map and a second model according to the generated three-dimensional virtual image. Texture, sent to the terminal.
- the terminal receives the first model map and the second model map, and determines a target area of the three-dimensional avatar.
- the terminal sets the brightness of each pixel in the target area in the shader to an equal value, and sets the texture data of the pixel located in the target area in the first model map and the second model map to equal texture data. .
- the terminal renders the first model map and the second model map by using a shader.
- the process of rendering according to the first model map and the second model map is similar to the foregoing embodiment, and details are not described herein again.
- the method provided by the embodiment of the present application determines the target area of the three-dimensional virtual image by acquiring the first model map and the second model map of the three-dimensional virtual image, and each pixel in the target area in the shader is displayed when displaying the three-dimensional virtual image. After the brightness is set to an equal value and then rendered, the brightness of the pixels in the target area is equal, and the transition effect between the first model and the second model is natural, no seams appear, and the display effect is improved. It can better meet the display requirements of 3D avatars, improve the authenticity of 3D avatars, and bring users an immersive experience.
- FIG. 5 is a schematic structural diagram of a three-dimensional avatar display device according to an embodiment of the present application. Referring to Figure 5, the device includes:
- a map obtaining module 501 configured to perform step 301 in the above embodiment
- the area determining module 502 is configured to perform step 302 in the foregoing embodiment
- the setting module 503 is configured to perform step 303 in the above embodiment
- the rendering module 504 is configured to perform step 305 in the above embodiment.
- the device further includes:
- An image acquisition module configured to acquire a facial image
- the sending module is configured to send a three-dimensional avatar generation request to the server.
- the area determining module 502 is configured to determine a first preset size area at a lower edge of the first model and a second preset size area at an upper edge of the second model as the target area.
- the setting module is further configured to perform step 304 in the above embodiment.
- the rendering module 504 is further configured to perform the process of rendering by using the cache in step 305 above.
- the display device of the three-dimensional avatar provided by the above embodiment is only illustrated by the division of the above functional modules when displaying the three-dimensional avatar. In actual applications, the functions may be assigned differently according to needs.
- the function module is completed, that is, the internal structure of the terminal is divided into different functional modules to complete all or part of the functions described above.
- the display device of the three-dimensional avatar provided by the above embodiment is the same as the embodiment of the method for displaying the three-dimensional avatar. The specific implementation process is described in detail in the method embodiment, and details are not described herein again.
- FIG. 6 is a schematic structural diagram of a terminal according to an embodiment of the present application.
- the terminal can be used to implement the functions performed by the terminal in the display method of the three-dimensional avatar shown in the above embodiment. Specifically:
- the terminal 600 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more computer readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a transmission module 170, including One or more processing core processor 180, and power supply 190 and the like.
- RF Radio Frequency
- FIG. 6 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:
- the RF circuit 110 can be used for transmitting and receiving information or during a call, and receiving and transmitting signals. Specifically, after receiving the downlink information of the base station, the downlink information is processed by one or more processors 180. In addition, the data related to the uplink is sent to the base station. .
- the RF circuit 110 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier). , duplexer, etc. In addition, the RF circuit 110 can also communicate with the network and other terminals through wireless communication.
- SIM Subscriber Identity Module
- LNA Low Noise Amplifier
- the wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.
- GSM Global System of Mobile communication
- GPRS General Packet Radio Service
- CDMA Code Division Multiple Access
- WCDMA Wideband Code Division Multiple Access
- LTE Long Term Evolution
- e-mail Short Messaging Service
- the memory 120 can be used to store software programs and modules, such as the software programs and modules corresponding to the terminals shown in the above exemplary embodiments, and the processor 180 executes various functional applications by running software programs and modules stored in the memory 120. And data processing, such as implementing video-based interactions.
- the memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 600 (such as audio data, phone book, etc.) and the like.
- memory 120 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 120 may also include a memory controller to provide access to memory 120 by processor 180 and input unit 130.
- the input unit 130 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
- input unit 130 can include touch-sensitive surface 131 as well as other input terminals 132.
- Touch-sensitive surface 131 also referred to as a touch display or trackpad, can collect touch operations on or near the user (such as a user using a finger, stylus, etc., on any suitable object or accessory on touch-sensitive surface 131 or The operation near the touch-sensitive surface 131) and driving the corresponding linking device according to a preset program.
- the touch-sensitive surface 131 can include two portions of a touch detection device and a touch controller.
- the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
- the processor 180 is provided and can receive commands from the processor 180 and execute them.
- the touch-sensitive surface 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
- the input unit 130 may also include other input terminals 132.
- other input terminals 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
- the display unit 140 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of the terminal 600, which can be composed of graphics, text, icons, video, and any combination thereof.
- the display unit 140 may include a display panel 141.
- the display panel 141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
- the touch-sensitive surface 131 may cover the display panel 141, and when the touch-sensitive surface 131 detects a touch operation thereon or nearby, it is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 according to the touch event The type provides a corresponding visual output on display panel 141.
- touch-sensitive surface 131 and display panel 141 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 131 can be integrated with display panel 141 for input. And output function.
- Terminal 600 may also include at least one type of sensor 150, such as a light sensor, motion sensor, and other sensors.
- the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may close the display panel 141 when the terminal 600 moves to the ear. / or backlight.
- the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
- the gesture of the mobile phone such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the terminal 600 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
- the audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the terminal 600.
- the audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker 161 for conversion to the sound signal output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal by the audio circuit 160. After receiving, it is converted into audio data, and then processed by the audio data output processor 180, transmitted to the terminal, for example, via the RF circuit 110, or outputted to the memory 120 for further processing.
- the audio circuit 160 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 600.
- the terminal 600 can help the user to send and receive emails, browse web pages, access streaming media, etc. through the transmission module 170, and provides the user with wireless or wired broadband Internet access.
- FIG. 6 shows the transmission module 170, it can be understood that it does not belong to the essential configuration of the terminal 600, and may be omitted as needed within the scope of not changing the essence of the application.
- the processor 180 is the control center of the terminal 600, which links various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120, The various functions and processing data of the terminal 600 are performed to perform overall monitoring of the mobile phone.
- the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
- the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.
- the terminal 600 also includes a power source 190 (such as a battery) for powering various components.
- a power source 190 such as a battery
- the power source can be logically coupled to the processor 180 through a power management system to manage functions such as charging, discharging, and power management through the power management system.
- Power supply 190 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
- the terminal 600 may further include a camera, a Bluetooth module, and the like, and details are not described herein.
- the display unit of the terminal 600 is a touch screen display
- the terminal 600 further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be one or one
- the above processor executing one or more of the above-described programs includes instructions for implementing the operations performed by the terminal in the above-described embodiments.
- the embodiment of the present application further provides a three-dimensional avatar display device, the device comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, an instruction, a program, a code set or an instruction.
- the operations performed in the display method of the three-dimensional avatar loaded and executed by the processor to implement the above-described embodiment are set.
- the embodiment of the present application further provides a computer readable storage medium, where the computer readable storage medium stores at least one instruction, at least one program, a code set or a set of instructions, the program, the program, the code set or the instruction.
- a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
- the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Architecture (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
本申请实施例公开了一种三维虚拟形象的显示方法、装置、终端及存储介质,属于虚拟现实技术领域。方法包括:获取三维虚拟形象的第一模型贴图和第二模型贴图,三维虚拟形象包括第一模型和第二模型,第一模型贴图包括第一模型中每个像素点的纹理数据,第二模型贴图包括第二模型中每个像素点的纹理数据;确定三维虚拟形象的目标区域,将着色器中目标区域内每个像素点的光亮度设置为相等的数值;通过着色器对第一模型贴图和第二模型贴图进行渲染,以使渲染后所显示的目标区域的每个像素点的光亮度相等。本申请实施例能够保证目标区域内像素点的光亮度相等,在第一模型与第二模型的衔接处过渡效果自然,不会出现接缝,提升了显示效果。
Description
本申请要求申请日为2017年8月17日、申请号为201710706915.8、申请创造名称为《三维虚拟形象的显示方法、装置、终端及存储介质》的申请专利申请的优先权。
本申请实施例涉及虚拟现实技术领域,特别涉及一种三维虚拟形象的显示方法、装置、终端及存储介质。
随着虚拟现实技术的发展,三维显示技术实现了广泛应用,通过创建三维虚拟环境并创建用户的三维虚拟形象,能够精确模拟真实的景象,给人们带来身临其境的感受。
考虑到实际生活中不同用户的面部差异较大,在创建三维虚拟形象时,可以预先生成躯干模型,根据当前用户的面部图像生成头部模型,将头部模型和躯干模型组合构成一个完整的三维虚拟形象。其中,躯干模型用于展示人体的躯干动作,头部模型用于展示人脸面部表情或头部动作。
然而,躯干模型与头部模型组合时,会在两者的衔接区域出现一些明显的接缝,导致三维虚拟形象的显示效果不佳。
发明内容
为了解决相关技术的问题,本申请实施例提供了一种三维虚拟形象的显示方法、装置、终端及存储介质。所述技术方案如下:
一方面,提供了一种三维虚拟形象的显示方法,所述方法包括:
获取三维虚拟形象的第一模型贴图和第二模型贴图,所述三维虚拟形象包括第一模型和第二模型,所述第一模型贴图包括所述第一模型中每个像素点的纹理数据,所述第二模型贴图包括所述第二模型中每个像素点的纹理数据;
确定所述三维虚拟形象的目标区域,所述目标区域为所述第一模型与所述第二模型的衔接区域;
将着色器中所述目标区域内每个像素点的光亮度设置为相等的数值,所述着色器用于设置所述三维虚拟形象中每个像素点的光照环境数据,所述光照环境数据至少包括光亮度;
通过所述着色器对所述第一模型贴图和所述第二模型贴图进行渲染,以使渲染后所显示的所述目标区域的每个像素点的光亮度相等。
另一方面,提供了一种三维虚拟形象的显示装置,所述装置包括:
贴图获取模块,用于获取三维虚拟形象的第一模型贴图和第二模型贴图,所述三维虚拟形象包括第一模型和第二模型,所述第一模型贴图包括所述第一模型中每个像素点的纹 理数据,所述第二模型贴图包括所述第二模型中每个像素点的纹理数据;
区域确定模块,用于确定所述三维虚拟形象的目标区域,所述目标区域为所述第一模型与所述第二模型的衔接区域;
设置模块,用于将着色器中所述目标区域内每个像素点的光亮度设置为相等的数值,所述着色器用于设置所述三维虚拟形象中每个像素点的光照环境数据,所述光照环境数据至少包括光亮度;
渲染模块,用于通过所述着色器对所述第一模型贴图和所述第二模型贴图进行渲染,以使渲染后所显示的所述目标区域的每个像素点的光亮度相等。
再一方面,提供了一种终端,所述终端包括处理器和存储介质,所述存储介质中存储有至少一条指令,所述指令由所述处理器加载并执行以实现上述三维虚拟形象的显示方法。
又一方面,提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有至少一条指令,所述指令由处理器加载并执行以实现上述三维虚拟形象的显示方法。
本申请实施例提供的方法、装置、终端及存储介质,通过获取三维虚拟形象的第一模型贴图和第二模型贴图,确定三维虚拟形象的目标区域,在显示三维虚拟形象时将着色器中目标区域内每个像素点的光亮度设置为相等的数值后再进行渲染,能够保证目标区域内像素点的光亮度相等,在第一模型与第二模型的衔接处过渡效果自然,不会出现接缝,提升了显示效果,更能满足三维虚拟形象的显示需求,提高了三维虚拟形象的真实性,更能为用户带来身临其境的感受。
本申请的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实践了解到。
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的一种实施环境的示意图;
图2是相关技术提供的一种三维虚拟形象的示意图;
图3A是本申请实施例提供的一种三维虚拟形象的显示方法的流程图;
图3B是本申请实施例提供的一种躯干模型选择界面的示意图;
图3C是本申请实施例提供的一种三维模型的示意图;
图3D是本申请实施例提供的一种三维模型展示后得到的二维图片示意图;
图3E是本申请实施例提供的一种目标区域的示意图;
图4是本申请实施例提供的另一种三维虚拟形象的显示方法的流程图;
图5是本申请实施例提供的一种三维虚拟形象的显示装置的结构示意图;
图6是本申请实施例提供的一种终端的结构示意图。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
图1是本申请实施例提供的一种实施环境的示意图,该实施环境包括:终端101和服务器102,终端101可以通过有线或者无线网络与服务器102连接。
终端101可以为诸如手机、平板电脑、台式电脑或者电子阅读器之类的终端,服务器102是指为终端101提供后台服务的服务器,可以为一台服务器,也可以为由多台服务器组成的服务器集群。在一种可能实现方式中,服务器102可以为终端101中安装的客户端的后台服务器。
本申请实施例中,终端101为支持三维虚拟形象生成功能的终端。在一种可能实现方式中,终端101中可以安装客户端,该客户端支持三维虚拟形象生成功能,该客户端可以为社交应用客户端或者游戏客户端。
其中,该三维虚拟形象是指根据第一模型与第二模型组合构成的形象,其中第一模型和第二模型为构成一个整体的三维虚拟形象所需的两部分的模型。例如第一模型为头部模型,第二模型为躯干模型,或者第一模型为身体模型,而第二模型为四肢模型。服务器生成三维虚拟形象后,可以获取第一模型贴图和第二模型贴图,发送至终端101,以便终端101进行渲染以显示该三维虚拟形象。
以第一模型为头部模型,第二模型为躯干模型为例,终端101可以具备拍摄功能,通过拍摄功能获取到用户的面部图像后,发送至服务器102,由服务器102根据该面部图像生成对应的头部模型,将头部模型与躯干模型组合构成三维虚拟形象,并获取相应的头部模型贴图和躯干模型贴图,发送至终端101,以便终端101进行渲染以显示该三维虚拟形象。
可选地,上述的无线网络或有线网络使用标准通信技术和/或协议。网络通常为因特网,也可以是任何网络,包括但不限于局域网(Local Area Network,LAN)、城域网(Metropolitan Area Network,MAN)、广域网(Wide Area Network,WAN)、移动、有线或者无线网络、专用网络或者虚拟专用网络的任何组合。在一些实施例中,使用包括超文本标记语言(Hyper Text Mark-up Language,HTML)、可扩展标记语言(Extensible Markup Language,XML)等的技术和/或格式来代表通过网络交换的数据。此外还可以使用诸如安全套接字层(Secure Socket Layer,SSL)、传输层安全(Transport Layer Security,TLS)、虚拟专用网络(Virtual Private Network,VPN)、网际协议安全(Internet Protocol Security,IPsec)等常规加密技术来加密所有或者一些链路。在另一些实施例中,还可以使用定制 和/或专用数据通信技术取代或者补充上述数据通信技术。
本申请实施例应用于显示三维虚拟形象的应用场景中,例如游戏玩家通过游戏客户端进行游戏活动时,每个用户均可设置一个三维虚拟形象,或者在社交应用客户端中用户可以设置一个三维虚拟形象,与其他用户进行互动。
相关技术中,将头部模型和躯干模型组合构成三维虚拟形象时,头部模型与躯干模型的衔接区域的显示效果如图2所示,参见图2,三维虚拟形象的脖子上出现了一条明显的接缝,与现实中的人体形象存在很大差异,导致显示效果不佳,影响了用户体验。
而本申请实施例中,在显示三维虚拟形象时,通过控制衔接区域的光照环境数据后再进行渲染,可以保证衔接区域的表面均匀,避免出现接缝,提升了显示效果。具体过程可以参见下述实施例。
图3A是本申请实施例提供的一种三维虚拟形象的显示方法的流程图。该申请实施例的执行主体为图1所示的终端101,参见图3A,该方法包括:
301、获取三维虚拟形象的第一模型贴图和第二模型贴图。
其中,三维虚拟形象包括第一模型和第二模型,由第一模型和第二模型组合构成。
终端可以获取其他设备发送的三维虚拟形象以及第一模型贴图和第二模型贴图。或者,也可以根据当前用户的面部图像生成三维虚拟形象。在一种可能实现方式中,该第一模型为头部模型,该第二模型为躯干模型,终端获取面部图像,根据面部图像生成第一模型,并将第一模型与第二模型组合构成三维虚拟形象,向终端发送三维虚拟形象的第一模型贴图和第二模型贴图。
其中,该面部图像可以由终端拍摄用户的面部得到,第一模型的面部与用户提供的面部图像匹配,使得所生成的三维虚拟形象可以代表用户,为用户带来身临其境的感受。
拍摄面部图像时,终端开启拍摄界面,拍摄界面中显示预设部位的基准线,该基准线用于提示将预览图像中的预设部位调整至基准线所在的位置;可选地,拍摄界面中还可以包括用于提示将预设部位调整至基准线所在的位置的文本提示信息。如终端可以在拍摄界面中显示眼部和鼻子的基准线以及文本提示信息“将眼睛和鼻子对准基准线后点击拍照”。
可选地,为了提高准确度,获取到更加真实的面部图像,终端可以在用户的配合之下,从不同的拍摄角度对用户进行拍摄,得到多张面部图像,如人脸正前方图像、左侧图像、右侧图像等,终端向服务器发送三维虚拟形象生成请求时,该三维虚拟形象生成请求可以包括多张面部图像,服务器可以基于该多张面部图像生成第一模型。
另外,该面部图像也可以由用户从图库存储的图片中选择,或者通过其他方式得到。
获取到面部图像之后,可以对该面部图像进行美化处理。可选地,对该面部图像进行特征识别,得到多个特征点,展示该面部图像并在该面部图像上展示识别得到的特征点,用户可以调整该多个特征点中任一特征点的位置,得到调整后的面部图像,从而达到了调整面部某一部位所在位置的效果。其中,该多个特征点可以包括眼睛、鼻子、眉毛、嘴巴 或者面部轮廓等特征点,该调整过程可以通过用户拖动特征点的操作实现。
而第二模型可以由终端预先确定,或者可以预先设置多种第二模型。例如,以第二模型为躯干模型为例,可以设置人体模型和动物模型等多种躯干模型,人体模型包括男性模型和女性模型,动物模型包括猫的模型、狗的模型等,此时用户可以从中选择任一种模型作为生成三维虚拟形象时采用的躯干模型。参见图3B,终端显示躯干模型选择界面,在该躯干模型选择界面中显示男性模型和女性模型以及两个模型的选择按钮,用户可以通过点击任一模型的选择按钮选择相应的模型。
或者,终端还可以根据用户信息确定与该用户信息匹配的第二模型,该用户信息可以包括用户注册时填写的资料信息以及通过采集用户的操作行为确定的操作信息等。例如以第二模型为躯干模型为例,根据用户信息确定用户的性别为女性,则选取女性模型作为生成三维虚拟形象时采用的躯干模型。
相应地,第一模型贴图包括第一模型中每个像素点的纹理数据,第二模型贴图包括第二模型中每个像素点的纹理数据。贴图(Map)是用于绘制三维虚拟形象表面纹理的模型贴图,可以采用TGA(Targa)格式、PNG(Portable Network Graphic可移植网络图形)格式或TIF(Tag Image File,标签图像文件)格式等。贴图上的每一个像素点可以精确对应到三维虚拟形象表面上的每一个像素点,而像素点之间的间隙通过进行图像光滑插值处理。例如针对法线贴图,在每个像素点确定表示像素点法线方向的三维向量,将该三维向量当作RGB(红绿蓝)中三个颜色的值进行存储,并将每个分量映射到[-1,1]的范围,从而确定每个像素点的RGB值,以RGB值来表示法线方向,后续采用法线贴图进行渲染时,根据每个像素点的法线方向可以表现出由凹凸造成的明暗变化,让人感觉三维虚拟形象是凹凸不平的,提升了显示效果。
像素点的纹理数据可以确定对应像素点所在区域的纹理。实际应用时,贴图可以包括像素点的坐标数据和对应的纹理数据,关于该坐标数据的确定方式,参见图3C和图3D,可以将三维模型展开形成一张二维图片,该二维图片中的像素点与三维模型中的像素点一一对应,根据该二维图片建立二维坐标系,根据每个像素点在该二维坐标系中所在的位置确定每个像素点的坐标数据。例如,该坐标数据可以为UV坐标(水平方向为U,垂直方向为V)。
需要说明的第一点是,除该第一模型和第二模型之外,该三维虚拟形象还可以包括其他形象数据,例如配饰信息和图像美化信息等,该配饰信息可以包括帽子、围巾、服装、发型等,图片美化信息可以包括美白、磨皮、肤色等。
需要说明的第二点是,终端接收到服务器返回的三维虚拟形象之后,可以存储该三维虚拟形象,后续过程中每次可以直接读取存储的三维虚拟形象进行展示,而无需再次向服务器发送三维虚拟形象生成请求。
302、确定三维虚拟形象的目标区域。
其中,目标区域为第一模型与第二模型的衔接区域,本申请实施例为了解决第一模型 与第二模型衔接而导致的接缝问题,确定接缝所在的区域,作为目标区域。
在一种可能实现方式中,第一模型位于第二模型的上方,将处于第一模型下边缘的第一预设尺寸的区域及处于第二模型上边缘的第二预设尺寸的区域确定为目标区域。该第一预设尺寸的区域是指以第一模型的下边缘线作为区域下边缘线、上边缘线与下边缘线形状相同且高度为第一预设高度的区域,该第二预设尺寸是指以第二模型的上边缘线作为上边缘线、上边缘线与下边缘线形状相同且高度为第二预设高度的区域,该第一预设尺寸和该第二预设尺寸可以预先根据精确度确定。
以图2所示的三维虚拟形象为例,根据该三维虚拟形象中第一模型和第二模型的边缘的位置和形状可以确定如图3E所示的目标区域(两条虚线之间的区域)。
303、将着色器中目标区域内每个像素点的光亮度设置为相等的数值。
着色器(Shader)用于设置三维虚拟形象中每个像素点的光照环境数据,通过将设置的光照环境数据作用于三维虚拟形象上,着色器可以模拟在某种光照条件下从某种方向对三维虚拟形象进行照射的效果,从而在渲染时增强三维虚拟形象的真实性。
着色器可以包括顶点着色器、片段着色器等多种着色器,不同着色器涉及的功能不同,例如顶点着色器用于渲染模型的顶点,片段着色器用于渲染模型表面的纹理。着色器的光照环境数据至少包括光亮度,光亮度用于表示三维虚拟形象表面的明亮程度,能够描述观察者在观看该三维虚拟形象时所感受到的光亮度。另外着色器的光照环境数据还可以包括光通量、发光强度等,光通量是光源在单位时间内发出的光量,发光强度是指光源在指定方向的单位立体角内发出的光通量。
本申请实施例中,目标区域中存在接缝,导致显示三维虚拟形象时会在脖子位置形成一道阴影,影响显示效果。因此,为了去除目标区域中的接缝,本申请实施例并未直接通过着色器进行渲染,而是先将着色器中目标区域内每个像素点的光亮度设置为相等的数值,这样可以保证在渲染三维虚拟形象后,所显示的目标区域的每个像素点的光亮度相等,用户在观看现实的三维虚拟形象时不会看到阴影。
其中,终端可以获取目标区域内每个像素点的光亮度,计算目标区域的光亮度平均值,将目标区域内每个像素点的光亮度设置为该平均值,当然也可以采用其他方式确定要设置的光亮度的数值。
304、将第一模型贴图和第二模型贴图中位于目标区域内的像素点的纹理数据设置为相等的纹理数据。
本申请实施例中,为了保证第一模型与第二模型衔接处过渡自然,增强真实性,终端还可以将第一模型贴图中位于目标区域内的像素点以及第二模型贴图中位于目标区域内的像素点的纹理数据设置为相等的纹理数据,这样可以保证在渲染三维虚拟形象后,所显示的目标区域的每个像素点的纹理相同。
其中,终端可以获取目标区域内每个像素点的纹理数据,计算目标区域的纹理数据的平均值,将目标区域内每个像素点的纹理数据设置为该平均值,当然也可以采用其他方式 确定要设置的纹理数据。
需要说明的是,该步骤304为可选步骤,终端可以不执行步骤304,或者也可以执行步骤304以进一步提升显示效果。
305、通过着色器对第一模型贴图和第二模型贴图进行渲染。
第一模型贴图和第二模型贴图中已经设置好每个像素点的纹理数据,着色器也已经设置好每个像素点的光照环境数据,通过着色器对第一模型贴图和第二模型贴图进行渲染,可以显示出三维虚拟形象。
在一种可能实现方式中,将第一模型贴图、第二模型贴图以及着色器设置的光照环境数据组合存储在一起,即可构成材质(Material),将材质写入到缓存,之后可以通过渲染器从缓存中提取材质,对材质进行渲染,从而显示出三维虚拟形象。基于材质的着色器,可以使用特定材质的贴图作用于三维虚拟形象上,实现了具有均匀表面着色的反射材质物体的显示,更具真实性。
本申请实施例提供的方法,通过获取三维虚拟形象的第一模型贴图和第二模型贴图,确定三维虚拟形象的目标区域,在显示三维虚拟形象时将着色器中目标区域内每个像素点的光亮度设置为相等的数值后再进行渲染,能够保证目标区域内像素点的光亮度相等,在第一模型与第二模型的衔接处过渡效果自然,不会出现接缝,提升了显示效果,更能满足三维虚拟形象的显示需求,提高了三维虚拟形象的真实性,更能为用户带来身临其境的感受。
图4是本申请实施例提供的另一种三维虚拟形象的显示方法的流程图。该申请实施例的执行主体为图1所示的终端101和服务器102,参见图4,该方法包括:
401、终端获取待生成三维虚拟形象的面部图像。
402、终端向服务器发送三维虚拟形象生成请求。
本申请实施例中,终端获取到面部图像后,将包括该面部图像的三维虚拟形象生成请求发送给服务器,由服务器生成相应的三维虚拟形象。
其中,该面部图像可以由终端拍摄用户的面部得到,或者从图库存储的图片中选择。且终端获取到面部图像之后,还可以进行美化处理,如通过拖动特征点调整面部某一部位所在的位置,之后再发送给服务器。
403、服务器接收到三维虚拟形象生成请求时,根据面部图像生成第一模型,并将第一模型与第二模型组合构成三维虚拟形象。
404、服务器向终端发送三维虚拟形象的第一模型贴图和第二模型贴图。
其中,该第一模型根据用户的面部图像生成,该第二模型可以由服务器预先确定,或者服务器也可以为终端提供多种第二模型,终端显示该多种第二模型供用户选择,当获取到用户选择的第二模型时,发送给服务器,服务器即可将第一模型与用户选择的第二模型组合构成三维虚拟形象,并根据生成的三维虚拟形象绘制生成第一模型贴图和第二模型贴 图,发送给终端。
405、终端接收该第一模型贴图和第二模型贴图,确定三维虚拟形象的目标区域。
406、终端将着色器中目标区域内每个像素点的光亮度设置为相等的数值,将第一模型贴图和第二模型贴图中位于目标区域内的像素点的纹理数据设置为相等的纹理数据。
407、终端通过着色器对第一模型贴图和第二模型贴图进行渲染。
终端获取到第一模型贴图和第二模型贴图后,根据第一模型贴图和第二模型贴图进行渲染的过程与上述实施例类似,在此不再赘述。
本申请实施例提供的方法,通过获取三维虚拟形象的第一模型贴图和第二模型贴图,确定三维虚拟形象的目标区域,在显示三维虚拟形象时将着色器中目标区域内每个像素点的光亮度设置为相等的数值后再进行渲染,能够保证目标区域内像素点的光亮度相等,在第一模型与第二模型的衔接处过渡效果自然,不会出现接缝,提升了显示效果,更能满足三维虚拟形象的显示需求,提高了三维虚拟形象的真实性,更能为用户带来身临其境的感受。
图5是本申请实施例提供的一种三维虚拟形象的显示装置的结构示意图。参见图5,该装置包括:
贴图获取模块501,用于执行上述实施例中的步骤301;
区域确定模块502,用于执行上述实施例中的步骤302;
设置模块503,用于执行上述实施例中的步骤303;
渲染模块504,用于执行上述实施例中的步骤305。
可选地,装置还包括:
图像获取模块,用于获取面部图像;
发送模块,用于向服务器发送三维虚拟形象生成请求。
可选地,区域确定模块502用于将处于第一模型下边缘的第一预设尺寸的区域及处于第二模型上边缘的第二预设尺寸的区域确定为目标区域。
可选地,设置模块,还用于执行上述实施例中的步骤304。
可选地,渲染模块504还用于执行上述步骤305中通过缓存进行渲染的过程。
上述所有可选技术方案,可以采用任意结合形成本公开的可选实施例,在此不再一一赘述。
需要说明的是:上述实施例提供的三维虚拟形象的显示装置在显示三维虚拟形象时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将终端的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的三维虚拟形象的显示装置与三维虚拟形象的显示方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。
图6是本申请实施例提供的一种终端的结构示意图。该终端可以用于实施上述实施例所示出的三维虚拟形象的显示方法中的终端所执行的功能。具体来讲:
终端600可以包括RF(Radio Frequency,射频)电路110、包括有一个或一个以上计算机可读存储介质的存储器120、输入单元130、显示单元140、传感器150、音频电路160、传输模块170、包括有一个或者一个以上处理核心的处理器180、以及电源190等部件。本领域技术人员可以理解,图6中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。其中:
RF电路110可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,交由一个或者一个以上处理器180处理;另外,将涉及上行的数据发送给基站。通常,RF电路110包括但不限于天线、至少一个放大器、调谐器、一个或多个振荡器、用户身份模块(SIM)卡、收发信机、耦合器、LNA(Low Noise Amplifier,低噪声放大器)、双工器等。此外,RF电路110还可以通过无线通信与网络和其他终端通信。所述无线通信可以使用任一通信标准或协议,包括但不限于GSM(Global System of Mobile communication,全球移动通讯系统)、GPRS(General Packet Radio Service,通用分组无线服务)、CDMA(Code Division Multiple Access,码分多址)、WCDMA(Wideband Code Division Multiple Access,宽带码分多址)、LTE(Long Term Evolution,长期演进)、电子邮件、SMS(Short Messaging Service,短消息服务)等。
存储器120可用于存储软件程序以及模块,如上述示例性实施例所示出的终端所对应的软件程序以及模块,处理器180通过运行存储在存储器120的软件程序以及模块,从而执行各种功能应用以及数据处理,如实现基于视频的交互等。存储器120可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据终端600的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器120可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地,存储器120还可以包括存储器控制器,以提供处理器180和输入单元130对存储器120的访问。
输入单元130可用于接收输入的数字或字符信息,以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。具体地,输入单元130可包括触敏表面131以及其他输入终端132。触敏表面131,也称为触摸显示屏或者触控板,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触敏表面131上或在触敏表面131附近的操作),并根据预先设定的程式驱动相应的链接装置。可选的,触敏表面131可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器180,并能接收处理器180发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及 表面声波等多种类型实现触敏表面131。除了触敏表面131,输入单元130还可以包括其他输入终端132。具体地,其他输入终端132可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元140可用于显示由用户输入的信息或提供给用户的信息以及终端600的各种图形用户接口,这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成。显示单元140可包括显示面板141,可选的,可以采用LCD(Liquid Crystal Display,液晶显示器)、OLED(Organic Light-Emitting Diode,有机发光二极管)等形式来配置显示面板141。进一步的,触敏表面131可覆盖显示面板141,当触敏表面131检测到在其上或附近的触摸操作后,传送给处理器180以确定触摸事件的类型,随后处理器180根据触摸事件的类型在显示面板141上提供相应的视觉输出。虽然在图6中,触敏表面131与显示面板141是作为两个独立的部件来实现输入和输入功能,但是在某些实施例中,可以将触敏表面131与显示面板141集成而实现输入和输出功能。
终端600还可包括至少一种传感器150,比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板141的亮度,接近传感器可在终端600移动到耳边时,关闭显示面板141和/或背光。作为运动传感器的一种,重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于终端600还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。
音频电路160、扬声器161,传声器162可提供用户与终端600之间的音频接口。音频电路160可将接收到的音频数据转换后的电信号,传输到扬声器161,由扬声器161转换为声音信号输出;另一方面,传声器162将收集的声音信号转换为电信号,由音频电路160接收后转换为音频数据,再将音频数据输出处理器180处理后,经RF电路110以发送给比如另一终端,或者将音频数据输出至存储器120以便进一步处理。音频电路160还可能包括耳塞插孔,以提供外设耳机与终端600的通信。
终端600通过传输模块170可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线或有线的宽带互联网访问。虽然图6示出了传输模块170,但是可以理解的是,其并不属于终端600的必须构成,完全可以根据需要在不改变申请的本质的范围内而省略。
处理器180是终端600的控制中心,利用各种接口和线路链接整个手机的各个部分,通过运行或执行存储在存储器120内的软件程序和/或模块,以及调用存储在存储器120内的数据,执行终端600的各种功能和处理数据,从而对手机进行整体监控。可选的,处理器180可包括一个或多个处理核心;优选的,处理器180可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器 主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器180中。
终端600还包括给各个部件供电的电源190(比如电池),优选的,电源可以通过电源管理系统与处理器180逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源190还可以包括一个或一个以上的直流或交流电源、再充电系统、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。
尽管未示出,终端600还可以包括摄像头、蓝牙模块等,在此不再赘述。具体在本实施例中,终端600的显示单元是触摸屏显示器,终端600还包括有存储器,以及一个或者一个以上的程序,其中一个或者一个以上程序存储于存储器中,且经配置以由一个或者一个以上处理器执行上述一个或者一个以上程序包含用于实施上述实施例中终端所执行操作的指令。
本申请实施例还提供了一种三维虚拟形象的显示装置,该装置包括处理器和存储器,存储器中存储有至少一条指令、至少一段程序、代码集或指令集,指令、程序、代码集或指令集由处理器加载并执行以实现上述实施例的三维虚拟形象的显示方法中所执行的操作。
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质中存储有至少一条指令、至少一段程序、代码集或指令集,该指令、该程序、该代码集或该指令集由处理器加载并执行以实现上述实施例的三维虚拟形象的显示方法中所执行的操作。
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。
以上所述仅为本申请的较佳实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。
Claims (12)
- 一种三维虚拟形象的显示方法,包括:终端获取三维虚拟形象的第一模型贴图和第二模型贴图,所述三维虚拟形象包括第一模型和第二模型,所述第一模型贴图包括所述第一模型中每个像素点的纹理数据,所述第二模型贴图包括所述第二模型中每个像素点的纹理数据;所述终端确定所述三维虚拟形象的目标区域,所述目标区域为所述第一模型与所述第二模型的衔接区域;所述终端将着色器中所述目标区域内每个像素点的光亮度设置为相等的数值,所述着色器用于设置所述三维虚拟形象中每个像素点的光照环境数据,所述光照环境数据至少包括光亮度;所述终端通过所述着色器对所述第一模型贴图和所述第二模型贴图进行渲染,以使渲染后所显示的所述目标区域的每个像素点的光亮度相等。
- 根据权利要求1所述的方法,其中,所述第一模型为头部模型,所述第二模型为躯干模型,所述获取三维虚拟形象的第一模型贴图和第二模型贴图之前,所述方法还包括:所述终端获取面部图像;所述终端向服务器发送三维虚拟形象生成请求,所述三维虚拟形象生成请求包括所述面部图像,所述服务器用于根据所述面部图像生成第一模型,并将所述第一模型与第二模型组合构成所述三维虚拟形象,返回所述三维虚拟形象的第一模型贴图和第二模型贴图。
- 根据权利要求1所述的方法,其中,所述终端确定所述三维虚拟形象的目标区域,包括:所述终端将处于所述第一模型下边缘的第一预设尺寸的区域及处于所述第二模型上边缘的第二预设尺寸的区域确定为所述目标区域。
- 根据权利要求1所述的方法,其中,所述终端通过所述着色器对所述第一模型贴图和所述第二模型贴图进行渲染之前,所述方法还包括:所述终端将所述第一模型贴图和所述第二模型贴图中位于所述目标区域内的像素点的纹理数据设置为相等的纹理数据,以使渲染后所显示的所述目标区域的每个像素点的纹理相同。
- 根据权利要求1-4任一项所述的方法,其中,所述终端通过所述着色器对所述第一模型贴图和所述第二模型贴图进行渲染,包括:所述终端将所述第一模型贴图、所述第二模型贴图以及所述着色器设置的光照环境数据组合构成材质,写入到缓存中;所述终端通过渲染器对所述缓存中的所述材质进行渲染。
- 一种三维虚拟形象的显示装置,包括:贴图获取模块,用于获取三维虚拟形象的第一模型贴图和第二模型贴图,所述三维虚拟形象包括第一模型和第二模型,所述第一模型贴图包括所述第一模型中每个像素点的纹 理数据,所述第二模型贴图包括所述第二模型中每个像素点的纹理数据;区域确定模块,用于确定所述三维虚拟形象的目标区域,所述目标区域为所述第一模型与所述第二模型的衔接区域;设置模块,用于将着色器中所述目标区域内每个像素点的光亮度设置为相等的数值,所述着色器用于设置所述三维虚拟形象中每个像素点的光照环境数据,所述光照环境数据至少包括光亮度;渲染模块,用于通过所述着色器对所述第一模型贴图和所述第二模型贴图进行渲染,以使渲染后所显示的所述目标区域的每个像素点的光亮度相等。
- 根据权利要求6所述的装置,其中,所述第一模型为头部模型,所述第二模型为躯干模型,所述装置还包括:图像获取模块,用于获取面部图像;发送模块,用于向服务器发送三维虚拟形象生成请求,所述三维虚拟形象生成请求包括所述面部图像,所述服务器用于根据所述面部图像生成第一模型,并将所述第一模型与第二模型组合构成所述三维虚拟形象,返回所述三维虚拟形象的第一模型贴图和第二模型贴图。
- 根据权利要求6所述的装置,其中,所述区域确定模块用于将处于所述第一模型下边缘的第一预设尺寸的区域及处于所述第二模型上边缘的第二预设尺寸的区域确定为所述目标区域。
- 根据权利要求6所述的装置,其中,所述设置模块,还用于将所述第一模型贴图和所述第二模型贴图中位于所述目标区域内的像素点的纹理数据设置为相等的纹理数据,以使渲染后所显示的所述目标区域的每个像素点的纹理相同。
- 根据权利要求6-9任一项所述的装置,其中,所述渲染模块还用于将所述第一模型贴图、所述第二模型贴图以及所述着色器设置的光照环境数据组合构成材质,写入到缓存中;通过渲染器对所述缓存中的所述材质进行渲染。
- 一种终端,包括处理器和存储介质,所述存储介质中存储有至少一条指令,所述指令由所述处理器加载并执行以实现如权利要求1至权利要求5任一项所述的三维虚拟形象的显示方法。
- 一种计算机可读存储介质,存储有至少一条指令,所述指令由处理器加载并执行以实现如权利要求1至权利要求5任一项所述的三维虚拟形象的显示方法。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/541,620 US10854017B2 (en) | 2017-08-17 | 2019-08-15 | Three-dimensional virtual image display method and apparatus, terminal, and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710706915.8 | 2017-08-17 | ||
| CN201710706915.8A CN109427083B (zh) | 2017-08-17 | 2017-08-17 | 三维虚拟形象的显示方法、装置、终端及存储介质 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US16/541,620 Continuation US10854017B2 (en) | 2017-08-17 | 2019-08-15 | Three-dimensional virtual image display method and apparatus, terminal, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019034142A1 true WO2019034142A1 (zh) | 2019-02-21 |
Family
ID=65362674
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2018/101028 Ceased WO2019034142A1 (zh) | 2017-08-17 | 2018-08-17 | 三维虚拟形象的显示方法、装置、终端及存储介质 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US10854017B2 (zh) |
| CN (1) | CN109427083B (zh) |
| WO (1) | WO2019034142A1 (zh) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110680353A (zh) * | 2019-09-17 | 2020-01-14 | 中国人民解放军总医院第四医学中心 | 一种股骨头完整率的分析装置及方法 |
| CN111340925A (zh) * | 2020-02-28 | 2020-06-26 | 福建数博讯信息科技有限公司 | 一种区域划分的渲染优化方法及终端 |
| CN111599005A (zh) * | 2020-05-19 | 2020-08-28 | 上海万面智能科技有限公司 | 一种三维模型植入方法、装置、电子设备及存储介质 |
| CN111862338A (zh) * | 2020-06-23 | 2020-10-30 | 深圳市新镜介网络有限公司 | 模拟眼镜佩戴图像的显示方法及装置 |
| CN113112580A (zh) * | 2021-04-20 | 2021-07-13 | 北京字跳网络技术有限公司 | 一种虚拟形象的生成方法、装置、设备及介质 |
| CN113450444A (zh) * | 2021-07-09 | 2021-09-28 | 网易(杭州)网络有限公司 | 生成光照贴图的方法、装置、存储介质及电子设备 |
| CN114022623A (zh) * | 2021-10-29 | 2022-02-08 | 武汉烽火信息集成技术有限公司 | 基于地图数据在Unity3D中绘制三维模型的方法及装置 |
| CN114218338A (zh) * | 2021-11-04 | 2022-03-22 | 广州三七极耀网络科技有限公司 | 地图层级信息文件生成方法、装置、设备和存储介质 |
Families Citing this family (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020055779A1 (en) * | 2018-09-10 | 2020-03-19 | Aveva Software, Llc | Integration of 3rd party geometry for visualization of large data sets system and method |
| CN110264393B (zh) * | 2019-05-15 | 2023-06-23 | 联想(上海)信息技术有限公司 | 一种信息处理方法、终端和存储介质 |
| CN112242004B (zh) * | 2019-07-16 | 2023-09-01 | 华中科技大学 | 一种基于光照渲染的ar场景的虚拟雕刻方法及系统 |
| CN112837427B (zh) * | 2019-11-25 | 2025-03-28 | 京东方科技集团股份有限公司 | 可变人体模型的处理方法、装置、系统及存储介质 |
| WO2021104300A1 (zh) | 2019-11-25 | 2021-06-03 | 京东方科技集团股份有限公司 | 健康管理系统以及用于其的人体信息显示方法和人体模型生成方法 |
| CN110971930B (zh) * | 2019-12-19 | 2023-03-10 | 广州酷狗计算机科技有限公司 | 虚拟形象直播的方法、装置、终端及存储介质 |
| CN111340943B (zh) * | 2020-02-26 | 2023-01-03 | 北京市商汤科技开发有限公司 | 图像处理方法、装置、设备及存储介质 |
| CN111445563B (zh) * | 2020-03-23 | 2023-03-10 | 腾讯科技(深圳)有限公司 | 一种图像生成的方法以及相关装置 |
| CN111681317B (zh) * | 2020-03-31 | 2023-03-17 | 腾讯科技(深圳)有限公司 | 数据处理方法、装置、电子设备及存储介质 |
| CN111696179A (zh) * | 2020-05-06 | 2020-09-22 | 广东康云科技有限公司 | 卡通三维模型和虚拟仿真人的生成方法、装置和存储介质 |
| CN111481936A (zh) * | 2020-05-18 | 2020-08-04 | 网易(杭州)网络有限公司 | 虚拟模型的生成方法、装置、存储介质和电子装置 |
| CN111862053B (zh) * | 2020-07-22 | 2023-11-28 | 上海米哈游天命科技有限公司 | 查找缝隙的方法、装置、设备及介质 |
| CN113971714B (zh) * | 2020-07-24 | 2024-12-03 | 北京达佳互联信息技术有限公司 | 目标物体图像渲染方法、装置、电子设备及存储介质 |
| CN111932664B (zh) | 2020-08-27 | 2023-06-23 | 腾讯科技(深圳)有限公司 | 图像渲染方法、装置、电子设备及存储介质 |
| CN112037338A (zh) * | 2020-08-31 | 2020-12-04 | 深圳传音控股股份有限公司 | Ar形象的创建方法、终端设备以及可读存储介质 |
| EP3970818A1 (en) * | 2020-09-18 | 2022-03-23 | XRSpace CO., LTD. | Method for adjusting skin tone of avatar and avatar skin tone adjusting system |
| CN114612641B (zh) * | 2020-12-07 | 2025-05-06 | 阿里巴巴集团控股有限公司 | 素材的迁移方法和装置、数据处理方法 |
| CN112439196B (zh) * | 2020-12-11 | 2021-11-23 | 完美世界(北京)软件科技发展有限公司 | 游戏灯光渲染方法、装置、设备和存储介质 |
| CN112634416B (zh) * | 2020-12-23 | 2023-07-28 | 北京达佳互联信息技术有限公司 | 虚拟形象模型的生成方法、装置、电子设备及存储介质 |
| CN112604294A (zh) * | 2020-12-29 | 2021-04-06 | 完美世界(北京)软件科技发展有限公司 | 贴图资源的渲染方法和装置、电子设备和存储介质 |
| CN114764840B (zh) * | 2020-12-31 | 2026-04-21 | 阿里巴巴达摩院(杭州)科技有限公司 | 图像渲染方法、装置、设备和存储介质 |
| CN114782240B (zh) * | 2021-01-06 | 2025-09-16 | 阿里巴巴集团控股有限公司 | 图片处理方法以及装置 |
| CN113032698A (zh) * | 2021-02-26 | 2021-06-25 | 深圳壹账通创配科技有限公司 | 3d图像展示方法、装置、计算机设备及可读存储介质 |
| CN114117604B (zh) * | 2021-11-24 | 2024-09-06 | 深圳须弥云图空间科技有限公司 | 数据处理方法、装置、电子设备和计算机可读存储介质 |
| CN114125304B (zh) * | 2021-11-30 | 2024-04-30 | 维沃移动通信有限公司 | 拍摄方法及其装置 |
| CN114387402B (zh) * | 2022-01-18 | 2025-07-22 | 北京有竹居网络技术有限公司 | 虚拟现实场景显示方法及装置、电子设备、可读存储介质 |
| CN117035894A (zh) * | 2022-04-29 | 2023-11-10 | 北京字跳网络技术有限公司 | 一种图像生成方法及装置 |
| CN115018966B (zh) * | 2022-06-24 | 2025-08-22 | 网易(杭州)网络有限公司 | 虚拟模型渲染方法、装置、电子设备及存储介质 |
| CN115147522B (zh) * | 2022-07-04 | 2025-10-28 | 网易(杭州)网络有限公司 | 一种模型渲染的方法和装置 |
| CN115272636A (zh) * | 2022-07-28 | 2022-11-01 | 北京优酷科技有限公司 | 数字藏品模型的生成方法、装置及电子设备 |
| CN116563475B (zh) * | 2023-07-07 | 2023-10-17 | 南通大学 | 一种图像数据处理方法 |
| CN120198564B (zh) * | 2025-05-26 | 2025-08-26 | 湖南快乐阳光互动娱乐传媒有限公司 | 一种vr渲染方法及相关装置 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101539804A (zh) * | 2009-03-11 | 2009-09-23 | 上海大学 | 基于增强虚拟现实与异型屏的实时人机互动方法及系统 |
| CN102117500A (zh) * | 2009-12-30 | 2011-07-06 | 新奥特(北京)视频技术有限公司 | 一种三维模型构建方法及系统 |
| CN103778538A (zh) * | 2012-10-17 | 2014-05-07 | 李兴斌 | 一种家具仿真布局方法和系统 |
| CN105957018A (zh) * | 2016-07-15 | 2016-09-21 | 武汉大学 | 一种无人机影像滤波分频拼接方法 |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1267860C (zh) * | 2003-01-23 | 2006-08-02 | 财团法人工业技术研究院 | 三维影像接合处的色彩处理方法 |
| AU2003238803A1 (en) * | 2003-05-30 | 2005-01-04 | Dreamworks | Shading computer-generated objects using generalized shading regions |
| CN101217511A (zh) * | 2008-01-03 | 2008-07-09 | 腾讯科技(深圳)有限公司 | 个人形象管理系统和管理方法 |
| US9305389B2 (en) * | 2008-02-28 | 2016-04-05 | Autodesk, Inc. | Reducing seam artifacts when applying a texture to a three-dimensional (3D) model |
| JP5303692B1 (ja) * | 2011-11-28 | 2013-10-02 | パナソニック株式会社 | 立体画像処理装置及び立体画像処理方法 |
| US20130170715A1 (en) * | 2012-01-03 | 2013-07-04 | Waymon B. Reed | Garment modeling simulation system and process |
| US9098922B2 (en) * | 2012-06-06 | 2015-08-04 | Apple Inc. | Adaptive image blending operations |
| US9314692B2 (en) * | 2012-09-21 | 2016-04-19 | Luxand, Inc. | Method of creating avatar from user submitted image |
| CN103324810A (zh) * | 2013-07-09 | 2013-09-25 | 贵州太和环境工程有限公司 | 个性装饰搭配系统 |
| JP6332281B2 (ja) * | 2013-12-17 | 2018-05-30 | ソニー株式会社 | 情報処理装置、情報処理方法およびプログラム |
| CN105320532B (zh) * | 2014-07-31 | 2020-04-21 | 腾讯科技(深圳)有限公司 | 显示交互界面的方法、装置及终端 |
| JP6654625B2 (ja) * | 2014-08-04 | 2020-02-26 | フェイスブック・テクノロジーズ・リミテッド・ライアビリティ・カンパニーFacebook Technologies, Llc | 仮想現実環境において遮られた顔部分を再構築する方法およびシステム |
| CN104252705B (zh) * | 2014-09-30 | 2017-05-17 | 中安消技术有限公司 | 一种图像拼接方法及装置 |
| CN104376160A (zh) * | 2014-11-07 | 2015-02-25 | 薛景 | 真人模拟个性装饰搭配系统 |
| CN104732585B (zh) * | 2015-03-23 | 2019-08-06 | 腾讯科技(深圳)有限公司 | 一种人体体型重构的方法及装置 |
| CN106204698A (zh) * | 2015-05-06 | 2016-12-07 | 北京蓝犀时空科技有限公司 | 为自由组合创作的虚拟形象生成及使用表情的方法和系统 |
| EP3408835A4 (en) * | 2016-01-27 | 2019-12-25 | Vats, Nitin | VIRTUAL TRYING ON CLOTHING ON A REALISTIC BODY MODEL OF A USER |
-
2017
- 2017-08-17 CN CN201710706915.8A patent/CN109427083B/zh active Active
-
2018
- 2018-08-17 WO PCT/CN2018/101028 patent/WO2019034142A1/zh not_active Ceased
-
2019
- 2019-08-15 US US16/541,620 patent/US10854017B2/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101539804A (zh) * | 2009-03-11 | 2009-09-23 | 上海大学 | 基于增强虚拟现实与异型屏的实时人机互动方法及系统 |
| CN102117500A (zh) * | 2009-12-30 | 2011-07-06 | 新奥特(北京)视频技术有限公司 | 一种三维模型构建方法及系统 |
| CN103778538A (zh) * | 2012-10-17 | 2014-05-07 | 李兴斌 | 一种家具仿真布局方法和系统 |
| CN105957018A (zh) * | 2016-07-15 | 2016-09-21 | 武汉大学 | 一种无人机影像滤波分频拼接方法 |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114947905A (zh) * | 2019-09-17 | 2022-08-30 | 中国人民解放军总医院第四医学中心 | 一种生成髋臼月状面结构模型的系统及方法 |
| CN110680353A (zh) * | 2019-09-17 | 2020-01-14 | 中国人民解放军总医院第四医学中心 | 一种股骨头完整率的分析装置及方法 |
| CN114947905B (zh) * | 2019-09-17 | 2025-07-25 | 中国人民解放军总医院第四医学中心 | 一种生成髋臼月状面结构模型的系统及方法 |
| CN111340925A (zh) * | 2020-02-28 | 2020-06-26 | 福建数博讯信息科技有限公司 | 一种区域划分的渲染优化方法及终端 |
| CN111340925B (zh) * | 2020-02-28 | 2023-02-28 | 福建数博讯信息科技有限公司 | 一种区域划分的渲染优化方法及终端 |
| CN111599005A (zh) * | 2020-05-19 | 2020-08-28 | 上海万面智能科技有限公司 | 一种三维模型植入方法、装置、电子设备及存储介质 |
| CN111599005B (zh) * | 2020-05-19 | 2024-01-05 | 湖南飞戈数字科技有限公司 | 一种三维模型植入方法、装置、电子设备及存储介质 |
| CN111862338A (zh) * | 2020-06-23 | 2020-10-30 | 深圳市新镜介网络有限公司 | 模拟眼镜佩戴图像的显示方法及装置 |
| US12002160B2 (en) | 2021-04-20 | 2024-06-04 | Beijing Zitiao Network Technology Co., Ltd. | Avatar generation method, apparatus and device, and medium |
| CN113112580A (zh) * | 2021-04-20 | 2021-07-13 | 北京字跳网络技术有限公司 | 一种虚拟形象的生成方法、装置、设备及介质 |
| CN113450444A (zh) * | 2021-07-09 | 2021-09-28 | 网易(杭州)网络有限公司 | 生成光照贴图的方法、装置、存储介质及电子设备 |
| CN114022623A (zh) * | 2021-10-29 | 2022-02-08 | 武汉烽火信息集成技术有限公司 | 基于地图数据在Unity3D中绘制三维模型的方法及装置 |
| CN114218338A (zh) * | 2021-11-04 | 2022-03-22 | 广州三七极耀网络科技有限公司 | 地图层级信息文件生成方法、装置、设备和存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109427083A (zh) | 2019-03-05 |
| US10854017B2 (en) | 2020-12-01 |
| US20190371082A1 (en) | 2019-12-05 |
| CN109427083B (zh) | 2022-02-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109427083B (zh) | 三维虚拟形象的显示方法、装置、终端及存储介质 | |
| JP7206388B2 (ja) | 仮想キャラクターの顔の表示方法、装置、コンピュータデバイス、およびコンピュータプログラム | |
| US11508087B2 (en) | Texture-based pose validation | |
| CN109389664B (zh) | 模型贴图渲染方法、装置及终端 | |
| US20250131584A1 (en) | Mirror-based augmented reality experience | |
| CN107247548B (zh) | 图像显示方法、图像处理方法及装置 | |
| US12353628B2 (en) | Virtual reality communication interface with haptic feedback response | |
| US12164689B2 (en) | Virtual reality communication interface with haptic feedback response | |
| WO2018171429A1 (zh) | 图像拼接方法、装置、终端及存储介质 | |
| WO2018153267A1 (zh) | 群组视频会话的方法及网络设备 | |
| US20220317774A1 (en) | Real-time communication interface with haptic and audio feedback response | |
| US20220206582A1 (en) | Media content items with haptic feedback augmentations | |
| CN108876878B (zh) | 头像生成方法及装置 | |
| WO2020233403A1 (zh) | 三维角色的个性化脸部显示方法、装置、设备及存储介质 | |
| WO2022212175A1 (en) | Interface with haptic and audio feedback response | |
| US20250272931A1 (en) | Dynamic augmented reality experience | |
| CN113409468A (zh) | 一种图像处理方法、装置、电子设备及存储介质 | |
| US12573100B2 (en) | User-defined contextual spaces | |
| US20220319125A1 (en) | User-aligned spatial volumes | |
| WO2019071562A1 (zh) | 一种数据处理方法及终端 | |
| US20250209703A1 (en) | Augmented reality experiences with dual cameras | |
| US20240248576A1 (en) | Virtual screens using wearable devices | |
| US12294688B2 (en) | Hardware encoder for stereo stitching | |
| US12372782B2 (en) | Automatic media capture using biometric sensor data | |
| CN114004922B (zh) | 骨骼动画显示方法、装置、设备、介质及计算机程序产品 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18846699 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18846699 Country of ref document: EP Kind code of ref document: A1 |