CN116310005A - Holographic cabinet, dynamic virtual image video processing method and image processing method - Google Patents

Holographic cabinet, dynamic virtual image video processing method and image processing method Download PDF

Info

Publication number
CN116310005A
CN116310005A CN202310333450.1A CN202310333450A CN116310005A CN 116310005 A CN116310005 A CN 116310005A CN 202310333450 A CN202310333450 A CN 202310333450A CN 116310005 A CN116310005 A CN 116310005A
Authority
CN
China
Prior art keywords
shadow
layer
image
video
dynamic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310333450.1A
Other languages
Chinese (zh)
Inventor
叶穗城
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Frontop Digital Creative Technology Co ltd
Original Assignee
Guangzhou Frontop Digital Creative Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Frontop Digital Creative Technology Co ltd filed Critical Guangzhou Frontop Digital Creative Technology Co ltd
Priority to CN202310333450.1A priority Critical patent/CN116310005A/en
Publication of CN116310005A publication Critical patent/CN116310005A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Holo Graphy (AREA)

Abstract

A processing method of a video with a shadow dynamic virtual image, a processing method of an image with a shadow dynamic virtual image and a holographic cabinet, wherein the processing method of the video with the shadow dynamic virtual image comprises the following steps: step (1), obtaining an initial video of an virtual dynamic image; step (2), generating a shadow corresponding to the dynamic gesture of the virtual dynamic image in the initial video in the step (1) through processing software, and obtaining a shadow video corresponding to the dynamic image; step (3), the shadow video of the step (2) and the initial video of the step (1); synchronously projecting to the holographic cabinet, and displaying the virtual dynamic image with the shadow on the holographic cabinet. The virtual dynamic image of the initial video is correspondingly added with the shadow in the display process, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.

Description

Holographic cabinet, dynamic virtual image video processing method and image processing method
Technical Field
The invention relates to the technical field of virtual person display, in particular to a processing method of a dynamic virtual image video with a shadow, a processing method of a dynamic virtual image with a shadow and a holographic cabinet.
Background
With the continuous development of the internet, AI technology, animation production and other technologies, the traditional way of introducing, displaying and other scenes by using a real person is gradually completed through the virtual image. The avatar may be a dummy, a virtual animal, a virtual cartoon character, etc. The virtual characters are used for carrying out related introduction on scenes such as a museum, a gymnasium and a science and technology museum, and the defects of physical strength, invalid waiting and the like of a real person can be overcome. With the development of science and technology, the virtual image replaces a real person to finish services such as display and introduction, has the advantages of reality, flexibility and the like, and can also save human resources. The application scene can be expanded, such as remote virtual venue introduction and the like by means of a network, and virtual scene nesting display and the like.
The avatar in the prior art is usually displayed by being in a holographic cabinet. The holographic cabinet is a principle of generating virtual images by utilizing optical holographic technology, and particularly utilizes an oriented semitransparent display screen to display the optical holographic virtual images on the surface so as to form a three-dimensional image. At present, the expression image and the action state of the virtual person displayed by the holographic cabinet can be highly simulated to be the form of the person. However, the avatar in the prior art does not embody a shadow effect of the character under the light, the displayed avatar does not have a shadow effect, and the overall avatar effect is not ideal.
Therefore, in order to solve the defects in the prior art, it is necessary to provide a processing method of a video with a shadow dynamic avatar, a processing method of an image with a shadow dynamic avatar, and a holographic cabinet.
Disclosure of Invention
The first object of the present invention is to provide a method for processing a dynamic virtual video with shadow, which avoids the disadvantages of the prior art. According to the processing method of the virtual image video with the shadow, the shadow is correspondingly added in the display process of the virtual dynamic image, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
The above object of the present invention is achieved by the following technical measures:
the processing method for the dynamic virtual image video with the shadow comprises the following steps:
step (1), obtaining an initial video of an virtual dynamic image;
step (2), generating a shadow corresponding to the dynamic gesture of the virtual dynamic image in the initial video in the step (1) through processing software, and obtaining a shadow video corresponding to the dynamic image;
step (3), the shadow video of the step (2) and the initial video of the step (1); synchronously projecting to the holographic cabinet, and displaying the virtual dynamic image with the shadow on the holographic cabinet.
Preferably, the step (2) includes the steps of:
step (2.1), importing the initial video in the step (1) into processing software, copying the virtual dynamic image into Shadow, and adding an effect DROP Shadow to obtain a Shadow layer;
step (2.2), newly creating a white solid layer, adding a shadow upper body in the shadow layer in the step (2.1) according to holographic cabinet measurement data, enabling the white solid layer to be arranged on a first layer, enabling the shadow layer to be arranged on a second layer, and then setting transparency and a layer channel of a shadow layer;
step (2.3), copying the white solid layer and the shadow to enable the white solid layer to be arranged on the first layer and the shadow to be arranged on the second layer, and then setting transparency and layer channels of the shadow layer;
step (2.4), newly building an Adjustment Layer, and then adjusting the effect;
step (2.5), copying the Adjustment Layer, and then adjusting Fast Radius, registration and blurry dimension blurring directions;
step (2.6), the Adjustment Layer is duplicated for the second time, and then the Fast Radius, the projects and the blue dimension fuzzy directions of the Fast Radius are adjusted;
and (2.7) pre-synthesizing the shadow Layer and all Adjustment Layer layers into an integral Layer shadow, adding the Bezier Warp Bezier bending effect, and generating a shadow video corresponding to the virtual dynamic image in the initial video in the step (1).
Preferably, the processing software is an After Effect software.
Preferably, the initial video is an initial video with a transparent channel.
Preferably, the measurement data of the holographic cabinet is the depth corner position of the holographic cabinet matching box.
Preferably, in the step (3), the shadow video in the step (2) and the initial video in the step (1) are combined into a whole video, and projected to the holographic cabinet.
Preferably, in the step (3), the shadow position in the shadow video of the step (2) is adjusted in real time by using a KINECT apparatus to correspond to the observer position, and the initial video of the step (1) is synchronously projected to the holographic cabinet.
Preferably, the step (3) specifically includes the following steps:
step (3.1), the KINECT equipment acquires and identifies the relative positions of the single observer and the holographic cabinet in real time, and then sets the tracking coordinate point of the observer as S 0 (X 0 ,Y 0 )；
Step (3.2), setting the shadow in the current shadow video as a skeleton, wherein the skeleton comprises 3 nodes, and an overhead node A 1 Shadow dog-ear node B 1 And foot connection node C 1 Obtaining the overhead node A 1 Node B with shadow dog-ear 1 Connecting line A between 1 B 1 Is the midpoint S of (1) 1 (X 1 ,Y 1 )；
Step (3.3), when S 0 (X 0 ,Y 0 ) When the position changes, the current S is real-time 0 (X 0 ,Y 0 ) Subtracting S in step (3.2) from the coordinates of (C) 1 (X 1 ,Y 1 ) Is the coordinate of the deformation point S 2 (X 2 ,Y 2 ) Then at the deformation point S 2 (X 2 ,Y 2 ) As S after deformation 2 (X 2 ,Y 2 ) The middle point of the connection between the vertex and the shadow inflection point, keeping the distance between the vertex and the shadow inflection point unchanged and keeping the coordinate of the point C unchanged, and obtaining a deformed shadow, wherein three skeleton nodes of the deformed shadow are the vertex node A 2 Shadow dog-ear node B 2 And a foot connection node C;
and (3.4) modifying the shadow video according to the deformed shadow obtained in the step (3.3), and synchronously projecting the modified shadow video and the initial video in the step (1) to the holographic cabinet respectively.
The processing method of the dynamic virtual image video with the shadow comprises the following steps: step (1), obtaining an initial video of an virtual dynamic image; step (2), generating a shadow corresponding to the dynamic gesture of the virtual dynamic image in the initial video in the step (1) through processing software, and obtaining a shadow video corresponding to the dynamic image; step (3), the shadow video of the step (2) and the initial video of the step (1); synchronously projecting to the holographic cabinet, and displaying the virtual dynamic image with the shadow on the holographic cabinet. The virtual dynamic image of the initial video is correspondingly added with the shadow in the display process, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
The second object of the present invention is to provide a method for processing a dynamic avatar image with shadow, which avoids the disadvantages of the prior art. The processing method of the virtual image with the shadow dynamic image can generate the shadow corresponding to the virtual image for the image frame of the initial video of the virtual dynamic image, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
The above object of the present invention is achieved by the following technical measures:
the processing method for the dynamic virtual image with the shadow comprises the following steps:
selecting at least one frame of image in the initial video with the virtual dynamic image, defining the image as a reference image, and importing the reference image into Photoshop software;
and (B) shifting the shadow in the reference image according to the light source angle, then adjusting the division ratio of the shadow upper body and the shadow lower body in the reference image according to the holographic cabinet measurement data, processing the shadow upper body according to the light source angle, and finally merging the processed shadow upper body and the shadow lower body to obtain the shadow dynamic virtual image.
Preferably, the step (b.1) specifically includes the following steps:
step (b.1.1), selecting at least one frame of image in the initial video of step (a), defining the image as a reference image, and importing the reference image into processing software;
step (B.1.2), shifting the shadow in the reference image according to the angle of the light source, then adjusting the dividing ratio of the shadow upper half body and the shadow lower half body in the reference image according to the measured data of the holographic cabinet, processing the shadow upper half body according to the angle of the light source, and finally merging the processed shadow upper half body and the shadow lower half body to obtain a dynamic virtual image with the shadow;
preferably, the measurement data of the holographic cabinet is the depth corner position of the holographic cabinet matching box.
Preferably, the initial video is an initial video with a transparent channel.
Preferably, the above
The step (B.2) specifically comprises the following steps:
step (B.2.1), defining the reference image in the step (B.1) as a layer 1, copying the layer 1 to obtain a layer 2, and setting the gray level of the layer 2 to obtain a shadow in the reference image;
step (B.2.2), shifting the layer 2 according to the angle of the light source;
step (B.2.3), dividing the image layer 2 into an upper part and a lower part according to the measurement data of the holographic cabinet to obtain an image layer 3 containing a shadow upper half body and an image layer 4 containing a shadow lower half body;
step (b.2.4), connecting the foot position in the shadow lower body of the layer 4 with the foot of the layer 1, and tilting the foot position of the layer 4 by a tilting tool;
step (B.2.5), connecting the edge position of the shadow upper half body of the layer 3 with the edge position of the shadow lower half body of the layer 4 to form and combine into a layer 5;
step (B.2.6), stretching and retracting the layer 5 according to the angle of the light source;
step (b.2.7), adjusting the transparency of the layer 5;
step (b.2.8), blurring the layer 5.
In the step (b.2.1), the gray scale processing method of the layer 2 specifically selects the color superposition in the mixing option, and then sets the values of the R channel, the G channel and the B channel of the gray scale layer to 120 to 140, respectively.
In the step (B.2.8), blurring of the layer 5 is performed by blurring means in the filter option and selecting an angle in the dynamic blurring of 25 DEG to 30 deg.
In the step (b.2.7), the transparency of the layer 5 is adjusted to 60% to 70%.
The invention relates to a processing method of a dynamic virtual image video with a shadow, which comprises the following steps: selecting at least one frame of image in the initial video with the virtual dynamic image, defining the image as a reference image, and importing the reference image into Photoshop software; and (B) shifting the shadow in the reference image according to the light source angle, then adjusting the division ratio of the shadow upper body and the shadow lower body in the reference image according to the holographic cabinet measurement data, processing the shadow upper body according to the light source angle, and finally merging the processed shadow upper body and the shadow lower body to obtain the shadow dynamic virtual image. According to the method, at least one frame of image in the initial video of the virtual dynamic image is collected, then the shadow is added to the image, so that the virtual dynamic image is more truly displayed, and the 3D effect is more truly achieved when the virtual dynamic image is watched by naked eyes.
A third object of the present invention is to provide a method for processing a dynamic avatar image with shadow, which avoids the disadvantages of the prior art. The processing method of the virtual image with the shadow dynamic image can generate the shadow corresponding to the virtual image for the image frame of the initial video of the virtual dynamic image, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
The above object of the present invention is achieved by the following technical measures:
a holographic cabinet is provided, and the processing method of the dynamic virtual image video with the shadow is adopted.
The holographic cabinet adopts the processing method of the dynamic virtual image video with the shadow. The holographic cabinet increases the shadow corresponding to the dynamic gesture of the virtual dynamic image when the dynamic virtual image video is played, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
Drawings
The invention is further illustrated by the accompanying drawings, which are not to be construed as limiting the invention in any way.
Fig. 1 is a diagram showing the result of displaying an avatar in a holographic cabinet, which is obtained by a processing method of a video with a shadow avatar.
FIG. 2 is a schematic diagram of step (2.1) in example 2.
FIG. 3 is a schematic diagram of step (2.2) in example 2.
FIG. 4 is a schematic diagram of step (2.3) in example 2.
FIG. 5 is a schematic diagram of step (2.6) in example 2.
Fig. 6 is a diagram of an avatar video screenshot after adding a shadow in accordance with embodiment 2.
Fig. 7 is a schematic view of a shadow before deformation in example 3.
FIG. 8 is a schematic view of the deformed shadow in example 3.
Fig. 9 is a schematic diagram of layer 1 and layer 2 in example 5.
Fig. 10 is a schematic diagram of layer 3 and layer 4 in example 5.
Fig. 11 is a schematic diagram of layer 5 in example 5.
Fig. 12 is a schematic view of a shadow dynamic avatar image in embodiment 5.
Fig. 13 is a graph of the avatar achievement obtained by the processing method of embodiment 5.
Detailed Description
The technical scheme of the invention is further described with reference to the following examples.
Example 1
A processing method of a dynamic virtual image video with a shadow comprises the following steps:
step (1), obtaining an initial video of an virtual dynamic image;
step (2), generating a shadow corresponding to the dynamic gesture of the virtual dynamic image in the initial video in the step (1) through processing software, and obtaining a shadow video corresponding to the dynamic image;
step (3), the shadow video of the step (2) and the initial video of the step (1); synchronously projecting to the holographic cabinet, and displaying the virtual dynamic image with the shadow on the holographic cabinet.
Wherein, the step (2) comprises the following steps:
step (2.1), importing the initial video in the step (1) into processing software, copying the virtual dynamic image into Shadow, and adding an effect DROP Shadow to obtain a Shadow layer;
step (2.2), newly creating a white solid layer, namely adding the upper half of a shadow in the shadow layer in the step (2.1) according to holographic cabinet measurement data, enabling the white solid layer to be arranged on a first layer, enabling the shadow layer to be arranged on a second layer, setting transparency of a shadow layer and a layer channel, wherein the transparency of the shadow layer is 40%, and enabling the layer channel to be Alpha;
step (2.3), copying the white solid layer and the shadow to enable the white solid layer to be arranged on the first layer and the shadow to be arranged on the second layer, and then setting transparency and layer channels of the shadow layer;
step (2.4), newly creating an Adjustment Layer, then adjusting the effect, and specifically adding the effect Fast Box blue Fast frame blurring in the embodiment;
step (2.5), copying the Adjustment Layer, and then adjusting Fast Radius, registration and blurry dimension blurring directions;
step (2.6), the Adjustment Layer is duplicated for the second time, and then the Fast Radius, the projects and the blue dimension fuzzy directions of the Fast Radius are adjusted;
and (2.7) pre-synthesizing the shadow Layer and all Adjustment Layer layers into an integral Layer shadow, adding the Bezier Warp Bezier bending effect, and generating a shadow video corresponding to the virtual dynamic image in the initial video in the step (1).
The initial video of the invention is an initial video with a transparent channel. The processing software is the After Effect software; the holographic cabinet measurement data is the depth corner position of the holographic cabinet matching box.
And (3) combining the shadow video of the step (2) and the initial video of the step (1) into an integral video, and projecting the integral video to the holographic cabinet.
According to the processing method of the dynamic virtual image video with the shadow, the shadow is correspondingly added in the display of the virtual dynamic image in the initial video, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
Example 2
The processing method of the dynamic virtual image video with shadow is the same as the embodiment 1, except that:
the Shadow Color of step (2.1) of this embodiment is black, the transparency is adjusted to 50%, the Direction angle is 240 °, the Distance is 273, the softness is 50, and the Shadow Only is hooked, as shown in fig. 2;
step (2.2) is to shade the transparency of the layer to 40%, and the layer channel is Alpha as shown in figure 3;
step (2.3) is specifically to shade the transparency of the layer to 80%, wherein the layer channel is Ain as shown in FIG. 4;
step (2.4) of Fast Box blue Fast block blurring with specific adding effect, wherein Fast Radius is 64, the fuzzy direction is horizontal with the method of Itemerations being 3,Blur Dimensions;
step (2.5) the specific Fast Radius is 64, the fuzzy direction is 3,Blur Dimensions, and the fuzzy direction is horizontal;
step (2.6) the Fast Radius of the Fast Radius is 40, the fuzzy direction of the Itemation gs is 3,Blur Dimensions, and the fuzzy direction is Horlzontal and Vertlcal horizontal and vertical, as shown in FIG. 5;
step (2.6) Bessel bending parameters are as follows:
Figure BDA0004155610490000111
Figure BDA0004155610490000121
after the series of settings, the virtual dynamic image video screenshot with the added shadow is finally obtained, as shown in fig. 6.
According to the embodiment, through the parameter setting, the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
Example 3
As shown in fig. 1, other features are the same as those of embodiment 1, except that: and (3) specifically, adjusting the shadow position in the shadow video of the step (2) to correspond to the observer position in real time through a KINECT device, and synchronously projecting the virtual dynamic image video of the step (1) to the holographic cabinet.
The specific step (3) comprises the following steps:
step (3.1), the KINECT equipment acquires and identifies the relative positions of the single observer and the holographic cabinet in real time, and then sets the tracking coordinate point of the observer as S 0 (X 0 ,Y 0 ) Wherein X is 0 ,Y 0 A variable for the head of the observer to move in front of the holographic cabinet screen;
step (3.2), setting the shadow in the current shadow video as a skeleton, wherein the skeleton comprises 3 nodes, and an overhead node A 1 Shadow dog-ear node B 1 And foot connection node C 1 Obtaining the overhead node A 1 Node B with shadow dog-ear 1 Connecting line A between 1 B 1 Is the midpoint S of (1) 1 (X 1 ,Y 1 ) As in fig. 7;
step (3.3), when S 0 (X 0 ,Y 0 ) When the position changes, the current S is real-time 0 (X 0 ,Y 0 ) Subtracting S in step (3.2) from the coordinates of (C) 1 (X 1 ,Y 1 ) Is obtained by coordinates of (a)Deformation point S 2 (X 2 ,Y 2 ) Then at the deformation point S 2 (X 2 ,Y 2 ) As S after deformation 2 (X 2 ,Y 2 ) The middle point of the connection between the vertex and the shadow inflection point, keeping the distance between the vertex and the shadow inflection point unchanged and keeping the coordinate of the point C unchanged, and obtaining a deformed shadow, wherein three skeleton nodes of the deformed shadow are the vertex node A 2 Shadow dog-ear node B 2 And a foot connection node C, as shown in fig. 8;
and (3.4) modifying the shadow video according to the deformed shadow obtained in the step (3.3), and synchronously projecting the modified shadow video and the initial video in the step (1) to the holographic cabinet respectively.
It should be noted that, when the head coordinate of the observer moves leftwards, then the shadow in the current shadow video moves rightwards relative to the center of the dynamic object; when the observer's head coordinates move to the right, then the shadow in the current shadow video moves to the left relative to the center of the dynamic object. When the head coordinates of the observer move downwards, then the shadow in the current shadow video is relatively stretched; when the head coordinates of the viewer move upward, then the shadows in the current shadow video are relatively compressed.
Compared with embodiment 1, the shadows in the shadow video of the present embodiment can be shifted according to the position of the observer, thereby further increasing the naked eye 3D effect.
Example 4
A holographic cabinet employing the method of any one of embodiments 1 to 3 for processing a video with a shadow dynamic avatar.
The holographic cabinet adds the shadow correspondingly in the display of the virtual dynamic image in the initial video, so that the virtual dynamic image is displayed more truly, and the 3D effect is more realistic when the virtual dynamic image is watched by naked eyes.
Example 5
The processing method of the shadow dynamic virtual image can be applied to the virtual dynamic virtual image video of the holographic cabinet to generate a shadow video corresponding to the virtual dynamic virtual image.
Specifically, in the processing method of the shadow dynamic avatar video in embodiment 1, the shadow is directly adjusted according to parameters such as offset angle, inclination angle, transparency, etc. of the shadow dynamic avatar image after the evaluation and presentation effect of the shadow dynamic avatar image is obtained in advance. The processing method of the embodiment can also be adopted for all frame images in the virtual dynamic image video, and corresponding shadow dynamic virtual image images are generated corresponding to each frame image, so that the final output video is obtained.
The processing method of the dynamic virtual image with the shadow comprises the following steps:
selecting at least one frame of image in the initial video with the virtual dynamic image, defining the image as a reference image, and importing the reference image into Photoshop software;
and (B) shifting the shadow in the reference image according to the light source angle, adjusting the division ratio of the shadow upper body and the shadow lower body in the reference image according to the holographic cabinet measurement data, processing the shadow upper body according to the light source angle, and merging the finally processed shadow upper body and the shadow lower body to obtain the shadow-carrying dynamic virtual image, as shown in fig. 13.
The holographic cabinet measurement data of the invention is the depth corner position of the holographic cabinet matching box, and it is required to be noted that in practical situations, according to the depth of the general holographic cabinet matching box, the division ratio of the general shadow upper half body to the general shadow lower half body is 7:1. the initial video is an initial video with a transparent channel.
The step (B) of the invention specifically comprises the following steps:
step (b.1), selecting at least one frame of image in the initial video of step (a), defining the image as a reference image, and importing the reference image into processing software, as shown in fig. 9;
and (B.2) offsetting the shadow in the reference image according to the angle of the light source, adjusting the dividing ratio of the shadow upper half body and the shadow lower half body in the reference image according to the measured data of the holographic cabinet, processing the shadow upper half body according to the angle of the light source, and merging the processed shadow upper half body and the shadow lower half body to obtain the dynamic virtual image with the shadow.
Wherein, the step (B.2) specifically comprises the following steps:
step (B.2.1), defining the reference image in step (B.1) as a layer 1, copying the layer 1 to obtain a layer 2, and setting the gray level of the layer 2 to obtain a shadow in the reference image, as shown in FIG. 10;
step (B.2.2), shifting the layer 2 according to the angle of the light source, and specifically shifting a half body position in the embodiment;
step (B.2.3), dividing the image layer 2 into an upper part and a lower part according to the measurement data of the holographic cabinet to obtain an image layer 3 containing a shadow upper half body and an image layer 4 containing a shadow lower half body, as shown in figure 11;
step (b.2.4), connecting the foot position in the shadow lower body of the layer 4 with the foot of the layer 1, and tilting the foot position of the layer 4 by a tilting tool;
step (B.2.5), connecting the edge position of the shadow upper half body of the layer 3 with the edge position of the shadow lower half body of the layer 4 to form and combine into a layer 5;
step (B.2.6), performing stretching treatment on the layer 5 according to the angle of the light source, wherein the deviation is specifically 45 degrees in the embodiment;
step (b.2.7), adjusting the transparency of the layer 5;
step (b.2.8), blurring the layer 5, as shown in fig. 12.
In the step (B.2.1), the gray scale processing method of the layer 2 specifically selects color superposition in the mixing option, and then sets the values of the R channel, the G channel and the B channel of the gray scale layer to 120-140 respectively. Note that the values of the R channel, the G channel, and the B channel in this embodiment are all set to 130.
In the step (B.2.8), blurring of the layer 5 is performed by a blurring tool in a filter option and selecting an angle in dynamic blurring of 25-30 degrees. The angle of this embodiment is 27 °.
In the step (B.2.7), the transparency of the layer 5 is adjusted to 60-70%. It should be noted that, in this embodiment, the transparency of the layer 5 is adjusted to 65%.
The processing method of the shadow-carrying dynamic virtual image can obtain the shadow-carrying dynamic virtual image with the corresponding added shadow, and the shadow-carrying dynamic virtual image can be applied to the virtual dynamic image video of the holographic cabinet to generate the shadow video corresponding to the virtual dynamic image.
Finally, it should be noted that the above embodiments are only for illustrating the technical solution of the present invention and not for limiting the scope of the present invention, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present invention may be modified or substituted equally without departing from the spirit and scope of the technical solution of the present invention.

Claims (10)

1. A processing method of a dynamic virtual image video with a shadow is characterized by comprising the following steps:
step (1), obtaining an initial video of an virtual dynamic image;
step (2), generating a shadow corresponding to the dynamic gesture of the virtual dynamic image in the initial video in the step (1) through processing software, and obtaining a shadow video corresponding to the dynamic image;
step (3), the shadow video of the step (2) and the initial video of the step (1); synchronously projecting to the holographic cabinet, and displaying the virtual dynamic image with the shadow on the holographic cabinet.
2. The method for processing the shadow dynamic avatar video according to claim 1, wherein the step (2) comprises the steps of:
step (2.1), importing the initial video in the step (1) into processing software, copying the virtual dynamic image into Shadow, and adding an effect DROP Shadow to obtain a Shadow layer;
step (2.2), newly creating a white solid layer, adding a shadow upper body in the shadow layer in the step (2.1) according to holographic cabinet measurement data, enabling the white solid layer to be arranged on a first layer, enabling the shadow layer to be arranged on a second layer, and then setting transparency and a layer channel of a shadow layer;
step (2.3), copying the white solid layer and the shadow to enable the white solid layer to be arranged on the first layer and the shadow to be arranged on the second layer, and then setting transparency and layer channels of the shadow layer;
step (2.4), newly building an Adjustment Layer, and then adjusting the effect;
step (2.5), copying the Adjustment Layer, and then adjusting Fast Radius, registration and blurry dimension blurring directions;
step (2.6), the Adjustment Layer is duplicated for the second time, and then the Fast Radius, the projects and the blue dimension fuzzy directions of the Fast Radius are adjusted;
and (2.7) pre-synthesizing the shadow Layer and all Adjustment Layer layers into an integral Layer shadow, adding the Bezier Warp Bezier bending effect, and generating a shadow video corresponding to the virtual dynamic image in the initial video in the step (1).
3. The method for processing a shadow dynamic avatar video according to claim 2, wherein the processing software is an After Effect software;
the initial video is an initial video with a transparent channel;
the holographic cabinet measurement data are depth corner positions of the holographic cabinet matching box.
4. A method for processing a shadow dynamic avatar video according to any one of claims 1 to 3, wherein: the step (3) is specifically to combine the shadow video of the step (2) and the initial video of the step (1) into an integral video, and project the integral video to the holographic cabinet.
5. A method for processing a shadow dynamic avatar video according to any one of claims 1 to 3, wherein: the step (3) is specifically to adjust the shadow positions in the shadow video of the step (2) in real time through a KINECT device to correspond to the positions of observers, and synchronously project the initial video of the step (1) to the holographic cabinet.
6. The method for processing the shadow dynamic avatar video of claim 5, wherein the step (3) comprises the steps of:
step (3.1), the KINECT equipment acquires and identifies the relative positions of the single observer and the holographic cabinet in real time, and then sets the tracking coordinate point of the observer as S 0 (X 0 ,Y 0 )；
Step (3.2), setting the shadow in the current shadow video as a skeleton, wherein the skeleton comprises 3 nodes, and an overhead node A 1 Shadow dog-ear node B 1 And foot connection node C 1 Obtaining the overhead node A 1 Node B with shadow dog-ear 1 Connecting line A between 1 B 1 Is the midpoint S of (1) 1 (X 1 ,Y 1 )；
Step (3.3), when S 0 (X 0 ,Y 0 ) When the position changes, the current S is real-time 0 (X 0 ,Y 0 ) Subtracting S in step (3.2) from the coordinates of (C) 1 (X 1 ,Y 1 ) Is the coordinate of the deformation point S 2 (X 2 ,Y 2 ) Then at the deformation point S 2 (X 2 ,Y 2 ) As S after deformation 2 (X 2 ,Y 2 ) The middle point of the connection between the vertex and the shadow inflection point, keeping the distance between the vertex and the shadow inflection point unchanged and keeping the coordinate of the point C unchanged, and obtaining a deformed shadow, wherein three skeleton nodes of the deformed shadow are the vertex node A 2 Shadow dog-ear node B 2 And a foot connection node C;
and (3.4) modifying the shadow video according to the deformed shadow obtained in the step (3.3), and synchronously projecting the modified shadow video and the initial video in the step (1) to the holographic cabinet respectively.
7. A processing method of a dynamic virtual image with a shadow is characterized in that: the method comprises the following steps:
selecting at least one frame of image in the initial video with the virtual dynamic image, defining the image as a reference image, and importing the reference image into Photoshop software;
and (B) shifting the shadow in the reference image according to the light source angle, then adjusting the division ratio of the shadow upper body and the shadow lower body in the reference image according to the holographic cabinet measurement data, processing the shadow upper body according to the light source angle, and finally merging the processed shadow upper body and the shadow lower body to obtain the shadow dynamic virtual image.
8. The method for processing the shadow dynamic avatar image as set forth in claim 7, wherein the step (B) comprises the steps of:
step (B.1), selecting at least one frame of image in the initial video of the step (A), defining the image as a reference image, and importing the reference image into processing software;
step (B.2), shifting the shadow in the reference image according to the angle of the light source, then adjusting the dividing ratio of the upper half body and the lower half body of the shadow in the reference image according to the measured data of the holographic cabinet, processing the upper half body of the shadow according to the angle of the light source, and finally merging the upper half body of the shadow and the lower half body of the shadow to obtain a dynamic virtual image with the shadow;
the holographic cabinet measurement data are depth corner positions of the holographic cabinet matching box;
the initial video is an initial video with a transparent channel.
9. The method for processing the shadow dynamic avatar video of claim 8, wherein the step (b.2) comprises the steps of:
step (B.2.1), defining the reference image in the step (B.1) as a layer 1, copying the layer 1 to obtain a layer 2, and setting the gray level of the layer 2 to obtain a shadow in the reference image;
step (B.2.2), shifting the layer 2 according to the angle of the light source;
step (B.2.3), dividing the image layer 2 into an upper part and a lower part according to the measurement data of the holographic cabinet to obtain an image layer 3 containing a shadow upper half body and an image layer 4 containing a shadow lower half body;
step (b.2.4), connecting the foot position in the shadow lower body of the layer 4 with the foot of the layer 1, and tilting the foot position of the layer 4 by a tilting tool;
step (B.2.5), connecting the edge position of the shadow upper half body of the layer 3 with the edge position of the shadow lower half body of the layer 4 to form and combine into a layer 5;
step (B.2.6), stretching and retracting the layer 5 according to the angle of the light source;
step (b.2.7), adjusting the transparency of the layer 5;
step (B.2.8), blurring the layer 5;
in the step (B.2.1), the gray level processing method of the layer 2 specifically comprises the steps of selecting color superposition in a mixing option, and then setting the values of an R channel, a G channel and a B channel of a gray layer to 120-140 respectively;
in the step (B.2.8), blurring the layer 5 by a blurring tool in a filter option and selecting an angle in dynamic blurring of 25-30 degrees;
in the step (b.2.7), the transparency of the layer 5 is adjusted to 60% to 70%.
10. A holographic cabinet, characterized in that: a method of processing a shadow dynamic avatar video according to any one of claims 1-6.
CN202310333450.1A 2023-03-31 2023-03-31 Holographic cabinet, dynamic virtual image video processing method and image processing method Pending CN116310005A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310333450.1A CN116310005A (en) 2023-03-31 2023-03-31 Holographic cabinet, dynamic virtual image video processing method and image processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310333450.1A CN116310005A (en) 2023-03-31 2023-03-31 Holographic cabinet, dynamic virtual image video processing method and image processing method

Publications (1)

Publication Number Publication Date
CN116310005A true CN116310005A (en) 2023-06-23

Family

ID=86815024

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310333450.1A Pending CN116310005A (en) 2023-03-31 2023-03-31 Holographic cabinet, dynamic virtual image video processing method and image processing method

Country Status (1)

Country Link
CN (1) CN116310005A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116824029A (en) * 2023-07-13 2023-09-29 北京弘视科技有限公司 Method, device, electronic equipment and storage medium for generating holographic shadow

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116824029A (en) * 2023-07-13 2023-09-29 北京弘视科技有限公司 Method, device, electronic equipment and storage medium for generating holographic shadow
CN116824029B (en) * 2023-07-13 2024-03-08 北京弘视科技有限公司 Method, device, electronic equipment and storage medium for generating holographic shadow

Similar Documents

Publication Publication Date Title
Agrawala et al. Artistic multiprojection rendering
JP7395577B2 (en) Motion smoothing of reprojected frames
US7131733B2 (en) Method for creating brightness filter and virtual space creation system
CN109410298B (en) Virtual model manufacturing method and expression changing method
US6462769B1 (en) Image correction method to compensate for point of view image distortion
CN106412556B (en) A kind of image generating method and device
US8094148B2 (en) Texture processing apparatus, method and program
CN101968892A (en) Method for automatically adjusting three-dimensional face model according to one face picture
JP2014063470A (en) Depth estimation device, depth estimation method, depth estimation program, image processing device, image processing method, and image processing program
CN105678724A (en) Background replacing method and apparatus for images
CN111292389B (en) Image processing method and device
CN114049464B (en) Reconstruction method and device of three-dimensional model
CN104217461B (en) A parallax mapping method based on a depth map to simulate a real-time bump effect
CN103533318A (en) Building outer surface projection method
JP2018505580A (en) 3D image display method and head mounted device
US11941729B2 (en) Image processing apparatus, method for controlling image processing apparatus, and storage medium
CN116310005A (en) Holographic cabinet, dynamic virtual image video processing method and image processing method
CN111405264B (en) 3D video comfort level improving method based on depth adjustment
CN115841539A (en) Three-dimensional light field generation method and device based on visual shell
JPH11328443A (en) System and method for generating three-dimensional panorama image and recording media therefor
Seitner et al. Trifocal system for high-quality inter-camera mapping and virtual view synthesis
CN110853147B (en) Three-dimensional face transformation method
Peng et al. Studying user perceptible misalignment in simulated dynamic facial projection mapping
EP4070538A1 (en) Encoding stereo splash screen in static image
CN102467747A (en) Building decoration animation three-dimensional (3D) effect processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination