CN116107463A - 3D virtual digital person interaction system and method - Google Patents
3D virtual digital person interaction system and method Download PDFInfo
- Publication number
- CN116107463A CN116107463A CN202211665591.5A CN202211665591A CN116107463A CN 116107463 A CN116107463 A CN 116107463A CN 202211665591 A CN202211665591 A CN 202211665591A CN 116107463 A CN116107463 A CN 116107463A
- Authority
- CN
- China
- Prior art keywords
- imaging
- fixedly connected
- virtual digital
- box
- double
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/54—Accessories
- G03B21/56—Projection screens
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B41/00—Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention relates to the technical field of virtual reality and intelligent recognition, in particular to an interaction system and method of a 3D virtual digital person, comprising a mobile terminal device and a 3D virtual digital person imaging device, wherein the mobile terminal device and the 3D virtual digital person imaging device perform signal transmission in a wireless communication mode, the 3D virtual digital person imaging device comprises an imaging box, and a double-layer inner box is fixedly connected in the imaging box. According to the invention, video pictures played by the TTSA character model in the mobile terminal equipment are projected onto the imaging column through the projectors, the 3D virtual digital person is presented, the TTSA character model outputs texts through the recognition sensing module and the intelligent analysis module through carrying out scene communication with the 3D virtual digital person, the TTSA character model is driven to generate corresponding voices and actions to interact with the user, and the video pictures generated by the voices and the actions of the digital person are displayed on the imaging column through the projectors, so that the reality of interaction of the virtual digital person is improved.
Description
Technical Field
The invention relates to the technical field of virtual reality and intelligent recognition, in particular to an interaction system and method of a 3D virtual digital person.
Background
With the continuous development of society and the continuous popularization of electronic devices, man-machine interaction becomes more frequent, and people are continuously striving to create a more natural and humanized interaction system, wherein a virtual digital person refers to a virtual character with a digital appearance, and the virtual digital person exists depending on a display device unlike a robot with an entity.
In the prior art, the Chinese patent with the application number of CN201610882664.4 discloses a virtual human interaction system and a method based on dynamic 3D handwriting digital recognition, wherein the system comprises a gesture and digital recognition module, a central server module and a virtual human control module, wherein the gesture and digital recognition module is used for extracting a hand section and recognizing a gesture and a handwriting track; the central server module is used for connecting the gesture with the digital identification module and the virtual person control module to realize data acquisition, transmission and command transmission; the virtual person control module is a carrier for actually interacting with a person, displaying a virtual person, and controlling actions, languages, expressions and the like of the virtual person according to commands received from the central server module.
In the prior art, the interactive system for the virtual digital person performs interactive learning by forming the virtual digital person through the interface of the mobile terminal, such as a mobile phone and the like, however, the mobile terminal can only form the 2D virtual digital person and can only communicate with a user through stiff static limb actions or simple language, the interactive mode is relatively rigid, and the authenticity of the interaction of the virtual digital person is reduced.
Based on the above, the invention designs a 3D virtual digital human interaction system and a method thereof to solve the above problems.
Disclosure of Invention
The invention aims to provide a 3D virtual digital person interaction system and method, which are used for solving the problems that the conventional virtual digital person interaction system provided in the background art is used for forming a virtual digital person through a mobile terminal interface to perform interaction learning, such as a mobile phone and the like, but a mobile terminal can only form a 2D virtual digital person and can only communicate with a user through stiff static limb actions or simple language, and the interaction mode is relatively rigid, so that the authenticity of the interaction of the virtual digital person is reduced.
In order to achieve the above purpose, the present invention provides the following technical solutions: the utility model provides an interactive system of virtual digital people of 3D, includes mobile terminal equipment and the virtual digital people imaging device of 3D, mobile terminal equipment and the virtual digital people imaging device of 3D carry out signal transmission through wireless communication's mode, the virtual digital people imaging device of 3D includes the imaging box, the internal fixedly connected with bilayer is internal to box, bilayer is internal to box bottom symmetry rotation and is connected with the dwang, its tip fixedly connected with threaded rod behind the dwang top run through bilayer is internal box top layer bottom, threaded rod surface threaded connection has the connecting plate, two connecting plate surface fixedly connected with transparent imaging post, behind the imaging post top run through bilayer is internal box top layer top, with bilayer is internal box sliding connection, the dwang bottom is provided with the rotatory actuating mechanism of drive dwang;
the imaging box comprises an imaging box body, a double-layer inner box body, a mounting plate, a sliding rod, a sliding shaft, a projection chamber, a projector, a projection probe, a reset spring, an extension plate and a pushing block, wherein the mounting plate is fixedly connected with the inner side of the imaging box and the outer side of the double-layer inner box in an array mode;
the driving mechanism comprises a turbine, the turbine is fixedly connected to the surface of the rotating rod, worm screws are meshed with the side surfaces of the turbine, a rotating shaft is fixedly connected in the worm screws, a driving motor is connected to the end part of the rotating shaft in a transmission manner, and the driving motor is fixedly connected in the double-layer imaging box;
when the system works, the existing interaction system for the virtual digital person forms the virtual digital person through the interface of the mobile terminal to perform interaction learning, such as a mobile phone and the like, however, the mobile terminal can only form the 2D virtual digital person and can only communicate with a user through stiff static limb actions or simple language, the interaction mode is relatively rigid, and the problem of the authenticity of the interaction of the virtual digital person is reduced. The method comprises the steps of carrying out signal transmission with the 3D virtual digital human imaging equipment in a wireless communication mode such as Bluetooth through a mobile terminal equipment, firstly selecting a TTSA character model through a mobile terminal, then starting a driving mechanism through the mobile terminal, enabling an output shaft of a driving motor to rotate, enabling a worm to rotate, enabling a turbine to rotate under the meshing effect, enabling a connecting plate to move upwards along the threaded rod under the threaded connection effect, enabling an imaging column originally hidden in a double-layer inner box to move upwards to expose an imaging position, enabling an extension plate to move upwards when the imaging column moves upwards, enabling a sliding shaft to drive a projection chamber to move upwards after the imaging column moves to the top end, enabling a projector to be exposed out of an imaging box through pushing blocks at the end of the extension plate, enabling a projection probe of the projector to project oblique projection to the imaging column, enabling a video picture played by the TTSA character model in the mobile terminal equipment to be projected onto the imaging column through a plurality of projectors, enabling a 3D virtual digital human to be displayed through interaction with the 3D virtual digital human, enabling a user to interact with a voice recognition module to generate a corresponding voice picture through the digital human visual image, enabling the digital human image to interact with the digital human image to be generated in the imaging column through the corresponding digital image box, and enabling the digital human image to interact with the digital human image to be displayed in the digital image box through the digital image display device to be in the opposite to the direction, and enabling the digital human image to interact with the digital human image to be displayed by the digital image to be displayed on the imaging picture through the digital image, the imaging column and the projector are prevented from being exposed to the outside for a long time, and damage is avoided.
As a further scheme of the invention, the bottom end of the inner side wall of the projection chamber is fixedly connected with an annular toothed belt, a driving gear is meshed with the bottom end array of the annular toothed belt, the surface of the driving gear is in transmission connection with a high-speed motor, the high-speed motor is fixedly connected with the bottom end of the outer side wall of the projection chamber, the top end of the double-layer imaging box is fixedly connected with a limit switch for controlling the high-speed motor, and the surface of the extension plate is fixedly connected with a switch key matched with the limit switch; when the extension board moves to the topmost end, the switch key arranged on the surface of the extension board touches the limit switch, so that the high-speed motor is electrified, the output shaft of the high-speed motor rotates at a high speed, the driving gear rotates, the projection chamber rotates at a high speed at the top end of the sliding seat under the meshing action, and therefore a plurality of projectors rotate around the imaging column at a high speed, and the continuity of playing 3D digital human video pictures by the imaging column is improved.
As a further scheme of the invention, a transparent multi-edge imaging body is fixedly connected in the imaging column, an imaging medium is arranged in the multi-edge imaging body, and the imaging medium is white mist; during operation, the multi-edge imaging column and the imaging medium are arranged, so that the imaging definition is improved, and the authenticity of interaction of virtual digital people is improved.
As a further scheme of the invention, a fan is fixedly connected in the double-layer imaging box, and the fan is respectively communicated with the multi-edge imaging body through a ventilation hose; during operation, through setting up the fan, when the projecting apparatus carries out the projection to the imaging column, through the air current of fan to the internal injection air current of many arriss formation of image for imaging medium flows, has increased the definition of formation of image, improves the authenticity of virtual digital man's interaction.
In order to solve the above problems, the present invention further provides an interaction method of an interaction system of a 3D virtual digital person, where the interaction method of the 3D virtual digital person includes the following steps:
step one: the method comprises the steps that signal transmission is carried out between mobile terminal equipment such as a mobile phone and the 3D virtual digital human imaging equipment in a Bluetooth wireless communication mode, and a TTSA character model is selected through a mobile terminal;
step two: the driving mechanism is started through the moving end, so that an output shaft of the driving motor rotates, the worm rotates, the turbine rotates under the meshing action, the rotating rod and the threaded rod rotate, the connecting plate moves upwards along the threaded rod under the threaded connection action, and the imaging column originally hidden in the double-layer inner box moves upwards to expose the imaging position;
step three: when the imaging column moves upwards, the extension plate moves upwards, and after the imaging column moves to the top end, the pushing block at the end part of the extension plate pushes the bottom end of the sliding shaft to enable the sliding shaft to drive the projection chamber to move upwards, so that the projector is exposed out of the imaging box, and the reset spring is compressed, so that the projection probe of the projector performs oblique projection on the imaging column;
step four: the method comprises the steps that video pictures played by TTSA character models in mobile terminal equipment are projected onto an imaging column through a plurality of projectors, a 3D virtual digital person is displayed, a user carries out scene communication with the 3D virtual digital person, the TTSA character models output texts through an identification sensing module and an intelligent analysis module, the TTSA character models are driven to generate corresponding voices and actions to enable the digital person to interact with the user, and video pictures generated by the voices and actions of the digital person are displayed on the imaging column through the projectors;
step five: when the extension plate moves to the top end, the switch key arranged on the surface of the extension plate touches the limit switch, so that the high-speed motor is electrified, the output shaft of the high-speed motor rotates at a high speed, the driving gear rotates, the projection chamber rotates at a high speed at the top end of the sliding seat under the meshing action, and a plurality of projectors rotate around the periphery of the imaging column at a high speed, and the continuity of playing 3D digital human video pictures by the imaging column is improved;
step six: after interaction is completed, the customs clearance mobile terminal equipment starts the driving motor, so that the driving motor rotates in the opposite direction, the imaging column is reset under the action of the principle, and the projection chamber is retracted into the imaging box under the action of the reset spring.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the invention, video pictures played by the TTSA character model in the mobile terminal equipment are projected onto the imaging column through the projectors, the 3D virtual digital person is presented, the user carries out scene communication with the 3D virtual digital person, the TTSA character model outputs texts through the recognition sensing module and the intelligent analysis module, the TTSA character model is driven to generate corresponding voices and actions so as to enable the digital person to interact with the user, and the video pictures generated by the voices and actions of the digital person are displayed on the imaging column through the projectors, so that the reality of interaction of the virtual digital person is improved.
2. According to the invention, the limit switch, the switch key, the high-speed motor and the driving gear are arranged, when the extension plate moves to the topmost end, the switch key arranged on the surface of the extension plate touches the limit switch, so that the high-speed motor is electrified, the output shaft of the high-speed motor rotates at a high speed, the driving gear rotates, the projection chamber rotates at a high speed at the top end of the sliding seat under the meshing effect, and therefore, the projectors rotate around the periphery of the imaging column at a high speed, and the continuity of playing 3D digital human video pictures by the imaging column is improved.
3. The invention improves the definition of imaging and the authenticity of virtual digital human interaction by arranging the multi-edge imaging column and the imaging medium.
4. According to the invention, the fan is arranged, when the projector projects to the imaging column, the air flow is injected into the multi-edge imaging body through the fan, so that the imaging medium flows, the imaging definition is increased, and the authenticity of interaction of virtual digital people is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a first schematic illustration of the general structure of the present invention;
FIG. 2 is a second schematic view of the general structure of the present invention (hidden projection chamber);
FIG. 3 is a first cross-sectional view of the general structure of the present invention;
FIG. 4 is a second cross-sectional view of the general structure of the present invention;
FIG. 5 is a third cross-sectional view of the general structure of the present invention;
FIG. 6 is a diagram showing the connection between the projection chamber and the slide shaft in the present invention;
FIG. 7 is a diagram showing the connection between the driving mechanism and the connecting plate according to the present invention;
FIG. 8 is a diagram of the connection between an imaging column and a multi-edge imaging body according to the present invention;
FIG. 9 is a flow chart of the operation of the intelligent driving type virtual digital person according to the present invention;
fig. 10 is a flow chart of the method of the present invention.
In the drawings, the list of components represented by the various numbers is as follows:
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1-10, the present invention provides a technical solution: the 3D virtual digital person interaction system comprises mobile terminal equipment and 3D virtual digital person imaging equipment, wherein the mobile terminal equipment and the 3D virtual digital person imaging equipment perform signal transmission in a wireless communication mode, the 3D virtual digital person imaging equipment comprises an imaging box 1, a double-layer inner box 2 is fixedly connected in the imaging box 1, a rotating rod 3 is symmetrically and rotatably connected to the bottom end of the bottom layer of the double-layer inner box 2, the top end of the rotating rod 3 penetrates through the bottom end of the top layer of the double-layer inner box 2 and is fixedly connected with a threaded rod 4, the surfaces of the threaded rods 4 are in threaded connection with connecting plates 5, the surfaces of the two connecting plates 5 are fixedly connected with transparent imaging columns 6, the top ends of the imaging columns 6 penetrate through the top end of the top layer of the double-layer inner box 2 and are in sliding connection with the double-layer inner box 2, and a driving mechanism for driving the rotating rod 3 to rotate is arranged at the bottom end of the rotating rod 3;
the inner side of the imaging box 1 and the outer side of the double-layer inner box 2 are fixedly connected with a mounting plate 7 in an array mode together, the surface of the mounting plate 7 is penetrated through and is connected with sliding rods 8 in a sliding mode, the tops of the sliding rods 8 are fixedly connected with sliding shafts 9 together, the surface of the sliding shafts 9 is connected with a projection chamber 10 in a sliding mode, a projector 11 is fixedly connected in the projection chamber 10 in an array mode, a projection probe of the projector 11 penetrates through the side wall of the projection chamber 10 and projects obliquely to an imaging column 6, the bottom end of the sliding rod 8 is fixedly connected with a mounting block 12, the surface of the sliding rod 8 is sleeved with a reset spring 13, two ends of the reset spring 13 are fixedly connected with the mounting plate 7 and the mounting block 12 respectively, two sides of the connecting plate 5 are symmetrically and fixedly connected with extension plates 14, the ends of the extension plates 14 penetrate through the side wall of the double-layer inner box and can longitudinally slide along the side wall of the double-layer inner box, and the ends of the extension plates 14 are fixedly connected with a pushing block 15;
the driving mechanism comprises a turbine 23, the turbine 23 is fixedly connected to the surface of the rotating rod 3, the side surfaces of the turbine 23 are respectively meshed with a worm 24, a rotating shaft 25 is fixedly connected in the worm 24, the end part of the rotating shaft 25 is in transmission connection with a driving motor 26, and the driving motor 26 is fixedly connected in the double-layer imaging box 1;
when the system works, the existing interaction system for the virtual digital person forms the virtual digital person through the interface of the mobile terminal to perform interaction learning, such as a mobile phone and the like, however, the mobile terminal can only form the 2D virtual digital person and can only communicate with a user through stiff static limb actions or simple language, the interaction mode is relatively rigid, and the problem of the authenticity of the interaction of the virtual digital person is reduced. The TTSA character model is firstly selected through a mobile terminal device, a driving mechanism is started through the mobile terminal, an output shaft of a driving motor 26 rotates, a worm 24 rotates, a turbine 23 rotates under the meshing action, a rotating rod 3 and a threaded rod 4 rotate, a connecting plate 5 moves upwards along the threaded rod 4 under the threaded connection action, an imaging column 6 originally hidden in a double-layer inner box 2 moves upwards to expose an imaging position, an extension plate 14 moves upwards while the imaging column 6 moves upwards, after the imaging column 6 moves to the top end, a pushing block 15 at the end part of the extension plate 14 extrudes and pushes the bottom end of a sliding shaft 9, the sliding shaft 9 drives a projection chamber 10 to move upwards to expose a projector 11 from the imaging box 1, the reset spring 13 is compressed to enable the projection probe of the projector 11 to project oblique projection to the imaging column 6, the video picture played by the TTSA character model in the mobile terminal device is projected to the imaging column 6 through the projectors 11 to present a 3D virtual digital person, the TTSA character model outputs texts through the recognition sensing module and the intelligent analysis module through scene communication with the 3D virtual digital person, the TTSA character model is driven to generate corresponding voices and actions to enable the digital person to interact with the user, the video picture generated by the voices and the actions of the digital person is displayed on the imaging column 6 through the projector 11, so that the reality of the interaction of the virtual digital person is improved, after the interaction is finished, the mobile terminal device is turned on the driving motor 26 to enable the driving motor 26 to rotate in the opposite direction, the imaging column 6 is reset, the projection chamber 10 is retracted into the imaging box 1 under the action of the reset spring 13, and damage to the imaging column 6 and the projector 11 which are exposed outside for a long time is avoided.
As a further scheme of the invention, the bottom end of the inner side wall of the projection chamber 10 is fixedly connected with an annular toothed belt 16, the bottom end array of the annular toothed belt 16 is meshed with a driving gear 17, the surface of the driving gear 17 is in transmission connection with a high-speed motor 18, the high-speed motor 18 is fixedly connected to the bottom end of the outer side wall of the projection chamber 10, the top end of the double-layer imaging box 1 is fixedly connected with a limit switch 19 for controlling the high-speed motor 18, and the surface of the extension plate 14 is fixedly connected with a switch key 20 matched with the limit switch 19; when the extension board 14 moves to the topmost end, the switch key 20 arranged on the surface of the extension board 14 touches the limit switch 19, so that the high-speed motor 18 is electrified, the output shaft of the high-speed motor 18 rotates at a high speed, the driving gear 17 rotates, the projection chamber 10 rotates at a high speed at the top end of the sliding seat under the meshing effect, the projectors 11 rotate around the imaging column 6 at a high speed, and the continuity of playing 3D digital human video pictures by the imaging column 6 is improved.
As a further scheme of the invention, a transparent multi-edge imaging body 21 is fixedly connected in the imaging column 6, an imaging medium is arranged in the multi-edge imaging body 21, and the imaging medium is white mist; in operation, the multi-edge imaging column 6 and the imaging medium are arranged, so that the imaging definition is improved, and the authenticity of the interaction of virtual digital people is improved.
As a further scheme of the invention, a fan 22 is fixedly connected in the double-layer imaging box 1, and the fan 22 is respectively communicated with the multi-edge imaging body 21 through a ventilation hose; during operation, through setting up fan 22, when projecting apparatus 11 carries out the projection to imaging column 6, through the air current of fan 22 injection into the multi-edge imaging body 21 for imaging medium flows, has increased the definition of formation of image, improves virtual digital man's interactive authenticity.
In order to solve the above problems, the present invention further provides an interaction method of an interaction system of a 3D virtual digital person, where the interaction method of the 3D virtual digital person includes the following steps:
step one: the method comprises the steps that signal transmission is carried out between mobile terminal equipment such as a mobile phone and the 3D virtual digital human imaging equipment in a Bluetooth wireless communication mode, and a TTSA character model is selected through a mobile terminal;
step two: the driving mechanism is started by the moving end, so that the output shaft of the driving motor 26 rotates, the worm 24 rotates, the turbine 23 rotates under the meshing action, the rotating rod 3 and the threaded rod 4 rotate, the connecting plate 5 moves upwards along the threaded rod 4 under the threaded connection action, and the imaging column 6 originally hidden in the double-layer inner box 2 moves upwards to expose the imaging position;
step three: when the imaging column 6 moves upwards, the extension plate 14 moves upwards, and after the imaging column 6 moves to the top end, the pushing block 15 at the end part of the extension plate 14 pushes the bottom end of the sliding shaft 9, so that the sliding shaft 9 drives the projection chamber 10 to move upwards to expose the projector 11 from the imaging box 1, and the reset spring 13 is compressed, so that the projection probe of the projector 11 performs oblique projection on the imaging column 6;
step four: the video picture played by the TTSA character model in the mobile terminal equipment is projected onto the imaging column 6 through the projectors 11 to present a 3D virtual digital person, the TTSA character model outputs texts through the recognition sensing module and the intelligent analysis module through carrying out scene communication with the 3D virtual digital person, the TTSA character model is driven to generate corresponding voice and actions to enable the digital person to interact with the user, and the video picture generated by the voice and actions of the digital person is displayed on the imaging column 6 through the projectors 11;
step five: when the extension board 14 moves to the topmost end, the switch key 20 arranged on the surface of the extension board 14 touches the limit switch 19, so that the high-speed motor 18 is electrified, the output shaft of the high-speed motor 18 rotates at a high speed, the driving gear 17 rotates, the projection chamber 10 rotates at a high speed at the top end of the sliding seat under the meshing effect, and the projectors 11 rotate around the imaging column 6 at a high speed, so that the continuity of playing 3D digital human video pictures by the imaging column 6 is improved;
step six: when the interaction is completed, the customs clearance mobile terminal device starts the driving motor 26, so that the driving motor 26 rotates in the opposite direction, the imaging column 6 is reset under the action of the principle, and the projection chamber 10 is retracted into the imaging box 1 under the action of the reset spring 13.
Working principle: the TTSA character model is selected through the mobile terminal equipment, the driving mechanism is started through the mobile terminal, the output shaft of the driving motor 26 rotates, the worm 24 rotates, the turbine 23 rotates under the meshing action, the rotating rod 3 and the threaded rod 4 rotate, the connecting plate 5 moves upwards along the threaded rod 4 under the threaded connection action, the imaging column 6 hidden in the double-layer inner box 2 moves upwards to expose the imaging position, the extension plate 14 moves upwards while the imaging column 6 moves upwards, after the imaging column 6 moves to the top end, the pushing block 15 at the end of the extension plate 14 extrudes and pushes the bottom end of the sliding shaft 9, the sliding shaft 9 drives the projection chamber 10 to move upwards to expose the projector 11 from the imaging box 1, the reset spring 13 is compressed to enable the projection probe of the projector 11 to project oblique projection to the imaging column 6, video pictures played by the TTSA character model in the mobile terminal equipment are projected to the imaging column 6 through the projectors 11 to present a 3D virtual digital person, the TTSA character model outputs texts through the recognition sensing module and the intelligent analysis module through scene communication with the 3D virtual digital person, the TTSA character model is driven to generate corresponding voices and actions to enable the digital person to interact with the user, the video pictures generated by the voices and the actions of the digital person are displayed on the imaging column 6 through the projector 11, after the extension board 14 moves to the top end, the switch key 20 arranged on the surface of the extension board 14 touches the limit switch 19 to enable the high-speed motor 18 to input current, the output shaft of the high-speed motor 18 rotates at a high speed, the driving gear 17 is made to rotate, under the action of meshing, the projection chamber 10 is made to rotate at a high speed at the top end of the sliding seat, so that the projectors 11 rotate at a high speed around the imaging column 6, the continuity of playing 3D digital human video pictures by the imaging column 6 is improved, after interaction is finished, the driving motor 26 is started by the mobile terminal equipment, the driving motor 26 rotates in the opposite direction, under the action of the principle, the imaging column 6 is reset, and the projection chamber 10 is retracted into the imaging box 1 under the action of the reset spring 13.
In the description of the present specification, the descriptions of the terms "one embodiment," "example," "specific example," and the like, mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended only to assist in the explanation of the invention. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best understand and utilize the invention. The invention is limited only by the claims and the full scope and equivalents thereof.
Claims (7)
1. The utility model provides an interactive system of virtual digital people of 3D, includes mobile terminal device and the virtual digital people imaging device of 3D, mobile terminal device and the virtual digital people imaging device of 3D carry out signal transmission through wireless communication's mode, its characterized in that: the 3D virtual digital human imaging device comprises an imaging box (1), wherein a double-layer inner box (2) is fixedly connected in the imaging box (1), a rotating rod (3) is symmetrically and rotationally connected to the bottom end of the bottom layer of the double-layer inner box (2), a threaded rod (4) is fixedly connected to the end part of the top end of the rotating rod (3) after penetrating through the bottom end of the top layer of the double-layer inner box (2), a connecting plate (5) is connected to the surface of the threaded rod (4) in a threaded manner, transparent imaging columns (6) are fixedly connected to the surfaces of the two connecting plates (5), the top ends of the imaging columns (6) penetrate through the top end of the top layer of the double-layer inner box (2) and then are in sliding connection with the double-layer inner box (2), and a driving mechanism for driving the rotating rod (3) to rotate is arranged at the bottom end of the rotating rod (3);
the imaging box (1) is inboard and the common array fixedly connected with mounting panel (7) in double-deck interior box (2) outside, mounting panel (7) surface runs through and sliding connection has slide bar (8), several slide bar (8) top is fixedly connected with slide shaft (9) jointly, slide shaft (9) surface sliding connection has projection room (10), array fixedly connected with projecting apparatus (11) in projection room (10), projection probe of projecting apparatus (11) runs through projection room (10) lateral wall backward imaging column (6) and carries out oblique projection, equal fixedly connected with installation piece (12) in slide bar (8) bottom, reset spring (13) have been cup jointed on slide bar (8) surface, reset spring (13) both ends are fixedly connected with on mounting panel (7) and installation piece (12) respectively, connecting plate (5) bilateral symmetry fixedly connected with extension board (14), extension board (14) tip all runs through double-deck interior box lateral wall to can carry out longitudinal sliding along double-deck interior box lateral wall, extension board (14) tip fixedly connected with piece (15).
2. The 3D virtual digital human interactive system according to claim 1, wherein: the novel high-speed imaging device is characterized in that an annular toothed strip (16) is fixedly connected to the bottom end of the inner side wall of the projection chamber (10), a driving gear (17) is meshed with the bottom end array of the annular toothed strip (16), a high-speed motor (18) is connected to the surface transmission of the driving gear (17), the high-speed motor (18) is fixedly connected to the bottom end of the outer side wall of the projection chamber (10), a limit switch (19) for controlling the high-speed motor (18) is fixedly connected to the top end of the double-layer imaging box (1), and a switch key (20) matched with the limit switch (19) is fixedly connected to the surface of the extension plate (14).
3. A 3D virtual digital human interactive system according to claim 2, characterized in that: the imaging column (6) is internally fixedly connected with a transparent multi-edge imaging body (21), and an imaging medium is arranged in the multi-edge imaging body (21).
4. A 3D virtual digital human interactive system according to claim 3, characterized in that: the imaging medium is white mist.
5. The 3D virtual digital human interactive system according to claim 4, wherein: the double-layer imaging box (1) is internally and fixedly connected with a fan (22), and the fan (22) is respectively communicated with the multi-edge imaging body (21) through a ventilation hose.
6. The 3D virtual digital human interactive system according to claim 5, wherein: the driving mechanism comprises a turbine (23), the turbine (23) is fixedly connected to the surface of the rotating rod (3), worm screws (24) are meshed with the side faces of the turbine (23), rotating shafts (25) are fixedly connected in the worm screws (24), driving motors (26) are connected to end portions of the rotating shafts (25) in a transmission mode, and the driving motors (26) are fixedly connected in the double-layer imaging box (1).
7. An interaction method of an interaction system of a 3D virtual digital person, which is applicable to the interaction system of a 3D virtual digital person according to claim 6, and is characterized in that: the interaction method of the 3D virtual digital person comprises the following steps:
step one: the method comprises the steps that signal transmission is carried out between mobile terminal equipment such as a mobile phone and the 3D virtual digital human imaging equipment in a Bluetooth wireless communication mode, and a TTSA character model is selected through a mobile terminal;
step two: the driving mechanism is started through the moving end, an output shaft of the driving motor (26) rotates, the worm (24) rotates, the turbine (23) rotates under the meshing action, the rotating rod (3) and the threaded rod (4) rotate, the connecting plate (5) moves upwards along the threaded rod (4) under the threaded connection action, and the imaging column (6) originally hidden in the double-layer inner box (2) moves upwards to expose the imaging position;
step three: when the imaging column (6) moves upwards, the extension plate (14) moves upwards, after the imaging column (6) moves to the top end, the pushing block (15) at the end part of the extension plate (14) pushes the bottom end of the sliding shaft (9) to push the sliding shaft (9) to drive the projection chamber (10) to move upwards, the projector (11) is exposed out of the imaging box (1), and the reset spring (13) is compressed to enable the projection probe of the projector (11) to perform oblique projection on the imaging column (6);
step four: the method comprises the steps that video pictures played by TTSA character models in mobile terminal equipment are projected onto an imaging column (6) through a plurality of projectors (11), 3D virtual digital people are displayed, a user carries out scene communication with the 3D virtual digital people, the TTSA character models output texts through a recognition sensing module and an intelligent analysis module, the TTSA character models are driven to generate corresponding voices and actions so as to enable the digital people to interact with users, video pictures generated by the voices and the actions of the digital people are displayed on the imaging column (6) through the projectors (11);
step five: when the extension plate (14) moves to the topmost end, a switch key (20) arranged on the surface of the extension plate (14) touches a limit switch (19), so that a high-speed motor (18) is electrified, an output shaft of the high-speed motor (18) rotates at a high speed, a driving gear (17) rotates, a projection chamber (10) rotates at the top end of a sliding seat at a high speed under the meshing effect, a plurality of projectors (11) rotate around an imaging column (6) at a high speed, and the continuity of playing 3D digital human video pictures by the imaging column (6) is improved;
step six: after interaction is completed, the customs clearance mobile terminal equipment starts the driving motor (26) to enable the driving motor (26) to rotate in the opposite direction, the imaging column (6) is reset under the action of the principle, and the projection chamber (10) is retracted into the imaging box (1) under the action of the reset spring (13).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211665591.5A CN116107463A (en) | 2022-12-23 | 2022-12-23 | 3D virtual digital person interaction system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211665591.5A CN116107463A (en) | 2022-12-23 | 2022-12-23 | 3D virtual digital person interaction system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116107463A true CN116107463A (en) | 2023-05-12 |
Family
ID=86260783
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211665591.5A Pending CN116107463A (en) | 2022-12-23 | 2022-12-23 | 3D virtual digital person interaction system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116107463A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117198293A (en) * | 2023-11-08 | 2023-12-08 | 北京烽火万家科技有限公司 | Digital human voice interaction method, device, computer equipment and storage medium |
| CN117221503A (en) * | 2023-11-08 | 2023-12-12 | 北京烽火万家科技有限公司 | Holographic projection system of digital personal mobile terminal |
-
2022
- 2022-12-23 CN CN202211665591.5A patent/CN116107463A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117198293A (en) * | 2023-11-08 | 2023-12-08 | 北京烽火万家科技有限公司 | Digital human voice interaction method, device, computer equipment and storage medium |
| CN117221503A (en) * | 2023-11-08 | 2023-12-12 | 北京烽火万家科技有限公司 | Holographic projection system of digital personal mobile terminal |
| CN117198293B (en) * | 2023-11-08 | 2024-01-26 | 北京烽火万家科技有限公司 | Digital human voice interaction method, device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116107463A (en) | 3D virtual digital person interaction system and method | |
| US5630017A (en) | Advanced tools for speech synchronized animation | |
| US5111409A (en) | Authoring and use systems for sound synchronized animation | |
| US4884972A (en) | Speech synchronized animation | |
| US6919892B1 (en) | Photo realistic talking head creation system and method | |
| Zongker | Creating animation for presentations | |
| US20100007665A1 (en) | Do-It-Yourself Photo Realistic Talking Head Creation System and Method | |
| CN113256821B (en) | Three-dimensional virtual image lip shape generation method and device and electronic equipment | |
| CN101247481A (en) | System and method for producing and playing real-time three-dimensional movie/game based on role play | |
| CN106896770A (en) | A kind of dynamic slide rail display systems and its control method | |
| CN216411876U (en) | Intelligent home scene and hardware equipment display device | |
| Smoot et al. | An interactive zoetrope for the animation of solid figurines and holographic projections. | |
| CN114185279A (en) | Intelligent household scene and hardware equipment display device and display method thereof | |
| CN105701235A (en) | Interactive webpage animation design method based on reverse inversion | |
| CN110930855A (en) | Demonstration instrument for simulating celestial body movement | |
| Perng et al. | Image talk: a real time synthetic talking head using one single image with chinese text-to-speech capability | |
| CN116245986A (en) | Virtual sign language digital person driving method and device | |
| CN210933809U (en) | Shadow play robot | |
| Derakhshani | Introducing Maya 2011 | |
| CN103810932A (en) | Virtual starry sky teaching device | |
| CN216014205U (en) | VR immerses virtual mutual integrative device in multidimensional space | |
| CN215376647U (en) | Rotary popular science device based on Leap motion | |
| CN212208812U (en) | Art display device that can reciprocate | |
| CN117901143A (en) | Artificial intelligent human robot imitation | |
| Xavier | When the Past Is Present |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |