CN115297224A - Campus virtual idol live broadcasting method, system, device and storage medium - Google Patents
Campus virtual idol live broadcasting method, system, device and storage medium Download PDFInfo
- Publication number
- CN115297224A CN115297224A CN202210767572.7A CN202210767572A CN115297224A CN 115297224 A CN115297224 A CN 115297224A CN 202210767572 A CN202210767572 A CN 202210767572A CN 115297224 A CN115297224 A CN 115297224A
- Authority
- CN
- China
- Prior art keywords
- virtual
- information
- idol
- virtual idol
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application discloses a campus virtual idol live broadcast method, a system, a device and a storage medium. The method comprises the following steps: constructing a three-dimensional model of the virtual idol; performing motion capture and facial expression capture on the captured object through a capture technology to obtain capture information; binding the capture information to the three-dimensional model to obtain virtual idol information; constructing a virtual education scene in a ghost engine, wherein the virtual education scene comprises a professional skill learning scene and a campus life scene; and combining the virtual idol information with the virtual education scene to construct virtual idol live broadcast. The system comprises a model building module, a capturing module, a binding module, a scene module and a live broadcasting module. By the method, the whole-body interaction of the virtual idols can be realized; the virtual idol live broadcast system can be better adapted to student groups, and is favorable for improving the practicability of virtual idol live broadcast in the campus. The method can be widely applied to the technical field of computers.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method, a system, an apparatus, and a storage medium for live virtual idol in a campus.
Background
With the popularity of network live broadcast, live broadcast users are more and more; the virtual idol direct seeding is thriving in such a piece of fertile soil, and even forms a unique culture and interaction mechanism. In the related technology, the virtual idol is more important than the live broadcast of facial expressions, and the whole-body interaction is lacked; meanwhile, for student groups, the double-image live broadcast in a learning scene is lacked.
Disclosure of Invention
The present application aims to solve at least to some extent one of the technical problems existing in the prior art.
Therefore, the invention aims to provide a quick and practical campus virtual idol live broadcast method, system, device and storage medium.
In order to achieve the technical purpose, the technical scheme adopted by the embodiment of the application comprises the following steps:
on one hand, the embodiment of the application provides a live virtual idol broadcasting method for a campus, which comprises the following steps:
the campus virtual idol live broadcasting method comprises the following steps: constructing a three-dimensional model of the virtual idol; performing motion capture and facial expression capture on the captured object through a capture technology to obtain capture information; binding the capture information to the three-dimensional model to obtain virtual idol information; constructing a virtual education scene in a ghost engine, wherein the virtual education scene comprises a professional skill learning scene and a campus life scene; combining the virtual idol information with the virtual education scene to construct virtual idol live broadcast; through the drive arrangement of the face and the action of the virtual idol, the whole-body interaction of the virtual idol can be realized; through the setting of virtual education scene, adaptation student's crowd that can be better is favorable to promoting the virtual idol of campus and broadcasts the practicality directly.
In addition, the campus virtual idol live broadcasting method according to the above embodiment of the present application may further have the following additional technical features:
further, in the campus virtual idol live broadcast method according to the embodiment of the present application, the method further includes:
in the virtual education scene, generating inquiry information according to scene characteristics; the inquiry information is sent out by the virtual idol in a questioning mode;
according to the inquiry information, response information is given by the target students to generate interactive information;
superposing and synthesizing the interaction information and the virtual idol live broadcast information to obtain popularization information;
and sending the popularization information to a target terminal for live broadcast popularization.
Further, in an embodiment of the present application, before the step of superimposing and synthesizing the interactive information and the virtual idol live broadcast information to obtain the promotion information, the method includes:
establishing a virtual camera in a fantasy engine, wherein data of the virtual camera is derived from a physical camera, and the physical camera is used for shooting the target students;
and establishing association information between the virtual camera and the physical camera through a time code and a tracker.
Further, in an embodiment of the present application, the motion capturing and facial expression capturing a captured object by using a capturing technology to obtain captured information includes the following steps:
if the mobile terminal is indoors, the motion of the captured object is captured through optical motion capture;
if the device is located outdoors, motion capture is performed on the captured object by inertial motion capture.
Further, in an embodiment of the present application, the step of capturing the captured object by motion capture and facial expression capture by using a capture technology to obtain the capture information includes:
capturing muscle data of the face through a capturing device to obtain capturing information; the capture device includes a helmet and a camera.
Further, in an embodiment of the present application, the constructing a three-dimensional model of a virtual idol comprises:
and constructing a three-dimensional model of the virtual idol according to the skeleton system.
Further, in an embodiment of the present application, the constructing a virtual education scene in the illusion engine includes:
constructing a virtual education scene in a virtual engine according to the characteristics of the virtual idol; the virtual idol characteristics comprise occupation information, character information and gender information of the virtual idol.
On the other hand, the embodiment of the present application provides a campus virtual idol live broadcast system, including:
the model building module is used for building a three-dimensional model of the virtual idol;
the capturing module is used for capturing the motion and the facial expression of the captured object through a capturing technology to obtain capturing information;
the binding module is used for binding the capture information to the three-dimensional model to obtain virtual idol information;
the scene module is used for constructing a virtual education scene in the illusion engine, wherein the virtual education scene comprises a professional skill learning scene and a campus life scene;
and the live broadcast module is used for combining the virtual idol information with the virtual education scene to construct virtual idol live broadcast.
On the other hand, the embodiment of the present application provides a campus virtual idol live broadcasting device, including:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, cause the at least one processor to implement any of the campus virtual idol live methods described above.
In another aspect, an embodiment of the present application provides a storage medium, in which a program executable by a processor is stored, where the program executable by the processor is used to implement any one of the above-mentioned campus virtual idol live broadcast methods.
The embodiment of the application can realize the whole-body interaction of the virtual idol; through the setting of virtual education scene, adaptation student's crowd that can be better is favorable to promoting the virtual idol of campus and broadcasts the practicality directly.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following description is made on the drawings of the embodiments of the present application or the related technical solutions in the prior art, and it should be understood that the drawings in the following description are only for convenience and clarity of describing some embodiments in the technical solutions of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flowchart of an embodiment of a campus virtual idol live broadcast method according to the present application;
fig. 2 is a schematic flowchart of another embodiment of a campus virtual idol live broadcast method according to the present application;
fig. 3 is a schematic structural diagram of an embodiment of a campus virtual idol live broadcast system provided in the present application;
fig. 4 is a schematic structural diagram of an embodiment of a campus virtual idol live broadcast device provided in the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application. For the step numbers in the following embodiments, they are set for convenience of illustration only, the order between the steps is not limited at all, and the execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art.
The virtual digital human refers to a comprehensive product which exists in a non-physical world, is created and used by computer means such as computer graphics, graphic rendering, motion capture, deep learning, voice synthesis and the like, and has multiple human characteristics (appearance characteristics, human performance capability, human interaction capability and the like). Also, scholars refer to them as avatars, digital people, etc., and representative segmentation applications include virtual assistants, virtual customer service, virtual idols/broadcasters, etc.
The virtual idol is a digital virtual human, which does not have a corresponding real human in the real world, and the appearance characteristics, basic human settings, various preferences, background information and the like of the virtual idol are set manually. The benefit of virtual idols is that they are stable for long periods of time, stable for people, and highly compatible with the high frequency, fragmented, and real-time operational requirements of the live business.
The live virtual image is growing vigorously in such a piece of fertile soil, and even forms a unique culture and interaction mechanism. In the related technology, the virtual idol is more important than the live broadcast of facial expressions, and the whole-body interaction is lacked; meanwhile, for student groups, the method lacks the live idol broadcasting in the learning scene.
The campus virtual idol live broadcast method and system provided by the embodiment of the application are described in detail below with reference to the accompanying drawings, and first, the campus virtual idol live broadcast method provided by the embodiment of the application will be described with reference to the accompanying drawings.
Referring to fig. 1, a campus virtual idol live broadcasting method is provided in this embodiment of the present application, and the campus virtual idol live broadcasting method in this embodiment of the present application may be applied to a terminal, may also be applied to a server, and may also be software running in the terminal or the server, and the like. The terminal may be, but is not limited to, a tablet computer, a notebook computer, a desktop computer, and the like. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, a cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, CDN, and a big data and artificial intelligence platform. The campus virtual idol live broadcasting method in the embodiment of the application mainly comprises the following steps:
s110: constructing a three-dimensional model of the virtual idol;
in this step, a three-dimensional model of the virtual idol is constructed. In some possible embodiments, the process may be: constructing a virtual education scene in a virtual engine according to the characteristics of the virtual idol; the virtual idol characteristics comprise occupational information, character information and gender information of the virtual idol. Illustratively, the present solution may construct a virtual idol combination of "two students (male and female) + two teachers (male and female)". The human characteristic data of the virtual idol comprises background characteristics such as professional information and character information. In some possible embodiments, the virtual idol may embody educational features of vocational education, and may be displayed in a cartoon style with a first-line, high-skill operator image as a prototype. Meanwhile, scenes can be designed by combining with some story blueprints. Specifically, the virtual idols of the male students can be characterized by not loving theoretical learning from childhood and liking manual operation; the virtual idol of a girl student can be characterized by a lambkin girl image without insights. Through the model design of virtual idol of different styles, increase the interest of live broadcast, promote student's interest in learning.
In some possible embodiments, building the campus virtual idol first requires performing a prior image design, original drawing or modeling. Because the actions are bound to realize real-time interaction, unlike the original picture design required for manufacturing a 2D digital virtual human, the three-dimensional models of the face and the body of the campus virtual idol are manufactured by using the 3D max, and the live broadcast content can be displayed in a more three-dimensional manner and can be fused with the background.
In some possible embodiments, a three-dimensional model of the virtual idol is constructed from the skeletal system. The campus virtual idol builds a model through a skeletal system, and the motion of the model is also driven by the motion of bones, and each piece of the bones drives one part of the model. Since the motion data of the captured object is acquired through motion capture, wherein the captured object can be a human, the campus virtual idol driven by the captured object has obvious advantages in terms of motion flexibility, interaction effect and the like.
S120: performing motion capture and facial expression capture on the captured object through a capture technology to obtain capture information;
in this step, for the created three-dimensional model of the virtual idol, the model needs to be designed to operate, and for example, the model can be designed to be associated by the capturing technology and the operation of the captured object. Specifically, motion capture and facial expression capture may be performed on the captured object. Through motion capture, the whole-body motion setting of the virtual idol is established, so that the virtual idol is more vivid and lively, and the learning interest of a user is improved.
In some possible embodiments, the capturing of the captured object by motion capture and facial expression capture through the capturing technology to obtain the captured information comprises the following steps:
if the mobile terminal is indoors, the motion capture is carried out on the captured object through optical motion capture;
if the device is located outdoors, the motion of the captured object is captured by inertial motion capture.
The optical motion capture is used for capturing the motion of an indoor scene due to high capture precision, low delay and strong real-time property. Specifically, the optical motion capture technology utilizes the computer vision principle to distribute reflective mark points on the body, then distribute infrared cameras around the body, determine the distance between a light spot and the cameras by recording the time of infrared reflection by the high-speed cameras, and track target feature points from different angles to complete the capture of the motion of the whole body. In outdoor scenes, inertial motion capture is used. Because the inertia motion capture technology can overcome the defect of light and shade influence, the cost of the device is low, the precision is higher, and the device is favorable for real-time measurement and simultaneous capture of a plurality of objects.
In some possible embodiments, the step of capturing the captured object by motion capture and facial expression capture by using a capture technology to obtain the capture information includes:
capturing muscle data of a face through a capturing device to obtain capturing information; the capture device includes a helmet and a camera.
In this step, a facial expression capturing technique is used when the facial expression of the campus virtual idol changes. Facial expression capture technology mainly catches the muscle data of face in real time through purpose-made helmet or camera, and then with the good model phase-match of binding in the computer, reaches the drive idol and makes the same expression purpose, uses this technique, is favorable to richening the expression characteristic of virtual idol, promotes the effect of live broadcast.
S130: binding the capture information to the three-dimensional model to obtain virtual idol information;
s140: constructing a virtual education scene in a ghost engine, wherein the virtual education scene comprises a professional skill learning scene and a campus life scene;
in the step, through the construction of the virtual education scene, the educational character and interactivity of the virtual idol live broadcast are fully excavated, the student groups are attracted to participate in the live broadcast, and the learning is driven. Specifically, the virtual education scene comprises a professional skill learning scene and a campus life scene. In some possible implementations, in an example described with reference to fig. 2, the design process of the campus life scenario may be: restoring an environment related to campus life in a virtual reality engine; in this environment, the student virtual idol 1401 meets the problems in campus life and seeks help from the students participating in live interaction; or after explaining the knowledge in the campus life, asking questions of students participating in live broadcast interaction; "students participating in live interaction" 1402 helps student virtual idol 1401 solve problems encountered; the problems of the virtual idols of the students are answered, and then the real-time interaction between the virtual idols of the campus and the students participating in live broadcast interaction is realized. Also, the professional skill learning scenario design may be: restoring an environment related to the learning of the specialized skills in a virtual reality engine; in this environment, teacher virtual idol 1403 explains and demonstrates skill operations, and student virtual idol 1401 listens and speaks and operates; the virtual idol of the student can ask for help from the students participating in the live broadcast interaction in real time in places with difficulty in learning, and the real-time interaction between the virtual idol of the campus and the students participating in the live broadcast interaction is realized.
S150: and combining the virtual idol information with the virtual education scene to construct virtual idol live broadcast.
In the step, virtual idol live broadcast is constructed by superposing and data synthesizing the virtual idol information and the virtual education scene. Specifically, under the support of a high-performance graphic workstation, the data of the campus virtual idol and the virtual education scene are superposed and synthesized by using a virtual reality engine. In some possible embodiments, the virtual reality engine employed is a fantasy engine (Unreal). The illusion engine is a development tool that is specifically provided for network games, real-time visualization projects, and immersive interactive experience projects. Various highly immersive real-time 3D content and experiences can be developed with the illusion engine. Parameters such as light types, angles and intensity are set in the illusion engine, and therefore the live broadcast effect is better improved.
Optionally, in the campus virtual idol live broadcasting method according to the embodiment of the present application, the method further includes the following steps:
in the virtual education scene, generating inquiry information according to scene characteristics; the inquiry information is sent out by the virtual idol in a questioning mode;
according to the inquiry information, response information is given by the target student to generate interaction information;
superposing and synthesizing the interaction information and the virtual idol live broadcast information to obtain popularization information;
and sending the popularization information to a target terminal for live broadcast popularization.
In this step, the popularization information is obtained through the interaction information between the scene design and the target students (i.e., the students participating in the live broadcast interaction), the data after the synthesis of the campus virtual idol, the virtual education scene and the students participating in the live broadcast interaction is pushed to the client or the director through the live broadcast stream pushing software by means of the data output function of the illusion engine, and the synthesized scene is displayed through display equipment such as a large screen, a computer, a mobile phone and a projector.
Optionally, in an embodiment of the application, before the step of synthesizing the interaction information and the live virtual idol information in an overlapping manner to obtain the promotion information, the method includes:
establishing a virtual camera in a ghost engine, wherein data of the virtual camera is derived from a physical camera, and the physical camera is used for shooting the target student;
and establishing association information between the virtual camera and the physical camera through a time code and a tracker.
In the step, the campus virtual idol binding the motion and expression of the captured object and the well-modeled educational scene are imported into the illusion engine. Meanwhile, a virtual camera is generated in the illusion engine, the data source of the virtual camera is a physical camera for shooting students participating in live broadcast interaction, and the virtual camera is synchronized with the physical camera through a time code and a tracker; therefore, the pictures of students participating in live broadcast interaction enter the illusion engine, and the real-time interaction with the campus virtual idol bound with the real person actions and expressions is realized in the virtual education scene. Meanwhile, in order to ensure the synchronization of the virtual idol and the real-time interaction of the on-site students, the method also comprises the following steps: (1) the parameter settings of the physical camera and the virtual camera are consistent (such as aperture, focal length, frame rate and the like) so as to ensure that the shooting visual angle of the virtual camera is consistent with that of the physical camera; (2) binding a virtual reality tracker to a physical camera to acquire motion information of the physical camera, and meanwhile, importing the motion information data into a virtual engine to be bound to the virtual camera so as to ensure that the motion track of the virtual camera is consistent with that of the physical camera; (3) and (3) importing the 'time code' of the physical camera into the virtual engine, and binding the 'time code' to the virtual camera so as to ensure that the movement time of the virtual camera is consistent with that of the physical camera.
In conclusion, the method can realize the whole-body interaction of the virtual idol by driving and setting the face and the action of the virtual idol; through the setting of virtual education scene, adaptation student's crowd that can be better is favorable to promoting the virtual idol of campus and broadcasts the practicality directly.
Next, a campus virtual idol live broadcasting system according to an embodiment of the present application is described with reference to fig. 3.
Fig. 3 is a schematic structural diagram of a campus virtual idol live broadcast system according to an embodiment of the present application, where the system specifically includes:
a model construction module 310, configured to construct a three-dimensional model of a virtual idol;
the capturing module 320 is used for performing motion capturing and facial expression capturing on the captured object through a capturing technology to obtain capturing information;
a binding module 330, configured to bind the capture information to the three-dimensional model to obtain virtual idol information;
the scene module 340 is configured to construct a virtual education scene in the illusion engine, where the virtual education scene includes a professional skill learning scene and a campus life scene;
and a live broadcast module 350, configured to combine the virtual idol information with the virtual education scene to construct a virtual idol live broadcast.
It can be seen that the contents in the foregoing method embodiments are all applicable to this system embodiment, the functions specifically implemented by this system embodiment are the same as those in the foregoing method embodiment, and the advantageous effects achieved by this system embodiment are also the same as those achieved by the foregoing method embodiment.
Referring to fig. 4, an embodiment of the present application provides a campus virtual idol live broadcasting device, including:
at least one processor 410;
at least one memory 420 for storing at least one program;
when executed by the at least one processor 410, cause the at least one processor 410 to implement the campus virtual idol live method.
Similarly, the contents of the method embodiments are all applicable to the apparatus embodiments, the functions specifically implemented by the apparatus embodiments are the same as the method embodiments, and the beneficial effects achieved by the apparatus embodiments are also the same as the beneficial effects achieved by the method embodiments.
An embodiment of the present application further provides a computer-readable storage medium, in which a program executable by the processor 410 is stored, and the program executable by the processor 410 is configured to perform the above-mentioned campus virtual idol live broadcasting method when executed by the processor 410.
Similarly, the contents in the foregoing method embodiments are all applicable to this storage medium embodiment, the functions specifically implemented by this storage medium embodiment are the same as those in the foregoing method embodiments, and the advantageous effects achieved by this storage medium embodiment are also the same as those achieved by the foregoing method embodiments.
In alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flowcharts of the present application are provided by way of example in order to provide a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed and in which sub-operations described as part of larger operations are performed independently.
Furthermore, although the present application is described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the functions and/or features may be integrated in a single physical device and/or software module, or one or more functions and/or features may be implemented in separate physical devices or software modules. It will also be appreciated that a detailed discussion regarding the actual implementation of each module is not necessary for an understanding of the present application. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be understood within the ordinary skill of an engineer given the nature, function, and interrelationships of the modules. Accordingly, those skilled in the art can, using ordinary skill, practice the present application as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative of and not intended to limit the scope of the application, which is defined by the appended claims and their full scope of equivalents.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, which are essential or part of the technical solutions contributing to the prior art, may be embodied in the form of a software product, which is stored in a storage medium and includes several programs for enabling a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable programs that can be considered for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with a program execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the programs from the program execution system, apparatus, or device and execute the programs. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the program execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable program execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the foregoing description of the specification, reference to the description of "one embodiment/example," "another embodiment/example," or "certain embodiments/examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: numerous changes, modifications, substitutions and variations can be made to the embodiments without departing from the principles and spirit of the application, the scope of which is defined by the claims and their equivalents.
While the present application has been described with reference to the preferred embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A campus virtual idol live broadcast method is characterized by comprising the following steps:
constructing a three-dimensional model of the virtual idol;
performing motion capture and facial expression capture on the captured object through a capture technology to obtain capture information;
binding the capture information to the three-dimensional model to obtain virtual idol information;
constructing a virtual education scene in a fantasy engine, wherein the virtual education scene comprises a professional skill learning scene and a campus life scene;
and combining the virtual idol information with the virtual education scene to construct virtual idol live broadcast.
2. The campus virtual idol live broadcasting method as claimed in claim 1, wherein said method further comprises:
in the virtual education scene, generating inquiry information according to scene characteristics; the inquiry information is sent out by the virtual idol in a questioning mode;
according to the inquiry information, response information is given by the target student to generate interaction information;
superposing and synthesizing the interaction information and the virtual idol live broadcast information to obtain popularization information;
and sending the popularization information to a target terminal for live broadcast popularization.
3. The method of claim 2, wherein before the step of obtaining promotion information by superimposing and combining the interaction information and the virtual idol live broadcast information, the method comprises:
establishing a virtual camera in a ghost engine, wherein data of the virtual camera is derived from a physical camera, and the physical camera is used for shooting the target student;
and establishing association information between the virtual camera and the physical camera through a time code and a tracker.
4. The method of claim 1, wherein the capturing information obtained by capturing the captured object by motion capture and facial expression capture comprises the following steps:
if the mobile terminal is indoors, the motion capture is carried out on the captured object through optical motion capture;
if the device is located outdoors, the motion of the captured object is captured by inertial motion capture.
5. The method of claim 1, wherein the step of capturing the captured object by motion capture and facial expression capture comprises:
capturing muscle data of the face through a capturing device to obtain capturing information; the capture device includes a helmet and a camera.
6. The campus virtual idol live broadcasting method according to claim 1, wherein said constructing a three-dimensional model of a virtual idol comprises:
and constructing a three-dimensional model of the virtual idol according to the skeleton system.
7. The campus virtual idol live broadcasting method according to claim 1, wherein said constructing a virtual educational scene in a ghost engine comprises:
constructing a virtual education scene in a virtual engine according to the characteristics of the virtual idol; the virtual idol characteristics comprise occupation information, character information and gender information of the virtual idol.
8. A campus virtual idol live broadcast system, comprising:
the model building module is used for building a three-dimensional model of the virtual idol;
the capturing module is used for capturing the motion and the facial expression of the captured object through a capturing technology to obtain capturing information;
the binding module is used for binding the capture information to the three-dimensional model to obtain virtual idol information;
the scene module is used for constructing a virtual education scene in the illusion engine, wherein the virtual education scene comprises a professional skill learning scene and a campus life scene;
and the live broadcast module is used for combining the virtual idol information with the virtual education scene to construct virtual idol live broadcast.
9. A campus virtual idol live broadcast device, comprising:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, cause the at least one processor to implement the campus virtual idol live method of any of claims 1-7.
10. A computer-readable storage medium in which a program executable by a processor is stored, characterized in that: the processor executable program when executed by a processor is for implementing the campus virtual idol live method as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210767572.7A CN115297224A (en) | 2022-07-01 | 2022-07-01 | Campus virtual idol live broadcasting method, system, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210767572.7A CN115297224A (en) | 2022-07-01 | 2022-07-01 | Campus virtual idol live broadcasting method, system, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115297224A true CN115297224A (en) | 2022-11-04 |
Family
ID=83821829
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210767572.7A Pending CN115297224A (en) | 2022-07-01 | 2022-07-01 | Campus virtual idol live broadcasting method, system, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115297224A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116668605A (en) * | 2023-05-10 | 2023-08-29 | 北京国际云转播科技有限公司 | Meta-universe studio system, playing method, storage medium and electronic device |
-
2022
- 2022-07-01 CN CN202210767572.7A patent/CN115297224A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116668605A (en) * | 2023-05-10 | 2023-08-29 | 北京国际云转播科技有限公司 | Meta-universe studio system, playing method, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Hughes et al. | Mixed reality in education, entertainment, and training | |
| CN112135158B (en) | Live broadcasting method based on mixed reality and related equipment | |
| Zhao et al. | Designing virtual reality based 3D modeling and interaction technologies for museums | |
| Regenbrecht et al. | Ātea Presence—Enabling Virtual Storytelling, Presence, and Tele-Co-Presence in an Indigenous Setting | |
| Greenwood et al. | Augmented reality and mobile learning: theoretical foundations and implementation | |
| Nikolai et al. | Active learning and teaching through digital technology and live performance:‘choreographic thinking’as art practice in the tertiary sector | |
| CN115297224A (en) | Campus virtual idol live broadcasting method, system, device and storage medium | |
| CN114967925A (en) | Use digital museum of VR panorama technique | |
| Halskov et al. | Virtual video prototyping | |
| Mantoro et al. | Analysis of the Metaverse in Society 5.0 for Learning Systems using Meta | |
| Fabola et al. | A virtual museum installation for time travel | |
| Yoo et al. | Evaluation of an Augmented Reality for Historical Context Experiences of 3D Restored Court Paintings | |
| Stefan et al. | Rethinking visual arts education with new technologies and resources during the covid pandemic | |
| Nummenmaa et al. | Space Pace: Method for creating augmented reality tours based on 360 videos | |
| Miyai et al. | New approach to camerawork skills education for 3D/S3D computer graphics animation | |
| Haddad | Educational Multimedia Entertainment (EME) and Childhood Heritage Awareness | |
| Roush et al. | Between snapshots and avatars: using visual methodologies for fieldwork in Second Life | |
| Arnold | Computer Graphics and Archaeology: realism and symbiosis | |
| Jain et al. | Virtual world for education and entertainment | |
| Mauyakufa et al. | An analysis on the role of computer graphics and animation in Zimbabwean film industry | |
| See et al. | MOOC for AR VR Training | |
| Holopainen et al. | Space Pace: Method for Creating Augmented Reality Tours Based on 360 Videos | |
| Ziemsen et al. | Film Production and Architecture Education in the Metaverse | |
| Somvanshi | Image and video processing: an ingenious tool of story telling | |
| Pan et al. | Digital olympic museum and sports simulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |