CN108200446A - Multimedia interactive system and method on the line of virtual image - Google Patents
Multimedia interactive system and method on the line of virtual image Download PDFInfo
- Publication number
- CN108200446A CN108200446A CN201810031218.1A CN201810031218A CN108200446A CN 108200446 A CN108200446 A CN 108200446A CN 201810031218 A CN201810031218 A CN 201810031218A CN 108200446 A CN108200446 A CN 108200446A
- Authority
- CN
- China
- Prior art keywords
- data
- virtual image
- line
- audio
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 96
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000003993 interaction Effects 0.000 claims abstract description 44
- 239000000284 extract Substances 0.000 claims abstract description 20
- 238000013075 data extraction Methods 0.000 claims abstract description 10
- 230000008676 import Effects 0.000 claims abstract description 9
- 238000012545 processing Methods 0.000 claims description 58
- 230000006835 compression Effects 0.000 claims description 36
- 238000007906 compression Methods 0.000 claims description 35
- 230000005540 biological transmission Effects 0.000 claims description 34
- 238000000605 extraction Methods 0.000 claims description 28
- 230000009471 action Effects 0.000 claims description 21
- 238000001514 detection method Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 9
- 241000406668 Loxodonta cyclotis Species 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 4
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 7
- 238000009877 rendering Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 238000003860 storage Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000003068 static effect Effects 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 230000000875 corresponding effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 230000008921 facial expression Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000011800 void material Substances 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000009193 crawling Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the present application provides multimedia interactive system and method on a kind of line of virtual image, the dummy model including importing virtual image by virtual image import modul；By data extraction module with the actual video data and actual audio data of extract real-time reality image, and the actual video data and actual audio data are mapped into the dummy model using data-driven module, generate the virtual audio-visual animation of the virtual image, the virtual audio-visual animation is then being exported by interactive service platform on the line provided to streaming media server by virtual image output module in real time, and interactive service platform on the line is accessed with virtual image and carries out multimedia interaction live streaming, the interest of multimedia interaction live streaming is improved whereby.
Description
Technical field
The invention relates to virtual animation design technique and the lines of multimedia live broadcast technology more particularly to virtual image
Upper multimedia interactive system and method.
Background technology
Network direct broadcasting technology be a kind of server-side by the live video data of main broadcaster user broadcast to multiple spectators users into
The Internet technology of row viewing, while may also provide spectators user and carry out interaction with main broadcaster user.
However, in the prior art, network direct broadcasting is typically to be shown with the reality image of main broadcaster, if can pass through technology
Virtual image is accessed interaction platform in the Internet line by means, and is participated on line and be broadcast live mutually instead of reality image with virtual image
In dynamic, the interest of network direct broadcasting will can be greatlyd improve.
Invention content
In view of this, the main purpose of the embodiment of the present invention is to provide multimedia interaction system on a kind of line of virtual image
System and method with dummy row image, it can be achieved that replace interaction platform in reality image access the Internet line straight into the interaction on line
It broadcasts, to increase the interest of interactive live streaming on line.
The embodiment of the present application provides multimedia interactive system on a kind of line of virtual image, which is characterized in that including：It is empty
Intend vivid import modul, for importing the dummy model of virtual image；Data extraction module, for extract real-time reality image
Actual video data and actual audio data；Data-driven module, for by the actual video data and the actual audio
Data map to the dummy model in real time, generate the virtual audio-visual animation of the virtual image；And virtual image output mould
Block, for the virtual audio-visual animation to be exported interactive service platform on the line provided to streaming media server in real time, and
Interactive service platform on the line is accessed with the virtual image and carries out multimedia interaction live streaming.
Optionally, in any embodiment of the application, the data extraction module further includes：Video extraction unit,
For extracting the actual video data of the reality image according to preset realtime graphic extraction rate；And audio extraction
Unit is used to extract the actual audio data of the reality image.
Optionally, in any embodiment of the application, the realtime graphic extraction rate is according to network bandwidth, calculates
The process performance and the network transmission protocol of machine and set.
Optionally, in any embodiment of the application, the virtual audio-visual animation of the virtual image is by the virtual shape
The virtual image data and virtual acoustic data of elephant are formed, and the data-driven module further includes：
Optionally, in any embodiment of the application, video data processing element is used for from the actual video number
Action drives data is generated so that the dummy model to be driven to perform action according to action data is decomposited, so as to generate the void
Intend the virtual image data of image；And audio data processing unit, it is used to distinguish for the realaudio data
It carries out including at least the processing that audio defeat, audio mute detection and audio echo are eliminated, so as to generate the virtual image
The virtual acoustic data.
Optionally, in any embodiment of the application, the virtual image output module further includes：Image data encodes
Unit is used to carry out encoding compression processing for the virtual image data, to generate video compression data；Voice data is compiled
Code unit is used to carry out encoding compression processing for the virtual acoustic data, to generate audio compression data；Data encapsulate
Unit is used for according to the message transmission protocol set by the streaming media server to the video compression data and the sound
Frequency compressed data is packaged, to generate data packet；And data transmission unit, it is used for based on the message transmission protocol
Interactive service platform on the line that the transmission of data packets is provided to the streaming media server.
Optionally, in any embodiment of the application, the audio performed by the audio data processing unit is quiet
Sound detection operation includes detecting the mute audio data in the realaudio data with mute label, to enable the sound number
The encoding compression processing is not performed for the mute audio data according to coding unit.
Optionally, in any embodiment of the application, the system also includes information interaction processing modules, are used to carry
The text information in interactive service platform on the line is taken, and input feedback letter is provided for the text information extracted
Breath, and the feedback information is exported to interactive service platform on the line, to provide the text information interactive operation on line.
Optionally, in any embodiment of the application, described information interactive processing module uses the webpage information side of crawling
At least one of formula and network packet capturing mode extract the text information in interactive service platform on the line.
Optionally, in any embodiment of the application, the system is applied in electronic equipment, and the electronic equipment
In be also equipped with and on the line interactive service platform communication connection multimedia live broadcast software, the virtual image output module
For the virtual audio-visual animation to be accessed the multimedia live broadcast software, so that the multimedia live broadcast software will be described virtual
Audio-visual animation is exported in real time to interactive service platform on the line, and accesses interactive service on the line with the virtual image
Platform carries out multimedia interaction live streaming.
Another embodiment of the application provides a kind of multimedia interaction method on line of virtual image, which is characterized in that packet
It includes：Import the dummy model of virtual image；The actual video data and actual audio data of extract real-time reality image；By described in
Actual video data maps to the dummy model in real time with the actual audio data, generates the virtual shadow of the virtual image
Sound animation；And the virtual audio-visual animation is exported into interactive service on the line provided to streaming media server in real time and is put down
Platform, and interactive service platform on the line is accessed with the virtual image and carries out multimedia interaction live streaming.
Optionally, in any embodiment of the application, the method is further included extracts speed according to preset realtime graphic
Rate extracts the actual video data of the reality image.
Optionally, in any embodiment of the application, the method further includes the processing according to network bandwidth, computer
Performance and the network transmission protocol set the realtime graphic extraction rate.
Optionally, in any embodiment of the application, the virtual audio-visual animation of the virtual image is by the virtual shape
The virtual image data and virtual acoustic data of elephant are formed, and the method further includes：It is decomposited from the actual video data
Action data, to generate action drives data and the dummy model is driven to perform action according to this, so as to generate the virtual shape
The virtual image data of elephant；And it is carried out respectively for the realaudio data quiet including at least audio defeat, audio
The processing that sound detects and audio echo is eliminated, so as to generate the virtual acoustic data of the virtual image.
Optionally, in any embodiment of the application, the method further includes：It is carried out for the virtual image data
Encoding compression processing, to generate video compression data；Encoding compression processing is carried out for the virtual acoustic data, to generate sound
Frequency compressed data；According to the message transmission protocol set by the streaming media server to the video compression data and the sound
Frequency compressed data is packaged, to generate data packet；And based on the message transmission protocol by the transmission of data packets
Interactive service platform on the line provided to the streaming media server.
Optionally, in any embodiment of the application, the audio mute detection operation includes the detection real-time sound
Frequency has the mute audio data of mute label in, and is not performed at the coding compression for the mute audio data
Reason.
Optionally, in any embodiment of the application, the method further includes interactive service platform on the extraction line
In text information, and provide input feedback information, and the feedback information is exported for the text information that is extracted
Interactive service platform on to the line, to provide the text information interactive operation on line.
Optionally, in any embodiment of the application, the method is applied to be equipped with the electricity of multimedia live broadcast software
In sub- equipment, and the method further includes the virtual audio-visual animation accessing the multimedia live broadcast software, for described more
Medium living broadcast software exports the virtual audio-visual animation in real time to interactive service platform on the line, and with the virtual shape
Multimedia interaction live streaming is carried out as accessing interactive service platform on the line.
Multimedia interactive system and method on the line for the virtual image that the embodiment of the present application is provided, by importing virtual shape
The dummy model of elephant, and the actual video data of the reality image of extract real-time and actual audio data mapped to described virtual
In model, to generate the virtual audio-visual animation of the virtual image in real time, and pass through the virtual image picture transmission to line
Upper interactive service platform, so as to fulfill with virtual image replace reality image and on tie-in line interactive service platform carry out multimedia
Interaction live streaming, sound, image and the word content that can be perceived mutually so as to providing virtual image and living broadcast interactive object, so as to
Promote the interest of multimedia interaction live streaming.
Description of the drawings
Some of detailed description the embodiment of the present application by way of example rather than limitation with reference to the accompanying drawings hereinafter are specific
Embodiment.Identical reference numeral denotes same or similar component or part in attached drawing.Those skilled in the art should manage
Solution, what these attached drawings were not necessarily drawn to scale.In attached drawing：
Fig. 1 is shown according to the basic framework of multimedia interactive system on the line of the virtual image shown in one embodiment of the application
It is intended to；
Fig. 2 is the embodiment configuration diagram of multimedia interactive system on the line for show virtual image shown in FIG. 1；
Fig. 3 is the basic flow of multimedia interaction method on the line of the virtual image according to another embodiment of the application
Journey schematic diagram；And
Fig. 4 is the embodiment flow diagram of multimedia interaction method on the line for show virtual image shown in Fig. 3.
Specific embodiment
Implement any technical solution of the embodiment of the present invention must be not necessarily required to reach simultaneously more than all advantages.
In order to which those skilled in the art is made to more fully understand the technical solution in the embodiment of the present invention, below in conjunction with the present invention
The technical solution in the embodiment of the present invention is clearly and completely described in attached drawing in embodiment, it is clear that described reality
It is only part of the embodiment of the embodiment of the present invention to apply example, instead of all the embodiments.Based on the implementation in the embodiment of the present invention
Example, those of ordinary skill in the art's all other embodiments obtained should all belong to the range that the embodiment of the present invention is protected.
Embodiment specific implementation is further illustrated the present invention with reference to attached drawing of the embodiment of the present invention.
Fig. 1 is shown according to the basic framework of multimedia interactive system on the line of the virtual image shown in one embodiment of the application
It is intended to.As shown in the figure, multimedia interactive system 1 mainly includes virtual image import modul on the line of the virtual image of the application
11st, data extraction module 12, data-driven module 13 and virtual image output module 14.
Virtual image import modul 11 is used to import the dummy model of virtual image.In this present embodiment, the virtual shape
As may be, for example, virtual figure image, virtual animal image etc..And the dummy model of the virtual image can be for example including virtual
Mask and skeleton model of image etc., wherein, mask can react the real-time facial expression of virtual image, skeleton model
The action that virtual image performs in real time can be reacted.
Data extraction module 12 is used for the actual video data and actual audio data of extract real-time reality image.Yu Benshi
It applies in example, reality image may be, for example, practical personage or animal.
Please refer to Fig. 2, in specific embodiment, data extraction module 12 has further included video extraction unit 121
And audio extraction unit 122.
Video extraction unit 121 is used for according to preset realtime graphic extraction rate, extracts the actual video of reality image
Data, namely for capturing the movement locus of reality image to generate action data.In this present embodiment, video extraction unit
121 can connect video capture device (being unillustrated), to receive and extract the shadow for the reality image that video capture device is acquired
As data, wherein, video capture device is, for example, video camera, video recorder or infrared sensor or computer camera etc., but simultaneously
Not with it is above-mentioned enumerate be limited, other kinds of video capture device is also applicable to the application.Furthermore the realtime graphic
Extraction rate is set according to real network bandwidth, the process performance of computer and the network transmission protocol.Usual three-dimensional is drawn
The different rendering rate such as 60/s or 30/s can be provided by holding up, and the application can be according to real network bandwidth, computer processing performance
And the objective factors such as object transmission agreement determine required image rate, whereby so that d engine subsequently can will be empty
The image rendering of analog model is to a fixed target texture, and (such as 1000ms/25=40ms pairs at regular intervals
Answer 25fps) this target texture is read, so that it is guaranteed that the real-time and fluency of the image frame of dummy model.
Audio extraction unit 122 is used to extract the actual audio data of reality image, in this present embodiment, audio extraction list
Member 122 can by being connected to audio collecting device (being unillustrated), to extract the voice data that audio collecting device is acquired,
In, audio collecting device may be, for example, independent microphone, also can be to integrate to be installed on electronic equipment (such as computer, video camera)
On microphone, but not with it is above-mentioned enumerate be limited, other kinds of sound pick-up outfit is also applicable to the application.In addition, sound
Frequency extraction unit 122 is in addition to for extracting the sound that reality image is sent out, it can also be used to extract reality image local environment
Ambient sound.
In addition, video extraction unit 121 is running independently of one another with audio extraction unit 122, therefore, the two is with synchronization
Mode performs respective data extraction work.
Data-driven module 13 is used to map to the actual video data extracted and actual audio data virtually in real time
Model generates the virtual audio-visual animation of the virtual image.In embodiments herein, the virtual image that is generated it is virtual
Audio-visual animation is made of the virtual image data and virtual acoustic data of virtual image.
Data-driven module 13 is similar with data extraction module 12 and video section and audio portion for virtual image
Divide and carry out independent process respectively, and the two also can be synchronization process pattern, specifically, please refer to Fig. 2, in the present embodiment
In, data-driven module 13 has further included video data processing element 131 and audio data processing unit 132.
Video data processing element 131 is used to decomposite from the actual video data that video extraction unit 121 is extracted
The action data of reality image passes through d engine to utilize the action drives data-driven to generate action drives data
Dummy model performs corresponding action, so as to generate the virtual image data of virtual image.
In an embodiment, video data processing element 131 is further included decomposites still image from actual video data
And dynamic image, and the still image decomposited is added on the virtual image of d engine rendering.Wherein, static map
Include the image information such as subtitle picture, static special efficacy picture as in, in addition, the dynamic image decomposited is also added to
On the virtual image that d engine is rendered, so as to form virtual image picture.
In addition, video data processing element 131 also has the function of the real-time filter of video, that is, d engine can be directed to
The effect of the image generated after rendering is adjusted processing, for example, being realized at the adjustment of shading value by Shader Language
Reason.
The realaudio data that audio data processing unit 132 is then used to be extracted for audio extraction unit 122 carries out
Relevant treatment operations, including the processing that audio defeat, audio mute detection and audio echo are eliminated, so as to generate virtual shape
The virtual acoustic data of elephant.In this present embodiment, audio data processing unit 132 is utilized respectively is carried by the third party SDK that increases income
Audio defeat function, audio mute detection function and the echo cancellation performance of confession are carried out for original realaudio data
Noise reduction, mute monitoring and echo cancellation process.
Virtual image output module 14 is used for the virtual audio-visual animation of virtual image for being generated data-driven module 13
Interactive service platform 20 on the line provided to streaming media server 2 is provided in real time, it is traditional so as to be replaced with virtual image
Multimedia interaction live streaming is carried out on reality image tie-in line in interactive service platform 20.In this present embodiment, interactive service on line
Platform 20 is including but not limited to traditional image/video live streaming, real-time video call, real-time video meeting etc..
In an embodiment, the system 1 of the application is applied in an electronic equipment, such as computer, smart mobile phone etc..And in
The multimedia live broadcast software of communication, virtual shape can be attached with interactive service platform on line by being also equipped in advance in electronic equipment
As output module 14 is used to the virtual audio-visual animation of the virtual image generated being linked into multimedia live broadcast software, for more
Medium living broadcast software exports virtual audio-visual animation in real time to interactive service platform on line 20, and with virtual image in mutual on line
Multimedia interaction live streaming is carried out in dynamic service platform 20.
In general, the multimedia live broadcast software being installed in electronic equipment can be received as taken by computer camera
The image of reality image is uploaded to live streaming platform on line with the image data as reality image and is broadcast live, and this Shen
Virtual image output module 14 please can be used for analogue computer camera, and the multimedia live broadcast software with being installed in computer is straight
Docking is connect, the virtual audio-visual animation of virtual image is replaced into interactive service platform 20 on the image frame tie-in line of reality image
In with communication other side carry out video interactive.
Please refer to Fig. 2, in specific embodiment, virtual image output module 14 has further included image data coding
Unit 141, voice data coding unit 142, data packaging unit 143 and data transmission unit 144.
Image data coding unit 141 is used to carry out encoding compression processing for virtual image data, to generate video pressure
Contracting data.In this present embodiment, image data coding unit 141 can be according to the support form of practical virtual image data, and adopts
SDK selections are increased income with hardware-compressed coding mode or Software Compression coding mode with third party, and virtual image data is compiled
Code compression processing.
Voice data coding unit 142 is used to carry out encoding compression processing for the virtual acoustic data, to generate sound
Frequency compressed data.In addition, in this present embodiment, it is detected from realaudio data for audio data processing unit 132
Mute audio data part, voice data coding unit 142 do not perform the audio coding compression processing, is to reduce
System resource consumption.
Data packaging unit 143 is used for according to the message transmission protocol set by streaming media server 2, for video compress
Data are packaged processing with audio compression data, to generate data packet.
Data transmission unit 144 seals data then for the message transmission protocol set by based on streaming media server 2
Packet is transmitted to interactive service platform 20 on the line that streaming media server 2 provided by internet system, and realization is with virtual shape
As into living broadcast interactive on line.
Please continue to refer to Fig. 2, in another embodiment of the application, multimedia interactive system 1 has further included information on line
Interactive processing module 15 is used to extract the text information in interactive service platform 20 on line, and believes for extracted word
Breath provides input feedback information, and feedback information is exported to interactive service platform on line 20, to provide the text information on line
Interactive operation.That is, information interaction processing module 15 can extract spectators' staying of being inputted of interactive service platform 20 on line
It says information, relevant feedback information is inputted, and feedback information is uploaded on line mutually for being located at the actual operator before computer
Dynamic service platform 20, whereby to realize the word interaction between virtual image and practical spectators.In specific embodiment,
Information interaction processing module 15 can be used webpage information and crawl interactive service platform 20 from line such as mode or network packet capturing mode
The message information of middle extraction spectators.
Fig. 3 is the basic flow of multimedia interaction method on the line of the virtual image according to another embodiment of the application
Journey schematic diagram.As shown in the figure, multimedia interaction method mainly includes following processing step on the line of the virtual image of the application：
Step S31 imports the dummy model of virtual image.
In this present embodiment, the virtual image may be, for example, virtual figure image, virtual animal image etc..
The dummy model of the virtual image may include the mask and skeleton model of virtual image, wherein, facial mould
For reacting the real-time facial expression of virtual image, skeleton model is then used to react the action that virtual image performs in real time type.
Step S32, the actual video data and actual audio data of extract real-time reality image.
In this present embodiment, reality image may be, for example, practical personage or animal, and can according to practical network bandwidth,
The process performance and the network transmission protocol of computer and set realtime graphic extraction rate, and according to the realtime graphic extract
Rate extracts the actual video data of reality image.Usual d engine can provide the different wash with watercolours such as 60/s or 30/s
Contaminate rate, as a result, the application according to real network bandwidth, computer processing performance and object transmission agreement etc. because usually determining
Required image rate so that d engine can by the image rendering of dummy model to a fixed target texture, with
For subsequently (such as 1000ms/25=40ms corresponds to 25fps) reads this target texture at regular intervals, so as to really
Protect the real-time and fluency of the rendering image of dummy model.
Actual video data and actual audio data are mapped to dummy model, generate virtual image by step S33 in real time
Virtual audio-visual animation.
In this present embodiment, the virtual audio-visual animation of virtual image by virtual image virtual image data and virtual acoustic
Data are formed, and the application from actual video data by decompositing action data to generate action drives data, and drive according to this
Dynamic dummy model performs action, so as to generate the virtual image data of virtual image.Specifically, the application can be from actual video
Decomposite still image and dynamic image in data, and the void for d engine rendering that the still image decomposited is added to
Intend on image.Wherein, the image information such as subtitle picture, static special efficacy picture is included in still image, and is decomposited
Dynamic image be also added on the virtual image that d engine is rendered, so as to form the virtual image picture of virtual image.
In addition, the application, which can also be directed to the effect of image generated after d engine renders, is adjusted processing, for example, passing through coloring
Device language come realize the adjustment of shading value handle, to provide the function of the real-time filter of video.
Meanwhile the application also directed to realaudio data respectively carry out include at least audio defeat, audio mute detection, with
And the processing that audio echo is eliminated, so as to generate the virtual acoustic data of virtual image.In embodiments herein, above-mentioned sound
Frequency noise reduction, audio mute detection and audio echo elimination can increase income correlation function that SDK is provided come complete by third party
Into.
Virtual audio-visual animation is exported interactive service on the line provided to streaming media server and put down by step S34 in real time
Platform, and multimedia interaction live streaming is carried out with interactive service platform on virtual image tie-in line.
In specific embodiment, this method can be applied in the electronic equipment for being equipped with multimedia live broadcast software, lead to
It crosses and accesses virtual audio-visual animation in multimedia live broadcast software, so that multimedia live broadcast software is defeated in real time by virtual audio-visual animation
Go out to interactive service platform on line, so as to replace traditional reality image with virtual image in interactive service platform on tie-in line
Carry out multimedia interaction live streaming.
Please continue to refer to Fig. 4, in another embodiment of the application, step S34 specifically includes following processing step：
Step S341, for the virtual image data carry out encoding compression processing, with generate video compression data and
Encoding compression processing is carried out for the virtual acoustic data, to generate audio compression data.
In this present embodiment, can according to the support form of practical virtual image data, and using third party increase income SDK selection
With hardware-compressed coding mode or Software Compression coding mode, encoding compression processing is carried out to virtual image data.
In addition, it should be noted that, for aforementioned detected mute audio data from realaudio data, in this sound
In frequency compression process, the audio coding compression processing will not be performed, to reduce system resources consumption.
Step S342, according to the message transmission protocol set by streaming media server to video compression data and the audio
Compressed data is packaged, to generate data packet.
Step S343, based on the message transmission protocol set by streaming media server by the transmission of data packets generated extremely
Interactive service platform on the line that streaming media server is provided, and in virtual image on line interactive service platform on line
Living broadcast interactive.
In addition, in another embodiment of the application, during the method may additionally include living broadcast interactive, extract real-time
Text information on line in interactive service platform, and input feedback information is provided, and will for the text information extracted
Feedback information is exported to interactive service platform on line, to provide the word interaction between virtual image and practical spectators.In
In specific embodiment, webpage information can be used crawl mode or network packet capturing mode etc. and extracted in interactive service platform from line
The message information of spectators.
Multimedia interactive system and method on the line for the virtual image that the embodiment of the present application is provided, by by extract real-time
Actual video data and the actual audio data of reality image map in the dummy model, it is same with reality image to generate
The virtual audio-visual animation of the virtual image of step, then by interactive service platform in the virtual image picture transmission to line, to utilize
Virtual image replaces interactive service platform on reality image tie-in line and carries out multimedia interaction live streaming, thus to promote multimedia
The interest of interaction live streaming.
Furthermore the application is calculated according to practical network bandwidth, the process performance of computer and the network transmission protocol
Realtime graphic extraction rate extracts real time video data, and the real-time messages based on interactive service platform on line transmit association according to this
View, and be packaged for virtual audio-visual animation data and transmission process, to ensure the interactive fluency being broadcast live and real-time.
In addition, the also extractable spectators' text information that interactive service platform is inputted on line of the application, and be directed to and carried
The text information taken provides input feedback information, and the feedback information is exported to interactive service platform on line, so as to
Word interaction between virtual image and practical spectators.
The apparatus embodiments described above are merely exemplary, wherein the module illustrated as separating component can
To be or may not be physically separate, the component shown as module may or may not be physics mould
Block, you can be located at a place or can also be distributed on multiple network modules.It can be selected according to the actual needs
In some or all of module realize the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying creativeness
Labour in the case of, you can to understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It is realized by the mode of software plus required general hardware platform, naturally it is also possible to pass through hardware.Based on such understanding, on
Technical solution is stated substantially in other words to embody the part that the prior art contributes in the form of software product, it should
Computer software product can store in a computer-readable storage medium, the computer readable recording medium storing program for performing include for
The readable form storage of computer (such as computer) or any mechanism of transmission information.For example, machine readable media is included only
Read memory (ROM), random access memory (RAM), magnetic disk storage medium, optical storage media, flash medium, electricity, light,
Sound or the transmitting signal of other forms (for example, carrier wave, infrared signal, digital signal etc.) etc., which includes
Some instructions are used so that computer equipment (can be personal computer, server or the network equipment etc.) perform it is each
Method described in certain parts of a embodiment or embodiment.
Finally it should be noted that：Above example is only to illustrate the technical solution of the embodiment of the present application rather than it is limited
System；Although the application is described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that：Its
Still it can modify to the technical solution recorded in foregoing embodiments or which part technical characteristic is equal
It replaces；And these modifications or replacement, each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution
Spirit and scope.
It will be understood by those skilled in the art that the embodiment of the embodiment of the present invention can be provided as method, apparatus (equipment) or
Computer program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine soft
The form of the embodiment of part and hardware aspect.Moreover, the embodiment of the present invention can be used wherein includes calculating in one or more
The computer-usable storage medium of machine usable program code (includes but not limited to magnetic disk storage, CD-ROM, optical memory
Deng) on the form of computer program product implemented.
The embodiment of the present invention with reference to according to the method for the embodiment of the present invention, device (equipment) and computer program product
Flowchart and/or the block diagram describes.It should be understood that it can be realized by computer program instructions every in flowchart and/or the block diagram
The combination of flow and/or box in one flow and/or box and flowchart and/or the block diagram.These computers can be provided
Program instruction is to the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices
To generate a machine so that the instruction performed by computer or the processor of other programmable data processing devices generates use
In the dress of function that realization is specified in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
It puts.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps are performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or
The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Claims (17)
1. a kind of multimedia interactive system on line of virtual image, which is characterized in that including：
Virtual image import modul, for importing the dummy model of virtual image；
Data extraction module, for the actual video data and actual audio data of extract real-time reality image；
Data-driven module, for the actual video data and the actual audio data to be mapped to the virtual mould in real time
Type generates the virtual audio-visual animation of the virtual image；And
Virtual image output module, for the virtual audio-visual animation to be exported the line provided to streaming media server in real time
Upper interactive service platform, and interactive service platform on the line is accessed with the virtual image and carries out multimedia interaction live streaming.
2. multimedia interactive system on the line of virtual image according to claim 1, which is characterized in that the data extraction
Module further includes：
Video extraction unit, the reality for being used to extract the reality image according to preset realtime graphic extraction rate regard
Frequency evidence；And
Audio extraction unit is used to extract the actual audio data of the reality image.
3. multimedia interactive system on the line of virtual image according to claim 2, which is characterized in that the realtime graphic
Extraction rate is set according to network bandwidth, the process performance of computer and the network transmission protocol.
4. multimedia interactive system on the line of virtual image according to claim 2, which is characterized in that the virtual image
Virtual audio-visual animation be made of, and the data-driven the virtual image data and virtual acoustic data of the virtual image
Module further includes：
Video data processing element is used to decomposite action data from the actual video data to generate action drives data
The dummy model is driven to perform action according to this, so as to generate the virtual image data of the virtual image；And
Audio data processing unit is used to carry out including at least audio defeat, audio respectively for the realaudio data
The processing that mute detection and audio echo are eliminated, so as to generate the virtual acoustic data of the virtual image.
5. multimedia interactive system on the line of virtual image according to claim 4, which is characterized in that the virtual image
Output module further includes：
Image data coding unit is used to carry out encoding compression processing for the virtual image data, to generate video pressure
Contracting data；
Voice data coding unit is used to carry out encoding compression processing for the virtual acoustic data, to generate audio pressure
Contracting data；
Data packaging unit is used for according to the message transmission protocol set by the streaming media server to the video compress
Data are packaged with the audio compression data, to generate data packet；And
Data transmission unit is used to be based on the message transmission protocol by the transmission of data packets to the streaming media service
Interactive service platform on the line that device is provided.
6. multimedia interactive system on the line of virtual image according to claim 5, which is characterized in that the audio data
Audio mute detection operation performed by processing unit includes having mute label in the detection realaudio data
Mute audio data, the voice data coding unit to be enabled not performed at the coding compression for the mute audio data
Reason.
7. multimedia interactive system on the line of virtual image according to claim 1, which is characterized in that the system is also wrapped
Information interaction processing module is included, is used to extract the text information on the line in interactive service platform, and be directed to what is extracted
The text information provides input feedback information, and the feedback information is exported to interactive service platform on the line, to carry
For the text information interactive operation on line.
8. multimedia interactive system on the line of virtual image according to claim 7, which is characterized in that described information is interactive
Processing module crawls at least one of mode and network packet capturing mode using webpage information and extracts interactive service on the line
The text information in platform.
9. multimedia interactive system on the line of virtual image according to claim 1, which is characterized in that the system application
It is also equipped in electronic equipment, and in the electronic equipment straight with the multimedia of interactive service platform communication connection on the line
Software is broadcast, the virtual image output module is used to the virtual audio-visual animation accessing the multimedia live broadcast software, for
The multimedia live broadcast software exports the virtual audio-visual animation in real time to interactive service platform on the line, and with described
Virtual image accesses interactive service platform on the line and carries out multimedia interaction live streaming.
10. a kind of multimedia interaction method on line of virtual image, which is characterized in that including：
Import the dummy model of virtual image；
The actual video data and actual audio data of extract real-time reality image；
The actual video data and the actual audio data are mapped into the dummy model in real time, generate the virtual shape
The virtual audio-visual animation of elephant；And
The virtual audio-visual animation is exported into interactive service platform on the line provided to streaming media server in real time, and with institute
It states virtual image and accesses interactive service platform progress multimedia interaction live streaming on the line.
11. multimedia interaction method on the line of virtual image according to claim 10, which is characterized in that the method is also
Including：
The actual video data of the reality image is extracted according to preset realtime graphic extraction rate.
12. multimedia interaction method on the line of virtual image according to claim 11, which is characterized in that the method is also
The realtime graphic extraction rate is set including the process performance according to network bandwidth, computer and the network transmission protocol.
13. multimedia interaction method on the line of virtual image according to claim 11, which is characterized in that the virtual shape
The virtual audio-visual animation of elephant is made of the virtual image data and virtual acoustic data of the virtual image, and the method is also wrapped
It includes：
Action data is decomposited from the actual video data, to generate action drives data and drive the dummy model according to this
Action is performed, so as to generate the virtual image data of the virtual image；And
It carries out disappearing including at least audio defeat, audio mute detection and audio echo respectively for the realaudio data
The processing removed, so as to generate the virtual acoustic data of the virtual image.
14. multimedia interaction method on the line of virtual image according to claim 13, which is characterized in that the method is also
Including：
Encoding compression processing is carried out for the virtual image data, to generate video compression data；
Encoding compression processing is carried out for the virtual acoustic data, to generate audio compression data；
According to the message transmission protocol set by the streaming media server to the video compression data and the audio compression
Data are packaged, to generate data packet；And
It is interactive on the line for being provided the transmission of data packets to the streaming media server based on the message transmission protocol
Service platform.
15. multimedia interaction method on the line of virtual image according to claim 14, which is characterized in that the audio is quiet
Sound detection operation includes detecting the mute audio data in the realaudio data with mute label, and for described mute
Audio data does not perform the encoding compression processing.
16. multimedia interaction method on the line of virtual image according to claim 10, which is characterized in that the method is also
Input is provided including extracting the text information on the line in interactive service platform, and for the text information extracted instead
Feedforward information, and the feedback information is exported to interactive service platform on the line, to provide the behaviour of the text information interaction on line
Make.
17. multimedia interaction method on the line of virtual image according to claim 10, which is characterized in that the method should
For being equipped in the electronic equipment of multimedia live broadcast software, and the method is further included the virtual audio-visual animation access institute
Multimedia live broadcast software is stated, so that the multimedia live broadcast software exports the virtual audio-visual animation to the line in real time
Interactive service platform, and interactive service platform on the line is accessed with the virtual image and carries out multimedia interaction live streaming.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810031218.1A CN108200446B (en) | 2018-01-12 | 2018-01-12 | On-line multimedia interaction system and method of virtual image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810031218.1A CN108200446B (en) | 2018-01-12 | 2018-01-12 | On-line multimedia interaction system and method of virtual image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108200446A true CN108200446A (en) | 2018-06-22 |
| CN108200446B CN108200446B (en) | 2021-04-30 |
Family
ID=62588894
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810031218.1A Active CN108200446B (en) | 2018-01-12 | 2018-01-12 | On-line multimedia interaction system and method of virtual image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108200446B (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108986192A (en) * | 2018-07-26 | 2018-12-11 | 北京运多多网络科技有限公司 | Data processing method and device for live streaming |
| CN109240709A (en) * | 2018-07-26 | 2019-01-18 | 北京运多多网络科技有限公司 | SDK cut-in method and device for live streaming |
| CN109448467A (en) * | 2018-11-01 | 2019-03-08 | 深圳市木愚科技有限公司 | A kind of virtual image teacher teaching program request interaction systems |
| CN110071938A (en) * | 2019-05-05 | 2019-07-30 | 广州虎牙信息科技有限公司 | Virtual image interactive method, apparatus, electronic equipment and readable storage medium storing program for executing |
| CN110139115A (en) * | 2019-04-30 | 2019-08-16 | 广州虎牙信息科技有限公司 | Virtual image attitude control method, device and electronic equipment based on key point |
| CN110225400A (en) * | 2019-07-08 | 2019-09-10 | 北京字节跳动网络技术有限公司 | A kind of motion capture method, device, mobile terminal and storage medium |
| CN110910691A (en) * | 2019-11-28 | 2020-03-24 | 深圳市木愚科技有限公司 | Personalized course generation method and system |
| CN110971930A (en) * | 2019-12-19 | 2020-04-07 | 广州酷狗计算机科技有限公司 | Live virtual image broadcasting method, device, terminal and storage medium |
| CN112164128A (en) * | 2020-09-07 | 2021-01-01 | 广州汽车集团股份有限公司 | Music visual interaction method and computer equipment for vehicle-mounted multimedia |
| CN112634684A (en) * | 2020-12-11 | 2021-04-09 | 深圳市木愚科技有限公司 | Intelligent teaching method and device |
| CN112732084A (en) * | 2021-01-13 | 2021-04-30 | 西安飞蝶虚拟现实科技有限公司 | Future classroom interaction system and method based on virtual reality technology |
| CN112788355A (en) * | 2020-12-30 | 2021-05-11 | 北京达佳互联信息技术有限公司 | Information processing method, device and storage medium |
| CN113132741A (en) * | 2021-03-03 | 2021-07-16 | 广州鑫泓设备设计有限公司 | Virtual live broadcast system and method |
| CN114786023A (en) * | 2022-03-28 | 2022-07-22 | 南京小灿灿网络科技有限公司 | AR live broadcast system based on virtual reality |
| CN115113963A (en) * | 2022-06-29 | 2022-09-27 | 北京百度网讯科技有限公司 | Information display method and device, electronic equipment and storage medium |
| CN116320521A (en) * | 2023-03-24 | 2023-06-23 | 吉林动画学院 | Three-dimensional animation live broadcast method and device based on artificial intelligence |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050130725A1 (en) * | 2003-12-15 | 2005-06-16 | International Business Machines Corporation | Combined virtual and video game |
| CN101494547A (en) * | 2009-03-05 | 2009-07-29 | 广东威创视讯科技股份有限公司 | Method and system for implementing conference combining local conference and network conference equipment |
| CN102377745A (en) * | 2010-08-19 | 2012-03-14 | 上海济丽信息技术有限公司 | Interactive collaboration system based on large spliced screen and interactive collaboration method |
| US20130083173A1 (en) * | 2011-09-30 | 2013-04-04 | Kevin A. Geisner | Virtual spectator experience with a personal audio/visual apparatus |
| CN105657294A (en) * | 2016-03-09 | 2016-06-08 | 北京奇虎科技有限公司 | Method and device for presenting virtual special effect on mobile terminal |
| CN105828106A (en) * | 2016-04-15 | 2016-08-03 | 山东大学苏州研究院 | Non-integral multiple frame rate improving method based on motion information |
| CN106383587A (en) * | 2016-10-26 | 2017-02-08 | 腾讯科技（深圳）有限公司 | Augmented reality scene generation method, device and equipment |
| CN106648120A (en) * | 2017-02-21 | 2017-05-10 | 戴雨霖 | Training system for escape from fire based on virtual reality and somatosensory technology |
| CN106937154A (en) * | 2017-03-17 | 2017-07-07 | 北京蜜枝科技有限公司 | Process the method and device of virtual image |
| CN106993195A (en) * | 2017-03-24 | 2017-07-28 | 广州创幻数码科技有限公司 | Virtual portrait role live broadcasting method and system |
| CN107170030A (en) * | 2017-05-31 | 2017-09-15 | 珠海金山网络游戏科技有限公司 | A kind of virtual newscaster's live broadcasting method and system |
| CN107274464A (en) * | 2017-05-31 | 2017-10-20 | 珠海金山网络游戏科技有限公司 | A kind of methods, devices and systems of real-time, interactive 3D animations |
| CN107438183A (en) * | 2017-07-26 | 2017-12-05 | 北京暴风魔镜科技有限公司 | A kind of virtual portrait live broadcasting method, apparatus and system |
-
2018
- 2018-01-12 CN CN201810031218.1A patent/CN108200446B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050130725A1 (en) * | 2003-12-15 | 2005-06-16 | International Business Machines Corporation | Combined virtual and video game |
| CN101494547A (en) * | 2009-03-05 | 2009-07-29 | 广东威创视讯科技股份有限公司 | Method and system for implementing conference combining local conference and network conference equipment |
| CN102377745A (en) * | 2010-08-19 | 2012-03-14 | 上海济丽信息技术有限公司 | Interactive collaboration system based on large spliced screen and interactive collaboration method |
| US20130083173A1 (en) * | 2011-09-30 | 2013-04-04 | Kevin A. Geisner | Virtual spectator experience with a personal audio/visual apparatus |
| CN105657294A (en) * | 2016-03-09 | 2016-06-08 | 北京奇虎科技有限公司 | Method and device for presenting virtual special effect on mobile terminal |
| CN105828106A (en) * | 2016-04-15 | 2016-08-03 | 山东大学苏州研究院 | Non-integral multiple frame rate improving method based on motion information |
| CN106383587A (en) * | 2016-10-26 | 2017-02-08 | 腾讯科技（深圳）有限公司 | Augmented reality scene generation method, device and equipment |
| CN106648120A (en) * | 2017-02-21 | 2017-05-10 | 戴雨霖 | Training system for escape from fire based on virtual reality and somatosensory technology |
| CN106937154A (en) * | 2017-03-17 | 2017-07-07 | 北京蜜枝科技有限公司 | Process the method and device of virtual image |
| CN106993195A (en) * | 2017-03-24 | 2017-07-28 | 广州创幻数码科技有限公司 | Virtual portrait role live broadcasting method and system |
| CN107170030A (en) * | 2017-05-31 | 2017-09-15 | 珠海金山网络游戏科技有限公司 | A kind of virtual newscaster's live broadcasting method and system |
| CN107274464A (en) * | 2017-05-31 | 2017-10-20 | 珠海金山网络游戏科技有限公司 | A kind of methods, devices and systems of real-time, interactive 3D animations |
| CN107438183A (en) * | 2017-07-26 | 2017-12-05 | 北京暴风魔镜科技有限公司 | A kind of virtual portrait live broadcasting method, apparatus and system |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108986192A (en) * | 2018-07-26 | 2018-12-11 | 北京运多多网络科技有限公司 | Data processing method and device for live streaming |
| CN109240709A (en) * | 2018-07-26 | 2019-01-18 | 北京运多多网络科技有限公司 | SDK cut-in method and device for live streaming |
| CN108986192B (en) * | 2018-07-26 | 2024-01-30 | 北京运多多网络科技有限公司 | Data processing method and device for live broadcast |
| CN109448467A (en) * | 2018-11-01 | 2019-03-08 | 深圳市木愚科技有限公司 | A kind of virtual image teacher teaching program request interaction systems |
| CN110139115A (en) * | 2019-04-30 | 2019-08-16 | 广州虎牙信息科技有限公司 | Virtual image attitude control method, device and electronic equipment based on key point |
| CN110071938A (en) * | 2019-05-05 | 2019-07-30 | 广州虎牙信息科技有限公司 | Virtual image interactive method, apparatus, electronic equipment and readable storage medium storing program for executing |
| CN110071938B (en) * | 2019-05-05 | 2021-12-03 | 广州虎牙信息科技有限公司 | Virtual image interaction method and device, electronic equipment and readable storage medium |
| CN110225400A (en) * | 2019-07-08 | 2019-09-10 | 北京字节跳动网络技术有限公司 | A kind of motion capture method, device, mobile terminal and storage medium |
| CN110225400B (en) * | 2019-07-08 | 2022-03-04 | 北京字节跳动网络技术有限公司 | Motion capture method and device, mobile terminal and storage medium |
| CN110910691B (en) * | 2019-11-28 | 2021-09-24 | 深圳市木愚科技有限公司 | Personalized course generation method and system |
| CN110910691A (en) * | 2019-11-28 | 2020-03-24 | 深圳市木愚科技有限公司 | Personalized course generation method and system |
| CN110971930A (en) * | 2019-12-19 | 2020-04-07 | 广州酷狗计算机科技有限公司 | Live virtual image broadcasting method, device, terminal and storage medium |
| CN112164128A (en) * | 2020-09-07 | 2021-01-01 | 广州汽车集团股份有限公司 | Music visual interaction method and computer equipment for vehicle-mounted multimedia |
| CN112164128B (en) * | 2020-09-07 | 2024-06-11 | 广州汽车集团股份有限公司 | Vehicle-mounted multimedia music visual interaction method and computer equipment |
| CN112634684B (en) * | 2020-12-11 | 2023-05-30 | 深圳市木愚科技有限公司 | Intelligent teaching method and device |
| CN112634684A (en) * | 2020-12-11 | 2021-04-09 | 深圳市木愚科技有限公司 | Intelligent teaching method and device |
| CN112788355A (en) * | 2020-12-30 | 2021-05-11 | 北京达佳互联信息技术有限公司 | Information processing method, device and storage medium |
| CN112788355B (en) * | 2020-12-30 | 2022-08-23 | 北京达佳互联信息技术有限公司 | Information processing method, device and storage medium |
| CN112732084A (en) * | 2021-01-13 | 2021-04-30 | 西安飞蝶虚拟现实科技有限公司 | Future classroom interaction system and method based on virtual reality technology |
| CN113132741A (en) * | 2021-03-03 | 2021-07-16 | 广州鑫泓设备设计有限公司 | Virtual live broadcast system and method |
| CN114786023A (en) * | 2022-03-28 | 2022-07-22 | 南京小灿灿网络科技有限公司 | AR live broadcast system based on virtual reality |
| CN115113963B (en) * | 2022-06-29 | 2023-04-07 | 北京百度网讯科技有限公司 | Information display method and device, electronic equipment and storage medium |
| CN115113963A (en) * | 2022-06-29 | 2022-09-27 | 北京百度网讯科技有限公司 | Information display method and device, electronic equipment and storage medium |
| CN116320521A (en) * | 2023-03-24 | 2023-06-23 | 吉林动画学院 | Three-dimensional animation live broadcast method and device based on artificial intelligence |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108200446B (en) | 2021-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108200446A (en) | Multimedia interactive system and method on the line of virtual image | |
| CN107241646B (en) | Multimedia video editing method and device | |
| US11670015B2 (en) | Method and apparatus for generating video | |
| CN107770626A (en) | Processing method, image synthesizing method, device and the storage medium of video material | |
| EP4099709A1 (en) | Data processing method and apparatus, device, and readable storage medium | |
| CN107438183A (en) | A kind of virtual portrait live broadcasting method, apparatus and system | |
| KR20220077132A (en) | Method and system for generating binaural immersive audio for audiovisual content | |
| WO2021082823A1 (en) | Audio processing method, apparatus, computer device, and storage medium | |
| CN107578777A (en) | Word-information display method, apparatus and system, audio recognition method and device | |
| CN108305308A (en) | It performs under the line of virtual image system and method | |
| KR20220148915A (en) | Audio processing methods, apparatus, readable media and electronic devices | |
| JP2022533911A (en) | MULTIMEDIA INTERACTIVE METHOD, DEVICE, APPARATUS AND STORAGE MEDIA | |
| CN108124170A (en) | A kind of video broadcasting method, device and terminal device | |
| CN113592985A (en) | Method and device for outputting mixed deformation value, storage medium and electronic device | |
| CN104113682B (en) | A kind of image acquiring method and electronic equipment | |
| CN112669846A (en) | Interactive system, method, device, electronic equipment and storage medium | |
| CN106101858A (en) | A kind of video generation method and device | |
| CN111629222A (en) | Video processing method, device and storage medium | |
| CN106604047A (en) | Multi-video-stream video direct broadcasting method and device | |
| CN114500879A (en) | Video data processing method, device, equipment and storage medium | |
| CN113821104A (en) | Visual interactive system based on holographic projection | |
| CN115426467A (en) | Video call-based film watching accompanying method, device and medium | |
| CN115661005B (en) | Custom digital person generation method and equipment | |
| US11470404B2 (en) | Consistent generation of media elements across media | |
| CN115243097B (en) | Recording method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |