CN109271553A - A kind of virtual image video broadcasting method, device, electronic equipment and storage medium - Google Patents

A kind of virtual image video broadcasting method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN109271553A
CN109271553A CN201811014984.3A CN201811014984A CN109271553A CN 109271553 A CN109271553 A CN 109271553A CN 201811014984 A CN201811014984 A CN 201811014984A CN 109271553 A CN109271553 A CN 109271553A
Authority
CN
China
Prior art keywords
virtual image
user
time period
preset time
live streaming
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811014984.3A
Other languages
Chinese (zh)
Inventor
黄苏豪
卢俊达
刘岳
张艳坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuomi Private Ltd
Original Assignee
Happy Honey Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Happy Honey Co Ltd filed Critical Happy Honey Co Ltd
Priority to CN201811014984.3A priority Critical patent/CN109271553A/en
Publication of CN109271553A publication Critical patent/CN109271553A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides a kind of virtual image video broadcasting method, device, electronic equipment and storage mediums, in this method, in the first preset time period, obtain user's face information and audio-frequency information, according to face information and default virtual image model, virtual image of the user in the first preset time period is generated in real time, according to virtual image and audio-frequency information, virtual image video of the user in the first preset time period is generated in real time, plays virtual image video of the user in the first preset time period in the target position at live streaming interface.In the present invention, according to face information and default virtual image model, generate virtual image of the user in the first preset time period, according to virtual image and audio-frequency information, it generates virtual image video of the user in the first preset time period and is played out in the target position at live streaming interface, provide as a result, it is a kind of virtual image replace authentic image participate in live streaming by way of, improve the interest of live streaming.

Description

A kind of virtual image video broadcasting method, device, electronic equipment and storage medium
Technical field
The present invention relates to direct seeding technique fields, set more particularly to a kind of virtual image video broadcasting method, device, electronics Standby and storage medium.
Background technique
Currently, main broadcaster can carry out net cast by the live streaming APP in used electronic equipment, broadcasted for spectators excellent Program, spectators by live streaming APP watch main broadcaster live streaming.
In the related technology, live streaming APP can also realize that spectators interact with main broadcaster, and in interactive process, either main broadcaster is gone back It is spectators, being broadcast live shown in interface is reality image, causes interest poor.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of virtual image video broadcasting method, device, electronic equipment and deposits Storage media promotes the interest of live streaming.Specific technical solution is as follows:
A kind of virtual image video broadcasting method is applied to electronic equipment, which comprises
In the first preset time period, user's face information and audio-frequency information are obtained;
According to the face information and default virtual image model, the user is generated in real time when described first is default Between virtual image in section;
According to the virtual image and the audio-frequency information, the user is generated in real time in first preset time period Interior virtual image video;
Virtual image video of the user in first preset time period is played in the target position at live streaming interface.
Optionally, described according to the face information and default virtual image model, the user is generated in real time in institute The step of stating the virtual image in the first preset time period, comprising:
According to the face information, face feature point letter of the user in first preset time period is determined in real time Breath;
It adjusts the facial expression of the default virtual image model in real time by the face feature point information, generates in real time Virtual image of the user in first preset time period.
Optionally, when the user is main sowing time, the target position at live streaming interface plays the user described The step of virtual image video in first preset time period, comprising:
Detect whether the live streaming interface shows comment area;
If so, virtual image video of the main broadcaster in first preset time period is played in the comment area, Live streaming area in the live streaming interface in addition to the comment area plays virtual shape of the main broadcaster in the second preset time period As video;
If not, playing void of the main broadcaster in first preset time period in the target position at the live streaming interface Quasi- image video.
Optionally, when the user is spectators, the target position at live streaming interface plays the user described The step of virtual image video in first preset time period, comprising:
Detect whether the live streaming interface shows comment area;
If so, playing virtual image of the spectators in first preset time period in the comment area at live streaming interface Video.
Optionally, the method also includes:
Receive and record the posture information of the virtual image of user's selection;
When receiving the game command that the user issues, interface corresponding with the game command is shown;
Obtain the operation information that the user is directed to the interface;
The posture information of the virtual image is adjusted according to the operation information.
Optionally, the method also includes:
It receives user and opens map instructions, show map interface;
Obtain the geographical location of the electronic equipment;
In the map interface, display position corresponding with the geographical location is determined;
The virtual image of user's selection is shown in the display position.
A kind of virtual image video play device, is applied to electronic equipment, and described device includes:
Module is obtained, for obtaining user's face information and audio-frequency information in the first preset time period;
Virtual image generation module, for generating institute in real time according to the face information and default virtual image model State virtual image of the user in first preset time period;
Virtual image video generation module, for generating institute in real time according to the virtual image and the audio-frequency information State virtual image video of the user in first preset time period;
Playing module, for playing the user in first preset time period in the target position at live streaming interface Virtual image video.
Optionally, the virtual image generation module, comprising:
Face feature point information determines submodule, for determining the user described in real time according to the face information Face feature point information in first preset time period;
Virtual image generates submodule, for adjusting the default virtual image in real time by the face feature point information The facial expression of model generates virtual image of the user in first preset time period in real time.
Optionally, when the user is main sowing time, the playing module, comprising:
First detection sub-module, for detecting whether the live streaming interface shows comment area, if so, triggering first plays Submodule, if not, triggering second plays submodule;
Described first plays submodule, for playing the main broadcaster in first preset time period in the comment area Virtual image video, the live streaming area in the live streaming interface in addition to the comment area plays the main broadcaster when second is default Between virtual image video in section;
Described second plays submodule, for playing the main broadcaster described first in the target position at the live streaming interface Virtual image video in preset time period.
Optionally, when the user is spectators, the playing module, comprising:
Second detection sub-module, for detecting whether the live streaming interface shows comment area, if so, triggering third plays Submodule;
The third plays submodule, for playing the spectators when described first is default in the comment area at live streaming interface Between virtual image video in section.
Optionally, described device further include:
Logging modle, the posture information of the virtual image for receiving and recording user's selection;
Interface display module, for when receiving the game command that the user issues, display to refer to the game Enable corresponding interface;
Operation information acquisition module, the operation information for being directed to the interface for obtaining the user;
Module is adjusted, for adjusting the posture information of the virtual image according to the operation information.
Optionally, described device further include:
Map interface display module opens map instructions for receiving user, shows map interface;
Geographical location obtains module, for obtaining the geographical location of the electronic equipment;
Display position determining module, for determining display corresponding with geographical location position in the map interface It sets;
Virtual image display module, for showing the virtual image of user's selection in the display position.
A kind of electronic equipment, including processor and memory, wherein
Memory, for storing computer program;
Processor when for executing the computer program stored on memory, realizes any of the above-described method step Suddenly.
A kind of computer readable storage medium is stored with computer program in the computer readable storage medium, described Any of the above-described method and step is realized when computer program is executed by processor.
In the embodiment of the present invention, in the first preset time period, user's face information and audio-frequency information are obtained, according to people Face information and default virtual image model generate virtual image of the user in the first preset time period, according to virtual in real time Image and audio-frequency information generate virtual image video of the user in the first preset time period, the mesh at live streaming interface in real time Cursor position plays virtual image video of the user in the first preset time period.In the present invention, first according to face information and Default virtual image model generates virtual image of the user in the first preset time period in real time, then according to virtual image with And audio-frequency information, virtual image video of the user in the first preset time period is generated in real time, finally in the target at live streaming interface Position plays virtual image video of the user in the first preset time period, allows and no longer shows that user's is true in live streaming Real image, but the virtual image video of user is played, one kind is provided as a result, to be participated in by virtual image instead of authentic image The mode of live streaming improves the interest of live streaming.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Fig. 1 is the first flow diagram of virtual image video broadcasting method provided in an embodiment of the present invention;
Fig. 2 be it is provided in an embodiment of the present invention according to face information and default virtual image model, generate user in real time The flow diagram of virtual image in the first preset time period;
Fig. 3 is that the target position provided in an embodiment of the present invention at live streaming interface plays user in the first preset time period Virtual image video the first flow diagram;
Fig. 4 is that the target position provided in an embodiment of the present invention at live streaming interface plays user in the first preset time period Virtual image video second of flow diagram;
Fig. 5 is second of flow diagram of virtual image video broadcasting method provided in an embodiment of the present invention;
Fig. 6 is the third flow diagram of virtual image video broadcasting method provided in an embodiment of the present invention;
Fig. 7 is the structural schematic diagram of virtual image video play device provided in an embodiment of the present invention;
Fig. 8 is the structural schematic diagram of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
A kind of virtual image video broadcasting method is provided for the embodiments of the invention first below to be introduced.
A kind of virtual image video broadcasting method provided in an embodiment of the present invention is applied to electronic equipment, wherein electronics is set It is standby to can include but is not limited to following equipment: mobile phone, tablet computer.
As shown in Figure 1, a kind of virtual image video broadcasting method provided in an embodiment of the present invention, this method may include:
S101: in the first preset time period, user's face information and audio-frequency information are obtained.
Currently, main broadcaster can broadcast excellent program by way of net cast for spectators.Main broadcaster is straight in progress video Sowing time, spectators can also can be interacted with watching video live broadcast, spectators with main broadcaster.
Due in the related technology, it is reality image used in the interactive process, causes interest poor, therefore, this In inventive embodiments, in order to improve interest, reality image is replaced to be interacted with virtual image.
When replacing reality image with virtual image, the expression of virtual image is, virtual image identical with reality image Sound be also it is identical as the sound of reality image, therefore, in order to replace reality image with virtual image, need default first In period, user's face information and audio-frequency information are obtained.
In order to obtain user's face information, needs to acquire the video information of user, acquire the mode of the video information of user It can be to acquire the video information of user by the camera of electronic equipment, and identify the face information in video information, thus Obtain user's face information.
In order to obtain audio-frequency information, needs to acquire the audio-frequency information of user by the microphone of electronic equipment, thus obtain Audio-frequency information.
S102: according to face information and default virtual image model, user is generated in real time in the first preset time period Virtual image.
Obtain in the first preset time period user's face information and audio-frequency information after, can be according to face information And default virtual image model, virtual image of the user in the first preset time period is generated in real time.
Wherein, presetting virtual image model can be virtual figure image model or virtual animal model of image etc..
Since the expression of virtual image and reality image is consistent, it is above-mentioned according to face information and default empty Quasi- model of image generates virtual image of the user in the first preset time period in real time, can be with are as follows: is generated and is used based on facial expression Virtual image of the family in the first preset time period.Referring to fig. 2, step S102 may include:
S1021: according to face information, face feature point information of the user in the first preset time period is determined in real time.
In order to which virtual image of the user in the first preset time period can be generated according to facial expression, need according to face Information determines face feature point information of the user in the first preset time period in real time.
Wherein, face feature point is the multiple points that can characterize facial characteristics being distributed on face, therefore, facial characteristics Point information can characterize the expression of user.
Illustratively, face feature point may include eye feature point, nose characteristic point, mouth characteristic point, eyebrow characteristic point, face Portion's muscular features point etc..
S1022: it adjusts the facial expression of default virtual image model in real time by face feature point information, generates use in real time Virtual image of the family in the first preset time period.
After determining face feature point information, default virtual image model can be adjusted in real time by face feature point information Facial expression, generate virtual image of the user in the first preset time period in real time.
The facial expression for adjusting default virtual image model in real time above by face feature point information may include:
The form that the eye of default virtual image model is adjusted by eye feature point information, is adjusted by nose characteristic point The form of the nose of default virtual image model is adjusted the form of the mouth of default virtual image model by mouth characteristic point, passed through Eyebrow characteristic point adjusts the form of the eyebrow of default virtual image model, adjusts default virtual image model by facial muscles characteristic point Facial muscles form.
The each form for adjusting default virtual image model namely adjusts the facial expression of default virtual image model, real When generate the virtual image of user.
As a result, by having determined user in the first preset time period in real time in the face information in the first preset time period Face feature point information, and be adjusted, made based on facial expression of the face feature point information to default virtual image model The facial expression that virtual image model must be preset is close to the facial expression of true face, reaches and generates user in real time first The purpose of virtual image in preset time period.
S103: according to virtual image and audio-frequency information, virtual shape of the user in the first preset time period is generated in real time As video.
Be since the sound of virtual image is with the sound of reality image it is identical, generating user first After virtual image in preset time period, need that it is default first to generate user in real time according to virtual image and audio-frequency information Virtual image video in period.
It is above-mentioned according to virtual image and audio-frequency information, generate virtual image of the user in the first preset time period in real time Video can be with are as follows: is associated with audio-frequency information with virtual image, generates virtual image of the user in the first preset time period in real time Video.
S104: virtual image video of the user in the first preset time period is played in the target position at live streaming interface.
User is being generated after the virtual image video in the first preset time period, it can be in the target position at live streaming interface Play virtual image video of the user in the first preset time period.Wherein, target position can exist for the authentic image of user The position in interface is broadcast live.
It can be in virtual image video of the user that the target position at live streaming interface plays in the first preset time period Virtual image video of the user in once certain time period is also possible to virtual image view of the user in current slot Frequently.
Due to during net cast, not only there are spectators but also there are main broadcasters, therefore, user may be that main broadcaster may also be Therefore spectators when playing virtual image video of the user in the first preset time period, need to be carried out according to the type of user It plays.
When user is main sowing time, referring to Fig. 3, step S104 may include:
S1041: whether detection live streaming interface shows comment area, if so, step S1042 is executed, if not, executing step S1043。
During net cast, spectators can live streaming interface comment area make comments, comment area can according to The selection at family carries out show or hide.When commenting on area's display, in order to increase interest, the void of main broadcaster can be shown in comment area The virtual images of quasi- image and spectators, therefore, it is necessary to detect whether live streaming interface shows comment area, and according to testing result into Row subsequent step.
S1042: virtual image video of the main broadcaster in the first preset time period is played in comment area, is removed in live streaming interface The live streaming area commented on outside area plays virtual image video of the main broadcaster in the second preset time period.
When detecting live streaming interface display comment area, in order to increase the interest in comment area, master can be played in comment area Broadcast the virtual image video in the first preset time period.Due to being currently broadcast live, and hence it is also possible at live streaming interface In live streaming area in addition to commenting on area play virtual image video of the main broadcaster in the second preset time period.
That is, currently playing the virtual image video of main broadcaster in the comment area at live streaming interface and live streaming area.The One preset time period may be the same or different with the second preset time period.If the first preset time period is default with second Period is identical, then spectators can watch the virtual image video in any one region, if the first preset time period is pre- with second If the period is different, then right to choose is provided for spectators, spectators can select to watch the void in which region according to self-demand Quasi- image video.
Wherein, playing the position of virtual image video of the main broadcaster in the first preset time period in comment area can be comment Upper left corner area, upper right comer region, lower left corner region and the bottom right angular region in area are including but not limited to commented in any position in area Domain.Similar, it may be live streaming in the position that live streaming area plays virtual image video of the main broadcaster in the second preset time period Any position in area.
S1043: virtual image video of the main broadcaster in the first preset time period is played in the target position at live streaming interface.
When detecting that live streaming interface does not show comment area, then main broadcaster only is played first in the target position at live streaming interface Virtual image video in preset time period.Wherein, target position can be position of the authentic image of user in live streaming interface It sets.
It is as a result, main sowing time in user, whether detection live streaming interface shows comment area, and according to testing result, with difference Mode play virtual image video of the main broadcaster in the first preset time period, wherein when be broadcast live interface display comment area when, can To show virtual image video of the main broadcaster in the first preset time period in comment area, so that comment area can not only show and comment By, while can also show the virtual image video of main broadcaster, allow spectators to watch the virtual image of main broadcaster in comment area Video improves spectators and uses the interest in comment area.
When user is spectators, referring to fig. 4, step S104 may include:
S1044: whether detection live streaming interface shows comment area, if so, step S1045 is executed, if not, not doing any Processing.
During net cast, spectators can live streaming interface comment area make comments, comment area can according to The selection at family carries out show or hide.When commenting on area's display, in order to increase interest, the void of spectators can be shown in comment area Quasi- image therefore, it is necessary to detect whether live streaming interface shows comment area, and carries out subsequent step according to testing result.
S1045: virtual image video of the spectators in the first preset time period is played in the comment area at live streaming interface.
When detecting live streaming interface display comment area, spectators can be played in the first preset time period in comment area Virtual image video.At this point, spectators not only can watch the virtual image video of main broadcaster in comment area, can also watch certainly The virtual image video of body.
It is as a result, main sowing time in user, whether detection live streaming interface shows comment area, and when detection shows comment area, Virtual image video of the spectators in the first preset time period is played, so that comment area can not only show comment, while may be used also To show the virtual image video of spectators, the virtual image video for allowing spectators to watch itself in comment area is improved Spectators use the interest for commenting on area.
In the embodiment of the present invention, in the first preset time period, user's face information and audio-frequency information are obtained, according to people Face information and default virtual image model generate virtual image of the user in the first preset time period, according to virtual in real time Image and audio-frequency information generate virtual image video of the user in the first preset time period, the mesh at live streaming interface in real time Cursor position plays virtual image video of the user in the first preset time period.In the present invention, first according to face information and Default virtual image model generates virtual image of the user in the first preset time period in real time, then according to virtual image with And audio-frequency information, virtual image video of the user in the first preset time period is generated in real time, finally in the target at live streaming interface Position plays virtual image video of the user in the first preset time period, allows and no longer shows that user's is true in live streaming Real image, but the virtual image video of user is played, one kind is provided as a result, to be participated in by virtual image instead of authentic image The mode of live streaming improves the interest of live streaming.
On the basis of method shown in Fig. 1, as shown in figure 5, a kind of virtual image video provided in an embodiment of the present invention is broadcast Method is put, can also include:
S105: receiving and records the posture information of the virtual image of user's selection.
During live streaming, main broadcaster and spectators can attend a game, and in gaming, can not only show virtual image Head can also show the body of virtual image, and therefore, virtual image is corresponding with posture information.
Before attending a game, user can choose different virtual images, such as: user can choose panda and can also select Dog is selected, after user's selection, receives and record the posture information of the virtual image of user's selection, wherein posture information can wrap Include the size of the four limbs of virtual image and the size on head.
S106: when receiving the game command that user issues, interface corresponding with game command is shown.
User can carry out game after selecting virtual image, at this point, user issues game command, electronic equipment is received The game command that user issues shows interface corresponding with game command.
S107: the operation information that user is directed to interface is obtained.
In carrying out game process, user can operate interface, and electronic equipment obtains user and is directed to game circle The operation information in face.
Such as: user can operate virtual image and run, into room etc..
S108: the posture information of virtual image is adjusted according to operation information.
After obtaining operation information of the user for interface, the posture of virtual image can be adjusted according to operation information Information.
Such as: operation information is that operation virtual image is eaten, then the posture for adjusting virtual image becomes fat, and operation information is Operation virtual image goes to gymnasium, then the posture for adjusting virtual image reduces.
Wherein, adjust virtual image posture become it is fat can be with are as follows: the four limbs of virtual image are tuned up according to default Adjustment principle Size and head size.
The posture of adjustment virtual image reduces can be with are as follows: turns the size of the four limbs of virtual image down according to default Adjustment principle And the size on head.
As a result, in game process, it can change the posture of virtual image based on user operation, increase game Interest.
On the basis of method shown in Fig. 1, as shown in fig. 6, a kind of virtual image video provided in an embodiment of the present invention is broadcast Method is put, can also include:
S109: it receives user and opens map instructions, show map interface.
During live streaming, map function is can be used in user, such as: when user is spectators, map function can be passed through It can check itself position, can also check nearby with the presence or absence of main broadcaster, in order to watch main broadcaster's live streaming.When user opens ground When figure, electronic equipment receives user and opens map instructions, shows map interface.
S110: the geographical location of electronic equipment is obtained.
After showing map interface, need to obtain the geographical location of electronic equipment.Usual electronic equipment can position, example Such as: electronic equipment is positioned by GPS (Global Positioning System, global positioning system), is obtained electronics and is set Standby geographical location.
S111: in map interface, display position corresponding with geographical location is determined.
Behind the geographical location for obtaining electronic equipment, in map interface, target position corresponding with geographical location is determined.
S112: the virtual image of user's selection is shown in display position.
After determining display position, user can choose different virtual images, such as: user can choose panda can also To select dog, after user's selection, the virtual image of user's selection can be shown in display position.
As a result, by way of in the virtual image that the display position of map interface shows user's selection, user is increased Interest when using map.
Relative to above method embodiment, referring to Fig. 7, the embodiment of the invention also provides a kind of virtual image video playings Device is applied to electronic equipment, the apparatus may include:
Module 701 is obtained, for obtaining user's face information and audio-frequency information in the first preset time period;
Virtual image generation module 702, for being generated in real time according to the face information and default virtual image model The virtual image of the user;
Virtual image video generation module 703, for being generated in real time according to the virtual image and the audio-frequency information Virtual image video of the user in first preset time period;
Playing module 704, for playing the user in first preset time period in the target position at live streaming interface Interior virtual image video.
In the embodiment of the present invention, in the first preset time period, user's face information and audio-frequency information are obtained, according to people Face information and default virtual image model generate virtual image of the user in the first preset time period, according to virtual in real time Image and audio-frequency information generate virtual image video of the user in the first preset time period, the mesh at live streaming interface in real time Cursor position plays virtual image video of the user in the first preset time period.In the present invention, first according to face information and Default virtual image model generates virtual image of the user in the first preset time period in real time, then according to virtual image with And audio-frequency information, virtual image video of the user in the first preset time period is generated in real time, finally in the target at live streaming interface Position plays virtual image video of the user in the first preset time period, allows and no longer shows that user's is true in live streaming Real image, but the virtual image video of user is played, one kind is provided as a result, to be participated in by virtual image instead of authentic image The mode of live streaming improves the interest of live streaming.
In a kind of implementation of the invention, the virtual image generation module 702 may include:
Face feature point information determines submodule, for determining the user described in real time according to the face information Face feature point information in first preset time period;
Virtual image generates submodule, for adjusting the default virtual image in real time by the face feature point information The facial expression of model generates virtual image of the user in first preset time period in real time.
In a kind of implementation of the invention, when the user is main sowing time, the playing module 704 may include:
First detection sub-module, for detecting whether the live streaming interface shows comment area, if so, triggering first plays Submodule, if not, triggering second plays submodule;
Described first plays submodule, for playing the main broadcaster in first preset time period in the comment area Virtual image video, the live streaming area in the live streaming interface in addition to the comment area plays the main broadcaster when second is default Between virtual image video in section;
Described second plays submodule, for playing the main broadcaster described first in the target position at the live streaming interface Virtual image video in preset time period.
In a kind of implementation of the invention, when the user is spectators, the playing module 704 may include:
Second detection sub-module, for detecting whether the live streaming interface shows comment area, if so, triggering third plays Submodule;
The third plays submodule, for playing the spectators when described first is default in the comment area at live streaming interface Between virtual image video in section.
In a kind of implementation of the invention, described device can also include:
Logging modle, the posture information of the virtual image for receiving and recording user's selection;
Interface display module, for when receiving the game command that the user issues, display to refer to the game Enable corresponding interface;
Operation information acquisition module, the operation information for being directed to the interface for obtaining the user;
Module is adjusted, for adjusting the posture information of the virtual image according to the operation information.
In a kind of implementation of the invention, described device can also include:
Map interface display module opens map instructions for receiving user, shows map interface;
Geographical location obtains module, for obtaining the geographical location of the electronic equipment;
Display position determining module, for determining display corresponding with geographical location position in the map interface It sets;
Virtual image display module, for showing the virtual image of user's selection in the display position.
The embodiment of the invention also provides a kind of electronic equipment, as shown in figure 8, including processor 801 and memory 802,
Memory 802, for storing computer program;
Processor 801 when for executing the computer program stored on memory 802, realizes that virtual image video is broadcast Method is put, this method may include steps of:
In the first preset time period, user's face information and audio-frequency information are obtained;
According to the face information and default virtual image model, the user is generated in real time when described first is default Between virtual image in section;
According to the virtual image and the audio-frequency information, the user is generated in real time in first preset time period Interior virtual image video;
Virtual image video of the user in first preset time period is played in the target position at live streaming interface.
In the embodiment of the present invention, electronic equipment obtains user's face information and audio letter in the first preset time period Breath generates virtual image of the user in the first preset time period according to face information and default virtual image model in real time, According to virtual image and audio-frequency information, virtual image video of the user in the first preset time period is generated in real time, is being broadcast live The target position at interface plays virtual image video of the user in the first preset time period.In the present invention, first according to face Information and default virtual image model generate virtual image of the user in the first preset time period, then according to void in real time Quasi- image and audio-frequency information generate virtual image video of the user in the first preset time period in real time, finally on live streaming circle The target position in face plays virtual image video of the user in the first preset time period, allows and no longer shows in live streaming The authentic image of user, but the virtual image video of user is played, it provides as a result, a kind of true by virtual image replacement Image participates in the mode of live streaming, improves the interest of live streaming.
It is described according to the face information and default virtual image model in a kind of implementation of the invention, it is real The step of virtual image of the user described in Shi Shengcheng in first preset time period, may include:
According to the face information, face feature point letter of the user in first preset time period is determined in real time Breath;
It adjusts the facial expression of the default virtual image model in real time by the face feature point information, generates in real time Virtual image of the user in first preset time period.
In a kind of implementation of the invention, when the user be main sowing time, it is described live streaming interface target position The step of playing virtual image video of the user in first preset time period may include:
Detect whether the live streaming interface shows comment area;
If so, virtual image video of the main broadcaster in first preset time period is played in the comment area, Live streaming area in the live streaming interface in addition to the comment area plays virtual shape of the main broadcaster in the second preset time period As video;
If not, playing void of the main broadcaster in first preset time period in the target position at the live streaming interface Quasi- image video.
In a kind of implementation of the invention, when the user is spectators, the target position at live streaming interface The step of playing virtual image video of the user in first preset time period may include:
Detect whether the live streaming interface shows comment area;
If so, playing virtual image of the spectators in first preset time period in the comment area at live streaming interface Video.
In a kind of implementation of the invention, the method can also include:
Receive and record the posture information of the virtual image of user's selection;
When receiving the game command that the user issues, interface corresponding with the game command is shown;
Obtain the operation information that the user is directed to the interface;
The posture information of the virtual image is adjusted according to the operation information.
In a kind of implementation of the invention, the method can also include:
It receives user and opens map instructions, show map interface;
Obtain the geographical location of the electronic equipment;
In the map interface, display position corresponding with the geographical location is determined;
The virtual image of user's selection is shown in the display position.
The memory that above-mentioned electronic equipment is mentioned may include random access memory (Random Access Memory, It RAM), also may include nonvolatile memory (Non-Volatile Memory, NVM), for example, at least a disk storage Device.Optionally, memory can also be that at least one is located remotely from the storage device of aforementioned processor.
Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit, CPU), network processing unit (Network Processor, NP) etc.;It can also be digital signal processor (Digital Signal Processing, DSP), it is specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete Door or transistor logic, discrete hardware components.
The embodiment of the present invention also provides a kind of computer readable storage medium, storage in the computer readable storage medium There is computer program, virtual image video broadcasting method is realized when the computer program is executed by processor, this method can be with Include the following steps:
In the first preset time period, user's face information and audio-frequency information are obtained;
According to the face information and default virtual image model, the user is generated in real time when described first is default Between virtual image in section;
According to the virtual image and the audio-frequency information, the user is generated in real time in first preset time period Interior virtual image video;
Virtual image video of the user in first preset time period is played in the target position at live streaming interface.
In the embodiment of the present invention, when computer program is executed by processor in the first preset time period, user people is obtained Face information and audio-frequency information generate user when first is default according to face information and default virtual image model in real time Between virtual image in section void of the user in the first preset time period is generated according to virtual image and audio-frequency information in real time Quasi- image video plays virtual image video of the user in the first preset time period in the target position at live streaming interface.This hair In bright, first according to face information and default virtual image model, void of the user in the first preset time period is generated in real time Quasi- image generates virtual image of the user in the first preset time period then according to virtual image and audio-frequency information in real time Video finally plays virtual image video of the user in the first preset time period in the target position at live streaming interface, so that The authentic image of user can be no longer shown when live streaming, but plays the virtual image video of user, provided as a result, a kind of logical The mode that virtual image participates in live streaming instead of authentic image is crossed, the interest of live streaming is improved.
It is described according to the face information and default virtual image model in a kind of implementation of the invention, it is real The step of virtual image of the user described in Shi Shengcheng in first preset time period, may include:
According to the face information, face feature point letter of the user in first preset time period is determined in real time Breath;
It adjusts the facial expression of the default virtual image model in real time by the face feature point information, generates in real time Virtual image of the user in first preset time period.
In a kind of implementation of the invention, when the user be main sowing time, it is described live streaming interface target position The step of playing virtual image video of the user in first preset time period may include:
Detect whether the live streaming interface shows comment area;
If so, virtual image video of the main broadcaster in first preset time period is played in the comment area, Live streaming area in the live streaming interface in addition to the comment area plays virtual shape of the main broadcaster in the second preset time period As video;
If not, playing void of the main broadcaster in first preset time period in the target position at the live streaming interface Quasi- image video.
In a kind of implementation of the invention, when the user is spectators, the target position at live streaming interface The step of playing virtual image video of the user in first preset time period may include:
Detect whether the live streaming interface shows comment area;
If so, playing virtual image of the spectators in first preset time period in the comment area at live streaming interface Video.
In a kind of implementation of the invention, the method can also include:
Receive and record the posture information of the virtual image of user's selection;
When receiving the game command that the user issues, interface corresponding with the game command is shown;
Obtain the operation information that the user is directed to the interface;
The posture information of the virtual image is adjusted according to the operation information.
In a kind of implementation of the invention, the method can also include:
It receives user and opens map instructions, show map interface;
Obtain the geographical location of the electronic equipment;
In the map interface, display position corresponding with the geographical location is determined;
The virtual image of user's selection is shown in the display position.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention It is interior.

Claims (10)

1. a kind of virtual image video broadcasting method, which is characterized in that be applied to electronic equipment, which comprises
In the first preset time period, user's face information and audio-frequency information are obtained;
According to the face information and default virtual image model, the user is generated in real time in first preset time period Interior virtual image;
According to the virtual image and the audio-frequency information, the user is generated in real time in first preset time period Virtual image video;
Virtual image video of the user in first preset time period is played in the target position at live streaming interface.
2. the method according to claim 1, wherein described according to the face information and default virtual image Model, the step of generating virtual image of the user in first preset time period in real time, comprising:
According to the face information, face feature point information of the user in first preset time period is determined in real time;
The facial expression of the default virtual image model is adjusted in real time by the face feature point information, in real time described in generation Virtual image of the user in first preset time period.
3. described at live streaming interface the method according to claim 1, wherein when the user is main sowing time Target position plays the step of virtual image video of the user in first preset time period, comprising:
Detect whether the live streaming interface shows comment area;
If so, virtual image video of the main broadcaster in first preset time period is played in the comment area, in institute It states the live streaming area in live streaming interface in addition to the comment area and plays virtual image view of the main broadcaster in the second preset time period Frequently;
If not, playing virtual shape of the main broadcaster in first preset time period in the target position at the live streaming interface As video.
4. described at live streaming interface the method according to claim 1, wherein when the user is spectators Target position plays the step of virtual image video of the user in first preset time period, comprising:
Detect whether the live streaming interface shows comment area;
If so, playing virtual image view of the spectators in first preset time period in the comment area at live streaming interface Frequently.
5. method according to claim 1 to 4, which is characterized in that the method also includes:
Receive and record the posture information of the virtual image of user's selection;
When receiving the game command that the user issues, interface corresponding with the game command is shown;
Obtain the operation information that the user is directed to the interface;
The posture information of the virtual image is adjusted according to the operation information.
6. method according to claim 1 to 4, which is characterized in that the method also includes:
It receives user and opens map instructions, show map interface;
Obtain the geographical location of the electronic equipment;
In the map interface, display position corresponding with the geographical location is determined;
The virtual image of user's selection is shown in the display position.
7. a kind of virtual image video play device, which is characterized in that be applied to electronic equipment, described device includes:
Module is obtained, for obtaining user's face information and audio-frequency information in the first preset time period;
Virtual image generation module, for generating the use in real time according to the face information and default virtual image model Virtual image of the family in first preset time period;
Virtual image video generation module, for generating the use in real time according to the virtual image and the audio-frequency information Virtual image video of the family in first preset time period;
Playing module, it is virtual in first preset time period for playing the user in the target position at live streaming interface Vivid video.
8. device according to claim 7, which is characterized in that the virtual image generation module, comprising:
Face feature point information determines submodule, for determining the user described first in real time according to the face information Face feature point information in preset time period;
Virtual image generates submodule, for adjusting the default virtual image model in real time by the face feature point information Facial expression, generate virtual image of the user in first preset time period in real time.
9. a kind of electronic equipment, which is characterized in that including processor and memory, wherein
Memory, for storing computer program;
Processor when for executing the computer program stored on memory, realizes any method of claim 1-6 Step.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium Program realizes claim 1-6 any method and step when the computer program is executed by processor.
CN201811014984.3A 2018-08-31 2018-08-31 A kind of virtual image video broadcasting method, device, electronic equipment and storage medium Pending CN109271553A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811014984.3A CN109271553A (en) 2018-08-31 2018-08-31 A kind of virtual image video broadcasting method, device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811014984.3A CN109271553A (en) 2018-08-31 2018-08-31 A kind of virtual image video broadcasting method, device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN109271553A true CN109271553A (en) 2019-01-25

Family

ID=65187032

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811014984.3A Pending CN109271553A (en) 2018-08-31 2018-08-31 A kind of virtual image video broadcasting method, device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109271553A (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109872724A (en) * 2019-03-29 2019-06-11 广州虎牙信息科技有限公司 Virtual image control method, virtual image control device and electronic equipment
CN109922355A (en) * 2019-03-29 2019-06-21 广州虎牙信息科技有限公司 Virtual image live broadcasting method, virtual image live broadcast device and electronic equipment
CN110071938A (en) * 2019-05-05 2019-07-30 广州虎牙信息科技有限公司 Virtual image interactive method, apparatus, electronic equipment and readable storage medium storing program for executing
CN110602517A (en) * 2019-09-17 2019-12-20 腾讯科技(深圳)有限公司 Live broadcast method, device and system based on virtual environment
CN110827379A (en) * 2019-10-31 2020-02-21 北京字节跳动网络技术有限公司 Virtual image generation method, device, terminal and storage medium
CN111221495A (en) * 2020-01-06 2020-06-02 广东小天才科技有限公司 Visual interaction method and device and terminal equipment
CN111402399A (en) * 2020-03-10 2020-07-10 广州虎牙科技有限公司 Face driving and live broadcasting method and device, electronic equipment and storage medium
CN111432267A (en) * 2020-04-23 2020-07-17 深圳追一科技有限公司 Video adjusting method and device, electronic equipment and storage medium
CN111641844A (en) * 2019-03-29 2020-09-08 广州虎牙信息科技有限公司 Live broadcast interaction method and device, live broadcast system and electronic equipment
CN112153400A (en) * 2020-09-22 2020-12-29 北京达佳互联信息技术有限公司 Live broadcast interaction method and device, electronic equipment and storage medium
CN112396679A (en) * 2020-11-20 2021-02-23 北京字节跳动网络技术有限公司 Virtual object display method and device, electronic equipment and medium
CN112562705A (en) * 2019-05-05 2021-03-26 广州虎牙信息科技有限公司 Live broadcast interaction method and device, electronic equipment and readable storage medium
CN112689151A (en) * 2020-12-07 2021-04-20 深圳盈天下视觉科技有限公司 Live broadcast method and device, computer equipment and storage medium
CN113365146A (en) * 2021-06-04 2021-09-07 北京百度网讯科技有限公司 Method, apparatus, device, medium and product for processing video
CN113840158A (en) * 2021-10-11 2021-12-24 深圳追一科技有限公司 Virtual image generation method, device, server and storage medium
CN114007091A (en) * 2021-10-27 2022-02-01 北京市商汤科技开发有限公司 Video processing method and device, electronic equipment and storage medium
WO2022121557A1 (en) * 2020-12-11 2022-06-16 北京字跳网络技术有限公司 Live streaming interaction method, apparatus and device, and medium
WO2023138548A1 (en) * 2022-01-24 2023-07-27 北京字跳网络技术有限公司 Image processing method and apparatus, and device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050098456A (en) * 2004-04-07 2005-10-12 주식회사 알티캐스트 Participation in broadcast program by avatar and system which supports the participation
CN106878820A (en) * 2016-12-09 2017-06-20 北京小米移动软件有限公司 Living broadcast interactive method and device
CN107741809A (en) * 2016-12-21 2018-02-27 腾讯科技(深圳)有限公司 Interactive approach, terminal, server and system between a kind of virtual image
CN107750005A (en) * 2017-09-18 2018-03-02 迈吉客科技(北京)有限公司 Virtual interactive method and terminal
CN107911644A (en) * 2017-12-04 2018-04-13 吕庆祥 The method and device of video calling is carried out based on conjecture face expression

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050098456A (en) * 2004-04-07 2005-10-12 주식회사 알티캐스트 Participation in broadcast program by avatar and system which supports the participation
CN106878820A (en) * 2016-12-09 2017-06-20 北京小米移动软件有限公司 Living broadcast interactive method and device
CN107741809A (en) * 2016-12-21 2018-02-27 腾讯科技(深圳)有限公司 Interactive approach, terminal, server and system between a kind of virtual image
CN107750005A (en) * 2017-09-18 2018-03-02 迈吉客科技(北京)有限公司 Virtual interactive method and terminal
CN107911644A (en) * 2017-12-04 2018-04-13 吕庆祥 The method and device of video calling is carried out based on conjecture face expression

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109922355A (en) * 2019-03-29 2019-06-21 广州虎牙信息科技有限公司 Virtual image live broadcasting method, virtual image live broadcast device and electronic equipment
CN109872724A (en) * 2019-03-29 2019-06-11 广州虎牙信息科技有限公司 Virtual image control method, virtual image control device and electronic equipment
CN111641844B (en) * 2019-03-29 2022-08-19 广州虎牙信息科技有限公司 Live broadcast interaction method and device, live broadcast system and electronic equipment
CN111641844A (en) * 2019-03-29 2020-09-08 广州虎牙信息科技有限公司 Live broadcast interaction method and device, live broadcast system and electronic equipment
WO2020200080A1 (en) * 2019-03-29 2020-10-08 广州虎牙信息科技有限公司 Virtual image live broadcast method, virtual image live broadcast apparatus and electronic device
CN112562705A (en) * 2019-05-05 2021-03-26 广州虎牙信息科技有限公司 Live broadcast interaction method and device, electronic equipment and readable storage medium
CN110071938A (en) * 2019-05-05 2019-07-30 广州虎牙信息科技有限公司 Virtual image interactive method, apparatus, electronic equipment and readable storage medium storing program for executing
CN110071938B (en) * 2019-05-05 2021-12-03 广州虎牙信息科技有限公司 Virtual image interaction method and device, electronic equipment and readable storage medium
CN110602517A (en) * 2019-09-17 2019-12-20 腾讯科技(深圳)有限公司 Live broadcast method, device and system based on virtual environment
CN110827379A (en) * 2019-10-31 2020-02-21 北京字节跳动网络技术有限公司 Virtual image generation method, device, terminal and storage medium
CN111221495A (en) * 2020-01-06 2020-06-02 广东小天才科技有限公司 Visual interaction method and device and terminal equipment
CN111402399A (en) * 2020-03-10 2020-07-10 广州虎牙科技有限公司 Face driving and live broadcasting method and device, electronic equipment and storage medium
CN111402399B (en) * 2020-03-10 2024-03-05 广州虎牙科技有限公司 Face driving and live broadcasting method and device, electronic equipment and storage medium
CN111432267A (en) * 2020-04-23 2020-07-17 深圳追一科技有限公司 Video adjusting method and device, electronic equipment and storage medium
WO2021212733A1 (en) * 2020-04-23 2021-10-28 深圳追一科技有限公司 Video adjustment method and apparatus, electronic device, and storage medium
CN112153400A (en) * 2020-09-22 2020-12-29 北京达佳互联信息技术有限公司 Live broadcast interaction method and device, electronic equipment and storage medium
CN112396679A (en) * 2020-11-20 2021-02-23 北京字节跳动网络技术有限公司 Virtual object display method and device, electronic equipment and medium
CN112396679B (en) * 2020-11-20 2022-09-13 北京字节跳动网络技术有限公司 Virtual object display method and device, electronic equipment and medium
WO2022105846A1 (en) * 2020-11-20 2022-05-27 北京字节跳动网络技术有限公司 Virtual object display method and apparatus, electronic device, and medium
CN112689151A (en) * 2020-12-07 2021-04-20 深圳盈天下视觉科技有限公司 Live broadcast method and device, computer equipment and storage medium
WO2022121557A1 (en) * 2020-12-11 2022-06-16 北京字跳网络技术有限公司 Live streaming interaction method, apparatus and device, and medium
CN113365146A (en) * 2021-06-04 2021-09-07 北京百度网讯科技有限公司 Method, apparatus, device, medium and product for processing video
CN113365146B (en) * 2021-06-04 2022-09-02 北京百度网讯科技有限公司 Method, apparatus, device, medium and article of manufacture for processing video
CN113840158A (en) * 2021-10-11 2021-12-24 深圳追一科技有限公司 Virtual image generation method, device, server and storage medium
CN113840158B (en) * 2021-10-11 2024-05-31 深圳追一科技有限公司 Virtual image generation method, device, server and storage medium
CN114007091A (en) * 2021-10-27 2022-02-01 北京市商汤科技开发有限公司 Video processing method and device, electronic equipment and storage medium
WO2023138548A1 (en) * 2022-01-24 2023-07-27 北京字跳网络技术有限公司 Image processing method and apparatus, and device and storage medium

Similar Documents

Publication Publication Date Title
CN109271553A (en) A kind of virtual image video broadcasting method, device, electronic equipment and storage medium
CN107079141B (en) Image mosaic for 3 D video
CN105357542B (en) Live broadcasting method, apparatus and system
CN112165590B (en) Video recording implementation method and device and electronic equipment
US20130132836A1 (en) Methods and Systems for Presenting Media Content Generated by Attendees of a Live Event
US20180367820A1 (en) A crowd-sourced broadcasting system and method
CN105635675B (en) A kind of panorama playing method and device
CN106162357B (en) Obtain the method and device of video content
WO2021139728A1 (en) Panoramic video processing method, apparatus, device, and storage medium
KR20140017130A (en) Electronic device providing content and method content provision method according to user's position
CN102845057A (en) Display device, television receiver, display device control method, programme, and recording medium
CN106576180A (en) Panoramic video
US10674057B2 (en) Audio event detection for automatic plenoptic video refocusing
CN108235120A (en) Live video stream method for pushing, device and electronic equipment
WO2017002642A1 (en) Information device and display processing method
CN108881938A (en) Live video intelligently cuts broadcasting method and device
CN107087208B (en) Panoramic video playing method, system and storage device
US20170048584A1 (en) Network set-top box and its operating method
CN113225646B (en) Audio and video monitoring method and device, electronic equipment and storage medium
JP5941760B2 (en) Display control device, display control method, display system, program, and recording medium
CN105894084A (en) Theater box office people counting method, device and system
US20230046493A1 (en) Information processing system and information processing method
CN108419127A (en) A method of preventing child myopia
CN106375833A (en) Virtual reality (VR)-based video display method and apparatus, and terminal device
CN108093297A (en) A kind of method and system of filmstrip automatic collection

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20190614

Address after: Room 1101, Santai Commercial Building, 139 Connaught Road, Hong Kong, China

Applicant after: HONG KONG LIVE.ME Corp.,Ltd.

Address before: Kamana Bay

Applicant before: LIVE.ME Inc.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210525

Address after: 25, 5th floor, shuangjingfang office building, 3 frisha street, Singapore

Applicant after: Zhuomi Private Ltd.

Address before: Room 1101, Santai Commercial Building, 139 Connaught Road, Hong Kong, China

Applicant before: HONG KONG LIVE.ME Corp.,Ltd.

TA01 Transfer of patent application right
RJ01 Rejection of invention patent application after publication

Application publication date: 20190125

RJ01 Rejection of invention patent application after publication