CN104883516A - Method and system for producing real-time singing video - Google Patents
Method and system for producing real-time singing video Download PDFInfo
- Publication number
- CN104883516A CN104883516A CN201510306446.1A CN201510306446A CN104883516A CN 104883516 A CN104883516 A CN 104883516A CN 201510306446 A CN201510306446 A CN 201510306446A CN 104883516 A CN104883516 A CN 104883516A
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- song
- display
- flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The invention discloses a method and a system for producing real-time singing video. The method comprises the steps that a first video stream of a camera is generated; an operating instruction for song recording is acquired; a sound effect device receives MV accompanying audio and singing record, the MV accompanying audio and the singing record are synthesized into an audio stream, and the audio stream is sent to the camera; the camera mixes the audio stream and the first video stream so as to generate an audio-video stream, and the audio-video stream is sent to a control terminal; the control terminal decodes the audio-video stream so as to acquire a second video stream, and the second video stream is sent to a display terminal; and the display terminal plays the second video stream, and MV song words are loaded and displayed simultaneously. A purpose of constructing personal video in real time can be realized through the mode disclosed by the invention, and an effect of real-time synchronization is achieved, thereby being convenient for users to produce the personal video.
Description
Technical field
The present invention relates to digital audio-video field, particularly relate to a kind of method and system making performance video in real time.
Background technology
Using video and audio frequency to add captions in the market, to synthesize the technological means of new video very ripe, much software has this function, basic process is that the later stage resolves to the audio frequency obtained in advance, video and captions, then carries out secondary coding and generate new video.
Because existing technical scheme exists great defect in real-time, particularly cannot in digital audio-video place, video production user sung becomes to sing video file and shows in real time in user's performance process; More user cannot be sung video real-time manufacturing becomes the performance video file of audio-visual synchronization to carry out preserving and sharing.The making of above-mentioned real-time performance video file not only has very large difficulty on technology realizes, and not easily obtains about the source of video, audio frequency and captions, also easily when synthesis, the nonsynchronous problem of audio & video easily occurs.
Summary of the invention
Technical problem to be solved by this invention is: provide a kind of and make the method and system of singing video in real time, user can be facilitated to make individual video and fast share and download.
In order to solve the problems of the technologies described above, the technical solution used in the present invention is: provide a kind of and make the method for singing video in real time, comprising:
Camera Real-time Obtaining first video flowing;
Receive accompanying song audio frequency and sing recording, Composite tone stream, and being sent in camera; And described audio stream is exported by audio output apparatus;
Camera mixes described audio stream and the first video flowing, generates audio/video flow, and is sent in digital audio-video terminal equipment;
Digital audio-video terminal equipment is decoded described audio/video flow, obtains the second video flowing, and is sent to display terminal;
Described second video flowing play by display terminal, and the lyrics that synchronous loaded and displayed song is corresponding.
Wherein, described second video flowing play by described display terminal, and the lyrics file that synchronously loaded and displayed song is corresponding is specially: display terminal superposes broadcasting second video flowing on song MV video, and the lyrics file that synchronous loaded and displayed song is corresponding.
Wherein, after described display terminal superposes broadcasting second video flowing on song MV video, Overlapping display video mode Scene Representation layer again on the second video flowing.
Wherein, described second video flowing and video mode Scene Representation layer are presented on song MV video in a form of picture-in-picture, or carry out the display of painting masking-out to song MV video.
Wherein, prestore in described digital audio-video terminal equipment or place server more than one video mode Scene Representation layer, according to song play time progress, changes described video mode Scene Representation layer.
Wherein, described display terminal, in playing process, according to song play time progress, described video mode Scene Representation layer adds foreground elements or special efficacy multimedia picture.
Wherein, camera mixes described audio stream and the first video flowing, generate audio/video flow, and after being sent to the step in digital audio-video terminal equipment, also comprise: digital audio-video terminal equipment sends audio/video flow to place server, place server generates shares ID, and stores audio/video flow.
Wherein, digital audio-video terminal equipment sends audio/video flow to place server, and ID is shared in place server generation, and after the step stored audio/video flow, also comprises:
Acquisition for mobile terminal shares ID, and shares instruction to place server transmission;
Place server shares address according to sharing instruction generation, and the audio/video flow sharing address and correspondence is sent to cloud server;
Cloud server is preserved described audio/video flow according to sharing address;
Mobile terminal is according to sharing address access audio/video flow.
Wherein, camera mixes described audio stream and the first video flowing, generates audio/video flow, and after being sent to the step in digital audio-video terminal equipment, what also comprise performance video shares step, is specially:
After playback of songs, digital audio-video terminal equipment generates shares ID;
Acquisition for mobile terminal shares ID, and shares instruction to the transmission of digital audio-video terminal equipment;
Digital audio-video terminal equipment shares address according to sharing instruction generation, and the audio/video flow sharing address and correspondence is sent to cloud server;
Cloud server is preserved described audio/video flow according to sharing address;
Mobile terminal is according to sharing address access audio/video flow.
Wherein, before the step of described camera Real-time Obtaining first video flowing, also comprise: obtain the operational order recording the video that gives song recitals.
Wherein, the step obtaining the operational order recording the video that gives song recitals is specially:
Requesting song screen display shows the song catalog page and recording interface;
Obtain requesting songs and/or click the operational order recorded;
Display camera preview interface and mode tuning interface.
Wherein, obtain the operational order recording the video that gives song recitals and also comprise: trigger the song music composition for two or more, record madrigal.
For solving the problem, the present invention also provides a kind of and makes the system of singing video in real time, comprising: camera, audio device, digital audio-video terminal equipment and display terminal; Wherein,
Camera is used for Real-time Obtaining first video flowing; By mixed audio stream and the first video flowing, generate audio/video flow, and be sent to described digital audio-video terminal equipment;
Audio device is recorded for receiving accompanying song audio frequency and singing, Composite tone stream, and by described audio streams in camera;
Digital audio-video terminal equipment, for described audio/video flow of decoding, obtains the second video flowing, and is sent to display terminal; Prestore more than one video mode Scene Representation layer, according to song play time progress, changes video mode Scene Representation layer;
Display terminal is for playing described second video flowing, and the lyrics that synchronous loaded and displayed song is corresponding.
Wherein, described system also comprises requesting song screen, place server, cloud server and mobile terminal;
Requesting song screen is for showing the song catalog page and recording interface; Obtain requesting songs and/or click the operational order recorded; Display camera preview interface and mode tuning interface; Trigger the song music composition for two or more, record madrigal;
Described digital audio-video terminal equipment sends described audio/video flow to place server; The more than one foreground elements that prestores or special efficacy multimedia resource; Also carry out the display song catalog page and recording interface for controlling requesting song screen; Send requesting songs and/or click the operational order recorded to requesting song screen; Control requesting song screen display and show camera preview interface and mode tuning interface; Control requesting song screen display and show the song music composition for two or more, record madrigal;
The audio/video flow that place server sends for receiving digital audio-video terminal equipment, and ID is shared in generation; Mobile terminal receive share instruction, generate corresponding share address according to sharing instruction, and send the audio/video flow sharing address and correspondence to cloud server; Prestore more than one video mode Scene Representation layer; The more than one foreground elements that prestores or special efficacy multimedia resource;
Cloud server for receiving audio/video flow and sharing address, and preserves described audio/video flow according to sharing address;
Mobile terminal is used for reception and shares ID, and shares instruction according to sharing ID to place server transmission; The audio/video flow of cloud server preservation is play by sharing address.
Wherein, described display terminal for superposing broadcasting second video flowing on song MV video, Overlapping display video mode Scene Representation layer on the second video flowing, video mode Scene Representation layer adds foreground elements or special efficacy multimedia resource, and the lyrics file that synchronous loaded and displayed song is corresponding.
Beneficial effect of the present invention is: be different from prior art, making provided by the invention sings the method and system of video in real time by generating camera first video flowing, obtain the operational order of recording song again, audio device receives MV accompaniment and voice is recorded and obtains audio stream, camera mixes the first video flowing, audio stream, generate audio/video flow, be sent to control terminal, control terminal decoding audio/video flow obtains the second video flowing, and send to display terminal, the second video flowing play by display terminal simultaneously, and shows the MV lyrics.Both achieve the object building individual video in real time, and reach the effect of real-time synchronization display.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the inventive method embodiment one;
Fig. 2 is the schematic flow sheet of the inventive method embodiment two;
Fig. 3 is the schematic flow sheet of the inventive method embodiment three;
Fig. 4 is the schematic flow sheet of the inventive method embodiment four;
Fig. 5 is the structural representation of present system embodiment five;
Fig. 6 is the structural representation of present system embodiment six.
Embodiment
By describing technology contents of the present invention in detail, realized object and effect, accompanying drawing is coordinated to be explained below in conjunction with execution mode.
Please refer to Fig. 1, the embodiment of the present invention one provides a kind of method making performance video in real time, comprises the steps:
S110: camera Real-time Obtaining first video flowing;
S120: receive accompanying song audio frequency and sing recording, Composite tone stream, and being sent in camera; And described audio stream is exported by audio output apparatus;
S130: camera mixes described audio stream and the first video flowing, generates audio/video flow, and is sent to digital audio-video terminal equipment;
S140: digital audio-video terminal equipment is decoded described audio/video flow, obtains the second video flowing, and is sent to display terminal;
S150: described second video flowing play by display terminal, and the lyrics that synchronous loaded and displayed song is corresponding.
Be different from prior art, the method of video is sung in the making that the embodiment of the present invention one provides in real time, facilitate the video of user when the making of digital audio-video place gives song recitals, the video that user sings process can not only be shown in real time on display terminal, user can also be obtained and to give song recitals the process sound intermediate frequency stream performance video file synchronous with video flowing.
In the manufacturing process of singing video file, use the first video flowing that camera user in real is sung, it is the head portrait of user, the look of singing process and other limb actions etc. that first video flowing comprises especially, is mixed by the first video flowing, generate audio/video flow with audio frequency stream.Wherein audio stream is the performance sound of accompanying song and user, the performance sound of user obtains by microphone and sends to audio device, audio device obtains accompanying song from digital audio-video terminal equipment simultaneously, then the performance sound of user and accompanying song is carried out being mixed to get audio stream.The audio stream of mixing is play by audio device, and sends to video camera.
If audio stream and the first video flowing are all directly sent to digital audio-video terminal equipment to carry out making sing video, there is audio stream and the first video flowing in time and nonsynchronous problem in the performance video completed.
In order to overcome this defect, realize the object of audio frequency, audio video synchronization, first by mixed audio streams in camera, in camera, audio stream is mixed with the first video flowing and generates audio/video flow.Because making video at camera, the first video flowing does not need to transmit, and video flowing and audio stream in time can be synchronous, and the audio/video flow generated can achieve the synchronous of Voice & Video.And after digital audio-video terminal equipment receives the audio/video flow sent from camera, to its decoding acquisition second video flowing, play in the process of display second video flowing at display terminal, not audio stream plays (because audio stream is play by audio output apparatus), according to reproduction time progress, the lyrics that synchronous loading song is corresponding.
The above-mentioned digital audio-video terminal equipment mentioned of the present invention can be Set Top Box.The performance that the present invention mentions can refer in public number audiovisual place, and the performance that such as KTV, bar, nightclub etc. carry out can also be the performance that family's singing place is carried out.
Wherein, as shown in Figure 2, the embodiment of the present invention two, on the basis of above-described embodiment one, is expanded S150 step " described second video flowing of display terminal broadcasting, and the lyrics that synchronously loaded and displayed song is corresponding ".Due in performance process, some user wishes the MV video can seeing song first wife, can perform step S151: display terminal superposes broadcasting second video flowing on song MV video, and the lyrics file that synchronous loaded and displayed song is corresponding.And for other user, it is desirable to see the second video flowing not having song MV video completely, then do not need played songs MV video.The song MV video mentioned in the present invention, all refers to the MV video of the first wife that gives song recitals.MV refer to the deciphering of music simultaneously by the one art type that television image presents.
In order to more highlight the second video flowing, step S152 can be performed: after display terminal superposes broadcasting second video flowing on song MV video, Overlapping display video mode Scene Representation layer on the second video flowing.Video mode Scene Representation layer can be used as the background layer of the second video flowing, video mode Scene Representation layer can be classified according to theme, such as, stage pattern scene presentation layer, sandy beach pattern scene presentation layer, Christmas pattern scene presentation layer, space pattern scene presentation layer etc.The concrete bandwagon effect of video mode Scene Representation layer can be: mid portion is transparent, thus display the second video flowing; Frame portion is the picture arranged according to theme, and frame portion can be covered on the second video flowing and show.
In procedure for displaying, in order to highlight the second video flowing and video mode Scene Representation layer, the second video flowing and video mode Scene Representation layer can be presented on song MV video in a form of picture-in-picture, or the display of painting masking-out is carried out to song MV video.By the way, the second video flowing and video mode Scene Representation layer can be highlighted, weaken display song MV video.Second video flowing and video mode Scene Representation layer can be presented at the center of song MV video in a form of picture-in-picture; The lyrics corresponding to song can directly be presented at below lyrics MV video.
Wherein, before display video pattern scene presentation layer, also step S153 is comprised: prestore in described digital audio-video terminal equipment or place server more than one video mode Scene Representation layer; And step S154: according to types of songs, change video mode Scene Representation layer.Such as, when playing heat song, the video mode Scene Representation layer of the second video flowing collocation stage style; When playing the song relevant with Christmas, the video mode Scene Representation layer of the second video flowing collocation style on Christmas; When playing the song relevant to space, the video mode Scene Representation layer of the second video flowing collocation space style.By such cooperation, not only can adding users sing interest, user also can select various video mode Scene Representation layer according to the hobby of oneself.In implementation procedure, requesting song screen can will be arranged the select button of various video mode Scene Representation layer, user can directly select on requesting song screen.
Because user can switch in multiple video mode Scene Representation layer, the video that the user that such display terminal is shown sings in real time will have multiple background display, and also can select the switching mode of user preference when switching, the various effects etc. when similar lantern slide switches.Like this when playing, effect is lively, interesting strong.
In order to increase the sight of interactive and interesting, the display effect of procedure for displaying, described display terminal is in playing process, perform step S155: according to song play time progress, described video mode Scene Representation layer adds display foreground element or special efficacy multimedia resource.Described foreground elements, such as video frame, video filter etc.; Described characteristic multimedia resource, such as, colored special efficacy of wafing, spread 3D animation effect or barrage, the personalized emoticons etc. such as flower, bubble, fireworks, and other can strengthen element, the special efficacy of display effect, repeat no more herein.Described foreground elements or special efficacy multimedia picture layer resource are pre-stored in digital audio-video terminal equipment or place server.
When the video that display terminal displaying user sings in real time, user can see the mass effect of audio/video flow in real time, if when user needs to modify it or improve, can perform the operational order adjusted described video file, to adjust in real time, make customer satisfaction system video file to obtaining.
On the basis of embodiment two, the present invention also provides embodiment three, and as shown in Figure 3, embodiment three relates generally to making the preservation of audio-video document and sharing.Be specially: after step S130, also comprise step S131: digital audio-video terminal equipment sends audio/video flow to place server, place server generates shares ID, and stores audio/video flow.
And step S132: acquisition for mobile terminal shares ID, and shares instruction to place server transmission;
Step S133: place server shares address according to sharing instruction generation, and the audio/video flow sharing address and correspondence is sent to cloud server;
Step S134: cloud server is preserved described audio/video flow according to sharing address;
Step S135: mobile terminal is according to sharing address access audio/video flow.
Particularly, when user needs the audio/video flow made to share between friend, instruction is shared by digital audio-video terminal equipment to place server transmission by mobile terminal, place server will according to sharing instruction, address is shared accordingly by sharing ID generation, and address will be shared send to cloud server, cloud server preserves audio/video flow according to sharing address.Mobile terminal by digital audio-video terminal obtain share ID and correspondence share address, and then according to sharing address from cloud server playing audio-video stream.Such as user by mobile terminal such as mobile phone are installed client (as K rice app) scanning share address (as Quick Response Code etc.), can on mobile phone playing audio-video stream.Other users can also by terminal equipment at page end by sharing path access cloud server, page end use player share resource, or download share resource.By aforesaid operations, can realize sharing the object of singing video file easily.
In like manner, in the scene that some families sing, the step of sharing of audio/video flow is specially: camera mixes described audio stream and the first video flowing, generate audio/video flow, and after being sent to the step in digital audio-video terminal equipment, what also comprise performance video shares step, is specially:
After playback of songs, digital audio-video terminal equipment generates shares ID;
Acquisition for mobile terminal shares ID, and shares instruction to the transmission of digital audio-video terminal equipment;
Digital audio-video terminal equipment shares address according to sharing instruction generation, and the audio/video flow sharing address and correspondence is sent to cloud server;
Cloud server is preserved described audio/video flow according to sharing address;
Mobile terminal is according to sharing address access audio/video flow.
Other users by terminal equipment at page end by sharing path access cloud server, page end use player share resource, or download share resource.
On the basis of embodiment one, the present invention also provides embodiment four, as shown in Figure 4, mainly to the setting of camera record command.Wherein, when performing step S110, specifically following steps are performed:
S111: start digital audio-video place terminal in audiovisual place, successfully connect camera, recorded a video by camera, obtain the first video flowing;
S112: by the first video stream to digital audio-video terminal equipment, digital audio-video terminal equipment controls requesting song screen or display terminal preview;
S113: adjust camera position in time, to obtaining the first best video flowing.
Also comprise the steps: before step S110
S100: obtain the operational order recording the video that gives song recitals.
The concrete operations that described S100 obtains the operational order recording the video that gives song recitals are:
S101: requesting song screen display shows the song catalog page and recording interface;
S102: obtain requesting songs and/or click the operational order recorded; When user need to make sing video in real time time, the recording first triggered on requesting song screen gives song recitals the operational order of video.User before selection gives song recitals, the requesting song screen display song page and recording interface.The button that the described display song page and recording interface are arranged and instruction are arranged by digital audio-video terminal equipment, being shown on requesting song screen.Wherein the song page includes but not limited to song bent storehouse list and song information etc., and recording interface can be comprise the certain operations button or prompting of selecting dialog box and corresponding recording.User click its need the song of program request time, input corresponding operational order to song interface, digital audio-video terminal equipment will obtain these instructions, and controls requesting song screen and operate accordingly or show.In like manner, user also can be obtained by digital audio-video terminal for the instruction of recording, and control requesting song screen operates accordingly.
Wherein, after step S102, also comprise the steps:
S103: requesting song screen display shows camera preview interface and mode tuning interface;
User is by clicking recording interface, camera starts real-time recording user and sings video, wherein requesting song screen is after entering recording interface, and requesting song screen to show the preview interface of camera to user, and what this preview interface showed is the real-time video that is logged when singing of user and background context.When user if desired adjusts video, can also correspondingly recall display mode adjustment interface, select the pattern needed for it for user by the button on requesting song screen, the position as the replacing to background, camera adjusts and daylighting situation adjustment etc.
After step S103 step, also can carry out following steps:
S104: trigger the song music composition for two or more, records madrigal.
When the conditions such as camera, background, daylighting all after setting completed, user can the song music composition for two or more of triggering system, and carries out recording madrigal, and meanwhile, digital audio-video terminal equipment is not preserved the audio/video flow adjusted above.In performance process, when user if desired changes song or reselects fragment, can the song music composition for two or more of triggering system, and carry out recording madrigal.And carry out the preparation of recording in order to the time giving user's abundance, when triggering the music composition for two or more, give user a time, user also can regulate the preview interface of camera, in real time finally to reach the ideal situation that user wishes simultaneously.Therefore it operates hommization more, and user experience will obtain lifting.
Be different from prior art, the above embodiment of the present invention can facilitate user when camera is recorded a video, preview video recording effect also can make accommodation, simultaneously at the replacing that can realize song or the music composition for two or more, operability is stronger, also have more hommization, and user can select to the video file made to generate the effect shared address and share between everybody or directly check recording, and make adjustment.Whole operation all easily user performs, and fully solves the possible produced problem in manufacturing process, and provides corresponding Adjusted Option for user's selection, therefore not only simple operation, and hommization more, and will promote user experience.
As shown in Figure 5, the embodiment of the present invention five is also corresponding provides a kind of system 100 making performance video in real time, comprising: camera 110, audio device 120, digital audio-video terminal equipment 130 and display terminal 140; Wherein
Camera 110 is for Real-time Obtaining first video flowing; By mixed audio stream and the first video flowing, generate audio/video flow, and be sent to described digital audio-video terminal equipment 130;
Audio device 120 is recorded for receiving accompanying song audio frequency and singing, Composite tone stream, and by described audio streams in camera 110;
Digital audio-video terminal equipment 130, for described audio/video flow of decoding, obtains the second video flowing, and is sent to display terminal 140; Prestore more than one video mode Scene Representation layer, according to song play time progress, changes video mode Scene Representation layer;
Display terminal 140 is for playing described second video flowing, and the lyrics that synchronous loaded and displayed song is corresponding.
Wherein, as shown in Figure 6, the system 100 of present system embodiment six also comprises:
Requesting song screen 150, place server 160, cloud server 170 and mobile terminal 180;
Requesting song screen 150 is for showing the song catalog page and recording interface; Obtain requesting songs and/or click the operational order recorded; Display camera preview interface and mode tuning interface; Trigger the song music composition for two or more, record madrigal;
Described digital audio-video terminal equipment 130 is for sending described audio/video flow to place server 160; The more than one foreground elements that prestores or special efficacy multimedia resource; Also carry out the display song catalog page and recording interface for controlling requesting song screen 150; Send requesting songs and/or click the operational order recorded to requesting song screen 150; Control requesting song screen 150 and show camera preview interface and mode tuning interface; Control requesting song screen 150 and show the song music composition for two or more, record madrigal.
The audio/video flow that place server 160 sends for receiving digital audio-video terminal equipment 130, and ID is shared in generation; Mobile terminal receive 180 share instruction, generate corresponding share address according to sharing instruction, and send the audio/video flow sharing address and correspondence to cloud server 170; Prestore more than one video mode Scene Representation layer; The more than one foreground elements that prestores or special efficacy multimedia resource;
Cloud server 170 for receiving audio/video flow and sharing address, and preserves described audio/video flow according to sharing address;
Mobile terminal 180 shares ID for obtaining, and shares instruction according to sharing ID to place server 160 transmission; The audio/video flow of cloud server 170 preservation is play by sharing address.
Wherein, described display terminal 130 also for superposing broadcasting second video flowing on song MV video, Overlapping display video mode Scene Representation layer on the second video flowing, video mode Scene Representation layer adds foreground elements or special efficacy multimedia resource, and the lyrics file that synchronous loaded and displayed song is corresponding.
The foregoing is only embodiments of the invention; not thereby the scope of the claims of the present invention is limited; every equivalents utilizing specification of the present invention and accompanying drawing content to do, or be directly or indirectly used in relevant technical field, be all in like manner included in scope of patent protection of the present invention.
Claims (15)
1. make a method of singing video in real time, it is characterized in that, comprising:
Camera Real-time Obtaining first video flowing;
Receive accompanying song audio frequency and sing recording, Composite tone stream, and being sent in camera; And described audio stream is exported by audio output apparatus;
Camera mixes described audio stream and the first video flowing, generates audio/video flow, and is sent in digital audio-video terminal equipment;
Digital audio-video terminal equipment is decoded described audio/video flow, obtains the second video flowing, and is sent to display terminal;
Described second video flowing play by display terminal, and the lyrics that synchronous loaded and displayed song is corresponding.
2. make the method for singing video in real time according to claim 1, it is characterized in that, described second video flowing play by described display terminal, and the lyrics file that synchronously loaded and displayed song is corresponding is specially: display terminal superposes broadcasting second video flowing on song MV video, and the lyrics file that synchronous loaded and displayed song is corresponding.
3. make the method for singing in real time video according to claim 2, it is characterized in that, after described display terminal superposes broadcasting second video flowing on song MV video, Overlapping display video mode Scene Representation layer again on the second video flowing.
4. make the method for singing video in real time according to claim 3, it is characterized in that, described second video flowing and video mode Scene Representation layer are presented on song MV video in a form of picture-in-picture, or carry out the display of painting masking-out to song MV video.
5. make the method for singing video in real time according to claim 3, it is characterized in that, before display video pattern scene presentation layer, also comprise:
Prestore in described digital audio-video terminal equipment or place server more than one video mode Scene Representation layer;
According to song play time progress, change described video mode Scene Representation layer.
6. make the method for singing video in real time according to claim 3, it is characterized in that, described display terminal, in playing process, according to song play time progress, described video mode Scene Representation layer adds foreground elements or special efficacy multimedia resource.
7. make the method for singing video in real time according to claim 1, it is characterized in that, camera mixes described audio stream and the first video flowing, generate audio/video flow, and after being sent to the step in digital audio-video terminal equipment, what also comprise performance video shares step, is specially: digital audio-video terminal equipment sends audio/video flow to place server, place server generates shares ID, and stores audio/video flow.
8. make the method for singing in real time video according to claim 7, it is characterized in that, digital audio-video terminal equipment sends audio/video flow to place server, and ID is shared in place server generation, and after the step stored audio/video flow, also comprises:
Acquisition for mobile terminal shares ID, and shares instruction to place server transmission;
Place server shares address according to sharing instruction generation, and the audio/video flow sharing address and correspondence is sent to cloud server;
Cloud server is preserved described audio/video flow according to sharing address;
Mobile terminal is according to sharing address access audio/video flow.
9. make the method for singing video in real time according to claim 1, it is characterized in that, camera mixes described audio stream and the first video flowing, generate audio/video flow, and after being sent to the step in digital audio-video terminal equipment, what also comprise performance video shares step, is specially:
After playback of songs, digital audio-video terminal equipment generates shares ID;
Acquisition for mobile terminal shares ID, and shares instruction to the transmission of digital audio-video terminal equipment;
Digital audio-video terminal equipment shares address according to sharing instruction generation, and the audio/video flow sharing address and correspondence is sent to cloud server;
Cloud server is preserved described audio/video flow according to sharing address;
Mobile terminal is according to sharing address access audio/video flow.
10. make the method for singing video in real time according to claim 1, it is characterized in that, before the step of described camera Real-time Obtaining first video flowing, also comprise: obtain the operational order recording the video that gives song recitals.
11. make the method for singing video in real time according to claim 1, it is characterized in that, the step obtaining the operational order recording the video that gives song recitals is specially:
Requesting song screen display shows the song catalog page and recording interface;
Obtain requesting songs and/or click the operational order recorded;
Display camera preview interface and mode tuning interface.
12., according to making the method for singing video in real time described in claim 11, is characterized in that, obtain the operational order recording the video that gives song recitals and also comprise: trigger the song music composition for two or more, record madrigal.
13. 1 kinds make the system of singing video in real time, it is characterized in that, comprising: camera, audio device, digital audio-video terminal equipment and display terminal; Wherein,
Camera is used for Real-time Obtaining first video flowing; By mixed audio stream and the first video flowing, generate audio/video flow, and be sent to described digital audio-video terminal equipment;
Audio device is recorded for receiving accompanying song audio frequency and singing, Composite tone stream, and by described audio streams in camera;
Digital audio-video terminal equipment, for described audio/video flow of decoding, obtains the second video flowing, and is sent to display terminal; Prestore more than one video mode Scene Representation layer, according to song play time progress, changes video mode Scene Representation layer;
Display terminal is for playing described second video flowing, and the lyrics that synchronous loaded and displayed song is corresponding.
14., according to making the system of singing video in real time described in claim 13, is characterized in that, described system also comprises requesting song screen, place server, cloud server and mobile terminal;
Requesting song screen is for showing the song catalog page and recording interface; Obtain requesting songs and/or click the operational order recorded; Display camera preview interface and mode tuning interface; Trigger the song music composition for two or more, record madrigal;
Described digital audio-video terminal equipment is for sending described audio/video flow to place server; The more than one foreground elements that prestores or special efficacy multimedia resource; Also carry out the display song catalog page and recording interface for controlling requesting song screen; Send requesting songs and/or click the operational order recorded to requesting song screen; Control requesting song screen display and show camera preview interface and mode tuning interface; Control requesting song screen display and show the song music composition for two or more, record madrigal;
The audio/video flow that place server sends for receiving digital audio-video terminal equipment, and ID is shared in generation; Mobile terminal receive share instruction, generate corresponding share address according to sharing instruction, and send the audio/video flow sharing address and correspondence to cloud server; Prestore more than one video mode Scene Representation layer; The more than one foreground elements that prestores or special efficacy multimedia resource;
Cloud server for receiving audio/video flow and sharing address, and preserves described audio/video flow according to sharing address;
Mobile terminal is used for reception and shares ID, and shares instruction according to sharing ID to place server transmission; The audio/video flow of cloud server preservation is play by sharing address.
15. according to making the system of singing video in real time described in claim 13, it is characterized in that, described display terminal for superposing broadcasting second video flowing on song MV video, Overlapping display video mode Scene Representation layer on the second video flowing, video mode Scene Representation layer adds foreground elements or special efficacy multimedia resource, and the lyrics file that synchronous loaded and displayed song is corresponding.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510306446.1A CN104883516B (en) | 2015-06-05 | 2015-06-05 | It is a kind of to make the method and system for singing video in real time |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510306446.1A CN104883516B (en) | 2015-06-05 | 2015-06-05 | It is a kind of to make the method and system for singing video in real time |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104883516A true CN104883516A (en) | 2015-09-02 |
| CN104883516B CN104883516B (en) | 2018-08-14 |
Family
ID=53950840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510306446.1A Active CN104883516B (en) | 2015-06-05 | 2015-06-05 | It is a kind of to make the method and system for singing video in real time |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104883516B (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105635772A (en) * | 2015-12-30 | 2016-06-01 | 北京奇艺世纪科技有限公司 | Picture-in-picture video playing method and mobile terminal supporting picture-in-picture video playing |
| CN106060591A (en) * | 2016-05-31 | 2016-10-26 | 北京小米移动软件有限公司 | Interaction method and device in video live broadcasting application |
| WO2016177296A1 (en) * | 2015-05-04 | 2016-11-10 | 腾讯科技（深圳）有限公司 | Video generation method and apparatus |
| CN107027050A (en) * | 2017-04-13 | 2017-08-08 | 广州华多网络科技有限公司 | Auxiliary live audio/video processing method and device |
| CN107368491A (en) * | 2016-05-12 | 2017-11-21 | 富泰华工业（深圳）有限公司 | Making video system and method |
| CN107396137A (en) * | 2017-07-14 | 2017-11-24 | 腾讯音乐娱乐（深圳）有限公司 | The method, apparatus and system of online interaction |
| CN107770235A (en) * | 2016-08-23 | 2018-03-06 | 冯山泉 | One kind bucket song service implementing method and system |
| CN107798561A (en) * | 2017-10-25 | 2018-03-13 | 网易传媒科技（北京）有限公司 | Audio broadcasting, sharing method and device, storage medium and electronic equipment |
| CN109285568A (en) * | 2018-10-12 | 2019-01-29 | 北京微播视界科技有限公司 | Method and apparatus for generating audio file |
| CN109587549A (en) * | 2018-12-05 | 2019-04-05 | 广州酷狗计算机科技有限公司 | Video recording method, device, terminal and storage medium |
| CN109920399A (en) * | 2019-02-22 | 2019-06-21 | 南安市腾龙专利应用服务有限公司 | A kind of KTV obtains the method and K song system of audio-video |
| CN110324718A (en) * | 2019-08-05 | 2019-10-11 | 北京字节跳动网络技术有限公司 | Audio-video generation method, device, electronic equipment and readable medium |
| CN110944226A (en) * | 2019-11-27 | 2020-03-31 | 广州华多网络科技有限公司 | Network Karaoke system, lyric display method in Karaoke scene and related equipment |
| CN111163274A (en) * | 2020-01-21 | 2020-05-15 | 海信视像科技股份有限公司 | Video recording method and display equipment |
| CN111459396A (en) * | 2020-03-30 | 2020-07-28 | 北京小唱科技有限公司 | Playing method, device and system based on intelligent terminal |
| CN111757165A (en) * | 2019-03-28 | 2020-10-09 | 阿里巴巴集团控股有限公司 | Data output method, data processing method, device and equipment |
| CN111954052A (en) * | 2019-05-17 | 2020-11-17 | 上海哔哩哔哩科技有限公司 | Method for displaying bullet screen information, computer equipment and readable storage medium |
| CN112601110A (en) * | 2020-03-31 | 2021-04-02 | 美国西北仪器公司 | Method and apparatus for content recording and streaming |
| CN113747217A (en) * | 2020-05-29 | 2021-12-03 | 聚好看科技股份有限公司 | Display device and method for improving chorus speed |
| CN114500883A (en) * | 2022-04-18 | 2022-05-13 | 北京麦颂文化传播有限公司 | Method, device and equipment for KTV to self-control MV (music video) and computer readable storage medium |
| CN114697742A (en) * | 2020-12-25 | 2022-07-01 | 华为技术有限公司 | Video recording method and electronic equipment |
| CN115359156A (en) * | 2022-07-31 | 2022-11-18 | 荣耀终端有限公司 | Audio playing method, device, equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045373A (en) * | 1999-07-30 | 2001-02-16 | Satoshi Fujimae | Karaoke video compositing device for allowing singer to perform on screen |
| CN2518277Y (en) * | 2002-01-31 | 2002-10-23 | 宪锋光电科技股份有限公司 | Processing device for real time broadcasting and recording digitalization image audio |
| CN1684506A (en) * | 2004-04-16 | 2005-10-19 | 清华同方股份有限公司 | Picture-in-picture display system in video frequency ordering |
| CN101098523A (en) * | 2006-06-29 | 2008-01-02 | 海尔集团公司 | Method for realizing karaoke by mobile phone and mobile phone with karaoke function |
| CN101118743A (en) * | 2007-07-12 | 2008-02-06 | 深圳市融合视讯科技有限公司 | Remote interaction karaoke system establishing and using method thereof |
| CN102915725A (en) * | 2012-09-10 | 2013-02-06 | 福建星网视易信息系统有限公司 | Human-computer interaction song singing system and method |
| CN103268763A (en) * | 2013-06-05 | 2013-08-28 | 广州市花都区中山大学国光电子与通信研究院 | Wireless media system based on synchronous audio extraction and real-time transmission |
| CN103986947A (en) * | 2014-05-04 | 2014-08-13 | 苏州乐聚一堂电子科技有限公司 | Karaoke mobile phone song query system with image special effect |
| CN103999453A (en) * | 2011-09-18 | 2014-08-20 | 踏途音乐公司 | Digital jukebox device with karaoke and/or photo booth features, and associated methods |
-
2015
- 2015-06-05 CN CN201510306446.1A patent/CN104883516B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045373A (en) * | 1999-07-30 | 2001-02-16 | Satoshi Fujimae | Karaoke video compositing device for allowing singer to perform on screen |
| CN2518277Y (en) * | 2002-01-31 | 2002-10-23 | 宪锋光电科技股份有限公司 | Processing device for real time broadcasting and recording digitalization image audio |
| CN1684506A (en) * | 2004-04-16 | 2005-10-19 | 清华同方股份有限公司 | Picture-in-picture display system in video frequency ordering |
| CN101098523A (en) * | 2006-06-29 | 2008-01-02 | 海尔集团公司 | Method for realizing karaoke by mobile phone and mobile phone with karaoke function |
| CN101118743A (en) * | 2007-07-12 | 2008-02-06 | 深圳市融合视讯科技有限公司 | Remote interaction karaoke system establishing and using method thereof |
| CN103999453A (en) * | 2011-09-18 | 2014-08-20 | 踏途音乐公司 | Digital jukebox device with karaoke and/or photo booth features, and associated methods |
| CN102915725A (en) * | 2012-09-10 | 2013-02-06 | 福建星网视易信息系统有限公司 | Human-computer interaction song singing system and method |
| CN103268763A (en) * | 2013-06-05 | 2013-08-28 | 广州市花都区中山大学国光电子与通信研究院 | Wireless media system based on synchronous audio extraction and real-time transmission |
| CN103986947A (en) * | 2014-05-04 | 2014-08-13 | 苏州乐聚一堂电子科技有限公司 | Karaoke mobile phone song query system with image special effect |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016177296A1 (en) * | 2015-05-04 | 2016-11-10 | 腾讯科技（深圳）有限公司 | Video generation method and apparatus |
| CN105635772A (en) * | 2015-12-30 | 2016-06-01 | 北京奇艺世纪科技有限公司 | Picture-in-picture video playing method and mobile terminal supporting picture-in-picture video playing |
| CN107368491A (en) * | 2016-05-12 | 2017-11-21 | 富泰华工业（深圳）有限公司 | Making video system and method |
| CN106060591A (en) * | 2016-05-31 | 2016-10-26 | 北京小米移动软件有限公司 | Interaction method and device in video live broadcasting application |
| CN107770235A (en) * | 2016-08-23 | 2018-03-06 | 冯山泉 | One kind bucket song service implementing method and system |
| CN107027050A (en) * | 2017-04-13 | 2017-08-08 | 广州华多网络科技有限公司 | Auxiliary live audio/video processing method and device |
| CN107396137A (en) * | 2017-07-14 | 2017-11-24 | 腾讯音乐娱乐（深圳）有限公司 | The method, apparatus and system of online interaction |
| CN107396137B (en) * | 2017-07-14 | 2020-06-30 | 腾讯音乐娱乐（深圳）有限公司 | Online interaction method, device and system |
| CN107798561A (en) * | 2017-10-25 | 2018-03-13 | 网易传媒科技（北京）有限公司 | Audio broadcasting, sharing method and device, storage medium and electronic equipment |
| CN107798561B (en) * | 2017-10-25 | 2021-08-13 | 网易传媒科技（北京）有限公司 | Audio playing and sharing method and device, storage medium and electronic equipment |
| CN109285568A (en) * | 2018-10-12 | 2019-01-29 | 北京微播视界科技有限公司 | Method and apparatus for generating audio file |
| CN109587549A (en) * | 2018-12-05 | 2019-04-05 | 广州酷狗计算机科技有限公司 | Video recording method, device, terminal and storage medium |
| CN109587549B (en) * | 2018-12-05 | 2021-08-13 | 广州酷狗计算机科技有限公司 | Video recording method, device, terminal and storage medium |
| CN109920399A (en) * | 2019-02-22 | 2019-06-21 | 南安市腾龙专利应用服务有限公司 | A kind of KTV obtains the method and K song system of audio-video |
| CN111757165A (en) * | 2019-03-28 | 2020-10-09 | 阿里巴巴集团控股有限公司 | Data output method, data processing method, device and equipment |
| CN111954052B (en) * | 2019-05-17 | 2022-04-05 | 上海哔哩哔哩科技有限公司 | Method for displaying bullet screen information, computer equipment and readable storage medium |
| CN111954052A (en) * | 2019-05-17 | 2020-11-17 | 上海哔哩哔哩科技有限公司 | Method for displaying bullet screen information, computer equipment and readable storage medium |
| CN110324718A (en) * | 2019-08-05 | 2019-10-11 | 北京字节跳动网络技术有限公司 | Audio-video generation method, device, electronic equipment and readable medium |
| CN110324718B (en) * | 2019-08-05 | 2021-09-07 | 北京字节跳动网络技术有限公司 | Audio and video generation method and device, electronic equipment and readable medium |
| CN110944226B (en) * | 2019-11-27 | 2021-05-11 | 广州华多网络科技有限公司 | Network Karaoke system, lyric display method in Karaoke scene and related equipment |
| CN110944226A (en) * | 2019-11-27 | 2020-03-31 | 广州华多网络科技有限公司 | Network Karaoke system, lyric display method in Karaoke scene and related equipment |
| CN111163274A (en) * | 2020-01-21 | 2020-05-15 | 海信视像科技股份有限公司 | Video recording method and display equipment |
| CN111163274B (en) * | 2020-01-21 | 2022-04-22 | 海信视像科技股份有限公司 | Video recording method and display equipment |
| CN111459396B (en) * | 2020-03-30 | 2021-06-22 | 北京小唱科技有限公司 | Playing method, device and system based on intelligent terminal |
| CN111459396A (en) * | 2020-03-30 | 2020-07-28 | 北京小唱科技有限公司 | Playing method, device and system based on intelligent terminal |
| CN112601110A (en) * | 2020-03-31 | 2021-04-02 | 美国西北仪器公司 | Method and apparatus for content recording and streaming |
| CN112601110B (en) * | 2020-03-31 | 2023-10-27 | 美国西北仪器公司 | Method and apparatus for content recording and sharing |
| CN113747217A (en) * | 2020-05-29 | 2021-12-03 | 聚好看科技股份有限公司 | Display device and method for improving chorus speed |
| CN114697742A (en) * | 2020-12-25 | 2022-07-01 | 华为技术有限公司 | Video recording method and electronic equipment |
| CN114500883A (en) * | 2022-04-18 | 2022-05-13 | 北京麦颂文化传播有限公司 | Method, device and equipment for KTV to self-control MV (music video) and computer readable storage medium |
| CN115359156A (en) * | 2022-07-31 | 2022-11-18 | 荣耀终端有限公司 | Audio playing method, device, equipment and storage medium |
| CN115359156B (en) * | 2022-07-31 | 2023-12-05 | 荣耀终端有限公司 | Audio playing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104883516B (en) | 2018-08-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104883516A (en) | Method and system for producing real-time singing video | |
| CN109327741B (en) | Game live broadcast method, device and system | |
| US10531158B2 (en) | Multi-source video navigation | |
| US7952535B2 (en) | Electronic visual jockey file | |
| JP5609160B2 (en) | Information processing system, content composition apparatus and method, and recording medium | |
| CN105450642B (en) | It is a kind of based on the data processing method being broadcast live online, relevant apparatus and system | |
| CN100562084C (en) | Synchronously use the equipment and the method for audio-visual data | |
| US20100251173A1 (en) | Information processing device, contents processing method and program | |
| CN103814578B (en) | Receiver, display control method, broadcast system | |
| KR20080048308A (en) | Apparatus and method for linking a basic device and extended devices | |
| CN108449632B (en) | Method and terminal for real-time synthesis of singing video | |
| US11481983B2 (en) | Time shifting extended reality media | |
| CN109983786A (en) | Transcriber, reproducting method, information processing unit, information processing method and program | |
| KR20160031403A (en) | A multiscreen control method and device supporting multiple window applications | |
| US20110304735A1 (en) | Method for Producing a Live Interactive Visual Immersion Entertainment Show | |
| KR20150105058A (en) | Mixed reality type virtual performance system using online | |
| US20080271082A1 (en) | User controlled multimedia television broadcast on single channel | |
| CN105704399A (en) | Playing method and system for multi-picture television program | |
| TW200838294A (en) | System and method to generate the interactive video images | |
| CN111556357A (en) | Method, device and equipment for playing live video and storage medium | |
| JP2007013918A (en) | Digital camera having electronic visual jockey function, and file therefor | |
| JP2012015958A (en) | Content reproduction system | |
| CN108124188B (en) | Audio-video system operation method | |
| WO2021049048A1 (en) | Video-image providing system and program | |
| JPH0955920A (en) | Isdb transmission device and reception device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151104 Address after: 350018 Fujian city of Fuzhou province Nanjiang gate town of Cangshan District West Coast Road No. 198 Fuzhou Strait International Convention and Exhibition Center basement East Office Center No. A-029 (FTA test area) Applicant after: FUJIAN KAIMI NETWORK SCIENCE & TECHNOLOGY CO., LTD. Address before: Fuzhou City, Fujian Province, Jinshan Road 350028 No. 618 No. 20 Ruijie orangery Chau Science Park 4 Applicant before: Fujian Starnet e-Video Information System Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |