CN104883516B - It is a kind of to make the method and system for singing video in real time - Google Patents
It is a kind of to make the method and system for singing video in real time Download PDFInfo
- Publication number
- CN104883516B CN104883516B CN201510306446.1A CN201510306446A CN104883516B CN 104883516 B CN104883516 B CN 104883516B CN 201510306446 A CN201510306446 A CN 201510306446A CN 104883516 B CN104883516 B CN 104883516B
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- song
- real time
- flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The invention discloses a kind of method and system making performance video in real time, and wherein method includes step：Generate the first video flowing of camera；Obtain the operational order of recording song；Audio device receives MV audio accompaniments and sings recording, Composite tone stream, and will be in the audio streams to camera；Camera mixes the audio stream, the first video flowing, generates audio/video flow, and be sent in control terminal；Control terminal decodes the audio/video flow, obtains the second video flowing, and be sent to display terminal；Display terminal plays second video flowing, and the synchronous loaded and displayed MV lyrics.By the above-mentioned means, the purpose of structure individual video in real time can be achieved in the present invention, and achieve the effect that real-time synchronization, user is facilitated to make individual video.
Description
Technical field
The present invention relates to digital audio-video field more particularly to a kind of method and system making performance video in real time.
Background technology
The technological means for using video to synthesize new video with audio captioning currently on the market is highly developed, many soft
It is audio, video and the subtitle to obtaining in advance that part, which has this function, basic process, and the later stage is parsed, then is carried out secondary
Coding generates new video.
Since there are great defects in real-time for existing technical solution, especially can not in digital audio-video place,
The video production that user sings is shown at video file is sung in user's performance in real time in the process；It is even more impossible to drill user
Video real-time manufacturing is sung to be preserved and shared at the performance video file of audio-visual synchronization.Above-mentioned real-time performance video file
Make not only has prodigious difficulty in technology realization, and the source about video, audio and subtitle is not easy to obtain, and also easily exists
Audio ＆ video nonsynchronous problem is easy to happen when synthesis.
Invention content
The technical problem to be solved by the present invention is to：A kind of method and system for making and singing video in real time are provided, it can be square
Just user makes individual video and is fast shared and downloaded.
In order to solve the above-mentioned technical problem, the technical solution adopted by the present invention is：A kind of real-time performance video of making is provided
Method, including：
Camera obtains the first video flowing in real time；
It receives accompanying song audio and sings recording, Composite tone stream, and be sent in camera；And the audio circulation
Cross audio output apparatus output；
Camera mixes the audio stream and the first video flowing, generates audio/video flow, and be sent to digital audio-video terminal and set
In standby；
Digital audio-video terminal device decodes the audio/video flow, obtains the second video flowing, and be sent to display terminal；
Display terminal plays second video flowing, and the corresponding lyrics of synchronous loaded and displayed song.
Wherein, the display terminal plays second video flowing, and the corresponding lyrics file of synchronous loaded and displayed song
Specially：Display terminal is superimposed on song MV videos plays the second video flowing, and the corresponding lyrics of synchronous loaded and displayed song
File.
Wherein, after the display terminal is superimposed the second video flowing of broadcasting on song MV videos, on the second video flowing again
Overlapping display video mode Scene Representation layer.
Wherein, second video flowing and video mode Scene Representation layer are shown in song MV videos in a form of picture-in-picture
On, or painting masking-out is carried out to song MV videos and is shown.
Wherein, prestore more than one video mode Scene Representation in the digital audio-video terminal device or place server
Layer, according to song play time progress, replaces the video mode Scene Representation layer.
Wherein, the display terminal is in playing process, according to song play time progress, in the video mode scene
Foreground elements or special efficacy multimedia picture are added on presentation layer.
Wherein, camera mixes the audio stream and the first video flowing, generates audio/video flow, and is sent to digital audio-video end
After step in end equipment, further include：Digital audio-video terminal device sends audio/video flow to place server, place server
ID is shared in generation, and is stored to audio/video flow.
Wherein, digital audio-video terminal device sends audio/video flow to place server, and ID is shared in place server generation, and
After the step of being stored to audio/video flow, further include：
Acquisition for mobile terminal shares ID, and shares instruction to place server transmission；
Place server shares address according to sharing instruction and generate, and will share address and corresponding audio/video flow is sent to
Cloud server；
Cloud server preserves the audio/video flow according to address is shared；
Mobile terminal accesses audio/video flow according to address is shared.
Wherein, camera mixes the audio stream and the first video flowing, generates audio/video flow, and is sent to digital audio-video end
Further include singing video to share step, specially after step in end equipment：
After playback of songs, ID is shared in the generation of digital audio-video terminal device；
Acquisition for mobile terminal shares ID, and shares instruction to the transmission of digital audio-video terminal device；
Digital audio-video terminal device shares address according to instruction generation is shared, and will share address and corresponding audio/video flow
It is sent to cloud server；
Cloud server preserves the audio/video flow according to address is shared；
Mobile terminal accesses audio/video flow according to address is shared.
Wherein, before the camera obtains the step of the first video flowing in real time, further include：It obtains to record to give song recitals and regard
The operational order of frequency.
Wherein, obtain record give song recitals video operational order the step of be specially：
Requesting song screen shows the song catalog page and recording interface；
It obtains requesting songs and/or clicks the operational order recorded；
Show camera preview interface and mode tuning interface.
Wherein, it obtains and records the operational order of video of giving song recitals and further include：The song music composition for two or more is triggered, madrigal is recorded.
To solve the above problems, the present invention also provides a kind of systems for making and singing video in real time, including：Camera, sound
Imitate device, digital audio-video terminal device and display terminal；Wherein,
Camera for obtaining the first video flowing in real time；By mixed audio stream and the first video flowing, audio/video flow is generated,
And it is sent to the digital audio-video terminal device；
Audio device arrives the audio streams for receiving accompanying song audio and singing recording, Composite tone stream
In camera；
Digital audio-video terminal device obtains the second video flowing, and be sent to display terminal for decoding the audio/video flow；
Prestore more than one video mode Scene Representation layer, according to song play time progress, replaces video mode Scene Representation layer；
Display terminal is for playing second video flowing, and the corresponding lyrics of synchronous loaded and displayed song.
Wherein, the system also includes requesting song screen, place server, cloud server and mobile terminals；
Requesting song screen is for showing the song catalog page and recording interface；It obtains requesting songs and/or clicks the operation recorded
Instruction；Show camera preview interface and mode tuning interface；The song music composition for two or more is triggered, madrigal is recorded；
The digital audio-video terminal device sends the audio/video flow to place server；Prestore more than one foreground member
Element or special efficacy multimedia resource；It is additionally operable to control requesting song screen and carries out the display song catalog page and recording interface；Give requesting song screen hair
It send requesting songs and/or clicks the operational order recorded；Control requesting song screen shows camera preview interface and mode tuning interface；
Control requesting song screen shows the song music composition for two or more, records madrigal；
Place server is used to receive the audio/video flow of digital audio-video terminal device transmission, and generates and share ID；It receives and moves
Dynamic terminal shares instruction, according to share instruction generate it is corresponding share address, and send to cloud server share address and
Corresponding audio/video flow；Prestore more than one video mode Scene Representation layer；Prestore more than one foreground elements or special efficacy
Multimedia resource；
Cloud server preserves the audio/video flow for receiving audio/video flow and sharing address according to address is shared；
Mobile terminal shares ID for receiving, and shares instruction to place server transmission according to ID is shared；By sharing
Address plays the audio/video flow that cloud server preserves.
Wherein, the display terminal is used for the superposition on song MV videos and plays the second video flowing, on the second video flowing
Overlapping display video mode Scene Representation layer adds foreground elements or special efficacy multimedia money on video mode Scene Representation layer
Source, and the corresponding lyrics file of synchronous loaded and displayed song.
The beneficial effects of the present invention are：It is different from the prior art, the side of video is sung in making provided by the invention in real time
Method and system are by generating the first video flowing of camera, then obtain the operational order of recording song, audio device receive MV accompaniments and
Voice records and obtains audio stream, and the first video flowing, audio stream are mixed on camera, generates audio/video flow, is sent to control
Terminal, control terminal decodes audio/video flow and obtains the second video flowing, and is sent to display terminal, and display terminal plays second simultaneously
Video flowing, and show the MV lyrics.Both the purpose of structure individual video in real time had been realized, and has achieved the effect that real-time synchronization is shown.
Description of the drawings
Fig. 1 is the flow diagram of the method for the present invention embodiment one；
Fig. 2 is the flow diagram of the method for the present invention embodiment two；
Fig. 3 is the flow diagram of the method for the present invention embodiment three；
Fig. 4 is the flow diagram of the method for the present invention example IV；
Fig. 5 is the structural schematic diagram of present system embodiment five；
Fig. 6 is the structural schematic diagram of present system embodiment six.
Specific implementation mode
To explain the technical content, the achieved purpose and the effect of the present invention in detail, below in conjunction with embodiment and coordinate attached
Figure is explained.
Fig. 1 is please referred to, the embodiment of the present invention one provides a kind of method for making and singing video in real time, including walks as follows
Suddenly：
S110：Camera obtains the first video flowing in real time；
S120：It receives accompanying song audio and sings recording, Composite tone stream, and be sent in camera；And the sound
Frequency stream is exported by audio output apparatus；
S130：Camera mixes the audio stream and the first video flowing, generates audio/video flow, and is sent to digital audio-video end
End equipment；
S140：Digital audio-video terminal device decodes the audio/video flow, obtains the second video flowing, and is sent to display eventually
End；
S150：Display terminal plays second video flowing, and the corresponding lyrics of synchronous loaded and displayed song.
It is different from the prior art, the method that video is sung in the making that the embodiment of the present invention one provides in real time facilitates user to exist
Digital audio-video place makes video when giving song recitals, and real-time display user can not only sing regarding for process on display terminal
Frequently, moreover it is possible to obtain the performance video file of audio stream and video stream synchronization during user gives song recitals.
In the manufacturing process for singing video file, the first video flowing sung using camera user in real, the
One video flowing is especially comprising being the head portrait of user, the look for singing process and other limb actions etc., by the first video flowing unisonance
Frequency stream is mixed, and audio/video flow is generated.Wherein audio stream is accompanying song and the performance sound of user, the performance sound of user
Audio device can be obtained and is sent to by microphone, and audio device obtains accompanying song from digital audio-video terminal device simultaneously, then
It carries out the performance sound and accompanying song of user to be mixed to get audio stream.Audio device plays out mixed audio stream, and
It is sent to video camera.
Video, system are sung if audio stream and the first video flowing are transmitted directly to digital audio-video terminal device and make
The performance video for making to complete has that audio stream and the first video flowing are in time and asynchronous.
In order to overcome this defect, audio, the purpose of audio video synchronization are realized, first by mixed audio streams to camera shooting
In head, audio stream is mixed with the first video flowing in camera and generates audio/video flow.Because making video in camera, first regards
Frequency stream is not required to be transmitted, and video flowing in time can be synchronous with audio stream, and audio has can be realized in the audio/video flow generated
It is synchronous with video.And after digital audio-video terminal device receives the audio/video flow that is sent from camera, decode it acquisition the
Two video flowings, during display terminal plays and shows the second video flowing, audio stream plays are not (because audio stream has passed through
Audio output apparatus is played), it is synchronous to load the corresponding lyrics of song according to reproduction time progress.
Present invention digital audio-video terminal device mentioned above can be set-top box.The performance that the present invention mentions can refer to
The performance of the progress such as public number audiovisual place, such as KTV, bar, nightclub can also be drilling for family's singing place progress
It sings.
Wherein, as shown in Fig. 2, the embodiment of the present invention two on the basis of the above embodiment 1, " shows eventually S150 steps
End plays second video flowing, and the corresponding lyrics of synchronous loaded and displayed song " it is extended.Due to during performance,
Some users wish the MV videos it can be seen that song first wife, can perform step S151：Display terminal is folded on song MV videos
Add and play the second video flowing, and the corresponding lyrics file of synchronous loaded and displayed song.And for other user, it is desirable to see
Completely without the second video flowing of song MV videos, then it is not required to play song MV videos.Song MV mentioned in the present invention is regarded
Frequently, the MV videos for the first wife that gives song recitals are each meant.MV refers to a kind of art presented simultaneously with television image to the deciphering of music
Type.
In order to more highlight the second video flowing, step S152 can perform：Display terminal is superimposed on song MV videos and broadcasts
After putting the second video flowing, the Overlapping display video mode Scene Representation layer on the second video flowing.Video mode Scene Representation layer can
As the background layer of the second video flowing, video mode Scene Representation layer can classify according to theme, for example, stage pattern scene
Presentation layer, sandy beach pattern scene presentation layer, Christmas pattern scene presentation layer, space pattern scene presentation layer etc..Video mode field
The specific bandwagon effect of scape presentation layer can be：Middle section is transparent, to the second video flowing of display；Frame portion is according to master
The picture of setting is inscribed, frame portion can be covered on the second video flowing and show.
It, can be by the second video in order to highlight the second video flowing and video mode Scene Representation layer during display
Stream and video mode Scene Representation layer are shown in a form of picture-in-picture on song MV videos, or carry out painting illiteracy to song MV videos
Version display.By the above-mentioned means, the second video flowing and video mode Scene Representation layer can be highlighted, reduction shows that song MV is regarded
Frequently.Second video flowing and video mode Scene Representation layer can be shown in the center of song MV videos in a form of picture-in-picture；Song
The corresponding lyrics can be directly displayed at below lyrics MV videos.
Wherein, further include step S153 before showing video mode Scene Representation layer：The digital audio-video terminal device or field
Prestore more than one video mode Scene Representation layer in institute's server；And step S154：According to types of songs, video is replaced
Pattern scene presentation layer.For example, when playing heat song, the video mode Scene Representation layer of the second video flowing collocation stage style；
When playing song related with Christmas, the video mode Scene Representation layer of the second video flowing collocation Christmas style；When play with
When the relevant song of space, the second video flowing is arranged in pairs or groups the video mode Scene Representation layer of space style.Cooperation in this way, no
The interest of user's performance can only be increased, user can also select various video mode Scene Representation layers according to the hobby of oneself.
During realization, the select button of various video mode Scene Representation layers can will be set, and user can be directly in point on requesting song screen
It is selected on song screen.
Since user can switch in multiple video mode Scene Representation layers, the user of such display terminal displaying is real
When the video sung will there are many background display, and the switching mode of user preference, similar magic lantern can be also selected in switching
Various effects etc. when piece switches.In this way when playing, effect is lively, interesting strong.
In order to which the interactivity and interesting, display effect ornamental value, the display terminal that increase display process are playing
In the process, step S155 is executed：According to song play time progress, on the video mode Scene Representation layer before addition display
Scape element or special efficacy multimedia resource.Described foreground elements, such as video frame, video filter etc.；The characteristic multimedia
Resource, for example, colored special efficacy of floaing, the 3D animation effects or barrage, personalized emoticons etc. such as spread flower, bubble, fireworks and other can
Enhance element, the special efficacy of display effect, details are not described herein again.The foreground elements or special efficacy multimedia picture layer resource are pre-
It is stored in digital audio-video terminal device or place server.
In the video that display terminal displaying user sings in real time, user can see the mass effect of audio/video flow in real time,
If user needs to modify it or improve, the executable operational order adjusted to the video file is real-time to carry out
Adjustment, customer satisfaction system video file is enabled to obtain.
On the basis of embodiment two, the present invention also provides embodiment three, as shown in figure 3, embodiment three relates generally to pair
It makes the preservation of audio-video document and shares.Specially：Further include step S131 after step S130：Digital audio-video terminal is set
Preparation send audio/video flow to place server, and ID is shared in place server generation, and is stored to audio/video flow.
And step S132：Acquisition for mobile terminal shares ID, and shares instruction to place server transmission；
Step S133：Place server shares address according to sharing instruction and generate, and will share address and corresponding sound regards
Frequency stream is sent to cloud server；
Step S134：Cloud server preserves the audio/video flow according to address is shared；
Step S135：Mobile terminal accesses audio/video flow according to address is shared.
Specifically, when user needs to share the audio/video flow made between friend, number is passed through by mobile terminal
Audiovisual terminals equipment shares instruction to place server transmission, and place server will be generated according to instruction is shared by sharing ID
Share address accordingly, and address will be shared and be sent to cloud server, cloud server preserves audio and video according to address is shared
Stream.Mobile terminal by the acquisition of digital audio-video terminal share ID and it is corresponding share address, then further according to sharing address from cloud
Hold server playing audio-video stream.Such as user can be swept by the client (such as K meters of app) installed on mobile terminal such as mobile phone
It retouches and shares address (such as Quick Response Code), you can the playing audio-video stream on mobile phone.Other users can also be existed by terminal device
Page end shares resource by sharing path access cloud server, in page end using player, or downloads and share resource.It is logical
Aforesaid operations are crossed, it can be achieved that convenient share the purpose for singing video file.
Similarly, and in the scene that some families sing, the step of sharing to audio/video flow is specially：Described in camera mixing
Audio stream and the first video flowing generate audio/video flow, and further include drilling after the step being sent in digital audio-video terminal device
The step of sharing of video is sung, specially：
After playback of songs, ID is shared in the generation of digital audio-video terminal device；
Acquisition for mobile terminal shares ID, and shares instruction to the transmission of digital audio-video terminal device；
Digital audio-video terminal device shares address according to instruction generation is shared, and will share address and corresponding audio/video flow
It is sent to cloud server；
Cloud server preserves the audio/video flow according to address is shared；
Mobile terminal accesses audio/video flow according to address is shared.
Other users by terminal device in page end by sharing path access cloud server, broadcast in page end use
It puts device and shares resource, or download and share resource.
On the basis of embodiment one, the present invention also provides example IVs, as shown in figure 4, mainly being recorded to camera
The setting of order.Wherein, when executing step S110, following steps are specifically executed：
S111：Start digital audio-video place terminal in audiovisual place, be successfully connected camera, recorded a video by camera,
Obtain the first video flowing；
S112：By the first video stream to digital audio-video terminal device, digital audio-video terminal device control requesting song screen or
Display terminal preview；
S113：Adjustment camera position in time, to obtain the first best video flowing.
Further include following steps before step S110：
S100：Obtain the operational order for recording the video that gives song recitals.
The concrete operations that the S100 obtains the operational order for recording the video that gives song recitals are：
S101：Requesting song screen shows the song catalog page and recording interface；
S102：It obtains requesting songs and/or clicks the operational order recorded；Video is sung in real time when user needs to make
When, the recording on first triggering requesting song screen gives song recitals the operational order of video.User shows before selection gives song recitals on requesting song screen
Show the song page and recording interface.The button being arranged on the display song page and recording interface and instruction are by digital audio-video
Terminal device is configured, and is shown on requesting song screen.Include but not limited to the library list of song song and song wherein on the song page
Bent information etc., and it includes selection dialog box and some operation buttons accordingly recorded or prompt that recording interface, which can be,.With
When the song that it needs program request is clicked at family, corresponding operational order is inputted to song interface, digital audio-video terminal device will obtain
These instructions are taken, and controls requesting song screen and operate or show accordingly.Similarly, user also can be digital for the instruction of recording
Audiovisual terminals obtain, and control requesting song screen and operated accordingly.
Wherein, further include following steps after step S102：
S103：Requesting song screen shows camera preview interface and mode tuning interface；
User starts real-time recording user and sings video by clicking recording interface, camera, wherein requesting song screen is entering
After recording interface, requesting song screen shows the preview interface of camera to user, and quilt when user sings is shown in the preview interface
The real-time video and background context of typing.When user adjusts video if desired, by requesting a song, the button on screen can also be adjusted accordingly
Go out display pattern adjustment interface, the pattern needed for it selected for user, such as the position adjustment to the replacement of background, camera and
Daylighting situation adjustment etc..
After step S103 steps, can also it follow the steps below：
S104：The song music composition for two or more is triggered, madrigal is recorded.
After the conditions such as camera, background, daylighting are respectively provided with, user can trigger the song music composition for two or more of system, and carry out
Madrigal is recorded, meanwhile, the audio/video flow that digital audio-video terminal device adjusts front is without preserving.In the process of performance
In, when user replaces song or reselects segment if desired, the song music composition for two or more of system is can trigger, and carry out recording weight
It sings bent.And in order to give the preparation that the time of user's abundance carries out recording, when triggering the music composition for two or more, when giving one preparation of user
Between, while user can also be adjusted the preview interface of camera in real time, to be finally reached ideal situation desired by user.Therefore its
More hommization is operated, user experience will be promoted.
It is different from the prior art, the above embodiment of the present invention can facilitate user when camera is recorded a video, preview video recording effect
And can be adaptively adjusted, while the replacement to song or the music composition for two or more, operational stronger, also more hommization can be achieved, and use
The effect for sharing or being directly viewable recording between everybody in address is shared in family in optional generate of the video file to having made, and
It makes adjustment.The very convenient user of whole operation executes, and fully solves the problems, such as being likely to occur in manufacturing process, and
It provides corresponding Adjusted Option to select for user, therefore not only simple operation, but also more hommization, and user's body will be promoted
Degree of testing.
As shown in figure 5, a kind of system 100 making performance video in real time of the also corresponding offer of the embodiment of the present invention five, including：
Camera 110, audio device 120, digital audio-video terminal device 130 and display terminal 140；Wherein
Camera 110 for obtaining the first video flowing in real time；By mixed audio stream and the first video flowing, audio and video are generated
Stream, and it is sent to the digital audio-video terminal device 130；
Audio device 120 is for receiving accompanying song audio and singing recording, Composite tone stream, and by the audio streams
Into camera 110；
Digital audio-video terminal device 130 obtains the second video flowing, and be sent to display eventually for decoding the audio/video flow
End 140；Prestore more than one video mode Scene Representation layer, according to song play time progress, replaces video mode scene
Presentation layer；
Display terminal 140 is for playing second video flowing, and the corresponding lyrics of synchronous loaded and displayed song.
Wherein, as shown in fig. 6, the system 100 of present system embodiment six further includes：
Requesting song screen 150, place server 160, cloud server 170 and mobile terminal 180；
Requesting song screen 150 is for showing the song catalog page and recording interface；It obtains requesting songs and/or clicks the behaviour recorded
It instructs；Show camera preview interface and mode tuning interface；The song music composition for two or more is triggered, madrigal is recorded；
The digital audio-video terminal device 130 is for sending the audio/video flow to place server 160；Prestore one with
On foreground elements or special efficacy multimedia resource；Control requesting song screen 150 is additionally operable to carry out the display song catalog page and record boundary
Face；Requesting songs are sent to requesting song screen 150 and/or click the operational order recorded；The 150 display camera preview of control requesting song screen
Interface and mode tuning interface；The 150 display song music composition for two or more of control requesting song screen, records madrigal.
Place server 160 is used to receive the audio/video flow of the transmission of digital audio-video terminal device 130, and generates and share ID；
Receive mobile terminal 180 shares instruction, instructs generation is corresponding to share address according to sharing, and sent out to cloud server 170
It send and shares address and corresponding audio/video flow；Prestore more than one video mode Scene Representation layer；Prestore it is more than one before
Scape element or special efficacy multimedia resource；
Cloud server 170 preserves the audio and video for receiving audio/video flow and sharing address according to address is shared
Stream；
Mobile terminal 180 shares ID for obtaining, and shares instruction to the transmission of place server 160 according to ID is shared；It is logical
It crosses and shares the audio/video flow that address plays the preservation of cloud server 170.
Wherein, the display terminal 130 is additionally operable to the superposition on song MV videos and plays the second video flowing, in the second video
Overlapping display video mode Scene Representation layer on stream adds foreground elements or special efficacy multimedia on video mode Scene Representation layer
Resource, and the corresponding lyrics file of synchronous loaded and displayed song.
Example the above is only the implementation of the present invention is not intended to limit the scope of the invention, every to utilize this hair
Equivalents made by bright specification and accompanying drawing content are applied directly or indirectly in relevant technical field, include similarly
In the scope of patent protection of the present invention.
Claims (14)
1. a kind of making the method for singing video in real time, which is characterized in that including：
Camera obtains the first video flowing in real time；
It receives accompanying song audio and sings recording, Composite tone stream, and be sent in camera；And the audio stream passes through sound
Frequency output equipment exports；
Camera mixes the audio stream and the first video flowing, generates audio/video flow, and be sent in digital audio-video terminal device；
Digital audio-video terminal device decodes the audio/video flow, obtains the second video flowing, and be sent to display terminal；
Display terminal plays second video flowing, and the corresponding song of loaded and displayed song is synchronized on second video flowing
Word；
After the display terminal is superimposed the second video flowing of broadcasting on song MV videos, Overlapping display regards again on the second video flowing
Frequency pattern scene presentation layer.
2. making the method for singing video in real time according to claim 1, which is characterized in that described in the display terminal plays
Second video flowing, and the corresponding lyrics file of synchronous loaded and displayed song is specially：Display terminal is superimposed on song MV videos
Play the second video flowing, and the corresponding lyrics file of synchronous loaded and displayed song.
3. making the method for singing video in real time according to claim 1, which is characterized in that second video flowing and video
Pattern scene presentation layer is shown in a form of picture-in-picture on song MV videos, or is carried out painting masking-out to song MV videos and shown.
4. making the method for singing video in real time according to claim 1, which is characterized in that display video mode Scene Representation
Before layer, further include：
Prestore more than one video mode Scene Representation layer in the digital audio-video terminal device or place server；
According to song play time progress, the video mode Scene Representation layer is replaced.
5. making the method for singing video in real time according to claim 1, which is characterized in that the display terminal was playing
Cheng Zhong adds foreground elements or special efficacy multimedia according to song play time progress on the video mode Scene Representation layer
Resource.
6. making the method for singing video in real time according to claim 1, which is characterized in that camera mixes the audio stream
With the first video flowing, audio/video flow is generated, and after the step being sent in digital audio-video terminal device, further includes singing video
Share step, specially：Digital audio-video terminal device sends audio/video flow to place server, and place server generation is shared
ID, and audio/video flow is stored.
7. making the method for singing video in real time according to claim 6, which is characterized in that digital audio-video terminal device is sent
For audio/video flow to place server, ID is shared in place server generation, and after the step of being stored to audio/video flow, also wraps
It includes：
Acquisition for mobile terminal shares ID, and shares instruction to place server transmission；
Place server shares address according to sharing instruction and generate, and will share address and corresponding audio/video flow is sent to high in the clouds
Server；
Cloud server preserves the audio/video flow according to address is shared；
Mobile terminal accesses audio/video flow according to address is shared.
8. making the method for singing video in real time according to claim 1, which is characterized in that camera mixes the audio stream
With the first video flowing, audio/video flow is generated, and after the step being sent in digital audio-video terminal device, further includes singing video
Share step, specially：
After playback of songs, ID is shared in the generation of digital audio-video terminal device；
Acquisition for mobile terminal shares ID, and shares instruction to the transmission of digital audio-video terminal device；
Digital audio-video terminal device shares address according to instruction generation is shared, and will share address and the transmission of corresponding audio/video flow
To cloud server；
Cloud server preserves the audio/video flow according to address is shared；
Mobile terminal accesses audio/video flow according to address is shared.
9. making the method for singing video in real time according to claim 1, which is characterized in that the camera obtains the in real time
Before the step of one video flowing, further include：Obtain the operational order for recording the video that gives song recitals.
10. making the method for singing video in real time according to claim 9, which is characterized in that acquisition is recorded to give song recitals and be regarded
The step of operational order of frequency is specially：
Requesting song screen shows the song catalog page and recording interface；
It obtains requesting songs and/or clicks the operational order recorded；
Show camera preview interface and mode tuning interface.
11. making the method for singing video in real time according to claim 10, which is characterized in that acquisition is recorded to give song recitals and be regarded
The operational order of frequency further includes：The song music composition for two or more is triggered, madrigal is recorded.
12. a kind of making the system for singing video in real time, which is characterized in that including：Camera, audio device, digital audio-video terminal
Equipment and display terminal；Wherein,
Camera for obtaining the first video flowing in real time；By mixed audio stream and the first video flowing, audio/video flow is generated, concurrently
It send to the digital audio-video terminal device；
Audio device for receive accompanying song audio and sing recording, Composite tone stream, and by the audio streams to image
In head；
Digital audio-video terminal device obtains the second video flowing, and be sent to display terminal for decoding the audio/video flow；It prestores
More than one video mode Scene Representation layer replaces video mode Scene Representation layer according to song play time progress；
Display terminal is for playing second video flowing, and synchronous loaded and displayed song is corresponding on second video flowing
The lyrics；
The display terminal is used for the superposition on song MV videos and plays the second video flowing, and Overlapping display regards on the second video flowing
Frequency pattern scene presentation layer.
13. according to the system for singing video in real time is made described in claim 12, which is characterized in that the system also includes requesting songs
Screen, place server, cloud server and mobile terminal；
Requesting song screen is for showing the song catalog page and recording interface；It obtains requesting songs and/or clicks the operational order recorded；
Show camera preview interface and mode tuning interface；The song music composition for two or more is triggered, madrigal is recorded；
The digital audio-video terminal device is for sending the audio/video flow to place server；Prestore more than one foreground member
Element or special efficacy multimedia resource；It is additionally operable to control requesting song screen and carries out the display song catalog page and recording interface；Give requesting song screen hair
It send requesting songs and/or clicks the operational order recorded；Control requesting song screen shows camera preview interface and mode tuning interface；
Control requesting song screen shows the song music composition for two or more, records madrigal；
Place server is used to receive the audio/video flow of digital audio-video terminal device transmission, and generates and share ID；It receives mobile whole
Instruction is shared at end, instructs generation is corresponding to share address according to sharing, and share address and correspondence to cloud server transmission
Audio/video flow；Prestore more than one video mode Scene Representation layer；The more than one foreground elements that prestore or the more matchmakers of special efficacy
Body resource；
Cloud server preserves the audio/video flow for receiving audio/video flow and sharing address according to address is shared；
Mobile terminal shares ID for receiving, and shares instruction to place server transmission according to ID is shared；By sharing address
Play the audio/video flow that cloud server preserves.
14. according to the system for singing video in real time is made described in claim 12, which is characterized in that in video mode Scene Representation
Foreground elements or special efficacy multimedia resource, and the corresponding lyrics file of synchronous loaded and displayed song are added on layer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510306446.1A CN104883516B (en) | 2015-06-05 | 2015-06-05 | It is a kind of to make the method and system for singing video in real time |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510306446.1A CN104883516B (en) | 2015-06-05 | 2015-06-05 | It is a kind of to make the method and system for singing video in real time |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104883516A CN104883516A (en) | 2015-09-02 |
| CN104883516B true CN104883516B (en) | 2018-08-14 |
Family
ID=53950840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510306446.1A Active CN104883516B (en) | 2015-06-05 | 2015-06-05 | It is a kind of to make the method and system for singing video in real time |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104883516B (en) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967900B (en) * | 2015-05-04 | 2018-08-07 | 腾讯科技（深圳）有限公司 | A kind of method and apparatus generating video |
| CN105635772A (en) * | 2015-12-30 | 2016-06-01 | 北京奇艺世纪科技有限公司 | Picture-in-picture video playing method and mobile terminal supporting picture-in-picture video playing |
| CN107368491B (en) * | 2016-05-12 | 2023-07-25 | 富泰华工业（深圳）有限公司 | Image making system and method |
| CN106060591A (en) * | 2016-05-31 | 2016-10-26 | 北京小米移动软件有限公司 | Interaction method and device in video live broadcasting application |
| CN107770235A (en) * | 2016-08-23 | 2018-03-06 | 冯山泉 | One kind bucket song service implementing method and system |
| CN107027050B (en) * | 2017-04-13 | 2020-11-20 | 广州华多网络科技有限公司 | Audio and video processing method and device for assisting live broadcast |
| CN107396137B (en) * | 2017-07-14 | 2020-06-30 | 腾讯音乐娱乐（深圳）有限公司 | Online interaction method, device and system |
| CN107798561B (en) * | 2017-10-25 | 2021-08-13 | 网易传媒科技（北京）有限公司 | Audio playing and sharing method and device, storage medium and electronic equipment |
| CN109285568A (en) * | 2018-10-12 | 2019-01-29 | 北京微播视界科技有限公司 | Method and apparatus for generating audio file |
| CN109587549B (en) * | 2018-12-05 | 2021-08-13 | 广州酷狗计算机科技有限公司 | Video recording method, device, terminal and storage medium |
| CN109920399A (en) * | 2019-02-22 | 2019-06-21 | 南安市腾龙专利应用服务有限公司 | A kind of KTV obtains the method and K song system of audio-video |
| CN111757165B (en) * | 2019-03-28 | 2022-09-16 | 阿里巴巴集团控股有限公司 | Data output method, data processing method, device and equipment |
| CN111954052B (en) * | 2019-05-17 | 2022-04-05 | 上海哔哩哔哩科技有限公司 | Method for displaying bullet screen information, computer equipment and readable storage medium |
| CN110324718B (en) * | 2019-08-05 | 2021-09-07 | 北京字节跳动网络技术有限公司 | Audio and video generation method and device, electronic equipment and readable medium |
| CN110944226B (en) * | 2019-11-27 | 2021-05-11 | 广州华多网络科技有限公司 | Network Karaoke system, lyric display method in Karaoke scene and related equipment |
| CN111163274B (en) * | 2020-01-21 | 2022-04-22 | 海信视像科技股份有限公司 | Video recording method and display equipment |
| CN111459396B (en) * | 2020-03-30 | 2021-06-22 | 北京小唱科技有限公司 | Playing method, device and system based on intelligent terminal |
| US11395049B2 (en) * | 2020-03-31 | 2022-07-19 | Northwest Instrument Inc. | Method and device for content recording and streaming |
| CN113747217A (en) * | 2020-05-29 | 2021-12-03 | 聚好看科技股份有限公司 | Display device and method for improving chorus speed |
| CN114697742A (en) * | 2020-12-25 | 2022-07-01 | 华为技术有限公司 | Video recording method and electronic equipment |
| CN114500883A (en) * | 2022-04-18 | 2022-05-13 | 北京麦颂文化传播有限公司 | Method, device and equipment for KTV to self-control MV (music video) and computer readable storage medium |
| CN115359156B (en) * | 2022-07-31 | 2023-12-05 | 荣耀终端有限公司 | Audio playing method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045373A (en) * | 1999-07-30 | 2001-02-16 | Satoshi Fujimae | Karaoke video compositing device for allowing singer to perform on screen |
| CN1684506A (en) * | 2004-04-16 | 2005-10-19 | 清华同方股份有限公司 | Picture-in-picture display system in video frequency ordering |
| CN101118743A (en) * | 2007-07-12 | 2008-02-06 | 深圳市融合视讯科技有限公司 | Remote interaction karaoke system establishing and using method thereof |
| CN102915725A (en) * | 2012-09-10 | 2013-02-06 | 福建星网视易信息系统有限公司 | Human-computer interaction song singing system and method |
| CN103268763A (en) * | 2013-06-05 | 2013-08-28 | 广州市花都区中山大学国光电子与通信研究院 | Wireless media system based on synchronous audio extraction and real-time transmission |
| CN103986947A (en) * | 2014-05-04 | 2014-08-13 | 苏州乐聚一堂电子科技有限公司 | Karaoke mobile phone song query system with image special effect |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2518277Y (en) * | 2002-01-31 | 2002-10-23 | 宪锋光电科技股份有限公司 | Processing device for real time broadcasting and recording digitalization image audio |
| CN101098523B (en) * | 2006-06-29 | 2012-12-05 | 海尔集团公司 | Method for realizing karaoke by mobile phone and mobile phone with karaoke function |
| CN103999453B (en) * | 2011-09-18 | 2019-04-12 | 踏途音乐公司 | Digital Anytime device and correlation technique with Karaoke and photographic booth function |
-
2015
- 2015-06-05 CN CN201510306446.1A patent/CN104883516B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045373A (en) * | 1999-07-30 | 2001-02-16 | Satoshi Fujimae | Karaoke video compositing device for allowing singer to perform on screen |
| CN1684506A (en) * | 2004-04-16 | 2005-10-19 | 清华同方股份有限公司 | Picture-in-picture display system in video frequency ordering |
| CN101118743A (en) * | 2007-07-12 | 2008-02-06 | 深圳市融合视讯科技有限公司 | Remote interaction karaoke system establishing and using method thereof |
| CN102915725A (en) * | 2012-09-10 | 2013-02-06 | 福建星网视易信息系统有限公司 | Human-computer interaction song singing system and method |
| CN103268763A (en) * | 2013-06-05 | 2013-08-28 | 广州市花都区中山大学国光电子与通信研究院 | Wireless media system based on synchronous audio extraction and real-time transmission |
| CN103986947A (en) * | 2014-05-04 | 2014-08-13 | 苏州乐聚一堂电子科技有限公司 | Karaoke mobile phone song query system with image special effect |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104883516A (en) | 2015-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104883516B (en) | It is a kind of to make the method and system for singing video in real time | |
| CN108259989B (en) | Video live broadcast method, computer readable storage medium and terminal equipment | |
| US9743145B2 (en) | Second screen dilemma function | |
| US9576334B2 (en) | Second screen recipes function | |
| CN109327741B (en) | Game live broadcast method, device and system | |
| US9583147B2 (en) | Second screen shopping function | |
| CN105450642B (en) | It is a kind of based on the data processing method being broadcast live online, relevant apparatus and system | |
| US10531158B2 (en) | Multi-source video navigation | |
| KR20080048308A (en) | Apparatus and method for linking a basic device and extended devices | |
| CN108449632B (en) | Method and terminal for real-time synthesis of singing video | |
| US9578370B2 (en) | Second screen locations function | |
| US9596502B1 (en) | Integration of multiple synchronization methodologies | |
| US9516373B1 (en) | Presets of synchronized second screen functions | |
| US6452598B1 (en) | System and method for authoring and testing three-dimensional (3-D) content based on broadcast triggers using a standard VRML authoring tool | |
| CN111556357B (en) | Method, device and equipment for playing live video and storage medium | |
| JP2009301477A (en) | Content editing device, method and program | |
| US9197920B2 (en) | Shared media experience distribution and playback | |
| CN114461423A (en) | Multimedia stream processing method, device, storage medium and program product | |
| JP2007013918A (en) | Digital camera having electronic visual jockey function, and file therefor | |
| JP2010246094A (en) | Content provision system, content generation apparatus, content reproduction apparatus, and content provision method | |
| CN109862385A (en) | Method, apparatus, computer readable storage medium and the terminal device of live streaming | |
| JP4295470B2 (en) | Content providing system, content receiving apparatus, content providing method, content receiving method, content providing program, and content receiving program | |
| CN106713994A (en) | Method and device for generating electronic calendar | |
| JP2009077187A (en) | Video parallel viewing method and video display device | |
| CN114390048A (en) | Cloud VR screen projection system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151104 Address after: 350018 Fujian city of Fuzhou province Nanjiang gate town of Cangshan District West Coast Road No. 198 Fuzhou Strait International Convention and Exhibition Center basement East Office Center No. A-029 (FTA test area) Applicant after: FUJIAN KAIMI NETWORK SCIENCE & TECHNOLOGY CO., LTD. Address before: Fuzhou City, Fujian Province, Jinshan Road 350028 No. 618 No. 20 Ruijie orangery Chau Science Park 4 Applicant before: Fujian Starnet e-Video Information System Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |