TWI356636B - System and method for recording and reproducing vi - Google Patents

Description

Ij56636 IX. INSTRUCTIONS: [Technical Field] The present invention relates to an audio-visual playback system and method, and more particularly to a video recording and playback capable of individually adjusting a recorded vocal 'image and music playback time point for simultaneous playback. System and method. [Prior Art]

Karaoke (karaoke), a leisure activity introduced by Japan from Taiwan, gradually evolved into a KTV that sings and combines images, and the location of singing has evolved from an open place to a m-to-development chorus, making singing gradually A popular leisure activity for modern people. Due to the increasing technology of the Internet, more and more people use the Internet, so the online KTV __ has also been developed.

Enjoy the fun of singing KTV. When the user downloads the song music accompaniment slot to the computer through the network, and the _ electric equipment (such as the microphone and the speaker), the singer and the singer are also interested in the recording software and the network camera. The songs and the images of the singer were recorded, and the singer made a personal music video (music video. 2 'Because the scale camera captures the image, the image is delayed due to the computer. Moreover, the webcam The recording function used for recording II usually needs to be started by computer software, so in fact, the voice recording Wei _ also starts to play the accompaniment music, there may be a tree accompaniment music playback time point is also known from the τ, if directly The video recorded by the road camera is 5 丄 356636 and the sound and the sound are confusing. When the video is reduced, the video and the turn (four) steps are found, and even the scaly charm of the money is not in the image. [Explanation] There is a problem that the sound and video groove recorded by using the conventional technology may have sound and image unsynchronization during playback, and the present invention discloses a video recording and playback system and The method is so as to be able to synchronize the hidden sounds; and the image signal.

The present invention provides a video recording and playback system, which includes: a recording module, an adjustment pull group, a signal synthesis module, and a subtraction module. The recording module is used for recording a voice = number and an image signal, wherein the voice signal has - at the first time point, the image signal has - the second time _. The adjustment is the music of the rib carrier having the third time point, and (4) the music signal is used as a reference to adjust the displacement of the vocal signal and the image signal in the ridge axis So that the position of the first time point and the second time point on the time axis and the third parental and the same signal synthesis module are used to adjust the vocal signal _ sound Wei number - The sound signal is based on the sound signal and the image signal, and then the playback module is responsible for playing the video signal. The present invention provides a video recording and playback method, the steps of which are: recording the voice signal and the image first. a signal, wherein the human voice signal has a first time point, and the video signal has a second time point. Then, the manned person has a music signal at the third time point, and the music signal is approved by the music signal!峨 no image 峨 displacement in the time axis, so that the position of the first time point and the second time point on the time axis and the third time point (four). After that, the human voice of the Lai and the 6 1356636 曰 减 为 声音 声音 声音 魏 魏 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 356 Before the signal synthesis, this month provides the user with the time when the vocal sound begins to appear in the vocal signal and the video signal towel begins to appear. The first one of the mouth type: aHlii, which is adjusted to start with the music scarf. The main theme of the song is k S IX / Xiao except for the subsequent playback of the audio and video signal, the sound signal and the image, and the tiger's (four) difference, and then the effect of playing the sound signal and the image signal. [Embodiment] Detailed features and implementations of the present invention In the embodiment, the content of the following is sufficient for any skilled person to understand the technical content field of the present invention, and is disclosed in accordance with the present disclosure. </ RTI> </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; Please refer to the "figure map". The video recording system includes a recording module 110, an adjustment module 120, a signal synthesizing module 13A, and a playing module 14A. The 'recording pole group 100 is responsible for recording the vocal signal ^ and the video signal V. In the present embodiment, the video recording and playback system 100 includes an image capturing module 150 and a vocal group. The image subtraction V is transmitted to the recording module 110, for example, by the shadow side capture module 15〇. The vocal signal 4 is used to receive the signal received by the audio receiving module 16G of the video recording and playback system, and the audio receiving module 16 transmits the vocal signal ^ to the recording 7 module 110, so that For recording. In this embodiment, the music signal am may be a signal pre-stored in the video recording and playback system, or may be a signal transmitted from other storage devices or the network to the video recording and playback system 100. The present invention does not limit the source of the music signal to this. As described above, the image capturing module 150 is, for example, a web camera, and the audio receiving module 16 is, for example, a microphone. Of course, in other embodiments, the image capturing module 150 and the audio receiving module 16 can also be integrated into a single device, such as a network camera having a microphone, and the present invention is not limited thereto. 〃 After the recording of the vocal signal Ap visor video v by the recording module 110, the user can mark the first time point ρ and the second time point ν' in the vocal signal ^ and the image signal 透过 through the operation interface respectively. As shown in "Figure 8". Here, the so-called first-time point ρ is the time point at which the singing voice begins to appear in the human voice signal Αρ; the second time point ν is the video signal V+, and the mouth type of the first word in the song begins to appear. And the music signal stored in the video recording and playback system (10)

Am has a third time point m ', which is the time point at which the main melody of the song begins to appear in the music signal Am. The adjustment module 12 is used to adjust the displacement of the vocal signal ~ and the image signal V in the time axis so that the position of the first time point P and the second time point v on the time axis j and the third time point m The same, as shown in "Figure 2B". That is, the adjustment module 120 can adjust the vocal signal Ap and the image signal v recorded by the recording module 110 so that the day when the vocal sound begins to appear in the vocal signal Ap; between = 1356636 and the video signal v &quot; The time when the word of the song is the first word of the word, the music signal Am _ begins to appear the same time. In particular, the actual butterfly adjustments (3) pairs, image signal: after adjustment 'and before the signal synthesis module (10) shouting synthesis 'first use the playback module (10) to play the music signal respectively = adjusted The vocal signal Ap and the video signal v are used for the first time point of the person's miscellaneous AP and the second time point of the video signal v after the audition is adjusted.

Whether it is the same as the music signal Am (four) three time points, in order to achieve the synchronous playback = fruit.

Please continue to refer to "1st picture", adjust the time point of the song in the vocal signal AP and start the vocalization of the vocal signal in the vocal signal AP. After the beginning of the song main melody _ the same, then the signal synthesis module m is responsible for the vocal AP and the music 峨Am face as the sound domain A, and according to the sound (four) A and the image 峨 v generated - video signal %. Those skilled in the art should be familiar with the technology of video signal synthesis, and will not be described here. The playing module 140 is used to play the video signal vM generated by the signal synthesizing module 13A. The file format of the video signal Vm of this embodiment is, for example, MPEG-4 (movie picture experts groups-4) file or wMV (windows media video) file. Of course, in other embodiments, the file format of the video signal % may also be other currently common video file formats, which are not limited by the present invention. The idea is that the sound signal A is synthesized by the voice signal Ap and the music signal 9 U56636. Therefore, the total length of the voice signal a depends on the total length of the music call am. For the fine and miscellaneous module, the image signal v U degree recorded does not match the total length of the voice screaming A. In the process of synthesizing the video signal %, the image V is processed, and the sound signal A is bribed. Have the same file length. The "3A" diagram shows a schematic diagram of the video signal v and the audio signal a on the time axis of the present invention. Please refer to "3A", although the position of the image signal at the time of the == and the fourth time point a of the audio signal (equivalent to the second time point m of the music signal VM) are the same on the time axis, but In this embodiment, the total length of the image signal V recorded by the recording module 110 is smaller than the total length of the sound signal A. Therefore, an additional compensation signal is needed to compensate the time difference between the image signal V and the sound signal a. In order to avoid the occurrence of sound and no image when the video signal VM is initially played. This will be explained in more detail below. • Fig. 4 is a block diagram showing the video recording and reproducing system of the present invention in the second embodiment. Please refer to FIG. 4, the video recording and playback system 4 includes a recording module 410, a fading module 420, a signal synthesizing module ο, and a playing module 44 〇. The recording module 410 and the adjusting module 420 The playback module 44 is similar to the recording module 11A, the adjustment module 12A, and the playback module 14A of the foregoing embodiment. Of course, the video recording and playback system 4 can also include an image capture module 45. The function of the audio receiving module 460 is similar to that of the image capturing module 45 and the audio receiving module 460, and will not be described here. As described above, in order to solve the problem caused by the video and audio synthesis process, The teacher of the 榲l delays to hide in the second implementation of the financial statement to the signal synthesis (four) ★ do 3 improvements' where the signal synthesis module 430 further steps include the shadow as early as 70 432, based on the signal synthesis module 430 Sound signal A and two "V in the process of generating video signal Vm" video signal processing unit, the signal $\&quot; like the time difference between m and the sound signal eight to generate a compensation image c * and the original shirt image number v is synthesized as After the scene, like the Tigers%. Among them, = image _ Vg_ supported video and audio signal Na a: the length of time - as shown in the difference 'as "FIG. 3B." Therefore, it can be seen that the ~Vm μ top 本 is synthesized by the post-production video signal VB and the audio signal A. In addition, the total length of the image signal v recorded by the recording module can be greater than the total length of the sound signal A, as shown in Figure 5A. At this time, the image signal processing unit 432 deletes the P knife whose image signal V exceeds the sound signal A, for example, to generate a post-production image nickname VB having a cigarette time length of the sound signal A, as shown in FIG. 5B. Show. *The captain can know that Shuming's video and audio system is before the vocal signal Ap, video signal v and music job AM recorded by it, first = the whole human voice _ Ap and the image v-face _ upward displacement, and then Take a ride on Wu’s signal. In this way, Ke eliminates the problem that each signal is __ poorly recorded during the recording process of each signal, thereby avoiding the problem that the sound image is not synchronized. In the process, firstly, the image signal is subjected to the post-production image signal of the same length of time 1356636. After that, the video signal and the sound signal are used to synthesize the video signal synchronized with the sound and the image. In order to make the skilled person more familiar with the present invention, the operation flow of the above video recording and playback system will be described below by way of example. Fig. 6 is a flow chart showing the steps of the video recording and playback method implemented in the first embodiment of the present invention. Please refer to "Figure 6". #Users start the video recording function of the network camera, play music and start singing. The system first receives the user's voice signal and accompaniment music signal separately, and listens to the user's image. Signal (step 610). Then, the recording of the vocal signal and the video signal (step 620) is started, and the time point at which the singing starts to appear in the vocal signal is recorded, and the time point at which the first word of the song begins to appear in the video signal (such as "the first Figure"). After recording &amp; After the system, the system will display the music signal originally stored in the system and the position map of the video signal and the vocal signal recorded on the time axis in step 6 (see "Figure 2A"). On the screen for the user's reference, and provide user-operate, face, the user can use the music signal as a reference, and input commands to adjust the vocals. The displacement of the K number and the image signal in the time axis (step (4)), the time point at which the singing sound begins to appear in the vocal signal and the time point at which the mouth of the word begins to appear in the video signal, starting with the music signal The time at which the main melody appears is the same (as shown in Figure 2B). . In particular, after the user adjusts the position of the vocal signal and the video capture on the time axis through the operation interface, the present embodiment, for example, first plays the adjusted vocal signal, video signal and music signal (step 640). The user tries to listen to the audition, 12 1356636 by borrowing money to tell whether the three 峨 are synchronized (step 65〇). When it is determined in step 650 that the vocal signal, the video signal and the music signal are still out of synch, 'repeating step 630' is to adjust the position of each afL number and the camera number in the time axis according to the test result. On the contrary, when it is determined in the step lake that the vocal signal 'image signal and music signal have been synchronized, the adjusted vocal vocal 5 and the music signal are combined into one sound signal (step 66 〇), and according to the sound signal The number and the video signal generate an audio signal (step 67). The video signal can then be played (step 680). Here, the file format of the video signal Vm is, for example, an MPEG-4 (movie picture experts groups-4) slot, a WMV (windows media video) file, or other currently common video file format. As described in the following section, 'The total length of the video signal may be the total length of the audio signal during the process of generating the video signal based on the audio signal and the video signal (see "3A" and "5A"). Therefore, the video recording and playback method implemented in the second embodiment of the present invention is as shown in Fig. 7, and in step 670, for example, it is first determined whether the total length of the video signal and the audio signal are the same (step 771). When the total length of the video signal and the audio signal are the same, proceed to step 680 shown in Figure 6. Conversely, when the total length of the video signal and the audio signal are different, it is first determined whether the total length of the video signal is less than the total length of the audio signal (step 772). When the total length of the video signal is less than the total length of the audio signal, the time difference between the video signal and the audio signal is calculated (step 773)', and then a compensated video signal is generated according to the difference in time length (step 774). The 'compensated image signal is combined with the original 13 1356636 image signal into a post-image signal, and the compensated image signal can be the image of the song title. Then, the audio signal and the post-production video signal are combined into a video signal (Buxiang 776). In this way, when playing the video signal (such as step 680 of "Picture 6"), it can avoid the situation that there is no sound and no image when playing. In addition, when the total length of the video signal is greater than the total length of the audio signal, the portion of the video signal beyond the audio signal is deleted (step 775) to generate a rear view image signal having the same length of 4 times as the audio signal. The audio signal and the post-image signal are then combined into a video signal (step 776). As described above, it can be seen that the difference between the present invention and the prior art is that the present invention first adjusts the recorded vocal signals and video signals on the basis of the music signal, and then checks the semaphores. Riding the synthesis. By this technique, the problem of the time difference between the recorded sound signal and the image signal can be solved by the prior art technique, thereby achieving the technical effect of simultaneously playing the vocal signal, the image signal and the music signal. Moreover, the present invention also provides a technical means for processing video signals in the process of synthesizing video signals to ensure that the final synthesized (four) voices have synchronized audio signals and video signals. Although the embodiments of the present invention are as described above, the above description is not intended to directly limit the scope of the invention. Any changes in the form and details of the embodiments may be made without departing from the spirit and scope of the invention. The patent for the invention, Wei Wei, shall still be subject to the definition of the attached full-time application. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram and diagram of a video recording and playback system of the present invention in a first embodiment. Figure 2A is a schematic diagram of the human voice signal, video signal and music signal before the adjustment. Figure 2B is a schematic diagram of the human voice signal, video signal and music signal on the time axis after δ weeks. Fig. 3A is a view showing the image signal and the sound signal of the present invention on the time axis in the first embodiment. * 3B ® is a schematic diagram of the compensated video signal, video signal and audio signal of the present invention on the time axis in the first embodiment. Fig. 4 is a block diagram showing the video recording and reproducing system of the present invention in the second embodiment. Fig. 5A is a view showing the image signal and the sound signal of the present invention on the time axis in the second embodiment. The 5th figure is a schematic diagram of the image signal and the sound signal processed by the present invention in the second embodiment. Fig. 6 is a flow chart showing the steps of the video recording and playback method of the present invention in the first embodiment. Fig. 7 is a flow chart showing the steps of the video recording and playback method of the present invention in the second embodiment. [Main component symbol description] Video recording and playback system Recording module 15 110 1356636

120 Adjustment Module 130 Signal Synthesis Module 140 Playback Module 150 Image Capture Module 160 Audio Receiver Module 400 Video Recording System 410 Recording Module 420 Adjustment Module 430 Signal Synthesis Module 432 Video Signal Processing Unit 440 Playback Module 450 image capture module 460 audio receiving module A audio signal Ap vocal signal Am music signal V video signal Vc compensation image signal VB post-image signal a fourth time point m third time point P first time point V second Time point 16 1356636 Step 610 Step 620 Step 630 Step 640 Step 650 Step 660 Step 670 Step 680 Step 771 Step 772 Step 773 Step 774 - Step 775 Step 776 Receive the vocal signals separately, and capture the video signals to record the vocal signals and video signals. The music signal is used as a reference to adjust the displacement of the vocal and video signals in the time axis. The adjusted vocal, video and music signals are synchronized. The vocal and music signals are combined into an audio signal. This sound signal and video signal production An audio-visual signal plays the video signal. The total length of the video signal is the same as the total length of the audio signal. The total length of the §fL is less than the total length of the audio signal. The length of time between the video signal and the audio signal. The difference is based on the difference in length of time to generate a compensated image signal, and the image signal is combined into a post-image signal to delete the portion of the image signal beyond the sound signal to generate a post-image signal to synthesize the sound signal and the post-image signal into an audio signal 17

Claims (1)

1356636 X. Patent application scope: L A video recording and playback system, comprising: - a recording module for recording - a human voice signal and an image signal, wherein the human voice signal has a first time point, and the image signal has a second time An adjustment module for loading a music signal having a third time point, and adjusting an axial displacement of the human voice signal and the image signal based on the music signal to make the first - the time point and the second time point on the time axis are the same as the third time point; a signal synthesis module is configured to synthesize the adjusted human voice signal and the music signal into an audio signal, and according to The sound signal and the image signal generate an audio and video signal; and a play module for playing the video signal. 2. The video recording and playback system according to claim 1, wherein after adjusting the Lusheng sound number, the displacement of the Yuhai image number in the time axis, and the singular sound signal after the synthetic adjustment, Before the image signal, the playing module further includes playing the human voice signal, the image signal and the music signal simultaneously. 3. The video recording and playback system of claim 1, wherein the signal synthesizing module further comprises a piano signal processing unit, wherein when the total length of the video signal is different from the total length of the audio signal, The image signal is processed to generate a post-image signal, wherein the total length of the post-image signal is the same as the total length of the audio signal, and the audio signal is synthesized by the audio signal 'and the post-image signal Got it. 18 1356636 4·If the patent application scope is 3 video recording and playback system, the image processing unit is used according to the image signal when the total length of the image signal is less than the total length of the sound signal. The difference in length between the sound signal and the sound signal produces a compensated image signal, and the image signal is synthesized by the image signal and the compensated image signal. 5. In the case of applying for the video recording and playback system as described in item 3 of the special design, the total length of the video signal is greater than the total length of the audio signal, and the signal is used to delete the video signal. The portion of the audio signal to generate the post-image signal. 6. The video recording and playback system of claim 1, further comprising: an image capturing module for capturing the image signal and transmitting the image signal to the recording module; and an audio receiving The module is configured to receive the vocal signal and transmit the vocal signal to the recording module. The video recording and playback system according to claim 6, wherein the image capturing module is a web camera. 8. The video recording and playback system according to claim 6, wherein the audio receiving module is a microphone. 9. A video recording and playback method, comprising the steps of: recording a human voice and an image signal, wherein the human voice signal has a first time point, the image signal has a second time point; and the loading has a second time point a music signal, wherein the vocal shouting and the displacement of the image signal in the _ up direction are adjusted based on the music signal, and the position of the first time point and the second time point on the time axis is made with 19 1356636 The three time points are the same; the adjusted human voice signal and the music signal are combined into an audio signal, and the audio signal is generated according to the sound signal and the video signal; and the video signal is played. 1. The video recording and playback method according to claim 9, wherein after adjusting the human voice signal and the video signal in the upward shift of the time vehicle and after synthesizing the adjusted human voice thief and the image signal, The method further includes simultaneously playing the adjusted human voice signal, the image signal and the music signal. 11. If the method for recording video recording according to the ninth item is applied, the step of generating the video signal according to the sound signal and the image signal includes: determining the total length of the image signal and the total length of the sound signal. Whether the same is true, wherein when the total length of the video signal is different from the total length of the audio signal: the image signal is processed to generate a post-image signal, wherein the total length of the post-image signal and the total length of the audio signal The degree is the same; and the sound signal and the post-image signal are combined into the video signal. The method for processing the video signal according to the method of claim 11, wherein when the total length of the image signal is less than the total length of the audio signal, the method for processing the image signal comprises: calculating the image signal and the sound signal A difference in length between the two; a difference between the length of 20 1356636 and the length of the difference between the two - the county is reduced by the sum of the compensated image signal and the image signal. The image recording and playback method of claim 11, wherein when the total length of the image signal is greater than the total length of the sound signal, the method for processing the image signal includes deleting the image signal beyond the sound signal. The part to generate the post-image signal. 14. The video recording and playback method of claim 9, wherein before the audible signal and the image signal are clamped, the method further comprises: capturing the image signal; and receiving the vocal signal. twenty one