WO2016026427A1

WO2016026427A1 - Karaoke realization method and system

Info

Publication number: WO2016026427A1
Application number: PCT/CN2015/087355
Authority: WO
Inventors: 陆默
Original assignee: 深圳市比巴科技有限公司
Priority date: 2014-08-21
Filing date: 2015-08-18
Publication date: 2016-02-25
Also published as: CN104184894A

Abstract

A karaoke realization method and system, the system comprising a mobile terminal (11) and a wireless speaker (12); the mobile terminal (11) stores a karaoke accompaniment file therein, and is connected to and communicates with the wireless speaker (12) via a wireless communication method. The method comprises: the mobile terminal splits the karaoke accompaniment file into an audio accompaniment file, a video image file and a lyrics file, and displays the video image file and the lyrics file; the mobile terminal receives voice information input by a user, encodes the voice information, and transmits the encoded voice information and the audio accompaniment file to the wireless speaker; and the wireless speaker receives the encoded voice information and the audio accompaniment file, and decodes and plays in real time the encoded voice information and the audio accompaniment file.

Description

Karaoke implementation method and system

[Technical Field]

The invention belongs to the field of multimedia technology, and in particular relates to a method and a system for implementing karaoke.

【Background technique】

The existing family karaoke system generally consists of a song system, a sound system and a video system. The karaoke system is generally realized by a home appliance karaoke machine, that is, an embedded hard disk karaoke machine; the sound system includes a wireless microphone or a wired microphone and a speaker; the video system includes a liquid crystal television, a plasma television or a projector. For most users, the existing family karaoke system is more complicated to implement.

[Summary of the Invention]

Based on this, it is necessary to provide a method and system for implementing karaoke to solve the problem that the existing family karaoke system is difficult to implement.

A method for implementing karaoke, comprising:

Providing a mobile terminal and a wireless speaker, the mobile terminal and the wireless speaker are connected in a wireless manner, and the mobile terminal has a karaoke accompaniment file;

The mobile terminal splits the karaoke accompaniment file into an audio accompaniment file, a video image file, and a lyric file, and displays the video image file and the lyric file;

Receiving, by the mobile terminal, voice information input by a user, encoding the voice information, and transmitting the encoded voice information and the audio accompaniment file to the wireless speaker;

The wireless speaker receives the encoded voice information and the audio accompaniment file, and decodes and plays the encoded voice information and the audio accompaniment file in real time.

A karaoke system, characterized in that the system comprises a mobile terminal and a wireless speaker, the mobile terminal and the wireless speaker are connected in a wireless manner, and the mobile terminal has a karaoke accompaniment file;

The mobile terminal is configured to split the karaoke accompaniment file into an audio accompaniment file, a video image file, and a lyric file, display the video image file and the lyric file, and receive voice information input by the user, and the voice is The information is encoded, and the encoded voice information and the audio accompaniment file are sent to the wireless speaker;

The wireless speaker is configured to receive the encoded voice information and the audio accompaniment file, and decode and play the encoded voice information and the audio accompaniment file in real time.

The invention splits the audio accompaniment file, the video image file and the lyrics file in the karaoke accompaniment file by the mobile terminal, and plays the video image file and the lyric file through the display screen of the mobile terminal, receives the voice information input by the user, and receives the encoded voice information. The voice information and the audio accompaniment file are sent to the wireless speaker, so that the wireless speaker decodes and plays the voice information and the audio accompaniment file, thereby implementing the karaoke function through the mobile terminal and the wireless speaker wirelessly connected with the mobile terminal. Reduced the difficulty of achieving karaoke.

[Description of the Drawings]

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the embodiments or the description of the prior art will be briefly described below. It is obvious that the drawings in the following description are only the present invention. For some embodiments, other drawings may be obtained from those of ordinary skill in the art in light of the inventive workability.

1 is a block diagram showing the structure of a karaoke system according to an embodiment;

2 is a timing diagram of a method of implementing karaoke in an embodiment;

FIG. 3 is a flowchart of step S202 of the method for implementing karaoke according to an embodiment; FIG.

4 is a flowchart of step S204 of the method for implementing karaoke according to an embodiment;

FIG. 5 is a flowchart of step S403 of the method for implementing karaoke in an embodiment.

【detailed description】

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

1 is a block diagram showing the structure of a karaoke system of an embodiment, which includes a mobile terminal 11 and a wireless speaker 12. For the convenience of explanation, only the parts related to the present embodiment are shown.

The mobile terminal 11 has a karaoke accompaniment file stored in the mobile terminal. The mobile terminal 11 is configured to split the karaoke accompaniment file into an audio accompaniment file, a video image file, and a lyric file, and display a video image file and a lyric file through the display screen of the mobile terminal 11, receive the voice information input by the user, and perform voice information on the voice information. Encoding, and transmitting the encoded voice information and the audio accompaniment file to the wireless speaker 12;

The wireless speaker 12 and the mobile terminal 11 are wirelessly connected and communicated for receiving the encoded voice information and the audio accompaniment file, and decoding and playing the encoded voice information and the audio accompaniment file in real time.

Further, the mobile terminal 11 is further configured to: receive voice information input by the user through the microphone of the mobile terminal 11; sample, quantize, and encode the voice information in real time to obtain pulse code modulation corresponding to the voice information (Pulse) Code Modulation (PCM) data; compression-encoding the PCM data corresponding to the voice information to obtain the encoded voice information.

Further, the wireless speaker 12 is further configured to: decode the received voice information in real time to obtain PCM data corresponding to the voice information; and decode the received audio accompaniment file in real time to obtain PCM data corresponding to the audio accompaniment file; Playback is performed based on the obtained PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file.

Further, the wireless speaker 12 is further configured to: set a preset value and a gain coefficient; acquire a corresponding sampling point in the PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file; and the corresponding sampling point The PCM data corresponding to the voice information is superimposed with the PCM data corresponding to the audio accompaniment file to obtain a superimposed value; the gain coefficient is adjusted according to the relative size of the superimposed value and the preset value to obtain a current gain coefficient; and the superimposed value and the current gain coefficient are played. .

Further, the wireless speaker 12 is further configured to adjust the current gain coefficient according to the first N gain coefficients, where N is an integer greater than or equal to 1.

FIG. 2 is a timing diagram of an implementation method of a karaoke according to an embodiment. The execution body of the timing diagram may be the mobile terminal 11 and the wireless speaker 12 in FIG. 1. The mobile terminal and the wireless speaker are wirelessly connected and communicated. The terminal has a karaoke accompaniment file, and the method includes:

In step S201, the mobile terminal splits the karaoke accompaniment file into an audio accompaniment file, a video image file, and a lyric file, and displays the video image file and the lyric file through the display screen of the mobile terminal.

In this embodiment, the mobile terminal downloads the karaoke accompaniment file from the cloud music library in advance according to the user's request, and stores the karaoke accompaniment file in the mobile terminal. After receiving the request of the user to order a certain song, the mobile terminal splits the karaoke accompaniment file corresponding to the first song into an audio accompaniment file, a video image file and a lyric file. The audio accompaniment file is played by the wireless speaker, and the video image file and the lyric file are played by the mobile terminal. When the mobile terminal plays the video image file and the lyric file, the current playback progress of the karaoke accompaniment file is first detected, and according to the current playback progress of the karaoke accompaniment file, the video image corresponding to the current playback progress and the lyrics are displayed through the display screen of the mobile terminal.

Step S202: The mobile terminal receives the voice information input by the user, and encodes the voice information.

The mobile terminal displays the video image and the lyrics corresponding to the current playback progress through the display screen, so that the user inputs the voice information according to the video image and the lyrics displayed on the display screen. Here, the mobile terminal can receive the voice information input by the user through the microphone of the mobile terminal, and can also receive the voice information input by the user through an external Bluetooth headset, a headset or a microphone. After receiving the voice information input by the user, the mobile terminal converts the voice information into an electrical signal, and then encodes the voice information of the electrical signal, so that the amount of the audio data of the encoded voice information is controlled within a preset range, thereby When the mobile terminal transmits the encoded voice information to the wireless speaker, the transmission time is shortened to ensure that the audio playback of the wireless speaker is synchronized with the playback of the video image and the lyrics of the mobile terminal.

Step S203: The mobile terminal sends the encoded voice information and the audio accompaniment file to the wireless speaker.

Here, mobile terminals and wireless speakers are available via Wi-Fi (Wireless Fidelity). Direct, Bluetooth, ZigBee, Zinc (Neep Field) Wireless communication technology such as Communication (Near Field Communication) performs connection communication, which is not limited herein.

Step S204, the wireless speaker receives the encoded voice information and the audio accompaniment file, and decodes and plays the encoded voice information and the audio accompaniment file in real time.

In one embodiment, the wireless speaker decodes the received voice information and the audio accompaniment file frame by frame to cause the received voice information and the audio accompaniment file to be played as soon as possible, so that the voice information and the audio accompaniment file and the corresponding video image are And the lyrics play consistently.

FIG. 3 is a flowchart of step S202 of the method for implementing karaoke according to an embodiment. Referring to FIG. 3, step S202 includes:

Step S301, the mobile terminal receives voice information input by the user through the microphone of the mobile terminal.

In this embodiment, the mobile terminal receives the voice information input by the user through its own microphone. Optionally, the mobile terminal adds a noise reduction microphone. When the microphone of the mobile terminal receives the voice information input by the user, the noise reduction microphone receives the ambient noise, and the mobile terminal receives the voice information received by the microphone of the mobile terminal and the noise reduction microphone. The noise is calculated by the ambient noise. Here, the microphone of the mobile terminal may be an electret microphone or the like, which is not limited herein.

Step S302, the mobile terminal samples, quantizes, and encodes the voice information in real time to obtain PCM data corresponding to the voice information.

After the mobile terminal converts the voice information from the sound signal to the electrical signal, the voice information is sampled. Sampling is a process of extracting a sample of a speech information analog signal at a frequency more than twice the signal bandwidth and becoming a discrete speech information sampling signal on the time axis. Since the voice information sampling signal has an infinite number of values, the mobile terminal quantizes the voice information sampling signal, so that the value of the voice information sampling signal is changed from an infinite number to a limited number. The mobile terminal then performs binary encoding on the quantized voice information to obtain PCM (Pulse) Code Modulation, pulse code modulation) data.

Step S303, the mobile terminal compress-encodes the PCM data corresponding to the voice information to obtain the encoded voice information.

Since the amount of data of the PCM data is large, it is necessary to compress and encode the PCM data corresponding to the voice information, for example, MP3 (MPEG-1) Compression coding such as audio layer 3, MPEG audio layer 3) or WMA (Windows Media Audio) is not limited herein.

In this embodiment, by quantizing and compressing the encoding, the data amount of the PCM data corresponding to the voice information is greatly reduced, thereby improving the transmission rate of the encoded voice information transmitted by the mobile terminal to the wireless speaker, reducing the delay, and improving the user. induction.

FIG. 4 is a flowchart of step S204 of the method for implementing karaoke according to an embodiment. Referring to FIG. 4, step S204 includes:

Step S401, the wireless speaker decodes the received voice information in real time to obtain PCM data corresponding to the voice information;

Step S402, the wireless speaker decodes the received audio accompaniment file in real time to obtain PCM data corresponding to the audio accompaniment file;

In step S403, the wireless speaker plays according to the obtained PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file.

In this embodiment, after receiving the voice information and the audio accompaniment file, the wireless speaker decodes the voice information and the audio accompaniment file frame by frame, and obtains the PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file and plays.

FIG. 5 is a flowchart showing a specific implementation of step S403 of the method for implementing karaoke according to an embodiment. Referring to FIG. 5, step S403 includes:

Step S500, the wireless speaker sets a preset value and a gain coefficient;

Step S501, the wireless speaker acquires corresponding sampling points in the PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file;

Step S502, the wireless speaker superimposes the PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file on the corresponding sampling point to obtain a superimposed value;

Step S503, the wireless speaker adjusts the gain coefficient according to the relative size of the superimposed value and the preset value to obtain a current gain coefficient;

In step S504, the wireless speaker plays according to the superimposed value and the current gain coefficient.

In order to make the played voice information more fused with the audio accompaniment file, in the embodiment of the present invention, the corresponding sample points in the PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file are acquired. Here, the corresponding sampling point refers to a sampling point where the PCM data corresponding to the voice information and the PCM data corresponding to the audio accompaniment file coincide on the time axis. After the corresponding sampling point is determined, the value of the PCM data corresponding to the voice information on the corresponding sampling point and the value of the PCM data corresponding to the audio accompaniment file are obtained, and the two values are superimposed to obtain a superimposed value. After the superimposed value is obtained, it is judged whether the superimposed value is greater than the preset value. If the superimposed value is greater than the preset value, it indicates that noise is introduced in the superimposition process. At this time, the current gain coefficient is adjusted so that the product of the superimposed value and the current gain coefficient is multiplied. Equal to the saturation value, thereby avoiding the effect of noise generated after mixing on the mix. Wherein, the current gain coefficient is less than the preset gain coefficient. If the superimposed value is less than or equal to the preset value, the current gain coefficient is made equal to the preset gain coefficient. In the embodiment of the present invention, the current gain coefficient is adjusted according to the relative size of the superimposed value and the preset value, and the PCM corresponding to the PCM waveform corresponding to the audio information and the audio accompaniment file can be maintained while avoiding the noise introduced in the mixing to affect the mixing. The superimposed waveform of the waveform remains essentially unchanged.

Preferably, step S403 further includes:

The wireless speaker adjusts the current gain coefficient according to the first N gain coefficients, where N is an integer greater than or equal to one.

In one embodiment, the wireless speaker adjusts the current gain coefficient according to the gain coefficient corresponding to the first N frames of the current frame, so as to smoothly transition between the frames to ensure the sound quality after mixing.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. Within the scope.

Claims

A method for implementing karaoke, comprising:

Providing a mobile terminal and a wireless speaker, the mobile terminal and the wireless speaker are connected in a wireless manner, and the mobile terminal has a karaoke accompaniment file;

The mobile terminal splits the karaoke accompaniment file into an audio accompaniment file, a video image file, and a lyric file, and displays the video image file and the lyric file;

Receiving, by the mobile terminal, voice information input by a user, encoding the voice information, and transmitting the encoded voice information and the audio accompaniment file to the wireless speaker;

The wireless speaker receives the encoded voice information and the audio accompaniment file, and decodes and plays the encoded voice information and the audio accompaniment file in real time.
The method of claim 1, wherein the mobile terminal receives voice information input by a user, and the step of encoding the voice information comprises:

The mobile terminal receives voice information input by a user through a microphone of the mobile terminal;

The mobile terminal samples, quantizes, and encodes the voice information in real time to obtain pulse code modulated data corresponding to the voice information; and

The mobile terminal compress-encodes the pulse code modulated data corresponding to the voice information to obtain the encoded voice information.
The method according to claim 1 or 2, wherein said wireless speaker receives said encoded voice information and said audio accompaniment file, and performs said encoded voice information and said audio accompaniment file in real time. The steps to decode and play include:

The wireless speaker decodes the received encoded voice information in real time to obtain pulse code modulated data corresponding to the voice information;

The wireless speaker decodes the received audio accompaniment file in real time to obtain pulse code modulation data corresponding to the audio accompaniment file;

The wireless speaker plays according to the pulse code modulation data corresponding to the voice information and the pulse code modulation data corresponding to the audio accompaniment file.
The method according to claim 3, wherein said wireless speaker is played according to said pulse code modulation data corresponding to said voice information and said pulse code modulation data corresponding to said audio accompaniment file include:

The wireless speaker sets a preset value and a gain coefficient;

The wireless speaker acquires corresponding sampling points in the pulse code modulation data corresponding to the voice information and the pulse code modulation data corresponding to the audio accompaniment file;

The wireless speaker superimposes the pulse code modulation data corresponding to the voice information and the pulse code modulation data corresponding to the audio accompaniment file on the corresponding sampling point to obtain a superimposed value;

The wireless speaker adjusts the gain coefficient according to a relative size of the superimposed value and the preset value to obtain a current gain coefficient; and

The wireless speaker plays according to the superimposed value and the current gain coefficient.
The method according to claim 4, wherein said wireless speaker is played according to said pulse code modulation data corresponding to said voice information and said pulse code modulation data corresponding to said audio accompaniment file Also includes:

The wireless speaker adjusts the current gain coefficient according to the first N gain coefficients, where N is an integer greater than or equal to 1.
A karaoke system, characterized in that it comprises:

a mobile terminal, wherein the mobile terminal has a karaoke accompaniment file; and

a wireless speaker, the wireless speaker and the mobile terminal are wirelessly connected to communicate;

The mobile terminal is configured to split the karaoke accompaniment file into an audio accompaniment file, a video image file, and a lyric file, display the video image file and the lyric file, and receive voice information input by the user. The voice information is encoded, and the encoded voice information and the audio accompaniment file are sent to the wireless speaker; the wireless speaker is configured to receive the encoded voice information and the audio accompaniment file, in real time The encoded voice information and the audio accompaniment file are decoded and played.
The system of claim 6 wherein said mobile terminal is further configured to:

Receiving voice information input by a user through a microphone of the mobile terminal;

Sampling, quantizing, and encoding the voice information in real time to obtain pulse code modulated data corresponding to the voice information; and

And compressing the pulse code modulated data corresponding to the voice information to obtain the encoded voice information.
A system according to claim 6 or claim 7 wherein said wireless speaker is further adapted to:

Decoding the received voice information in real time to obtain pulse code modulated data corresponding to the voice information;

Decoding the received audio accompaniment file in real time to obtain pulse code modulated data corresponding to the audio accompaniment file; and

And playing according to the pulse code modulation data corresponding to the voice information and the pulse code modulation data corresponding to the audio accompaniment file.
The system of claim 8 wherein said wireless speaker is further for:

Set the preset value and gain factor;

Obtaining, in the pulse code modulation data corresponding to the voice information, a corresponding sampling point in the pulse code modulation data corresponding to the audio accompaniment file;

And superimposing the pulse code modulation data corresponding to the voice information on the corresponding sampling point and the pulse code modulation data corresponding to the audio accompaniment file to obtain a superimposed value;

Adjusting a gain coefficient according to a relative size of the superimposed value and the preset value to obtain a current gain coefficient; and

Playing according to the superimposed value and the current gain coefficient.
The system of claim 9 wherein said wireless speaker is further for:

The current gain coefficient is adjusted according to the first N gain coefficients, where N is an integer greater than or equal to one.