CN107332976B

CN107332976B - Karaoke method, device, equipment and system

Info

Publication number: CN107332976B
Application number: CN201710400146.9A
Authority: CN
Inventors: 陈雪琪
Original assignee: Tencent Music Entertainment Technology Shenzhen Co Ltd
Current assignee: Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority date: 2017-05-31
Filing date: 2017-05-31
Publication date: 2021-02-12
Anticipated expiration: 2037-05-31
Also published as: CN107332976A

Abstract

The embodiment of the invention discloses a karaoke method, a karaoke device, karaoke equipment and a karaoke system, and relates to the technical field of data processing. Taking the application to a mobile terminal with microphone hardware as an example, the method includes: scanning the two-dimensional code, establishing local area network long connection with the intelligent terminal according to local area network connection information in the two-dimensional code, and establishing wireless connection with a server according to server connection information in the two-dimensional code; receiving a song playing instruction pushed by the intelligent terminal, or receiving a song playing instruction sent by the server when the long connection of the local area network is disconnected; starting a microphone mode according to a song playing instruction, and carrying out PCM (pulse code modulation) on a voice signal acquired by microphone hardware in the microphone mode to obtain audio data; and transmitting the audio data to the intelligent terminal through the long connection of the local area network, and playing the audio data by the intelligent terminal. According to the embodiment of the invention, microphone equipment does not need to be purchased independently, the cost of the Karaoke is saved, and the Karaoke condition is reduced, so that the utilization rate of the Karaoke application program can be improved.

Description

Karaoke method, device, equipment and system

Technical Field

The embodiment of the invention relates to the technical field of data processing, in particular to a karaoke method, a karaoke device, karaoke equipment and a karaoke system.

Background

Along with the popularization of karaoke, the types of karaoke application programs for realizing the karaoke function are more and more, and many families purchase intelligent terminals (such as intelligent televisions or intelligent boxes) capable of installing the karaoke application programs, so that a user can realize karaoke at home without going to a professional KTV place. However, since the configuration of the smart terminal that can install the karaoke application is not uniform, and the smart terminal without the configuration of the microphone, the sound card, and the like is comparatively good, in this case, different devices are needed to implement karaoke.

In the related art, in order to realize the karaoke, a user needs to purchase a microphone for acquiring audio data in advance, and if the microphone is a wired microphone, the microphone needs to be connected with an intelligent terminal provided with a karaoke application program in a wired manner through a data line in advance; if the wireless microphone is used, a signal receiver needs to be connected to the intelligent terminal provided with the Karaoke application program in advance, and the signal receiver receives wireless signals sent by the wireless microphone so as to realize wireless connection between the microphone and the intelligent terminal. No matter which kind of connected mode is adopted, after the microphone is connected with intelligent terminal, intelligent terminal realizes K sings through receiving and playing the audio data that the microphone gathered.

In the scheme provided by the related technology, the cost of the karaoke is high because a microphone for collecting audio data needs to be purchased in advance, and in addition, many users without conditions can abandon the karaoke application program installed on the intelligent terminal, so that the utilization rate of the karaoke application program is reduced.

Disclosure of Invention

In order to solve the problems of higher cost, lower utilization rate of Karaoke application programs and the like of the Karaoke scheme provided by the related technology, the embodiment of the invention provides a Karaoke method, device, equipment and system. The technical scheme is as follows:

in a first aspect, a karaoke method is provided, which is applied to a mobile terminal having microphone hardware, and includes:

scanning a two-dimensional code displayed on an intelligent terminal, wherein the two-dimensional code comprises local area network connection information and server connection information;

establishing long connection of a local area network with an intelligent terminal provided with the Karaoke application program according to the local area network connection information, and establishing wireless connection with a server of the Karaoke application program according to the server connection information;

receiving a song playing instruction pushed by the intelligent terminal after playing the song accompaniment through the LAN leader connection, or receiving the song playing instruction sent by the server through the wireless connection when the LAN leader connection is disconnected;

starting a microphone mode according to the song playing instruction, and acquiring voice signals through microphone hardware in the microphone mode;

carrying out Pulse Code Modulation (PCM) on the collected voice signal to obtain audio data;

and transmitting the audio data to the intelligent terminal through long connection of a local area network, and playing the audio data by the intelligent terminal.

Optionally, the local area network connection information at least includes an address of the intelligent terminal in the local area network, an identifier of the intelligent terminal, and an identifier of the karaoke application program;

the establishing of the long connection of the local area network according to the local area network connection information and the intelligent terminal for installing the karaoke application program comprises the following steps:

establishing a TCP (Transmission Control Protocol) long connection and a UDP (User Datagram Protocol)/RTP (Real-time Transport Protocol) long connection according to the local area network connection information and an intelligent terminal for installing the Karaoke application program;

the song playing instruction that receives the propelling movement of intelligent terminal after playing the song accompaniment through the long connection of LAN includes:

receiving a song playing instruction pushed by the intelligent terminal after playing the song accompaniment through the TCP long connection;

the transmitting the audio data to the intelligent terminal includes:

and transmitting the audio data to the intelligent terminal through the UDP/RTP long connection.

Optionally, the method further comprises:

and applying for starting microphone hardware to the system and acquiring the authority of acquiring audio data.

Optionally, the method further comprises:

displaying a song requesting interface, wherein a song list is displayed on the song requesting interface;

acquiring song requesting information according to the selection operation in the song requesting interface;

the method comprises the steps that a song requesting instruction carrying song requesting information is sent to an intelligent terminal through LAN (local area network) connection, or when the LAN connection is disconnected, a song requesting instruction carrying the song requesting information is sent to a server through wireless connection, the server forwards the song requesting instruction to the intelligent terminal, and the song requesting instruction is used for triggering the intelligent terminal to play a song accompaniment corresponding to the song requesting information and sending the song playing instruction.

Optionally, the method further comprises:

displaying a song playing interface, wherein song playing control options are displayed on the song playing interface;

acquiring a song playing control instruction according to the selection operation in the song playing interface;

and sending the song playing control instruction to the intelligent terminal through LAN (local area network) connection, or sending the song playing control instruction to the server through wireless connection when the LAN connection is disconnected, and forwarding the song playing control instruction to the intelligent terminal by the server, wherein the song playing control instruction is used for triggering the intelligent terminal to control played song accompaniment or audio data.

In a second aspect, a karaoke method is further provided, where the method is applied to an intelligent terminal installed with a karaoke application program, and the method includes:

establishing wireless connection with a server of the Karaoke application program;

displaying a two-dimensional code, wherein the two-dimensional code comprises local area network connection information and server connection information;

after scanning the two-dimensional code, a mobile terminal with microphone hardware establishes long connection with a Local Area Network (LAN) with the mobile terminal, wherein the number of the mobile terminals is at least one;

acquiring a song requesting instruction carrying song requesting information, and playing a song accompaniment corresponding to the song requesting information according to the song requesting instruction;

sending a song playing instruction to the mobile terminal through long connection of a local area network, or sending the song playing instruction to the server through wireless connection when long connection of the local area network is disconnected, and forwarding the song playing instruction to the mobile terminal by the server, wherein the song playing instruction is used for triggering the mobile terminal to acquire voice signals through a microphone hardware in a microphone mode, and performing PCM on the acquired voice signals to obtain audio data;

and receiving the audio data transmitted by the mobile terminal through long connection of a local area network, and playing the audio data.

the establishing of the long connection of the local area network with the mobile terminal comprises the following steps:

establishing a TCP long connection and a UDP/RTP long connection with the mobile terminal;

sending a song playing instruction to the mobile terminal through long connection of a local area network, comprising the following steps:

sending a song playing instruction to the mobile terminal through the TCP long connection;

the receiving of the audio data transmitted by the mobile terminal through the long connection of the local area network comprises:

and receiving the audio data transmitted by the mobile terminal through the UDP/RTP long connection.

Optionally, the obtaining of the song requesting instruction carrying song requesting information includes:

the song requesting instruction carrying the song requesting information sent by the mobile terminal is received through long connection of a local area network, or the song requesting instruction carrying the song requesting information sent by the server is received through wireless connection, and the song requesting instruction is used for triggering the intelligent terminal to play the song accompaniment corresponding to the song requesting information and sending the song playing instruction.

Optionally, the method further comprises:

receiving a song playing control instruction sent by the mobile terminal through long connection of a local area network, or receiving the song playing control instruction sent by the server through wireless connection;

and controlling the played song accompaniment or audio data according to the song playing control instruction.

Optionally, the playing the audio data includes:

and playing the audio data through a player in a shortest path mode.

Optionally, the method further comprises:

when a plurality of mobile terminals are provided, carrying out sound mixing operation processing on the audio data transmitted by the plurality of mobile terminals to obtain audio data after sound mixing operation processing;

the playing the audio data comprises:

and playing the audio data after the sound mixing operation.

In a third aspect, a karaoke apparatus is further provided, where the apparatus is applied to a mobile terminal having microphone hardware, and the apparatus includes:

the scanning module is used for scanning a two-dimensional code displayed on the intelligent terminal, and the two-dimensional code comprises local area network connection information and server connection information;

the first connection module is used for establishing long connection of the local area network with an intelligent terminal provided with a karaoke application program according to the local area network connection information;

the second connection module is used for establishing wireless connection with a server of the Karaoke application program according to the server connection information;

the receiving module is used for receiving a song playing instruction pushed by the intelligent terminal after playing the song accompaniment through the LAN leader connection, or receiving the song playing instruction sent by the server through the wireless connection when the LAN leader connection is disconnected;

the acquisition module is used for starting a microphone mode according to the song playing instruction and acquiring voice signals through microphone hardware in the microphone mode;

the encoding module is used for carrying out Pulse Code Modulation (PCM) on the acquired voice signals to obtain audio data;

and the transmission module is used for transmitting the audio data to the intelligent terminal through long connection of a local area network, and the intelligent terminal plays the audio data.

the first connection module is used for establishing a Transmission Control Protocol (TCP) long connection and a User Datagram Protocol (UDP)/real-time transport protocol (RTP) long connection with an intelligent terminal provided with a Karaoke application program according to the local area network connection information;

the receiving module is used for receiving a song playing instruction pushed by the intelligent terminal after playing the song accompaniment through the TCP long connection;

and the transmission module is used for transmitting the audio data to the intelligent terminal through the UDP/RTP long connection.

Optionally, the apparatus further comprises:

and the permission application module is used for applying to the system for starting the microphone hardware and acquiring the permission for acquiring the audio data.

Optionally, the apparatus further comprises:

the first display module is used for displaying a song requesting interface, and a song list is displayed on the song requesting interface;

the first acquisition module is used for acquiring song requesting information according to selection operation in the song requesting interface;

the system comprises a first sending module and a second sending module, wherein the first sending module is used for sending a song requesting instruction carrying song requesting information to the intelligent terminal through LAN (local area network) connection, or sending the song requesting instruction carrying the song requesting information to the server through wireless connection when the LAN connection is disconnected, the server forwards the song requesting instruction to the intelligent terminal, and the song requesting instruction is used for triggering the intelligent terminal to play a song accompaniment corresponding to the song requesting information and sending the song playing instruction.

Optionally, the apparatus further comprises:

the second display module is used for displaying a song playing interface, and song playing control options are displayed on the song playing interface;

the second acquisition module is used for acquiring a song playing control instruction according to the selection operation in the song playing interface;

and the second sending module is used for sending the song playing control instruction to the intelligent terminal through LAN (local area network) connection, or sending the song playing control instruction to the server through wireless connection when the LAN connection is disconnected, and forwarding the song playing control instruction to the intelligent terminal by the server, wherein the song playing control instruction is used for triggering the intelligent terminal to control played song accompaniment or audio data.

In a fourth aspect, a karaoke apparatus is provided, where the apparatus is applied to an intelligent terminal installed with a karaoke application program, and the apparatus includes:

the first connection module is used for establishing wireless connection with a server of the Karaoke application program;

the display module is used for displaying a two-dimensional code, and the two-dimensional code comprises local area network connection information and server connection information;

the second connection module is used for establishing long connection of a local area network with the mobile terminal after the mobile terminal with the microphone hardware scans the two-dimensional code, and the number of the mobile terminals is at least one;

the acquisition module is used for acquiring a song requesting instruction carrying song requesting information;

the first playing module is used for playing the song accompaniment corresponding to the song requesting information according to the song requesting instruction;

the sending module is used for sending a song playing instruction to the mobile terminal through long connection of a local area network, or sending the song playing instruction to the server through wireless connection when the long connection of the local area network is disconnected, the server forwards the song playing instruction to the mobile terminal, and the song playing instruction is used for triggering the mobile terminal to collect voice signals through microphone hardware in a microphone mode and carrying out Pulse Code Modulation (PCM) on the collected voice signals to obtain audio data;

the first receiving module is used for receiving the audio data transmitted by the mobile terminal through long connection of a local area network;

and the second playing module is also used for playing the audio data.

the second connection module is used for establishing a Transmission Control Protocol (TCP) long connection and a User Datagram Protocol (UDP)/real-time transport protocol (RTP) long connection with the mobile terminal;

the sending module is used for sending a song playing instruction to the mobile terminal through the TCP long connection;

and the first receiving module is used for receiving the audio data transmitted by the mobile terminal through the UDP/RTP long connection.

Optionally, the obtaining module is configured to receive a song requesting instruction carrying song requesting information sent by the mobile terminal through long connection of a local area network, or receive a song requesting instruction carrying song requesting information sent by the server through wireless connection, where the song requesting instruction is used to trigger the intelligent terminal to play a song accompaniment corresponding to the song requesting information and send the song playing instruction.

Optionally, the apparatus further comprises:

the second receiving module is used for receiving the song playing control instruction sent by the mobile terminal through long connection of a local area network or receiving the song playing control instruction sent by the server through wireless connection;

and the control module is used for controlling the played song accompaniment or audio data according to the song playing control instruction.

Optionally, the second playing module is configured to play the audio data through a player in a shortest path manner.

Optionally, the apparatus further comprises:

the processing module is used for carrying out sound mixing operation processing on the audio data transmitted by the plurality of mobile terminals when the number of the mobile terminals is multiple, so as to obtain the audio data after the sound mixing operation processing;

and the second playing module is used for playing the audio data after the audio mixing operation.

In a fifth aspect, a karaoke apparatus is further provided, where the apparatus includes a processor and a memory, where the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the method according to the first aspect.

In a sixth aspect, a karaoke apparatus is further provided, where the karaoke apparatus includes a processor and a memory, where the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the method according to the second aspect.

In a seventh aspect, there is further provided a karaoke system, which includes a first karaoke device and a second karaoke device, wherein the first karaoke device is the device according to the fifth aspect, and the second karaoke device is the device according to the sixth aspect.

In an eighth aspect, there is also provided a computer readable storage medium having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by the processor to implement the method of the first aspect.

In a ninth aspect, there is also provided a computer readable storage medium having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by the processor to implement the method of the second aspect.

The technical scheme provided by the embodiment of the invention can bring the following beneficial effects:

because most mobile terminals are provided with microphone hardware, under the condition that the popularization rate of the mobile terminals with the microphone hardware is higher, the mobile terminals with the microphone hardware are connected with the intelligent terminal provided with the Karaoke application program in a long local area network mode, the mobile terminals with the microphone hardware are connected with the server provided with the Karaoke application program in a wireless mode, the Karaoke is realized by directly communicating with the intelligent terminal or communicating with the intelligent terminal through the server in the wireless mode on the basis of the local area network connection, microphone equipment does not need to be purchased independently, the Karaoke cost is saved, the Karaoke condition is reduced, and the utilization rate of the Karaoke application program can be improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of a Karaoke implementation environment provided by an embodiment of the present invention;

FIG. 2 is a flowchart illustrating a karaoke method according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of an application interface provided by one embodiment of the present invention;

FIG. 4 is a schematic diagram of an application interface provided by one embodiment of the present invention;

FIG. 5 is a schematic diagram of a Karaoke interaction provided by an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a karaoke apparatus according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of a karaoke apparatus according to another embodiment of the present invention;

fig. 8 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Along with the popularization of karaoke, the types of karaoke application programs for realizing the karaoke function are more and more, and many families purchase intelligent terminals (such as intelligent televisions or intelligent boxes) capable of installing the karaoke application programs, so that a user can realize karaoke at home without going to a professional KTV place. In the related technology for realizing the Karaoke, a user needs to purchase a traditional microphone device integrated with a drive in advance to collect the audio data of the user, so that the cost is higher, the use threshold of the Karaoke application program is improved, and the use rate of the Karaoke application program is reduced.

However, most mobile terminals have microphone hardware, and stability and call quality are both guaranteed, so in order to implement the karaoke music under the condition of saving cost, the embodiment of the invention provides a scheme for implementing the karaoke music by using the mobile terminal with the microphone hardware to replace an independent microphone device, namely, the mobile terminal with the microphone hardware is used as the microphone device of an intelligent terminal to implement the karaoke music in scenes such as a living room. And as the popularization rate of the mobile terminal is very high, most users have the mobile terminal, so that the condition of using the Karaoke application program installed on the intelligent terminal is reduced, and the utilization rate of the Karaoke application program can be improved.

In specific implementation, the karaoke method provided by the embodiment of the invention can be applied to the karaoke system implementation environment shown in fig. 1. As shown in fig. 1, the system includes a mobile terminal 101, an intelligent terminal 102 and a server 103 for the karaoke application, the mobile terminal 101 and the intelligent terminal 102 can be connected through a local area network, the mobile terminal 101 and the server 103 can be connected through a wireless connection, and the intelligent terminal 102 and the server 103 can be connected through a wireless connection. The mobile terminal 101 is installed with a mobile terminal version karaoke application client, and the mobile terminal 101 may be a terminal with microphone hardware, such as a mobile phone with microphone hardware, a mobile computer, a notebook computer, and the like. The intelligent terminal 102 is also provided with a karaoke application client of an intelligent terminal version, and the intelligent terminal 102 can be a terminal with an audio data playing function, such as an intelligent television, an intelligent box and the like. In addition, the mobile terminal 101 and the intelligent terminal 102 also have a communication function to communicate with the opposite terminal, so as to transmit data and instructions.

Based on the implementation environment shown in fig. 1, referring to fig. 2, an embodiment of the present invention provides a karaoke method, where before implementation, a mobile terminal and an intelligent terminal need to install corresponding clients. For example, the mobile terminal installs a karaoke application client of a mobile terminal version, and the intelligent terminal installs a karaoke application client of an intelligent terminal version. As shown in fig. 2, the process flow of the method is as follows:

201: the intelligent terminal establishes wireless connection with a server of the karaoke application program and displays a two-dimensional code, wherein the two-dimensional code comprises local area network connection information and server connection information;

according to the step, after the K song application client of the intelligent terminal version is installed on the intelligent terminal, the connection information of the connection established with the server of the K song application program can be obtained, and then the wireless connection is established with the server of the K song application program through the wireless network. After successful connection, credential information that communicates with the server may also be obtained. The specific content of the connection information for the connection between the intelligent terminal and the server of the karaoke application and the credential information for communication is not specifically limited in this embodiment.

In order to enable the mobile terminal to be connected with the intelligent terminal and a server connected with the intelligent terminal, the intelligent terminal can acquire a two-dimensional code containing local area network connection information and server connection information and display the two-dimensional code. The server connection information comprises credential information communicated with the server, and the local area network connection information at least comprises an address of the intelligent terminal in the local area network, an identification of the intelligent terminal and an identification of the karaoke application program. The identification of the intelligent terminal is the unique identification used for identifying the intelligent terminal, and the identification of the Karaoke application program can be the unique identification used for identifying the Karaoke application program. Under the condition that the intelligent terminal does not reinstall the Karaoke application program, the identification of the intelligent terminal and the identification of the Karaoke application program cannot be changed.

As an optional mode, the local area network connection information may further include a security check code, in addition to the address of the intelligent terminal in the local area network, the identifier of the intelligent terminal, and the identifier of the karaoke application program, where the security check code has a certain update period. In the process of establishing the long connection of the local area network, the intelligent terminal can verify the updating period of the safety check code, the long connection of the local area network is effective in the updating period, the long connection of the local area network is required to be carried out again after the updating period is reached, and the control right of the intelligent terminal is kept after the connection is avoided. Regarding the length of the update period, this embodiment is not particularly limited, and in practical application, a setting interface may be provided and set by a user.

202: the mobile terminal scans the two-dimensional code displayed on the intelligent terminal, establishes connection with the intelligent terminal provided with the Karaoke application program according to the local area network connection information, and establishes wireless connection with a server of the Karaoke application program according to the server connection information;

as an optional connection mode, the mobile terminal scans the two-dimensional code displayed by the intelligent terminal through a karaoke application client installed on the mobile terminal to acquire local area network connection information in the two-dimensional code; and establishing long connection of the local area network with the intelligent terminal through the local area network according to the local area network connection information. The identification of the intelligent terminal is the unique identification for identifying the intelligent terminal, and the identification of the Karaoke application program can be the unique identification for identifying the Karaoke application program, so that the corresponding relation between the mobile terminal and the Karaoke application program on the intelligent terminal can be established through the identification of the intelligent terminal and the identification of the Karaoke application program.

For example, the intelligent terminal installs a song-K application client of the intelligent terminal version, and an interface schematic diagram of the song-K application client of the intelligent terminal version may be as shown in fig. 3. The mobile terminal is provided with a karaoke application client of a mobile terminal version, and an interface schematic diagram of the karaoke application client of the mobile terminal version can be shown in fig. 4. After the two-dimensional code on the interface shown in fig. 3 is scanned by the mobile terminal, the mobile terminal acquires the local area network connection information included in the two-dimensional code, and because the local area network connection information includes the address of the intelligent terminal in the local area network, the mobile terminal can send a connection request to the intelligent terminal according to the address of the intelligent terminal in the local area network included in the connection information, and after the intelligent terminal responds to the connection request, connection between the mobile terminal and the intelligent terminal is established. After the long connection of the lan is successfully established, a prompt message for establishing the connection may be displayed on the interface of the karaoke application client of the mobile terminal, as shown in 401 in fig. 4.

Furthermore, when the mobile terminal establishes the long LAN connection with the intelligent terminal installed with the Karaoke application program according to the LAN connection information, the mobile terminal can establish the long TCP connection and the long UDP/RTP connection with the intelligent terminal installed with the Karaoke application program according to the LAN connection information. Because the TCP protocol adopts a retransmission mechanism, the transmission instruction is more reliable, and therefore the instruction can be transmitted by adopting a TCP long connection. And because the delay of the data transmission of the UDP/RTP long connection is relatively lower than that of the TCP long connection, the data can be transmitted by adopting the UDP/RTP long connection. For the UDP long connection and the RTP long connection, since the delay is low when the UDP long connection transmits data compared to the RTP long connection, but the voice quality is good when the RTP long connection transmits data compared to the UDP long connection, the embodiment is not limited in particular, and therefore, the data is transmitted by using the UDP long connection or the RTP long connection.

In practical application, the connection is divided into two types, namely short connection and long connection, wherein the short connection means that when two communication parties have data interaction, a connection is established, and after the data transmission is completed, the connection is disconnected, namely, only one service is transmitted in each connection. A long connection means that multiple packets can be sent continuously over one connection, and during the connection hold period, if no packet is sent, a link check packet needs to be sent in both directions. Because the method provided by the embodiment of the invention needs the mobile terminal to transmit the audio data to the intelligent terminal, in order to save the connection times and reduce the time delay caused by the connection process, the embodiment of the invention takes the example of establishing the long connection of the local area network between the mobile terminal and the intelligent terminal as an example. Certainly, under the condition that the intelligent terminal is controlled through the mobile terminal and audio data does not need to be transmitted, the method provided by the embodiment of the invention also supports the establishment of the short connection between the mobile terminal and the intelligent terminal because the long connection consumes a lot of bandwidth resources compared with the short connection.

No matter which kind of connection is established, because the delay range of the local area network connection is small, but the delay of the non-local area network connection is very large, in order to perfectly restore the K song scene of the user in KTV, and in consideration of the acceptable return listening delay range of the user, in the K song method provided by the embodiment of the invention, the mobile terminal and the intelligent terminal adopt the local area network connection to transmit audio data. The listening back is also called listening, monitoring and ear returning, namely when a microphone is used for making a sound, the behavior of listening the sound of the user in real time through a playing device is most commonly used in a KTV scene.

In addition, because the two-dimensional code also comprises server connection information, the mobile terminal can establish wireless connection with the server of the karaoke application program according to the server connection information after scanning the two-dimensional code and acquiring the server connection information in the two-dimensional code. When the user holds the mobile terminal to leave the Karaoke scene, and the mobile terminal leaves the coverage range of the local area network, the long connection of the local area network is disconnected, and at the moment, the mobile terminal can transmit the control instruction through the wireless connection.

It should be noted that the process of establishing connection provided in step 201 and step 202 does not need to be repeatedly executed each time when the karaoke is implemented, and after a connection is established once, the karaoke can be implemented multiple times, that is, the step 201 and step 202 are skipped, and the subsequent steps are directly executed.

203: the intelligent terminal acquires a song requesting instruction carrying song requesting information and plays song accompaniment corresponding to the song requesting information according to the song requesting instruction;

when the song K is realized, the user can order the song, so that the intelligent terminal can acquire the song ordering instruction and trigger the intelligent terminal to play the song accompaniment on demand through the song ordering instruction. Aiming at the song requesting mode, the embodiment of the invention does not limit the song requesting mode, and comprises but is not limited to directly requesting songs on the intelligent terminal by using remote control equipment of the intelligent terminal, so that the intelligent terminal obtains corresponding song requesting instructions according to remote control operation; in addition, the mobile terminal can replace a microphone device to be used for collecting audio data, and can also be used for requesting songs through the mobile terminal, and the mobile terminal pushes a song requesting instruction to the intelligent terminal through the local area network to realize song requesting.

When the mobile terminal is used for ordering songs, the mobile terminal can display a song ordering interface as an optional mode, and a song list can be displayed on the song ordering interface for the user to select the songs on demand. In addition, song-ordering options can be displayed on the interface, each song-ordering option can correspond to one song, and each song-ordering option on the song-ordering interface corresponds to song-ordering information, such as an ID (identification) of the song, a name of a singer and the like. When any song-ordering option is selected, the mobile terminal can detect the selection operation, obtains song-ordering information according to the selection operation in the song-ordering interface, generates a song-ordering instruction comprising the song-ordering information, and sends the song-ordering instruction carrying the song-ordering information to the intelligent terminal. For example, a song requesting instruction carrying song requesting information is sent to the intelligent terminal through long connection of the local area network, or when the long connection of the local area network is disconnected, the song requesting instruction carrying song requesting information is sent to the server through wireless connection, and the server forwards the song requesting instruction to the intelligent terminal.

Correspondingly, no matter which way the intelligent terminal obtains the song requesting instruction, the intelligent terminal comprises a song database, the song database stores contents such as song information, song accompaniment data and the like, and the song information and the song accompaniment data can be carried by the intelligent terminal when a K song application program is installed, can be downloaded from the Internet subsequently, and can be manufactured and uploaded by a user. After the intelligent terminal acquires the song ordering instruction carrying the song ordering information, the intelligent terminal searches song accompaniment data corresponding to the song ordering information in the database according to the song ordering instruction, and therefore song accompaniment corresponding to the song ordering information is played.

For example, the song requesting information acquired by the mobile terminal includes that the ID of the song is A001 (schematic), the name of the song is asterisk, the name of the singer of the song is Zhang III, a song requesting instruction carrying the song requesting information is sent to the intelligent terminal through TCP long connection, after the intelligent terminal receives the song requesting instruction carrying the song requesting information sent by the mobile terminal, song accompaniment data matched with the song requesting information is searched from a song database, and after the ID of the song is A001, the name of the song is asterisk, and the name of the singer of the song is song accompaniment data of Zhang III, the song accompaniment data is played through a player.

It should be noted that the song requesting instruction is a predefined protocol between the mobile terminal and the intelligent terminal, and the intelligent terminal can identify the song requesting instruction.

In addition, when the song requesting is realized through the mobile terminal, the mobile terminal can acquire and send a song requesting instruction to the intelligent terminal, can acquire and send other types of instructions or responses related to the song K process to the intelligent terminal, and can receive the instructions or responses related to the song K sent by the intelligent terminal. In specific implementation, the mobile terminal may display a song playing interface on which song playing control options are displayed. When the user selects any one of the song playing control options, the mobile terminal can acquire a song playing control instruction according to the selection operation in the song playing interface. Then, in order to control the song playing process of the intelligent terminal, the mobile terminal sends a song playing control instruction to the intelligent terminal through the LAN leader connection, or when the LAN leader connection is disconnected, the mobile terminal sends the song playing control instruction to the server through the wireless connection, and the server forwards the song playing control instruction to the intelligent terminal so as to trigger the intelligent terminal to control the played song accompaniment or audio data through the song playing control instruction. When the long connection transmission of the local area network is adopted, the long connection transmission can be carried out through TCP.

For example, in the process of singing, the mobile terminal acquires and sends a song switching instruction for switching songs, an original singing opening instruction, a song list refreshing instruction and the like to the intelligent terminal, the intelligent terminal returns a song switching response, an original singing opening response and the like to the mobile terminal, and the instructions and the responses can also be a predefined protocol between the mobile terminal and the intelligent terminal, and the mobile terminal and the intelligent terminal can identify the instructions and the responses.

204: the intelligent terminal sends a song playing instruction to the mobile terminal through the long connection of the local area network, or sends the song playing instruction to the server through the wireless connection when the long connection of the local area network is disconnected, and the server forwards the song playing instruction to the mobile terminal;

after the intelligent terminal acquires the song requesting instruction and plays the song accompaniment corresponding to the song requesting information, the intelligent terminal can send a song playing instruction to the mobile terminal in order to inform the mobile terminal to start the microphone. When the song playing instruction is sent, the song playing instruction can be preferentially sent through the long connection of the local area network. And if the long connection of the local area network is disconnected, sending a song playing instruction to the server through the wireless connection, and forwarding the song playing instruction to the mobile terminal by the server.

The song playing instruction is used for enabling the mobile terminal to determine that the intelligent terminal starts playing the song accompaniment, the mobile terminal needs to start a microphone mode, and audio data are collected through microphone hardware. The embodiment does not limit the specific form and content of the song playing instruction, and the song playing instruction may also be a predefined protocol between the mobile terminal and the intelligent terminal, and the mobile terminal may identify the song playing instruction, as with the song requesting instruction.

205: the mobile terminal receives a song playing instruction, a microphone mode is started according to the song playing instruction, voice signals are collected through microphone hardware in the microphone mode, and PCM is carried out on the collected voice signals to obtain audio data;

when the step is implemented specifically, if the intelligent terminal sends a song playing instruction to the mobile terminal through the TCP long connection, the mobile terminal receives the song playing instruction pushed by the intelligent terminal after playing the song accompaniment through the TCP long connection; and if the intelligent terminal sends a song playing instruction to the mobile terminal through the server, the mobile terminal receives the song playing instruction sent by the server. No matter which way the song playing instruction is obtained, after the mobile terminal identifies the song playing instruction, the mobile terminal can return a corresponding response to the intelligent terminal as an optional mode. The embodiment does not limit the specific form and content of the response, and may also be a predefined protocol between the mobile terminal and the intelligent terminal, which can be identified by the intelligent terminal.

In addition, in order to use the microphone hardware, the mobile terminal applies to the system for starting the microphone hardware and acquiring the authority for acquiring the audio data, so that after the authority for acquiring the audio data is acquired, the microphone mode is started, and the voice signal is acquired through the microphone hardware in the microphone mode. In specific implementation, the present embodiment does not limit the time when the mobile terminal applies to the system for starting the microphone hardware, and the permission to acquire the voice signal may be acquired before acquiring the voice signal.

For example, the mobile terminal may apply for starting microphone hardware to the system after establishing a long lan connection with the intelligent terminal; the mobile terminal can also apply for starting microphone hardware to the system before establishing long connection with the intelligent terminal; the mobile terminal can also apply for starting the microphone hardware from the system after the user requests the song.

The mobile terminal starts a microphone mode according to the song playing instruction, and after voice signals are collected through microphone hardware in the microphone mode, PCM can be carried out on the collected voice signals to obtain audio data. In this embodiment, the time for performing PCM on the mobile terminal is not limited, for example, in order to ensure real-time performance, after the mobile terminal collects a voice signal, the mobile terminal may perform PCM on the collected voice signal to obtain audio data, and perform real-time transmission through subsequent steps.

206: the mobile terminal transmits the audio data to the intelligent terminal through long connection of a local area network;

in specific implementation, in order to reduce delay and ensure real-time performance, the method provided in this embodiment transmits the audio data to the intelligent terminal in real time through UDP/RTP long connection after the mobile terminal acquires the audio data, so as to play the audio data through the intelligent terminal.

207: the intelligent terminal receives the audio data transmitted by the mobile terminal through the long connection of the local area network and plays the audio data.

After the intelligent terminal receives the audio data transmitted by the mobile terminal, a certain delay is usually generated when the audio data is played, the delay is the microphone listening delay, and generally, the collected audio data (i.e., recorded sound) needs to be played immediately while the microphone records the sound so that a user can hear the sound of the user in real time. In the process, sound is transmitted from the acquisition device (mobile terminal) to the application layer of the application program, then transferred to a Central Processing Unit (CPU), and then transmitted to the sound card by the CPU, and the sound is played by calling the playing device (loudspeaker, earphone, etc.). Typically above 50ms (milliseconds), which is noticeable to the user. Therefore, the embodiment of the invention adopts a low-delay scheme, and after the audio data transmitted by the mobile terminal is received, the audio data is played through the player in a shortest path mode.

The low delay is realized by using some software and hardware optimization schemes to reduce the physical time consumption in the audio data transmission process, and the sound is played immediately in a shortest path transmission mode as much as possible, so that the best listening experience is provided for listeners. In this mode, the mobile terminal transmits the acquired audio data (i.e., the recorded sound) to the intelligent terminal serving as the server through the local area network in real time, and the intelligent terminal immediately plays the audio data through the player in a shortest path manner.

In addition, as an optional mode, the intelligent terminal can transmit the audio data to other interfaces of the intelligent terminal in addition to playing the received audio data, so as to perform operations such as scoring calculation, real-time storage, noise reduction and beautification on the audio data. During storage, the received audio data and the played song accompaniment are synthesized according to time to obtain a synthesized file of the song accompaniment and the audio data sung by the user, and the synthesized file is stored for subsequent playback or sharing by the user to other users.

In addition, it should be noted that the method provided by this embodiment also supports a plurality of mobile terminals to replace microphone devices, so as to implement multiple users to simultaneously song K. The microphone device is replaced by a plurality of mobile terminals, a scene that a plurality of users are simultaneously playing songs is achieved, the operation of each mobile terminal can be consistent with the processing operation of the mobile terminal, and the embodiment is not illustrated one by one. However, for the intelligent terminal, when there are multiple mobile terminals interacting with the intelligent terminal, as an optional mode, after receiving the audio data sent by the multiple mobile terminals, the intelligent terminal may perform mixing operation processing on the audio data transmitted by the multiple mobile terminals to obtain the audio data after the mixing operation processing, and play the audio data after the mixing operation processing. Of course, the intelligent terminal may also perform other processing on the received voice data, which is not specifically limited in this embodiment.

According to the method provided by the embodiment, as most of mobile terminals are provided with the microphone hardware, under the condition that the popularization rate of the mobile terminals with the microphone hardware is high, long LAN connection is established between the mobile terminals with the microphone hardware and the intelligent terminal provided with the K song application program, wireless connection is established between the mobile terminals with the microphone hardware and the server provided with the K song application program, and the K song is realized by direct communication between the mobile terminals with the intelligent terminal or communication between the mobile terminals and the server provided with the wireless connection based on LAN connection, so that microphone equipment does not need to be purchased independently, the K song cost is saved, the K song condition is reduced, and the utilization rate of the K song application program can be improved.

For the above steps provided by the embodiment of the present invention, taking the mobile terminal as a mobile phone and the intelligent terminal as an intelligent television TV installed with a karaoke application program as an example, a flow of the karaoke method may be as shown in fig. 5. In the flow shown in fig. 5, the handset side acquires the microphone right in advance, and the TV side displays the two-dimensional code including the connection information. The mobile phone end is connected with the TV end by scanning the two-dimensional code displayed by the TV end. And then, the mobile phone end acquires the operation of the user to order the song and sends a song ordering instruction to the TV end. The TV end receives the song ordering instruction, determines the ordered song, and pushes a message to the mobile phone end when the song accompaniment is played through the loudspeaker, namely, the song playing instruction is sent so as to inform the mobile phone end to start the microphone mode. After the microphone mode is started by the mobile phone terminal, voice signals of a user are collected, PCM is carried out on the collected voice signals, audio data are obtained, and then the obtained audio data are transmitted to the TV terminal and played by the TV terminal.

The process shows that the mobile phone can completely replace microphone equipment in the K song, most mobile phone ends are provided with microphone hardware, the popularization rate of the mobile phone is very high, the K song is realized by communicating the mobile phone and the TV end on a local area network, the microphone equipment does not need to be purchased independently, the cost of the K song is saved, the condition of the K song is reduced, and the utilization rate of an application program of the K song can be improved.

In addition, in the implementation scenario shown in fig. 5, the mobile phone end and the TV end may also establish wireless connection with the server of the karaoke application program, and when the long connection of the lan between the mobile phone end and the TV end is disconnected, the mobile phone end may communicate with the TV end through the server to complete transmission of the instruction, so as to ensure reliability of instruction transmission.

Based on the concept of the above method embodiment, an embodiment of the present invention further provides a karaoke apparatus, which is applied to a mobile terminal having microphone hardware, and referring to fig. 6, the apparatus includes:

the scanning module 601 is configured to scan a two-dimensional code displayed on the intelligent terminal, where the two-dimensional code includes local area network connection information and server connection information;

the first connection module 602 is configured to establish a long lan connection with an intelligent terminal installed with a karaoke application according to the lan connection information;

a second connection module 603, configured to establish a wireless connection with a server of the karaoke application according to the server connection information;

a receiving module 604, configured to receive, through lan leader connection, a song playing instruction pushed by the intelligent terminal after playing a song accompaniment, or receive, through wireless connection, a song playing instruction sent by the server when the lan leader connection is disconnected;

the acquisition module 605 is configured to start a microphone mode according to the song playing instruction, and acquire a voice signal through a microphone hardware in the microphone mode;

the encoding module 606 is configured to perform Pulse Code Modulation (PCM) on the acquired voice signal to obtain audio data;

the transmission module 607 is configured to transmit the audio data to the intelligent terminal through lan long connection, and the intelligent terminal plays the audio data.

the first connection module 602 is configured to establish a long TCP connection and a long UDP/RTP connection according to the lan connection information and an intelligent terminal installed with the karaoke application;

the receiving module 604 is configured to receive, through the TCP long connection, a song playing instruction pushed by the intelligent terminal after playing a song accompaniment;

the transmission module 607 is configured to transmit the audio data to the intelligent terminal through the UDP/RTP long connection.

Optionally, the apparatus further comprises:

The device that this embodiment provided, because most mobile terminals all have microphone hardware, under the higher condition of mobile terminal prevalence rate with microphone hardware, establish the long connection of LAN through mobile terminal with microphone hardware and the intelligent terminal of installation K song application program, establish wireless connection with K song application program's server, and communicate with intelligent terminal based on LAN connection and intelligent terminal direct communication or through wireless connection's server and intelligent terminal and realize K song, thereby need not to purchase microphone equipment alone again, K song cost has been practiced thrift, K song condition has been reduced, thereby can improve K song application program's rate of utilization.

An embodiment of the present invention further provides a karaoke apparatus, which is applied to an intelligent terminal installed with a karaoke application program, and referring to fig. 7, the apparatus includes:

a first connection module 701, configured to establish a wireless connection with a server of the karaoke application;

a display module 702, configured to display a two-dimensional code, where the two-dimensional code includes local area network connection information and server connection information;

the second connection module 703 is configured to establish a long local area network connection with a mobile terminal having microphone hardware after the mobile terminal scans the two-dimensional code, where the number of the mobile terminals is at least one;

an obtaining module 704, configured to obtain a song requesting instruction carrying song requesting information;

a first playing module 705, configured to play a song accompaniment corresponding to the song requesting information according to the song requesting instruction;

a sending module 706, configured to send a song playing instruction to the mobile terminal through a long connection of a local area network, or send a song playing instruction to the server through a wireless connection when the long connection of the local area network is disconnected, where the song playing instruction is forwarded by the server to the mobile terminal, and the song playing instruction is used to trigger the mobile terminal to acquire a voice signal through a microphone hardware in a microphone mode, and perform Pulse Code Modulation (PCM) on the acquired voice signal to obtain audio data;

a first receiving module 707, configured to receive, through a lan long connection, audio data transmitted by the mobile terminal;

a second playing module 708, configured to play the audio data.

the second connection module 1003 is configured to establish a long TCP connection and a long UDP/RTP connection with the mobile terminal;

the sending module 1006 is configured to send a song playing instruction to the mobile terminal through the TCP long connection;

the first receiving module 1007 is configured to receive the audio data transmitted by the mobile terminal through the UDP/RTP long connection.

Optionally, the obtaining module 1004 is configured to receive a song requesting instruction carrying song requesting information sent by the mobile terminal through long connection of a local area network, or receive a song requesting instruction carrying song requesting information sent by the server through wireless connection, where the song requesting instruction is used to trigger the intelligent terminal to play a song accompaniment corresponding to the song requesting information and send the song playing instruction.

Optionally, the apparatus further comprises:

Optionally, the second playing module 1008 is configured to play the audio data through the player in a shortest path manner.

Optionally, the apparatus further comprises:

the second playing module 1008 is configured to play the audio data after the audio mixing operation.

It should be noted that, when the apparatus provided in the foregoing embodiment implements the functions thereof, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the apparatus may be divided into different functional modules to implement all or part of the functions described above. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.

Referring to fig. 8, a block diagram of a terminal 1100 provided by an embodiment of the present invention is shown, and the terminal may include Radio Frequency (RF) circuitry 1101, a memory 1102 including one or more computer-readable storage media, an input unit 1103, a display unit 1104, a sensor 1105, an audio circuit 1106, a Wireless Fidelity (WiFi) module 1107, a processor 1108 including one or more processing cores, and a power supply 1109. Those skilled in the art will appreciate that the terminal structure shown in fig. 8 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

the RF circuit 1101 may be used for receiving and transmitting signals during a message transmission or communication process, and in particular, for receiving downlink information from a base station and then processing the received downlink information by one or more processors 1108; in addition, data relating to uplink is transmitted to the base station. In general, the RF circuitry 1101 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), and the like.

The memory 1102 may be used for storing software programs and modules, and the processor 1108 may execute various functional applications and data processing by operating the software programs and modules stored in the memory 1102. The memory 1102 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal, etc. Further, the memory 1102 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 1102 may also include a memory controller to provide the processor 1108 and the input unit 1103 with access to the memory 1102.

The input unit 1103 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in a particular embodiment, the input unit 1103 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1108, and can receive and execute commands sent by the processor 1108. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 1103 may include other input devices in addition to the touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1104 may be used to display information input by or provided to the user and various graphical user interfaces of the terminal, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 1104 may include a Display panel, and optionally, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 1108 to determine the type of touch event, and the processor 1108 then provides a corresponding visual output on the display panel according to the type of touch event. Although in FIG. 8 the touch sensitive surface and the display panel are two separate components to implement input and output functions, in some embodiments the touch sensitive surface may be integrated with the display panel to implement input and output functions.

The terminal may also include at least one sensor 1105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that may turn off the display panel and/or the backlight when the terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.

Audio circuitry 1106, a speaker, and a microphone may provide an audio interface between the user and the terminal. The audio circuit 1106 may transmit the electrical signal converted from the received audio data to a speaker, and the electrical signal is converted into a sound signal by the speaker and output; on the other hand, the microphone converts the collected sound signal into an electric signal, which is received by the audio circuit 1106 and converted into audio data, which is then processed by the audio data output processor 1108, and then passed through the RF circuit 1101 to be sent to, for example, another terminal, or output to the memory 1102 for further processing. The audio circuitry 1106 may also include an earbud jack to provide peripheral headset communication with the terminal.

WiFi belongs to short distance wireless transmission technology, and the terminal can help the user to send and receive e-mail, browse web page and access streaming media etc. through the WiFi module 1107, which provides wireless broadband internet access for the user. Although fig. 8 shows the WiFi module 1107, it is understood that it does not belong to the essential constitution of the terminal, and it can be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 1108 is a control center of the terminal, connects various parts of the entire handset using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 1102 and calling data stored in the memory 1102, thereby performing overall monitoring of the handset. Optionally, processor 1108 may include one or more processing cores; preferably, the processor 1108 may integrate an application processor, which primarily handles operating systems, user interfaces, application programs, etc., and a modem processor, which primarily handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1108.

The terminal also includes a power supply 1109 (e.g., a battery) for powering the various components, which may preferably be logically connected to the processor 1108 via a power management system that may provide management of charging, discharging, and power consumption. The power supply 1109 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the terminal may further include a camera, a bluetooth module, and the like, which will not be described herein. Specifically, in this embodiment, the processor 1108 in the terminal executes at least one instruction stored in the memory 1102, so as to implement the karaoke method provided in the foregoing method embodiments.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as a memory comprising instructions, executed by a processor of a server or a camera to perform the steps in the above method embodiments is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

In an exemplary embodiment, a computer program product is also provided for implementing the functions of the individual steps in the above-described method embodiments when the computer program product is executed.

It should be understood that reference to "a plurality" herein means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

The above description is only exemplary of the present invention and should not be taken as limiting the invention, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A karaoke method, which is applied to a mobile terminal with microphone hardware, and comprises the following steps:

scanning a two-dimensional code displayed on an intelligent terminal, wherein the two-dimensional code comprises local area network connection information and server connection information, and the local area network connection information at least comprises an address of the intelligent terminal in a local area network, an identification of the intelligent terminal and an identification of a karaoke application program;

establishing local area network connection with an intelligent terminal provided with a Karaoke application program according to the local area network connection information, wherein the local area network connection comprises a local area network long connection and a local area network short connection, the local area network long connection comprises a Transmission Control Protocol (TCP) long connection and a User Datagram Protocol (UDP)/real-time transport protocol (RTP) long connection, the local area network long connection is used for the condition that audio data needs to be transmitted to the intelligent terminal, the local area network short connection is used for the condition that the intelligent terminal needs to be controlled without transmitting the audio data, after the local area network long connection is successfully established, prompting information for establishing connection is displayed, and wireless connection is established with a server of the Karaoke application program according to the server connection information;

responding to the need of transmitting audio data to the intelligent terminal, and receiving a song playing instruction pushed by the intelligent terminal after playing a song accompaniment through LAN (local area network) leader connection, or receiving the song playing instruction sent by the server through wireless connection when the LAN leader connection is disconnected;

2. The method according to claim 1, wherein the receiving of the song playing command pushed by the intelligent terminal after playing the song accompaniment through lan leader connection comprises:

the transmitting the audio data to the intelligent terminal includes:

3. The method of claim 1, further comprising:

4. The method according to any one of claims 1 to 3, further comprising:

5. The method according to any one of claims 1 to 3, further comprising:

6. The Karaoke method is applied to an intelligent terminal provided with a Karaoke application program, and comprises the following steps:

displaying a two-dimensional code, wherein the two-dimensional code comprises local area network connection information and server connection information, and the local area network connection information at least comprises an address of an intelligent terminal in a local area network, an identifier of the intelligent terminal and an identifier of a karaoke application program;

after the mobile terminal with the microphone hardware scans the two-dimensional code, local area network connection is established with the mobile terminal, the LAN connection comprises a long LAN connection and a short LAN connection, the long LAN connection comprises a long TCP connection and a long UDP/RTP connection, the long connection of the local area network is used for the case that the audio data transmitted by the mobile terminal needs to be received, the local area network short connection is used in case of need to accept control of the mobile terminal without receiving audio data transmitted by the mobile terminal, the number of the mobile terminals is at least one, the mobile terminals are used for displaying prompt information for establishing connection after the local area network long connection is successfully established, establishing wireless connection with a server of the Karaoke application program according to the server connection information;

responding to audio data transmitted by the mobile terminal, sending a song playing instruction to the mobile terminal through long connection of a local area network, or sending the song playing instruction to the server through wireless connection when the long connection of the local area network is disconnected, and forwarding the song playing instruction to the mobile terminal through the wireless connection by the server, wherein the song playing instruction is used for triggering the mobile terminal to acquire voice signals through a microphone hardware in a microphone mode, and performing Pulse Code Modulation (PCM) on the acquired voice signals to obtain the audio data;

7. The method of claim 6, wherein sending the song playing instruction to the mobile terminal via a lan-long connection comprises:

8. The method according to claim 6, wherein the obtaining of the song requesting instruction carrying song requesting information comprises:

9. The method of claim 6, further comprising:

10. The method of claim 6, wherein the playing the audio data comprises:

and playing the audio data through a player in a shortest path mode.

11. The method according to any one of claims 6 to 10, further comprising:

when a plurality of mobile terminals are provided, carrying out sound mixing operation processing on audio data transmitted by the plurality of mobile terminals to obtain audio data subjected to sound mixing operation processing;

the playing the audio data comprises:

and playing the audio data after the sound mixing operation.

12. A karaoke device, applied to a mobile terminal with microphone hardware, comprising:

the system comprises a scanning module, a storage module and a processing module, wherein the scanning module is used for scanning a two-dimensional code displayed on an intelligent terminal, the two-dimensional code comprises local area network connection information and server connection information, and the local area network connection information at least comprises an address of the intelligent terminal in a local area network, an identification of the intelligent terminal and an identification of a karaoke application program;

the first connection module is used for establishing local area network connection with an intelligent terminal provided with a karaoke application program according to the local area network connection information, the local area network connection comprises a local area network long connection and a local area network short connection, the local area network long connection comprises a Transmission Control Protocol (TCP) long connection and a User Datagram Protocol (UDP)/real-time transport protocol (RTP) long connection, the local area network long connection is used for the condition that audio data are required to be transmitted to the intelligent terminal, the local area network short connection is used for the condition that the intelligent terminal is required to be controlled without transmitting the audio data, and prompt information for establishing connection is displayed after the local area network long connection is successfully established;

the receiving module is used for responding to the need of transmitting audio data to the intelligent terminal, receiving a song playing instruction pushed by the intelligent terminal after playing a song accompaniment through LAN (local area network) leader connection, or receiving the song playing instruction sent by the server through wireless connection when the LAN leader connection is disconnected;

13. The device according to claim 12, wherein the receiving module is configured to receive, through the TCP long connection, a song playing instruction pushed by the intelligent terminal after playing a song accompaniment;

14. The apparatus of claim 12, further comprising:

15. The apparatus of any one of claims 12 to 14, further comprising:

16. The apparatus of any one of claims 12 to 14, further comprising:

17. The utility model provides a K sings device, its characterized in that, the device is applied to the intelligent terminal who installs K sings application program, the device includes:

the display module is used for displaying a two-dimensional code, the two-dimensional code comprises local area network connection information and server connection information, and the local area network connection information at least comprises an address of an intelligent terminal in a local area network, an identifier of the intelligent terminal and an identifier of a karaoke application program;

the second connecting module is used for scanning the two-dimensional code by the mobile terminal with the microphone hardware, establishing a local area network connection with the mobile terminal, the local area network connection comprising a local area network long connection and a local area network short connection, the long lan connection comprises a long TCP connection and a long UDP/RTP connection, the long connection of the local area network is used for the case that the audio data transmitted by the mobile terminal needs to be received, the local area network short connection is used in case of need to accept control of the mobile terminal without receiving audio data transmitted by the mobile terminal, the number of the mobile terminals is at least one, the mobile terminals are used for displaying prompt information for establishing connection after the local area network long connection is successfully established, establishing wireless connection with a server of the Karaoke application program according to the server connection information;

the sending module is used for responding to audio data transmitted by the mobile terminal, sending a song playing instruction to the mobile terminal through long connection of a local area network, or sending the song playing instruction to the server through wireless connection when the long connection of the local area network is disconnected, and forwarding the song playing instruction to the mobile terminal through the wireless connection by the server, wherein the song playing instruction is used for triggering the mobile terminal to collect voice signals through a microphone hardware in a microphone mode, and Pulse Code Modulation (PCM) is carried out on the collected voice signals to obtain the audio data;

and the second playing module is also used for playing the audio data.

18. The apparatus according to claim 17, wherein the sending module is configured to send a song playing instruction to the mobile terminal through the TCP long connection;

19. The device according to claim 17, wherein the obtaining module is configured to receive a song requesting instruction carrying song requesting information sent by the mobile terminal through long connection over a local area network, or receive a song requesting instruction carrying song requesting information sent by the server through wireless connection, where the song requesting instruction is used to trigger the intelligent terminal to play a song accompaniment corresponding to the song requesting information and send the song playing instruction.

20. The apparatus of claim 17, further comprising:

21. The apparatus of claim 17, wherein the second playing module is configured to play the audio data through a player in a shortest path manner.

22. The apparatus of any one of claims 17 to 21, further comprising:

23. Karaoke apparatus comprising a processor and a memory, wherein the memory has stored therein at least one instruction, which is loaded and executed by the processor, to implement the method of any one of claims 1 to 5.

24. A karaoke device comprising a processor and a memory, the memory having stored therein at least one instruction, the instruction being loaded and executed by the processor to implement the method of any one of claims 6 to 11.

25. A karaoke system comprising a first karaoke device and a second karaoke device, wherein the first karaoke device is the device of claim 23, and the second karaoke device is the device of claim 24.

26. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the method of any one of claims 1 to 5.

27. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the method of any one of claims 6 to 11.