CN105989823B - Automatic following and shooting accompaniment method and device - Google Patents

Automatic following and shooting accompaniment method and device Download PDF

Info

Publication number
CN105989823B
CN105989823B CN201510055814.XA CN201510055814A CN105989823B CN 105989823 B CN105989823 B CN 105989823B CN 201510055814 A CN201510055814 A CN 201510055814A CN 105989823 B CN105989823 B CN 105989823B
Authority
CN
China
Prior art keywords
speed
user
accompaniment
singing
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510055814.XA
Other languages
Chinese (zh)
Other versions
CN105989823A (en
Inventor
简勤
刘耕
朱泓
赖航
钟咏
周曜
张文晋
孙颖
陈亘志
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Group Sichuan Co Ltd
Ali Corp
Original Assignee
China Mobile Group Sichuan Co Ltd
Ali Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Group Sichuan Co Ltd, Ali Corp filed Critical China Mobile Group Sichuan Co Ltd
Priority to CN201510055814.XA priority Critical patent/CN105989823B/en
Publication of CN105989823A publication Critical patent/CN105989823A/en
Application granted granted Critical
Publication of CN105989823B publication Critical patent/CN105989823B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Electrophonic Musical Instruments (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)

Abstract

The invention discloses an automatic following accompaniment method, which comprises the following steps: determining the singing speed of a user; comparing the singing speed of the user with the standard accompanying speed to obtain a comparison result; and adjusting the speed of playing the accompaniment according to the comparison result, and outputting the accompaniment. The invention also discloses an automatic following and shooting accompaniment device. By adopting the technical scheme of the invention, the accompaniment effect can be improved, the pleasure effect of the songs per se can not be obviously reduced, and the obtrusive feeling of listeners can be reduced.

Description

Automatic following and shooting accompaniment method and device
Technical Field
The present invention relates to audio processing technologies, and in particular, to an automatic accompaniment method and apparatus for automatic follow-up shooting.
Background
Karaoke (karaoke) is one of activities frequently selected by modern life conditioners and leisure entertainment, and when singing karaoke, a singer rings along with accompanying Music and watches lyric subtitles on an accompanying Music Video tape (MV) or an Audio Video (AV) for singing. Due to the difference of personal singing, some singers can be close to perfect cooperation of original singing and accompaniment, and a very good singing effect is obtained; some singers get out of tune due to poor singing function or narrow vocal range; some singers cannot accurately take a beat, and cannot follow the rhythm of music too fast or too slow, so that the running tone is further caused, and the singing effect is poor.
The existing karaoke automatic accompaniment technique matches the voice of a singer by changing the accompaniment tones. This approach can be suitable for singers with narrow ranges. For example, in a case where the singer cannot sing up in a high-pitched voice, the tone is automatically lowered to enable the singer to easily complete singing. However, the change in tone can be more easily perceived by a listener; frequent changes of the tone may result in a decrease of the effect of the accompaniment, and may rather result in the performer running. For many types of songs, the variation range of the tone itself is large, which cannot accurately reflect the actual tone of the performer, and in this case, the matching effect of the accompaniment is not necessarily good.
In karaoke entertainment, the main cause of the tone jump is not to grasp the beat of the song except for singing in which the narrow range cannot be completed in a partial section, and it is always too fast or too slow to sing that is the cause of the tone jump of most singers.
Therefore, how to make the rhythm of singing of the accompaniment and the singer more in time, and not obviously reducing the pleasure effect of the song per se while improving the accompaniment effect becomes a problem to be solved urgently.
Disclosure of Invention
In view of the above, embodiments of the present invention are directed to providing an automatic accompaniment method and apparatus for automatic accompaniment, which can improve the accompaniment effect, without significantly reducing the musical effect of the song itself, and reduce the obtrusive feeling of the audience.
In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows:
the embodiment of the invention provides an automatic slap-following accompaniment method, which comprises the following steps:
determining the singing speed of a user;
comparing the singing speed of the user with the standard accompanying speed to obtain a comparison result;
and adjusting the speed of playing the accompaniment according to the comparison result, and outputting the accompaniment.
Preferably, before determining the singing speed of the user, the method further comprises:
collecting singing syllable data of a user;
calculating the singing speed of the user in a basic unit according to the singing syllable data of the user;
accordingly, before the collecting the singing syllable data of the user, the method further comprises:
dividing the song pre-sung by the user into a plurality of basic units, wherein the basic units take n syllables as basic units, n is greater than or equal to 1, and n is a positive integer.
Preferably, when comparing the singing speed of the user with a standard accompaniment speed, the method further comprises:
determining an adjustment proportion of the playing accompaniment;
correspondingly, the adjusting the speed of playing the accompaniment according to the comparison result comprises:
if the comparison result shows that the singing speed of the user is high, the playing speed is increased based on the adjustment proportion, so that the played accompaniment speed is consistent with the singing speed of the user;
and if the comparison result shows that the singing speed of the user is low, slowing down the playing speed based on the adjustment proportion so as to enable the singing speed of the user to be consistent with the played accompaniment speed.
Preferably, the determining an adjustment ratio of the play accompaniment includes:
calculating the time T1 needed by playing words of accompaniment lyrics in the basic unit;
calculating the time T2 required by the user to sing the lyrics in the basic unit;
determining an adjustment proportion K of the playing accompaniment according to T1 and T2, wherein the adjustment proportion K is T2/T1;
correspondingly, the adjusting the speed of playing the accompaniment according to the comparison result comprises:
determining the number of adjusting steps according to the adjusting proportion, and judging whether the user adjusts the singing speed;
if the singing speed is not adjusted by the user and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the singing speed is not adjusted by the user, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the user has the singing speed adjustment, and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment according to the proportion of K/M;
if the user has the singing speed adjustment, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment in a K/M ratio;
wherein M is greater than or equal to 2 and is a positive integer.
Preferably, the method for determining the adjustment ratio K of the play accompaniment further includes:
collecting at least two groups of adjacent syllable data in the basic unit;
generating linear parameters k (t) from the at least two sets of adjacent syllable data; wherein t is time;
determining K according to K (t).
Preferably, the method for determining the adjustment ratio of the play accompaniment further includes:
collecting the times C (N) of a first action of the user in the current period;
collecting the number C (N +1) of first actions of the user in the next period;
determining an adjustment proportion K ═ C (N +1)/C (N) of the accompaniment played in the next period; wherein N represents the number of cycles; the first action is an action capable of characterizing a singing tempo of the user.
The embodiment of the invention also provides an automatic slap-following accompaniment device, which comprises a determining unit, a comparing unit and an adjusting unit; wherein,
the determining unit is used for determining the singing speed of the user;
the comparison unit is used for comparing the singing speed of the user with the standard accompaniment speed to obtain a comparison result;
and the adjusting unit is used for adjusting the speed of playing the accompaniment according to the comparison result and outputting the accompaniment.
Preferably, the device further comprises a collecting unit for collecting singing syllable data of the user; the system is also used for dividing the songs pre-sung by the user into a plurality of basic units, wherein the basic units take n syllables as basic units, n is greater than or equal to 1, and n is a positive integer;
correspondingly, the determining unit is further configured to calculate the singing speed of the user in a basic unit according to the singing syllable data of the user.
Preferably, the comparison unit is further configured to:
determining an adjustment proportion of the playing accompaniment;
correspondingly, the adjusting unit is further configured to:
if the comparison result shows that the singing speed of the user is high, the playing speed is increased based on the adjustment proportion, so that the played accompaniment speed is consistent with the singing speed of the user;
and if the comparison result shows that the singing speed of the user is low, slowing down the playing speed based on the adjustment proportion so as to enable the singing speed of the user to be consistent with the played accompaniment speed.
Preferably, the comparison unit is further configured to:
calculating the time T1 needed by playing words of accompaniment lyrics in the basic unit;
calculating the time T2 required by the user to sing the lyrics in the basic unit;
determining an adjustment proportion K of the playing accompaniment according to T1 and T2, wherein the adjustment proportion K is T2/T1;
correspondingly, the adjusting unit is further configured to:
determining the number of adjusting steps according to the adjusting proportion, and judging whether the user adjusts the singing speed;
if the singing speed is not adjusted by the user and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the singing speed is not adjusted by the user, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the user has the singing speed adjustment, and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment according to the proportion of K/M;
if the user has the singing speed adjustment, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment in a K/M ratio;
wherein M is greater than or equal to 2 and is a positive integer.
Preferably, the acquiring unit is further configured to acquire at least two groups of adjacent syllable data in the basic unit;
correspondingly, the comparison unit is further configured to generate a linear parameter k (t) from the at least two sets of adjacent syllable data; wherein t is time;
determining K according to K (t).
Preferably, the acquisition unit is further configured to:
collecting the times C (N) of a first action of the user in the current period;
collecting the number C (N +1) of first actions of the user in the next period;
correspondingly, the comparison unit is further configured to:
determining an adjustment proportion K ═ C (N +1)/C (N) of the accompaniment played in the next period; wherein N represents the number of cycles; the first action is an action capable of characterizing a singing tempo of the user.
The automatic accompaniment method and the device for the accompaniment with shooting provided by the embodiment of the invention determine the singing speed of the user; comparing the singing speed of the user with the standard accompanying speed to obtain a comparison result; and adjusting the speed of playing the accompaniment according to the comparison result, and outputting the accompaniment. According to the technical scheme of the embodiment of the invention, the accompaniment speed is automatically accelerated or decelerated according to the singing speed (but not the tone) of the singer so as to achieve the purpose of following shooting, the accompaniment effect is improved, the pleasure effect of the song is not obviously reduced, and the obtrusive feeling of listeners can be reduced. That is to say, the technical scheme of the embodiment of the invention gives consideration to the requirements of automatic follow-up and no influence on the original accompanying music sense, and can also guide the singer to self-adjust and promote the level of the singer to practice the close-time. In addition, the karaoke experience of the user can be improved, and the accompaniment entertainment of karaoke is improved.
Drawings
Fig. 1 is a schematic flowchart illustrating an automatic accompaniment method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of an automatic accompaniment method according to a second embodiment of the present invention;
fig. 3 is a schematic flowchart of an automatic accompaniment method according to a third embodiment of the present invention;
fig. 4 is a schematic flowchart of an automatic accompaniment method according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of an automatic accompaniment apparatus for accompaniment with slap in accordance with an embodiment of the present invention.
Detailed Description
So that the manner in which the features and aspects of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings.
An embodiment of the present invention provides an automatic accompaniment method for karaoke, which is applied to an electronic device supporting karaoke function, and as shown in fig. 1, in a preferred embodiment of the present invention, the automatic accompaniment method for karaoke mainly includes the following steps:
step 101: the speed of singing by the user is determined.
Preferably, before determining the singing speed of the user, the method further comprises:
collecting singing syllable data of a user;
calculating the singing speed of the user in a basic unit according to the singing syllable data of the user;
accordingly, before the collecting the singing syllable data of the user, the method further comprises:
dividing the song pre-sung by the user into a plurality of basic units, wherein the basic units take n syllables as basic units, n is greater than or equal to 1, and n is a positive integer.
For example, the n may be the number of syllables in a piece of lyrics.
Step 102: and comparing the singing speed of the user with the standard accompaniment speed to obtain a comparison result.
Preferably, when comparing the singing speed of the user with a standard accompaniment speed, the method may further include:
and determining the adjustment proportion of the playing accompaniment.
Preferably, the adjustment ratio may be determined according to the following manner:
calculating the time T1 needed by playing words of accompaniment lyrics in the basic unit;
calculating the time T2 required by the user to sing the lyrics in the basic unit;
the adjustment scale K of the playing accompaniment is determined as T2/T1 from T1 and T2.
Preferably, the adjustment ratio may also be determined according to the following manner:
collecting at least two groups of adjacent syllable data;
generating linear parameters k (t) from the at least two sets of adjacent syllable data; wherein t is time;
determining K according to K (t).
Preferably, the adjustment ratio may also be determined according to the following manner:
collecting the times C (N) of a first action of the user in the current period;
collecting the number C (N +1) of first actions of the user in the next period;
determining an adjustment proportion K ═ C (N +1)/C (N) of the accompaniment played in the next period; wherein N represents the number of cycles; the first action is an action capable of characterizing a singing tempo of the user.
For example, the first motion may be a hand-shaking motion, a stepping motion, a head-shaking motion, or the like of the user during singing.
Step 103: and adjusting the speed of playing the accompaniment according to the comparison result, and outputting the accompaniment.
Preferably, the adjusting the speed of the playing accompaniment according to the comparison result may include:
if the comparison result shows that the singing speed of the user is high, the playing speed is increased based on the adjustment proportion, so that the played accompaniment speed is consistent with the singing speed of the user;
and if the comparison result shows that the singing speed of the user is low, slowing down the playing speed based on the adjustment proportion so as to enable the singing speed of the user to be consistent with the played accompaniment speed.
As an alternative embodiment, the speed of the accompaniment may be expressed in the form of several orders, for example: -5 … … + 5. Therefore, the adjustment of the video can be achieved in a manner of adjusting the duplicate frame (duplicate frame); the adjustment of the audio is achieved in a manner of adjusting the time scale (TimeScale).
In this embodiment the automatic accompaniment with clapping can accelerate or slow down the accompaniment automatically according to singer's speed of singing, reaches the purpose with clapping.
An embodiment of the present invention provides an automatic accompaniment method for karaoke, which is applied to an electronic device supporting karaoke function, and as shown in fig. 2, in a preferred embodiment of the present invention, the automatic accompaniment method for karaoke mainly includes the following steps:
step 201: collecting singing syllable data of a user, and calculating the singing speed of the user in a basic unit according to the singing syllable data of the user.
Preferably, before the collecting the singing syllable data of the user, the method further comprises:
dividing the song pre-sung by the user into a plurality of basic units, wherein the basic units take n syllables as basic units, n is greater than or equal to 1, and n is a positive integer.
For example, N may be the number of syllables in a certain piece of lyrics.
Step 202: and comparing the singing speed of the user with the standard accompaniment speed to obtain a comparison result, and determining the adjustment proportion of playing the accompaniment.
Preferably, the determining the adjustment proportion of the playing accompaniment may include:
calculating the time T1 needed by playing words of accompaniment lyrics in the basic unit;
calculating the time T2 required by the user to sing the lyrics in the basic unit;
the adjustment scale K of the playing accompaniment is determined as T2/T1 from T1 and T2.
Step 203: and adjusting the speed of playing the accompaniment according to the comparison result, and outputting the accompaniment.
Preferably, the adjusting the speed of the playing accompaniment according to the comparison result may include:
determining the number of adjusting steps according to the adjusting proportion, and judging whether the user adjusts the singing speed;
if the singing speed is not adjusted by the user and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the singing speed is not adjusted by the user, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the user has the singing speed adjustment, and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment according to the proportion of K/M;
if the user has the singing speed adjustment, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment in a K/M ratio;
wherein M is greater than or equal to 2 and is a positive integer.
In the automatic accompaniment method with beat in the embodiment, the number of singing syllables is compared with the number of words of the lyrics of the accompaniment by combining the phenomenon that the syllables of the singer are basically equal to the number of the lyrics, a comparison result is obtained, and the adjustment proportion of playing the accompaniment is determined. In addition, the speed of the accompaniment is gradually adjusted, so that the effect of the accompaniment can be improved, and the obtrusive feeling of audiences when the speed of the accompaniment changes can be further reduced.
An automatic accompaniment method for accompaniment with shooting provided by an embodiment of the present invention is applied to an electronic device supporting a karaoke function, as shown in fig. 3, in a preferred embodiment of the present invention, the automatic accompaniment method for accompaniment with shooting mainly comprises the following steps:
step 301: at least two sets of adjacent syllable data are collected.
Step 302: generating linear parameters k (t) from the at least two sets of adjacent syllable data; wherein t is time.
Step 303: determining K according to K (t).
Step 304: and adjusting the speed of playing the accompaniment according to the adjustment proportion, and outputting the accompaniment.
Preferably, the adjusting the speed of the playing accompaniment according to the adjustment ratio may include:
if K > 1, it means the singing speed of the user is fast, and based on the adjustment proportion, the playing speed is increased, so that the played accompaniment speed follows the singing speed of the user;
if K > 1, it means the singing speed of the user is slow, and the playing speed is slowed down based on the adjustment proportion, so that the singing speed of the user can keep up with the played accompaniment speed.
Preferably, the adjusting the speed of the playing accompaniment according to the adjustment ratio may further include:
determining the number of adjusting steps according to the adjusting proportion;
and when K is larger than 1, gradually slowing down the playing speed in the next period according to the adjusting step number, and finally playing the accompaniment according to the proportion of K.
And when K is less than 1, gradually increasing the playing speed in the next period according to the adjusting step number, and finally playing the accompaniment according to the proportion of K.
The automatic accompaniment method with beats in the embodiment is particularly suitable for the crowd with the singing speed of the singer changing linearly on the whole. By adopting the automatic following accompaniment method in the embodiment, listeners do not have a sharp feeling in listening; it is easy to guide the singer to correctly take a beat, rather than completely take a beat, and to promote the user to practice the level of taking a beat.
The above embodiments mainly follow the accompaniment according to the singing syllables of the user.
An automatic accompaniment method for accompaniment with shooting provided by an embodiment of the present invention is applied to an electronic device supporting a karaoke function, as shown in fig. 4, in a preferred embodiment of the present invention, the automatic accompaniment method for accompaniment with shooting mainly comprises the following steps:
step 401: the number C (N) of first actions of the user in the current period and the number C (N +1) of first actions of the user in the next period are collected.
Step 402: and determining the adjustment proportion K of the accompaniment played in the next period, wherein the adjustment proportion K is C (N +1)/C (N).
Wherein N represents the number of cycles; the first action is an action capable of characterizing a singing tempo of the user.
For example, the first motion may be a hand shaking motion, or a stepping motion, or a head shaking motion. Because the user feels pleasure and rhythm, the sound is synchronous with the action.
Step 403: and adjusting the speed of playing the accompaniment according to the adjustment proportion, and outputting the accompaniment.
Preferably, the adjusting the speed of the playing accompaniment according to the adjustment ratio may include:
if K > 1, it means the singing speed of the user is fast, and based on the adjustment proportion, the playing speed is increased, so that the played accompaniment speed follows the singing speed of the user;
if K > 1, it means the singing speed of the user is slow, and the playing speed is slowed down based on the adjustment proportion, so that the singing speed of the user can keep up with the played accompaniment speed.
Preferably, the adjusting the speed of the playing accompaniment according to the adjustment ratio may further include:
determining the number of adjusting steps according to the adjusting proportion;
and when K is larger than 1, gradually slowing down the playing speed in the next period according to the adjusting step number, and finally playing the accompaniment according to the proportion of K.
And when K is less than 1, gradually increasing the playing speed in the next period according to the adjusting step number, and finally playing the accompaniment according to the proportion of K.
The automatic following accompaniment method in the embodiment can improve the accompaniment effect and reduce the obtrusive feeling of listeners; in addition, by adopting the automatic accompaniment method in the embodiment, the karaoke singing can have stronger entertainment.
Fig. 5 is a schematic structural diagram of an automatic accompaniment apparatus for accompaniment with beat following according to an embodiment of the present invention, as shown in fig. 5, the automatic accompaniment apparatus for accompaniment with beat following comprises a determining unit 51, a comparing unit 52 and an adjusting unit 53; wherein,
the determining unit 51 is configured to determine a singing speed of the user;
the comparison unit 52 is configured to compare the singing speed of the user with a standard accompaniment speed to obtain a comparison result;
and the adjusting unit 53 is configured to adjust the speed of playing the accompaniment according to the comparison result, and output the accompaniment.
Preferably, the apparatus further comprises a collecting unit 54 for collecting singing syllable data of the user; the system is also used for dividing the songs pre-sung by the user into a plurality of basic units, wherein the basic units take n syllables as basic units, n is greater than or equal to 1, and n is a positive integer;
correspondingly, the determining unit 51 is further configured to calculate the singing speed of the user in a basic unit according to the singing syllable data of the user.
Preferably, the comparison unit 52 is further configured to:
determining an adjustment proportion of the playing accompaniment;
accordingly, the adjusting unit 53 is further configured to:
if the comparison result shows that the singing speed of the user is high, the playing speed is increased based on the adjustment proportion, so that the played accompaniment speed is consistent with the singing speed of the user;
and if the comparison result shows that the singing speed of the user is low, slowing down the playing speed based on the adjustment proportion so as to enable the singing speed of the user to be consistent with the played accompaniment speed.
Preferably, the comparison unit 52 is further configured to:
calculating the time T1 needed by playing words of accompaniment lyrics in the basic unit;
calculating the time T2 required by the user to sing the lyrics in the basic unit;
determining an adjustment proportion K of the playing accompaniment according to T1 and T2, wherein the adjustment proportion K is T2/T1;
accordingly, the adjusting unit 53 is further configured to:
determining the number of adjusting steps according to the adjusting proportion, and judging whether the user adjusts the singing speed;
if the singing speed is not adjusted by the user and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the singing speed is not adjusted by the user, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the user has the singing speed adjustment, and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment according to the proportion of K/M;
if the user has the singing speed adjustment, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the adjustment step number, and finally playing the accompaniment in a K/M ratio;
wherein M is greater than or equal to 2 and is a positive integer.
Preferably, the acquiring unit 51 is further configured to acquire at least two groups of adjacent syllable data in the basic unit;
correspondingly, the comparing unit 52 is further configured to generate a linear parameter k (t) according to the at least two adjacent sets of pitch data; wherein t is time;
determining K according to K (t).
Preferably, the acquisition unit 54 is further configured to:
collecting the times C (N) of a first action of the user in the current period;
collecting the number C (N +1) of first actions of the user in the next period;
accordingly, the comparison unit 52 is further configured to:
determining an adjustment proportion K ═ C (N +1)/C (N) of the accompaniment played in the next period; wherein N represents the number of cycles; the first action is an action capable of characterizing a singing tempo of the user.
The automatic tracking device can be arranged on the electronic equipment supporting karaoke.
In the embodiment of the invention, the automatic tracking device can be arranged in an electronic device supporting karaoke in practical application. In practical applications, the determining Unit 51, the comparing Unit 52, the adjusting Unit 53, and the acquiring Unit 54 in the automatic photo-tracking apparatus may be implemented by a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or a Field Programmable Gate Array (FPGA) in an electronic device.
In the embodiments provided by the present invention, it should be understood that the disclosed method, apparatus and system can be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Read-Only Memory (ROM), a magnetic disk, or an optical disk.
Alternatively, the integrated unit according to the embodiment of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (8)

1. An automatic follow-up accompaniment method, comprising:
determining the singing speed of a user;
comparing the singing speed of the user with the standard accompanying speed to obtain a comparison result;
adjusting the speed of playing the accompaniment according to the comparison result, and outputting the accompaniment;
when comparing the singing speed of the user with the standard accompanying speed, the method further comprises the following steps:
determining an adjustment proportion of the playing accompaniment;
correspondingly, the adjusting the speed of playing the accompaniment according to the comparison result comprises:
if the comparison result shows that the singing speed of the user is high, the playing speed is increased based on the adjustment proportion, so that the played accompaniment speed is consistent with the singing speed of the user;
if the comparison result shows that the singing speed of the user is low, slowing down the playing speed based on the adjustment proportion so as to enable the singing speed of the user to keep up with the played accompaniment speed;
wherein, the determining the adjustment proportion of the playing accompaniment comprises:
calculating the time T1 needed by the word number of accompaniment lyrics in the basic unit;
calculating the time T2 required by the user to sing the lyrics in the basic unit;
determining an adjustment proportion K of the playing accompaniment according to T1 and T2, wherein the adjustment proportion K is T2/T1;
or, the method for determining the adjustment ratio of the play accompaniment further includes:
collecting the times C (N) of a first action of the user in the current period;
collecting the number C (N +1) of first actions of the user in the next period;
determining an adjustment proportion K ═ C (N +1)/C (N) of the accompaniment played in the next period; wherein N represents the number of cycles; the first action is an action capable of characterizing a singing tempo of the user.
2. The method of claim 1, wherein prior to determining the speed of singing by the user, the method further comprises:
collecting singing syllable data of a user;
calculating the singing speed of the user in a basic unit according to the singing syllable data of the user;
accordingly, before the collecting the singing syllable data of the user, the method further comprises:
dividing the song pre-sung by the user into a plurality of basic units, wherein the basic units take n syllables as basic units, n is greater than or equal to 1, and n is a positive integer.
3. The method of claim 1, wherein the adjusting the speed of the playing accompaniment according to the comparison result comprises:
determining the number of adjusting steps according to the adjusting proportion, and judging whether the user adjusts the singing speed;
if the singing speed is not adjusted by the user and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the singing speed is not adjusted by the user, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the adjusting step number, and finally playing the accompaniment according to the proportion of K.
4. The method of claim 1, wherein the determining the adjusted scale K of the playing accompaniment further comprises:
collecting at least two groups of adjacent syllable data in the basic unit;
generating linear parameters k (t) from the at least two sets of adjacent syllable data; wherein t is time;
determining K according to K (t).
5. An automatic accompaniment apparatus for accompaniment with shooting, comprising a determining unit, a comparing unit and an adjusting unit; wherein,
the determining unit is used for determining the singing speed of the user;
the comparison unit is used for comparing the singing speed of the user with the standard accompaniment speed to obtain a comparison result;
the adjusting unit is used for adjusting the speed of playing the accompaniment according to the comparison result and outputting the accompaniment;
the comparison unit is also used for determining the adjustment proportion of the playing accompaniment;
correspondingly, the adjusting unit is further configured to adjust the speed of playing the accompaniment according to the comparison result, and includes:
if the comparison result shows that the singing speed of the user is high, the playing speed is increased based on the adjustment proportion, so that the played accompaniment speed is consistent with the singing speed of the user;
if the comparison result shows that the singing speed of the user is low, slowing down the playing speed based on the adjustment proportion so as to enable the singing speed of the user to keep up with the played accompaniment speed;
wherein, the comparison unit is also used for calculating the time T1 required by the word number of the accompaniment lyrics in the basic unit; calculating the time T2 required by the user to sing the lyrics in the basic unit; determining an adjustment proportion K of the playing accompaniment according to T1 and T2, wherein the adjustment proportion K is T2/T1;
or, collecting the number of times C (N) of a first action of the user in the current period; collecting the number C (N +1) of first actions of the user in the next period; determining an adjustment proportion K ═ C (N +1)/C (N) of the accompaniment played in the next period; wherein N represents the number of cycles; the first action is an action capable of characterizing a singing tempo of the user.
6. The apparatus of claim 5, further comprising a collecting unit for collecting singing syllable data of the user; the system is also used for dividing the songs pre-sung by the user into a plurality of basic units, wherein the basic units take n syllables as basic units, n is greater than or equal to 1, and n is a positive integer;
correspondingly, the determining unit is further configured to calculate the singing speed of the user in a basic unit according to the singing syllable data of the user.
7. The apparatus of claim 5, wherein the adjusting unit is further configured to:
determining the number of adjusting steps according to the adjusting proportion, and judging whether the user adjusts the singing speed;
if the singing speed is not adjusted by the user and when K is larger than 1, gradually slowing down the playing speed in the next basic unit according to the number of the adjusting steps, and finally playing the accompaniment according to the proportion of K;
if the singing speed is not adjusted by the user, and when K is less than 1, gradually increasing the playing speed in the next basic unit according to the adjusting step number, and finally playing the accompaniment according to the proportion of K.
8. The apparatus according to claim 5, wherein the collecting unit is further configured to collect at least two sets of adjacent syllable data within the basic unit;
correspondingly, the comparison unit is further configured to generate a linear parameter k (t) from the at least two sets of adjacent syllable data; wherein t is time;
determining K according to K (t).
CN201510055814.XA 2015-02-03 2015-02-03 Automatic following and shooting accompaniment method and device Active CN105989823B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510055814.XA CN105989823B (en) 2015-02-03 2015-02-03 Automatic following and shooting accompaniment method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510055814.XA CN105989823B (en) 2015-02-03 2015-02-03 Automatic following and shooting accompaniment method and device

Publications (2)

Publication Number Publication Date
CN105989823A CN105989823A (en) 2016-10-05
CN105989823B true CN105989823B (en) 2020-02-18

Family

ID=57037093

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510055814.XA Active CN105989823B (en) 2015-02-03 2015-02-03 Automatic following and shooting accompaniment method and device

Country Status (1)

Country Link
CN (1) CN105989823B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107680571A (en) * 2017-10-19 2018-02-09 百度在线网络技术(北京)有限公司 A kind of accompanying song method, apparatus, equipment and medium
CN107888963B (en) * 2017-10-27 2021-02-23 北京雷石天地电子技术有限公司 Method and system for synthesizing video based on rhythm
CN108109609B (en) * 2017-11-21 2021-07-20 北京小唱科技有限公司 Audio and video recording method and device
CN109841224B (en) * 2017-11-27 2021-12-31 北京京东尚科信息技术有限公司 Multimedia playing method, system and electronic equipment
CN108231048B (en) * 2017-12-05 2021-09-28 北京小唱科技有限公司 Method and device for correcting audio rhythm
CN110767204B (en) * 2018-07-27 2022-06-14 华为技术有限公司 Sound processing method, device and storage medium
CN109584905B (en) * 2019-01-22 2021-09-28 腾讯音乐娱乐科技(深圳)有限公司 Method, terminal and computer readable medium for measuring music speed
CN110910861A (en) * 2019-11-20 2020-03-24 西安音乐学院 Automatic accompaniment system for carrying out accurate matching by utilizing internet big data
CN111048058B (en) * 2019-11-25 2022-10-28 福建星网视易信息系统有限公司 Singing or playing method and terminal for adjusting song music score in real time
CN111161695B (en) * 2019-12-26 2022-11-04 北京百度网讯科技有限公司 Song generation method and device
CN112669798B (en) * 2020-12-15 2021-08-03 深圳芒果未来教育科技有限公司 Accompanying method for actively following music signal and related equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5511053A (en) * 1992-02-28 1996-04-23 Samsung Electronics Co., Ltd. LDP karaoke apparatus with music tempo adjustment and singer evaluation capabilities
CN1601600A (en) * 2003-09-24 2005-03-30 乐金电子(惠州)有限公司 Song Words coloring method in karaoke system
TW200813977A (en) * 2006-09-11 2008-03-16 Jotek Inc Automatic pitch following method and system for music accompaniment device
CN101667422A (en) * 2009-09-22 2010-03-10 北京中星微电子有限公司 Method and device for adjusting mode of song accompaniment
CN1748242B (en) * 2003-02-12 2010-12-01 皇家飞利浦电子股份有限公司 Audio reproduction apparatus, method, computer program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5511053A (en) * 1992-02-28 1996-04-23 Samsung Electronics Co., Ltd. LDP karaoke apparatus with music tempo adjustment and singer evaluation capabilities
CN1748242B (en) * 2003-02-12 2010-12-01 皇家飞利浦电子股份有限公司 Audio reproduction apparatus, method, computer program
CN1601600A (en) * 2003-09-24 2005-03-30 乐金电子(惠州)有限公司 Song Words coloring method in karaoke system
TW200813977A (en) * 2006-09-11 2008-03-16 Jotek Inc Automatic pitch following method and system for music accompaniment device
CN101667422A (en) * 2009-09-22 2010-03-10 北京中星微电子有限公司 Method and device for adjusting mode of song accompaniment

Also Published As

Publication number Publication date
CN105989823A (en) 2016-10-05

Similar Documents

Publication Publication Date Title
CN105989823B (en) Automatic following and shooting accompaniment method and device
US10957297B2 (en) Self-produced music apparatus and method
US10366684B2 (en) Information providing method and information providing device
US9852721B2 (en) Musical analysis platform
Cuesta et al. Analysis of intonation in unison choir singing
US9804818B2 (en) Musical analysis platform
JP2012103603A (en) Information processing device, musical sequence extracting method and program
Griffin et al. Beat-sync-mash-coder: A web application for real-time creation of beat-synchronous music mashups
US11295715B2 (en) Techniques for controlling the expressive behavior of virtual instruments and related systems and methods
Arzt et al. Artificial intelligence in the concertgebouw
Lemaitre et al. Vocal imitations of basic auditory features
WO2012021799A2 (en) Browser-based song creation
EP3552200B1 (en) Audio variations editing using tempo-range metadata.
CN101930732B (en) Music producing method and device based on user input voice and intelligent terminal
US20180151161A1 (en) Musical composition authoring environment integrated with synthetic musical instrument
JP2005107329A (en) Karaoke machine
JP6102076B2 (en) Evaluation device
TW201443874A (en) Voice processing device
JP6171393B2 (en) Acoustic synthesis apparatus and acoustic synthesis method
JP2016184112A (en) Ensemble evaluation apparatus
CN106448710B (en) A kind of calibration method and music player devices of music play parameters
JP2017173655A (en) Sound evaluation device and sound evaluation method
Gordon et al. Continuous sliding frequency shifts produce an illusory tempo drift
JP2012078700A (en) Singing voice evaluation device
JP6182894B2 (en) Sound processing apparatus and sound processing method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant