CN113569087A - Music playing and lyric display synchronization method based on wireless communication - Google Patents
Music playing and lyric display synchronization method based on wireless communication Download PDFInfo
- Publication number
- CN113569087A CN113569087A CN202110892380.4A CN202110892380A CN113569087A CN 113569087 A CN113569087 A CN 113569087A CN 202110892380 A CN202110892380 A CN 202110892380A CN 113569087 A CN113569087 A CN 113569087A
- Authority
- CN
- China
- Prior art keywords
- song
- information
- reading
- mobile phone
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000004891 communication Methods 0.000 title claims abstract description 24
- 238000001514 detection method Methods 0.000 claims description 92
- 230000002159 abnormal effect Effects 0.000 claims description 23
- 230000005856 abnormality Effects 0.000 claims description 3
- 230000002093 peripheral effect Effects 0.000 description 5
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000007689 inspection Methods 0.000 description 3
- 230000000737 periodic effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/683—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/685—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using automatically derived transcript of audio data, e.g. lyrics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/64—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Library & Information Science (AREA)
- Human Computer Interaction (AREA)
- Artificial Intelligence (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
- Telephone Function (AREA)
Abstract
The invention relates to a music playing and lyric display synchronization method based on wireless communication, belonging to the technical field of wireless communication; firstly, reading lyric information of the whole song by a mobile phone end, and simultaneously, identifying the lyric information currently played by a sound box end by the mobile phone end and matching to obtain time sequence information corresponding to the end of the lyric at the moment; then the mobile phone end reads the time sequence information of the starting position of the lyrics displayed on the mobile phone APP; and comparing the time sequence information of the two positions to obtain the actual time delay delta T of the mobile phone end and the sound box end, and finally dynamically adjusting the time delay delta T backwards according to the lyric display time of the mobile phone APP end, so that automatic lyric delay synchronization can be completed.
Description
Technical Field
The invention belongs to the technical field of wireless communication, and particularly relates to a music playing and lyric display synchronization method based on wireless communication.
Background
At present, when the peripheral loudspeaker box is connected in a wireless mode such as WiFi (AirPlay, DLNA) and Bluetooth to play mobile music, time delay can occur when songs are played due to the fact that different wireless devices are inconsistent in protocol and hardware performance, lyrics on a mobile phone APP are displayed and the actual played song time axis is not synchronous, and the current processing mode mainly comprises 2 methods: 1) after the wireless device is connected, the APP defaults to adjust the lyric progress by using a fixed delay time number. 2) The operation mode that the user can manually adjust the speed of the lyric progress is provided, and the user can adjust the speed by himself.
Firstly, the method comprises the following steps: a reference set value is written in a system, a mode of fixedly setting a delay time value is used, delay time of different devices is not completely the same, sometimes, larger difference exists, the condition that sound and lyrics are not synchronous still occurs when the delay time value is actually used, and user perception and experience are poor. Secondly, the method comprises the following steps: in the process of listening to the song, if the song played at the peripheral sound box end is found to be not matched with the lyrics displayed at the APP end of the mobile phone (namely the song playing time of the peripheral sound box end lags behind the lyrics displayed at the APP end of the mobile phone), the user manually adjusts the lyrics progress speed, and the lyrics displayed at the APP end of the mobile phone are adjusted to be synchronous with the song playing of the peripheral sound box end according to the combination of the hearing sense and the vision sense; however, still there can be the manual error after artifical manual regulation, can't guarantee certain time synchronization precision, simultaneously, artifical manual regulation is wasted time and energy, also can't carry out manual regulation in real time if the user is in states such as work, driving, leads to the condition of sound and lyrics asynchronization to last longer time, experiences and feels extremely poor.
Therefore, a method for synchronizing music playing and lyric display based on wireless communication is needed to solve the above problems.
Disclosure of Invention
The invention aims to provide a music playing and lyric display synchronization method based on wireless communication, which is used for solving the technical problems in the prior art, and can enable a mobile phone APP to automatically identify the delay time of wireless equipment, so that the lyric caption time can be dynamically adjusted according to the automatically acquired delay time.
In order to achieve the purpose, the technical scheme of the invention is as follows:
a music playing and lyric display synchronization method based on wireless communication comprises the following steps: s1: the mobile phone end completely reads the whole song information of the currently played song; the song information comprises source lyric information of the whole song and time sequence information corresponding to the source lyric information; s2: after recording and identifying a piece of real-time lyric information of a currently played song at the sound box end, the mobile phone end suspends the playing of the song; s3: the mobile phone terminal identifies the actual position of the real-time lyric information in the source lyric information, so that the time sequence information of the ending of the real-time lyric information is matched and recorded as the playing time T1 of the lyrics of the sound box; s4: the method comprises the steps that a mobile phone terminal identifies the time sequence information displayed by lyrics on a current mobile phone APP and records the time sequence information as the display time T2 of the lyrics of the mobile phone APP; s5: and dynamically adjusting the lyric display time of the APP end of the mobile phone backwards by a time delay delta T to finish automatic time delay synchronization of the lyrics, wherein the time delay delta T is an absolute value of T2-T1.
Further, step S5 includes:
the mobile phone end judges whether the lyrics of the whole song have repeated circulation, if so, the method comprises the following steps:
the mobile phone end obtains the time length of the lyric repeated cycle part of the whole song and records the time length as the lyric repeated cycle song time length T3;
judging whether the time delay delta T is smaller than the repeated cycle song time length T3, if so, judging that the current time delay delta T is the target time delay delta T; if not, judging that the current time delay delta T is error data and directly discarding the error data.
Further, the method also comprises a synchronous inspection step, which is as follows:
setting a self-checking time period T5; recording the actual playing time length of the song after the automatic delay synchronization of the lyrics as T6; when T6 ═ T5;
the method comprises the steps that a mobile phone end reads source audio information of a whole song currently played and time sequence information corresponding to the source audio information; after recording and identifying a piece of real-time audio information of a currently played song at the sound box end, the mobile phone end suspends the playing of the song; the mobile phone terminal identifies the actual position of the segment of real-time audio information in the source audio information, so that the time sequence information of the end of the segment of real-time audio information is matched and recorded as sound box audio playing time T7; the method comprises the steps that a mobile phone terminal identifies the time sequence information displayed by lyrics on a current mobile phone APP and records the time sequence information as the display time T8 of the lyrics of the mobile phone APP;
obtaining the self-checking time delay delta T at the moment, wherein the self-checking time delay delta T is the absolute value of T8-T7;
if the time delay delta t at the moment is equal to 0, judging that the synchronization is successful, and ending;
otherwise, judging that the synchronization fails, and ending.
Further, the synchronization checking step further comprises:
the mobile phone end judges whether the audio frequency of the whole song has repeated circulation, if so, the method comprises the following steps:
the mobile phone end obtains the duration of the audio frequency repeated cycle part of the whole song and records the duration as the audio frequency repeated cycle song duration T9;
judging whether the self-checking time delay delta T is equal to T9 xN, wherein N is 1, 2 and 3 …;
if yes, judging that the synchronization is successful, and ending;
otherwise, judging that the synchronization fails, and ending.
Furthermore, the mobile phone end is provided with a common song reading unit, a standby song reading unit and a main control unit; the main control unit is respectively connected with the common song reading unit and the standby song reading unit;
the frequently-used song reading unit and the main control unit are in a long-time opening state, and the standby song reading unit is in a long-time closing state;
the common song reading unit is used for reading the whole song information of a currently played song at the mobile phone end, recording the whole song information as first song reading information and sending the first song reading information to the main control unit;
the standby song reading unit is also used for reading the whole song information of the currently played song at the mobile phone end, recording the whole song information as second song reading information and sending the second song reading information to the main control unit;
the common song reading unit and the standby song reading unit are two units which are mutually independent;
wherein, when the synchronization is judged to fail in the synchronization checking step, the main control unit starts the spare song reading unit;
and the main control unit performs matching judgment on the first song reading information and the second song reading information, and if the first song reading information is not matched with the second song reading information, the main control unit judges that the common song reading unit is abnormal, namely the whole song information of the currently played song read by the mobile phone end is abnormal.
Further, the mobile phone end is also provided with a song reading output detection unit and a song reading input detection unit;
the main control unit is respectively connected with the song reading output detection unit and the song reading input detection unit;
the song reading and outputting detection unit is used for detecting whether the current song reading and outputting information at the output end of the common song reading unit meets the standard song reading and outputting information in the historical data;
the song reading input detection unit is used for detecting whether the current song reading input information at the input end of the main control unit meets the standard song reading input information in the historical data or not;
the song reading output detection unit and the song reading input detection unit are both in a long-time closed state;
when the common song reading unit is judged to be abnormal, namely the whole song information of the currently played song read by the mobile phone end is abnormal,
the main control unit starts the song reading output detection unit and the song reading input detection unit;
if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit does not accord with the song reading output information of the standard in the historical data, the commonly-used song reading unit is judged to be in fault;
if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit meets the song reading output information of the standard in the historical data, and the song reading input detection unit detects that the current song reading input information at the input end of the main control unit does not meet the song reading input information of the standard in the historical data, the communication link between the commonly-used song reading unit and the main control unit is judged to be in fault;
and if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit meets the song reading output information in the standard of the historical data, and the song reading input detection unit detects that the current song reading input information at the input end of the main control unit meets the song reading input information in the standard of the historical data, the main control unit is judged to be in fault.
Furthermore, the mobile phone end is provided with a common song identification unit and a standby song identification unit;
the common song identification unit is in a long-time open state, and the standby song identification unit is in a long-time close state;
the common song identification unit is used for identifying a piece of song information of a currently played song at the sound box end and recording the song information as first song identification information;
the standby song identification unit is used for identifying a piece of song information which is the same as that of the common song identification unit and recording the song information as second song identification information;
the common song identification unit and the standby song identification unit are two units which are mutually independent;
wherein, when the synchronization is judged to fail in the synchronization checking step, the main control unit starts the spare song recognition unit;
and the main control unit performs matching judgment on the first song identification information and the second song identification information, and if the first song identification information is not matched with the second song identification information, the main control unit judges that the common song identification unit is abnormal, namely the mobile phone end records and identifies the abnormality of a piece of real-time lyric information of the currently played song of the sound box end.
Further, the mobile phone end is also provided with a song recognition output detection unit and a song recognition input detection unit;
the main control unit is respectively connected with the song identification output detection unit and the song identification input detection unit;
the song identification output detection unit is used for detecting whether the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data;
the song identification input detection unit is used for detecting whether the current song identification input information of the input end of the main control unit meets the standard song identification input information in the historical data;
the song identification output detection unit and the song identification input detection unit are both in a long-time closed state;
when the common song identification unit is judged to be abnormal, namely the mobile phone end records and identifies the abnormal real-time lyric information of the currently played song at the sound box end,
the main control unit starts the song identification output detection unit and the song identification input detection unit;
if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit does not accord with the standard song identification output information in the historical data, the frequently-used song identification unit is judged to be in fault;
if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data, and the song identification input detection unit detects that the current song identification input information at the input end of the main control unit does not meet the standard song identification input information in the historical data, the communication link between the frequently-used song identification unit and the main control unit is judged to be in fault;
and if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data, and the song identification input detection unit detects that the current song identification input information at the input end of the main control unit meets the standard song identification input information in the historical data, the main control unit is judged to be in fault.
Compared with the prior art, the invention has the beneficial effects that:
firstly, reading lyric information of the whole song by a mobile phone end, and simultaneously, identifying the lyric information currently played by a sound box end by the mobile phone end and matching to obtain time sequence information corresponding to the end of the lyric at the moment; then the mobile phone end reads the time sequence information of the starting position of the lyrics displayed on the mobile phone APP; and comparing the time sequence information of the two positions to obtain the actual time delay delta T of the mobile phone end and the sound box end, and finally dynamically adjusting the time delay delta T backwards according to the lyric display time of the mobile phone APP end, so that automatic lyric delay synchronization can be completed. When the lyric information currently played at the sound box end is identified at the mobile phone end and the time sequence information corresponding to the end of the lyric at the moment is obtained through matching, a plurality of time sequence information can be matched, the time sequence information is respectively compared with the time sequence information of the starting position of the lyric displayed on the mobile phone APP read by the mobile phone end to obtain a plurality of corresponding time delay delta T, the time delay delta T is respectively compared with the repeated cycle song duration T3, and when the time delay delta T is smaller than the repeated cycle song duration T3, the time delay delta T is the target time delay delta T of the scheme, so that error data are eliminated. And (3) performing delay determination by adopting audio identification, wherein the obtained delay delta t is 0 at the moment, and the synchronization is successful, otherwise, the synchronization fails, and a clear delay synchronization inspection feedback can be given to a user.
Drawings
Fig. 1 is a schematic flow chart of the steps of example 1 of the present embodiment.
Fig. 2 is a schematic flow chart of the steps of example 2 according to the embodiment of the present application.
Fig. 3 is a schematic flow chart of the steps of example 3 of the present application.
Fig. 4 is a schematic flow chart of the steps of example 4 according to the embodiment of the present application.
Fig. 5 is a flowchart illustrating a song reading fault locating step in example 5 according to an embodiment of the present application.
Fig. 6 is a flowchart illustrating a song identification fault location procedure in example 5 according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to fig. 1 to 6 of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
in order to solve the defect that the song played at the peripheral sound box end is not matched with the lyrics displayed at the mobile phone APP end in the prior art, the scheme can enable the mobile phone APP to automatically identify the delay time of the wireless equipment, so that the lyrics caption time can be dynamically adjusted according to the automatically acquired delay time.
As shown in fig. 1, a method for synchronizing music playing and lyric display based on wireless communication is provided, which comprises the following steps: s1: the mobile phone end completely reads the whole song information of the currently played song; the song information comprises source lyric information of the whole song and time sequence information corresponding to the source lyric information; s2: after recording and identifying a piece of real-time lyric information of a currently played song at the sound box end, the mobile phone end suspends the playing of the song; s3: the mobile phone terminal identifies the actual position of the real-time lyric information in the source lyric information, so that the time sequence information of the ending of the real-time lyric information is matched and recorded as the playing time T1 of the lyrics of the sound box; s4: the method comprises the steps that a mobile phone terminal identifies the time sequence information displayed by lyrics on a current mobile phone APP and records the time sequence information as the display time T2 of the lyrics of the mobile phone APP; s5: and dynamically adjusting the lyric display time of the APP end of the mobile phone backwards by a time delay delta T to finish automatic time delay synchronization of the lyrics, wherein the time delay delta T is an absolute value of T2-T1.
In the scheme, firstly, a mobile phone end reads lyric information of the whole song, and simultaneously, the mobile phone end identifies the lyric information currently played by a sound box end and matches the lyric information to obtain time sequence information corresponding to the end of the lyric at the moment; then the mobile phone end reads the time sequence information of the starting position of the lyrics displayed on the mobile phone APP; and comparing the time sequence information of the two positions to obtain the actual time delay delta T of the mobile phone end and the sound box end, and finally dynamically adjusting the time delay delta T backwards according to the lyric display time of the mobile phone APP end, so that automatic lyric delay synchronization can be completed.
Example 2:
in the scheme of embodiment 1, the lyrics of the played song may have a repeated cycle portion, and then, when the mobile phone terminal identifies the currently played lyrics information at the speaker terminal and matches the currently played lyrics information to obtain the time sequence information corresponding to the end of the lyrics at this time, a plurality of time sequence information may be matched, but only one of the time sequence information is the target time sequence information that we need, and if one of the non-target time sequence information is used as a comparison object, the comparison object is taken to compare with the time sequence information of the start position of the lyrics displayed on the mobile phone APP read by the mobile phone terminal. The resulting actual delay deltat will be erroneous data.
Therefore, further to embodiment 1, as shown in fig. 2, step S5 further includes:
the mobile phone end judges whether the lyrics of the whole song have repeated circulation, if so, the method comprises the following steps:
the mobile phone end obtains the time length of the lyric repeated cycle part of the whole song and records the time length as the lyric repeated cycle song time length T3;
judging whether the time delay delta T is smaller than the repeated cycle song time length T3, if so, judging that the current time delay delta T is the target time delay delta T; if not, judging that the current time delay delta T is error data and directly discarding the error data.
In the scheme, when the lyric information currently played at the loudspeaker box end is identified at the mobile phone end and the time sequence information corresponding to the end of the lyric is obtained through matching, a plurality of time sequence information can be matched, the plurality of time sequence information are respectively compared with the time sequence information of the starting position of the lyric displayed on the mobile phone APP read by the mobile phone end to obtain a plurality of corresponding time delay delta T, the plurality of time delay delta T are respectively compared with the repeated cycle song duration T3, and when the time delay delta T is smaller than the repeated cycle song duration T3, the target time delay delta T is the scheme, so that error data are eliminated.
Example 3:
in the scheme of embodiment 2, although the automatic lyric delay synchronization operation is performed, the delay synchronization is not checked, and there is no corresponding feedback, and whether the delay synchronization is successful or not cannot be accurately judged completely by the vision of the user.
Therefore, on the basis of embodiment 2, as shown in fig. 3, the method further includes a synchronization checking step, which is specifically as follows:
setting a self-checking time period T5; recording the actual playing time length of the song after the automatic delay synchronization of the lyrics as T6; when T6 ═ T5;
the method comprises the steps that a mobile phone end reads source audio information of a whole song currently played and time sequence information corresponding to the source audio information; after recording and identifying a piece of real-time audio information of a currently played song at the sound box end, the mobile phone end suspends the playing of the song; the mobile phone terminal identifies the actual position of the segment of real-time audio information in the source audio information, so that the time sequence information of the end of the segment of real-time audio information is matched and recorded as sound box audio playing time T7; the method comprises the steps that a mobile phone terminal identifies the time sequence information displayed by lyrics on a current mobile phone APP and records the time sequence information as the display time T8 of the lyrics of the mobile phone APP;
obtaining the self-checking time delay delta T at the moment, wherein the self-checking time delay delta T is the absolute value of T8-T7;
if the time delay delta t at the moment is equal to 0, judging that the synchronization is successful, and ending;
otherwise, judging that the synchronization fails, and ending.
In the scheme, different from the mode of the embodiment 1, the embodiment 1 adopts the method of performing delay determination through recognition of lyrics, and the scheme adopts the method of performing delay determination through recognition of audio, wherein the obtained delay delta t is 0, which indicates that the synchronization is successful, otherwise, the synchronization is failed, and a clear delay synchronization inspection feedback can be given to a user.
Example 4:
in the scheme of embodiment 3, the audio information may still have a repetitive loop portion like the lyric information, and in accordance with the principle of embodiment 2, there may be erroneous data.
Therefore, further to embodiment 3, as shown in fig. 4, the synchronization checking step further includes:
the mobile phone end judges whether the audio frequency of the whole song has repeated circulation, if so, the method comprises the following steps:
the mobile phone end obtains the duration of the audio frequency repeated cycle part of the whole song and records the duration as the audio frequency repeated cycle song duration T9;
judging whether the self-checking time delay delta T is equal to T9 xN, wherein N is 1, 2 and 3 …;
if yes, judging that the synchronization is successful, and ending;
otherwise, judging that the synchronization fails, and ending.
In the scheme, the error data self-checking time delay delta t caused by the repeated circulating part of the audio information can be effectively eliminated, and the accurate self-checking time delay delta t is obtained.
Example 5:
in the scheme of embodiment 4, even if it is determined that the delay synchronization fails, the user cannot know which reason causes the failure, and cannot perform fault location, or further cannot perform corresponding adjustment and maintenance quickly.
In the whole delay synchronization process, two large plates are involved, wherein one large plate is used for reading the whole song information of the currently played song by the mobile phone end, and the other large plate is used for identifying a section of song information of the currently played song by the sound box end by the mobile phone end; therefore, the fault location of the delay synchronization failure can be completed by detecting the two plates.
Therefore, on the basis of embodiment 4, the mobile phone end is configured with a commonly used song reading unit, a standby song reading unit and a main control unit; the main control unit is respectively connected with the common song reading unit and the standby song reading unit;
the frequently-used song reading unit and the main control unit are in a long-time opening state, and the standby song reading unit is in a long-time closing state;
the common song reading unit is used for reading the whole song information of a currently played song at the mobile phone end, recording the whole song information as first song reading information and sending the first song reading information to the main control unit;
the standby song reading unit is also used for reading the whole song information of the currently played song at the mobile phone end, recording the whole song information as second song reading information and sending the second song reading information to the main control unit;
the common song reading unit and the standby song reading unit are two units which are independent from each other (the correlation interference between the two units can be eliminated);
wherein, when the synchronization is judged to fail in the synchronization checking step, the main control unit starts the spare song reading unit; when the synchronization is successful, the standby song reading unit is not required to be started and placed in a long-time closed state, so that the consumption of corresponding time is reduced, and meanwhile, the standby song reading unit also performs periodic element health state detection to ensure that the standby song reading unit is intact and can normally work;
and the main control unit performs matching judgment on the first song reading information and the second song reading information, and if the first song reading information is not matched with the second song reading information, the main control unit judges that the common song reading unit is abnormal, namely the whole song information of the currently played song read by the mobile phone end is abnormal.
The mobile phone end is also provided with a song reading output detection unit and a song reading input detection unit;
the main control unit is respectively connected with the song reading output detection unit and the song reading input detection unit;
the song reading and outputting detection unit is used for detecting whether the current song reading and outputting information at the output end of the common song reading unit meets the standard song reading and outputting information in the historical data (the standard song reading and outputting information in the historical data refers to all song information played by a mobile phone end connected with a sound box end, all song reading and outputting information output at the output end of the common song reading unit in the process forms a standard song reading and outputting information base, and the current song reading and outputting information is matched and compared with the standard song reading and outputting information base);
the song reading input detection unit is used for detecting whether the current song reading input information at the input end of the main control unit meets the standard song reading input information in the historical data (the standard song reading input information in the historical data refers to all song information played by a mobile phone end connected with a sound box end, all song reading input information input at the input end of the main control unit in the process forms a standard song reading input information base, and the current song reading input information is matched and compared with the standard song reading input information base);
the song reading output detection unit and the song reading input detection unit are both in a long-time closed state;
when the common song reading unit is judged to be abnormal, namely the whole song information of the currently played song read by the mobile phone end is abnormal,
the main control unit starts the song reading output detection unit and the song reading input detection unit, and corresponding consumption can be reduced;
as shown in fig. 5, if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit does not meet the song reading output information of the standard in the historical data, it determines that the commonly-used song reading unit is faulty;
if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit meets the song reading output information of the standard in the historical data, and the song reading input detection unit detects that the current song reading input information at the input end of the main control unit does not meet the song reading input information of the standard in the historical data, the communication link between the commonly-used song reading unit and the main control unit is judged to be in fault;
and if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit meets the song reading output information in the standard of the historical data, and the song reading input detection unit detects that the current song reading input information at the input end of the main control unit meets the song reading input information in the standard of the historical data, the main control unit is judged to be in fault.
By the scheme, the abnormal judgment and the corresponding fault location can be completed in the whole song information process of reading the currently played song by the mobile phone end.
Similarly, for the second plate, the mobile phone terminal identifies a section of song information of the currently played song at the sound box terminal, and the same mode as that of the first plate is adopted. The method comprises the following specific steps:
the mobile phone end is provided with a common song identification unit and a standby song identification unit;
the common song identification unit is in a long-time open state, and the standby song identification unit is in a long-time close state;
the common song identification unit is used for identifying a piece of song information of a currently played song at the sound box end and recording the song information as first song identification information;
the standby song identification unit is used for identifying a piece of song information which is the same as that of the common song identification unit and recording the song information as second song identification information;
the common song identification unit and the spare song identification unit are two units which are independent (the correlation interference between the two can be eliminated);
wherein, when the synchronization is judged to fail in the synchronization checking step, the main control unit starts the spare song recognition unit; when the synchronization is successful, the standby song recognition unit is placed in a long-time closed state without starting, so that the consumption of corresponding time is reduced, and meanwhile, the standby song recognition unit also performs periodic element health state detection to ensure that the standby song recognition unit is intact and can normally work;
and the main control unit performs matching judgment on the first song identification information and the second song identification information, and if the first song identification information is not matched with the second song identification information, the main control unit judges that the common song identification unit is abnormal, namely the mobile phone end records and identifies the abnormality of a piece of real-time lyric information of the currently played song of the sound box end.
Further, the mobile phone end is also provided with a song recognition output detection unit and a song recognition input detection unit;
the main control unit is respectively connected with the song identification output detection unit and the song identification input detection unit;
the song identification output detection unit is used for detecting whether the current song identification output information of the output end of the common song identification unit meets the standard song identification output information in the historical data (the standard song identification output information in the historical data refers to all song information played by a mobile phone end connected with a sound box end, and all song identification output information output by the output end of the common song identification unit in the process constitutes a standard song identification output information base and is matched and compared with the standard song identification output information base);
the song identification input detection unit is used for detecting whether the current song identification input information of the input end of the main control unit meets the standard song identification input information in the historical data (the standard song identification input information in the historical data refers to all song information played by a mobile phone end connected with a sound box end, and all song identification input information input by the input end of the main control unit in the process constitutes a standard song identification input information base and is matched and compared with the standard song identification input information base);
the song identification output detection unit and the song identification input detection unit are both in a long-time closed state;
when the common song identification unit is judged to be abnormal, namely the mobile phone end records and identifies the abnormal real-time lyric information of the currently played song at the sound box end,
the main control unit starts the song identification output detection unit and the song identification input detection unit, and corresponding consumption can be reduced;
as shown in fig. 6, if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit does not conform to the standard song identification output information in the historical data, it determines that the frequently-used song identification unit is faulty;
if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data, and the song identification input detection unit detects that the current song identification input information at the input end of the main control unit does not meet the standard song identification input information in the historical data, the communication link between the frequently-used song identification unit and the main control unit is judged to be in fault;
and if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data, and the song identification input detection unit detects that the current song identification input information at the input end of the main control unit meets the standard song identification input information in the historical data, the main control unit is judged to be in fault.
By the scheme, the abnormal judgment and the corresponding fault location can be completed in the process of identifying the song information of the current played song of the sound box end by the mobile phone end.
The above are preferred embodiments of the present invention, and all changes made according to the technical scheme of the present invention that produce functional effects do not exceed the scope of the technical scheme of the present invention belong to the protection scope of the present invention.
Claims (8)
1. A music playing and lyric display synchronization method based on wireless communication is characterized by comprising the following steps: s1: the mobile phone end completely reads the whole song information of the currently played song; the song information comprises source lyric information of the whole song and time sequence information corresponding to the source lyric information; s2: after recording and identifying a piece of real-time lyric information of a currently played song at the sound box end, the mobile phone end suspends the playing of the song; s3: the mobile phone terminal identifies the actual position of the real-time lyric information in the source lyric information, so that the time sequence information of the ending of the real-time lyric information is matched and recorded as the playing time T1 of the lyrics of the sound box; s4: the method comprises the steps that a mobile phone terminal identifies the time sequence information displayed by lyrics on a current mobile phone APP and records the time sequence information as the display time T2 of the lyrics of the mobile phone APP; s5: and dynamically adjusting the lyric display time of the APP end of the mobile phone backwards by a time delay delta T to finish automatic time delay synchronization of the lyrics, wherein the time delay delta T is an absolute value of T2-T1.
2. The method for synchronizing music playing and lyrics display based on wireless communication according to claim 1, wherein the step S5 further comprises:
the mobile phone end judges whether the lyrics of the whole song have repeated circulation, if so, the method comprises the following steps:
the mobile phone end obtains the time length of the lyric repeated cycle part of the whole song and records the time length as the lyric repeated cycle song time length T3;
judging whether the time delay delta T is smaller than the repeated cycle song time length T3, if so, judging that the current time delay delta T is the target time delay delta T; if not, judging that the current time delay delta T is error data and directly discarding the error data.
3. The method for synchronizing music playing and lyric display based on wireless communication according to claim 2, further comprising a synchronization checking step, specifically as follows:
setting a self-checking time period T5; recording the actual playing time length of the song after the automatic delay synchronization of the lyrics as T6; when T6 ═ T5;
the method comprises the steps that a mobile phone end reads source audio information of a whole song currently played and time sequence information corresponding to the source audio information; after recording and identifying a piece of real-time audio information of a currently played song at the sound box end, the mobile phone end suspends the playing of the song; the mobile phone terminal identifies the actual position of the segment of real-time audio information in the source audio information, so that the time sequence information of the end of the segment of real-time audio information is matched and recorded as sound box audio playing time T7; the method comprises the steps that a mobile phone terminal identifies the time sequence information displayed by lyrics on a current mobile phone APP and records the time sequence information as the display time T8 of the lyrics of the mobile phone APP;
obtaining the self-checking time delay delta T at the moment, wherein the self-checking time delay delta T is the absolute value of T8-T7;
if the time delay delta t at the moment is equal to 0, judging that the synchronization is successful, and ending;
otherwise, judging that the synchronization fails, and ending.
4. The method for synchronizing music playback and lyric display based on wireless communication according to claim 3, wherein said synchronization checking step further comprises:
the mobile phone end judges whether the audio frequency of the whole song has repeated circulation, if so, the method comprises the following steps:
the mobile phone end obtains the duration of the audio frequency repeated cycle part of the whole song and records the duration as the audio frequency repeated cycle song duration T9;
judging whether the self-checking time delay delta T is equal to T9 xN, wherein N is 1, 2 and 3 …;
if yes, judging that the synchronization is successful, and ending;
otherwise, judging that the synchronization fails, and ending.
5. The method for synchronizing music playing and lyric display based on wireless communication of claim 4, wherein the mobile phone end is configured with a common song reading unit, a standby song reading unit, and a main control unit; the main control unit is respectively connected with the common song reading unit and the standby song reading unit;
the frequently-used song reading unit and the main control unit are in a long-time opening state, and the standby song reading unit is in a long-time closing state;
the common song reading unit is used for reading the whole song information of a currently played song at the mobile phone end, recording the whole song information as first song reading information and sending the first song reading information to the main control unit;
the standby song reading unit is also used for reading the whole song information of the currently played song at the mobile phone end, recording the whole song information as second song reading information and sending the second song reading information to the main control unit;
the common song reading unit and the standby song reading unit are two units which are mutually independent;
wherein, when the synchronization is judged to fail in the synchronization checking step, the main control unit starts the spare song reading unit;
and the main control unit performs matching judgment on the first song reading information and the second song reading information, and if the first song reading information is not matched with the second song reading information, the main control unit judges that the common song reading unit is abnormal, namely the whole song information of the currently played song read by the mobile phone end is abnormal.
6. The method for synchronizing music playing and lyric display based on wireless communication of claim 5, wherein the mobile phone terminal is further configured with a song reading output detection unit and a song reading input detection unit;
the main control unit is respectively connected with the song reading output detection unit and the song reading input detection unit;
the song reading and outputting detection unit is used for detecting whether the current song reading and outputting information at the output end of the common song reading unit meets the standard song reading and outputting information in the historical data;
the song reading input detection unit is used for detecting whether the current song reading input information at the input end of the main control unit meets the standard song reading input information in the historical data or not;
the song reading output detection unit and the song reading input detection unit are both in a long-time closed state;
when the common song reading unit is judged to be abnormal, namely the whole song information of the currently played song read by the mobile phone end is abnormal,
the main control unit starts the song reading output detection unit and the song reading input detection unit;
if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit does not accord with the song reading output information of the standard in the historical data, the commonly-used song reading unit is judged to be in fault;
if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit meets the song reading output information of the standard in the historical data, and the song reading input detection unit detects that the current song reading input information at the input end of the main control unit does not meet the song reading input information of the standard in the historical data, the communication link between the commonly-used song reading unit and the main control unit is judged to be in fault;
and if the song reading output detection unit detects that the current song reading output information at the output end of the commonly-used song reading unit meets the song reading output information in the standard of the historical data, and the song reading input detection unit detects that the current song reading input information at the input end of the main control unit meets the song reading input information in the standard of the historical data, the main control unit is judged to be in fault.
7. The method for synchronizing music playing and lyric display based on wireless communication of claim 5, wherein the mobile phone end is configured with a common song recognition unit and a standby song recognition unit;
the common song identification unit is in a long-time open state, and the standby song identification unit is in a long-time close state;
the common song identification unit is used for identifying a piece of song information of a currently played song at the sound box end and recording the song information as first song identification information;
the standby song identification unit is used for identifying a piece of song information which is the same as that of the common song identification unit and recording the song information as second song identification information;
the common song identification unit and the standby song identification unit are two units which are mutually independent;
wherein, when the synchronization is judged to fail in the synchronization checking step, the main control unit starts the spare song recognition unit;
and the main control unit performs matching judgment on the first song identification information and the second song identification information, and if the first song identification information is not matched with the second song identification information, the main control unit judges that the common song identification unit is abnormal, namely the mobile phone end records and identifies the abnormality of a piece of real-time lyric information of the currently played song of the sound box end.
8. The method for synchronizing music playing and lyric display based on wireless communication according to claim 7, wherein the mobile phone terminal is further provided with a song recognition output detection unit and a song recognition input detection unit;
the main control unit is respectively connected with the song identification output detection unit and the song identification input detection unit;
the song identification output detection unit is used for detecting whether the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data;
the song identification input detection unit is used for detecting whether the current song identification input information of the input end of the main control unit meets the standard song identification input information in the historical data;
the song identification output detection unit and the song identification input detection unit are both in a long-time closed state;
when the common song identification unit is judged to be abnormal, namely the mobile phone end records and identifies the abnormal real-time lyric information of the currently played song at the sound box end,
the main control unit starts the song identification output detection unit and the song identification input detection unit;
if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit does not accord with the standard song identification output information in the historical data, the frequently-used song identification unit is judged to be in fault;
if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data, and the song identification input detection unit detects that the current song identification input information at the input end of the main control unit does not meet the standard song identification input information in the historical data, the communication link between the frequently-used song identification unit and the main control unit is judged to be in fault;
and if the song identification output detection unit detects that the current song identification output information at the output end of the frequently-used song identification unit meets the standard song identification output information in the historical data, and the song identification input detection unit detects that the current song identification input information at the input end of the main control unit meets the standard song identification input information in the historical data, the main control unit is judged to be in fault.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110892380.4A CN113569087A (en) | 2021-08-04 | 2021-08-04 | Music playing and lyric display synchronization method based on wireless communication |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110892380.4A CN113569087A (en) | 2021-08-04 | 2021-08-04 | Music playing and lyric display synchronization method based on wireless communication |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113569087A true CN113569087A (en) | 2021-10-29 |
Family
ID=78170577
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110892380.4A Pending CN113569087A (en) | 2021-08-04 | 2021-08-04 | Music playing and lyric display synchronization method based on wireless communication |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113569087A (en) |
-
2021
- 2021-08-04 CN CN202110892380.4A patent/CN113569087A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8879744B2 (en) | Audio testing system and audio testing method for device under test | |
| CN112804607B (en) | Tone quality adjusting method and device and tone quality adjustable earphone | |
| US8639370B2 (en) | Audio source system and method | |
| WO2017148270A1 (en) | Volume control method and device, and terminal | |
| CN113225647A (en) | Cooperative working method of multiple intelligent sound boxes | |
| CN113507337B (en) | Method, device, medium and equipment for determining clock synchronization precision | |
| CN105828254A (en) | Audio adjusting method and device | |
| CN108364643A (en) | The test method and system of auditory localization performance for smart machine | |
| CN113569087A (en) | Music playing and lyric display synchronization method based on wireless communication | |
| CN113709650A (en) | Microphone testing method, device and storage medium | |
| CN108377414A (en) | A kind of method, apparatus, storage medium and electronic equipment adjusting volume | |
| CN114724545A (en) | Method and device for testing air conditioner, testing system and storage medium | |
| KR100481514B1 (en) | a apparatus and method of controlling input signal level | |
| JPH11243599A (en) | Setup method for audio reproducing system and apparatus therefor | |
| CN115016301A (en) | Method and device for controlling intelligent equipment, intelligent equipment and storage medium | |
| CN113596548A (en) | Stepping teaching method and system for vocational education | |
| CN110996166B (en) | Audio control method and device | |
| RU2781476C1 (en) | Method for testing microphones and the speaker system implementing it | |
| CN116346583B (en) | Main and standby audio switching method and system based on decoding end | |
| CN114567848B (en) | Audio output channel state detection device and method | |
| TW202101196A (en) | Audio playback system and method | |
| CN106255008A (en) | The output correcting method of double track sound equipment and output correcting device | |
| US20240281202A1 (en) | Electronic Device Audio Adjustment | |
| CN208821050U (en) | A kind of music control system | |
| CN116471531A (en) | Method, system, terminal and medium for detecting sound reproduction fault of middle-set sound channel of cinema |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20211029 |