CN112086080A

CN112086080A - Music rhythm feedback method and device, electronic equipment and system

Info

Publication number: CN112086080A
Application number: CN202010955525.6A
Authority: CN
Inventors: 刘晓丹; 杨子斌; 万亿
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2020-09-11
Filing date: 2020-09-11
Publication date: 2020-12-15

Abstract

The embodiment of the invention provides a music rhythm feedback method, a music rhythm feedback device, electronic equipment and a music rhythm feedback system, and relates to the technical field of computers. The music rhythm feedback method is applied to a mobile terminal, and the mobile terminal is connected with a vibration engine; the method comprises the following steps: in the playing process of multimedia data, when a music rhythm interval playing to the multimedia data is detected, determining a vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate; and controlling the vibration engine to execute the vibration event corresponding to the music rhythm interval. Through the scheme, the problem that playing experience brought to users during multimedia data playing in the related technology is single and traditional can be solved.

Description

Music rhythm feedback method and device, electronic equipment and system

Technical Field

The invention relates to the technical field of computers, in particular to a music rhythm feedback method, a music rhythm feedback device, electronic equipment and a music rhythm feedback system.

Background

Playing multimedia data through the mobile terminal, for example: the smart phone plays the video provided by the video client, which becomes an indispensable leisure and recreation mode in the life of people. The type of the mobile terminal may include a smart phone, a tablet computer, and the like.

In the related art, the playing process of the multimedia data can only bring visual and/or auditory feelings to the user, so that the playing experience brought to the user is single and traditional, and the requirement of the user on the playing experience cannot be met.

Disclosure of Invention

The embodiment of the invention aims to provide a music rhythm feedback method, a music rhythm feedback device, electronic equipment and a music rhythm feedback system, so as to solve the problem that playing experience brought to a user when multimedia data are played in the related art is single and traditional. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a music tempo feedback method, which is applied to a mobile terminal, where the mobile terminal is connected to a vibration engine; the method comprises the following steps:

in the playing process of multimedia data, when a music rhythm interval playing to the multimedia data is detected, determining a vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate;

and controlling the vibration engine to execute the vibration event corresponding to the music rhythm interval.

In a second aspect, an embodiment of the present invention provides a music tempo feedback method, which is applied to a server, and the method includes:

obtaining vibration description information corresponding to a music rhythm interval of the multimedia data;

when a playing request aiming at the multimedia data from a mobile terminal is received, sending the acquired vibration description information to the mobile terminal, so that when the mobile terminal plays the music rhythm interval, determining a vibration event which is constructed based on the vibration description information and corresponds to the music rhythm interval, and controlling a vibration engine connected with the mobile terminal to execute the vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate.

In a third aspect, an embodiment of the present invention provides a music tempo feedback system, including: a mobile terminal and a server;

the mobile terminal is used for sending a playing request aiming at the multimedia data to the server; the mobile terminal is connected with the vibration engine;

the server is used for acquiring vibration description information corresponding to a music rhythm interval of the multimedia data; when a playing request aiming at the multimedia data from a mobile terminal is received, sending the acquired vibration description information to the mobile terminal;

the mobile terminal is further configured to determine a vibration event corresponding to the music rhythm interval, which is constructed based on the vibration description information, when the music rhythm interval of the multimedia data is played, and control the vibration engine to execute the vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate.

In a fourth aspect, an embodiment of the present invention provides a music tempo feedback device, which is disposed in a mobile terminal, where the mobile terminal is connected to a vibration engine; the device comprises:

the event determining module is used for determining a vibration event corresponding to a music rhythm interval when the music rhythm interval played to the multimedia data is detected in the playing process of the multimedia data; wherein the vibration event is used for controlling the vibration engine to vibrate;

and the event execution module is used for controlling the vibration engine to execute the vibration event corresponding to the music rhythm interval.

In a fifth aspect, an embodiment of the present invention provides a music tempo feedback apparatus, which is disposed in a server, and includes:

the acquisition module is used for acquiring vibration description information corresponding to a music rhythm interval of the multimedia data;

the request response module is used for sending the acquired vibration description information to the mobile terminal when a playing request aiming at the multimedia data from the mobile terminal is received, so that when the mobile terminal plays the music rhythm interval, a vibration event which is constructed based on the vibration description information and corresponds to the music rhythm interval is determined, and a vibration engine connected with the mobile terminal is controlled to execute the vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate.

In a sixth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;

a memory for storing a computer program;

a processor for implementing the steps of the music tempo feedback method according to the first aspect or the second aspect when executing the program stored in the memory.

In a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the music tempo feedback method according to the first aspect or the second aspect.

In an eighth aspect, embodiments of the present invention provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform the steps of the music tempo feedback method according to the first or second aspect.

According to the scheme provided by the embodiment of the invention, in the playing process of the multimedia data, if a music rhythm interval playing to the multimedia data is detected, a vibration event corresponding to the music rhythm interval is determined, and a vibration engine connected with the mobile terminal is controlled to execute the vibration event corresponding to the music rhythm interval. In this scheme, mobile terminal can control the vibrations engine of being connected with mobile terminal when playing multimedia data, shakes according to corresponding vibrations incident when the interval broadcast of music rhythm for multimedia data's broadcast form is more abundant and novel, and can bring the broadcast experience of user immersive with the form of body sense feedback, promotes the broadcast effect greatly. Therefore, the problem that playing experience brought to users during multimedia data playing in the related technology is single and traditional can be solved through the scheme.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

Fig. 1 is a flowchart of a music tempo feedback method provided from the perspective of a mobile terminal according to an embodiment of the present invention;

fig. 2 is another flowchart of a music tempo feedback method provided from the perspective of a mobile terminal according to an embodiment of the present invention;

fig. 3 is a flowchart of a music tempo feedback method provided from the perspective of a server according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a music tempo feedback system according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a music tempo feedback apparatus provided from the perspective of a mobile terminal according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a music tempo feedback apparatus provided from a server perspective according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.

In order to solve the problem that playing experience brought to a user is single and traditional when multimedia data are played in the related art, the embodiment of the invention provides a music rhythm feedback method, a device, electronic equipment and a system.

First, a music tempo feedback method provided by an embodiment of the present invention from the perspective of a mobile terminal is described below.

It should be noted that the music tempo feedback method provided by the embodiment of the present invention is applied to a mobile terminal, and the mobile terminal is connected to a vibration engine, where the electronic device may be a smart phone, a tablet computer, or the like. Wherein the vibration engine is a motor device for realizing vibration. For example, the vibration engine may be a device provided in the mobile terminal, that is, a vibration engine provided in the mobile terminal, and in this case, the vibration engine is a motor device for vibrating the mobile terminal. For example, the mobile terminal may be further connected to a smart home device having a vibration engine, and the mobile terminal may also control vibration of the vibration engine of the smart home device, that is, the vibration engine does not belong to a device of the mobile terminal, and the mobile terminal may control vibration of the smart home device through the vibration engine. For example, the mobile phone may be in communication with the smart massage armchair, so that when the user watches a video program through the mobile phone, the vibration engine of the smart massage armchair may vibrate in coordination with the playing of the video program.

Specifically, the execution subject of the music tempo feedback method may be a music tempo feedback apparatus operating in the mobile terminal. Illustratively, the music tempo feedback device may be a multimedia playing client running in the mobile terminal, such as: video clients, audio clients, etc.; of course, it is reasonable that the music tempo feedback device can also be a plug-in program in the multimedia playing client.

In addition, the multimedia data involved in the embodiments of the present invention may include, but is not limited to: video or audio; and, the multimedia data may be multimedia data that has been downloaded locally by the mobile terminal, or online multimedia data. When the multimedia data is a video, the video comprises image data and audio data, and at least one piece of music content exists in the audio data; when the multimedia data is audio, the audio comprises audio data, and at least one piece of music content exists in the audio data. It should be noted that the types of music content according to the embodiment of the present invention may include: vocal type and instrumental type; the music content of vocal type may include a sound expressed by voice such as a song, rap music, drama music, or opera, and the music content of instrumental type may include a content played by musical instruments such as a solo, a tempo, and a symphony.

Moreover, for multimedia data with at least one piece of music content, at least one music rhythm interval can be determined in advance, and each music rhythm interval contains music content with a certain duration. The music content with a certain duration may include one or more music beats, and the duration of the music rhythm interval may be set according to actual requirements, which is not limited in the embodiment of the present invention. For example, for the video a, assuming that the duration of the video a is 30 mm, and there is a piece of music in the period of 20:00 to 20:30, the period of 20:00 to 20:30 of the video a may be taken as one music rhythm interval of the video a, or three periods of 20:00 to 20:10, 20:11 to 20:20, and 20:21 to 20:30 of the video a may be taken as three music rhythm intervals of the video a.

In addition, in a specific application, a piece of music content in the multimedia data may be divided into one music rhythm interval or a plurality of music rhythm intervals, and the plurality of music rhythm intervals may be continuous or discontinuous. The determination of the music rhythm interval may be performed manually or by using special audio recognition software, and the embodiment of the present invention is not limited thereto. Also, for a music tempo interval, the division into sub-intervals, which may be called tempos, may continue, so that a music tempo interval may comprise one or more tempos.

The music rhythm feedback method provided by the embodiment of the invention is applied to a mobile terminal, the mobile terminal is connected with a vibration engine, and the method can comprise the following steps:

in the playing process of multimedia data, when a music rhythm interval playing to the multimedia data is detected, determining a vibration event corresponding to the music rhythm interval; wherein, the vibration event is used for controlling the vibration engine to vibrate;

and controlling a vibration engine to execute a vibration event corresponding to the music rhythm interval.

A music tempo feedback method provided from the perspective of a mobile terminal according to an embodiment of the present invention will be described in detail below with reference to fig. 1. Wherein the mobile terminal is connected with the vibration engine.

It should be noted that the multimedia data may include one or more audio rhythm intervals, and the processing procedure for each music rhythm interval may be the same. The following describes a music tempo feedback method provided by an embodiment of the present invention, taking a music tempo interval as an example.

As shown in fig. 1, a music tempo feedback method provided in an embodiment of the present invention is applied to a mobile terminal, and may include the following steps:

s101, in the playing process of multimedia data, when a music rhythm interval playing to the multimedia data is detected, determining a vibration event corresponding to the music rhythm interval;

in order to solve the problem in the prior art, when detecting a music rhythm interval playing to multimedia data, the mobile terminal indicates that a music part of the multimedia data is being played, and at this time, the mobile terminal may determine a vibration event corresponding to the music rhythm interval. Wherein the vibration event is used for controlling the vibration engine to vibrate.

The manner of detecting whether to play the music rhythm interval of the multimedia data may include: whether to play the music rhythm interval of the multimedia data is detected based on the time parameter of the music rhythm interval and the current playing time. For example, the time parameter includes a start time and a duration, the mobile terminal may determine whether the current playing time is not less than the start time of the music rhythm interval, and a difference between the start time and the current playing time is not greater than the duration, if so, it is determined that the current playing time is played to the music rhythm interval, otherwise, it is determined that the current playing time is not played to the music rhythm interval; or, when the time parameter includes a start time and an end time, the mobile terminal may determine whether the current playing time is not less than the start time of the music rhythm interval and not greater than the end time of the music rhythm interval, if so, determine to play to the music rhythm interval, otherwise, determine not to play to the music rhythm interval. The start time and the end time included in the time parameter of the music tempo interval may be relative times with respect to the start time of the multimedia data.

Before S101, the mobile terminal may pre-construct and buffer a vibration event corresponding to a music rhythm interval of the multimedia data, so that music rhythm feedback can be performed quickly, and music rhythm feedback efficiency is improved; of course, the mobile terminal may also construct a vibration event corresponding to the music rhythm interval when detecting the music rhythm interval played to the multimedia data, so that the occupation of the buffer memory and the waste of computing resources may be reduced.

In addition, in order to ensure better user experience, whether to execute the music tempo feedback process may be determined according to user requirements. In one implementation, the mobile terminal may provide a function switch for a user as to whether to turn on the music tempo feedback function, so that the user may select whether to turn on the music tempo feedback function according to a need. The function switch can be arranged on a setting page and can also be arranged on a playing interface of the multimedia data. For the setting of the function switch on the setting page, the user can start the function in the setting page, so that the mobile terminal can trigger the execution of S101 when the multimedia data starts to be played; for the function switch set on the playing page, the user may start the function at any playing time or before playing the multimedia data, so that the mobile terminal may trigger to execute S101 after detecting that the function is started.

In yet another implementation, the mobile terminal may implement the music tempo feedback process by requesting user authorization. For example: the mobile terminal outputs a prompt message for guiding the user to perform authorization, and the mobile terminal may perform the music tempo feedback process when the user selects authorization and not perform the music tempo feedback process when the user does not select authorization. The output timing of the prompt message may include, but is not limited to: when the user requests to play the multimedia data, in the process of playing the multimedia data.

S102, controlling the vibration engine to execute the vibration event corresponding to the music rhythm interval.

After determining the vibration event corresponding to the music rhythm interval, the mobile terminal may control the vibration engine to execute the vibration event corresponding to the music rhythm interval. Wherein, the vibration event may be: and the vibration engine is used for controlling the vibration engine to vibrate according to the fluctuation of the music rhythm interval, so that the vibration event is executed in the playing process of the music rhythm interval, and the vibration of the vibration event is matched with the fluctuation of the played music rhythm.

Optionally, in an implementation, a tactile feedback interface set may be disposed in the mobile terminal, and then the controlling, by the mobile terminal, the vibration engine to execute a vibration event corresponding to the music rhythm interval may include:

and controlling the vibration engine to execute the vibration event corresponding to the music rhythm interval by calling the event starting interface in the tactile feedback interface group.

By way of example, and not limitation, the set of haptic feedback interfaces may be a Core Haptics interface set. It can be understood that Haptics technology simulates the real human haptic experience through a haptic feedback mechanism combining hardware and software, and Core Haptics is a new API (Application Programming Interface) group in iOS13 (a proprietary mobile operating system developed by apple for its mobile devices), and provides a more delicate and controllable vibration expression mode, which enables APP (Application) to generate a completely new experience.

If the set of haptic feedback interfaces may be a Core Haptics interface set, then, for example, the code content of the event initiated interface may be as follows:

(BOOL)startAndReturnError:(NSError**)outError。

and after the execution of the vibration event corresponding to any music rhythm interval is finished, the mobile terminal can clear the vibration data of the vibration event corresponding to the music rhythm interval, so that the storage space is released, and the occupation of the music rhythm feedback on the memory is reduced. The seismic data may include, but is not limited to, related data regarding seismic events, among others.

Optionally, in another embodiment of the present invention, the vibration event corresponding to the music rhythm interval in the above S101 is an event constructed by using vibration description information corresponding to the music rhythm interval;

wherein the vibration description information includes: a vibration parameter and/or a time parameter; the shock parameter may include: a vibration level parameter and/or a vibration mode parameter; wherein, the vibration mode parameter comprises at least one of type, intensity, sharpness and vibration change curve.

In this embodiment, in order to implement music rhythm feedback, for multimedia data with music content, after a music rhythm interval of the multimedia data is determined, vibration description information corresponding to the music rhythm interval may be determined, where the vibration description information corresponding to the music rhythm interval is used to describe vibration that needs to be performed by a vibration engine when the vibration engine plays in the music rhythm interval. The vibration description information corresponding to the music rhythm interval can be determined according to the music rhythm of the multimedia data, so that the vibration is matched with the fluctuation of the rhythm of the music rhythm interval. The vibration description information of any music rhythm interval can be manually analyzed and determined, and can also be determined based on special audio recognition software. In addition, for a music rhythm interval, the sub-interval may be continuously divided, and the sub-interval may be referred to as a rhythm, so that a music rhythm interval may include a plurality of rhythms, and the vibration description information corresponding to the music rhythm interval may include: the music rhythm control method comprises the steps of time parameters of music rhythm intervals, time parameters of various rhythms and vibration mode parameters corresponding to various rhythms.

It can be understood that, for any multimedia data, the vibration description information corresponding to each music rhythm interval of the multimedia data can be saved as the rhythm description information of the multimedia data. For example, the tempo description information of the multimedia data may be recorded in a file of a specified type, which may be: json, xml, etc. can be machine-recognized, although not limited thereto.

In this embodiment, for any music rhythm section, the vibration description information corresponding to the music rhythm section is used to describe vibration that the vibration engine needs to perform when the music rhythm section is played, and the vibration is matched with the fluctuation of the rhythm of the music rhythm section, so that a vibration event can be constructed by using the vibration description information corresponding to the music rhythm section, and the vibration that the vibration engine is controlled by the vibration event can be matched with the fluctuation of the rhythm of the music rhythm section.

For convenience of understanding, each of the vibration parameters included in the vibration description information is described below:

the type in the vibration mode parameters can comprise a short vibration type or a long vibration type; the intensity in the vibration mode parameters can change the amplitude and the strength of touch sensation; the sharpness in the vibration mode parameter, which may also be referred to as sharpness or vibration clarity, can determine the characteristics of the haptic experience.

The vibration variation curve in the vibration mode parameters is used for representing the corresponding relation between at least one time point and the vibration parameters at each time point, and the at least one time point is a time point in the duration time period of the music rhythm interval. For example, assuming that the duration of a certain music rhythm interval is 3s, the vibration variation curve may be recorded with: the vibration parameters at 0-1s are: the vibration parameters at intensity 1 and sharpness 1, 1-2s are: the vibration parameters under vibration intensity 1 and vibration sharpness 2, 2-3s are: vibration intensity 3 and vibration sharpness 2. It is understood that the vibration mode parameters may include only: the type, the intensity and the sharpness, so that for the vibration event corresponding to the music rhythm interval, the vibration type is the type in the vibration mode parameters, and the intensity and the sharpness are fixed values, in particular the intensity and the sharpness in the vibration mode parameters; of course, the vibration mode parameters may include only: the type and the vibration change curve are adopted, so that the vibration type is the type in the vibration mode parameter for the vibration event corresponding to the music rhythm interval, and the strength and the sharpness are changed according to the change curve; in addition, the vibration mode parameters may include: the type, the intensity, the sharpness and the vibration change curve, so that for the vibration event corresponding to the music rhythm interval, the vibration type is the type in the vibration mode parameter, the initial values of the intensity and the sharpness are the intensity and the sharpness in the vibration mode parameter, and the intensity and the sharpness are changed according to the change curve in the vibration mode parameter.

The parameter value of the vibration level parameter can be at least two, namely at least two vibration levels, and the vibration mode parameter can be different under different vibration levels. It can be understood that, when the correspondence between the vibration level parameter and the vibration mode parameter is set, the vibration parameter may only include the vibration level parameter, so that the vibration mode parameter may be determined by the vibration level parameter.

In addition, since the vibration event is constructed by using the vibration description information corresponding to the music rhythm interval, the mobile terminal can acquire the vibration description information corresponding to the music rhythm interval of the multimedia data to construct the vibration event based on the vibration description information corresponding to the music rhythm interval before detecting whether the vibration event is played to the music rhythm interval of the multimedia data. The vibration description information corresponding to the music rhythm interval of the multimedia data can be generated by the server and sent to the mobile terminal, can be preset in the server manually and sent to the mobile terminal through the server, and can be generated by the mobile terminal.

Illustratively, in one implementation manner, the mobile terminal sends a play request for the multimedia data to the server, and the server feeds back vibration description information corresponding to a pre-stored music rhythm interval of the multimedia data to the mobile terminal while feeding back the multimedia data, wherein the vibration description information is determined according to the music rhythm of the multimedia data; therefore, the mobile terminal can acquire the vibration description information corresponding to the music rhythm interval of the multimedia data. In this implementation, the vibration description information corresponding to the music rhythm section of the multimedia data is information pre-stored in the server. For the case that the vibration description information is stored in the server, in one implementation, the server may generate vibration description information corresponding to a music rhythm interval of the multimedia data according to a music rhythm of the multimedia data, and store the generated vibration description information; in another implementation manner, the server receives vibration description information corresponding to a music rhythm interval of the multimedia data preset by a relevant person, and stores the received vibration description information.

For example, in another implementation manner, if the multimedia data is local data of the mobile terminal, after the mobile terminal acquires the multimedia data, the mobile terminal may determine vibration description information corresponding to a music rhythm interval of the multimedia data according to the music rhythm of the multimedia data. In this implementation manner, the vibration description information corresponding to the music rhythm interval of the multimedia data is automatically generated and stored by the mobile terminal.

In this embodiment, in the playing process of multimedia data, if a music rhythm interval playing to the multimedia data is detected, a vibration event corresponding to the music rhythm interval is determined, where the vibration event is constructed by using vibration description information corresponding to the music rhythm interval; and controlling a vibration engine connected with the mobile terminal to execute the vibration event corresponding to the music rhythm interval. In this scheme, mobile terminal can control the vibrations engine of being connected with mobile terminal when playing multimedia data, shakes according to corresponding vibrations incident when the interval broadcast of music rhythm for multimedia data's broadcast form is more abundant and novel, and can bring the broadcast experience of user immersive with the form of body sense feedback, promotes the broadcast effect greatly. Therefore, the problem that playing experience brought to users during multimedia data playing in the related technology is single and traditional can be solved through the scheme.

Optionally, in another embodiment of the present invention, before performing S101, the music tempo feedback method provided from the perspective of the mobile terminal may further include:

acquiring the music rhythm of the multimedia data;

and determining vibration description information corresponding to the music rhythm interval of the multimedia data based on the music rhythm.

Any manner of obtaining the music tempo of the multimedia data can be applied to the embodiment; after the music tempo is determined, any implementation manner that can determine the vibration description information corresponding to the audio tempo interval based on the music tempo can be applied to this embodiment.

For example, in one implementation, the manner of obtaining the music tempo of the multimedia data may include: the method comprises the steps of obtaining audio data of multimedia data, calculating a cross-correlation function between audio signals of the audio data and audio signals of preset music rhythm models, obtaining the number of the preset music rhythm models contained in the audio data according to the frequency of each peak position of a cross-correlation function curve appearing in the audio signals, and accordingly obtaining the number of music rhythms, and determining the music rhythm intervals of each music rhythm through the time intervals in which each peak position is located. After the music rhythm interval is determined, the type, the strength and the sharpness of the vibration description information corresponding to the music rhythm interval and the vibration change curve can be determined based on the height information of the corresponding peak position. The music rhythm model may be a basic beat model selected from a piece of music, for example: Dum-Du-Dum-Dum beat model.

Optionally, in another embodiment of the present invention, a haptic feedback interface set for controlling the vibration engine is provided in the mobile terminal, as shown in fig. 2, the S101 may include:

S101A, in the process of playing multimedia data, when a music rhythm interval playing the multimedia data is detected, obtaining vibration description information corresponding to the music rhythm interval;

and S101B, building a vibration event corresponding to the music rhythm interval by calling an event building interface in the tactile feedback interface group and using the vibration parameter in the acquired vibration description information.

And the vibration event corresponding to the music rhythm interval is used for controlling the vibration engine to vibrate according to the rhythm fluctuation of the music rhythm interval.

The step of constructing the vibration event corresponding to the music rhythm interval by calling the event establishment interface in the haptic feedback interface group and using the vibration parameter in the acquired vibration description information may include:

an event establishing interface in the tactile feedback interface group is called, an initial vibration event belonging to the type in the vibration mode parameters is established, other parameters are set for the initial vibration event, and a vibration event matched with vibration description information corresponding to the music rhythm interval is obtained;

the other parameters are parameters except for types in the vibration mode parameters.

If the set of haptic feedback interfaces may be a Core Haptics interface set, then, for example, the code content of the event establishment interface may be as follows:

(nullable id<CHHapticAdvancedPatternPlayer>)create Advanced Player With Pattern:

(CHHapticPattern*)pattern

error:(NSError**)outError。

in this embodiment, in the playing process of multimedia data, if a music rhythm interval playing to the multimedia data is detected, vibration description information corresponding to the music rhythm interval is acquired, an interface is established by calling an event in the tactile feedback interface group, and a vibration event corresponding to the music rhythm interval is established by using a vibration parameter in the acquired vibration description information; and controlling a vibration engine connected with the mobile terminal to execute the vibration event corresponding to the music rhythm interval. In this scheme, mobile terminal can control the vibrations engine of being connected with mobile terminal when playing multimedia data, shakes according to corresponding vibrations incident when the interval broadcast of music rhythm for multimedia data's broadcast form is more abundant and novel, and can bring the broadcast experience of user immersive with the form of body sense feedback, promotes the broadcast effect greatly. Therefore, the problem that playing experience brought to users when multimedia data are played in the related technology is single and traditional can be solved through the scheme; moreover, the occupation of the cache can be reduced and the waste of computing resources can be avoided.

Optionally, in order to enable the vibration engine to be in a ready state before the vibration event is executed, so as to ensure quick and effective execution of the vibration event, in another embodiment of the present invention, before the vibration engine is controlled to execute the vibration event corresponding to the music rhythm interval, the music rhythm feedback method may further include:

the shock engine is initialized.

There are various ways to initialize the shock engine. For example, in one implementation, initializing the shock engine may include:

initializing the vibration engine by calling an initialization interface related to the vibration engine; wherein the initialization interface for the shock engine is an interface in a set of haptic feedback interfaces provided for the mobile terminal. For example, if the set of haptic feedback interfaces may be a Core Haptics interface set, then, for example, the code content of the initialization interface may be as follows:

(nullable instancetype)initAndReturnError:(NSError**)error。

the scheme provided by the embodiment can solve the traditional problem that the playing experience brought to users when the multimedia data are played in the related technology is single; also, the shock engine may be placed in a ready state prior to execution of the shock event, thereby ensuring fast and efficient execution of the shock event.

Optionally, the number of the music tempo sections of the multimedia data is multiple, in another embodiment of the present invention, on the basis of including S101-S102, the music tempo feedback method provided from the perspective of the mobile terminal may further include the steps of:

if the current playing time does not reach any music rhythm interval of the multimedia data, searching a nearest music rhythm interval with the starting time behind the current playing time to obtain a candidate music rhythm interval;

obtaining vibration description information corresponding to the candidate music rhythm interval;

and constructing a vibration event corresponding to the candidate music rhythm interval based on the vibration description information corresponding to the candidate music rhythm interval.

In this embodiment, the mobile terminal pre-establishes the vibration event corresponding to the candidate music tempo interval, so that the vibration event corresponding to the candidate music tempo interval can be directly obtained and executed when the candidate music tempo interval is subsequently played, thereby achieving the purpose of quickly feeding back the music tempo. It is emphasized that any music tempo interval may be a candidate music tempo interval.

It is understood that, in this embodiment, the mobile terminal may further initialize the vibration engine before controlling the vibration engine to execute the vibration event corresponding to the music rhythm interval.

The scheme provided by the embodiment can solve the traditional problem that the playing experience brought to the user when the multimedia data is played in the related technology is single; and the vibration event corresponding to the candidate music rhythm interval is pre-established, so that when the candidate music rhythm interval is reached, the vibration event corresponding to the candidate music rhythm interval is directly acquired, and the vibration event is executed, thereby quickly feeding back the music rhythm.

In addition, in another embodiment of the present invention, the music tempo feedback method provided from the perspective of the mobile terminal may further include:

outputting an interactive interface or a popup window for a user to adjust vibration parameters corresponding to a music rhythm interval in the multimedia data playing process;

and acquiring vibration parameters set by the user based on the interactive interface/popup window, and updating corresponding vibration parameters corresponding to the music rhythm interval of the multimedia data by using the acquired vibration parameters.

After the vibration parameters are updated, the mobile terminal can construct a vibration event according to the updated vibration parameters, so that the individualized vibration requirements of the user are met.

Illustratively, a setting button corresponding to the vibration parameter is displayed in the interactive interface/popup window, so that the user can complete the setting of each vibration parameter based on the setting button. The vibration parameters displayed in the interactive interface/popup window may include part or all of the vibration mode parameters and the vibration level parameters, that is, the user may set all or part of the vibration parameters according to his or her own needs or preferences. For example, for the intensity in the vibration mode parameter, the user may turn the intensity up or down; for the type in the vibration mode parameter, the user may set to short or long vibrations.

And on the premise of not influencing the playing experience of the user, the mobile terminal can automatically output the interactive interface or the popup window in the multimedia data playing process so as to enable the user to set parameters. For example: and in the non-full screen state, automatically popping up the interactive interface or the popup window on the right side or the lower side of the playing interface. Of course, the mobile terminal may output an interactive interface or a popup window after detecting a designated operation issued by the user. For example: the mobile terminal detects a designated gesture operation of the user, or detects that the user clicks a button for outputting an interactive interface/popup, and so on.

In addition, the user can also set vibration parameters in the setting interface, such as: the mobile terminal can provide a setting icon related to the vibration parameter in the setting interface, and after the mobile terminal detects that the user clicks the setting icon, the mobile terminal can output an interactive interface/popup window related to the vibration parameter, so that the user can realize personalized setting of the vibration parameter based on the interactive interface/popup window.

In the scheme provided by this embodiment, an interactive interface or a popup window for adjusting the vibration parameter corresponding to the music rhythm interval is output to the user, so that the user can complete personalized setting for the vibration parameter, that is, select a required vibration mode according to the self requirement. Therefore, the personalized vibration experience can be further provided for the user through the scheme.

Corresponding to the method provided from the perspective of the mobile terminal, the embodiment of the invention also provides a music rhythm feedback method from the perspective of the server.

As shown in fig. 3, an embodiment of the present invention further provides a music tempo feedback method, which is applied to a server, and the method may include the following steps:

s301, obtaining vibration description information corresponding to a music rhythm interval of the multimedia data;

s302, when a playing request aiming at the multimedia data from a mobile terminal is received, sending the obtained vibration description information to the mobile terminal, so that when the mobile terminal plays the music rhythm interval, determining a vibration event which is constructed based on the vibration description information and corresponds to the music rhythm interval, and controlling a vibration engine connected with the mobile terminal to execute the vibration event corresponding to the music rhythm interval; wherein, the vibration event is used for controlling the vibration engine to vibrate.

When the server receives a playing request aiming at the multimedia data from the mobile terminal, the server not only feeds back the multimedia data to the mobile terminal, but also sends the acquired vibration description information to the mobile terminal, so that in the playing process of the multimedia data, the mobile terminal can execute a vibration event constructed based on the vibration description information, and the vibration event brings an immersive playing experience to a user in a somatosensory feedback mode.

Wherein the vibration description information includes: a vibration parameter and/or a time parameter; the vibration parameter includes: a vibration level parameter and/or a vibration mode parameter; wherein, the vibration mode parameter comprises at least one of type, intensity, sharpness and vibration change curve.

Optionally, the vibration description information is determined according to a music tempo of the multimedia data.

Optionally, the obtaining of the vibration description information corresponding to the music rhythm interval of the multimedia data may include:

acquiring the music rhythm of the multimedia data;

The specific content of the vibration description information corresponding to the music rhythm interval of the multimedia data and the obtaining manner may refer to the related description content in the embodiment provided from the perspective of the mobile terminal, which is not described herein again. Similarly, the mobile terminal determines the vibration event corresponding to the music rhythm interval and constructed based on the vibration description information, and controls the vibration engine connected to the mobile terminal to execute the detailed description content of the vibration event corresponding to the music rhythm interval, which may refer to the related description content in the embodiment provided from the perspective of the mobile terminal, and is not described herein again.

According to the scheme provided by the embodiment of the invention, the server acquires the vibration description information corresponding to the music rhythm interval of the multimedia data; further, when a playing request aiming at the multimedia data from a mobile terminal is received, the obtained vibration description information is sent to the mobile terminal, so that when the mobile terminal plays the music rhythm interval, a vibration event which is constructed based on the vibration description information and corresponds to the music rhythm interval is determined, and a vibration engine connected with the mobile terminal is controlled to execute the vibration event corresponding to the music rhythm interval; wherein, the vibration event is used for controlling the vibration engine to vibrate. In this scheme, the server feeds back the vibrations description information that multimedia data's music rhythm interval corresponds to mobile terminal, and like this, mobile terminal can control the vibrations engine of being connected with mobile terminal when playing multimedia data, shakes according to corresponding vibrations incident when playing music rhythm interval for multimedia data's broadcast form is more abundant and novel, and can bring the broadcast experience of user immersive with the form that the body feels the feedback, promotes the broadcast effect greatly. Therefore, the problem that playing experience brought to users during multimedia data playing in the related technology is single and traditional can be solved through the scheme.

A music tempo feedback method provided by an embodiment of the present invention is described below with reference to a specific example.

Assume that there are a plurality of pieces of music content in the video a. For each piece of music content, the starting time of the music content in the video a is assumed to be startT, and the ending time is assumed to be endT, and the time from startT to endT can be referred to as a music tempo interval. The video a may include a plurality of music tempo intervals therein based on the manner of division for the music tempo intervals.

In order to realize music tempo feedback for the video a, the server performs the following preprocessing operations on the video a in advance:

step 1, constructing a rhythm description file of a video A through a manual mode or specified audio recognition software;

and 2, storing the rhythm description file of the video A into a server.

Wherein, the rhythm description file can be of json, xml and the like. Specifically, the rhythm description file may record vibration description information corresponding to each music rhythm section, and the vibration description information corresponding to each music rhythm section may include:

a. time parameters: the starting time of the music rhythm interval and the duration of the music rhythm interval;

b. vibration parameters: a vibration mode parameter; wherein, the vibration mode parameters comprise type, intensity, sharpness and vibration change curve;

after the preprocessing operation of the video a is completed, the music tempo feedback method can be implemented based on the tempo description file of the video a. The specific process can be as follows:

step one, when a music rhythm feedback device in a mobile terminal detects a playing instruction of the mobile terminal for a video A, inquiring whether the video A has a rhythm description file or not through a server, if so, downloading the rhythm description file of the video A from the server and storing the rhythm description file into a magnetic disk of the mobile terminal;

step two, when the video A starts to play, searching a music rhythm interval with the starting time located behind the curr and closest to the curr in the rhythm description file of the video A by using the current playing time curr of the video A; for ease of reference, a music tempo interval whose start time is after the curl and closest to the curl may be taken as a candidate music tempo interval, and the start time of the to-be-processed music tempo interval is set to StartM.

Setting a timer at intervals of T₀Checking the current playing time once in seconds, comparing the current playing time with StartM, and executing the steps if the current playing time is not less than the StartMStep four;

reading vibration description information corresponding to a candidate music rhythm interval in a rhythm description file of the video A, and initializing a vibration engine of the mobile terminal by utilizing an initialization interface related to the vibration engine in a Core Haptics interface group;

and fifthly, aiming at the candidate music rhythm interval, establishing an interface by calling events in the Core Haptics interface group, constructing an initial vibration event of a type belonging to the corresponding vibration mode parameters, and configuring other parameters for the initial vibration event to obtain the vibration event corresponding to the candidate music rhythm interval. The other parameters are parameters except for types in the vibration mode parameters.

And step six, controlling a vibration engine to execute vibration events corresponding to the candidate music rhythm intervals by calling an event starting interface in the Core Haptics interface group, so that the vibration engine in the mobile terminal vibrates according to the vibration events corresponding to all rhythms.

And step seven, when the execution of the vibration event corresponding to the candidate music rhythm interval is finished, removing the event data of the vibration event corresponding to the candidate music rhythm interval, returning to the step two, continuously utilizing the current playing time curl of the video A, searching the music rhythm interval with the starting time being behind the curl and closest to the curl in the rhythm description file of the video A, and starting the processing process of the next music rhythm interval.

According to the scheme provided by the embodiment of the invention, the playing form of the multimedia data is richer and more novel, and the immersive playing experience can be brought to the user in a somatosensory feedback form through the vibration of the mobile terminal, so that the playing effect is greatly improved. Therefore, the problem that playing experience brought to users during multimedia data playing in the related technology is single and traditional can be solved through the scheme.

A music tempo feedback method provided by an embodiment of the present invention will be described below with reference to another specific example.

Assume that there are a plurality of pieces of music content in the video a. For each piece of music content, the starting time of the music content in the video a is assumed to be startT, and the ending time is assumed to be endT, and the time from startT to endT can be referred to as a music tempo interval. Based on the division manner for the music tempo intervals, the video a may include a plurality of music tempo intervals, each of which is further divided into one or more sub-intervals, which may serve as tempos in the music tempo interval, so that each of the music tempo intervals may include one or more tempos.

In order to realize music tempo feedback for video a, the following preprocessing operations are performed on video a in advance:

and 2, storing the rhythm description file of the video A into a background server.

a. time parameters: the starting time of the music rhythm interval, the duration of the music rhythm interval, and the starting time and the duration of each rhythm;

b. vibration parameters: vibration mode parameters corresponding to each rhythm in the music rhythm interval; wherein, the vibration mode parameters include: type, intensity, sharpness and vibration profile.

step one, when a music rhythm feedback device in a mobile terminal detects a playing instruction of the mobile terminal for a video A, inquiring whether the video A has a rhythm description file or not through a background server, if so, downloading the rhythm description file of the video A from the background server, and storing the rhythm description file into a magnetic disk of the mobile terminal;

step two, when the video A starts to play, searching a music rhythm interval with the starting time located behind the curr and closest to the curr in the rhythm description file of the video A by using the current playing time curr of the video A; for ease of reference, a music tempo section whose start time is located after the curl and closest to the curl may be set as the candidate music tempo section, and the start time of the candidate music tempo section is set to StartM.

Setting a timer at intervals of T₀Checking the current playing time once second, comparing the current playing time with StartM, and executing the step four if the current playing time is not less than the StartM;

reading vibration mode parameters of each rhythm in a candidate music rhythm interval in a rhythm description file of the video A, and initializing a vibration engine of the mobile terminal by utilizing an initialization interface related to the vibration engine in a Core Haptics interface group;

step five, aiming at each rhythm in the candidate music rhythm interval, establishing an interface by calling events in a Core Haptics interface group, constructing an initial vibration event of a type contained in vibration mode parameters of the rhythm, and configuring other parameters for the initial vibration event to obtain a vibration event corresponding to the rhythm; wherein, the other parameters are other parameters except the type in the rhythm vibration mode parameters;

step six, controlling a vibration engine to execute vibration events corresponding to various rhythms by calling an event starting interface in a Core Haptics interface group according to the starting time of each rhythm in the candidate music rhythm interval, so that the vibration engine in the mobile terminal vibrates according to the vibration events corresponding to various rhythms;

and step seven, when the execution of the vibration events corresponding to each rhythm in the candidate music rhythm interval is finished, clearing the event data of the vibration events corresponding to each rhythm in the candidate rhythm interval, returning to the step two to continuously utilize the current playing time curl of the video A, searching the music rhythm interval with the starting time after the curl and closest to the curl in the rhythm description file of the video A, and starting the processing process of the next music rhythm interval.

Based on the above method embodiment, as shown in fig. 4, an embodiment of the present invention further provides a music tempo feedback system, including: a mobile terminal 410 and a server 420;

the mobile terminal 410 is configured to send a play request for multimedia data to the server 420; the mobile terminal is connected with the vibration engine;

the server 420 is configured to obtain vibration description information corresponding to a music rhythm interval of the multimedia data; when a playing request aiming at the multimedia data from a mobile terminal is received, sending the acquired vibration description information to the mobile terminal;

the mobile terminal 410 is further configured to determine a vibration event corresponding to the music rhythm interval, which is constructed based on the vibration description information, when the music rhythm interval of the multimedia data is played, and control the vibration engine to execute the vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate.

When the server receives a playing request for the multimedia data from the mobile terminal, the server not only feeds the multimedia data back to the mobile terminal, but also sends the acquired vibration description information to the mobile terminal, so that in the playing process of the multimedia data, the mobile terminal can execute a vibration event constructed based on the vibration description information, and the vibration event brings an immersive playing experience to a user in a somatosensory feedback mode.

According to the scheme provided by the embodiment of the invention, the playing form of the multimedia data is richer and more novel, and the immersive playing experience can be brought to the user in a somatosensory feedback form, so that the playing effect is greatly improved. Therefore, the problem that playing experience brought to users during multimedia data playing in the related technology is single and traditional can be solved through the scheme.

Corresponding to the above method embodiment provided from the perspective of the mobile terminal, the embodiment of the present invention provides a music tempo feedback device. As shown in fig. 5, a music tempo feedback device provided in an embodiment of the present invention is disposed in a mobile terminal, where the mobile terminal is connected to a vibration engine; the apparatus may include:

an event determining module 510, configured to determine, when a music rhythm interval played to multimedia data is detected in a playing process of the multimedia data, a vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate;

and an event executing module 520, configured to control the vibration engine to execute a vibration event corresponding to the music rhythm interval.

Optionally, the vibration event is an event constructed by using vibration description information corresponding to the music rhythm interval;

wherein the shock description information includes: a vibration parameter and/or a time parameter; the vibration parameters include: a vibration level parameter and/or a vibration mode parameter; wherein the vibration mode parameter comprises at least one of type, strength, sharpness and vibration change curve.

Optionally, the apparatus further comprises:

the vibration description information determining module is used for acquiring the music rhythm of the multimedia data; and determining vibration description information corresponding to the music rhythm interval of the multimedia data based on the music rhythm.

Optionally, a tactile feedback interface set for controlling the vibration engine is arranged in the mobile terminal;

the determining, by the event determining module, a vibration event corresponding to the music rhythm interval may include:

obtaining vibration description information corresponding to the music rhythm interval;

and establishing an interface by calling the event establishing interface in the tactile feedback interface group, and constructing a vibration event corresponding to the music rhythm interval by using the vibration parameter in the acquired vibration description information.

Optionally, the apparatus further comprises:

and the initialization module is used for initializing the vibration engine before the event execution module controls the vibration engine to execute the vibration event corresponding to the music rhythm interval.

Optionally, the number of the music rhythm intervals is multiple; the device further comprises:

the event vibration module is used for searching a nearest music rhythm interval with the starting time after the current playing time to obtain a candidate music rhythm interval if the current playing time does not reach any music rhythm interval of the multimedia data; obtaining vibration description information corresponding to the candidate music rhythm interval; and constructing a vibration event corresponding to the candidate music rhythm interval based on the vibration description information corresponding to the candidate music rhythm interval.

Corresponding to the method embodiment provided from the server perspective, the embodiment of the invention also provides a music rhythm feedback device which is arranged on the server. As shown in fig. 6, the music tempo feedback means may include:

the acquiring module 610 is configured to acquire shake description information corresponding to a music rhythm interval of the multimedia data;

a request response module 620, configured to send the obtained vibration description information to the mobile terminal when receiving a play request for the multimedia data from the mobile terminal, so that when the mobile terminal plays to the music rhythm interval, a vibration event corresponding to the music rhythm interval and constructed based on the vibration description information is determined, and a vibration engine connected to the mobile terminal is controlled to execute the vibration event corresponding to the music rhythm interval; wherein the vibration event is used for controlling the vibration engine to vibrate.

According to the scheme provided by the embodiment of the invention, the server acquires the vibration description information corresponding to the music rhythm interval of the multimedia data; further, when a playing request aiming at the multimedia data from a mobile terminal is received, the obtained vibration description information is sent to the mobile terminal, so that when the mobile terminal plays the music rhythm interval, a vibration event which is constructed based on the vibration description information and corresponds to the music rhythm interval is determined, and a vibration engine connected with the mobile terminal is controlled to execute the vibration event corresponding to the music rhythm interval; wherein, the vibration event is used for controlling the vibration engine to vibrate. According to the scheme, the server feeds back vibration description information corresponding to the music rhythm interval of the multimedia data to the mobile terminal, so that the mobile terminal can control the vibration engine connected with the mobile terminal when playing the multimedia data, and vibrates according to corresponding vibration events when playing the music rhythm interval, so that the playing form of the multimedia data is richer and more novel, the immersive playing experience of a user can be brought by the form of body feeling feedback, and the playing effect is greatly improved. Therefore, the problem that playing experience brought to users during multimedia data playing in the related technology is single and traditional can be solved through the scheme.

Corresponding to the above method embodiment, an electronic device according to an embodiment of the present invention is further provided, as shown in fig. 7, and includes a processor 701, a communication interface 702, a memory 703 and a communication bus 704, where the processor 701, the communication interface 702 and the memory 703 complete mutual communication through the communication bus 704,

a memory 703 for storing a computer program;

the processor 701 is configured to implement the steps of the music tempo feedback method provided from the perspective of the mobile terminal in the embodiment of the present invention, or implement the steps of the music tempo feedback method provided from the perspective of the server in the embodiment of the present invention, when executing the program stored in the memory 703.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

In yet another embodiment provided by the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the music tempo feedback method according to any one of the above embodiments.

In a further embodiment provided by the present invention, there is also provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the music tempo feedback method according to any of the above embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for embodiments of devices, apparatuses, media, etc., which are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A music rhythm feedback method is characterized by being applied to a mobile terminal, wherein the mobile terminal is connected with a vibration engine; the method comprises the following steps:

2. The method according to claim 1, wherein the vibration event is an event constructed by using vibration description information corresponding to the music rhythm interval;

3. The method of claim 2, wherein the vibration description information is determined according to a music tempo of the multimedia data.

4. The method of claim 3, further comprising:

acquiring the music rhythm of the multimedia data;

5. The method according to any one of claims 1-4, wherein a haptic feedback interface set for controlling the vibration engine is provided in the mobile terminal;

the determining of the vibration event corresponding to the music rhythm interval includes:

6. The method according to any one of claims 1-4, wherein before controlling the vibration engine to execute the vibration event corresponding to the music rhythm interval, the method further comprises:

initializing the shock engine.

7. The method according to any one of claims 1 to 4, wherein the number of music tempo intervals is plural; the method further comprises the following steps:

8. A music tempo feedback method applied to a server, the method comprising:

9. The method of claim 8, wherein the vibration description information is determined according to a music tempo of the multimedia data.

10. The method of claim 9, wherein the obtaining of the vibration description information corresponding to the music rhythm interval of the multimedia data comprises:

acquiring the music rhythm of the multimedia data;

11. A music tempo feedback system, comprising: a mobile terminal and a server;

12. A music rhythm feedback device is characterized by being arranged on a mobile terminal, wherein the mobile terminal is connected with a vibration engine; the device comprises:

13. A music tempo feedback apparatus, provided in a server, the apparatus comprising:

14. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for performing the method steps of any one of claims 1 to 7 or the method steps of any one of claims 8 to 10 when executing a program stored in a memory.

15. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any of the claims 1-7 or the method steps of any of the claims 8-10.