CN115712473A

CN115712473A - Music score display method and device, electronic equipment and storage medium

Info

Publication number: CN115712473A
Application number: CN202211276521.0A
Authority: CN
Inventors: 毕纪灵; 曹偲; 俞静; 张琴; 朱双淼
Original assignee: Hangzhou Netease Cloud Music Technology Co Ltd
Current assignee: Hangzhou Netease Cloud Music Technology Co Ltd
Priority date: 2022-10-18
Filing date: 2022-10-18
Publication date: 2023-02-24

Abstract

The application provides a music score display method and device, electronic equipment and a storage medium. The method comprises the steps of responding to a selection instruction aiming at target music and target musical instruments, and displaying a music display interface corresponding to the target musical instruments, wherein the music display interface comprises: a music score display area and a fingering display area; in response to a performance start instruction, identification information indicating a current syllable of target music is presented in a score presentation area, and fingering information for playing the current syllable is presented in a fingering presentation area. Therefore, the music score symbol of the current syllable can be prompted in the music score display area through the identification information, and the playing fingering of the current syllable is displayed in the fingering display area, so that a user can learn to play the musical instrument without knowing the music theory and the music score, the learning threshold of the musical instrument is reduced, and the music score display area is friendly to beginners.

Description

Music score display method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a music score display method, apparatus, electronic device, computer-readable storage medium, and computer program product.

Background

Music is a good product in the mental world, and can directly support the heart and burst emotion, so that people can enjoy the spiritual enjoyment which cannot be brought by other things. Along with the continuous improvement of the living standard of people, people have higher and higher requirements on music.

Various musical instruments such as pianos, electronic organs, guitars, etc. have also come into common people, but it is not easy to play wonderful songs using these musical instruments. The musical instrument teaching in the related technology is based on the understanding of music theory and music score by users, has higher threshold and is not friendly to beginners.

Disclosure of Invention

The embodiment of the application provides a music score display method and device, electronic equipment and a storage medium, so that the learning threshold of musical instruments is lowered, and the friendliness to beginners is improved.

One aspect of the embodiments of the present application provides a music score display method, including: responding to the selection instruction aiming at the target music and the target musical instrument, and displaying a music display interface corresponding to the target musical instrument, wherein the music display interface comprises: a music score display area and a fingering display area; in response to a performance start instruction, identification information indicating a current syllable of target music is presented in a score presentation area, and fingering information for playing the current syllable is presented in a fingering presentation area.

Another aspect of the embodiments of the present application provides a music score displaying apparatus, including: the display unit is used for responding to the selection instruction aiming at the target music and the target musical instrument and displaying a music display interface corresponding to the target musical instrument, wherein the music display interface comprises: a music score display area and a fingering display area; and the prompting unit is used for responding to the performance starting instruction, displaying identification information used for indicating the current syllable of the target music in the music score display area, and displaying playing fingering information used for playing the current syllable in the fingering display area.

Another aspect of an embodiment of the present application provides an electronic device, including: a processor; and a memory for storing executable instructions for the processor; wherein the processor is configured to perform the method of any of the embodiments described above via execution of the executable instructions.

Another aspect of the embodiments of the present application provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method according to any of the embodiments.

Another aspect of the embodiments of the present application provides a computer program product, including a computer program, wherein the computer program is configured to implement the method according to any one of the above embodiments when executed by a processor.

The music score display method, the music score display device, the electronic equipment and the storage medium provided by the embodiment of the application display a music display interface corresponding to a target musical instrument by responding to a selection instruction aiming at the target music and the target musical instrument, wherein the music display interface comprises: a music score display area and a fingering display area; in response to a performance start instruction, identification information indicating a current syllable of target music is presented in a score presentation area, and fingering information for playing the current syllable is presented in a fingering presentation area. Therefore, the music score symbol of the current syllable can be prompted in the music score display area through the identification information, and the playing fingering of the current syllable is displayed in the fingering display area, so that a user can learn to play the musical instrument without knowing the music theory and the music score, the learning threshold of the musical instrument is reduced, and the music score display area is friendly to beginners.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a system to which a music score presentation method according to an embodiment of the present application is applied;

fig. 2 is a schematic flowchart of a music score displaying method according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a music presentation interface according to an embodiment of the present application;

FIG. 4 is a schematic view of a selection interface provided in an embodiment of the present application;

FIG. 5a is a partial schematic view of the music score presentation area of FIG. 3;

FIG. 5b is a schematic view of the finger display area of FIG. 3;

FIG. 6 is a schematic diagram of a second display mode provided by the embodiments of the present application;

FIG. 7a is a schematic diagram of a display interface after a click exercise feedback provided in an embodiment of the present application;

fig. 7b is a schematic view of a third display mode provided by the embodiment of the present application;

FIG. 7c is a schematic view of a display interface at the end of a third display mode according to the present disclosure;

fig. 7d is a schematic view of a sharing display interface provided in the embodiment of the present application;

fig. 8a is a schematic view of a display interface after repeated play by clicking according to an embodiment of the present application;

fig. 8b is a schematic view of a display interface after a play speed is clicked according to an embodiment of the present application;

fig. 8c is a schematic view of a display interface after switching musical instruments by clicking provided in the embodiment of the present application;

FIG. 9a is another schematic diagram of a music presentation interface provided in an embodiment of the present application;

FIG. 9b is a schematic view of a second display mode provided by the embodiments of the present application;

FIG. 9c is a schematic view of the fingering display area in FIG. 9 a;

FIG. 9d is a left-hand fingering schematic view of a guitar according to an embodiment of the present application;

fig. 9e is another schematic diagram of first status prompt information provided in the embodiment of the present application;

FIG. 9f is another diagram illustrating second status prompt information according to an embodiment of the present application;

fig. 10 is a flowchart of a music score displaying method according to an embodiment of the present application;

fig. 11a is a schematic view of white keys in a piano provided in an embodiment of the present application;

fig. 11b is a block diagram illustrating a loading flow of a virtual instrument region of a piano according to an embodiment of the present application;

FIG. 12a is a schematic diagram of a two-dimensional array generated based on FIG. 9 d;

FIG. 12b is a block diagram illustrating the loading flow of the virtual instrument area of a guitar according to an embodiment of the present application;

fig. 13 is a block diagram illustrating a loading process of a fingering display area according to an embodiment of the present disclosure;

fig. 14 is a block diagram illustrating a loading process of a music score display area according to an embodiment of the present application;

FIG. 15 is a block diagram illustrating a loading process of an exercise mode provided by an embodiment of the present application;

fig. 16 is a schematic structural diagram of a music score displaying apparatus provided in an embodiment of the present application;

fig. 17 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a music score display method and device, electronic equipment and a storage medium. Specifically, the music score presentation method according to the embodiment of the application may be executed by an electronic device, where the electronic device may be a terminal or a server. The terminal can be a smart phone, a tablet computer, a notebook computer, an intelligent voice interaction device, an intelligent household appliance, a wearable intelligent device, an aircraft, an intelligent vehicle-mounted terminal and other devices, and can further comprise a client, wherein the client can be an audio client, a video client, a browser client, an instant messaging client or an applet and the like. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, middleware service, a domain name service, a security service, a Content Delivery Network (CDN), a big data and artificial intelligence platform, and the like.

In the related art musical instrument learning, taking piano learning as an example, a user needs to know staff well and be skilled in correspondence between piano keys and musical notation symbols, but the requirement on the user is high, that is, the piano learning threshold is high, and is not friendly to beginners.

In order to solve at least one of the above technical problems, embodiments of the present application provide a music score display method, apparatus, electronic device and storage medium, which can prompt a music score symbol of a current syllable in a music score display area through identification information, and display a fingering method of playing the current syllable in a fingering display area, so that a user can learn to play the musical instrument without knowing musical theory and without understanding the music score, thereby reducing a threshold of learning the musical instrument and being friendly to beginners. Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings. Fig. 1 is a schematic structural diagram of a system to which a music score presentation method according to an embodiment of the present application is applied. Referring to fig. 1, the system includes a terminal 10, a server 20, and the like; the terminal 10 and the server 20 are connected via a network, such as a wired or wireless network connection.

The terminal 10, among other things, may be used to display a graphical user interface. The terminal is used for interacting with a user through a graphical user interface, for example, downloading and installing a corresponding client through the terminal and running the client, for example, calling a corresponding applet and running the applet, for example, displaying a corresponding graphical user interface through logging in a website, and the like. In the embodiment of the present application, the terminal 10 may be installed with an instrument learning application, the server 20 may be provided with a music database containing target music, the terminal 10 may obtain a score of the target music through the server 20, and the terminal 10 displays a music presentation interface corresponding to the target instrument by responding to a selection instruction for the target music and the target instrument, where the music presentation interface includes: a music score display area and a fingering display area; and in response to the performance start instruction, presenting identification information indicating a current syllable of the target music in the score presentation area, and presenting fingering information for playing the current syllable in the fingering presentation area.

It should be noted that, although the terminal 10 obtains the music score of the target musical instrument from the server 20, it should be understood by those skilled in the art that the terminal 10 may also store a music database, i.e. it may obtain the music score by means of its own music database. The application may be an application installed on a desktop computer, an application installed on a mobile terminal, an applet embedded in an application, or the like, and the present disclosure is not limited thereto.

It should be noted that the above application scenarios are merely illustrative for the convenience of understanding the spirit and principles of the present disclosure, and embodiments of the present disclosure are not limited in this respect. Rather, embodiments of the present disclosure may be applied to any scenario where applicable.

The details will be described below. It should be noted that the description sequence of the following embodiments is not intended to limit the priority sequence of the embodiments.

Fig. 2 is a schematic flowchart of a music score displaying method according to an embodiment of the present application; FIG. 3 is a schematic diagram of a music presentation interface according to an embodiment of the present application; referring to fig. 2 and fig. 3, an embodiment of the present application provides a music score displaying method 100, where the method 100 includes the following steps S110 to S120.

In step S110, in response to the selection instruction for the target music and the target musical instrument, a music display interface 200 corresponding to the target musical instrument is displayed, where the music display interface 200 includes: a score presentation area 210 and a fingering presentation area 220.

In step S120, in response to the performance start instruction, the identification information 211 indicating the current syllable of the target music is presented in the score presentation area 210, and the fingering information for playing the current syllable is presented in the fingering presentation area 220.

In step S110, the selection instruction may be an instruction to select the target music and the target musical instrument by clicking, double clicking, or the like. The target music may be music that the user wants to play, and the target music may include a plurality of syllables. The target musical instrument is a musical instrument used by the user who wants to play the target music. By selecting a target music and a target instrument, a music presentation interface 200 corresponding to the target instrument may be displayed. The usage object may be a learner of the musical instrument or a user using the musical instrument.

FIG. 4 is a schematic view of a selection interface provided in an embodiment of the present application; referring to fig. 4, in some embodiments, after an object is used to select a target music, for example, song 1, a selection interface 300 shown in fig. 4 may be displayed, a name of the selected song, for example, song 1, may be displayed above the selection interface 300, and in addition, various selectable musical instruments may be displayed, for example, selectable controls such as piano, violin, guitar, saxophone, clarinet, ukulele, bass, and the like, for convenience of description, the piano is taken as an example of the target musical instrument, and if the object is used to select a piano, the music display interface 200 shown in fig. 3 may be displayed.

Music presentation interface 200 can include a score presentation area 210 and a fingering presentation area 220. The score presentation area 210 and the fingering presentation area 220 may be arranged in the music presentation interface 200 in a first direction (up-down direction in fig. 3). A score of the target music is displayed in the score display area 210, and the score may include a plurality of score symbols, which may have a one-to-one correspondence with a plurality of syllables in the target music. It is understood that the musical score is corresponding to a target musical instrument, for example, the target musical instrument is a piano, and the musical score may be displayed as a staff, and for example, the target musical instrument is a guitar, and the musical score may be displayed as a six staff.

In addition, the top of the music presentation interface 200 may also display the type of target instrument and the name of the target music, such as "piano score" and "song 1". The bottom of the music display interface 200 may further display a progress bar 231, a play control 232, and the like of the target music.

In step S120, the performance start instruction may be a voice instruction or a click instruction to the play control 232, or the like. It is understood that the current syllable is a syllable located at the current time during the performance of the target music.

FIG. 5a is a partial schematic view of the music score presentation area of FIG. 3; referring to fig. 3 and 5a, the identification information 211 may be a mark in the score for indicating the current syllable, which may be displayed on the score symbol corresponding to the current syllable, for example, which may be represented as a vertical cursor in fig. 5a, or alternatively, it may also be displayed as a cursor in the shape of an arrow or the like. The color of the identification information 211 can be distinguished from the colors of other areas to achieve a striking effect.

In some embodiments, the score presentation area 210 presents a plurality of score lines in the score, and the method 100 may further include highlighting the score line 214 in which the identification information 211 is located, so that the location in which the object identification information 211 is located may be further prompted to be used. The highlight mode may be a mode of displaying a semi-transparent floating layer or a frame selection area.

Taking the click playing control 232 as an example, if the object is used to click the playing control 232, at this time, the music score display area 210 starts to display the identification information 211, and as time increases, the identification information 211 can move in the music score, so that the indication can be always indicated on the music score symbol corresponding to the current syllable. Moreover, after the play control 232 is clicked, the fingering display area 220 may start to display the playing fingering corresponding to the current syllable, and as the identification information 211 moves, the content displayed in the fingering display area 220 also changes, so that the playing fingering of the current syllable indicated by the identification information 211 may be always displayed. It will be appreciated that the fingering may take a variety of forms, such as to indicate the location of the piano key to be played in text, graphics, or a combination of text and graphics.

Therefore, the embodiment can prompt the music score symbol of the current syllable in the music score display area 210 through the identification information 211, and display 220 the fingering method of the current syllable in the fingering display area, so that the user does not need to understand the music theory knowledge and the music score, can quickly link the music score and the real sound, can check the fingering method of the musical instrument in real time, can help the user without the basis of the musical instrument to quickly learn to play the musical instrument, reduces the learning threshold of the musical instrument, and is friendly to beginners.

FIG. 5b is a schematic view of the finger display area of FIG. 3; referring to fig. 3 and 5b, in some embodiments, the fingering display area 220 includes: a virtual instrument area 221, the virtual instrument area 221 including a plurality of playing controls 221a corresponding to a plurality of playing parts of the target instrument, respectively; the fingering information for playing the current syllable is presented in the fingering presentation area 220 in step S120, including: a first prompt message 221b is presented at the current playing control corresponding to the current syllable, the first prompt message 221b being used to prompt the operation of the current playing part corresponding to the current playing control in the target musical instrument using the object.

In which the virtual instrument region 221 can simulate the shape structure of the target instrument. The playing part may be a part that can be played in the target musical instrument. Taking a piano as an example, the piano may include multiple keys, specifically, multiple black keys and multiple white keys, each key may serve as a playing part, the virtual instrument area 221 may simulate the shape of the piano, and display multiple playing controls 221a, and the multiple playing controls 221a may correspond to multiple keys in the piano, respectively. The current playing control is a control which can make the sound corresponding to the current syllable if the corresponding playing part is played. The first prompt information 221b may be displayed at the current playing control, the first prompt information 221b may be displayed in the form of a semi-transparent floating layer, or may be in the form of an arrow, etc.

It is to be understood that the fingering presentation area 220 may not display the contents or may display the virtual instrument area 221 before acquiring the performance start instruction. After a playing start instruction is obtained, first prompt information 221b can be displayed in the virtual musical instrument area, the first prompt information 221b can indicate a current playing control, after the first prompt information 221b is seen by a user, the playing position of a current syllable can be quickly determined by corresponding to keys corresponding to the current playing control in a playing piano, a playing fingering method can be visually displayed through the virtual musical instrument area to be simulated, a user is prompted, and learning of a beginner is facilitated.

In some embodiments, if the target musical instrument is a keyboard musical instrument, the first prompt message 221b includes a left-hand prompt message and a right-hand prompt message, and the display format of the left-hand prompt message is different from the display format of the right-hand prompt message.

A keyboard-type musical instrument such as a piano or the like, which usually requires both hands to play, the first prompt information 221b can prompt the playing positions of the left hand and the right hand at the same time. As shown in fig. 5b, the left first prompt message 221b is a left-hand prompt message, and the right first prompt message 221b is a right-hand prompt message, which are displayed in different formats, such as different colors, different shades of colors, or different filling patterns. In fig. 5b, the left-hand prompt message is lighter in color, and the right-hand prompt message is darker in color, so that the playing positions of the left hand and the right hand can be distinguished conveniently by using the object.

In some embodiments, the fingering presentation area 220 further includes a gesture presentation area 223 provided with a hand graphic 223a, and the presenting of the playing fingering information for playing the current syllable in the fingering presentation area 220 in step S120 further includes: second prompt information 223b for prompting the position of the finger that operates the currently playing part using the object is shown in the hand figure 223 a.

Wherein the hand graphics 223a can be set according to the kind of the target musical instrument, for example, the piano needs to be played with two hands, the hand graphics 223a can include left and right graphics and right hand graphics, and for example, the guitar mainly fingering is in the left hand, and the hand graphics 223a can include only left hand graphics.

The second prompt information 223b may be a highlight circle, an arrow, or the like, and in some embodiments, if the target musical instrument is a keyboard musical instrument, the second prompt information 223b is displayed at the fingers for playing the current syllable, and the user can know the key to be pressed through the first prompt information 221b and which finger to press through the second prompt information 223b, thereby quickly learning the playing method of the musical instrument.

In some embodiments, the left-hand graphic may be displayed in the same format as the left-hand prompt message, the right-hand graphic may be displayed in the same format as the right-hand prompt message, and the display format may be color (fig. 5 b), fill-in pattern, and the like, so as to further facilitate intuitive determination of the playing position of the left hand and the right hand by using the object.

In some embodiments, as shown in fig. 5b, the step S120 of presenting the fingering information for playing the current syllable in the fingering presentation area 220 further comprises: and displaying the position identification information 270 of the fingers for playing the current syllable at the current playing control, wherein the position identification information 270 is the position serial number of the fingers in the palm.

The position identification information 270 may be a number, which may indicate the position of the finger that needs to depress the key in the palm, for example, 1 for the thumb, and 1-5 for the number from the thumb to the little finger. The position identification information 270 may be presented at the current playing control, which may or may not have a partial overlap with the first prompt information 221b.

In fig. 5b, the left hand prompt information lower display position identification information 270 is 5, which indicates that the key corresponding to the playing control is to be pressed by the left little finger, and the right hand prompt information lower display position identification information 270 is 3, which indicates that the key corresponding to the playing control is to be pressed by the right middle finger. Since the position identification information is displayed in the vicinity of the first cue information 221b, the playing fingering for playing the current syllable can be more conveniently understood using the object.

In some embodiments, the method 100 may further include: in response to the current performance input information using the object not corresponding to the current syllable, first state cue information 240 for indicating that the performance state of the current syllable using the object is an error state is presented in the fingering presentation area 220.

It is understood that the electronic device may be connected to the musical instrument in a wireless manner such as bluetooth or in a wired manner such as a data line, so as to acquire the playing input information of the subject, i.e., the key actually depressed by the subject or the sound emitted.

The current playing input information is the playing input information of the object used at the current moment. When it is detected that the current playing input information does not coincide with the current syllable, the first state prompt information 240 may be presented in the fingering presentation area 220, and the first state prompt information 240 may be in the form of "x", "error", etc., thereby indicating a playing error. By comparing the musical instrument vocalization practiced by the user with the system standard vocalization and giving a prompt with the first state prompt information 240, the user can be helped to know whether the performance of the user is correct in real time, and therefore the playing fingering can be corrected while learning.

In some embodiments, the first state cue information 240 may be presented at the playing control 221a actually played with the object, i.e., the first cue information 221b shows the position at which the object should be played with, and the first state cue information 240 shows the position of the key actually depressed with the object. Of course, in other embodiments, the first status prompt 240 may be presented in other locations.

In some embodiments, the method 100 may further include: in response to the current playing input information coinciding with the current syllable, a second state cue information 250 is presented in the fingering presentation area, the second state cue information 250 indicating that the playing state of the current syllable using the object is the correct state.

When it is detected that the current playing input information coincides with the current syllable, the second state prompt information 250 may be presented in the fingering presentation area 220, and the second state prompt information 250 may be in the form of "√" or "correct", etc., thereby indicating that the playing is correct. Through the second status prompt message 250, the user can quickly know whether the user is paired. In some embodiments, the second status prompt 250 may be presented at the current playing control presented by the first prompt 221b, although in other embodiments it may be presented at other locations.

It will be appreciated that in fig. 5b, the first status prompt 240 indicates a left-hand playing error, while the second status prompt 250 indicates a right-hand playing error.

In some embodiments, with continued reference to fig. 5b, if the target instrument is a keyboard instrument, the fingering display area 220 further includes: fingering scroll area 222; in step S120, the fingering display area 220 displays the fingering information for playing the current syllable, which may further include: a third cue message 260 including a plurality of sub cue messages 261 is presented in the fingering scroll area 222, and the plurality of sub cue messages 261 are used to cue the playing position and the playing time of a plurality of syllables following the current syllable, respectively.

The fingering scroll area 222 may be located between the music score display area 210 and the virtual instrument area 221, the third prompt message 260 may include a plurality of sub-prompts 261, each sub-prompt 261 may be displayed in a square, circle or other shape, and when several consecutive syllables are the same, the plurality of sub-prompts 261 may be connected into a bar. The third prompt 260 may help the subject know in time the time of the performance of the subsequent multiple syllables, as well as the location of the performance.

In some embodiments, the presenting the third prompt message 260 including a plurality of sub prompt messages 261 in the fingering scroll area 222 in the method may include: in response to the time interval between the syllable in the target music and the current syllable being less than or equal to the preset time interval, the sub-cue information 261 corresponding to the syllable is presented in the fingering scroll area 222, wherein the sub-cue information 261 is located at one end of the playing control 221a corresponding to the syllable in the first direction, and the sub-cue information 261 moves toward the playing control 221a in the first direction at the preset speed. The presenting of the first prompt information 221b at the current playing control corresponding to the current syllable in the above method may include: in response to the movement of the sub prompt information 261 to the playing control 221a, the sub prompt information 261 is cancelled to be displayed, the playing control is taken as the current playing control, and the first prompt information 221b is displayed on the current playing control.

It is to be understood that the sub-cue information 261 corresponds to one syllable, and based on the target music, a time interval between the syllable corresponding to each sub-cue information and the current syllable may be determined, and the preset speed multiplied by the time interval may be equal to a distance between the sub-cue information 261 and the virtual instrument region 221 in the first direction.

The predetermined time interval may be a length dimension of the fingering scroll area 222 along the first direction divided by a predetermined speed. A plurality of syllables displayed in the fingering scroll area 222 can be obtained according to the current syllable and the preset time interval, and the third prompt message 260 corresponding to the syllables can be drawn.

For a certain sub-cue information 261, the time when the sub-cue information appears in the fingering scroll area 222 can be calculated, the appearance position of the sub-cue information 261 can be above the playing control 221a corresponding to the corresponding syllable, the distance between the sub-cue information and the virtual musical instrument area can also be calculated, the sub-cue information 261 can be further drawn, the sub-cue information 261 can move downwards along with the continuation of the playing, when the sub-cue information is moved to the virtual musical instrument area 221, the corresponding syllable is just the current syllable, at this moment, the sub-cue information 261 can be cancelled, the playing control corresponding to the sub-cue information 261 in the up-down direction is taken as the current playing control, the first cue information 261 is displayed, and the fingering of the subsequent syllables to be played can be intuitively displayed for the user.

In addition, the third prompt message 260 on the left side in fig. 5b may be a left-handed fingering, and the third prompt message 260 on the right side may be a right-handed fingering, which may be in the same display format as the left-handed prompt message and the right-handed prompt message, respectively, so as to facilitate the judgment of the left-handed fingering and the right-handed fingering.

In some embodiments, the score in the score presentation area includes a plurality of score symbols, each score symbol corresponding to a syllable in the target music, and the method 100 may further include: presenting first information at a score symbol corresponding to a current syllable in response to the current playing input information not coinciding with the current syllable; in response to the current playing input information coinciding with the current syllable, presenting second information at the score symbol corresponding to the current syllable.

The historical playing states of the music score symbols can be visually displayed in the music score through the first information and the second information, the first information represents playing errors, and the second information represents playing correctness, so that the user can be helped to know the mastering degree of the user on each music bar in time.

In some embodiments, the first information has the same shape as the corresponding musical score symbol, the second information has the same shape as the corresponding musical score symbol, and the display format of the first information is different from that of the second information.

For example, the display format of the second information may be green, and the display format of the first information may be red. The green floating layer with the same shape as the music score symbol with correct playing can be displayed, and the red floating layer with the same shape as the music score symbol with wrong playing can be displayed, so that the music score symbols before the identification information 211 can be displayed in red or green, and the historical playing state of the whole music can be visually displayed.

As shown in fig. 5a, the score symbols after the identification information 211, which are not played, may be shown as black and gray. In addition, the wire frame 212 and the wire frame 213 show the played score symbols before the identification information 211, if the syllables corresponding to the score symbols in the wire frame 212 are all played incorrectly, the score symbols in the wire frame 212 may be displayed in red, and if the syllables corresponding to the score symbols in the wire frame 213 are all played correctly, the score symbols in the wire frame 212 may be displayed in green.

In some embodiments, the music presentation mode may have a plurality of modes, for example, the first presentation mode illustrated in fig. 3 may be a novice mode, and the displaying the music presentation interface 200 corresponding to the target musical instrument in step S110 may include: in response to a first operation instruction to the first display mode, the music display interface 200 is displayed, and the music score display area 210 and the fingering display area 220 are arranged along the first direction.

The first operation instruction may be a click operation, a double click operation, or the like. As shown in fig. 3, the music display interface 200 may be a display interface in a first display mode, in this case, the music display interface 200 includes a music score display area 210 and a fingering display area 220 located below the music score display area 210, and the first display mode may facilitate a beginner to learn the playing of the musical instrument according to the fingering.

FIG. 6 is a schematic view of a second display mode provided by the embodiments of the present application; referring to fig. 6, in some embodiments, the music presentation mode may include a second presentation mode, the second presentation mode may be an expert mode, and the size along the first direction is a length size, and the method 100 may further include: and in response to a second operation instruction of the second display mode, canceling the display of the fingering display area, and adjusting the display size of the music score display area, so that the length size of the adjusted music score display area is equal to the sum of the length sizes of the music score display area and the fingering display area in the first display mode.

The second operation instruction can be clicking, double-clicking and the like. As shown in fig. 3, the bottom of the music presentation interface 200 may also present various controls, such as novice mode 271, repeat 272, play speed 273, exercise feedback 274, and switching musical instruments 275. In some embodiments, if the novice mode 271 is clicked, the mode can be switched to the second display mode, and the display interface 400 shown in fig. 6 is displayed, at this time, the music score display area 410 is expanded to occupy the original fingering display area, and the fingering display area is cancelled, so that an expert with a certain music theory basis can play conveniently.

FIG. 7a is a schematic diagram of a display interface after a click exercise feedback provided in an embodiment of the present application; fig. 7b is a schematic view of a third display mode provided by the embodiment of the present application; referring to fig. 7a and 7b, in some embodiments, the music display mode may include a third display mode, the third display mode may be an exercise mode, and the method 100 may further include: and adjusting the display direction and the display size of the music score display area and the fingering display area in response to a third operation instruction for a third display mode, so that the adjusted music score display area and the adjusted fingering display area are arranged along a second direction, wherein the second direction is perpendicular to the first direction.

The third operation instruction can be clicking, double-clicking and the like. If the exercise feedback 274 of FIG. 3 is clicked, a display interface 450 of FIG. 7a may be displayed, which may pop-up through the exercise feedback to indicate to the user that exercise feedback is about to begin and ask the user whether to record an exercise video. If the object is used to click the opening in the display interface 450, the user will jump to the third display mode and display the display interface 500 shown in fig. 7 b. It can be understood that, in fig. 3, the display interface is displayed in a vertical screen mode, the up-down direction is a first direction, and the left-right direction is a second direction, while in fig. 7, the direction of the display interface is changed and displayed in a horizontal screen mode, the up-down direction is a second direction, and the left-right direction is a first direction.

In fig. 7b, the display interface 500 includes a music score display area 510 and a fingering display area 520, which are arranged up and down along the second direction, it can be understood that, except for the display direction and the display scale of the music score display area and the fingering display area in the third display mode and the first display mode, the display modes and contents of the music score display area and the fingering display area may be the same or slightly different, for example, the music score display area 510 may display only one music score row, and the gesture display area 521 in the fingering display area 520 may be displayed in the lower left corner of the fingering scroll area. In the third display mode, the display area of the fingering display area 520 is larger, so that the playing fingering can be better learned by using the object conveniently.

FIG. 7c is a schematic view of a display interface at the end of a third display mode provided by the embodiments of the present application; fig. 7d is a schematic diagram of a sharing display interface provided in the embodiment of the present application; referring to fig. 7c and 7d, if the target music is played in the third display mode, the display interface 550 shown in fig. 7c may be displayed, the display interface 550 may display a play scoring window, and show the scoring condition of the system for the play, if the user clicks the end of the play scoring window, the sharing display interface 600 shown in fig. 7d may be displayed, so that the user may share the recorded exercise video and display the sharing to the window, a platform and a copy connection option available for sharing may be displayed through the sharing to the window, and by obtaining the selection of the user to the sharing to the window, the user may jump to the corresponding platform or copy the exercise video to the clipboard.

Of course, the control of the music display interface is not limited to the control shown in fig. 3, and in other embodiments, there may be other controls, and there may be a variety of methods for jumping from the first display mode to the third display mode, for example, the display interface 450 is cancelled, and the display interface 500 is directly displayed.

Fig. 8a is a schematic view of a display interface after repeated play by clicking according to an embodiment of the present application; referring to fig. 3 and 8a, if the repeat play 272 in fig. 3 is clicked, a display interface 620 shown in fig. 8a can be displayed, a paragraph that the user wants to practice repeatedly can be highlighted in the music score display area by the selection of the user, and a "repeat" character is marked in front of and behind the paragraph, such as the first two music score lines in fig. 8a, and after the play of the paragraph is completed, the paragraph can be automatically replayed so that the user can practice the paragraph repeatedly, so as to learn playing fingering quickly.

Fig. 8b is a schematic view of a display interface after the play speed is clicked according to the embodiment of the present application; referring to fig. 3 and 8b, if the play speed 273 in fig. 3 is clicked, the display interface 640 shown in fig. 8b may be displayed, and selectable play speeds, such as 1.0, 0.75, 0.5, 0.25, etc., are provided, so that the user may select a desired play speed, and after selecting a play speed, the moving speed of the identification information and the speed of the entire fingering display may be adjusted accordingly, so that the user may autonomously select a play speed according to proficiency, which may help the user to quickly learn fingering, and is very friendly to beginners.

FIG. 8c is a schematic diagram of a display interface after the instrument is switched by clicking according to an embodiment of the present application; referring to fig. 3 and 8c, if the switching musical instrument 275 in fig. 3 is clicked, the display interface 660 shown in fig. 8c can be displayed, and an optional switching musical instrument, such as a guitar, a violin, a piano, a ukulele, etc., is provided, for example, when a guitar is selected, the musical score in the musical score display area can be adjusted accordingly, so that the musical score is changed from a staff to a staff, and the fingering display area can also be changed from fingering displaying a piano to fingering displaying a guitar, so that the user can autonomously switch musical instruments during the learning process, and the user experience is improved.

In the above, the piano is taken as an example to represent the keyboard instrument in the target instrument, and the method for displaying the music display interface of the guitar is taken as an example to represent the stringed instrument in the target instrument, and the method for displaying the music display interface of the guitar is briefly described below.

FIG. 9a is another schematic diagram of a music presentation interface according to an embodiment of the present application; FIG. 9b is a schematic view of a second display mode provided by the embodiments of the present application; FIG. 9c is a schematic diagram of the fingering display area in FIG. 9 a. For clarity of illustration, an enlarged view of the gesture presentation area is shown in FIG. 9 c. Referring to fig. 9a to 9c, the music display interface 700 may include a music score display area 710 and a fingering display area 720. The score presentation area 710 presents a six-line spectrum with the target music. If a performance start instruction is obtained, at this time, the music score display area 710 starts to display the identification information 711, and the fingering display area 220 may start to display the fingering corresponding to the current syllable.

Fig. 9a shows a display interface which may be the first display mode under the guitar, and if the novice mode 771 in the music display interface 700 is clicked, the display interface 760 of the second mode shown in fig. 9b may be displayed, at which time, the fingering display area 720 is cancelled and the display area of the music score display area 710 is increased.

In addition, the fingering presentation area 220 may also include a virtual instrument area 721 and a gesture presentation area 723.

Fig. 9d is a left-hand fingering diagram of a guitar according to the embodiment of the present application, wherein EF and BC are half-tone relationships without pitch down or pitch up. As shown in fig. 9d, it can be understood that the fingering of the guitar is mainly performed on the left hand, therefore, the fingering display part is mainly performed on the left-hand fingering, the guitar comprises 6 strings (horizontal direction) and 19 frets (vertical direction), but for the convenience of playing, the guitar adopts the half tone step (#, b), and covers substantially all syllables in 0 to 4 frets, usually, only the commonly used playing part of the first 0 to 3 frets can be used as the playing control, and the 0 frets are empty strings and do not need to be pressed, so that the virtual musical instrument area 721 of the guitar has 6 rows and 3 columns in total, and 18 playing controls 721a are obtained. As shown in fig. 9c, 3 playing controls 721a for the first row, i.e., string 6, are shown.

When the first prompt for the current syllable is displayed in the virtual instrument area 721, two situations can be roughly divided, and if the current syllable corresponds to 0 fret, the first prompt 721b can highlight the line where the current playing control is located, for example, the first prompt 721b filled with vertical grid in the 6 th line in fig. 9c, where the first prompt 721b is a strip shape. If the current syllable is not 0, a first prompt message, for example, the first prompt message 721b with a circle in the 2 nd column of the 4 th row or the 2 nd column of the 5 th row in fig. 9c, can be presented at the corresponding current playing control. It is understood that the three first prompt messages 721b shown in fig. 9c do not normally appear at the same time, and fig. 9c is drawn in a single drawing for convenience of illustration.

Since the playing of the guitar relies primarily on the left four fingers, the hand graphic 723a in the gesture display region 723 may include only a left-hand graphic. The left-hand graphic may be presented with a second reminder information 723b.

In some embodiments, if the target musical instrument is a stringed musical instrument, i.e. a guitar, where multiple strings need to be played, the second prompt information 723b includes multiple prompt graphics respectively displayed at multiple fingers, the display format of each prompt graphic is different from the display format of the other prompt graphics, and the display format of the first prompt information at the current playing control is the same as the display format of the prompt graphics at the finger corresponding to the current playing control.

For example, the prompt graphics in the little finger can be filled in by oblique lines, the prompt graphics in the ring finger can be filled in by oblique grids, the prompt graphics in the middle finger can be not filled in, and the prompt graphics in the index finger can be filled in by dots. The corresponding first prompt message may also be filled in the same manner. Taking the first prompt information 721b in the 4 th row and the 2 nd column in fig. 9c as an example, it is filled with oblique lines, and the corresponding prompt graph is the second prompt information 723b at the little finger, which indicates that the playing control 721a at the position where the first prompt information needs to be played with the little finger. In this way, the playing position and the playing finger of the current syllable can be visually displayed.

Fig. 9e is another schematic diagram of first status prompt information provided in an embodiment of the present application; referring to fig. 9e, when it is detected that the current playing input information does not match the current syllable, the first state prompt information 740 may be displayed in the fingering display area 720, and for the position of the playing control where the current playing input information can be acquired, the first state prompt information may be displayed at the position of the wrong playing control, and if the position of the wrong playing control cannot be acquired, the first state prompt information 740 may be displayed at any position.

Fig. 9f is another schematic diagram of second status prompt information provided in the embodiment of the present application; referring to fig. 9f, when it is detected that the current playing input information coincides with the current syllable, a second state prompt information 750 may be displayed in the fingering display area 720, and the second state prompt information 750 may be displayed at the current playing control displayed by the first prompt information 221b, but may be displayed at other positions in other embodiments.

In addition, position identification information can be displayed at the current playing control to indicate the position sequence number of the finger used for playing the current playing control in the palm. In some embodiments, the score display area 710 may further have first information or second information to visually display the historical playing states of the symbols of the respective scores in the score, the first information indicating that the playing is wrong, and the second information indicating that the playing is correct.

The display contents and switching modes of the UI layers of the display interfaces in method 100 are shown in the above for piano and guitar, respectively, and the following description will be given with reference to the method for generating the logical layer of the display interface.

Fig. 10 is a flowchart of a music score displaying method according to an embodiment of the present application; referring to fig. 10, in one embodiment, the music score display method can be roughly divided into an interface display UI layer and a logic layer, after the target music is selected in step 31, step 36 of requesting and parsing data of the target music can be executed, music data of step 38 can be generated, the music data refers to related data parsed from the target music based on a data format that can be read and used by the electronic device, and after the target musical instrument is selected in step 37, the virtual musical instrument loading area of step 32 is executed. In addition, after the music data is generated, step 33 may be executed to load the music score, that is, a corresponding music score is generated according to the music data in the music score display area, after the performance starting instruction is obtained, step 34 may be executed to load the identification information in the music score display area, and step 35 may be executed to load the playing fingering in the fingering display area.

In some embodiments, in generating the virtual instrument region, the method 100 further comprises: acquiring size information of a virtual instrument region; determining the size information of each playing control and the arrangement mode of the playing controls in the virtual musical instrument area based on the arrangement rule of the playing parts in the target musical instrument and the size information of the virtual musical instrument area; and showing a plurality of playing controls in the virtual instrument area.

Referring to fig. 3 and 5b, the size information of the virtual instrument region 221 may include a length size along a first direction (up-down direction) and a width size along a second direction (left-right direction), the length size may be set according to requirements, and the width size may be a width size of the music display interface 200. The arrangement rule of the playing parts in the target musical instrument can be the arrangement position relationship and the size relationship of each playing part, the arrangement mode of the playing controls in the virtual musical instrument area can be the same as the arrangement rule of the playing parts in the target musical instrument, the playing controls can be displayed in the virtual musical instrument area 221 according to a certain proportion, and the playing parts correspond to the playing controls 221a one to one, so that the drawing generation of the virtual musical instrument area is realized.

In some embodiments, to implement the presentation of the first prompt message, the method 100 may further include: generating a number series set comprising a plurality of syllable data based on the corresponding relation between the playing control and the syllables, wherein the arrangement mode of the syllable data corresponds to the arrangement mode of the playing control in the virtual musical instrument area, the syllable data is used for representing the syllables corresponding to the playing control, and the coordinate information of the syllable data in the number series set is used for representing the position coordinate of the playing control in the virtual musical instrument area; the displaying of the first prompt information at the current playing control corresponding to the current syllable in the above steps includes: searching syllable data corresponding to the current syllable in the array set; determining coordinate information of syllable data in the array set; determining a current playing control corresponding to the coordinate information in the virtual instrument region based on the coordinate information; and displaying the first prompt message at the current playing control.

It will be appreciated that each of the play controls may have a corresponding syllable that can be uttered, and that the play controls and corresponding syllables for each instrument may constitute a set of columns, which may be referred to as syllable data in the set of columns, which may be one-dimensional, two-dimensional, etc. The array set comprises a plurality of syllable data, each syllable data has coordinate information in the array set, and the coordinate information is used for representing the position coordinate of the corresponding playing control in the virtual instrument area. It will be appreciated that the number of syllable data may be the same as the number of playing controls, based on the type of instrument, such as guitar. Or the number of syllable data may be smaller than the number of playing controls, for example, the number of syllable data in the piano may be the same as the number of white keys, of course, the number of syllable data in the piano may also be the same as the sum of black and white keys.

By finding syllable data corresponding to the current syllable in the sequence set, coordinate information of the syllable data in the sequence set can be determined, and the position of the current playing control in the virtual instrument area can be determined based on the coordinate information, so that the display position of the first prompt message can be determined, and then the first prompt message can be displayed at the position.

In some embodiments, the searching of syllable data corresponding to the current syllable in the sequence set in the above steps may include: acquiring syllable attribute information of a current syllable; generating syllable combination data based on syllable attribute information of the current syllable; syllable data that coincides with the syllable combination data is determined in the array set based on the syllable combination data. Wherein, if the target musical instrument is a keyboard musical instrument, the syllable attribute information includes scale information, tone information and half-scale information; if the target instrument is a stringed instrument, the syllable attribute information includes scale information and half-scale information.

It is understood that each syllable may include syllable attribute information, which may include scale information, tone information, and semi-scale information (e.g., piano) or scale information and tone information (e.g., guitar) depending on the kind of instrument. The scale information is the scale of a syllable, the tone information is the tone of a syllable, and the chromatic scale information may indicate whether the syllable is chromatic scale.

By parsing the current syllable, syllable attribute information can be obtained, syllable combination data of the current syllable can be determined by combining the syllable attribute information, and then the same syllable data as the syllable combination data can be found in the sequence set by the syllable combination data as syllable data corresponding to the current syllable.

The following describes a method of generating a virtual instrument region and first prompt information, using a piano and a guitar as examples.

Fig. 11a is a schematic view of white keys in a piano provided in an embodiment of the present application; fig. 11b is a block diagram illustrating the loading flow of the virtual instrument region of the piano according to the embodiment of the present application; referring to fig. 11a and 11b, in some embodiments, an E-version piano is taken as an example: the piano is divided into 52 white keys and 36 black keys, 88 keys in total. The musical scale information is divided into seven steps do, re, mi, fa, so, la and si, the tone information is divided into 9 groups from low to high, the leftmost two (la and si) are one group, the rightmost one (do) is one group, the middle 49 pieces are each 7 groups, the total number can be divided into 2+ 7+1=52 steps, namely the playing control corresponding to the white key, and the black key gear is the front half or the back half of a certain white key. When the piano score data (score version, e.g., E-tune, C-tune, etc.) is acquired in step 40, step 41 and step 42 are performed simultaneously. It will be appreciated that the musical score version may also be selected on the display interface shown in fig. 4.

Step 41 may acquire a display interface width (height in the practice mode)/52 based on the current mode being the novice mode, determine a white key width, and draw white keys, and then between white keys 1-2, 3-4, 4-5, 6-7, 7-8 \8230onthe basis of black key positions, may execute step 43 to draw black keys between white keys.

Step 42, after analyzing the piano score data, a number array set under the piano can be constructed, and the arrangement mode of syllable data in the number array set is as follows: syllable data corresponding to white keys may be arranged based on scale information and tone information, do, re, mi, fa, so, la, si are represented by C/C, D/D, E/E, F/F, G/G, a/a, B/B, respectively, and tone grouping numbers are 2, 1, 0, 1, 2, 3, 4, 5, respectively, from left to right, so the distribution of syllable data of white keys from left to right is shown in fig. 11 a. The black keys are chromatic scales (#, b), syllable data of the black keys may be inserted between adjacent white keys, for example, C1 denotes a third white key, D1 denotes a fourth white key, syllable data of the black keys therebetween may be denoted as C1#, D1b, C denotes a seventeenth white key, D denotes an eighteenth white key, and syllable data of the black keys therebetween may be denoted as C #, db. The syllable data of the black key and the white key may be arranged from left to right in sequence to form a series set, and the coordinate information thereof may be 1 to 88 in sequence. And the position coordinates of 88 key regions (including black and white keys) drawn by the virtual instrument region also correspond to 1-88.

With continued reference to fig. 11b, after the performance is started, the step 44 of obtaining scale information and the step 45 of obtaining tone information may be performed based on the current syllable, then the step 46 of combining the scale information and the tone information may be performed, then it may be determined whether the current syllable is half-scale information based on the step 47, if the current syllable is half-scale information, the data generated in the step 46 may be combined with the half-scale (#, b) to generate syllable combination data, then based on the sequence set, the coordinate information of the black key consistent with the syllable combination data is determined, for example, the coordinate information of the syllable data C1#, is 5, and then the position coordinate of the black key in the virtual instrument region is also determined to be 5, and then the step 48 of presenting the first prompt information at the 5 th key region of the virtual instrument region, that is, the black key, is performed. Similarly, if the virtual musical instrument is not a chromatic scale, for example, the syllable data C1 has coordinate information of 4, step 49 may be executed to display the first prompt information at the 4 th position key region of the virtual musical instrument region, i.e. the white key.

FIG. 12a is a schematic diagram of a two-dimensional array generated based on FIG. 9 d; FIG. 12b is a block diagram illustrating the loading flow of the virtual instrument area of a guitar according to an embodiment of the present application; referring to fig. 12a and 12b, in some embodiments, taking an E-tune version of guitar as an example, since the virtual instrument area only shows the top 4 (0 to 3) frets, and the 0 frets are empty strings and do not need to be pressed, the two-dimensional array set of guitars can be made up of the 2 nd to 5 th columns in the array shown in fig. 12 a.

As shown in fig. 12b, after step 50 retrieves guitar score data (e.g., E-tune, C-tune, etc.) steps 51a and 54 may be performed.

Step 51a can determine whether the mode is the practice mode, if the mode can be executed, step 52a is to acquire the height of the display interface as the guitar width, the height is calculated according to the ratio of 42. Alternatively, if the mode is not the novice mode, step 52c may be performed without displaying the fingering display area.

Step 54 may construct a two-dimensional array set under the guitar, and if the performance starts, the scale information and the tone information may be obtained based on the current syllable, and the two are combined to generate syllable combination data, and then the syllable data identical to the syllable combination data is searched in the array set. Then, step 55 may be executed to determine the abscissa of the syllable data corresponding to the current syllable in the sequence set, that is, to determine the row of the first prompt information, step 56 may be executed to determine whether the current syllable is 0, if yes, the row of the playing control corresponding to 0 is determined, step 57 is executed to display the first prompt information in the row (the lowermost first prompt information 721b in fig. 9C), if not, step 58 may be executed to compare the syllable attribute information (C, D, F, # -..), that is, to determine the position coordinate of the playing control corresponding to the ordinate of the syllable data, step 59 is executed to determine the display format of the first prompt information based on the suggested fingering method (fig. 9D), and the first prompt information is displayed in the display format (the first prompt information 721b indicated by a circle in fig. 9D).

In some embodiments, the third prompting message in fig. 5b can be generated by the following method, and the method 100 can further include: and generating a prompt message list based on the target music, wherein the prompt message list comprises a plurality of sub prompt messages arranged according to a preset rule, and each sub prompt message corresponds to one syllable in the target music. Before the fingering scroll area displays the third prompt message including a plurality of sub prompt messages in the above steps, the method 100 may further include: determining the current fingering display duration based on the current time and the receiving time of the playing start instruction; and determining a plurality of sub prompt messages forming third prompt message from the prompt message list based on the current fingering display duration, the preset speed and the length size of the fingering rolling area along the first direction.

The cue information list may include all sub cue information that the whole song needs to show. The sub-prompt messages are arranged according to a preset rule, and the preset rule can include the front and back time arrangement sequence of the sub-prompt messages and the position information of the playing controls corresponding to the sub-prompt messages. And the time arrangement sequence of all the sub-prompt messages respectively corresponds to the time arrangement sequence of syllables in the target music.

When the third prompt message is displayed, the current time may be obtained first, and then the reception time of the performance start instruction is subtracted to calculate the current fingering display duration. Then, according to the current fingering display duration, a first position of sub-prompt information corresponding to the current syllable in a prompt information list is determined, then, the length size of a fingering rolling area along the first direction is divided by a preset speed to obtain a display time interval, then, all syllables which are behind the current syllable and in the display time interval are obtained, a second position of the corresponding sub-prompt information in the prompt information list is determined according to the last syllable, then, third prompt information formed by all sub-prompt information between the first position and the second position can be determined, and therefore the third prompt information can be displayed.

Fig. 13 is a block diagram illustrating a loading process of a fingering display area according to an embodiment of the present disclosure; referring to fig. 13, in some embodiments, after determining the target music, step 60 may be executed to load music data, and then step 61 may be executed to determine whether the target music is in the novice mode, if not, step 62a is executed to hide the fingering exhibition area, if yes, step 62b is executed to parse the music data, and after determining the target musical instrument through step 63a, step 64 may be executed to load the playing control of the virtual musical instrument.

In addition, after the step 62b, a step 63b of parsing the cue information list may be executed, and then after the performance is started, a step 65 of scrolling the cue information list according to rhythm may be executed, that is, sequentially displaying a plurality of sub cue information in the fingering scroll area. And after the performance is completed, step 66 may be executed to end the scrolling, i.e. to not present any further sub-cues.

In addition, after the performance is started, the current playing input information can be acquired through the external musical instrument or audio acquisition input in step 70, then the current playing input information is analyzed in step 71, then step 67 is executed to compare the current syllable with the current playing input information, step 68 is executed to judge whether the current syllable and the current playing input information are consistent, and if not, step 69 can be executed to display the first state prompt information.

In some embodiments, the music presentation of the music presentation region may be implemented by the following method, and the method 100 may further include: generating a score including M score lines based on the target music and size information of a score display area, each score line including a plurality of score symbols, each score symbol corresponding to a syllable in the target music, wherein M is a natural number; determining N music score lines currently displayed in a music score display area and target positions of music score symbols corresponding to current syllables in the N music score lines based on the current fingering display duration, wherein N is a natural number and is less than or equal to M; and displaying the N music score rows in the music score display area. The presenting of the identification information indicating the current syllable of the target music in the score presentation area in the above step S120 may include: the identification information is presented at the target location.

Wherein a corresponding score of the target music may be generated based on the target music, the score may include a plurality of score symbols, and the score symbols may correspond to syllables of the target music. And the music score can be changed according to the width size of the music score display area to form M music score lines.

According to the current fingering display duration, the score line where the score symbol corresponding to the current syllable is located and the target position of the score symbol in the score line can be determined. It can be understood that, since the length size of the music score display area is limited, only N music score lines may be displayed in M music score lines, and the N music score lines may be updated with time, the N music score lines capable of being displayed in the area may be determined according to the current fingering display duration. In the method, the score line where the current syllable is positioned can be always displayed in the score display area.

Fig. 14 is a block diagram illustrating a loading process of a music score display area according to an embodiment of the present application; referring to fig. 14, in some embodiments, the score presentation area may include a background area of the score line list and an interactive area superimposed on the background area, the interactive area may be a transparent area before the performance starts, and size information of the background area, the interactive area, and the score presentation area may be consistent.

Taking the display of the score display area in the music display interface in step S110 as an example, after the music data is loaded in step S80, a corresponding score line list may be generated based on the target instrument, and the score line list may include N score lines to be displayed. Meanwhile, step 81 may be performed to load the staff in the background area, and step 82 is performed to obtain the rendering size, that is, the size information of the staff area, which may be the size information of the interaction area, and therefore, the size information of the interaction area may be calculated.

When constructing the score list and calculating the interaction area, step 83 may be executed to determine whether the loading of the score line list is completed, i.e., whether the score line list is completely drawn on the staff, if so, step 84UI initialization is completed, otherwise, step 83 is continuously executed until step 84 is completed. In addition, after the performance start instruction is acquired, the identification information and the highlight floating layer may be drawn in the interactive area.

FIG. 15 is a block diagram illustrating a loading process of an exercise mode provided by an embodiment of the present application; referring to fig. 15, in a third display mode, such as a practice mode, the music score display area may include a horizontal sliding area and an interaction area disposed on the horizontal sliding area. And the interactive area may be a transparent area before the performance starts.

The horizontal sliding area is consistent with the size information of the music score display area, and the music score symbols in the horizontal sliding area can be horizontally slid, so that the current syllable is always displayed in the music score display area.

Step 90 may be executed to load music data after the target music is selected, then step 91 is executed to determine whether the practice mode is adopted, and if not, step 92 is executed to enter the novice mode, which may be specifically referred to the flow shown in fig. 13. If yes, step 93 is executed to draw a fingering display area and step 94 is executed to load a staff, wherein step 93 is similar to the loading of the fingering display area in fig. 13, which is not repeated herein. Step 94 may be followed by step 95 of parsing the music data to generate a score, and since the practice mode only presents one line of the score line, step 96 of parsing the score in measure (i.e. obtaining a plurality of score symbols presented) and rendering the parsed data to a laterally sliding region may be performed.

In addition, step 95 may be followed by step 97 of parsing the identification information and drawing to the interactive region, and then step 98 of overlaying the interactive region and the horizontal sliding region to form a music score display region may be performed.

It is understood that the embodiments of the present application are described with guitar for stringed instruments and piano for keyboard instruments, but the embodiments of the two can be replaced or combined with each other and can be adaptively adjusted according to the types of instruments.

In order to better implement the music score displaying method according to the embodiment of the present application, a music score displaying apparatus is further provided according to the embodiment of the present application, please refer to fig. 16, and fig. 16 is a schematic structural diagram of the music score displaying apparatus according to the embodiment of the present application. The music score presentation apparatus 800 may include the following units.

A display unit 801, configured to display, in response to a selection instruction for a target music and a target musical instrument, a music presentation interface corresponding to the target musical instrument, where the music presentation interface includes: a music score display area and a fingering display area.

A presentation unit 802 for presenting, in response to a performance start instruction, identification information indicating a current syllable of the target music in the score presentation area and presenting fingering information for playing the current syllable in the fingering presentation area.

In some embodiments, the fingered display area comprises: a virtual instrument region including a plurality of play controls corresponding to the plurality of play parts of the target instrument, respectively; the prompt unit 802, when being configured to present fingering information for playing the current syllable in the fingering presentation area, is further configured to present first prompt information at the current playing control corresponding to the current syllable, the first prompt information being used to prompt the operation of the current playing part corresponding to the current playing control in the target musical instrument using the object.

In some embodiments, the fingering presentation area further includes a gesture presentation area provided with a hand graphic, and the prompt unit 802, when being configured to present fingering information for playing the current syllable in the fingering presentation area, is further configured to present second prompt information in the hand graphic, the second prompt information being configured to prompt a position of a finger that operates the current playing part using the object.

In some embodiments, the apparatus 800 further comprises: a first unit, configured to, in response to that the current playing input information of the usage object does not coincide with the current syllable, present first state prompt information in the fingering presentation area, the first state prompt information being used to indicate that the playing state of the current syllable by the usage object is an error state.

In some embodiments, the apparatus 800 further comprises: and a second unit for presenting second state prompt information in the fingering presentation area in response to the current playing input information coinciding with the current syllable, the second state prompt information indicating that the playing state of the current syllable using the object is the correct state.

In some embodiments, the score in the score presentation area comprises a plurality of score symbols, each score symbol corresponding to a syllable in the target music, the apparatus 800 further comprising: a third unit for presenting the first information at a score symbol corresponding to the current syllable in response to the current playing input information not coinciding with the current syllable; in response to the current playing input information coinciding with the current syllable, second information is presented at the score symbol corresponding to the current syllable.

In some embodiments, the prompting unit 802, when being configured to present the fingering information for playing the current syllable in the fingering presentation area, is further configured to present, at the current playing control, the position identification information of the finger for playing the current syllable, the position identification information being a position number of the finger in the palm.

In some embodiments, if the target musical instrument is a keyboard musical instrument, the fingering display area further includes: a fingering scroll area; the prompt unit 802 is further configured to display a third prompt message including a plurality of sub prompt messages in the fingering scroll area when the prompt unit is configured to display the fingering information for playing the current syllable in the fingering display area, and the plurality of sub prompt messages are respectively used for prompting the playing position and the playing time of the plurality of syllables after the current syllable.

In some embodiments, the prompt unit 802, when being configured to display the third prompt information including a plurality of sub prompt information in the fingering scroll area, is further configured to display the sub prompt information corresponding to the syllable in the fingering scroll area in response to that a time interval between the syllable in the target music and the current syllable is less than or equal to a preset time interval, wherein the sub prompt information is located at one end of the playing control corresponding to the syllable along the first direction, and the sub prompt information moves towards the playing control along the first direction at a preset speed; the prompting unit 802 is further configured to cancel displaying the sub-prompt information in response to the sub-prompt information moving to the playing control when being configured to display the first prompt information at the current playing control corresponding to the current syllable, take the playing control as the current playing control, and display the first prompt information at the current playing control.

In some embodiments, if the target musical instrument is a keyboard musical instrument, the first prompt message includes a left-hand prompt message and a right-hand prompt message, and a display format of the left-hand prompt message is different from a display format of the right-hand prompt message.

In some embodiments, if the target musical instrument is a keyboard musical instrument, the second cue information is displayed at the finger for playing the current syllable; if the target musical instrument is a stringed instrument, the second prompt message comprises a plurality of prompt graphics respectively displayed at a plurality of fingers, the display format of each prompt graphic is different from the display formats of other prompt graphics, and the display format of the first prompt message at the current playing control is the same as the display format of the prompt graphics at the finger corresponding to the current playing control.

In some embodiments, the display unit 801, when being configured to display the music presentation interface corresponding to the target instrument, is further configured to display the music presentation interface in response to the first operation instruction of the first presentation mode, and the music score presentation area and the fingering presentation area are arranged along the first direction.

In some embodiments, with the dimension along the first direction being the length dimension, the apparatus 800 further comprises: and a fourth unit, configured to cancel the display of the fingering display area and adjust the display size of the score display area in response to a second operation instruction for the second display mode, so that the length size of the adjusted score display area is equal to the sum of the length sizes of the score display area and the fingering display area in the first display mode.

In some embodiments, the apparatus 800 further comprises: and a fifth unit for adjusting the display direction and the display size of the score display area and the fingering display area in response to a third operation instruction for a third display mode, so that the adjusted score display area and the adjusted fingering display area are arranged along a second direction, wherein the second direction is perpendicular to the first direction.

In some embodiments, the apparatus 800 further comprises: a sixth unit for acquiring size information of the virtual instrument region; determining the size information of each playing control and the arrangement mode of the playing controls in the virtual musical instrument area based on the arrangement rule of the playing parts in the target musical instrument and the size information of the virtual musical instrument area; and displaying a plurality of playing controls in the virtual instrument area.

In some embodiments, the apparatus 800 further comprises: a seventh unit, configured to generate a sequence set including a plurality of syllable data based on a corresponding relationship between the playing control and the syllables, where an arrangement manner of the syllable data corresponds to an arrangement manner of the playing control in the virtual instrument region, the syllable data is used to represent the syllable corresponding to the playing control, and coordinate information of the syllable data in the sequence set is used to represent a position coordinate of the playing control in the virtual instrument region; the prompt unit 802, when configured to present the first prompt information at the current playing control corresponding to the current syllable, is further configured to search the sequence set for syllable data corresponding to the current syllable; determining coordinate information of syllable data in the array set; determining a current playing control corresponding to the coordinate information in the virtual musical instrument region based on the coordinate information; and displaying the first prompt message at the current playing control.

In some embodiments, the prompting unit 802, when being configured to search the sequence set for syllable data corresponding to the current syllable, is further configured to obtain syllable attribute information of the current syllable; generating syllable combination data based on syllable attribute information of the current syllable; determining syllable data in accordance with the syllable combination data in the sequence set based on the syllable combination data; wherein, if the target musical instrument is a keyboard musical instrument, the syllable attribute information comprises scale information, tone information and half-scale information; if the target instrument is a stringed instrument, the syllable attribute information includes scale information and half-scale information.

In some embodiments, the apparatus 800 further comprises: an eighth unit configured to generate a cue information list based on the target music, the cue information list including a plurality of sub cue information arranged in a preset rule, each sub cue information corresponding to one syllable in the target music;

before the prompting unit 802 is configured to present the third prompting message including a plurality of sub-prompting messages in the fingering scroll area, the apparatus 800 further includes: a ninth unit, configured to determine a current fingering display duration based on the current time and a reception time of the performance start instruction; and determining a plurality of sub prompt messages forming third prompt message from the prompt message list based on the current fingering display duration, the preset speed and the length size of the fingering rolling area along the first direction.

In some embodiments, the apparatus 800 further comprises: a tenth unit, configured to generate a score including M score lines based on the target music and size information of a score display area, where each score line includes a plurality of score symbols, each score symbol corresponds to a syllable of the target music, and M is a natural number; determining N music score lines currently displayed in a music score display area and target positions of music score symbols corresponding to current syllables in the N music score lines based on the current fingering display duration, wherein N is a natural number and is less than or equal to M; displaying N music score rows in a music score display area; the prompting unit 802, when being configured to present the identification information indicating the current syllable of the target music at the score presentation area, is further configured to present the identification information at the target position.

The music score displaying apparatus 800 is implemented in the same way as the music score displaying method, and reference may be made to the above embodiments.

In some embodiments, the present application further provides an electronic device comprising: a processor; and a memory for storing executable instructions for the processor; wherein the processor is configured to perform the method implementing any of the embodiments described above via execution of the executable instructions.

Fig. 17 is a schematic structural diagram of an electronic device according to an embodiment of the present application, where the electronic device 900 may be the terminal or the server shown in fig. 1. As shown in fig. 17, the electronic device 900 may include: a communication interface 901, a memory 902, a processor 903, and a communication bus 904. The communication interface 901, the memory 902 and the processor 903 are communicated with each other through a communication bus 904. The communication interface 901 is used for the electronic apparatus 900 to perform data communication with an external apparatus. The memory 902 may be used for storing software programs and modules, and the processor 903 may operate the software programs and modules stored in the memory 902, for example, the software programs of the corresponding operations in the above-described method embodiments.

In some embodiments, the processor 903 may invoke software programs and modules stored in the memory 902 to perform the following operations: responding to the selection instruction aiming at the target music and the target musical instrument, and displaying a music display interface corresponding to the target musical instrument, wherein the music display interface comprises: a music score display area and a fingering display area; in response to a performance start instruction, identification information indicating a current syllable of target music is presented in a score presentation area, and fingering information for playing the current syllable is presented in a fingering presentation area.

The present application also provides a computer-readable storage medium, in which a computer program is stored, which, when executed by a processor, implements the method of any of the above embodiments. For brevity, no further description is provided herein.

The present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the method of any of the embodiments described above. For brevity, no further description is provided herein.

The present application also provides a computer program comprising computer instructions stored in a computer readable storage medium. The processor of the electronic device reads the computer instruction from the computer-readable storage medium, and executes the computer instruction, so that the electronic device executes corresponding processes in the methods in the embodiment of the present application, which is not described herein again for brevity.

It should be understood that the processor of the embodiments of the present application may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method embodiments may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, or discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and combines hardware thereof to complete the steps of the method.

It will be appreciated that the memory in the embodiments of the subject application can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. The volatile Memory may be a Random Access Memory (RAM) which serves as an external cache. By way of example, and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double Data Rate Synchronous Dynamic random access memory (DDR SDRAM), enhanced Synchronous SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer or a server) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk or an optical disk, and various media capable of storing program codes.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A music score presentation method, comprising:

responding to a selection instruction for target music and a target musical instrument, and displaying a music display interface corresponding to the target musical instrument, wherein the music display interface comprises: a music score display area and a fingering display area;

in response to a performance start instruction, displaying identification information indicating a current syllable of the target music in the score display area, and displaying fingering information for playing the current syllable in the fingering display area.

2. The method of claim 1, wherein the fingering display area comprises: a virtual instrument region including a plurality of playing controls corresponding to a plurality of playing parts of the target instrument, respectively;

the displaying of the fingering information for playing the current syllable in the fingering display area includes:

displaying first prompt information at a current playing control corresponding to the current syllable, the first prompt information being used for prompting a user to operate a current playing part corresponding to the current playing control in the target musical instrument.

3. The method according to claim 2, wherein the fingering presentation area further comprises a gesture presentation area provided with a hand graphic, the presentation of fingering information for playing the current syllable in the fingering presentation area further comprising:

and displaying second prompt information in the hand graph, wherein the second prompt information is used for prompting the position of the finger of the current playing part operated by the using object.

4. The method of claim 2, further comprising:

in response to that the current playing input information of the using object does not accord with the current syllable, displaying first state prompt information in the fingering display area, wherein the first state prompt information is used for indicating that the playing state of the using object on the current syllable is an error state.

5. The method of claim 4, further comprising:

in response to the current playing input information corresponding to the current syllable, displaying second state prompt information in the fingering display area, wherein the second state prompt information is used for indicating that the playing state of the current syllable by the use object is the correct state.

6. The method of claim 5, wherein the score in the score presentation area comprises a plurality of score symbols, each score symbol corresponding to a syllable in the target music, the method further comprising:

in response to the current playing input information not corresponding to the current syllable, presenting first information at the score symbol corresponding to the current syllable;

presenting second information at the score symbol corresponding to the current syllable in response to the current playing input information coinciding with the current syllable.

7. A music score presentation device, comprising:

the display unit is used for responding to a selection instruction aiming at target music and a target musical instrument and displaying a music display interface corresponding to the target musical instrument, wherein the music display interface comprises: a music score display area and a fingering display area;

and the prompting unit is used for responding to a performance starting instruction, displaying identification information used for indicating the current syllable of the target music in the music score display area, and displaying fingering information used for playing the current syllable in the fingering display area.

8. An electronic device, comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the method of any of claims 1-6 via execution of the executable instructions.

9. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, implements the method of any one of claims 1-6.

10. A computer program product comprising a computer program, characterized in that the computer program realizes the method of any of claims 1-6 when executed by a processor.