CN113963601A

CN113963601A - Rhythm video-song visualization method, system and device

Info

Publication number: CN113963601A
Application number: CN202111230129.8A
Authority: CN
Inventors: 冯毅; 尹一笑; 曹邱晴
Original assignee: Changhua Technology Nanjing Co ltd
Current assignee: Changhua Technology Nanjing Co ltd
Priority date: 2021-10-22
Filing date: 2021-10-22
Publication date: 2022-01-21
Anticipated expiration: 2041-10-22
Also published as: CN113963601B; CN116631264A

Abstract

The invention relates to the technical field of music auxiliary teaching, and discloses a rhythm visual and singing visualization method, system and device, which comprise the following steps: s1, inputting a beat number and a plurality of notes in sequence, and presetting a beat time value and reference loudness; s2, acquiring the beat number and the notes in sequence; s3, determining the strength of the beat according to the beat number, determining the strength of the rhythm according to the sequence of the notes, and synthesizing or calling corresponding audio according to the strength of the beat, the strength of the rhythm and the reference loudness; s4, determining information such as the position of the indicating module according to the beat number and the note information; and S5, controlling the indication module to move according to the track line, and controlling the sound generation module to generate sound synchronously with the audio. The beneficial effects are as follows: the rhythm content capable of performing autonomous video-song practice is enriched by arranging the note and beat unit modules capable of being freely combined and combining the acoustic model synthesis technology, and the personalized requirements of the user are met; through setting up visual module, reduced the degree of difficulty of looking singing rhythm exercise.

Description

Rhythm video-song visualization method, system and device

Technical Field

The invention relates to the technical field of music auxiliary teaching, in particular to a rhythm video and song visualization method, system and device.

Background

Rhythm is the general term of the length and strength of sound, and rhythm solo is the basic work of learning and reading a book. The reading has two main contents, namely intonation and rhythm. The purpose of rhythm singing is to master the note combinations of various durations and the strengths and speeds of different beats.

In music, time is divided into equal basic units, each unit being called a "beat" or simply "beat". The duration of the "beat" is represented by the duration of the notes, different notes correspond to different durations, and the duration of a beat can be a quarter note (i.e., a quarter note is taken as a beat), or a half note (a half note is taken as a beat) or an eighth note (an eighth note is taken as a beat). The duration of a beat is a relative notion of time, such as when the specified tempo of the music is 60 beats per minute, the time taken per beat is one second and half a beat is one second; when the prescribed speed is 120 beats per minute, the time per beat is half a second, half a beat is one quarter of a second, and so on. When the basic duration of the beat is determined, the notes of the various durations are associated with the beat. For example, when a quarter note is taken as one beat, a full note is equivalent to four beats, a half note is equivalent to two beats, an eighth note is equivalent to half beats, and a sixteenth note is equivalent to one quarter beats; if the eighth note is taken as one beat, the full note is equivalent to eight beats, the half note is four beats, the quarter note is two beats, and the sixteenth note is half beats.

In rhythm solo, practice is usually carried out by a beating method, namely, one stroke and one motion of hands or feet are taken as one beat, the press value of each note pronounces 'Da' or a certain pronunciation along with the beating motion, and the pronunciation and the motion of the 'Da' character are required to be kept uniform and stable.

In the conventional rhythm solo training, taking the illustration shown in fig. 1 as an example, the first row of fig. 1 represents the serial number of the note by arabic numerals, the second row represents a section of rhythm, which is composed of a beat number and notes and divided by bar space lines, and 2/4 of the second row represents the beat number, which represents different music beats, and emphasizes the combination rule of strong beats and weak beats, specifically, the total length of the notes of each bar in the music score is specified, 2/4 represents a quarter note as one beat, and one bar has two beats, commonly 1/4 beats, 2/4 beats, 3/4 beats, 4/4 beats, 3/8 beats, 6/8 beats, 7/8 beats, 9/8 beats, 12/8 beats and the like. The third row represents the beating rule of the corresponding note, and the fourth row represents the articulation strength relationship of the note. In fig. 1, the note indicates the length of the sound, and the length and strength of the corresponding rhythm sound can be clearly determined by combining the beat number. However, it can be seen from fig. 1 that even though the notes have the same duration, the corresponding sound intensities of the notes are different due to different time stamps or different positions in the measure. The common pronunciation strength rules are shown in table 1.

When the solo rhythm teaching exercise is carried out, students mainly control the sound length and the strength of each note in continuous rhythmic solo, familiarize and determine the strength and the strength of the note according to the beat number and the note, and send out the sound of 'Da, Da … …' or '1, 2, 3 … …' or the like to represent each note. For a beginner, it is difficult to accurately control the pronunciation time and strength of each note in the rhythm, a common teacher can perform solo pronunciation demonstration, and move up and down with hands, indicate the pronunciation position of each note in the time domain with the spatial position of the hands, and through synchronous demonstration of vision and hearing, the beginner can learn the music rhythm more easily.

When a student with rhythm solo, particularly a child or an infant, performs solo rhythm exercise, a teacher generally demonstrates the exercise, or watches videos, or performs the exercise through an auxiliary metronome. The metronome on the market sets related parameters through a plurality of buttons, and the setting is complex for children and is not easy to use; on the other hand, the metronome cannot completely demonstrate the rhythm of the note combination set by the metronome, and is often in a plurality of fixed modes; in three aspects, the metronome generally segments the beat fixedly and then sounds, and its display portion is also segmented and discrete, and cannot indicate the sounding position of each note in the time domain by the continuously changing spatial position of the hand as in the case of a teacher.

Disclosure of Invention

As known from the background art, for the rhythmic solo beginners, especially for children or infants, the conventional metronome has complex operation and single mode, and cannot reflect the strength relationship and continuous change of notes in real time. In order to overcome the technical problems in the prior art, the invention provides a rhythm video and song visualization method, system and device, and the specific technical scheme is as follows:

a rhythm visual singing visualization method comprises the following steps: s1, inputting a beat number and a plurality of notes in sequence, and presetting a beat time value and reference loudness; s2, acquiring the beat number and the notes in sequence; s3, determining the strength of the beat according to the beat number, determining the strength of the rhythm according to the sequence of the notes, and synthesizing or calling corresponding audio according to the strength of the beat, the strength of the rhythm and the reference loudness; s4, determining the position information of the corresponding time point indicating module according to the beat number, the plurality of notes input in sequence and the beat time value; determining a trajectory line indicating the movement of the module according to the position information; the trajectory line corresponds to the durations of the sequentially input plurality of notes; and S5, controlling the indication module to move according to the track line, and controlling the sound generation module to generate sound synchronously with the audio.

Further, in the S3, the retrieving of the corresponding audio means directly retrieving the stored original audio of the corresponding note and beat combination; and synthesizing the corresponding audio frequency refers to determining an acoustic model according to the strength of the beat, the strength of the rhythm and the reference loudness, and calling the original audio frequency corresponding to the single note according to the acoustic model to synthesize the continuous and smooth audio frequency.

Further, in S3, it is determined whether the current beat number and rhythm combination corresponding to the note belong to a high-frequency combination or a low-frequency combination; for high-frequency combination, directly calling corresponding audio; for low frequency combining, the corresponding audio is synthesized.

Further, the method comprises the following steps: s1, inputting a beat number and a plurality of notes in sequence at the terminal by a user, and presetting a beat time value and reference loudness; s2, the central processing unit sequentially obtains the beat number and the plurality of notes according to the sequence; s3, the CPU determines the sound intensity of each note according to the beat number, the plurality of notes and the reference loudness, and calls or synthesizes the corresponding audio; s4, the CPU determines the position information of the corresponding time point indication module according to the beat number, the plurality of notes input in sequence and the beat time value; determining a trajectory line indicating the movement of the module according to the position information; the trajectory line corresponds to the durations of the sequentially input plurality of notes; and S5, the central processing unit controls the indication module to continuously move at a constant speed according to the track line and controls the sound production module to produce sound according to the audio frequency.

Further, the method comprises the following steps: s1, splicing a first note card with beat information and a plurality of second note cards with notes or basic combined note information in sequence by a user, putting the spliced first note card and second note cards into a note card sensing area, and presetting a beat time value and reference loudness; s2, the note card sensing area sequentially acquires the beat number and the notes according to the sequence and converts the beat number and the notes to be transmitted to a central processing unit, and the central processing unit sequentially acquires the beat number and the notes according to the sequence; s3, the CPU determines the sound intensity of each note according to the beat number, the plurality of notes and the reference loudness, and calls or synthesizes the corresponding audio; s4, the CPU determines the position information of the corresponding time point indication module according to the beat number, the plurality of notes input in sequence and the beat time value; determining a trajectory line indicating the movement of the module according to the position information; the trajectory line corresponds to the durations of the sequentially input plurality of notes; and S5, the central processing unit controls the indication module to continuously move at a constant speed according to the track line and controls the sound production module to produce sound according to the audio frequency.

Further, the sizes of the first note card and the second note card are the same in S1; the note card sensing area is provided with a clamping groove, a groove or a magnet, and the first note card and the second note card are connected with the note card sensing area in a clamping manner, a concave-convex manner or a magnetic attraction manner; the method for acquiring the information of the first note card and the second note card by the note card sensing area is radio frequency chip sensing identification, image coding identification, coding hole identification, image content identification or multi-point touch identification.

Further, in S1, the user sequentially splices the first note card with the time information, the plurality of second note cards with the note duration, and the plurality of third note cards with the note pitch, puts the spliced first note card, second note card, and third note card into the note card sensing area, and presets the tempo duration and the reference loudness.

Further, the size of the second note card is proportional to the note duration correspondence on the second note card; the note card induction zone is provided with a plurality of, and the tone quality of every note card induction zone can set up as required.

Further, between S1 and S2, S11 is further included, and it is determined whether or not the bars corresponding to the time scale are included in the plurality of notes input, and if included, the process proceeds to S2, and if not included, the process returns to S1 to prompt an error.

A rhythm video and song visualization system comprises a terminal, a display and a display, wherein the terminal is used for inputting a beat number and musical notes; the communication module is used for being in communication connection with the terminal and the central processing unit respectively; the note cards are provided with time marks and notes; a memory, which stores the audio data corresponding to each note card, note card code, acoustic model, music rule and other information; the note card identification module is provided with a note card induction area and is used for identifying note cards placed in the note card induction area; the indication module is used for moving along the track to represent the time domain position of the note in real time; the sound emitting module is used for playing audio; the central processing unit is used for determining the sound intensity of each note according to the beat number, the plurality of notes and the reference loudness, and calling or synthesizing corresponding audio; determining the position information of the corresponding time point indicating module according to the beat number, a plurality of musical notes input in sequence and a beat time value; determining a trajectory line indicating the movement of the module according to the position information; the trajectory line corresponds to the durations of the sequentially input plurality of notes; and controlling the indication module to continuously move at a constant speed according to the trajectory line, and controlling the sound production module to produce sound according to the audio.

A rhythm video and song visualization device comprises the system and further comprises a click module or a sound pickup module, wherein the click module records user click operation and relevant time points, the sound pickup module records user sound production and relevant time points, and a central processing unit compares user click information and user sound production information with the sound production content of corresponding notes, calculates deviation and outputs results after processing.

The invention has the beneficial effects that: the invention greatly enriches the content of the video-song practice by arranging the freely combined note and beat unit modules and combining the acoustic model synthesis technology, thereby meeting the individual requirements of users; the convenience of using the note combination rhythm is improved by arranging the note cards capable of automatically identifying; the macroscopic note proportion line is drawn by correspondingly and proportionally marking the pronunciation duration of the note, then the indication module is controlled to continuously move along the note proportion line at a constant speed, and the sounding device is controlled to synchronously sound, so that the abstract music sounding process is simplified into visual linear motion, and the entrance difficulty of the rhythm solfeggio beginner is greatly reduced.

Drawings

Fig. 1 is a schematic diagram of a rhythm solo training element.

Fig. 2 is a flow chart of the method of the present invention.

FIG. 3 is a diagram of a first note card.

FIG. 4 is a diagram of a second note card.

Fig. 5 is a schematic diagram of a third token card.

Fig. 6 is a combination diagram of a first note card and a second note card.

Fig. 7 is a system block diagram of the present invention.

Fig. 8 is a schematic structural diagram of a first embodiment of the device of the present invention.

Fig. 9 is a schematic structural diagram of a second embodiment of the device of the present invention.

Fig. 10 is a schematic structural diagram of a third embodiment of the device of the present invention.

Fig. 11 is a schematic structural diagram of a fourth embodiment of the device of the present invention.

Fig. 12 is a block diagram of a fifth embodiment of the apparatus of the present invention.

Fig. 13 is a schematic structural diagram of a sixth embodiment of the device of the present invention.

Fig. 14(a) is a schematic structural diagram of a note card reading apparatus according to a seventh embodiment of the invention.

Fig. 14(B) is a schematic view of a first state of the rhythm visualization device according to the seventh embodiment of the present invention.

Fig. 14(C) is a second state diagram of the rhythm visualization device according to the seventh embodiment of the present invention.

Fig. 15 is a schematic view of the movement process of the indicating module of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In order to overcome the defects that a metronome in the prior art is complex in operation and single in mode and cannot reflect the strength relation of notes and the continuous change of the notes in real time, the rhythm solo visualization method, the rhythm solo visualization system and the rhythm solo visualization device are designed, the pronunciation duration of the notes is correspondingly scaled to form macroscopic note proportion lines, then the indication module is controlled to continuously move along the note proportion lines at a constant speed, and the sounding device is controlled to sound synchronously, so that the abstract music sounding process is simplified into visual linear motion, and the entry difficulty of a rhythm solo beginner is greatly reduced.

A rhythm solo visualization method is shown in fig. 2, S1, inputting a beat number and a plurality of notes in sequence, and presetting a beat time value and a reference loudness; s2, acquiring the beat number and the notes in sequence; s3, determining the strength of the beat according to the beat number, determining the strength of each note according to the sequence of the notes, and synthesizing corresponding audio according to the strength of the beat, the strength of the notes and the reference loudness; s4, determining the position information of the corresponding time point indicating module according to the beat number, the plurality of notes input in sequence and the beat time value; determining a trajectory line indicating movement of a module according to the position information, the trajectory line corresponding to a beat line of the sequentially input plurality of notes; the position of the indication module on the track line corresponds to the relative position of a single note on a beat line; and S5, controlling the indication module to move according to the track line, and controlling the sound production module to produce sound according to the audio.

Aiming at the characteristic of single mode of the conventional metronome, the rhythm solo visualization method provided by the invention mainly comprises the following two different methods according to different transmission modes of note information and beat information.

The first method comprises the following steps: 1. directly inputting a beat number and a plurality of notes through intelligent terminals such as a mobile phone, a computer and the like, and presetting a beat time value and reference loudness; the beat time value is the time corresponding to one beat; the reference loudness is the decibel of the audio, and because the beat stress and the rhythm stress need to be distinguished in the rhythm solo practice, the strength of a single note is determined by the strength of the beat and the position of a music measure, the reference loudness needs to be preset; after the terminal inputs the relevant data, the data is directly acquired by the central processing unit in a communication mode; note that the tempo value and the reference loudness are autonomously input by the user, and when the user does not select an input, system defaults may be used.

2. The central processing unit synthesizes corresponding audio; the central processing unit firstly determines the strength of the beat according to the beat number, when the beat number is determined, the strength of the beat in the bar is fixed, and the strength relation of the beat can be directly determined according to the beat number; then determining the rhythm intensity of each note according to the input note sequence, wherein the rhythm intensity refers to the regular intensity relation presented by different numbers and positions of the notes in the single beat, and the intensity of each note in the single beat can be determined at the moment; and finally, determining the strength relation of each input note according to the preset reference loudness, and then correspondingly synthesizing the audio. There are two processing modes when synthesizing audio; the method comprises the steps that in the first mode, original audios corresponding to corresponding note and beat combinations are stored in a system, and after the original audios are directly called, the next step of processing is carried out; and secondly, a single original audio corresponding to a single note card is stored in the system, and the corresponding continuous and smooth audio is synthesized according to the corresponding pronunciation intensity rule, the tone, the beat time value and the acoustic model determined by the reference loudness information, and then the next step of processing is carried out after the synthesis.

3. An indicator module trajectory is determined. In the invention, the abstract music sounding process is mainly expressed as the vivid and concrete motion process of the indicating module. When the trajectory line is determined, the original shooting process is referred to. The central processing unit correspondingly projects the sounding duration of the notes on a horizontal line or a circumferential line according to the mathematical model, judges a mark point corresponding to each note according to a preset time value, wherein the mark point is the position of the indication module at the moment, and finally specifically determines a trajectory line through curves, broken lines, straight lines and other forms. The specific form of the trace line is shown in the drawings of the embodiments.

4. And finally, the central processing unit controls the indicating module to move according to the trajectory line and controls the sound generating module to generate sound according to the audio synchronously. The synchronous sounding refers to that when the indication module correspondingly passes through the mark point of the note, the sounding module sends out the audio frequency of the corresponding note and continuously sounds within the duration range of the note.

The second method comprises the following steps: the time scale information and the note information are carried in a physical form, and before the time scale information and the note information are input, the time scale and the corresponding note can be manually adjusted based on the training purpose. The identification and conversion processes between the note card and the sensing device are added in the transmission process of the time information and the note information. A rhythm visual singing visualization method comprises the following steps.

1. The method comprises the steps that a user sequentially splices a first note card with beat information and a plurality of second note cards with note information, the spliced first note card and the spliced second note cards are placed in a note card sensing area, and a beat time value and reference loudness are preset.

The note cards comprise a first note card and a second note card, wherein the first note card is printed with the note number information, and the second note card is printed with the note information. The note cards include but are not limited to cards, puzzles, building blocks and other concrete spliceable objects. In a specific embodiment, the first note card is structured as shown in fig. 3, and has time information printed thereon, wherein the time information can be, but is not limited to, a score and a pattern. The beat number, which expresses different music beats, refers to a regular combination of strong beats and weak beats, and specifically refers to the total note length of each measure in the music score. In an embodiment, the second note card is printed with visual note information as shown in fig. 4, the note information may include, but is not limited to, a numbered musical note or a staff musical note, one note card may correspond to one note or a plurality of combined notes, and the note information mainly records the duration of the notes. Specifically, the note cards representing the duration in fig. 4 are, from top to bottom, a whole note card, a half note card, a quarter note card, an eighth note card, a sixteenth note card, a corresponding pause card, and a combined note card, which are not illustrated here. Note that, although the second note card showing the duration in fig. 4 is used in such a manner that the length of the second note card is proportional to the corresponding note duration, a mode in which the length is not proportional to the note duration may be used.

A third note card representing the tone height is also provided in the present invention, and as shown in fig. 5, it is preferable that the size thereof is set not to exceed the size of the second note card representing the minimum duration for the convenience of combination. When in use, the third note card can be spliced with the second note card for use; the third note card may also be provided as a card containing both pitch and note duration information for use alone.

Since at least one complete music measure is required in rhythm solo to show the strong and weak relationship of the beats, when the note cards are spliced, as shown in fig. 6, the plurality of note cards should include a complete music measure formed by at least one first note card and a corresponding number of second note cards. During splicing, in order to accurately and completely visually express the music information, the splicing of the note cards can be sequentially spliced according to a certain specific sequence, and the splicing can be but is not limited to a horizontal sequence from left to right, a vertical sequence from top to bottom, a clockwise sequence and the like. To facilitate the reading of information of the note card, it is preferable that the shape of the tile of the note card is identical to the shape of the sensing area of the note card.

2. The note card sensing area sequentially acquires the beat number and the notes in the sequence, converts the beat number and the notes and transmits the notes to the central processing unit.

After the note cards are spliced, the note cards are placed in the note card induction area, and the note card identification module can identify the arrangement sequence, the time mark information and the note information on the note cards according to the splicing shape or the distance relation. In a specific embodiment, the first note card, the second note card, and the third note card may be configured with a radio frequency module, an NFC module, a barcode, an identification code hole, or image identification information, and the note card sensing area identifies the time stamp information and the note information on the note by identifying the corresponding radio frequency information, barcode, identification code hole, or image identification information. More specifically, the note card identification module records the position serial number and the code of the note card in the identification process, and transmits the position serial number and the code to the central processing unit, and the central processing unit calls the related data of the note card from the storage according to the code of the note card. As an example of the note card in fig. 5, the note card identification module may perform data transmission in a data packet after identifying the note card, where the corresponding data packet is (1, 2/4), (2, 16), (3, 4), (4, 8), (5, 16), that is, the data packet is represented in the form of (X, Y) data packet, where X represents a position serial number of the note card, Y represents time information or note information on the note card, and the encoding rule of the (X, Y) data packet may be set as required, and different codes represent different pieces of note information and time information, and may be applied to combination and superposition of the note cards. And the central processing unit sequentially calls the related data in the storage according to the (X, Y) data packet.

The spliced note card is judged to be valid or not after identifying corresponding beat number information and note information because the complete music bar comprises a beat number and corresponding bar notes, if and only if the spliced note card at least comprises a first note card and the complete music bar consisting of a plurality of second note cards, the note card is valid, and if not, an error is reported.

It should be noted that, since the second note card carries the associated note information, in order to facilitate the user to more intuitively observe the duration relationship of the notes on each note card, the size of the second note card may be preferably designed to be proportional to the duration of the notes carried, for example, when the second note card is rectangular, the length of the second note card may be corresponding to the duration of the notes, so that the ratio of the lengths of the note cards is equal to the ratio of the durations of the notes thereon. For example, when the second note card is arc-shaped, the central angle of the second note card can be corresponding to the duration of the note, so that the ratio of the central angles of the note cards is equal to the ratio of the durations of the notes thereon. The first note card and the second note card can also be manufactured by specification and size, and the size of the second note card does not correspond to the note duration value on the second note card.

3. Determining the strength of a beat according to the beat number, determining the strength of a rhythm according to the sequence of notes, and determining corresponding audio according to the strength of the beat, the strength of the rhythm and reference loudness; the steps are the same as the first method, and it should be noted here that the system classifies according to whether the combination of the beat number and the tone symbol is high frequency or low frequency, and respectively adopts different schemes to obtain corresponding audio frequencies; the corresponding combination of high frequency can be obtained according to the statistics of the existing music learning materials, and also can be automatically obtained according to the statistics of the actual use cases and comprehensively determined. Because the traditional card recognition and pronunciation technology mostly queries the corresponding audio file in the system according to the code of the corresponding playing audio, and then plays the audio file, namely, the first method is the first method; the system uses the scheme for high-frequency rhythm combination, and the scheme can ensure the continuous smoothness of the audio frequency. However, due to the addition of the combination cards, the combination of the cards can greatly increase the memory of the system, for example, 12 cards representing different notes or combined notes are taken as an example, the combination mode has different strengths and weaknesses due to different positions of the notes, and the combination has a total factorial seed scheme of 12; as the number of cards increases, it is obviously not feasible to exhaust these combinations and store the corresponding audio files. Therefore, an audio file synthesis technology is also adopted, namely in the second mode of the first method, only the audio corresponding to a single card needs to be prepared, then real-time synthesis is carried out through the acoustic module according to the pronunciation intensity rule of the notes, and the system is used for rhythm combination of long tail and low frequency, so that the practical application of the product is greatly expanded. By flexibly applying the two methods in the system, the audio quality of the rhythm exercise of the high-frequency note combination is ensured, and the requirement of the rhythm exercise of the free combination note is met.

4. Determining the position information of the corresponding time point indicating module according to the beat number, a plurality of musical notes input in sequence and a beat time value; determining a trajectory line indicating movement of a module according to the position information, the trajectory line corresponding to a beat line of the sequentially input plurality of notes; the position of the indication module on the track line corresponds to the relative position of a single note on a beat line.

5. And controlling the indication module to move according to the trajectory line, and controlling the sound production module to produce sound according to the audio. The second method mainly has the following three characteristics that firstly, the demonstration rhythm can be set in a card combination and splicing mode, the method is very suitable for children to use, and the used interaction mode is simple; secondly, the note cards can be freely spliced to form various rhythms instead of a plurality of set rhythms, so that the combinations of the rhythms which can be trained are richer; thirdly, the pronunciation position of each note in the time domain is indicated through the continuous motion of the indication module in the space, the initial position of each note pronunciation is clearly shown, the sufficient prejudgment time is provided for a user to carry out rhythm solo, and the condition that a beginner always feels slow when using a discrete indication mode for prompting is effectively avoided.

A rhythm video and song visualization system is disclosed, as shown in figure 7, a terminal for inputting a time scale and a note; the communication module is used for being in communication connection with the terminal and the central processing unit respectively; the note cards are provided with time marks and notes; a memory, which stores the information data corresponding to each note card; the note card identification module is provided with a note card induction area, and the note card identification module is used for identifying note cards placed in the note card induction area; the indication module is used for moving along the note proportion line and representing the time domain position of the pronunciation note in real time; the sound emitting module is used for playing audio; a central processor for controlling the motion of the indication module according to the total length of the note proportional line and the total duration of the plurality of notes; determining the sound intensity of each note according to the beat number, the plurality of notes and the reference loudness, and calling or synthesizing corresponding audio; determining the position information of the corresponding time point indicating module according to the beat number, a plurality of musical notes input in sequence and a beat time value; determining a trajectory line indicating movement of the module according to the position information and displaying a visual trajectory line through a display, the trajectory line corresponding to a beat line of the sequentially input plurality of notes; the position of the indication module on the track line corresponds to the relative position of a single note on a beat line; and controlling the indication module to continuously move at a constant speed according to the trajectory line, and controlling the sound production module to produce sound according to the audio.

Specifically, the note card may be, but is not limited to, a paper card, a paper puzzle, a plastic card, or a building block, or a card or a building block made of other materials, and the note card has a time mark or a note printed thereon, wherein the first note card with time mark information may have a uniform standard size. The shape of the note card can be rectangular, arcuate, or other irregular shape. Preferably, the length of the rectangular second note card is positively correlated with the note duration, and the corresponding central angle of the arc-shaped second note card is positively correlated with the note duration. Meanwhile, the note card is provided with a radio frequency module, an NFC module, a bar code, an identification code or image identification information and multi-point touch information, wherein the radio frequency module, the NFC module, the bar code, the identification code or the image identification information can be identified and correspond to the beat number or the note.

The utility model provides a visual device is sung to rhythm, includes a plurality of note cards, has note card identification module of note card induction zone, accumulator, instruction module and sound production module, central processing unit. The central processing unit is respectively in communication connection with the note card identification module, the storage, the indication module and the sound production module.

In a first embodiment, as shown in fig. 8, a rhythm video visualization device includes a rectangular bottom plate 11, rectangular note cards 12, and a circular tower-shaped sound device 13, wherein a card slot 14 is formed in the bottom plate, and a plurality of note cards can be inserted into the card slot 14 in a splicing manner. The bottom is internally provided with a note card identification module, a memory and a central processing unit. After the note card is embedded into the clamping groove, the device performs analysis processing, the note card identification module acquires corresponding card information according to a bar code at the bottom of the note card, the central processing unit performs data processing, the control indication block moves from left to right, and the sound production device produces sound synchronously. The sound production device 13 is in communication connection with the central processing unit, and the shape of the sound production device does not influence the implementation effect of the invention. In the present embodiment, the trace line 10 is a broken line with an arrow, and the indication module 20 is a circular cursor. Both the trace line 10 and the indicating module 20 are displayed on the display screen, and the arrow on the trace line 10 is determined by the minimum duration note entered and then marked sequentially on the trace line 10. In the present embodiment, the horizontally projected length of the trajectory line 10 corresponds to the note duration.

In the second embodiment, as shown in fig. 9, a card slot and an indication block are added on the basis of the first embodiment, and at the time, different card slots and sounding devices can make different timbres. The first embodiment is suitable for basic tempo exercises and the second embodiment is suitable for combined tempo familiarity. In the single card slot of the first embodiment, music bar note cards of different beats can be inserted, but since the length of the bottom board is limited by the length of the second note card, the arrangement of more note cards can be satisfied in the form of a multi-card slot. Meanwhile, the corresponding indication blocks of different card slots can move synchronously or asynchronously. In the present embodiment, the trace line 10 is a horizontal line with an arrow, and the indication module is an arrow-shaped cursor, both of which are displayed on the display screen. The length of the trace line 10 at this time corresponds to the duration of the note.

In the third embodiment, as shown in fig. 10, in this embodiment, a circular bottom plate is used as the bottom plate, and a circular slot and a pointer concentrically arranged are formed on the bottom plate. The note cards are correspondingly designed to be arc-shaped and can be embedded in the annular card slot after being spliced. The note card identification module, the accumulator, the sound production module, central processing unit all place in the bottom plate, note card identification module passes through the built-in radio frequency module of note card and discerns note card information. Compared with a rectangular bottom plate, the embodiment shows the rhythm as circular motion, and can more vividly and intuitively show the music rhythm when a single music bar or note card is spliced less. In this embodiment, the trace line 10 is a circular arc segment, and the indicating module is an external pointer concentric with the trace line 10, at this time, the central angle of the track trace corresponds to the note duration.

A fourth embodiment, as shown in fig. 11, in this embodiment, the musical note card recognition device includes a housing with a certain shape design, a slot for inserting a musical note card is disposed on the housing, a musical note card recognition module recognizes information corresponding to the card through a coding hole at the bottom of the musical note card, an area for placing a corresponding musical note trace line pattern is disposed at the lower end of the slot, and a row of LED strips is disposed below the area; the different notes are taken as the rhythm of one beat, the corresponding track line reference pattern blocks which are printed are arranged in the area, the different reference pattern blocks can be replaced according to the different beat settings, for example, the quarter notes are taken as one beat, and the user can place the track line pattern blocks corresponding to the quarter notes as one beat in the area as the reference. In this embodiment, adopt slot structure to replace original recess design, utilize LED lamp area as indicating module. Specifically, after the note card is inserted, the LED strip controls the LED lamps to light up from left to right, and the user uses the trace line reference pattern as a reference. The central processing unit controls the sound generating device and the LED lamp to generate sound synchronously. It should be noted that, in order to ensure the continuity in vision, the light strip is a flexible LED light strip, and the arrangement of LEDs needs to be compact to ensure the visual effect of continuous motion. In this embodiment, a curve with peaks or valleys is used as the track line, and the LED strip is used as the indication module, and the horizontal projection of the track line corresponds to the note duration.

Fifth embodiment, a system structure is shown in fig. 12, and this embodiment adds a click module or a sound pickup module on the basis of the original structure. The clicking module can be a button, a key and the like, and clicking operation is performed by a user according to the music rhythm; the sound input module may be a sound pickup device such as a microphone. The user clicks or sounds according to the rhythm set by the note card; through the input and recognition processing of user click data or sound data, the central processing unit compares the standard pronunciation data of corresponding notes, gives the deviation from the standard pronunciation, and outputs the result after processing.

A sixth embodiment, the structure of which is shown in fig. 13, in this embodiment, a fastening slot of a third token card 15 is added on the basis of the first embodiment, and training and learning of pitches are added on the basis of the original training rhythm; meanwhile, the top of the circular tower-shaped sound generating device 13 is provided with a camera 30 as a note card recognition device, the camera collects image information of the first note card 12, the second note card 14 and the third note card 15 on the rectangular bottom plate 11, after recognition, analysis and processing, corresponding beat numbers, note time values and note pitches are obtained, and after data processing, the central processing unit controls the indication block to move from left to right and controls the sound generating device to generate sound synchronously.

The seventh embodiment has a structure as shown in fig. 14, and is composed of two separated parts, namely a note card reading device part and a rhythm visualization device part, which are connected in a communication manner; the note card reading device part, as shown in fig. 14(a), is mainly composed of a communication module, a note card identification module and a storage; the rhythm visualization device portion, as shown in fig. 14(B), is mainly composed of an indication module, a sound generation module, a storage, and a central processor. Compared with the third embodiment, in this embodiment, the note card reading device obtains information corresponding to the card by a multi-point touch manner, each card has a plurality of touch points at the bottom, different relative position relationships between the touch points correspond to different codes, and different codes correspond to different card information contents, as shown in fig. 14(a), a bottom plate for placing the note card is a multi-point touch screen, and the cards with different information placed on the screen can identify the corresponding codes according to the position relative relationship of the contacts at the bottom of the card, so as to determine the beat or note information corresponding to the card; by placing the note card, rhythm information corresponding to multiple circles of the visualization device can be set at one time, and each circle can correspond to different contents; after the note card reading device acquires the content corresponding to the card, the related information is transmitted to the rhythm visualization device through the communication module. The rhythm visualization device can also directly receive information such as the beat note input by a mobile phone or other terminals.

The rhythm visualization device part adopts a circular bottom plate, a display screen is arranged on the bottom plate, and a sounding module and a central processor module are arranged below the bottom plate. And the rhythm visualization device determines the displayed and played content through calculation and analysis, and displays and plays the content. In the using process, the rhythm visualization device firstly displays the content corresponding to the first circle of rhythm, including the images of the note cards, the flashing indication blocks, the track lines and other related information, as shown in fig. 14(B), the display screen on the rhythm visualization device displays the corresponding note marks according to the proportion of the note duration, and the central angle degree occupied by the note marks is proportional to the corresponding note duration. The indication module moves along a ring below the note mark by adopting a flashing icon, and the figure is a visual schematic diagram of the device displaying the rhythm of the first turn; after the display of the note cards in the first row is finished, the display screen displays the related visual information corresponding to the note cards in the second row according to the content of the note cards corresponding to the second circle of rhythm, as shown in fig. 14(C), which is a visual schematic diagram of the device displaying the second circle of rhythm; according to the information such as the transferred musical notes, the display screen can sequentially display a plurality of circles of visual contents. It can be seen that, in this embodiment, the scheme of multiple touch can be adopted to the note card reading device, and the note card reading device can set up multirow note card and send the identification information to rhythm visualization device part through communication, also can send information such as beat note to rhythm visualization device part through cell-phone or other terminals, further satisfies different music measures' combination demand, and rhythm visualization device can show the visual process of the rhythm of a plurality of music measures according to reading order in proper order, corresponds the visual content of multiturn difference.

It should be noted that, although in the above embodiments 1 to 7, the indicating module uses a pointer or an LED strip or a display to directly display the digital image, other forms such as a cursor, a caliper, or a moving slider may also be used. The note card induction zone can be provided with a clamping groove, a groove or a magnet, and the first, second and third note cards can be connected with the note card induction zone through clamping, concave-convex matching or magnetic attraction. In the present invention, the constant speed continuous motion of the indicating module has the following but not limited to two modes, as shown in fig. 15, the time from a to B of the indicating module is one beat; the indicating module can continuously move from A to B at a constant speed; or rapidly moving from the A position to the 1 position in a jumping mode, stopping for a moment, rapidly moving to the 2 position again, stopping for a moment, and the like until the B position. In the present invention, the central processing unit may be, but is not limited to, a calculation control unit such as a CPU, MCU, MPU, DSP, etc., and necessary accessories.

Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims

1. A rhythm video and song visualization method is characterized by comprising the following steps:

s1, inputting a beat number and a plurality of notes in sequence, and presetting a beat time value and reference loudness;

s2, acquiring the beat number and the notes in sequence;

s3, determining the strength of the beat according to the beat number, determining the strength of the rhythm according to the sequence of the notes, and synthesizing or calling corresponding audio according to the strength of the beat, the strength of the rhythm and the reference loudness;

s4, determining the position information of the corresponding time point indicating module according to the beat number, the plurality of notes input in sequence and the beat time value; determining a trajectory line indicating the movement of the module according to the position information; the trajectory line corresponds to the durations of the sequentially input plurality of notes;

and S5, controlling the indication module to move according to the track line, and controlling the sound generation module to generate sound synchronously with the audio.

2. The rhythm solo visualization method according to claim 1, wherein in the S3, it is determined whether a rhythm combination corresponding to a current beat number and a note belongs to a high-frequency combination or a low-frequency combination; for the high-frequency combination, directly calling corresponding audio, and specifically directly calling the stored original audio corresponding to the beat number and the rhythm of the phonetic symbol combination; and for low-frequency combination, synthesizing corresponding audio, specifically determining an acoustic model according to the strength of the beat, the strength of the rhythm and the reference loudness, calling original audio corresponding to a single note according to the acoustic model, and synthesizing continuous and smooth audio.

3. The rhythmic solo visualization method according to claim 1, comprising the steps of:

s1, inputting a beat number and a plurality of notes in sequence at the terminal by a user, and presetting a beat time value and reference loudness;

s2, the central processing unit sequentially obtains the beat number and the plurality of notes according to the sequence;

s3, the CPU determines the sound intensity of each note according to the beat number, the position relation of a plurality of notes and the reference loudness, and synthesizes or calls the corresponding audio;

s4, the CPU determines the position information of the corresponding time point indication module according to the beat number, the plurality of notes input in sequence and the beat time value; determining a trajectory line indicating the movement of the module according to the position information; the trajectory line corresponds to the durations of the sequentially input plurality of notes;

and S5, the central processing unit controls the indication module to continuously move at a constant speed according to the track line and controls the sound production module to produce sound according to the audio frequency.

4. The rhythmic solo visualization method according to claim 1, comprising the steps of:

s1, splicing a first note card with beat information and a plurality of second note cards with note information in sequence by a user, putting the spliced first note card and second note card into a note card sensing area, and presetting a beat time value and reference loudness;

s2, the note card sensing area sequentially acquires the beat number and the notes according to the sequence and converts the beat number and the notes to be transmitted to a central processing unit, and the central processing unit sequentially acquires the beat number and the notes according to the sequence;

s3, the CPU determines the sound intensity of each note according to the beat number, the plurality of notes and the reference loudness, and synthesizes or calls the corresponding audio;

5. The rhythm solo visualization method according to claim 4, wherein the first note card and the second note card are the same size in S1; the note card sensing area is provided with a clamping groove, a groove or a magnet, and the first note card and the second note card are connected with the note card sensing area in a clamping manner, a concave-convex manner or a magnetic attraction manner; the method for acquiring the information of the first note card and the second note card by the note card sensing area is radio frequency chip sensing identification, image coding identification, coding hole identification, image content identification or multi-point touch identification.

6. The rhythm solfeggio visualization method according to claim 4, wherein in S1, the user sequentially splices a first note card with beat information, a plurality of second note cards with note duration, and a plurality of third note cards with note sounds, puts the spliced first note card, second note card, and third note cards into a note card sensing area, and presets a beat duration and a reference loudness; in S3, the corresponding audio with pitch information is synthesized according to the first, second and third note card information and the corresponding music rule.

7. The rhythm chorus visualization method according to claim 4, wherein the size of said second note card is proportional to the note duration correspondence on the second note card; the note card induction zone is provided with a plurality of note card induction zones, and each note card induction zone corresponds to different timbres.

8. The rhythm solo visualization method according to any one of claims 1 to 7, further comprising, between S1 and S2, S11 of determining whether or not a bar corresponding to the beat number is included in the plurality of notes inputted, and if so, proceeding to S2; if not, the flow returns to S1 and prompts an error.

9. A rhythm visual and singing visualization system is characterized by comprising

A terminal for inputting a time stamp and a note;

the communication module is used for being in communication connection with the terminal and the central processing unit respectively;

the note cards are provided with time marks and notes;

a memory, which stores the audio data corresponding to each note card or the audio data corresponding to different beat numbers and note combinations;

the note card identification module is provided with a note card induction area and is used for identifying note cards placed in the note card induction area;

the indication module is used for moving along the track line and representing the time domain position of the pronunciation note in real time;

the sound emitting module is used for playing audio;

a central processor, which determines the sound intensity of each note according to the beat number, the plurality of notes and the reference loudness, and synthesizes or calls the corresponding audio; determining the position information of the corresponding time point indicating module according to the beat number, a plurality of musical notes input in sequence and a beat time value; determining a trajectory line indicating the movement of the module according to the position information; the trajectory line corresponds to the durations of the sequentially input plurality of notes; and controlling the indication module to continuously move at a constant speed according to the trajectory line, and controlling the sound production module to produce sound according to the audio.

10. A rhythm video-song visualization device, which is characterized by comprising the system of claim 9, and further comprising a click module or a sound pickup module, wherein the click module records click operation of a user, the sound pickup module records sound production of the user, and the central processing unit compares click information or sound production information of the user with the sound production content of corresponding notes, calculates deviation, processes and outputs a result.