JPS59128576A - Display for note - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

DETAILED DESCRIPTION OF THE INVENTION (Industrial Application Field) The present invention is capable of displaying an indication corresponding to the pitch of an audio signal in a note-like figure in a corresponding part of a staff-like display figure on a display. This invention relates to a musical note display device.

(Conventional Examples and Problems) If it were possible to immediately display the song being played on the musical staff when playing an instrument, it would be easy for anyone to record the music they have composed on the musical score. Since it is also expected to be used in music education, various types of display devices have been tried in the past that display the music being played as musical notes on a staff-shaped display surface. However, conventional devices configured to light up lamps on a staff-shaped display board using a switch operated by pressing a keyboard, for example, cannot be used for instruments other than keyboard instruments, such as string instruments and wind instruments. The problem is that it cannot be applied to conventional devices with other configurations, such as converting the sound of an instrument into a 'gt signal with a sound 1# electrical converter, and converting it into a 'gt signal using a number of bandpass filters. In the case of a configuration in which frequency analysis is carried out using a 3D filter, and a lamp is lit on a staff-shaped display board based on the analysis result, the configuration becomes complicated because a large number of bandpass filters are required. There was a drawback.

(Means for Solving the Problems) The present invention converts an audio signal into a digital signal, performs frequency analysis, determines the pitch of the audio signal based on the analysis result, and displays the pitch based on the pitch determination result. The present invention provides a musical note display device in which required figures are displayed in corresponding portions on a staff-shaped display screen.

(Embodiments) Hereinafter, the musical note display device of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a block diagram of an embodiment of the musical note display device of the present invention. In FIG. 1, l is an input terminal for a left channel (L channel) signal, and 2 is a right channel (R channel) signal input terminal. The L channel σ) signal is amplified by the buffer amplifier BAD and then applied to the switch Wt, the adder ADD and the subtracter SUB - while the R channel signal is amplified by the buffer amplifier BAr. After being amplified, the switch SWr, the adder ADD and the subtractor SU
Be given to B.

SW indicated by a dashed-dotted line frame in FIG. 1 is a selection switch including the individual switches SWt + lr + SWa + SWb, and this selection switch sW
When any one of its individual switches is turned on, all other switches are turned off.
) state and enters the above-mentioned on state, t,=1
σ] so that the signal selected by the switch is given to the subsequent circuit. A switching control signal for the selection switch SW is given from the operation control section CLD, and the operation control section CLD operates based on information given from the operation section OP and the central control unit CPU.

In the illustrated example, the selection switch Sw selects the L channel signal, the R channel signal, the sum signal of the L channel signal and the R channel signal, and the difference between the L channel signal and the R channel signal. Among the four signals σ), one signal is selected.

The signal selected by the selection switch SW is given to the graphic equalizer GEQ, and the output signal from the graphic equalizer GE is passed through the anti-aliasing filter AAF to the absolute value detection circuit section A.
VD and the sign detection circuit SD, and the output signal from the absolute value detection circuit AVD is analog-digital (hereinafter referred to as A
The output signal from the code detection circuit SD is also provided to the central control unit CPU.

Alternatively, a comparator configured to output high-level and low-level outputs depending on whether the input signal is positive or negative can be used.

The digital signal obtained by AD converting the output signal of the absolute value detection circuit AVD by the AD converter ADC and the 1-bit signal output from the sign detection circuit SD are processed as a set of digital signals by the central control unit. t CPU
It is stored in the main memory RAM under the control of the controller and used for FFT calculations. However, if the absolute value detection circuit AVD and the sign detection circuit SD are used as described above, an AD converter with a small number of bits can be used. This allows AD conversion of input signals with a wide dynamic range.

The above-mentioned graphic equalizer GEQ varies the frequency a characteristic of the input signal depending on the type of musical instrument, and the anti-aliasing filter AAF limits the frequency band of the signal to prevent so-called aliasing noise. This is a low-pass filter for performing the following.

It is well known that if the cutoff frequency of the anti-aliasing filter leg described above is fc, then the sampling frequency fs in the AD converter ADC should be 2fc or more, and the output from the AD converter ADC should be 2fc or higher. When frequency analysis is performed by calculating FF'T using a digital signal, the frequency v interval f of the spectrum can be obtained as an analysis result.

It depends on the sampling frequency fs of the AD converter ADC used to obtain the digital signal and the number N of data of the digital signal used when performing the FFT operation.

For example, when the cutoff frequency fc of anti-aliasing filter AAF is 20 KHz, AD converter ADO
In this case, the sampling frequency fs is set to 40KHz (fs=2f
c), and as a result of analysis by FFT calculation, if we want to obtain a spectrum with frequency v of interval f of IH7, the number N of digital signal data to be used for FFT calculation is 4000 pieces.

In the FFT operation described above, the number of data used for the operation is N.
The more data there is, the longer the time required for frequency analysis, so the more data there is, the longer it takes to determine the pitch of the input signal, and the more the pitch is displayed in real time. It is desirable that only the FFT operation be performed by a multiplier so that the pitch of the input signal can be displayed in a state close to real time.

Now, the musical note display device of the present invention displays the pitch of the input audio signal on the display surface of the display CRT.For example, as shown in FIG. Mariha is a display mode in which musical notes are displayed sequentially at a predetermined repetition period.

Converts the input audio signal to a digital signal so that it can be displayed in a scrolling display mode,
Frequency analysis is performed using FFT calculation using the digital signal to determine the sound of the input audio signal, and a predetermined figure is displayed at a specific position on the screen of the display determined by the determination result. However, as mentioned above, for example, the pitch of the 12-equal temperament note name can be used as a criterion for determining the pitch of a human-generated audio signal.

Now, the pitch of the input audio signal can be expressed by the note names of three octaves that can be represented by the staff notation displayed on the screen of the display, that is, +F2~F, and the corresponding staff notation.
If you want to display it as ``'',
As a result of frequency analysis, if it is determined that the fundamental tone of the input audio signal is, for example, 440 Hz, the input audio signal is assumed to have pitch name A and the pitch is set to A4 on the staff notation on the display. For example, if it is determined that the fundamental tone of the input audio signal is 146.83Hz as a result of frequency analysis of the input audio signal, the human-powered audio signal is Assuming that it is the brightness of the note D3, a note is displayed at the D3 position on the staff notation on the display.6..., -1
- The pitch of the input audio signal is displayed in a display format such as pitch names F2 to F,! This can be done when the voice signals of jealousy corresponding to each note name in step 2 are input.

By the way, the audio signals input to the musical note display device of the present invention are mainly acoustoelectrically converted sounds emitted from various musical instruments and electronic musical instruments, but the musical instrument sounds may differ from the fundamental tone depending on the type of instrument. The relationship with the strength of the overtones and the way the fundamental tone and overtones are combined differ.

In Figure 5, (al to (di) are diagrams showing the frequency analysis results of the sounds of various instruments (51! v, l (a) are flute sounds, (bl is clarinet sounds, (C
) is the sound of the violin (the G string of the violin), and (
d) is a contrapass (the El sound of a contrapass), but for example, in wind instruments such as the flute and clarinet shown in Figure 5 (a) and (b), the fundamental tone is louder than any overtone. (Pianos, guitars, etc. show the same tendency as wind instruments), and in the case of violins and contrapasses, there are overtones that are stronger than the fundamental tone.

As can be seen from the frequency τ analysis results of various musical instrument sounds illustrated in (a) to (d) of Fig. 5, the frequency components constituting the musical instrument sounds are As shown in Figure 5, there are not only those in which the fundamental tone is the strongest, but also those in which the overtones are stronger than the fundamental tone, as shown in (cl, (dl) in Figure 5. Therefore, even if the input audio signal is analyzed 7 and the largest of the negative frequency components obtained as the analysis result is extracted, it does not necessarily mean that it is the fundamental tone, so the input audio signal is The height of the input audio signal fundamental tone is determined based on the result of frequency V analysis of the audio signal7, and the note corresponding to the pitch of the fundamental tone is displayed at a predetermined position on the staff score on the display surface of the display. In order to do this, it is necessary to determine the fundamental tone of the input audio signal by specifically looking at the relative relationship between the intensities of each frequency component as a result of frequency analysis of the input audio signal.

Therefore, in the musical note display device shown in FIG. Once each frequency component of the audio signal is obtained by one person, a frequency lower than the frequency of the frequency component showing the largest spectral value among all the frequency components obtained by the frequency analysis means is selected. Among the frequency components existing in the region 5., a frequency component exhibiting a smaller spectral value within a predetermined range than the spectral value of the frequency component exhibiting the largest spectral value as described above is detected; If the corresponding frequency component is not detected by the detection means, the frequency of the frequency component exhibiting the largest spectral value is determined to be the high pitch fundamental tone of the input audio signal. If a frequency component is detected by the detection means, the frequency of the lowest frequency component among the detected frequency components is determined to be the pitch of the input audio signal (the pitch of the fundamental tone). , so that the fundamental tone of the input audio signal is determined.

The following is an explanation of how the fundamental tone of a human-powered audio signal can be found correctly by determining the fundamental tone of the input audio signal, with reference to (al to (d)) in Figure 5. .

The results of frequency analysis for the input audio signal are shown in Figure 5 (
When the fundamental tone is the strongest, as in a) and (b),
Naturally, the fundamental tone should be determined as the fundamental tone of the input audio signal. In other words, the fundamental tone has the lowest frequency among the many frequency components obtained as a result of frequency analysis, so in this case it is lower than the fundamental tone with the largest spectral value. Therefore, among the many frequency components obtained as a result of frequency analysis, the frequency value of the fundamental tone exhibiting the largest spectral value is determined to be the fundamental tone.

Also, if the result of frequency analysis of the input audio signal is that the spectral value of the overtone is larger than the spectral value of the fundamental tone, as shown in (C) and (d) in Figure 5, , the largest of the many frequency components obtained as a result of frequency analysis ((C
In the case of the violin G line shown in ), the third harmonic (3rd key e), and in the case of the contrabass E line shown in (dl) in Figure 5, the second harmonic (2nd harmonic). ) Frequencies that exhibit a smaller spectral value within a predetermined force range than the spectral value of the frequency component that exhibits the largest spectral value as described above, among the frequency components that exist in the frequency range lower than the frequency of The frequency of the component is determined as 7 as the fundamental tone.

In the case of the G string sound (open string sound) of the violin shown in Figure 5 (C), the range determined for [the above].
should be about +jOdB, and (d
) In the case of the E-line sound (open string) of a contrapass shown in (2) above, the above-mentioned (predetermined range) may be approximately 30 dB.

7. In the case where the frequency analysis result of the sound of a normal musical instrument shows that the spectral value of the overtone is thicker than the spectral value of the fundamental tone, the spectral value of the overtone with the largest spectral value and the spectral value of the fundamental tone are calculated. The level difference with the spectrum value is within υdB, and the E-line sound of the contrapass shown in FIG. 5(d) is an exception.

Therefore, when determining the fundamental tone, if the frequency value of the frequency component with the largest spectral value is lower than, for example, 10 (lHz), then the frequency value of the frequency component with the largest spectral value is lower than the frequency component with the largest spectral value. It is checked whether there is a frequency component that shows a level difference within, for example, 3 (J dB) compared to the spectrum value of the frequency O component with the largest spectrum value, and in cases other than the above, that is,
If the frequency value of the frequency component with the largest spectral value is, for example, 1 (XJHz or more), the frequency with the largest spectral value is If you check whether there is a frequency component that shows a level difference of, for example, within 1 odB compared to the spectrum value of the component, the fundamental tone in the input audio signal will always be correctly determined based on the above-mentioned criteria. become.

By the way, if the musical note display device is configured to be able to clearly display the notes F2 to F5, as shown in Akira's example, it is not subject to the above-mentioned display. The most pronounced sound name is l.

Even when the pitch name F5 is input, the display device must display the corresponding pitch name F. However, as mentioned above, the pitch of the input audio signal is higher than the fundamental tone. ), the spectral value or frequency value of the frequency component that shows the largest spectral value obtained as a result of frequency analysis is required, so the note name F,
In order to determine the sound based on the result of frequency analysis of the input audio signal, the frequency of the fundamental tone of pitch name F5 must be 698.4.
The higher harmonic (at least third harmonic) component of 6 Hz must also be obtained as a correct value by frequency analysis.

Therefore, in a display device that also displays the note name F, as in the above example, an anti-aliasing filter AAF that limits the frequency band of the input audio signal is used. The cutoff frequency fc of is the frequency value 6 of the pitch name F.
A frequency setting of three times or more than 98.46Hz is required.

When configuring the actual equipment, anti-aliasing
It is desirable to use a filter V with a cutoff frequency Pjfc set as high as other conditions allow (the cutoff frequency Pjfc of the anti-aliasing filter V and the AD variable The relationship between the sampling frequency fs in the ADC, the frequency interval f of the spectrum obtained as a frequency analysis result, the fine grain N of the data, and the time required for FFT calculation has already been described. (as mentioned above).

In FIG. 1, the digital signal output from the AD converter ADC and the 1-bit signal output from the code detection circuit SD are stored in the main memory RAM and
As mentioned above, it is used for calculations,
The central control unit CPU performs predetermined control operations and arithmetic operations according to the program stored in the read-only memory ROM, and also transmits data to the video rams V- to W via the video display processor VDP. Give me. ROM2 is a high-speed read-only memory that stores boograms for spectrum analysis, but FFT calculations are not performed by the central controller CPU.
When using a multiplier, the ROM in Figure 1
The configuration is such that the 20th section is changed to a multiplier.

The CRT in FIG. 1 is a display, and in the following explanation, the display uses a cathode ray tube.
On the display surface of the display CRT, the pitch of the input audio signal is displayed, for example, as shown in figure I44.

Now, the display mode to be performed on the display surface of the display CRT is such that the display surface is cleared every time a predetermined number of musical notes are displayed from the left side to the right side of the display surface. In other words, after a predetermined number of notes are displayed from the left side to the right side of one display screen in a display mode at a predetermined repetition period, a series of display patterns are displayed in a row above. This is the display pattern of Sukhmir, or the display of notes is performed from the left side of the display screen to the right side for a predetermined number of times V, and the subsequent notes are always displayed on the display screen. It will be displayed at the top right corner - the previously displayed notes will be displayed in that position.
A scroll display mode that moves each one to the left one by one, a halt display mode that displays the pitch of the audio signal at an arbitrarily specified time γ, and a display surface of the display. For example, the halt display mode allows the displayed content to continue to be displayed as it is, but the display mode for the note display device is determined by the operating section OP.
The switches and controls provided on the machine are controlled by the settings of input means such as push buttons.

A video display processor VDP is connected thereto via a data bus 4.
- It operates as an interface between the RAM and the central control unit @CPU, and the video RAM V-
The image content is determined by various data stored in the RAM, and it is configured to be able to generate a composite video signal according to a predetermined standard method. As a video display processor VDP, for example, Nikkei MagO Hill Co., Ltd. [Nikkei Electronics J] March 30, 981
It is possible to use the video display processor (VDP) manufactured by Texas Instruments, Inc., introduced in the Japanese issue (JJ, pages 156 to 164). It is said that a display processor is used.

Figure 2 shows the video display processor connected to bus 4.
tf is a diagram showing an example of a memory map of a video ram V-RAM connected to the video ram, and in the memory map of the video ram shown in FIG.・
Also, 768 bytes from address 1024 to address 1771 are used as a pattern name table (PNT), and 1772 bytes are used as a pattern name table (SGT).
The 128 bytes from address to address 1919 are used as the sprite attribute table (SAT), and +r,
= 32 bytes from address -1920 to address 1951 are used as a color table (CT), and -1952
96 bytes from address to address 2047 are unused, 2
2048 bytes from address 048 to address 4015 are used as a pattern generator table (PGT).

Pattern Geoshi-Evening Table PGT id,
By using 8 bytes each, one specific pattern of 8 pixels x 8 pixels can be stored, so 256 types of patterns of 8 x 8 pixels can be stored. The pattern information stored in the pattern φ generator e-table PGT is transferred from the read-only memory ROM in the initial state of the device by the operation of the central control unit CPU. Of course, it may also be a read-only memory.

8 each in pattern ° generator table PGT
As mentioned above, each byte storage area has 8×
Specific patterns of 8 pixels are stored individually, and each specific pattern can be specified by a pattern name given to each storage area where each specific pattern is stored. do. Pattern generator table PGT of the example shown in the second diagram
Then pattern name ≠ 2 from Q to pattern name 255
256 types of patterns can be specified using the 56 Nohatan names.

Next, the pattern name table PNT is displayed on display C.
Each of the display sections assumed on the display surface of RT' is
Each pattern generator table PGT B
In order to store information indicating which pattern name the column is, it has a storage capacity corresponding to the total number of display sections described above.

In the example shown in Figure 3, the total number of sections set on the display screen is ((32 columns) x (24 rows) l = 768, and the amount of information indicating one section of land is 1 byte. As mentioned above, the pattern name table PNT has a storage capacity of 768 bytes.

As mentioned above, the necessary patterns are stored in the pattern generator table PGT in Video Ramsaw Tojun, and the corresponding patterns (
When the required pattern names assigned as 7 are stored in each section of the display surface in the pattern name table PNTc, the video display panel VDP is stored in the previous M[:! L, 7C video ram V
- Information stored in pattern name table PNT in RAM and pattern generator table P
Generates a composite video signal whose image content is determined by the information stored in the GT and, if necessary, the information stored in the color table CT and follows a specific standard format, and applies it to the display CRT; Display CR
A specific pattern is displayed on the display screen of the T.

The explanation so far has been based on a display in which a specific pattern stored in the pattern generator table PGT is displayed in a specific section among 768 sections on the display surface of the display. This relates to the case where a pattern is displayed in the so-called graphic mode, but in this graph ink mode, the pattern position is specified by the pattern name table PNT, so the pattern is displayed on the display screen. When an attempt is made to move one pattern, the pinch of pattern movement is one section (distance of 8 pixels) on the display screen.

Therefore, in order to reduce the pinch of movement of the pattern on the display screen and make the pattern move smoothly, the pattern stored in the sprite generator table SGT can be moved one pixel by changing the coordinates. to move within the display screen at a pitch of

The pattern to be stored in the sprite generator table SGT may be 8 pixel x 8 pixel sprite data or 16 pixel x 16 pixel sprite data. Each pattern is individually assigned a sprite name, such as ≠0゜J41...+N.
Sprite surfaces corresponding to this pattern are given higher priority as the sprite name indicates a smaller sand value.

In the memory map of the video RAM V-RAM illustrated in FIG. Therefore, in this example, if the pattern is 81 pixels x 8 pixels, there will be 128 patterns (sprite name temple 0 to
≠127), and the pattern is 16 pixels
In the case of 6 pixels, there are 32 patterns (sprite name ≠
θ~+31) can be stored. Video RAM V-RAM
In the sprite generator table SGT
It goes without saying that if 2048 bytes are allocated to the sprite generator table SGT, the number of patterns to be stored in the sprite generator table SGT will be twice as large as in the previous case.

The sprite attribute table SAT uses 4 bytes for each sprite, and contains the sprite position (1 byte each for vertical and horizontal position specifications), display sprite name (1 byte), and color code. and the end code (1 byte) of the displayed sprite, etc., so if 128 bytes are used as the sprite attribute table SAT, information for 32 sprites is stored in this sprite attribute table SAT.

The position of the sprite is in the horizontal direction (X direction) on the display screen.
256 pixels (8 pixels x 32 sections) and vertical direction (Y direction) 1
491.52 determined by 92 pixels (8 pixels x 24 sections)
The coordinates of the pixel are determined by the vertical position (number indicating the number of the pixel in the vertical direction) and the horizontal position (the number indicating the number of the pixel in the horizontal direction) in the sprite attribute table S.
The sprite is determined by the information written in the AT (the origin of the sprite is taken to be the left-hand edge of the sprite), and movement of the sprite can be done with a one-pixel pinch.

The musical note display device of the present invention has a pattern generator table PGT and a sprite generator table PGT.
+10 types of patterns are stored in the table SGT, and selection of the pattern to be displayed on the display surface of the Nice Play CRT, designation of pattern movement, etc. Based on the data written in the table SAT, a display as shown in FIG. 4, for example, is displayed on the display surface of the display CRT.

In FIG. 4, which shows the display mode on the display surface of the display CRT, figures of musical notation, G-note, ~-note, and other musical symbols are stored in advance in read-only memory ROM,
At the start of the operation of the musical note display device, the various patterns stored in the read-only memory ROM are stored in the central controller CPU and the video controller. transferred to and stored in a pattern generator table PGT and a sprite generator table SGT in the video RAM V-RAM via the display processor VDP;
It is used for the first time in the display operation on the display surface of the display. The musical note-shaped mark S shown above the musical staff command in Figure 4 is displayed on the display surface of the display CRT in correspondence with the pitch of the input audio signal. be.

The central control unit CPU performs the operations shown in the flowchart shown in Figure 6 to create the data necessary for displaying the vividness of the input audio signal and displays it on the video display.・Processor VDP, Video Ram V
-The pitch of the sound is displayed on the display surface of the display using musical notes as shown in the fourth figure.
Rub.

In the a-chart (shown in Figure 6), the power is turned on at the start and the note display device is started.
1) Initialization (system initialization) is performed to clear the A'D converter ADC, main memory RAM, video RAM V-RAM, etc., and also clear the data in the video display processor VDP. The registers are set, and the table used for the storage area in the video RAM V-RAM is set, the operation mode is set, and so on.
From the read-only memory ROM, predetermined types of pattern information (
For example, the various graphical information shown in FIG. 4) is transferred via the video display processor VDP, and the sprite name, Data/7 is transferred.

(2) The central control unit CPU repeats each control operation of each step from step (2) to step α until an interrupt shown in chart a in FIG. 6 occurs.
However, when an interrupt occurs at each specific sampling period set in the internal counter provided in the central control unit CPU, the central control unit CPU executes the control that was being executed at that time. Pause the operation, go to step 7, and go to step (1).
Moan? Perform the control action shown in υ, and when it is completed,
Continues execution of the control operation that was previously interrupted by the occurrence of the interrupt.

That is, the central control unit CPU determines that it is the AD converter A.
During the time other than the time when the control operation for DC is performed, the control operations from step (2) to step θ→ are performed.

Now, when the internal counter provided inside the central control unit CPU generates an interrupt every sampling period of the A/D converter ADC, the central control unit CPU causes the AD converter ADC to perform an AD conversion operation. Give a start pulse and step (
At step 19), the AD converter ADC performs an AD conversion operation and stores the output digital signal in the main memory.

In step (4), it is checked whether the AD conversion operation in the AD converter ADC has been performed a predetermined number of times (whether digital data of a predetermined fine grain has been obtained), and if NO, return is made. If YES, proceed to step QυG and set the internal counter to 0 in step eυ. ADC
preset) to return.

In step (2), perform a switch scan and check the input conditions set on the operation panel OP.
Go forward 4 steps. In step (3), it is checked whether a hold display input has been given, and if YES, the current display contents are repeatedly displayed while the hold display continues.

If the judgment result in step (3) is No, - Stenobu (
Proceed to step 4), and in step (4) check whether the input for the halt display is 4 or not. If the determination result in step (4) is No, the process proceeds to step (8), and if the determination result in step (4) is YES, the process proceeds to step (5).

In step (5), it is determined whether or not the input for bold deletion is given (7, if YES, proceed to step (6), erase one note, proceed to step α, and step (5) If the judgment result in step (7) is No,
) to determine whether a halt instruction input has been given, and if No, return to step (2), and: YE
If S, proceed to step (8).

In step (8), an FFT calculation is performed using a predetermined number of digital data stored in the main memory RAM, and n/2 spectral data of the calculation results are stored in the main memory RAM.

FFT calculation is performed using read-only memory IJ that operates at high speed.
It may be stored in the ROM 2 and the central control unit CPU may perform the processing in a short time according to the Arrival a-gram, or it may be performed in a short time using a -multiplier. Which of the above-mentioned methods should be used to perform the FFT calculation depends on how closely the display on the display device needs to approximate real time.

In step (9), a worth vector operation is performed on the mr=varnish vector data in step (8), and the result of the operation is stored in the main memory RAM. Next, in step u0, a pitch analysis is performed. In other words, in step QQ, first, the largest spectral value is found, and then the pitch analysis is performed in step QQ. (7
, and find the frequency value of the spectrum that shows the lowest frequency value among the spectra that have a smaller spectral value within a predetermined range than the maximum spectral value, and calculate it. If there is no spectrum that meets the above conditions, the above 1-1
The frequency value of the spectrum showing the largest spectral value is determined to be the fundamental tone of the sound of the input audio signal, and the process proceeds to step αη.

In step α◇, it is determined whether or not the input for repeatedly displaying at a predetermined period is 4 women. If the first determination result is YES, the process proceeds to step Q2, and the determination result is N.
If O, proceed to step O→.

In step α→, it is checked whether a predetermined number of notes are displayed on the display surface of the display (is it full?), and if YES, the process proceeds to step α1, where the display of notes is cleared, and , if the determination result in step 02 is No, the process advances to step 0→.

! ): r:, In the above-mentioned step α, it is determined whether data transfer is necessary or not, and if YES, the data is transferred in step ← U, then proceed to step 0Q, and the determination is made in step (B). If the result is No, proceed to step αQ.

In step αQ, corresponding to the data value indicating the sound quotient,
The data to be written to the pattern name table PNT and the data to be written to the sprite attribute table SAT are created, and then in step α, the data is written to the video RAM V-RAM via the video display processor VDP. and the video display processor VDP transfers the video ram V-R to the video ram V-R as described above.
A composite video signal is created from the data collected in the AM, and it is sent to the display CRT.
The pitch of the sound is displayed on the display surface of the T, for example, in a pattern as shown in the fourth figure. In step α barrel, the tempo is set by time interval.

The pitch display pattern illustrated in FIG. 4 is projected on the display surface of the display CRT if the pitch of the input audio signal is displayed at the position of the corresponding note name in the five-line image. As the axis changes, musical note-shaped figures S, S...
This is the case when ・ is displayed.

Then, the time interval from when one musical note S is displayed on the display surface of the display CRT until the next musical note S is newly displayed on the display surface is from step (2) to 0→
It roughly corresponds to the repetition period of 7, and the display CR
If a maximum of 26 notes are displayed one after another in the horizontal direction on the display screen of T, and the waiting time at step 9 is set to 0, the repetition period of steps (2) to O→ is For example, if it is 200 milliseconds, the display CR will correspond to the length of 5.6 seconds of the input audio signal.
T) There will be 26 notes lined up on the display screen, and if the waiting time of the step α barrel is τ milliseconds, then one note S will be lined up on the display screen of the display CRT. The time interval from when the next note S is displayed until it is newly displayed on the display screen, that is, the tempo, changes from 200 milliseconds in the example above to (200+τ) milliseconds, and the display The time it takes for 26 notes to be lined up on the surface is (5, 6 seconds + 26τ milliseconds).

Therefore, by making the waiting time given by the step (I barrel) variable, it is easy to freely set the tempo.

7 and 8 are diagrams for explaining how musical notes are displayed on the display surface using various display modes in the musical note display device of the present invention. In FIG. 8, I and It are staff-shaped figures displayed on the display surface of the display CRT, and the display surface shown in FIG. 7 shows two staff-shaped figures 1. II
A predetermined number of note-shaped figures are displayed so as to correspond to the pitch of the audio signal 1-7 from the left side to the right side of the desired one, and a predetermined number of note-shaped figures are displayed, for example. When the display screen is finished as shown in the fourth figure, the display of the musical note-shaped figure displayed on the display screen is cleared, and then the musical note-shaped figure corresponding to the pitch of the audio signal is cleared. By repeating the state in which the figures are sequentially arranged from the left side to the right side of the staff-shaped figures I and 110 required numbers until a predetermined number is reached, the display of the musical note-shaped figures is performed at a predetermined period. The display should be displayed in such a way that it is requested to be repeated. FIG. 7 shows an example of the display state of the display surface of the display CRT before the number of musical note-shaped figures S, S, . . . reaches a predetermined number.

When you want to fix the display on the display screen of the display CRT and display it in one state, all you have to do is give a hold switch input to the operation unit OP. The display on the display screen is maintained in the state it was in when the hold switch input was made to the operation unit OP.

In addition, the musical note-shaped figures that are sequentially displayed on the display screen of the display CRT are moved to the corresponding part of the staff-shaped figure so that they correspond to the pitch of the audio signal at an arbitrarily specified moment. In order to display it, all you have to do is give the HALT switch input to the operation panel OP, and then set the switch input for the halt command to 4. When a switch input of 1 is given to the operating section OP, the switch ψ of the halt instruction is set to ψ≠. The musical note-shaped figure should be displayed at the planned horizontal position where the musical note-shaped figure should be displayed with respect to the figure.

As mentioned above, input the switch for the halt instruction by opening the operation section.
In order to erase the musical note-shaped figure displayed on the display screen by applying a halt erase switch input to the operating unit OP, the halt erase switch input must be applied to the operating unit OP. As a result, the display of the musical note-shaped figure displayed on the display screen immediately before the halt erase switch input is applied to the operation unit OP is erased.

Figure M8 is a diagram used to explain the state of the display on the display surface of the display CRT when the display mode on the display surface of the display CRT is an upward upward display. I and ■ are staff-shaped figures displayed on the display screen.

First, the display CR when an upward scroll switch input is given to the operation unit OP.
The display mode of the display surface of T is as follows. That is, a predetermined number of musical note-shaped figures based on the taste of successive notes of the audio signal to be displayed are sequentially displayed on the display surface of the display CRT from the left side to the right side of the J6 Kero staff-shaped figure ■. After this is completed, a predetermined number of note-shaped figures are sequentially displayed from the left side to the right side of the staff-shaped figure H.

As mentioned above, 2 on the display surface of the display CRT
Two staff-shaped figures 1. When the predetermined number of note-shaped figures are displayed on T, the display of the note-shaped figures displayed on the staff-like figure is cleared, and it is displayed on the staff-like figure. The note-shaped figure that had been displayed in the staff-shaped figure ■ is cleared, and the display of the note-shaped figure that had been displayed in the staff-shaped figure H is cleared.

Then, note-shaped figures are sequentially displayed on the staff-shaped figure H from the left side to the right side until a predetermined number is reached, and the musical note-shaped figures H are displayed in sequence until a predetermined number of note-shaped figures are displayed on the staff-shaped figure H. When a musical note shape is displayed,
At that time, the note-shaped figure that was displayed in correspondence with the staff-shaped figure ■ is cleared, and the note-shaped figure that was displayed in correspondence with the 15#l1g-shaped figure n in the staff-shaped figure ■ is cleared. The figure will scroll, and the note-shaped figure that was displayed in correspondence with the staff-shaped figure ■ will be cleared.

Thereafter, the display is performed in the same manner by scrolling upward. S, upward movement 0
In the operation described in 2 with reference to the flowchart shown in Figure 6, immediately before step αQ, a note-shaped figure displayed on the screen of the display in correspondence with a staff-shaped figure is displayed. It is necessary to take the step of clearing the display.

Next, referring to FIG. 7 (7), a description will be given of the display mode of the display screen of the display CRT in the case where a leftward switch input is applied to the operation unit OP.

In this case, the display state is such that after a predetermined number of note-shaped figures are displayed sequentially from the left side to the right side of the staff-shaped figure on the display surface of the display, they are displayed one after another. Pitch display using a new musical note shape is always displayed at the nearest display position, and -
The previously displayed musical note-shaped (2) shape is shifted one by one to the adjacent display position on the right, and the musical note-shaped figure is cleared at the display position on the -Koseki side. Display is performed in such a display mode.

Even when the display mode of 16 on the display surface of the display CRT is upward or leftward, the hold switch input, halt switch input, or halt command can be sent to the operation unit OP. In this case, a display operation is performed in the same display manner as described above.

The above-mentioned operating section OP is provided with manual means such as switches for setting various input information, and a display using, for example, a light emitting element.

FIG. 9 shows the display mode on a display CRT as a display mode at a predetermined repetition cycle.
When displaying musical notes on display C.
The video signal for one frame in front of which the image displayed on the RT is changed to the next image is recorded by the image word e, the recording means (sequentially and sequentially), and the musical notes of the present invention. 9 is a block diagram showing an example of the configuration of a display device. In FIG. 9, a VTR is a video recorder used as an image recording means.
It is a tape recorder, and -SSG is a generator of recording control signals.

The recording control signal generator SSG generates a control signal in response to a signal given from the central control unit CPU every time the image to be displayed on the display CRT is in a state in which a predetermined number of musical note-shaped figures are lined up. This signal controls the recording operation of the video tape recorder VTR.
The video tape recorder VTR records video signals for one frame one after another, and the necessary recording control signal generated by the recording control signal generator SSG is as follows. For example, release the pause of a video tape recorder (VTR) that is on standby in a paused state [2. One frame worth of video signals will be sequentially recorded onto the magnetic tape every time a recording control signal is issued. Make it.

1. Therefore, the magnetic tape of the video tape recorder VTRi will continuously record the musical scores that are displayed on the display surface of the display CRT at a predetermined repetition period. By playing the Shobatsu tape, you can obtain the entire musical score of the piece you played from beginning to end.

Note that the tempo,
It is a preferred embodiment to display the title of the song, the page number of the song, etc.

FIG. 10 is an overall configuration diagram of the musical note display device of the present invention.

(Effects) As is clear from the above detailed explanation, in the musical note display device of the present invention, new information is displayed one after another on the display surface of the display CRT at a predetermined repeating interval of 7 cycles in response to human-powered audio signals. You can display the score one page at a time, or move the left side upwards so that the score is displayed one after another, and also hold or hold. This allows the display to be held in a stopped state, making it easier to transcribe the score.Furthermore, the recording device can record successive scores in succession, making it easier for amateurs to compose and transcribe. Providing a display device for musical notes that can be performed]
Furthermore, since the device of the present invention performs frequency analysis by signal processing using digital signals,
Compared to conventional devices that use a large number of bandpass filters, this device has a simpler configuration, is suitable for mass production, and can be supplied to customers at low cost.

[Brief explanation of the drawing]

1 and 9 are book diagrams of embodiments of different diameters of the musical note display device of the present invention, FIG. 2 is an example of a memory map of a video ram, and FIG. 3 is an explanation of the divisions of the display surface. Figures 4, 7, and 8 are plan views of display patterns on the display screen, Figure 5 d is a spectral distribution diagram of musical instrument sounds, vJ6
The figure is a flowchart, and FIG. 10 is an overall configuration diagram of the musical note display device of the present invention. 1.2. Input terminal, BAt, BAr...buffer amplifier, SW...selection switch, GEQ/graphic equalizer5. ~ Lido anti-aliasing fist filter, AVD - Absolute value detection circuit = SD... Sign @ detection circuit - ADC... AD converter ~ CPU / Central control unit t-
RAM ・Main memory ROM, , ROIvI
2...Read-only memory, VDP...Video tape recorder, OP → f-V-~ key...Video RAM, CRT...Disgi 1/I, VTR...Video tape recorder, OP ...Operation unit, CLD...Operation control unit, SSG, ...Recording control signal generator,

Claims (1)

[Claims] 1. Anamigu-to-digital conversion means for converting an audio signal into a digital signal, means for performing frequency analysis using the digital signal, and a method for analyzing the sound of the audio signal based on the result of the frequency analysis. The determination result by the above-mentioned pitch determination means is displayed in a musical note shape in a part corresponding to the pitch of the pitch of the staff-shaped display diagram on the display surface of the display. A musical note display device 2 comprising a means for displaying a display surface of a display, and a means for selecting a mode of display on a display surface of a display between repeated display at a predetermined cycle and Sukhmir display, and an audio signal. Anamig-to-digital conversion means for converting a digital signal into a digital signal, means for performing frequency analysis using the digital signal, means for determining the pitch of an audio signal based on the frequency analysis result, and a display. means for displaying the judgment result of the above-mentioned pitch determining means in a note-shaped figure in a portion of the staff-shaped display figure on the display surface that corresponds to the pitch of the note;
Means for enabling the mode of display on the display surface of the display to be selected between repeated display at a predetermined cycle and Sukhumir display, and a means for selecting the mode of display on the display surface of the display, a musical note display device 3 comprising means for displaying the quotient; an anamig-to-digital conversion means for converting an audio signal into a digital signal; and a digital signal output from the anamig-to-digital conversion means. In addition to performing FFT calculations,
The power spectrum is calculated on the result, the pitch of the audio signal is determined based on the level of the spectrum obtained as a result of the calculation, the determined pitch is converted into pattern information corresponding to it, and the display is displayed. a central control unit that performs a predetermined control operation according to the mode of display on the display screen; and a video display processor to which output data from the central control unit is applied;
A musical note display device 4 configured to display musical notes in corresponding portions of a staff-like display figure on the display surface of the display, an anamig/digital conversion means for converting an audio signal into a digital signal, and the above-mentioned digital signal. means for performing frequency analysis using the above frequency analysis results, means for determining the pitch of the audio signal based on the frequency analysis results, and means for determining the pitch of the sound in the staff-like display figure on the display surface of the display. means for displaying the judgment result of the above-mentioned sound taste judgment means in a musical note-like figure at a predetermined repetition period; A musical note display device comprising an image recording means for sequentially recording video signals for frames.