JP2001265325A - Score display device and document display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a score display device capable of automatically turning over the pages with an inexpensive configuration. SOLUTION: A display area of a display 12a is divided into an upper area 121 and a lower area 122 bordering a borderline 120. It is calculated to which note of the displayed score the musical sound inputted from a microphone corresponds, and the neighborhood of the note is defined as a noteworthy area noticed by a player, and when this noteworthy area moves down to the lower area 122, the score on the upper area 121 is updated into that on the next page. When the noteworthy area moves up to the upper area 121 from the lower area 122, the score on the lower area is updated into that of the same next page as the upper one.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a score display device and a document display device for displaying a document such as a score over a plurality of pages.

[0002]

2. Description of the Related Art Conventionally, various devices for electrically displaying a musical score on a screen have been proposed. Since many scores cover many pages, the score display device has a display update function of updating the display on the screen at a predetermined timing.

The display updating function of the conventional apparatus includes a function of sequentially displaying a new staff notation while scrolling up from the bottom, and a function of updating the display of the entire screen instantly or by cross-fade or wipe. was there.

[0004]

However, in the above-mentioned scroll system, the displayed musical score moves gradually, so that the line of sight must follow this movement, and the performance is performed as when reading a normal musical score. The line of sight is from left to right,
There is a problem that the natural movement of moving from top to bottom is hindered and reading becomes difficult. In addition, in the method of updating the entire screen, the display of the musical score is interrupted at the moment of updating, so it is difficult to determine the timing of updating the display, and it is necessary to use a fast response device such as a liquid crystal display device. However, there was a problem that it became expensive.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a musical score display device and a document display device capable of displaying a plurality of pages without interruption with an inexpensive configuration.

[0006]

SUMMARY OF THE INVENTION The present invention is a document (score) display device having a so-called page turning function.
Storage means for storing score display data for displaying a score composed of a plurality of pages; display means for displaying a score based on the score display data; and detection means for detecting a position of interest of a user with respect to a display area of the display means And the display means 1
While displaying the score for the page, the display area is divided into an upper area and a lower area, and when the position of interest is in the lower area, the display content of the upper area is updated to the score of the page next to the currently displayed page. Display control means for updating the display content of the lower area to the score of the next page when the attention position is in the upper area.

Further, the present invention provides storage means for storing document display data for displaying a document composed of a plurality of pages, display means for displaying a document based on the document display data, and use of the display means for a display area. Detecting means for detecting the attention position of the user, and displaying one page of the document on the display means, dividing the display area into a first area and a second area, and when the attention position is in the second area. The display content of the first area is updated to the document of the page next to the currently displayed page, and when the target position is in the first area, the display content of the second area is updated to the document of the next page. And display control means.

In the above invention, the target position may be detected by, for example, providing a device for detecting the user's line of sight and setting a position near the position of the user's line of sight as the target position. In the case of a musical score, a musical tone emitted by a user (player) or the like may be input, and a note position corresponding to the musical tone may be set as a target position. Then, the display area of the display means is divided into a first area and a second area with a predetermined position as a boundary, and when the target position shifts to the second area, the first area is updated to the contents of the next page. When the position of interest shifts to the first area, the second area is updated to the contents of the next page. Since the score is written horizontally, the display area is vertically divided, and the display of the upper area is updated when the target position shifts to the lower area, and the display of the lower area is updated when the target position shifts to the upper area.

As described above, by dividing the display area into two and updating the display one by one, the user can see a document such as a musical score composed of a plurality of pages without interruption. Since the display is updated half a page at a time, detection of the target position, determination of the display update timing, and the like are rough and easy to control.

According to the present invention, when pages of a musical score (document) displayed in an upper area (first area) and a lower area (second area) are different, the same page is displayed in both areas. Display mode is different from the display mode. This allows
Even if a document such as a musical score is discontinuous at a predetermined position as a boundary, the user does not make a mistake.

According to the present invention, a storage unit for storing score display data for displaying a score, a display unit for displaying a score based on the score display data, and a position of interest of a user with respect to a display area of the display unit are detected. Detecting means, and display control means for displaying a plurality of music scores on the display means, deleting the music score of the music passage where the target position has passed, and displaying a new music score at the erased position. Features.

Further, according to the present invention, a storage means for storing document display data for displaying a document, a display means for displaying a document based on the document display data, and a position of interest of a user with respect to a display area of the display means. Detection means for detecting, and display control means for displaying a plurality of lines of text on the display means, erasing the text of the line where the target position has passed, and displaying a new line of text at the erased position. It is characterized by the following.

According to the present invention, a musical score of a plurality of columns or a document of a plurality of lines (either vertically or horizontally) is displayed, and the musical score of the column that the user's attention area has passed, that is, the user has read, is displayed. Document) to a new one. By rewriting the contents of the read columns (rows) as described above, new columns (rows) are sequentially displayed without moving the display content, and the display is smooth as in scrolling. Although the display content is updated, the movement of the line of sight remains as natural as when viewing a normal score or document.

Further, in the present invention, the display control means controls to highlight the noted position. Thereby, the concentration of the user can be increased. In addition, even when following a musical score following a record or the performance of another person, it is possible to keep track of where the music is currently being played.

[0015]

FIG. 1 is a block diagram of a musical score display device according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of musical score display data stored in the hard disk 13 or the removable medium (hereinafter, referred to as a medium) 15. This apparatus displays an image of a musical score on a display device 12 using musical score display data stored in a medium 15 set in a hard disk 13 or a media drive 14. Here, as the medium 15, a floppy disk, CD-ROM, MO, D
VD and the like can be adopted, but the present invention is not limited to these.

The operation of the apparatus is controlled by the CPU 10. CP
A memory 11, a display device 12, a hard disk 13, a drive 14, and an interface 16 are connected to U10. A sensor 17 and an operation unit 18 are connected to the interface 16. The display device 12 has a liquid crystal display 12a and a display driver 12b. The liquid crystal display 12a is a matrix display of about 15 inches and is installed vertically. In this embodiment, the display is installed vertically because it is a musical score display device. However, the display may be installed horizontally so that the present invention can be implemented.

The hard disk 13 and the medium 15 store score display data for displaying a score composed of a plurality of pages. Figure 2 shows the basic structure of the score display data.
As shown in (A), it is image data for each page.
This image data is for displaying the score,
The musical note or staff may be raster data expressed by dot matrices, and the musical note or staff may be vector data expressed by a mathematical expression representing the shape. Further, musical tone / coordinate correspondence data as shown in FIG. 3B may be attached to the image data of each page. The musical tone / coordinate correspondence data is obtained by associating sequence data obtained by converting notes represented in a musical score into data and coordinate data indicating at which coordinates of the image data the notes are drawn.
By detecting the musical tone generated by the player playing the instrument and determining which musical tone in the musical tone / coordinate correspondence data is present, it is possible to determine where the player is currently performing, that is, Can be detected.

This apparatus updates the display page of the musical score displayed on the liquid crystal display 12a (page turning) by manual operation of the operation unit 18, detects the player's attention position, and responds to the attention position. You can also turn pages.

The operation unit 18 includes a selection operator for selecting a desired musical score display data from a plurality of musical score display data stored in the hard disk 13 or the medium 15, and a switch for turning pages of the musical score by manual operation. . In this embodiment, a foot switch operated by the left foot is used as a switch for turning a page. The foot switch consists of a forward switch for advancing the page and a backward switch for returning the page.

The sensor 17 is for detecting a position of interest, which indicates a position of the musical score displayed on the display device 12 by the player. This device turns pages of a musical score according to the detected position of interest, but turns pages at different timings in an upper area, which is the upper half of the display area of the liquid crystal display 12a, and a lower area, which is the lower half. That is, the apparatus updates the upper area to display a new page when the target position moves to the lower area, and displays the lower area to display a new (same as the upper half) page when the target position moves to the upper area. Update.

FIG. 3 shows an example of the sensor and the target position detecting device. In this embodiment, the sensor 17 includes a microphone 17a and an ADC 17b. Microphone 17
a converts the musical tone played by the player into an electric signal,
This signal is converted into digital data by the DC 17b. Analysis unit 20 and readout unit 2 of the target position detection device described below
2. The attention coordinate indexing unit 23 is realized as a software function of the CPU 10. The analysis unit 20 includes the ADC 17
The musical tone signal input from b is analyzed to extract the pitch and beat information of the musical tone being pronounced. The beat information is information indicating the ticks of the music being played. The analysis unit 20 inputs the detected beat information to the reading unit 22. The reading section 22 reads out the musical tone / coordinate correspondence data from the musical score display data storage means 21 at a tempo timing based on the input beat information. The read musical tone / coordinate correspondence data is input to the attention coordinate indexing unit 23. The attention coordinate indexing unit 23 is supplied with a plurality of musical tone / coordinate correspondence data in a time zone considered to be currently being played. The attention coordinate determining unit 23 determines which musical tone is currently being generated by comparing the input musical tone / coordinate correspondence data with the output of the analyzing unit 20 (pitch extracting unit 20a), and displays the musical tone. The coordinates or the coordinates of a note several notes ahead of the tone currently being pronounced are output as the position of interest.

The musical tone input to the microphone 17a may be any piano, violin, singing, electronic musical instrument, or the like. In the case of an electronic musical instrument capable of MIDI output, the MID
You may make it input I output data. Further, the playback sound is not limited to the performance sound played by the user, and may be a playback sound obtained by playing a record. When a device that directly detects the player's line of sight is used as the attention position detection device, the tone / coordinate correspondence data of the score display data is unnecessary.

FIG. 4 is a flowchart showing the operation of the musical score display device. FIG. 5 is a diagram showing a display example of the musical score display device. The user (player) operates the music selection switch of the operation unit 18 to operate the hard disk 13 or the media 1.
Then, one is selected from the score display data stored in No. 4 (s1). The selected musical score display data is read, and the (first musical score) of the first page is displayed (s2). Note that a page designation operation element may be provided in the operation unit 18 so that a page number to be displayed first can be designated, and the page designated in s2 may be displayed.

Thereafter, the position of interest is displayed on the display 12a.
(S3), the forward switch or the reverse switch of the pedal switch is turned on (s3).
It waits until judgment of (4, s5). The position of interest is shown in FIG.
As shown in (1), detection is performed based on the musical sound generated by the player. In addition, s3 is not determined at the moment when the target position exceeds the boundary 120 set (virtually) at the center of the display 12a, but is determined when the target position is stabilized in the lower region. Make a decision.

Whether the target position is stable in the lower region (s3),
Or, when the forward switch is turned on (s4), unless the currently displayed page is the last page (s4).
6) The image displayed in the upper area of the display 12a is switched to the image of the score of the next page (s7). When the backward switch is turned on (s5), the image displayed in the lower area of the display 12a is switched to the image of the score of the previous page unless the currently displayed page is the first page (s8). (S9). Thereafter, the operation proceeds to the operation of s11 and below.

By the above operation, different pages are displayed in the upper and lower areas on the display 12a as shown in FIG. 5B or 5C. In this case, the page displayed in the upper area is one page ahead of the page displayed in the lower area. When the pages displayed in the upper and lower areas are different, the display mode is changed so that the display of the upper area is slightly shifted, so that the pages appear to be overlapped, and the page is different for the player in the upper and lower areas. Let them know

The operation after s11 is shown in FIGS. 5B and 5C.
This is an operation in a state where different pages are displayed in the upper and lower regions as shown in FIG. Attention position is display 12a
The process waits until it is determined that it has moved to the upper region 121 (s11) and that the forward switch or the reverse switch of the pedal switch has been turned on (s12, s13). s11
Determines YES when the target position is stabilized in the upper region 121 of the display 12a.

The target position is the upper region 1 of the display 12a.
If it is stable at 21 (s11) or if the forward switch is turned on (s12), the display 12 is displayed unless the currently displayed page is the last page (s14).
The image displayed in the lower area 122 of a is updated to the image of the score of the next page (s15). When the backward switch is turned on (s13), the display 12a is turned on unless the currently displayed page is the first page (s16).
Is updated to the image of the score of the previous page (s17). Thereafter, the process returns to s3.

With the above operation, the score of the same page is displayed on the entire display 12a as shown in FIG.

When another page is displayed in the upper and lower areas, as shown in FIG. 5B, the boundary 120 of the upper and lower areas is movably set at a position where the staff is not cut off in the middle of the step. Although the upper and lower regions may be divided, FIG.
As shown in (1), the upper and lower regions may be divided by simply setting the boundary line 120 fixedly at the center without considering the staff notation. If the display is updated with a sufficient margin after the point of interest moves beyond the boundary line 120, the display will not be updated when the staff near the center is read. Even if the nearby staff breaks in the middle of the column, there is no effect on the performance.

In the above operation, the last page is kept displayed even after the performance is finished. However, the display may be deleted by providing an erasing operator in the operation unit 18.

As described above, the switching timing of the page may be set within a time width in which the performance progresses by half a page of the score, so that the page can be switched with a sufficient margin, and The detection may be rough. In addition, since the response of the display does not need to be high-speed, in the case of a liquid crystal display, it is not necessary to use a TFT, and STN is sufficient.

In the above embodiment, the image data of one page unit is stored as the score display data, and the page turning is performed by half of the screen. However, the score display data is stored in a format that can be displayed by the line. The displayed music can be switched in units of one or several lines. With reference to FIGS. 6 to 8, another embodiment of the present invention, a musical score display device for switching musical scores in units of one or several lines, will be described.

The hardware configuration of this embodiment is the same as that of the first embodiment, and a description thereof will be omitted. FIG. 6 is a diagram showing the score display data stored in the hard disk 13 or the medium 15. This score display data is
It is almost conforming to standard MIDI data or of a format that can be converted to standard MIDI data.

FIG. 7 is a flowchart showing the operation of the musical score display device according to the embodiment. First, a performance start position is set (s21). The musical score for one screen is displayed from the set position (s22). Thereafter, when the player starts playing (s23), the player inputs the performance sound and detects the current target position (s24). The target position is a note several ahead of the note of the input performance sound. When the score at that position is highlighted (s25), and the display shifts to a lower stage beyond the break of the staff line (s26), the display of the played stage is updated to the next stage (s27). ), Return to s24.

The method of emphasizing display includes a method of changing the display color only for that portion or displaying a thick line, but other methods may be used, and the emphasis method is arbitrary. By highlighting the attention position, the user does not lose sight of where the music is currently being played even when following the music score following the record or the performance of another person.

As shown in FIG. 8, the update of the row does not move the displayed staff, but deletes the row of the played staff and displays the new staff at that position. I do. In addition,
In this embodiment, the display is updated line by line. However, the display may be updated in units of a plurality of lines such as two lines. Also in this embodiment, the display in units of rows can be updated by manual operation of the operation unit 18 (foot pedal).

In the first embodiment, image data for each page is stored as musical score display data. However, in the first embodiment, M data similar to the second embodiment is stored.
Data similar to the IDI data may be stored as musical score display data, and image data for each page may be drawn and displayed.

In the above embodiment, the musical score display device has been described as an example. However, the display content of the present invention is not limited to the musical score, but may be a text such as an electronic book or a text downloaded from the Internet by streaming. It is also possible to realize as a document display device for displaying a document.

Here, in the case of a horizontally written document, the position of interest moves as shown in FIG. 9A, as in the case of the above-described musical score display device, but in the case of a vertically written document, as shown in FIG. 9B. In the first embodiment, the display area is divided into right and left, and the rows are sequentially updated from the right in the second embodiment.

The display may be vertically long as in the above embodiment, or may be horizontally long. The invention of the present application can be implemented in any of the installation forms.

[0042]

As described above, according to the present invention, when updating the display of a document such as a musical score, by updating each half of the page, the user can read continuously without interruption. Automatic page turning is possible by detecting the target position and updating the page, but by detecting the display half a page at a time, the detection accuracy of the target position may be rough. A display means having a slow response can be used.

Further, according to the present invention, the display content is updated smoothly as in the case of scrolling, but the display does not move, so that the user can read with a natural movement of the line of sight.

[Brief description of the drawings]

FIG. 1 is a block diagram of a musical score display device according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of score display data used in the score display device.

FIG. 3 is a configuration diagram of an attention position detection device of the musical score display device.

FIG. 4 is a flowchart showing the operation of the musical score display device.

FIG. 5 is a diagram showing a display example of the musical score display device.

FIG. 6 is a diagram showing a configuration of score display data used in a score display device according to another embodiment of the present invention.

FIG. 7 is a flowchart showing the operation of the musical score display device.

FIG. 8 is a diagram showing a display example of the musical score display device.

FIG. 9 is a view for explaining the movement of the user's line of sight;

[Explanation of symbols]

10 CPU, 11 memory, 12 display device, 12a
... Display, 12b ... Display driver, 13
... Hard disk, 14 ... Media driver, 15 ... Removable media, 16 ... Interface, 17 ... Sensor, 17a ... Microphone, 17b ... ADC, 18 ... Operation unit, 20 ... Analysis unit, 20a ... Pitch extraction unit, 20b ... Beat extraction Section, 21 ... score / coordinate correspondence data storage section, 22 ...
Readout unit, 23: attention coordinate indexing unit

Claims (8)

[Claims] 1. A storage means for storing score display data for displaying a score composed of a plurality of pages, a display means for displaying a score based on the score display data, and a position of interest of a user with respect to a display area of the display means. And a display means for displaying one page of the score, dividing the display area into an upper area and a lower area, and presenting the display content of the upper area when the target position is in the lower area. And a display control unit that updates the score of the next page after the current page and updates the display content of the lower region to the score of the next page when the position of interest is in the upper region. 2. The score display apparatus according to claim 1, wherein the display control means changes the display mode of the display means when the score page displayed in the upper area and the score page displayed in the lower area are different from each other. 3. A storage means for storing score display data for displaying a score, a display means for displaying a score based on the score display data, and a detection means for detecting a position of interest of a user with respect to a display area of the display means. And a display control means for displaying, on the display means, a plurality of musical scores, erasing the musical score of the tier where the target position has passed, and displaying a new musical score at the erased position. 4. The score display apparatus according to claim 3, wherein the display control means highlights the position of interest. 5. A storage means for storing document display data for displaying a document composed of a plurality of pages, a display means for displaying a document based on the document display data, and a user's attention position with respect to a display area of the display means. And a display unit for displaying a one-page document, dividing the display area into a first area and a second area, and setting the first area when the attention position is in the second area. Display control means for updating the display content of the second page to the document of the next page after the currently displayed page, and updating the display content of the second area to the document of the next page when the position of interest is in the first area. And a document display device comprising: 6. The document display according to claim 5, wherein the display control means changes the display mode of the display means when the page of the document displayed in the first area and the page of the document displayed in the second area are different. apparatus. 7. A storage device for storing document display data for displaying a document, a display device for displaying a document based on the document display data, and a detection device for detecting a position of interest of a user with respect to a display area of the display device. And a display control means for displaying, on the display means, a plurality of lines of the document, erasing the document of the line where the target position has passed, and displaying a new line of the document at the erased position. 8. The document display device according to claim 7, wherein the display control means highlights the position of interest.