JP6828549B2 - Score display method, score display device, score display program - Google Patents

Description

The present invention relates to a score display method, a score display device, and a score display program.

For example, there is known a score display device that displays a score on a display unit and automatically updates the display of the score in response to playback of a musical piece corresponding to the score (see Patent Document 1 below). Further, in an electronic book, a technique is also known in which an original page position marker is added to the page position displayed when the slide bar is displayed, and the original page can be easily returned to the original page when a page jump operation is performed. (See Patent Document 2 below).

Japanese Unexamined Patent Publication No. 2013-68899 Japanese Unexamined Patent Publication No. 2015-184784

Here, for example, in addition to displaying the score described in Patent Document 1, a slide bar in which all pages of the score are represented by a number line is displayed, and the page position of the currently displayed score is displayed on the slide bar. Can be considered. As a result, the user can grasp the current page position of the score among all the pages of the score. However, when the page of the displayed score is changed, it may be difficult for the user to grasp the page before the change. For example, when a user is playing by displaying a score on a display unit, the score may be returned and displayed on several pages by the repetition symbol of the score. At this time, if the display of the score shifts to another page, it may be difficult to grasp the page before the repetition. For example, as disclosed in Patent Document 1, when the score automatically turns pages following a performance, if the page is automatically changed by the repetition symbol, the user grasps the page before the repetition. Becomes difficult.

In view of the above, the present invention provides a score display method, a score display device, and a score display program that make it easier to grasp the page before the transition even when the displayed score page is transitioned. Realize.

In the score display method of the present invention, a score image of a designated page is displayed on the display unit based on the score data composed of a plurality of pages, and page information based on the number of pages of the score data is displayed on the display unit. Based on the score data, the first page position identification information representing the page position of the currently displayed score is displayed in the first mode in association with the page information, and is displayed immediately before the currently displayed score. The second page position identification information representing the page position of the score is associated with the page information and displayed in a second aspect different from the first aspect.

The score display device of the present invention has a score display control unit that displays a score image of a designated page on a display unit based on score data composed of a plurality of pages, and page information based on the number of pages of the score data. The page information display control unit to be displayed in the unit and the first page position identification information indicating the page position of the currently displayed score based on the score data are displayed in the first mode in association with the page information, and are currently displayed. Page position identification information display control that associates the second page position identification information representing the page position of the score displayed immediately before the displayed score with the page information and displays it in a second mode different from the first mode. Including the part.

The score display program of the present invention includes a score display control unit that displays a score image of a designated page on a display unit based on score data composed of a plurality of pages, and the display unit that displays page information based on the number of pages of the score data. Based on the page information display control unit to be displayed on the screen and the score data, the first page position identification information representing the page position of the currently displayed score is displayed in the first mode in association with the page information, and is currently displayed. Page position identification information display control that associates the second page position identification information representing the page position of the score displayed immediately before the displayed score with the page information and displays it in a second mode different from the first mode. Make the computer function as a department.

Further, in the score display method of the present invention, the page of the score is displayed on the display unit based on the current playing position of the score, and the page information based on the number of pages of the score is displayed on the display unit. Based on the playing position of, the playing position identification information representing the current playing position is displayed in association with the page information, and it is determined whether or not the current playing position has reached the repeating position representing the repetition in the score. Then, when it is determined that the current playing position has reached the repeating position, the repeating identification information representing the repeating position is displayed in association with the page information.

The score display device of the present invention displays a score display control unit that displays the page of the score on the display unit based on the current playing position of the score, and page information based on the number of pages of the score on the display unit. A page information display control unit, a performance position identification information display control unit that displays performance position identification information representing the current performance position in association with the page information based on the current performance position, and the current performance position. A repeat determination unit for determining whether or not has reached a repeat position representing a repeat in the score, and a repeat identification information representing the repeat position when it is determined that the current playing position has reached the repeat position. Includes a repeat identification information display control unit that displays the page information in association with the page information.

The score display program of the present invention includes a score display control unit that displays the page of the score on the display unit based on the current playing position of the score, and a page that displays page information based on the number of pages of the score on the display unit. The information display control unit, the performance position identification information display control unit that displays the performance position identification information representing the current performance position in association with the page information based on the current performance position, and the current performance position is the score. The repeat determination unit for determining whether or not the repeat position representing the repetition in the above is reached, and the page information for the repeat identification information indicating the repeat position when it is determined that the current playing position has reached the repeat position. The computer functions as a repeat identification information display control unit that is displayed in association with.

It is a figure which shows an example of the musical score display device. It is a figure which shows an example of the outline of the hardware structure of the musical score display device of FIG. It is a figure which shows an example of the outline of the functional structure of the control part shown in FIG. It is a figure for demonstrating the display on a display part. It is a figure for demonstrating the display on a display part. It is a figure for demonstrating the display on a display part. It is a figure for demonstrating the display on a display part. It is a figure which shows an example of the flow of the music score display apparatus processing.

FIG. 1 is a diagram showing an example of a score display device according to an embodiment of the present invention. The score display device 100 has a display unit 101 (touch panel). Then, information can be input to the score display device 100 by, for example, a user performing a touch operation (hereinafter, referred to as “touch”) on the display unit 101 with a finger or the like. Specifically, the score display device 100 corresponds to, for example, a mobile terminal such as a tablet or a smartphone, or a mobile electronic device such as a PDA (Personal Digital Assistance). Further, the score display device 100 may be configured as an electronic book terminal or as hardware dedicated to displaying the score. The method of the display unit 101 includes, for example, a capacitance coupling method for detecting a capacitance change in the touched portion, a resistance film method for detecting a resistance value change, or a light amount change in the portion shielded by the touch. Use an optical sensor method or the like to detect.

FIG. 2 is a diagram for explaining an example of an outline of the hardware configuration of the score display device. As shown in FIG. 2, the score display device 100 includes a control unit 201, a storage unit 202, an operation unit 203, a display unit 101, and a communication unit 204. The units 201 to 204 and the display unit 101 are connected to each other by an internal bus.

The control unit 201 is, for example, a CPU or a control circuit, and operates according to a program stored in the storage unit 202. The storage unit 202 is an information recording medium composed of, for example, an information recording medium such as a ROM, a RAM, or a hard disk, and holds a program executed by the control unit 201. The storage unit 202 also operates as a work memory for the control unit 201.

The program may be downloaded and provided via a network, for example, or may be provided by various computer-readable information recording media such as a CD-ROM and a DVD-ROM. ..

The operation unit 203 is configured as a so-called touch panel, for example, together with the display unit 101 described later, and outputs the content of the instruction operation to the control unit 201 in response to the user's instruction operation. The display unit 101 is, for example, a liquid crystal display, an organic EL display, or the like, and displays information according to an instruction from the control unit 201. The communication unit 204 communicates with an external device. Although the operation unit 203 and the display unit 101 are shown separately in FIG. 2, in the present embodiment, for example, the operation unit 203 and the display unit 101 are integrally formed as a touch panel. Further, in the present embodiment, the operation unit 203 other than the touch panel may be configured to have, for example, a button or the like.

Next, using FIG. 3, the functional of the control unit 201 for making it easier to grasp the page before the transition even when the page of the score displayed on the display unit 101 is transitioned. An example of the outline of the configuration will be described. Note that, in FIG. 3, as an example of the case where the page transition of the score is performed, the page transition of the score is performed by the repetition symbol of the score when the user is playing while displaying the score on the display unit 101. Is shown, an example of the functional configuration of the control unit 201 is shown.

The data acquisition unit 301 acquires, for example, score data representing a score, music data representing a song, and reference data associated with the score data corresponding to the song and the song data. Specifically, the musical score data is, for example, image data representing a musical score or MusicXML data. The music data is, for example, MIDI data, Audio data, and moving image data. The reference data is, for example, data in which the position information of the score indicated by the score data and the reproduction position information (time information) indicated by the music data are associated with each other. The data acquisition unit 301 may be configured to have a score data acquisition unit and a music data generation unit. In this case, for example, the score display device 100 has a camera, and the score data acquisition unit is configured to acquire the image data of the score by photographing the score. Then, the music data generation unit image-recognizes each symbol such as a musical note from the image data representing the musical score, and generates music data and reference data based on the recognized image data. When the score data is MusicXML data, the data acquisition unit 301 may generate music data or reference data based on the MusicXML data.

The data acquisition unit 301 may acquire page designation data for designating the page of the score of the score data. Further, the page designation data may be acquired based on the performance data described later. That is, the page designation data that specifies the page including the current performance position among all the pages of the score may be acquired based on the performance data. Alternatively, the page designation data may be acquired from the outside of the score display device 100 via the communication unit 204, or may be acquired from the inside of the score display device 100, for example, from the tap determination unit 315 or the swipe determination unit 304 described later. You may.

The performance data acquisition unit 302 acquires performance data. Here, the performance data is data based on the performance of the user's musical instrument or the like, and corresponds to, for example, musical sound data based on the performance of the musical instrument or the like.

The display unit information acquisition unit 303 acquires display unit information representing the display unit of the score to be displayed on the display unit 101, for example, one page unit, two page units, and the like. The display unit may be, for example, a partial enlargement of a half page or the like when a part of one page of the score is enlarged and displayed.

The swipe determination unit 304 determines whether or not the swipe has been performed. Swipe is an operation of moving a finger or the like touched on the touch panel in a certain direction by the user. As will be described later, when the swipe determination unit 304 determines that the swipe has been performed, the page of the score displayed on the display unit 101 is advanced or returned.

The score display control unit 305 causes the display unit 101 to display the score represented by the score data based on the display unit information acquired by the display unit information acquisition unit 303. For example, when the display unit is one page unit, the score is displayed page by page. When the swipe determination unit 304 detects a swipe, the score display control unit 305 causes the display unit 101 to display the score page by page in order according to the swipe. For example, when a swipe is made to the left (or upward), the score display control unit 305 advances the score displayed on the display unit 101 by one page, and the swipe is made to the right (or downward). In this case, the score display control unit 305 returns the score displayed on the display unit 101 by one page.

Further, the score display control unit 305 causes the display unit 101 to display the score of the designated page in the display unit indicated by the display unit information, based on the page designation data and the display unit information. For example, if the display unit is a 2-page unit and the page designation data specifies the 3rd page, the scores on the 3rd and 4th pages are displayed.

Further, the score display control unit 305 causes the display unit 101 to automatically update the display of the corresponding score according to the progress of the performance of the score based on the performance data described later. For example, when the display unit is a 2-page unit and the user is playing a part in the score on the 3rd page (that is, when the page designation data for designating the 3rd page is acquired based on the performance data). Displays the scores on the third and fourth pages. It should be noted that such a technique is called score alignment, and can be realized by using, for example, the technique described in JP-A-2015-79183.

Further, when the tap determination unit 315, which will be described later, determines that an area within a predetermined range from the display position of the repeat identification information has been tapped, the score display control unit 305 is one of the scores corresponding to the repeat identification information. Display the part. Details will be described later (see FIGS. 4 to 7).

The repetition symbol identification display control unit 306 identifies and displays the repetition symbol in the score displayed by the score display control unit 305. Details will be described later.

The page information generation unit 307 generates page information based on the number of pages of the score, for example, based on the score data. The page information display control unit 308 causes the display unit 101 to display the page information generated by the page information generation unit 307. Here, the page information corresponds to, for example, information representing a page of the entire score. Specifically, for example, the page information displayed by the page information display control unit 308 has a bar shape and is displayed as a so-called scroll bar displayed above or below the score. The scroll bar is an object displayed on the display unit 101, and each page (or each position) of the score is associated with each point on the object. The page information may be displayed as the object other than the scroll bar, and may be displayed as the object having another shape such as a circular shape, for example.

The page position identification information display control unit 309 displays the first page position identification information representing the page position of the currently displayed score in association with the page information. Here, the page position is the position of the currently displayed page in all the pages of the score. For example, the page position identification information display control unit 309 displays the first page position identification information in association with the position corresponding to the currently displayed page on the page information (for example, on the position). Further, when the page transition of the score is performed, the page position identification information display control unit 309 displays the first page position identification information in association with the page information in the first mode, and the currently displayed score. The second page position identification information indicating the page position of the score displayed immediately before is associated with the page information and displayed in a second mode different from the first mode.

As described above, here, the configuration of the page position identification information display control unit 309 will be described by taking as an example the case where the page transition of the score is performed by the repetition symbol of the score. As shown in FIG. 3, the page position identification information display control unit 309 includes a performance position identification information display control unit 311 and a repeat identification information display control unit 314, which will be described later. Details of these will be described later (see FIGS. 4 to 7).

The performance position information acquisition unit 310 sequentially acquires and stores the performance position information representing the current performance position in the page information based on the acquired performance data, for example. Specifically, for example, the performance position information acquisition unit 310 analyzes the acquired performance data to specify the current performance position in the music data. Then, the corresponding current performance position in the page information is specified based on the performance position in the music data. In other words, it identifies the page containing the current playing position among all the pages of the score.

The performance position identification information display control unit 311 causes the display unit 101 to display the performance position identification information indicating the current performance position in the page information based on the performance position information acquired by the performance position information acquisition unit 310. In other words, the performance position identification information (corresponding to the above-mentioned first page identification identification information) representing the page including the current performance position among all the pages of the score is displayed. Details will be described later (see FIGS. 4 to 7).

The repetition determination unit 312 determines whether or not the current performance position has reached the repetition position (for example, the repetition symbol) representing the repetition of the score, based on, for example, the performance position information and the score data. When it is determined that the current performance position has reached the repeat position, the repeat position information acquisition unit 313 acquires and holds the repeat position information indicating the position in the page information of the repeat position. The repeat identification information display control unit 314 causes the display unit 101 to display the repeat identification information indicating the repeat position in the page information based on the repeat position information. In other words, the repeat identification information (corresponding to the above-mentioned second page position identification information) representing the page including the repeat position among all the pages of the score is displayed. The repetitive identification information displayed by the repetitive identification information display control unit 314 and the performance position identification information displayed by the performance position identification information display control unit 311 are displayed in different modes and are displayed so as to be distinguishable from each other. To.

The tap determination unit 315 determines whether or not a region within a predetermined range (a region around the display position of the repeat position information) has been tapped from the display position of the repeat identification information. The area corresponds to, for example, the tap detection area 601 described later. Details will be described later (see FIG. 7).

Next, a case where the display on the display unit 101 of the score display device 100 transitions from the state of FIG. 4 to the state of FIG. 7 in order when the user displays the score on the display unit 101 and plays the music will be described. To do.

As shown in FIG. 4, the score display control unit 305 causes the display unit 101 to display a page of the score including the current playing position. The page information display control unit 308 displays the page information as the scroll bar 400. The performance position identification information display control unit 311 displays the performance position identification information (first page position identification information) representing the page including the current performance position on the scroll bar 400 as the performance position identifier 401. The repetition symbol identification display control unit 306 displays the repetition symbol identifier 402-1 (repetition symbol identification information) on the score in a manner different from the bar line so that the repetition symbol can be identified. For example, the color of the repeat symbol identifier 402-1 may be changed to a bar line. When the user taps an arbitrary position of the scroll bar 400, the score display control unit 305 causes the display unit 101 to display the page of the score corresponding to the arbitrary position.

Assuming that the performance by the user progresses and the performance is performed up to the repeat symbol identifier 402-1 (repeat symbol), the performance position is returned to the front by the repeat symbol identifier 402-1, and as shown in FIG. 5, the repeat symbol identifier 402-2 Immediately after (start position of repetition). At this time, as the playing position changes, the page of the score displayed on the display unit 101 also changes, and the page including the new playing position is displayed on the display unit 101. At this time, the performance position identification information display control unit 311 displays the performance position identification information (first page position identification information) representing the page including the current performance position on the scroll bar 400 as the performance position identifier 401. .. Further, the repeat identification information display control unit 314 repeats the repeat position information (second page position identification information) representing the page including the repeat symbol identifier 402-1 (that is, the page displayed immediately before the page transition). It is displayed on the scroll bar 400 as the position identifier 501. As shown in FIG. 5, the performance position identifier 401 and the repeat position identifier 501 are displayed in different modes from each other. In the example shown in FIG. 5, these are displayed in different colors, but they may be displayed in different shapes or the like. The repetition symbol identification display control unit 306 may also display the repetition symbol identifier 402-2 (repetition symbol identification information) in a mode different from that of the bar line so that the repetition symbol can be identified.

Now, suppose the user wants to display a score that includes the repeat symbol identifier 402-1. At this time, as shown in FIG. 6, the repeat identification information display control unit 314 sets a region within a predetermined distance from the repeat position identifier 501 as the tap detection region 601. The tap detection area 601 is set in association with the display of the repeat position identifier 501. When the user taps the tap detection area 601, the tap determination unit 315 determines that the tap detection area 601 has been tapped. At this time, the score display control unit 305 displays the page of the score corresponding to the repeat position identifier 501 on the display unit 101. That is, as shown in FIG. 7, the score display control unit 305 is a page of the score including the repeat symbol identifier 402-1 (that is, the page displayed before the transition to the page shown in FIG. 5 is performed). Is displayed on the display unit 101.

Next, an example of the processing flow of the score display device 100 in the present embodiment will be described. In the following, for the sake of simplification of the explanation, the flow from data acquisition to the transition from the tap detection area 601 to the page of the score before the repetition will be described as an example. It is not limited to.

As shown in FIG. 8, the data acquisition unit 301 acquires, for example, score data representing a score, music data representing a song, and reference data associated with the score data corresponding to the song and the song data (S101). The page information generation unit 307 generates page information (S102). The score display control unit 305 causes the display unit 101 to display the initial page of the score, and the page information display control unit 308 causes the display unit 101 to display the page information generated by the page information generation unit 307 (S103).

The performance data acquisition unit 302 acquires performance data (S104). The performance position information acquisition unit 310 acquires performance position information representing the current performance position (S105). The performance position identification information display control unit 311 displays the performance position identification information on the page information (S106). At this time, the score display control unit 305 causes the display unit 101 to display a page including the current performance position. For example, when a certain page in the score with the current playing position moves to another page, the score display control unit 305 causes the display unit 101 to display the other page.

The repetition determination unit 312 determines whether or not the current playing position has reached the repetition position of the score (S107). When the repeat position information acquisition unit 313 determines that the repeat position has been reached, the repeat position information acquisition unit 313 acquires and holds the repeat position information representing the position in the page information of the repeat position (S108). The repetitive identification information display control unit 314 displays the repetitive identification information on the page information (S109). At this time, if the current playing position is moved to another page in the score by the repetition symbol, the score display control unit 305 causes the display unit 101 to display the other page. Further, the performance position identification information display control unit 311 changes the display position of the performance position identification information according to the position (new performance position) of the other page. On the other hand, when the repetition determination unit 312 determines that the repetition position has not been reached, the process returns to S104.

The tap determination unit 315 determines whether or not the peripheral area (tap detection area 601) of the position in the page information indicated by the repeated position information has been tapped (S110). When it is determined that the tap has been made, the score display control unit 305 causes the display unit 101 to display the page of the score corresponding to the repeating position (S111). At this time, the performance position identification information display control unit 311 changes the display position of the performance position identification information according to the position (new performance position) of the page. Then, the process ends. On the other hand, if it is determined that the tap has not been tapped, the process returns to S110.

According to the present embodiment, a score display method and a score display device that enable the user to more easily grasp the page before the transition even when the page of the displayed score is transitioned. , A score display program can be realized. For example, even when the page of the score displayed by the repetition symbol is changed, the score display method, the score display device, and the score allow the user to easily grasp the page before the repetition. A display program can be realized.

The present invention is not limited to the above-described embodiment, and is substantially the same as the configuration shown in the above-described embodiment, has the same effect and effect, or can achieve the same object. May be replaced with.

For example, in the above, as an example of the case where the page transition of the score is performed, the case where the page transition of the score is performed by the repetition symbol of the score while the user is playing while displaying the score on the display unit 101. As described mainly, the present invention can also be applied to the case where the page transition of the musical score is performed by a symbol other than the repeating symbol. For example, when the first user and the second user are playing one song at the same time while looking at each score display device 100, the second user pages the score page displayed on the score display device 100. When the page is changed from A to page B, the page of the score displayed on the score display device 100 of the first user is also a page by transmitting the page designation data specifying page B to the score display device 100 of the first user. In addition to changing to B, the first page position identifier (similar to the performance position identifier 401) indicating the position of the currently displayed page B and the position of the page A displayed immediately before are displayed on the scroll bar 400. The second page position identifier (an identifier similar to the repeat position identifier 501) representing the above may be displayed. By doing so, even if the page of the score displayed on the score display device 100 of the first user is changed due to the operation of the second user, the first user can change the page before the transition. Can be grasped more easily. As described above, the present invention can also be applied to the case where the page of the score displayed on the display unit 101 is changed due to the operation of another user.

Further, for example, the score display method of the present invention may be applied when displaying an object other than the score.

In addition, Patent Document 2 discloses a configuration in which an original page position marker indicating a page displayed at the time of displaying the slide bar is added to the slide bar, but the present invention is different from the invention described above. And the action and effect are different. Specifically, the first page position identification information indicating the page position of the currently displayed score, which is defined in the claims of the present application, is associated with the page information and displayed in the first mode (for example, on the scroll bar), and is currently displayed. Patent Document 2 describes a configuration in which the second page position information indicating the page position of the score displayed immediately before the displayed score is associated with the page information and displayed in a second mode different from the first mode. Not disclosed.

100 sheet music display device, 101 display unit, 201 control unit, 202 storage unit, 203 operation unit, 204 communication unit, 301 data acquisition unit, 302 performance data acquisition unit, 303 display unit information acquisition unit, 304 swipe judgment unit, 305 sheet music Display control unit, 306 repeat symbol identification information display control unit, 307 page information generation unit, 308 page information display control unit, 309 page position identification information display control unit, 310 performance position information acquisition unit, 311 performance position identification information display control unit 312 Repeat judgment unit, 313 Repeat position information acquisition unit, 314 Repeat identification information display control unit, 315 Tap judgment unit, 400 Scroll bar, 401 Play position identifier, 402-1, 402-2 Repeat symbol identifier, 501 Repeat identifier, 601 Tap detection area.

Claims (6)

Based on the score data consisting of multiple pages, the score image of the specified page is displayed on the display.
Page information based on the number of pages of the score data is displayed on the display unit, and the page information is displayed.
Based on the score data, the first page position identification information representing the page position of the currently displayed score is displayed in the first mode in association with the page information, and is displayed immediately before the currently displayed score. The second page position identification information representing the page position of the score is associated with the page information and displayed in a second mode different from the first mode.
It is a score display method ,
Based on the current playing position of the score, the score image of the page including the current playing position is displayed on the display unit.
The first page position identification information representing the page position of the score including the current playing position is displayed in the first aspect in association with the page information.
When the current playing position reaches the repeating position representing the repetition in the score, the second page position identification information representing the page position of the score including the repeating position is associated with the page information in the second aspect. Display with,
How to display the score . The page of the score is displayed on the display based on the current playing position of the score.
Page information based on the number of pages of the score is displayed on the display unit.
Based on the current performance position, the performance position identification information representing the current performance position is displayed in association with the page information.
It is determined whether or not the current playing position has reached the repeating position representing the repetition in the score.
When it is determined that the current playing position has reached the repeating position, the repeating identification information representing the repeating position is displayed in association with the page information.
How to display the score. The score display method further determines whether or not the peripheral area of the repeated identification information has been tapped.
When it is determined that the peripheral area has been tapped, the page of the score corresponding to the repeated identification information is displayed on the display unit.
The score display method according to claim 2 . The score display method according to claim 2 or 3 , wherein the performance position identification information and the repeat identification information are displayed so that they can be distinguished from each other. A score display control unit that displays the page of the score on the display unit based on the current playing position of the score,
A page information display control unit that displays page information based on the number of pages of the score on the display unit,
A performance position identification information display control unit that displays performance position identification information representing the current performance position in association with the page information based on the current performance position.
A repeat determination unit that determines whether or not the current playing position has reached a repeat position that represents a repeat in the score.
When it is determined that the current playing position has reached the repeating position, the repeating identification information display control unit that displays the repeating identification information representing the repeating position in association with the page information.
Musical score display device including. A score display control unit that displays the page of the score on the display unit based on the current playing position of the score.
Page information display control unit that displays page information based on the number of pages of the score on the display unit,
A performance position identification information display control unit that displays performance position identification information representing the current performance position in association with the page information based on the current performance position.
A repeat determination unit for determining whether or not the current playing position has reached a repeat position representing a repeat in the score.
A repeat identification information display control unit that displays the repeat identification information representing the repeat position in association with the page information when it is determined that the current performance position has reached the repeat position.
A score display program that makes your computer work as.

Images