JP2013037238A - Electronic music device and program for realizing control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic music device capable of easily inputting a music score by rough touch operation, and further to provide a program for realizing a control method thereof.SOLUTION: When a user touches keys corresponding to, for example, do C4, mi E4 and sol G4 by the user's fingers on a keyboard portion 2b1, colors of the touched keys are changed and the user is informed of selection states of the touched keys, (a). In the next place, when the user touches any position on a note displaying portion 2b2 in a state that the keys of the keyboard part 2b1 are selected, a grid array nearest a touched position is determined, and notes are input to grids corresponding to selected pitches out of grids belonging to the determined grid array, (b). In addition, by performing dragging operation in a time axis direction on the note displaying portion 2b2, note lengths of the input notes can be also specified. The touched position on the note displaying portion 2b2 is not limited to positions in the grids corresponding to the keys selected on the keyboard part 2b1 and may be any position, if the touched position is positioned in the same grid array to which the grid belongs.

Description

  The present invention relates to an electronic music apparatus that includes a touch panel display having a multipoint recognition function, and that can input a score using the touch panel display, and a program for realizing a control method thereof.

  A DAW (digital audio workstation) for music production and software for music score creation are installed in a PC (personal computer), and music production or music score creation on the PC is generally performed. With these software, the user can input the pitch of a note (note) and the length of the note while visually confirming by piano roll input (see, for example, Patent Documents 1 and 2).

  In music production and score creation on such a PC, (i) it is not possible to easily enter notes on the go, and (ii) it is complicated to input notes one by one using a mouse or keyboard. (Iii) Connecting a MIDI (musical instrument digital interface) keyboard to a PC to input MIDI data has problems such as a large amount of equipment and troublesome use of a mouse and a MIDI keyboard.

  In order to deal with these problems, there is also a technique for producing a music piece or creating a score using a portable terminal having a touch panel display. If it is a portable terminal, (i) it can be carried, (ii) it can be operated intuitively with a touch panel, and (iii) no input device (mouse, keyboard, etc.) is required. The above problem in creation is solved.

JP-A-1-321484 JP 2006-267667 A

  However, in the above conventional technique, since the operation performed on the PC is simply replaced with the operation on the touch panel as it is, the complexity of the operation is not completely eliminated. For example, select one of the buttons from the note length setting palette where a large number of buttons (buttons assigned to eighth notes, quarter notes, etc.) are arranged, or specify the exact position where you want to input the notes on the piano roll. For example, it is difficult to perform detailed operations that have been conventionally performed using a mouse by touch operation.

  The present invention has been made paying attention to this point, and provides a program for realizing an electronic music apparatus and a control method thereof capable of easily inputting a score with a rough touch operation. Objective.

  In order to achieve the above object, an electronic music device according to claim 1 includes a touch panel display having a multipoint recognition function, and a first designating unit for designating a pitch of an input note on the touch panel display. Display means for displaying a note input screen including a second designating unit for designating the sounding timing of the input note, and the pitch at the touch position when the user touches the first designating unit. First determination means for determining the input position, second determination means for determining the input position of the input note in the time direction based on the touch position when the user touches the second designation unit, and the user When the second designation unit is touched in a state where the pitch of the input note is designated by touching the first designation unit, the note having the pitch determined by the first determination unit is displayed. And having an input means for inputting the determined input position by said second judging means.

  The electronic music device according to claim 2 is the electronic music device according to claim 1, wherein a pitch of an input note is designated by the user touching the first designation unit, and the user performs the second music operation. When the designated part is touched and moved to a different position on the second designated part while maintaining the touch state, the note length corresponding to the interval from the position before the movement to the position after the movement is It further has setting means for setting as a note length of a note input by the input means.

  The electronic music apparatus according to claim 3 is the electronic music apparatus according to claim 2, wherein the changing means changes the display mode of the area from the position before the movement to the position after the movement on the second designation unit. It further has these.

  In order to achieve the above object, the program according to claim 4 can be realized by the same technical idea as claim 1.

  According to the first or fourth aspect of the invention, the first designation unit for designating the pitch of the input note and the second designation unit for designating the sounding timing of the input note on the touch panel display. When the user touches the first designated portion, the pitch of the touch position is determined, and when the user touches the second designated portion, The input position in the time direction of the input note is determined based on the touch position, and the second designation unit is touched in a state where the pitch of the input note is designated by the user touching the first designation unit. Then, since the note having the determined pitch is input to the determined input position, it is possible to easily input a score by a rough touch operation.

It is a block diagram which shows schematic structure of the electronic music apparatus which concerns on one embodiment of this invention. It is a figure which shows an example of the score input screen displayed on the touchscreen display of FIG. 1 when the score creation mode is selected as an operation mode. It is a figure for demonstrating the score input process in the staff score display screen displayed on the touchscreen display of FIG. It is a figure for demonstrating the score input process in the piano roll display screen displayed on the touchscreen display of FIG. It is a figure for demonstrating the rotation process of each display component in the staff score display screen of FIG. 3, and the piano roll display screen of FIG. It is a flowchart which shows the procedure of the main routine which the electronic music apparatus of FIG. 1, especially CPU performs. It is a flowchart which shows the detailed procedure of the input note designation | designated process # 1 performed when the staff score display screen is selected among the input note designation | designated processes in the main routine of FIG. It is a flowchart which shows the detailed procedure of input position designation | designated processing # 1 performed when the staff score display screen is selected among the input position designation | designated processes in the main routine of FIG. It is a flowchart which shows the detailed procedure of the input note designation | designated process # 2 performed when the piano roll display screen is selected among the input note designation | designated processes in the main routine of FIG. It is a flowchart which shows the detailed procedure of the input position designation | designated process # 2 performed when the piano roll display screen is selected among the input position designation | designated processes in the main routine of FIG. It is a flowchart which shows the detailed procedure of process # 1 according to operation in the main routine of FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of an electronic music apparatus according to an embodiment of the present invention.

  As shown in the figure, the electronic music apparatus of the present embodiment includes a setting operator 1 including a plurality of switches for inputting various types of information, and various UIs including a GUI (graphical user interface) for creating a score. a user interface), and a touch panel display (hereinafter abbreviated as “touch panel”) 2 for inputting various information by touching various UI displayed by the user with a finger, for example, and operation of the setting operator 1 A detection circuit 3 for detecting a state, a detection circuit 4 for detecting a pressing operation such as an operation position or an operation pressure on the touch panel 2 by a user, a display circuit 5 for displaying the various UIs on the touch panel 2, and an entire apparatus The CPU 6 that controls the control, the control program that the CPU 6 executes, the ROM 7 that stores various table data, etc., the various input information, the calculation results, etc. A RAM 8 that stores data, a storage device 9 that stores various application programs including the control program, various data, and the like, and an external device 100, and a communication interface (I / F) that transmits and receives data to and from the external device 100 ) 10 and a sound source / effect circuit 11 for converting performance information obtained by playing back a score created using the GUI into a musical sound signal and applying various effects to the musical sound signal, For example, a sound system 12 such as a DAC (digital-to-analog converter), an amplifier, or a speaker is used to convert a musical sound signal from the sound source / effect circuit 11 into sound.

  The above components 3 to 11 are connected to each other via a bus 13, an external device 100 is connected to the communication I / F 10, and a sound system 12 is connected to the sound source / effect circuit 11.

  The touch panel 2 is a panel provided with a multipoint recognition function for recognizing a user's simultaneous pressing operations on a plurality of positions. The electronic music apparatus of the present embodiment assumes a small portable terminal (specifically, a general-purpose slate PC or a smartphone) that can be operated with one hand on the palm. The touch panel 2 is also small.

  The storage device 9 is, for example, a storage medium such as a flexible disk (FD), a hard disk (HD), a CD-ROM, a DVD (digital versatile disc), a magneto-optical disk (MO), and a semiconductor memory, and a driving device thereof. The storage medium may be detachable from the drive device, or the storage device 9 itself may be detachable from the electronic music device of the present embodiment. Alternatively, neither the storage medium nor the storage device 9 may be detachable. As described above, the storage device 9 (the storage medium) can also store the control program executed by the CPU 6. If the control program is not stored in the ROM 7, the control program is stored in the storage device 9. By reading it into the RAM 8, it is possible to cause the CPU 6 to perform the same operation as when the control program is stored in the ROM 7. In this way, control programs can be easily added and upgraded.

  In the illustrated example, the external device 100 is connected to the communication I / F 10, but the present invention is not limited to this. For example, a server computer is connected via a communication network such as a LAN (local area network), the Internet, or a telephone line. You may be made to do. In this case, if the above programs and various parameters are not stored in the storage device 9, the communication I / F 10 is used to download the programs and parameters from the server computer. The electronic music apparatus serving as a client transmits a command requesting download of a program and parameters to the server computer via the communication I / F 10 and the communication network. Upon receiving this command, the server computer distributes the requested program or parameter to the electronic music device via the communication network, and the electronic music device receives the program or parameter via the communication I / F 10. Downloading is completed by accumulating in the storage device 9.

  As the communication I / F 10, for example, a music dedicated wired I / F that exclusively transmits and receives a music signal such as a MIDI signal, a general-purpose short-distance wired I / F such as USB (universal serial bus) and IEEE 1394, and Ethernet (registered trademark) And general-purpose network I / F such as wireless LAN (local area network) and Bluetooth (registered trademark), and communication I / F for digital telephone network. In this embodiment, a communication I / F for a digital telephone network and / or a wireless LAN is employed as the communication I / F 10.

  FIG. 2 is a diagram showing an example of a score input screen displayed on the touch panel 2 when the score creation mode is selected as the operation mode. The electronic music apparatus of the present embodiment displays a staff score and a keyboard as a score input screen, and uses this to input a score (hereinafter referred to as a “stave score display screen”) 2a (FIG. 2A); 2b (FIG. 2 (c)), which displays a piano roll and uses it to input a musical score (hereinafter referred to as a “piano roll display screen”) 2b, depending on the user's selection operation. , So that you can choose one.

  As shown in FIG. 2 (a), two staff notation 2a1 and one keyboard 2a2 are displayed on the staff notation display screen 2a, and a ruler 2a3 is displayed on each staff notation 2a1. The ruler 2a3 indicates the minimum unit of the note length of the input note. In the example shown in the figure, the one scale of the ruler 2a3 corresponds to the quarter note length, so that the note having the minimum unit of the quarter note length is input. be able to. The length of one scale of the ruler 2a3, that is, the minimum unit of the note length can be freely changed by the user. FIG. 2B is a diagram showing an example of the changing method. As shown in FIG. 5B, when the user presses and holds an arbitrary position on the ruler 2a3, a menu 2a5 in which selectable note lengths are displayed pops up, and it is desired to change from the menu 2a5. Select the note length. Similarly, the clef of the staff 2a1 is also displayed by displaying the menu 2a6 in which selectable clefs are described and selecting a clef to be changed from the menu 2a6. It can be changed to a part name. In this embodiment, the minimum unit of the note length and the clef are changed by pressing and holding the vicinity of the object to be changed to display a menu, and selecting one to be changed is selected. However, the present invention is not limited to this, and the menu may be displayed by pressing any one of buttons 2a4 described later, and the menu to be changed may be selected.

  Returning to FIG. 2A, since the touch panel 2 is a small one as described above, a general keyboard instrument (for example, 88 keys for a piano) having many octaves on the touch panel 2 is used. Since the whole image (the whole keyboard) cannot be displayed (or even if it can be displayed, each key is too small to cause operational problems), the keyboard 2a2 is a part of the whole keyboard (in the illustrated example, 2). It is an octave-like keyboard, but it is not limited to this as long as each key is of a size that can be touch-operated with a finger, and it may be a 1-octave keyboard or a 3-octave keyboard. It is. Since only a part of the keys can be displayed in this way, there is a case where it is desired to display a part that is not displayed. In that case, the user swipes left / right on the keyboard 2a2 (operation to slide his / her finger while touching the touch panel 2), and the keyboard 2a2 scrolls left / right to display keys. The area is changing. Of course, the method of changing the displayed key range is not limited to this, and a displayed scroll range may be changed by displaying a scroll bar near the keyboard 2a2 and performing a swipe operation or a drag operation on the scroll bar. . The user can also display the keyboard 2a2 in an enlarged / reduced manner by performing a pinch operation (operation to open and close two fingers while touching the touch panel 2) on the keyboard 2a2. It is like that.

In addition to this, a plurality of (eight in the illustrated example) buttons 2a4 are also displayed on the staff notation display screen 2a. In the present embodiment, the user can perform the following processing by pressing these buttons 2a4. That is,
(O1) Reading saved musical score data and saving musical score data being displayed (O2) Setting basic information (time signature, key, tempo, etc.) (O3) Setting the minimum unit of note length of input notes ( O4) Input of rests, music symbols, and temporary symbols (O5) Deletion and cancellation of input note data (Undo)
(O6) Switching between the staff score display screen and the piano roll display screen (O7) Changing the operation mode (O8) Other settings can be performed. Here, as the operation mode, in addition to the above “score creation mode”, for example, a “viewing mode” in which the keyboard 2a2 is hidden and used as a mere score is provided. Since which button 2a4 is operated and which of the above processes can be executed is not a feature of the present invention, description thereof is omitted.

  When switching to the piano roll display screen is instructed while the stave display screen 2a is displayed on the touch panel 2, the piano roll display screen 2b is displayed on the touch panel 2 as shown in FIG. Is displayed. However, the piano roll display screen 2b in FIG. 5C is a part of the entire display screen, and actually, in addition to this, a screen corresponding to the button 2a4 in the staff score display screen 2a is also displayed.

  The piano roll display screen 2b is composed of a keyboard portion 2b1 and a note display portion 2b2. As with the keyboard 2a2, the keyboard 2b1 displays a part of the entire keyboard, so that the user can swipe the keyboard 2b1 up / down to scroll the keyboard 2b1 up / down. The display key range is changed. Further, when the user performs a pinch operation on the keyboard portion 2b1, the keyboard portion 2b1 can be enlarged / reduced and displayed. In conjunction with the scrolling and enlargement / reduction of the keyboard part 2b1, the note display part 2b2 is also scrolled and enlarged / reduced. Furthermore, the display area of the note display unit 2b2 is changed by scrolling left / right when the user performs a swipe operation on the left / right.

  The notebook display unit 2b2 is composed of a plane composed of a vertical axis indicating the pitch and a horizontal axis indicating the passage of time, and a plurality of grids are formed in the plane. Each grid displays notes ("notes", but not "notes" as described in the notation 2a1 but in an "ellipse" shape (see FIGS. 4B to 4B described later). d) (referred to as “notes”), a score (piano roll) is created. Note that the length of the horizontal side of each grid indicates the minimum unit of the note length of the input note. The minimum unit of the note length can be freely changed by the user in the same way as the length of one scale of the ruler 2a3. In the present embodiment, when the user presses and holds an arbitrary position on the note display unit 2b2, a menu (not shown) similar to the menu 2a5 pops up, and the note length to be changed is selected from the menu. By doing so, the minimum unit of note length can be changed. Of course, the changing method is not limited to this, and it may be changed by pressing the button 2a4.

  A control process executed by the electronic music apparatus configured as described above will be described first with reference to FIGS. 3 to 5 and then in detail with reference to FIGS.

The electronic music apparatus of this embodiment is
(A) Music score input process on the staff score display screen 2a (B) Music score (note) input process on the piano roll display screen 2b (C) Rotation processing of each display component in the staff score display screen 2a and the piano roll display screen 2b is there.

  FIG. 3 is a diagram for explaining the score input process of (A), wherein FIG. 3 (a) shows a state when an input position of a score is designated, and FIG. 3 (b) is an input note. (C) shows the state when the note length of the input note is specified.

  As shown in FIG. 3A, when the user touches, for example, the first beat of measure 1 around A4 (La) on the staff 2a1, the grid closest to the touch position (nearest) is determined. Here, the grid indicates an area between the scales engraved on the ruler 2a3. How to determine the nearest grid from the touch position will be described later in the process of step S42 in FIG. Then, a cursor C is displayed on the scale located at the head of the determined nearest grid, and informs the user that a note can be input at this position. At this time, the display key range of the keyboard 2a2 is automatically scrolled to the left / right so that the pitch at the touch position is at or near the center of the keyboard 2a2. Here, “the pitch at the touch position comes near the center” means that when the display key range is scrolled, for example, in units of one octave or half octave, the pitch at the touch position is displayed. Since it cannot be positioned exactly in the center of the area, in this case, it means that it is positioned near the center. Of course, even if the pitch at the touch position can be strictly positioned at the center of the display key range, the pitch is not positioned exactly at the center of the display key range due to the user's operational convenience. When it is better, “the pitch at the touch position comes near the center” may be used.

  Next, as shown in FIG. 3B, the user presses the key of the keyboard 2a2 corresponding to the pitch to be input (in the illustrated example, A4 (La), C5 (Do), E5 (Mi)) with a finger. The color of the key changes (in the example shown, the color change is represented by diagonal lines), and when the finger is released, the key changes to a position on the staff 2a1 corresponding to the position of the cursor C drawn by a broken line. , The note of the specified pitch is input. However, the note length of the input note is a length corresponding to one scale (the horizontal side of the grid) of the ruler 2a3, which is a quarter note length in the illustrated example. When a note is input, the cursor C automatically advances by one scale.

  When the same minimum note length is continuously input, the cursor C automatically advances to the next input position as described above, so that the user only has to press and release the key on the keyboard 2a2. Good. For example, when two notes having the same pitch and the same note length as those entered in FIG. 3 (b) are to be input in succession, these correspond to A4 (La), C5 (Do), and E5 (Mi). The operation of pressing and releasing the key of the keyboard 2a2 is performed twice in succession. As a result, in the staff 2a1 in FIG. 3C, three quarter notes having the same pitch are input in succession from the first beat to the third beat of the first measure. FIG. 3 (c) shows an example in which notes of the same pitch are continuously input, but this is only for convenience, and each time a key is pressed and released, a different sound is played. By operating the high key, notes with different pitches are input with the same minimum unit note length.

  On the other hand, when the user wants to input a note having a note length different from the note length of the minimum unit, the user holds the note length to be input on the staff 2a1 while holding the key of the keyboard 2a2 as shown in FIG. Instruct. Specifically, the instruction of the note length is a position (example shown) separated from the note length to be input from the position corresponding to the current position of the cursor C (fourth beat of the first measure in the example shown) on the staff 2a1. Then, it touches the vicinity of the second beat of the second measure). When the note length is specified, a strip-shaped display 2a7 having a length corresponding to the note length appears on the ruler 2a3 in order to inform the user of the note length. Then, when the user releases the finger of the key pressed from the keyboard 2a2, the note having the designated pitch is input with the designated note length. In the example of FIG. 3 (c), the user presses the key on the keyboard 2a2 corresponding to A4 (La), C5 (Do), and E5 (Mi) with the cursor C positioned at the fourth beat of the first measure. While holding and touching, touch the second beat of the second measure on the staff 2a1 (or the second beat of the second measure from the fourth beat of the first measure on the staff 2a1 Then, a strip-shaped display 2a7 indicating the instructed note length appears on the ruler 2a3. Thereafter, when the user lifts his / her finger from the keyboard 2a2, a half note having a designated pitch is input. However, in the example shown in the figure, the input note straddles a measure and is displayed in tie. When a note is input, the cursor C automatically advances to the next input position (the beginning of the second beat of the second measure). In FIG. 3 (c), the note length is shown as being specified in the vicinity of the ruler 2a3. However, this is only shown as such for the sake of convenience. Is going. Of course, the note length may be specified in the vicinity of the ruler 2a3.

  As described above, according to the score input process of (A), in order to continuously input notes of the same minimum note length, it is only necessary to repeatedly touch and release the keys of the keyboard 2a2, thereby simplifying the input operation. can do. In addition, since a plurality of pitches of input notes can be specified at the same time, the input operation when inputting chords can be particularly simplified. Furthermore, even when a note having a note length longer than the minimum unit is input, it is only necessary to touch the position corresponding to the note length on the staff 2a1, so that even if a note having a different note length is input, the input operation is complicated. Do not turn.

  FIG. 4 is a diagram for explaining the score input process of (B), where FIG. 4 (a) shows the state when the pitch of the input note is specified, and FIG. 4 (b) shows the note. (C) shows a state when notes having the same pitch and the same note length are continuously input, and (d) shows a note of the smallest unit. This shows how a note with a note length longer than the length is input.

  As shown in FIG. 4A, when the user touches a key corresponding to, for example, C4 (do), E4 (mi), or G4 (so) on the keyboard unit 2b1, the color of the touched key is changed. Instead (in the illustrated example, the color change is represented by diagonal lines), the user is informed of the selection state. When the user lifts the finger, the selected state of the key is released and the key color returns to the original color.

  Next, when the user touches any position on the note display section 2b2 in a state where the key of the keyboard section 2b1 is selected, the grid row closest to the touch position is determined. Here, the grid row means one row in the vertical direction of the grid, and in FIG. 4 is any one of the rows R1 to R6. Then, when the user releases the touched finger from the note display unit 2b2, as shown in FIG. 4 (b), the note is placed on the grid corresponding to the selected pitch among the grids belonging to the determined grid row. Entered. The note input is represented by an ellipse inscribed in the grid. Here, the touch position on the note display unit 2b2 is not limited to the position in the grid corresponding to the key selected on the keyboard unit 2b1, and may be any position as long as it is in the same grid row as the grid. . In the illustrated example, the user touches the grid corresponding to the key “D # 4” of the keyboard portion 2b1 among the grids belonging to the grid row R3 of the note display portion 2b2, but the note is the key “G4”. , “E4” and “C4” respectively. In the illustrated example, the ellipse is represented in black. However, the color is not limited to black, and any color may be adopted, and a shade or a pattern may be used instead of a solid color.

  It is assumed that a conventional electronic music device includes a note display unit similar to the note display unit 2b2, and using this conventional electronic music device, C4 (do), E4 (mi), G4 as described above. When inputting a note having a pitch of (G), it is necessary to touch the grid corresponding to each pitch on the note display section one by one, that is, three times. However, according to the electronic music apparatus of the present embodiment, as described above, the touch on the note display unit 2b2 only needs to be performed once, so that it is possible to simplify the input operation particularly when inputting chords. Furthermore, since the touch position on the note display unit 2b2 may be anywhere in the grid row to which the grid corresponding to the pitch of the input note belongs, the user does not need an accurate touch operation.

  When notes of the same minimum unit length and the same pitch are continuously input, as shown in FIG. 4 (c), the selected state of the key on the keyboard portion 2b1 is maintained on the note display portion 2b2. Change the touch position. In the illustrated example, since the user touches the grid row R5 and the grid row R6 following the grid row R3, notes of pitches C4 (do), E4 (mi), and G4 (so) are displayed on the grid row. The data is input to grids belonging to the columns R3, R5, and R6.

  As described above, according to the electronic music device of the present embodiment, when a number of notes having the same note length and the same pitch are continuously input, the key corresponding to the pitch on the keyboard portion 2b1 is held down. Then, only the input position (temporal position) needs to be specified on the note display unit 2b2, so that the user does not need an accurate touch operation.

  On the other hand, when it is desired to input a note having a note length longer than the minimum unit note length, as shown in FIG. 4 (d), the user maintains the selected state of the key on the keyboard portion 2b1 and the note display portion 2b2. Drag the top sideways. During dragging, the entire range from the grid column including the drag start point to the grid column including the end point (in the illustrated example, from the grid column R3 to the grid column R6) is colored so that the range being dragged can be understood. Displayed (in the illustrated example, the color change is represented by diagonal lines). When the user stops dragging and releases the touched finger, the note length corresponding to the dragged length is selected on the keyboard part 2b1 from the position where the drag is started to the position where the finger is released. A note with the correct pitch is input. In the illustrated example, since the user is dragging from the position in the grid row R3 to the position in the grid row R6, the pitches of C4 (do), E4 (mi), G4 (so) and the total note length ( = Minimum unit × 4; However, the note of the minimum unit, that is, the length of the horizontal side of each grid is set to the quarter note length) is input.

  As described above, according to the electronic music apparatus of the present embodiment, the pitch can be specified on the keyboard unit 2b1, and the note length can be specified on the note display unit 2b2. Thus, the user intuitively inputs the notes. be able to.

  FIG. 5 is a diagram for explaining the rotation process of (C). FIG. 5 (a) shows display components included in the staff notation display screen 2a, and FIG. ) Shows a state when each display component is independently rotated. FIG. 10C shows display components included in the piano roll display screen 2b, and FIG. It shows a state when one of the display parts is rotated.

  As shown in FIG. 5A, the musical score display screen 2a includes a display component Pa1 composed of a staff notation 2a1 and a ruler 2a3, and a display component Pa2 composed of a keyboard 2a2. The display component means a display image that can be rotated integrally and independently, and the display image constituting each display component is displayed for each screen (in this embodiment, the staff score display screen 2a and the piano roll display screen 2b). And) fixed in advance. Note that the staff notation display screen 2a includes the button 2a4 as described above. However, in the present embodiment, the button 2a4 does not rotate and is not included in the display component (this is because the piano roll display screen 2b The same applies to. Of course, you may comprise so that button 2a4 can also rotate.

  When a user inputs a musical score from the staff notation display screen 2a, the initial display on the staff notation display screen 2a, that is, the display shown in FIG. In this case, if either one or both of the display components Pa1 and Pa2 are rotated, the input operation may be greatly facilitated. Therefore, the electronic music apparatus according to the present embodiment is configured so that the display components Pa1 and Pa2 can be independently rotated in accordance with a user's rotation instruction. FIG. 5B shows how the user gives a rotation instruction and how the display components Pa1 and Pa2 are rotated in accordance with the rotation instruction. When the user first touches within or near the range of the display component to be rotated with one finger and then designates the direction and angle of rotation with the other finger by a drag operation, the touched display component Rotate in the indicated direction and angle. In the illustrated example, the display component Pa1 is rotated by a predetermined angle in the direction in which the clock hand rotates, and the display component Pa2 is rotated by a predetermined angle in the direction opposite to the direction in which the clock hand rotates. . In the illustrated example, the selection of the display component and the rotation instruction are depicted as being performed with fingers of different hands, but it is needless to say that they may be performed with different fingers of the same hand. .

  The above-mentioned problem when inputting a score from the staff score display screen 2a, that is, it may be difficult to perform an input operation with the initial screen displayed, may occur when inputting a score from the piano roll display screen 2b. As shown in FIG. 5C, the piano roll display screen 2b is also provided with a display component Pb1 composed of a keyboard portion 2b1 and a display component Pb2 composed of a note display portion 2b2, and each display component Pb1 and Pb2 is provided. Each can be rotated independently.

  FIG. 5D shows the manner in which the user gives a rotation instruction and the state after the display component Pb1 is rotated in accordance with the rotation instruction, as in FIG. 5B. However, in FIG. 5 (d), unlike FIG. 5 (b), only one of the two display components is rotated and the other is left in the initial display, but this is the display component Pb1, that is, the keyboard. This is because the part 2b1 is difficult to perform an input operation in the initial display direction, whereas the display component Pb2, that is, the note display part 2b2, cannot be said to be difficult to perform an input operation even in the initial display state. Of course, the display component Pb2 may also be rotated, or conversely, the display component Pb2 may be rotated and the display component Pb1 may not be rotated. Note that the method of selecting the display component to be rotated and the method of specifying the direction and angle of rotation are the same as those for each display component in the staff notation display screen 2a, and a description thereof will be omitted.

  In the present embodiment, the keyboard 2a2 and the keyboard portion 2b1 are rotated as a whole as a whole. However, the present invention is not limited to this, and the left key range and the right key range can be rotated separately. May be. In addition to rotation, each display component may be moved independently. In this case, it may be moved by a normal drag operation, or the operation method may be made different by, for example, dragging with two fingers to clearly distinguish it from a swipe operation (keyboard scrolling, etc.). Moreover, you may enable it to rotate or move several display components collectively.

  The rotated or moved state may be stored in the user area of the RAM 8 and may be called up and used. In this case, it is possible to save multiple settings such as settings for sitting and using, lying down, portrait, landscape, etc., and calling and using the appropriate one according to the user's usage You should be able to do it.

  Next, this control process will be described in detail.

  FIG. 6 is a flowchart showing the procedure of the main routine executed by the electronic music apparatus of the present embodiment, particularly the CPU 6.

This main routine mainly includes (1) initialization processing (step S1).
(2) Acceptance / determination process for accepting user operation and determining its operation position and operation type (steps S2 and S3)
(3) (31) Input note designation process (step S7) according to the operation position and operation type determined by the reception / determination process of (2) above
(32) Input position designation processing (step S9)
(33) Process # 1 according to the operation (step S10)
(34) Process # 2 according to operation (step S13)
(35) End processing (step S12)
Branching process for branching to any one of the processes (steps S4, S5, S6, S8, S11)
It is constituted by. This main routine is started when the power is turned on by a power switch (not shown) included in the setting operator 1. After the start-up, the initial setting process (1) is executed once, and subsequently, the processes (2) and (3) are sequentially executed, and the branch branches by the branch process (3). When the previous process ends, the process returns to the process (2), and the processes (2) and (3) are repeatedly executed until the power is turned off by the power switch. However, when the branch destination process is the (35) end process, the main routine ends when the (35) end process ends.

  In the (1) initialization process, the CPU 6 clears the RAM 8, sets various parameter values to default values, and selects and displays a display screen. In the present embodiment, the display screen, that is, either the staff score display screen 2a or the piano roll display screen 2b can be selected only once in this (1) initialization process, and then changed until the main routine ends. You can't do that. This is only for convenience of explanation, and may be arbitrarily switched in accordance with a user instruction during the main routine. It should be noted that (1) selection of the display screen in the initialization process may be made by inquiring the user which screen is desired to be displayed, and the user responding to the selection is selected.

  In the (2) reception / determination process, the CPU 6 constantly checks the output from the detection circuit 4 to monitor whether there is a user operation on the touch panel 2, and accepts the user operation when there is a user operation. (Step S2) Based on the received user operation, the operation position and the operation type are determined (Step S3). Here, the operation position is an operation position on the touch panel 2, and the operation type is a touch operation, a hold operation, a swipe operation, a drag operation, a pinch operation, or the like.

In the (3) branch process, the CPU 6 branches the process as follows based on the determined operation position and operation type. That is,
(C1) The operation position is on the note input image & (and) the operation position is in the pitch designation section & the operation type is a touch operation or a drag operation: branch to the (31) input note designation process (steps S4 → S5 → S6 → S7);
(C2) The operation position is on the note input image & the operation position is in the timing designation section & the operation type is a touch operation or a drag operation: branch to the (32) input position designation process (steps S4 → S5 → S8 → S9);
(C3) The operation position is on the image for note input & the operation position is in the pitch designating part & the operation type is neither touch operation nor drag operation: (33) Branch to process # 1 according to the operation (step S4 → S5 → S6 → S10);
(C4) The operation position is on the image for note input & the operation position is in the timing designation section & the operation type is neither touch operation nor drag operation: (33) Branch to the process # 1 according to the operation (steps S4 to S5) → S8 → S10);
(C5) The operation position is not on the note input image & the operation type is “end instruction”: branch to the (35) end process (steps S4 → S11 → S12);
(C6) Operation position other than on note input image & operation type other than “end instruction”: Branch to process # 2 corresponding to the operation (34) (steps S4 → S11 → S13).

  In the case (C1), the first case, that is, “the operation position is on the note input image” indicates a case where the user is operating on an image related to note (note) input. In the present embodiment, an image related to note (note note) input (note input image) is an image portion related to pitch specification of an input note (note), and a note to be input ( The “timing designation unit” is an image part related to the timing designation of the (note). On the staff notation display screen 2a, the keyboard 2a2 corresponds to "pitch designation part", and the staff notation 2a1 and ruler 2a3 correspond to "timing designation part". On the piano roll display screen 2b, the keyboard part 2b1 corresponds to "pitch designation part". ", The note display unit 2b2 corresponds to a" timing designation unit ". Therefore, when the staff score display screen 2a is selected, the user is operating on the staff score 2a1, the keyboard 2a2, and the ruler 2a3 (in addition to these, the vicinity thereof may be included. The same applies hereinafter) When the piano roll display screen 2b is selected, the user is operating on the keyboard part 2b1 and the note display part 2b2 (in addition to these, the vicinity thereof may be included. The same applies hereinafter). This corresponds to the first case. On the other hand, a state where the user is operating other than on the image such as the button 2a4 and the menus 2a5 and 2a6 (see FIG. 2) does not correspond to the first case.

  In the case (C1), the second case, that is, “the operation position is a pitch designating part”, as described above, is a “pitch designating part which is one of the components of the“ note input image ”by the user. ”(In the stave display screen 2a, it is the keyboard 2a2, and in the piano roll display screen 2b, it is the keyboard portion 2b1).

  Therefore, the entire case (C1) is touched by the user on the keyboard 2a2 when the staff score display screen 2a is selected, and on the keyboard portion 2b1 when the piano roll display screen 2b is selected. Or the case where it dragged is shown.

  In the case (C2), the first case is the same as the first case of the case (C1), and the description thereof is omitted, but the second case in the case (C2) is omitted. In this case, that is, “the operation position is in the timing designating portion”, as described above, the user designates the “timing designating portion” which is the other component of the “note input image”. It is a ruler 2a3, and a case in which the inside of the piano roll display screen 2b is a note display unit 2b2 is shown.

  Therefore, the entire case (C2) is displayed on the staff notation 2a1 or the ruler 2a3 when the staff notation display screen 2a is selected, and on the note display portion 2b2 when the piano roll display screen 2b is selected. A case where the top is touched or dragged is shown.

  The entire case (C3) differs from the entire case (C1) only in the type of user operation. That is, a case where the user performs an operation other than the touch operation and the drag operation, for example, a swipe operation or a pinch operation is shown.

  Similarly, the entire case (C4) is different from the entire case (C2) only in the operation type of the user. That is, a case where the user performs an operation other than the touch operation and the drag operation, for example, a swipe operation or a pinch operation is shown.

  In the case (C5), the first case, that is, “the operation position is not on the note input image” indicates the case where the user is operating outside the “note input image” as described above. Yes. In the second case, that is, “the operation type is“ end instruction ””, the user has a special operation corresponding to the “end instruction” (for example, “end” is assigned to one of the buttons 2a4). This is a case where a touch operation on the button can be considered (of course, but not limited to this).

  The entire case (C6) differs from the entire case (C5) only in the type of user operation. That is, a case where the user performs an operation other than the operation corresponding to the “end instruction”, for example, the operations (O1) to (O8) is shown.

  FIG. 7 is a flowchart showing a detailed procedure of the input note designation process # 1 executed when the staff score display screen 2a is selected in the input note designation process of (31).

This input note designation processing # 1 is mainly (41) pitch determination processing (steps S21 to S25) for determining the pitch of the input note.
(42) First note input processing for inputting a note having a pitch determined by the above-described (41) pitch determination processing in a minimum unit note length (steps S28 and S29).
(43) Second note input processing (steps S34, S35) for inputting a note having a pitch determined by the above-described (41) pitch determination processing with a note length longer than the minimum unit.
(44) Post-processing after the note input processing of (42) or (43) (steps S30 to S33)
It is constituted by.

  In the pitch determination process of (41), first, the CPU 6 converts the coordinates of the touch position into a note number (step S21). Specifically, the CPU 6 determines which key of the keyboard 2a2 is touched by the user from the coordinates of the touch position, and obtains the note number assigned to the determined key, thereby obtaining the note from the coordinates of the touch position. Convert to number. Here, for determining which key is touched, for example, it is determined which xy coordinates of the touch position are included in the area occupied by each white key and each black key on the keyboard 2a2. Can be done. Note that the touch position is actually a region having an area, but is regarded as a point having no area in order to simplify the description (the same applies hereinafter).

  Next, the CPU 6 stores the converted note number in an input buffer (not shown) secured at a predetermined position in the RAM 8 for inputting notes (step S22). Further, the CPU 6 changes the display mode of the key corresponding to the converted note number, that is, the key of the touched keyboard 2a2 to the “selected state” (step S23). The “selected state” means that the display color of the “selected state” is different from the original display color (see FIG. 3B).

  The processing in steps S21 to S23 corresponds to the processing when the user touches one key with one finger. In the flowchart of FIG. Although the process is not described, when a plurality of keys are operated simultaneously, the processes in steps S21 to S23 are repeatedly executed for the number of keys operated simultaneously, as shown in FIG. Also supports simultaneous operation of multiple keys.

  When the user makes a mistake in touching the key, the user can determine the pitch as intended by moving the key to the correct key while maintaining the touch state. The processes in steps S24 and S25 are for realizing this. That is, in step S24, it is determined whether or not the touch position has moved. If the touch position has moved, the process returns to step S21, and the note number is re-acquired from the moved touch position, and accordingly. The display mode of the corresponding key is also changed (step S23). Then, the determination process of step S24 is repeatedly executed until the user releases (releases) the finger from the keyboard 2a2 (step S25 → S24). This is the (41) pitch determination process.

  When the (41) pitch determination process ends, the CPU 6 determines which of (42) the first note input process and (43) the second note input process should proceed. As described above in the overview of the control processing, the user specifies the note length by touching the staff 2a1 when inputting a note having a note length longer than the minimum unit, and inputting the note having the minimum unit note length. To do this, the user simply touches and releases the keyboard 2a2 without touching the staff 2a1. When the user touches the staff 2a1 and designates the note length, the grid corresponding to the touch position is set as the input end position (see step S43 in FIG. 8 described later). If a valid value (= value for specifying the grid) is set at the end position, this indicates that the user has touched the staff 2a1 to specify the note length. Therefore, in step S26, it is determined whether or not the input end position is set. If the input end position is not set as a result of this determination, the CPU 6 proceeds to the (42) first note input process, assuming that the user has input a note having a minimum note length. (Step S26 → S28). On the other hand, when the input end position is set, the CPU 6 proceeds to the (43) second note input process on the assumption that the user has input a note having a note length longer than the minimum unit. Before that, it is determined whether or not the input start position (grid where the cursor C is located) and the input end position have the same value (step S27). As a result of this determination, if the input start position = input end position, the CPU 6 determines that the note of the minimum unit note length is still input even if the user touches the staff notation 2a1, and the process (42) While the process proceeds to the first note input process, if the input start position is not equal to the input end position, the CPU 6 proceeds to the (43) second note input process.

  (42) In the first note input process, the CPU 6 is the input position (the position in the horizontal (time) axis direction) on the staff 2a1, specifically, the position on the staff 2a1 corresponding to the position of the cursor C. (This is also the case with the processing of step S34 described later) After inputting the note corresponding to the note number stored in the input buffer with a note length corresponding to one division of the ruler 2a3 (step S28) The next grid is set at the input start position (step S29).

  (43) In the second note input process, the CPU 6 assigns a note corresponding to the note number stored in the input buffer to the input position on the staff 2a1 with a length from the input start position to the input end position. After the length is input (step S34), the grid next to the input end position is set to the input start position (step S35).

  In the post-processing (44), the CPU 6 updates the position of the cursor C of the ruler 2a3 with the input start position (step S30), clears the input end position (step S31), and clears the input buffer (step S30). (S32) The display mode of the changed key 2a2 is returned to the “non-selected state” (step S33).

  FIG. 8 is a flowchart showing a detailed procedure of the input position specifying process # 1 executed when the staff score display screen 2a is selected in the input position specifying process of (32).

This input position designation process # 1 is mainly (51) first input position designation process (steps S42 to S46) executed while the user is touching the keyboard 2a2.
(52) Second input position designation processing executed in a state where the user does not touch the keyboard 2a2 (steps S47 to S52)
It is constituted by.

  The CPU 6 determines whether or not the user is touching the keyboard 2a2 based on whether or not the note number is stored in the input buffer (step S41). As a result of this determination, if the note number is stored in the input buffer, that is, if the user is touching the keyboard 2a2, the CPU 6 performs the process (51) the first input position. On the other hand, if the note number is not stored in the input buffer, that is, if the user is not touching the keyboard 2a2, the CPU 6 performs the above processing ((S41 → S42)). 52) Proceed to the second input position designation process (step S41 → S47).

  (51) In the first input position designation process, first, the CPU 6 determines the closest (closest) grid to the touch position among the plurality of grids of the ruler 2a3 from the coordinates of the touch position (step S42). Here, the determination of the nearest grid is, for example, which region of the regions (regions in the horizontal axis (x-axis) direction) occupied by each grid on the ruler 2a3 is included in the x coordinate of the touch position. However, if the vicinity of the border between adjacent grids is touched, the user selects the subsequent grid even if the touch position is included in the previous grid. It is necessary to perform exception handling such as making the grid the nearest grid.

  Next, the CPU 6 sets the determined grid (information for identifying, for example, a grid number) as an input end position (step S43), and changes the display mode of the ruler 2a3 from the input start position to the input end position (step S43). S44). As a result, a strip-shaped display 2a7 appears on the ruler 2a3 as shown in FIG.

  Further, the CPU 6 determines whether or not the touch position has moved (step S45). If there is a touch position movement, the process returns to step S42 in the same manner as step S24 in FIG. The nearest grid is re-determined from the coordinates of the touch position, and the length of the horizontal side of the strip-shaped display 2a7 is changed accordingly (step S44). The determination process in step S45 is repeated until the user removes (releases) his / her finger from the timing designating part (stave 2a1 + ruler 2a3) (step S45 → S46).

  (52) In the second input position designation process, first, the CPU 6 determines the nearest grid and note number from the coordinates of the touch position (step S47). The determination of the nearest grid may be performed by using a method similar to the determination method described in step S42, and thus the description thereof is omitted. For example, the note number is determined by comparing the y coordinate of the touch position with the y coordinate of each pitch in the staff 2a1, and the note number corresponding to the pitch having the y coordinate with the smallest difference is selected as the target note number. It may be determined that. Next, the CPU 6 sets the determined grid (identifying information, for example, the grid number) as the input start position (step S48), and displays the cursor C on the determined grid (at the top) (step S49). The display of the keyboard 2a2 is controlled so that the key corresponding to the determined note number comes near the center of the keyboard (step S50). Further, the CPU 6 performs processing similar to the processing in steps S45 and S46 (steps S51 and S52).

  In each determination process of steps S45 and S51, the movement of the touch position is detected regardless of the amount of movement, and the process is repeated according to the detection, but the currently determined grid is changed. Only when there is a movement (drag operation) of the amount touch position, it may be determined as “YES” and the process may be repeated. Even though the user does not intend to move the finger, the user actually swings slightly, so if the slight swing is detected as the movement of the touch position, the process is repeated each time the detection is made, and this waste This is because the operation of the entire control process becomes heavy due to an unnecessary process.

  In the present embodiment, the movement of the touch position is limited to the timing designation part (stave 2a1 + ruler 2a3) and is not assumed to go outside the timing designation part. Assuming that the finger touched by the user for moving the touch position (drag operation) is released (released) from the timing designation unit, the input position designation process is performed by the determination processes in steps S46 and S52. # 1 may be terminated, and the input start position (and input end position) executed so far is regarded as cancellation of the touch operation itself (meaning that it includes not only the drag operation but also the previous touch operation). The input position designation process # 1 may be terminated after all the settings of () are cleared. At that time, a message indicating that the touch position has moved out of the timing designation section may be displayed, or a warning sound may be generated.

  FIG. 9 is a flowchart showing a detailed procedure of the input note specifying process # 2 executed when the piano roll display screen 2b is selected in the input note specifying process of (31). In FIG. 9, steps that perform the same processing as in FIG. 7 are given the same step numbers.

  The case where the input note designation process # 2 is activated is a case where the user performs a touch operation or a drag operation on the keyboard part 2b1, as described above with reference to FIG. That is, the processing of steps S21 to S25, S32, and S33 'in FIG. 9 and the processing of steps S21 to S25, S32, and S33 in FIG. The latter process is different from the user operation for 2b1, whereas the latter process is related to the user operation for the keyboard 2a2. However, since the former process can be easily understood by applying the latter process by analogy, the description thereof is omitted.

  When the process of step S33 ′ is completed, the CPU 6 determines whether or not an input position designation process # 2 described later with reference to FIG. 10 is being executed (step S101). If the input position designation process # 2 is being executed as a result of this determination, the CPU 6 clears the input start position and the input end position set in the input position designation process # 2 (step S102). After the display mode of the note display unit 2b2 changed in step S115 of step 10 is restored (step S103), the input note designation process # 2 is terminated, while the input position designation process # 2 is not being executed. The CPU 6 immediately ends the input note designation process # 2 (step S101 → return).

  FIG. 10 is a flowchart showing a detailed procedure of the input position specifying process # 2 executed when the piano roll display screen 2b is selected in the input position specifying process of (32). In FIG. 10, steps that perform the same processing as in FIG. 8 are given the same step numbers.

This input position specifying process # 2 mainly includes (61) a note (note) having a pitch specified by the input note specifying process # 2 at the position specified by the user on the note display unit 2b2, and the note length in the minimum unit. First note input process input at step S119
(62) Second note input processing for inputting a note (note) having a pitch specified by the input note specifying processing # 2 to a position specified by the user on the note display unit 2b2 with a note length longer than the minimum unit. (Step S122)
It is constituted by.

Then, the first note input process (61) is executed through one of the following operations by the user. That is,
(61a) When the note display unit 2b2 is touched and the touch state is released (released) while the keyboard unit 2b1 is being touched (step S41 → S42 ′ → S110 → S111 → S112 → S116 → S117 → S119)
(61b) When the note display unit 2b2 is touched while the keyboard unit 2b1 is being touched, the drag operation is performed while the touch state is maintained, and then the drag state is released (released) (however, the drag operation is performed) (If the next grid is not selected) (Step S41 → S42 ′ → S110 → S111 → S112 → S113 → S114 → S115 → S111 → S112 → S116 → S117 → S118 → S119)
(61c) Touching the note display unit 2b2 without touching the keyboard unit 2b1, and then touching the keyboard unit 2b1 while maintaining the touch state, and then releasing the touch state of the note display unit 2b2 (release) ) (From step S41 → S123 → S42 ′ of (61a) above)
It is.

The second note input process (62) is executed through one of the following operations by the user. That is,
(62a) When the note display unit 2b2 is touched while the keyboard unit 2b1 is being touched and a drag operation is performed while maintaining the touch state, and then the drag state is released (released) (steps S41 → S42) ′ → S110 → S111 → S112 → S113 → S114 → S115 → S111 → S112 → S116 → S117 → S118 → S122)
(62b) The user touches the note display unit 2b2 without touching the keyboard unit 2b1, and then touches the keyboard unit 2b1 while maintaining the touch state, and then performs a drag operation on the note display unit 2b2. After that, when the drag state is released (released) (Step S41 → S123 → S42 ′ of (62a) above)
It is.

  When the user performs the above-described series of operations (61a), since the keyboard part 2b1 is in the touch state, the note number is stored in the input buffer (see step S22 in FIG. 9). The CPU 6 determines the closest (closest) grid row to the touch position among the plurality of grid rows of the note display unit 2b2 from the coordinates of the touch position (steps S41 → S42 ′). The grid row corresponds to the “grid” described in the flowchart of FIG. 8, and the determination method of the nearest grid row may be the same as the determination method of the nearest “grid”, and the description thereof will be omitted.

  Next, the CPU 6 sets the determined grid row (information for identifying, for example, the grid row number) as an input start position (step S110). In the series of operations (61a), a valid note number is stored in the input buffer, and the touch operation on the note display unit 2b2 is canceled without performing the drag operation. Is not set, the CPU 6 proceeds with the process from step S111 → S112 → S116 → S117 → S119, whereby (61) the first note input process, that is, stored in the input buffer, at least 1 A process of inputting notes corresponding to one note number with a note length of one grid from the input start position is executed. As a result, as shown in FIG. 4B, at least one grid (in the illustrated example, three grids) corresponding to the selected pitch among the plurality of grids belonging to the determined grid row. Notes are entered with a minimum note length.

  In step S111, it is determined whether or not the input buffer has been cleared. This is because the user touches the note display unit 2b2 (including during dragging) while the touch state on the keyboard unit 2b1 is changed. It is determined whether or not it has been canceled (steps S25 → S32 in FIG. 9). This is because in the present embodiment, a note is input to the note display unit 2b2 when the user touches and releases the note display unit 2b2 while maintaining a touch state on the keyboard unit 2b1. If it is determined in step S111 that the input buffer is cleared, the CPU 6 advances the process to step S123, which will be described later, until the note number is stored in the input buffer, that is, the user again tries the keyboard unit 2b1. Wait until touch operation is performed.

  In step S116, it is determined whether or not the touch state on the note display unit 2b2 has been released (released). This indicates whether or not the user has instructed to input a note to the note display unit 2b2. Judgment. If it is determined in step S116 that the touch state is not released, the current operation state is that the touch state is continuing or dragging, and therefore the CPU 6 returns the process to step S111.

  When the user performs the series of operations (62a), the CPU 6 advances the processing in steps S41 → S42 ′ → S110 → S111 → S112. Since steps S41, S42 ', S110 and S111 have already been described, they will not be repeated here. Since the user performs the drag operation by the series of operations (62a), the CPU 6 determines the nearest grid row from the coordinates of the touch position after the movement (drag operation) in the same manner as in step S42 ′. (Step S112 → S113), and the determined grid row (information for identifying, for example, the grid row number) is set as the input end position (Step S114), and then the input start position from the input start position on the note display unit 2b2. The display mode of the display area is changed (step S115). As a result, as shown in FIG. 4D, the color of the display area from the input start position to the input end position (in the illustrated example, the area of the grid columns R3 to R6) changes. When the drag operation is finished and the user releases the touch state, the CPU 6 advances the process in steps S111 → S112 → S116 → S117. Since the processing of steps S111, S112 and S116 has already been described, it will not be repeated here. By the processing of step S114, a valid grid row is set at the input end position, and in the series of operations (62a), the input end position and the input start position are different, so the CPU 6 performs the processing. By proceeding in steps S117 → S118 → S122, the note corresponding to at least one note number stored in the (62) second note input process, that is, the input buffer is changed from the input start position to the input end position. Executes input processing with note lengths up to. As a result, as shown in FIG. 4D, it corresponds to the selected pitch among a plurality of grid rows belonging to a plurality of grid columns (four columns in the illustrated example) from the input start position to the input end position. A note is input to a grid of at least one row (3 rows in the illustrated example) with a note length of minimum unit × number of columns.

  When the user performs the series of operations (61b), the CPU 6 proceeds with the process in steps S41 → S42 ′ → S110 → S111 → S112 → S113 → S114 → S115 → S111 → S112 → S116 → S117 → S118. Since the process of step S41 → (omitted) → S117 has already been described, it will not be repeated here. In the series of operations (61b), since the input start position and the input end position are the same, the CPU 6 advances the process from step S118 to S119, and executes the (61) first note input process. . Since this (61) first note input processing has already been described in detail, it will not be repeated any more.

  When the user performs the series of operations (61c), since the keyboard part 2b1 is in a non-touch state, the note number is not stored in the input buffer. Until it is stored, that is, until the user performs a touch operation on the keyboard portion 2b1, it waits while monitoring whether or not the touch state on the note display portion 2b2 is released (steps S41 → S123 → S124 → S123). ). If the touch state on the note display portion 2b2 is canceled while the keyboard portion 2b1 is in the non-touch state, the CPU 6 immediately ends the input position designation processing # 2 (step S124 → return). In the series of operations (61c), since the user performs a touch operation on the keyboard portion 2b1 before the touch state on the note display portion 2b2 is released, the CPU 6 performs the process from step S123 to step S42. Proceed with '. Since the processing after step S42 'is the same as the processing in the case of performing the series of operations (61a), the description thereof is omitted.

  The process when the user performs the series of operations (62b) is the same as the series of processes (62a) in part of the process (the processes of steps S123 and S124) when the series of operations (61c) is performed. This is a combination of part of the processing when the operation is performed (processing after step S42 '), and both processings have been described in detail, and will not be repeated any further.

  When the (61) first and (62) second note input processes are completed, the CPU 6 clears the input start position and the input end position (step S120) and has been changed by the process of step S115. The display mode of the display area on the note display unit 2b2 is restored (step S121).

  FIG. 11 is a flowchart showing a detailed procedure of process # 1 according to the operation (33).

  When the process # 1 corresponding to this operation is activated, the CPU 6 first determines the type of operation performed by the user (step S61). The process # 1 corresponding to this operation is activated when a user operation on the note input image is detected. The user operation includes a long press operation as described above in the present embodiment. , Swipe operation, pinch operation, rotation operation (operation for instructing rotation), touch operation and drag operation are included. Among these, the touch operation and the drag operation are excluded in Steps S6 and S8 in FIG. 6, and in Step S61, one of the long press operation, swipe operation, pinch operation, and rotation operation is performed as the user operation. Determined. The swipe operation corresponds to a “scroll” instruction, the pinch operation corresponds to an “enlargement / reduction” instruction, the rotation operation corresponds to a “rotation” instruction, and the long press operation corresponds to an instruction other than these. Therefore, when the user operation is determined to be any one of the swipe operation, the pinch operation, and the rotation operation, the CPU 6 advances the process from step S62 to S63, while when the user operation is determined to be a long press operation, the CPU 6 The process proceeds from step S62 to S66.

  In step S63, the CPU 6 detects an operation amount based on a user operation. The amount of operation differs depending on the type of operation. The swipe operation detects the “movement amount” of the scroll, the pinch operation detects the “enlargement (reduction) ratio” of the enlargement / reduction, and the rotation operation detects the rotation. “Rotation angle” is detected. In the swipe operation, not only the moving amount of the scroll but also the moving speed may be detected. In the present embodiment, as described above, when each display component is rotated, the rotation center is a fixed point for each display component, and therefore the rotation operation by the user is used to determine the rotation angle. Of course, the present invention is not limited to this, and the center of rotation may be set freely by the user.

  Next, the CPU 6 changes the display state of the target display component according to the detected operation amount (step S64). Specifically, when “scroll” is instructed, the display component is scrolled by the detected amount of movement, and when “enlargement / reduction” is instructed, the display component is detected in the detected enlargement ( When the “rotation” is instructed, the display component is rotated by the detected rotation angle.

  Further, the CPU 6 changes the coordinate setting of the target display component according to the detected operation amount (step S65). In the present embodiment, independent coordinates are set for each display component. In the process of step S65, the coordinates set for the target display component are changed according to the detected operation amount. Yes. For example, when “rotate” is instructed, the display component is rotated by the process of step S64, and the coordinates of the display component are also rotated in accordance with the rotation amount. As a result, if the user touches the same position on the display component, the obtained coordinate values are the same regardless of whether the display component is rotated or not, so the user feels uncomfortable even if the display state of the display component changes. It can be operated without.

  On the other hand, in step S66, the CPU 6 executes a process corresponding to the operation. In the present embodiment, the operation is only the “long press operation” as described above. However, when this long press operation is performed, the CPU 6 performs the operation as described in FIG. Depending on the operation position, the menu 2a5 or 2a6 is popped up.

  In the present embodiment, the present invention has been described by taking a keyboard instrument as an example of a musical instrument type for designating the pitch of an input note (note), but is not limited to this, and other instruments such as a guitar and a drum set are also described. The present invention can also be applied to other musical instruments. When a guitar is used, the staff notation 2a1 on the staff notation display screen 2a may be a tablature and the keyboard 2a2 may be a fret image. The keyboard portion 2b1 of the piano roll display screen 2b may be a fret image, but the note display portion 2b2 does not need to be changed as it is. If a drum set is used, the staff notation 2a1 on the staff notation display screen 2a may be a drum score, and the keyboard 2a2 may be various drum images that constitute the drum set. The keyboard part 2b1 of the piano roll display screen 2b may be various drum images or the names of the drum types constituting the drum set may be arranged, but the note display part 2b2 does not need to be changed as it is.

  In the present embodiment, the keyboard 2a2 is scrolled in accordance with the touch position on the staff notation 2a1, but the present invention is not limited to this. For example, in the initial state, the entire image of the musical instrument is displayed and the touch on the staff notation is touched. The key range near the pitch corresponding to the position may be enlarged and displayed. In short, what is necessary is just to change the keyboard display so that the corresponding keyboard (or guitar strings or frets) can be operated immediately when the pitch is specified on the score.

  Furthermore, in this embodiment, the grid is displayed on both the staff notation display screen 2a and the piano roll display screen 2b. However, the present invention is not limited to this, and a mode in which no grid is displayed is provided, and this mode is selected. The grid may not be displayed. Thereby, the user can input a note (note) irrespective of the minimum input unit. In this case, a fine grid such as a 64th note length is provided inside the apparatus, and the grid is not displayed on the screen. The unit of the grid is the note length in the present embodiment, but is not limited to this, and a MIDI clock, a time such as μsec, or the like may be adopted.

  In the present embodiment, as shown in steps S25, S32, and S33 ′ of FIGS. 4B and 4C and FIG. 9, the user touches the keyboard 2b1 with the finger (while maintaining the touch state). ), When another finger touches and releases the note display unit 2b2, the note is input. However, the present invention is not limited to this, and after the user releases the touch to the keyboard unit 2b1, The pitch selection state by touching the keyboard portion 2b1 is maintained until the key is touched or the selection release switch provided separately is operated, and the user selects a note in this pitch selection state. A note may also be input when the display unit 2b2 is touched and released.

  Further, in the present embodiment, as shown in FIG. 4D, when the note length is designated by the drag operation, the input end position is always on the right side (the direction in which time passes) from the input start position. It is not assumed that the operation is performed in the reverse direction, but if the operation is performed in the reverse direction, the input start position is compared with the input end position, and the earlier one in time is regarded as the input start position. It is preferable that the note length of the drag range is specified by regarding one as the input end position.

  A program in which a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus is stored in the storage medium. It goes without saying that the object of the present invention can also be achieved by reading and executing the code.

  In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the program code and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic A tape, a non-volatile memory card, a ROM, or the like can be used. Further, the program code may be supplied from a server computer via a communication network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also the OS running on the computer based on the instruction of the program code performs the actual processing. It goes without saying that a case where the functions of the above-described embodiment are realized by performing part or all of the above and the processing thereof is included.

  Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

2 ... Touch panel display, 5 ... Display circuit (display means), 6 ... CPU (display means, first determination means, second determination means, input means, setting means, change means)

Claims (4)

Touch panel display with multi-point recognition function,
Display means for displaying on the touch panel display a note input screen including a first designation unit for designating the pitch of the input note and a second designation unit for designating the sounding timing of the input note; ,
First determination means for determining a pitch of the touch position when the user touches the first designation unit;
Second determination means for determining an input position in the time direction of the input note based on the touch position when the user touches the second designation unit;
When the pitch of the input note is designated by the user touching the first designation unit, when the second designation unit is touched, the note having the pitch determined by the first determination unit And an input means for inputting the signal to the input position determined by the second determination means.   In a state where the pitch of the input note is designated by the user touching the first designation unit, the user touches the second designation unit, and further holds the touch state while the second designation unit is held. And a setting means for setting a note length corresponding to an interval from the position before the movement to the position after the movement as the note length of the note input by the input means when moved to a different position above. The electronic music apparatus according to claim 1, wherein   3. The electronic music apparatus according to claim 2, further comprising a changing unit configured to change a display mode of an area from the position before the movement to the position after the movement on the second designation unit. A program for causing a computer to execute a control method for controlling an electronic music apparatus having a touch panel display having a multipoint recognition function,
The control method is:
A display step for displaying on the touch panel display a note input screen including a first designation unit for designating the pitch of the input note and a second designation unit for designating the sounding timing of the input note; ,
A first determination step of determining a pitch at the touch position when the user touches the first designation unit;
A second determination step of determining an input position in the time direction of the input note based on the touch position when the user touches the second designation unit;
When the pitch of the input note is designated by the user touching the first designation portion, and the second designation portion is touched, the note having the pitch determined by the first determination step. And an input step for inputting to the input position determined in the second determination step.

Images