JP5803705B2 - Electronic musical instruments - Google Patents

Description

  The present invention relates to an electronic musical instrument having a function of generating musical sounds in response to a user operation on a screen displayed on a display. In particular, the present invention relates to a technique for reproducing a musical tone of a special performance tone such as a musical tone of an internal performance of a grand piano or a musical tone of a prepared piano.

  For example, a natural musical instrument (acoustic instrument) such as a grand piano has a sound generation element such as a string that can vibrate in a sound generation mechanism for each key, and the user touches the strings directly. A special performance method called “internal performance method” is known in which a musical tone is generated by vibrating the string. By changing the position where the user touches the string, the user can repel the string directly with a finger or pick, or play the keyboard while touching the string, thereby playing various musical tones that cannot be achieved with normal keyboard performance. Can be issued. For this reason, the user can perform a variety of performances with a single piano by performing a combination of internal playing and normal keyboard performance.

  There is also a so-called “prepared piano”. This is one of the special performances. In a normal grand piano, metal or wood chips are sandwiched between strings in advance, and when the keyboard is played in this state, the tone is completely different from the normal piano tone. The sound of According to this, the user can generate musical tones of various timbres by changing the type and position of the thing to be sandwiched between strings, and preliminarily arrange a plurality of metals, pieces of wood, etc. on a plurality of strings. Thus, even a single instrument can generate musical tones with completely different timbres depending on the keys, so that it is possible to perform a variety of performances with a single piano.

  On the other hand, in recent electronic musical instruments, a virtual operator imitating a physically existing performance operator (eg, a keyboard) is displayed in advance on a touch panel display, and a user touch to the virtual operator is displayed. According to the operation, it is possible to generate the same musical sound as when the user operates the performance operator (see, for example, Patent Document 1 shown below).

JP 2010-204401 A

  By the way, in a natural musical instrument, for example, in order for a user to directly touch a string in a grand piano or to insert a metal or a piece of wood between strings beforehand, a large preparation such as removing the piano roof is required. Also, touching the strings directly or putting metal or wood pieces between the strings can damage the strings and cut or rust them, which can promote the deterioration of the piano. Furthermore, in the case of the internal performance method, it is difficult to perform such a performance operation by only one performer because it is necessary to touch the strings while performing the keyboard performance. For these reasons, it is very difficult for general users to actually perform musical performances of special performances using natural instruments, even though the performances of internal performances and prepared pianos are attractive. is there.

  The present invention has been made in view of the above points, and reproduces a musical tone of a special performance tone such as an internal performance tone or a prepared piano tone according to a user operation on a screen imitating a sound generation mechanism including a sound generation element in a natural musical instrument. It is intended to provide an electronic musical instrument that can be used.

  The electronic musical instrument according to claim 1 of the present invention is a display means for displaying a screen simulating the sound generation mechanism of a keyboard instrument, and the screen at least shows a virtual sounding element that emits sound by vibrating in the sound generation mechanism. A detection element for detecting a user operation on the screen displayed on the display means; an operation by the user detected by the detection means in the screen displayed on the display means; Identifying means for identifying which position on the virtual pronunciation element image displayed corresponding to the operation position in the screen corresponding to the operation position, and a keyboard instrument imitating the sound generation mechanism A tone generation unit that generates a tone of a second tone different from the one tone, the tone generation unit responding to each arbitrary position on the virtual pronunciation element image in response to detection of the user operation. From the Tagged tone of the second tone, and a configured to generate a musical tone of a second tone corresponding to the position on the virtual sound image element has the identified.

  According to the present invention, as a screen imitating the sound generation mechanism of a keyboard instrument, a screen including at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound, which the sound generation mechanism has, is displayed on the display means. When the user performs any operation on the screen displayed on the display means, the operation is displayed corresponding to the operation position in the screen where the user has operated in response to detecting the user operation. It is specified to which position on the virtual pronunciation element image that the operation position corresponds. Based on the identified operation position, a tone having a tone different from the tone of the keyboard instrument simulating the tone generation mechanism, and a tone having a second tone associated with each arbitrary position on the virtual tone generation element image The tone color of the second tone color corresponding to the position on the identified virtual pronunciation element image is generated. In this way, in the electronic musical instrument, a screen including a virtual sounding element image simulating the sounding element of the sounding mechanism in the keyboard instrument is displayed on the display means instead of the virtual performance sounding element imitating the performance manipulator. In response to detection of a user touch operation or the like on the virtual pronunciation element image displayed on the screen, the user generates a tone of the second tone different from the tone of the natural musical instrument generated by the normal performance. It is possible to easily generate the musical tone of the internal performance in the same manner as the actual “internal performance” performance mode of a keyboard instrument such as playing a string directly.

  An electronic musical instrument according to a second aspect of the present invention is a display means for displaying a screen imitating a sound generation mechanism of a keyboard instrument, and the screen is a virtual display that indicates at least a sound generation element that vibrates and emits sound possessed by the sound generation mechanism. A detection element for detecting a user operation on the screen displayed on the display means; an operation by the user detected by the detection means in the screen displayed on the display means; Identifying means for identifying at which position on the virtual pronunciation element image displayed corresponding to the operation position in the screen corresponding to the operation position, supply means for supplying performance information, A tone generation unit that generates a tone of a second tone different from the first tone of a keyboard instrument simulating a sound generation mechanism, the tone generation unit being in a state where a position on the virtual tone generation element image is specified According to serial performance information is supplied, and a one that generates a musical tone of the second tone associated with the position on the virtual sound element image in pitch based on the performance information. According to this, the user can easily generate the musical tone of the internal performance in the same manner as the actual “internal performance” performance mode of the keyboard instrument in which the keyboard is operated while touching the string.

  An electronic musical instrument according to a third aspect of the present invention is a display means for displaying a screen simulating the sound generation mechanism of a keyboard instrument, and the screen is a virtual display that indicates at least a sound generation element that vibrates and emits sound of the sound generation mechanism. A detection element for detecting a user operation on the screen displayed on the display means; an operation by the user detected by the detection means in the screen displayed on the display means; Identifying means for identifying at which position on the virtual pronunciation element image displayed corresponding to the operation position in the screen corresponding to the operation position, supply means for supplying performance information, A musical tone generating means for generating a musical tone of a second timbre different from the first timbre of a keyboard instrument simulating a sounding mechanism, wherein the musical tone generating means is configured to specify a position on the virtual pronunciation element image according to the position specified on the virtual tone generation element image. And a one tone in the first tone of the keyboard instrument that is generated in response to the supply of the performance information, to change the tone of the second tone associated with the position on the virtual sound element image. According to this, the user can easily generate the musical sound of the internal performance method in the same manner as the performance mode of the actual “internal performance method” in the natural musical instrument in which the user directly touches the already vibrating string according to the keyboard operation. become able to.

  An electronic musical instrument according to a fourth aspect of the present invention is a display means for displaying a screen simulating the sound generation mechanism of a keyboard musical instrument, and the screen is a virtual display that indicates at least a sound generation element that vibrates and emits sound of the sound generation mechanism. Arrangement means for arranging an arbitrary object image with respect to the virtual pronunciation element image in the screen displayed on the display means, an arbitrary object for the virtual pronunciation element image in the screen A means for generating a musical tone of a second tone different from the first tone of the keyboard instrument imitating the sound generation mechanism, a detecting means for detecting an arrangement mode of the image, a supplying means for supplying performance information; The musical sound generation means is configured to detect the detected object from the second timbre musical sounds associated with the arrangement form of the object image in accordance with the performance information supplied from the supply means. And a configured to generate a musical tone of a second tone corresponding to arrangement of the bets image. According to this, the user can arbitrarily change the virtual tone generation element image in the screen in the same way as changing the timbre by changing the kind and position of the thing to be put between strings like an actual prepared piano. By arranging the object image and changing the arrangement mode, it is possible to easily generate the musical sound of the prepared piano (the musical sound of the second tone color) from the electronic musical instrument.

  The present invention can be constructed and implemented not only as a device invention but also as a method invention. Further, the present invention can be implemented in the form of a program of a processor such as a computer or a DSP, or can be implemented in the form of a storage medium storing such a program.

According to the present invention, in the electronic musical instrument, a screen including a virtual sounding element image simulating the sounding element of the sounding mechanism in the keyboard instrument is displayed on the display unit, not the virtual performance sounding element imitating the performance operator. In response to detection of a user touch operation or the like on the virtual pronunciation element image in the screen, the user reproduces the tone of the second tone that is different from the tone of the natural musical instrument generated by the normal performance. An effect is obtained that it is possible to easily generate the musical sound of the internal performance in the same manner as the actual “internal performance” performance mode of the musical instrument.
Further, by arranging an arbitrary object image with respect to the virtual sound generation element image in the screen and changing the arrangement mode, it is possible to easily generate the musical sound of the prepared piano from the electronic musical instrument.

1 is a block diagram of a hardware configuration showing an example of the overall configuration of an electronic musical instrument according to the present invention. It is a conceptual diagram which shows an example of the special performance screen displayed on a display. It is a flowchart which shows one Example of a screen touch process. It is a flowchart which shows one Example of an internal performance process. It is a flowchart which shows one Example of a prepared piano setting process. It is a flowchart which shows one Example of a key pressing process.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a hardware configuration block diagram showing the overall configuration of an electronic musical instrument according to the present invention. The electronic musical instrument shown in this embodiment is an electronic keyboard instrument in which a performance operator is provided with a keyboard. The electronic musical instrument shown in this embodiment is controlled by a microcomputer including a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3. The CPU 1 controls the operation of the entire electronic musical instrument. With respect to this CPU 1, ROM 2, RAM 3, detection circuits 4, 5, detection circuit 6, display circuit 7, sound source / effect circuit 8, storage device 9, communication interface (I / F) 10 via data and address bus 1D Are connected to each other.

  The ROM 2 stores various control programs executed by the CPU 1 and, for example, tone sounds generated in response to the execution of an internal performance by a user using a grand piano or tone sounds generated from a prepared piano (special performance tone sounds). ) Is stored and a large number of waveform data obtained by sampling is stored. A large number of waveform data are, for example, one or a plurality of strings that are sounding elements of each key of a grand piano, the strength applied when the strings are actually played by the user, the user operation position on the strings ( As an example, the back side and the near side of the piano when viewed from the performer), or the combination of the velocity when the corresponding key is pressed and the user operation position on the string, and the metal sandwiched between the strings And a waveform database that is mapped in association with arbitrary parameters according to the performance mode at the time of sampling, the member installation status, and the like, such as combinations of member types such as wood pieces and their arrangement positions with respect to the strings.

  The RAM 3 is used as a working memory that temporarily stores various data generated when the CPU 1 executes a predetermined program, or as a memory that stores a currently executed program and related data. A predetermined address area of the RAM 3 is assigned to each function and used as a register, flag, table, memory, or the like.

  The performance operator 4A is a physical performance operator such as a keyboard provided with a plurality of keys for selecting the pitch of a musical tone, and has a key switch corresponding to each key. The operator 4A (keyboard or the like) can be used not only for hand-playing by the user but also for selecting an initial tone, for example. In this specification, the initial timbre corresponds to the timbre of a musical tone generated in a normal performance mode, which will be described later, and a virtual string for which a user touch operation has not been performed on a “special performance screen” (see FIG. 2) which will be described later in a special performance mode. The tone color of a musical tone generated when a key corresponding to a virtual string on which no key or object is placed is operated. The detection circuit 4 generates a detection output by detecting the pressing and release of each key of the performance operator 4A. In addition to the above-described keyboard, the performance operator 4A includes one or more pedals for instructing the application of effects such as changing the volume of a musical tone being sounded or extending only an arbitrary musical tone for a long time. It may be.

  A setting operator (switch, etc.) 5A is a physical operator arranged on the main body panel. For example, a mode switching button for switching device settings between a normal performance mode and a special performance mode, and a musical sound control parameter value are changed. For example, it is configured to include various operators such as a dial type or slider type input operator. The normal performance mode is a mode in which only the initial tone color tone is generated, and the special performance mode is a mode in which an internal performance method tone or a prepared piano tone is generated. In addition to the above, the setting operator 5A is displayed on a numeric keypad for inputting numeric data, a keyboard for inputting character data, or a display TP for selecting, setting, and controlling the pitch, initial tone, effect, etc. Various operators such as a mouse for operating the cursor may be included. The detection circuit 5 detects the operation state of the setting operation element 5A, and outputs switch information and the like corresponding to the operation state to the CPU 1 via the data and address bus 1D.

  The display device TP is a touch panel type display composed of, for example, liquid crystal (LCD), organic EL, electronic paper, or the like. In response to detecting (recognizing) a touch operation on the display unit TP by a user, the detection circuit 6 includes a coordinate position (xy coordinate) on the display unit TP that has been touched, an operation speed, and the like. A signal is generated and output to the CPU 1 via the data and address bus 1D. The touch operation detection method (that is, the detection circuit 6) of the display TP may be any known type, for example, any type such as a capacitance type, a resistance film type, and a built-in optical sensor type. It may be. Further, it may be one that can simultaneously detect multiple points on the display TP. For example, the display circuit 7 performs control to display various screens such as a special performance screen (see FIG. 2), which will be described later, on the display TP, as well as control programs stored in the ROM 2, the storage device 9, and the like. Control for displaying data or the control state of the CPU 1 can also be performed. Note that one to many images included in various screens displayed on the display device TP and the coordinate positions on the display device TP are linked in advance, and the screen being displayed according to the detection of the coordinate position by the detection circuit 6. It is possible to detect which position of which image included in the image is touched by the user.

  The tone generator / effect circuit 8 can simultaneously generate musical tone signals on a plurality of channels, and from the waveform memory (ROM 2) in response to input of data and performance information or screen touch information given via the address bus 1D. The corresponding waveform data is read to generate a musical sound signal. An effect can also be given to the generated musical sound signal. The musical tone signal generated from the sound source / effect circuit 8 is generated from a sound system 8A including an amplifier and a speaker. It should be noted that any conventional configuration may be used for the configuration of the sound source / effect circuit 8 and the sound system 8A. For example, the tone synthesis method of the tone generator / effect circuit 8 is not limited to the waveform memory method, and an FM method, a physical model method, a harmonic synthesis method, a formant synthesis method, or the like may be adopted. Any of these may be used alone or in combination. In other words, by changing the waveform data read from the waveform memory, it is not limited to generating internal tones of different timbres or tones of a prepared piano, but differs depending on the effect processing on the musical sounds synthesized by various musical tone synthesis methods. It is also possible to generate musical tones with internal tone and prepared piano. Furthermore, the sound source / effect circuit 8 may be configured by software processing by the CPU 1 or may be configured by dedicated hardware.

  The storage device 9 stores various data such as various control programs executed by the CPU 1 and a large number of waveform data described above. When the control program is not stored in the ROM 2 described above, the control program is stored in the storage device 9 (for example, a hard disk) and read into the RAM 3 to store the control program in the ROM 2. It is possible to cause the CPU 1 to execute the same operation as in FIG. In this way, control programs can be easily added and upgraded. The storage device 9 is not limited to a hard disk (HD), but may be a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), or a DVD (Digital Versatile Disk). It may be a storage device using a portable storage medium in the form. Alternatively, a semiconductor memory such as a flash memory may be used.

  A communication interface (I / F) 10 is an interface for transmitting and receiving various information such as a control program and various data between the apparatus and an external device (not shown). The communication interface 10 may be, for example, a MIDI interface, a LAN, the Internet, a telephone line, or the like, and may include both wired and wireless ones.

Note that the performance operator 4A, the display TP, the sound source / effect circuit 8 and the like are not limited to those built in one apparatus body, but each is configured separately, and each communication unit such as a MIDI interface or various networks is used. Needless to say, the apparatus may be configured to be connected.
The present invention is not limited to an electronic musical instrument, and includes a touch panel display TP such as a personal computer, a portable communication terminal such as a PDA (personal digital assistant) or a mobile phone, or a game device, and can be used for user operations. Any type of apparatus / apparatus may be used as long as it can generate a musical sound accordingly. In the case of a mobile communication terminal, not only the case where a predetermined function is completed with only the terminal, but a part of the function is provided on the server side, and the predetermined function is realized as a whole system including the terminal and the server You may do it.

  In the present embodiment, a screen simulating a sound generation mechanism including a sound element in a natural musical instrument (referred to as a special performance screen for convenience) is displayed on the display TP, and an internal performance method corresponding to a user touch operation on the screen is displayed. A musical tone can be generated, or a musical tone of a prepared piano according to the object arrangement on the screen can be generated. An example of the special performance screen is shown in FIG. As the special performance screen, a screen simulating the sound generation mechanism of the musical instrument corresponding to the initial tone color is selectively displayed in accordance with switching to the special performance mode.

  The special performance screen shown in FIG. 2 can be broadly divided into a sound generation mechanism display area, a keyboard display area, and a menu display area. In the sound generation mechanism display area, for example, a piano internal screen O in which a string stretched inside the grand piano is viewed from above is displayed. In the piano internal screen O, a plurality of virtual string images L (hereinafter simply referred to as virtual strings) are displayed, and each virtual string L indicates which of the keys that are the physical performance operators 4A. . Here, an example is shown in which notes pre-assigned to each key are displayed as pitch names (A, A #,...). A keyboard illustration P corresponding to the keyboard is displayed in the keyboard display area. In the keyboard illustration P, for example, the keys are displayed in different colors or displays so that the user can distinguish at a glance a key on which the virtual string L is displayed and a key on which the virtual string L is not displayed. It is shown separately according to the aspect.

  In the menu display area, one or more object buttons Qa for setting a prepared piano, and an edit menu (not shown) used when adding, deleting, and replacing the object buttons Qa are separately displayed on the screen. An edit button Qb for saving and a save button Qc for saving or reading the prepared piano settings are displayed. The object button Qa indicates the name and size of the member that is virtually sandwiched between the strings, such as “metal piece (screw etc.) / Medium size”, “wood piece / medium size”, “rubber piece / medium size”, etc. It is only necessary to be displayed with a button or an icon imitating the form of a member.

  The user can drag and drop an arbitrary object button Qa onto the virtual string L, and an object image Y (hereinafter simply referred to as an object) corresponding to the object button Qa is displayed at the drop position in accordance with this operation. For example, when the object button Qa is dragged and dropped on the relatively far side of the virtual string L having the pitch “A” at the left end in the drawing, the screw object Y is displayed at the drop position. The user can not only drag and drop the same or different object buttons Qa to each of the plurality of virtual strings L, but also can drag and drop the same or different object buttons Qa to one virtual string L. Thereby, the user can set the prepared piano in a state where the member is virtually sandwiched between the strings. When the dragged object button Qa is continuously dropped on a plurality of adjacent virtual strings L, one object Y that crosses the plurality of virtual strings L may be displayed.

  It should be noted that the enlargement / reduction of the piano internal screen O may be changed in accordance with the range specified by a key pressing operation on the keyboard or a touch operation on the keyboard display area. For example, if the range is set narrow (or wide) by the keyboard, the piano internal screen O is enlarged (or reduced). At this time, the piano internal screen O may be switched between full key range display and partial key range display. Further, by using an edit menu (not shown) that is displayed separately when the edit button Qb is pressed, the display mode of the piano internal screen O (for example, the enlargement ratio, the internal peep angle, that is, the display mode of the virtual string L, virtual The display range of the string L) may be changed. Further, the keyboard range displayed on the keyboard illustration P may be adjusted to an arbitrary range and displayed in accordance with the range being specified by a key pressing operation on the keyboard.

  By performing a touch operation on the piano internal screen O, the user can generate a musical sound of an internal performance. As a first generation method of a musical tone of an internal performance method, in response to detecting a touch operation on an arbitrary virtual string L, a musical tone having a different tone color corresponding to the strength and direction of the touch and the touch position is generated. However, a musical sound is generated when a touch operation that flicks a string, that is, a sliding operation between the left and right positions sandwiching the virtual string L is detected without generating a musical sound simply by detecting a touch on the virtual string L. . At this time, according to the strength of the touch operation for repelling the string (for example, it can be considered according to the speed at which the finger is moved) and the touch position of the virtual string L, the corresponding waveform data is read to generate a musical sound. .

  As a second generation method of the internal performance musical tone, the virtual string L is touched when an arbitrary virtual string L is touched and a key corresponding to the virtual string L is operated. A musical tone having a tone different from that of the initial tone generated in the absence of the tone is generated. At this time, according to the velocity at the time of key depression and the touch position of the virtual string L, the corresponding waveform data is read to generate a musical sound.

  In addition, the user can generate a musical tone of the prepared piano by operating the keyboard after setting the prepared piano. As a method for generating a musical sound of a prepared piano, a tone color different from the initial tone color generated in a state where the object Y is not arranged in response to the operation of the key corresponding to the virtual string L where the object Y is arranged is used. Generate music. At this time, according to the type and arrangement position of the object Y, corresponding waveform data is read to generate a musical sound.

  Next, a description will be given of various types of processing for realizing the musical tone generation of the internal performance method and the musical tone generation of the prepared piano using the special performance screen (see FIG. 2). FIG. 3 is a flowchart illustrating an example of the screen touch process. This “screen touch process” is started by the CPU 1 in accordance with the display of the special performance style screen on the display TP in response to the user's instruction to switch to the special performance mode.

  In step S1, in response to detection of a user touch operation on the special performance screen, the touched position (touch position) is any one of “sounding mechanism display area”, “keyboard display area”, and “menu display area”. Determine if it is an area. If it is the sounding mechanism display area, the internal performance method shown in FIG. 4 is executed (step S2). If it is the keyboard display area, display change processing described later is executed (step S3). If it is the menu display area, the prepared piano setting process shown in FIG. 5 is executed (step S4).

  The internal performance process (see step S2 in FIG. 3) will be described. FIG. 4 is a flowchart showing an embodiment of the internal performance method. Step S11 obtains various information such as the coordinate position of each virtual string L displayed on the piano internal screen O on the display TP and notes assigned to each key corresponding to each virtual string L. . In step S12, whether or not the musical sound is being sounded, and if the musical sound is being sounded, the sounding is started when the key corresponding to the virtual string L in the state where the user is touching the musical sound being sounded is pressed. It is determined whether or not the musical tone has been played. If it is determined that the musical sound is being generated and the musical sound being generated is due to a key pressing operation on the key corresponding to the virtual string L in the touched state (YES in step S12), the musical sound being generated is muted. Attenuation processing is executed (step S20). In other words, the internal performance method of touching the strings for the musical sound that is sounding (in the state that the strings vibrate on the grand piano) is intended to mute the sound. Mutes a normal musical tone.

  The musical tone is not being generated or the musical tone being generated is not due to a key pressing operation on the key corresponding to the virtual string L in the touched state (that is, a key other than the key corresponding to the virtual string L in the touched state is pressed). If it is determined that the key is operated and a musical tone is started to be generated (NO in step S12), the touch position accompanying the user touch operation and the movement of the touch position are detected (step S13). In step S14, it is determined whether or not the touch operation corresponding to the detection involves selection of the object Y. If it is determined that the touch operation involves the selection of the object Y (YES in step S14), the process proceeds to a prepared piano setting process (see step S32 in FIG. 5) described later.

  The user can select the object Y by touching the object Y already placed on the virtual string L for a certain period of time (for example, 2 seconds or more), and can be selected by moving the touch position. The object Y can be shifted to another position of the virtual string L or moved onto another virtual string L. Since the arrangement change of the object Y corresponds to the setting of the prepared piano, when the touch operation is performed even during the internal performance process, the process is changed to the prepared piano setting process (see FIG. 5). Transition. That is, it does not sound the internal musical tone.

  On the other hand, when it is determined that the touch operation does not involve selection of the object Y (NO in step S14), it is determined whether or not the touch operation involves selection of the virtual string L (step S15). That is, it is determined whether or not the touch operation is performed on the virtual string L. If it is determined that the touch operation is not an operation involving selection of the virtual string L (NO in step S15), the process jumps to the process in step S21. In this case, the touch operation is not for the virtual string L, and the internal musical tone is not generated.

  When it is determined that the touch operation is an operation involving selection of the virtual string L, that is, at least the virtual string L is touched (YES in step S15), an internal performance method prepared for each key assigned in advance to each key. For example, “1” is set to the internal performance flag of the key corresponding to the touched virtual string L among the flags (step S16). A step S17 decides whether or not the touch operation has passed over the virtual string L. If it is determined that the touch operation has not passed over the virtual string L (NO in step S17), the process jumps to the process in step S21. In this case, the touch operation is merely an operation of touching the virtual string L, and is not an operation of repelling the string. However, when the corresponding key is pressed while the virtual string L is touched, an internal performance musical tone is generated. This sound generation process is executed by a key pressing process (see step S42 in FIG. 6) described later.

  If it is determined that the touch operation has passed over the virtual string L (YES in step S17), a sound generation process is executed (step S18). This sound generation process is a process for realizing the first method for generating an internal performance musical tone, and an internal performance musical tone is generated with a note assigned in advance to a key corresponding to the touched virtual string L. At that time, the timbre is changed or the volume is controlled according to the speed at which the finger is moved or the touch position of the virtual string L. In step S19, the internal performance flag of the note for which the sound generation process has been executed is cleared to “0”, for example.

  In step S21, it is determined whether or not the touch operation is a release operation for releasing the finger from the screen. If it is determined that the touch operation is not a release operation for releasing the finger from the screen (NO in step S21), the process returns to step S13. If it is determined that the touch operation is a release operation that releases the finger from the screen (YES in step S21), all internal performance flags are cleared to “0” (step S22).

  The display change process (see step S3 in FIG. 3) will be described. In the display change process (not shown), when a touch operation in the keyboard display area is detected, a process of changing the piano internal screen O displayed in the sounding mechanism display area is executed. Specific examples are shown below.

  First, when it is detected that two keys on the keyboard illustration P are simultaneously touched in the keyboard display area, the two pitches based on the note numbers assigned to the two keys are set to the lowest and highest pitches, respectively. As the sound, the piano internal screen O is changed so that the virtual string L related to only the keys to which the pitches within the range of the lowest and highest sounds are assigned is displayed. Secondly, when it is detected that a pinch operation is performed in which the finger is moved closer to or away from the keyboard display area while holding the screen with two fingers, the operation amount and the operation speed of the pinch operation are increased. Accordingly, the piano internal screen O is changed so that the virtual string L is enlarged / reduced. In this case, the range of the virtual string L displayed in the piano internal screen O changes to narrow / wide according to the enlarged / reduced display of the virtual string L. Third, when it is detected that a swipe operation such as sweeping the screen with a finger is performed in the keyboard display area, the current enlargement ratio is maintained according to the operation amount and operation speed of the swipe operation. The piano internal screen O is changed so that the virtual string L is scroll-displayed left and right. In this way, the user can set the range of the virtual string L to be displayed in the piano internal screen O by a touch operation in the keyboard display area.

  When the piano internal screen O is changed, the display in the keyboard display area is updated so as to indicate the keyboard range corresponding to the range of the virtual string L being displayed in the keyboard display area. In addition, when a pinch operation or a swipe operation is performed, the display range of the keyboard illustration P in the keyboard display area may be updated to be narrower / wider. When the range of the virtual string L is changed, the notes assigned to the keys corresponding to the virtual strings L within the changed range are displayed in association with the virtual strings L in the piano internal screen O. Of course.

  The prepared piano setting process (see step S4 in FIG. 3) will be described. FIG. 5 is a flowchart showing an embodiment of the prepared piano setting process. In step S31, it is determined whether or not the touch operation is selection of the object button Qa. When it is determined that the object button Qa is not selected, that is, the editing menu (not shown) displayed separately in response to the touch operation on the edit button Qb or the save button Qc or the touch operation on the edit button Qb. If it is a touch operation (NO in step S31), other processing is executed (step S36). Other processing includes addition, deletion, replacement processing of the object button Qa, processing for changing the display mode of the piano internal screen O, processing for saving / reading the prepared piano settings, and the like.

  If it is determined that the object button Qa is selected (YES in step S31), it is determined whether or not the object button Qa selected according to the touch operation is arranged on the virtual string L (step S32). If it is determined that the object button Qa is not placed on the virtual string L (NO in step S32), the prepared piano flag is cleared to “0” (step S35). However, when the object button Qa is dragged and dropped on a screen other than the piano internal screen O, the object Y is not arranged on the virtual string L, so that nothing is required. On the other hand, the object Y originally arranged on the virtual string L is selected (see step S14 in FIG. 4), and it is dragged and dropped on the screen other than the piano internal screen O, and one object Y is also placed on the virtual string L. In the case of no arrangement, it corresponds to the virtual string L in which the dragged and dropped object Y is arranged among the prepared piano flags prepared in units of notes pre-assigned to the keys. Clear the key's prepared piano flag to "0". A prepared piano flag is prepared for each object type in units of notes.

  When the object button Qa selected according to the touch operation is arranged on the virtual string L, that is, when it is determined that the object button Qa is dragged and dropped to the piano internal screen O (YES in step S32), the prepared piano flag is set. “1” is set (step S33). At this time, when the object button Qa is arranged across a plurality of adjacent virtual strings L, a prepared piano flag is set for each of the plurality of virtual strings L. Note that the process of step S33 is also executed when the object Y originally placed on the virtual string L is selected and moved onto another virtual string L (see step S14 in FIG. 4). In this case, the prepared piano flag for the virtual string L where the object Y was originally placed is cleared to “0”. A step S34 displays the object Y at the drop position of the object button Qa on the piano internal screen O. In this way, the prepared piano setting is realized.

  In the present embodiment, not only a musical tone of an internal performance is generated in response to a touch operation that repels the virtual string L (see step S18 in FIG. 4), but the key (performance) is kept touching the virtual string L. The musical tone of the internal performance is also generated by operating the operator 4A). Further, when a key corresponding to the virtual string L on which the object Y is arranged is operated, a musical tone of a prepared piano is generated. Therefore, processing executed in accordance with the key pressing operation will be described with reference to FIG. FIG. 6 is a flowchart showing an embodiment of the key pressing process. This process is executed by the CPU 1 in response to a key pressing operation (key-on operation) of the performance operator 4A. Note that this processing may be performed in response to receiving MIDI note-on from an external device or note-on by playing back sequence data.

  In step S41, it is determined whether one of the internal performance flag and the prepared piano flag of the note assigned to the pressed key is set, or neither flag is set. When the internal performance flag is raised, that is, when the key is operated while the virtual string L is touched, a musical tone of the internal performance is generated with a tone corresponding to the touch position of the virtual string L (step) S42). This sound generation process is a process for realizing a second method for generating an internal performance musical tone, and an internal performance musical tone is generated with notes pre-assigned to keys. At that time, the timbre is changed according to the touch position of the virtual string L.

  On the other hand, when the prepared piano flag is raised, that is, when the key corresponding to the virtual string L on which the object Y is arranged is operated, the musical tone of the prepared piano is set with a tone corresponding to the type of the arranged object Y. Is generated (step S44). This sound generation process is a process for realizing a method for generating a musical sound of a prepared piano, and generates a musical sound of a prepared piano with notes pre-assigned to keys. At this time, the timbre is changed according to the type and arrangement position of the object Y. If neither flag is set, a musical tone is generated with the initial tone color (step S43). That is, the generation of musical sounds during normal performance is realized.

  As described above, the special performance method screen including the display of the virtual sound generation element image (virtual string L) imitating the sound generation element of the sound generation mechanism of the natural musical instrument is displayed on the display TP, and the virtual string L is displayed on the virtual string L. On the other hand, when the user performs any touch operation, a musical tone having a special performance tone color different from the tone color of the natural musical instrument imitating the sound generation mechanism is generated based on the touch position in the virtual sound generation element image. Alternatively, an arbitrary object image can be arranged with respect to the virtual pronunciation element image in the screen displayed on the display TP, and the pronunciation according to the arrangement mode of the arbitrary object image with respect to the virtual pronunciation element image A musical tone having a special performance tone color different from that of a natural musical instrument simulating a mechanism is generated according to a key depression operation or a note-on reception from an external device.

  In this way, in an electronic musical instrument, a virtual sounding element image (virtual sounding element image simulating a sounding element such as a string, which vibrates and emits sound generated by the sounding mechanism of a natural musical instrument, not a virtual performance sounding element imitating the performance operator 4A. A special performance screen including a string L) is displayed on the display TP, and a musical sound generated by a normal performance is detected in response to detection of a user touch operation on the virtual pronunciation element image displayed on the screen. Now reproduces musical sounds with special performance timbres with different timbres. As a result, the user can easily generate the musical sound of the internal performance in the same manner as the actual “internal performance” performance mode of the natural musical instrument. An advantage of the present invention is that musical sounds can be generated in a performance mode that cannot be realized with natural musical instruments. For example, a single player can virtually perform a performance while touching the inner part of a string that cannot be reached by an actual grand piano. If the piano internal screen O is displayed in a reduced size, a touch panel that supports multi-touch can touch two distant virtual strings L simultaneously or touch more virtual strings L simultaneously (for example, all 88 strings). ) Since you can play the keyboard, you can easily realize various expressions by playing.

  Further, according to the present embodiment, the virtual string L is generated in the state where the musical data is generated by reproducing the song data on the electronic musical instrument (or in the state where the musical sound is generated by note-on received from the external device). By touching, you can change only some of the musical sounds included in the piano part of the song data being played back to internal musical tones (in other words, you can change the timbre). Alternatively, when song data is played with the prepared piano settings read out, it is possible to play a song by changing some of the musical tones included in the piano part to those of the prepared piano (in other words, changing the tone) it can. That is, the performer can easily change a part of the musical sounds from the screen to the musical sounds of the internal performance or the prepared piano even if the music data generates the musical sounds of the normal performance.

  As mentioned above, although an example of embodiment was demonstrated based on drawing, this invention is not limited to this, It cannot be overemphasized that various embodiment is possible. For example, the object Y arranged on the virtual string L is not limited to a metal piece, a piece of wood, a rubber piece, or the like, but may be an object that cannot actually be placed on a piano. For example, cotton (because it is fluffy, there is a risk that it will get inside the natural musical instrument) or ice (natural language breaks down with a natural musical instrument). By simulating and generating musical sounds when they are arranged on strings, it is possible to achieve expressions that are impossible with an acoustic piano and realize various expressions.

  In the above-described embodiment, an example of generating a musical sound of an internal performance method of a grand piano has been shown. However, in this embodiment, an internal performance method is used for any musical instrument as long as it is a keyboard instrument having a mechanical sound generation mechanism. It is possible to reproduce the musical sound. As for the sounding mechanism, the sounding element is a string (Grand piano, harpsichord, etc.), the sounding element is a piece of metal (Wurlitzer piano), the sounding element is a tuning fork (Rhodes (Rose) ) Piano) or the like. For example, when the special performance mode is set when a rose piano tone is selected, a virtual tuning fork is displayed instead of the virtual string L. The user can reproduce the musical tone of the tone when hitting the tuning fork by directly touching the virtual tuning fork, or can reproduce the musical tone of a tone different from the normal performance by playing the keyboard while touching the virtual tuning fork. Further, when a virtual tuning fork is touched while a musical tone is generated, a silencing effect can be obtained.

  In the above-described embodiment, an example is shown in which a musical tone generation or a prepared piano setting for an internal performance is performed according to a user touch operation on a touch panel display, but the present invention is not limited thereto. The display device does not have to be a touch panel type. In this case, an arbitrary user operation corresponding to the user touch operation with respect to the virtual string L is performed according to the operation of a pointer that moves on the screen according to the operation of the mouse or the trackball. What is necessary is just to detect and to perform the musical tone generation of an internal performance method and a prepared piano setting.

DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4,5 ... Detection circuit, 4A ... Performance operator (keyboard etc.), 5A ... Setting operator (switch etc.), 6 ... Detection circuit, 7 ... Display circuit, TP ... Display, 8 ... Sound source / effect circuit, 8A ... Sound system, 9 ... Storage device, 10 ... Communication interface, 1D ... Data and address bus, L ... Virtual strings, O ... Piano internal screen, P ... Keyboard illustration, Qa ... Object button, Qb ... Edit button, Qc ... Save button, Y ... Object

Claims (8)

Display means for displaying a screen imitating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound, which the sound generation mechanism has,
Detecting means for detecting a user operation on the screen displayed on the display means;
In the screen displayed on the display means, at any position on the virtual pronunciation element image displayed corresponding to the operation position in the screen where the user has detected an operation detected by the detection means, the operation position A means of identifying whether this is true,
A tone generation unit that generates a tone of a second tone different from the first tone of the keyboard instrument simulating the sound generation mechanism, wherein the tone generation unit detects the virtual tone generation element image in response to detection of the user operation. An electronic musical instrument comprising: a second tone color tone corresponding to a position on the identified virtual tone generation element image from second tone color tone sounds associated with each of arbitrary positions above. Display means for displaying a screen imitating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound, which the sound generation mechanism has,
Detecting means for detecting a user operation on the screen displayed on the display means;
In the screen displayed on the display means, at any position on the virtual pronunciation element image displayed corresponding to the operation position in the screen where the user has detected an operation detected by the detection means, the operation position A means of identifying whether this is true,
Supply means for supplying performance information;
A tone generator for generating a tone of a second tone different from the first tone of the keyboard instrument simulating the tone generation mechanism, the tone generator being in a state in which the position on the virtual tone generation element image is specified; An electronic musical instrument comprising: a musical tone of a second tone color associated with a position on the virtual pronunciation element image at a pitch based on the performance information in response to the performance information being supplied. Display means for displaying a screen imitating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound, which the sound generation mechanism has,
Detecting means for detecting a user operation on the screen displayed on the display means;
In the screen displayed on the display means, at any position on the virtual pronunciation element image displayed corresponding to the operation position in the screen where the user has detected an operation detected by the detection means, the operation position A means of identifying whether this is true,
Supply means for supplying performance information;
A musical tone generating means for generating a musical tone of a second tone different from the first musical tone of the keyboard musical instrument imitating the sound generation mechanism, wherein the musical tone generating means is configured to perform the performance according to specification of the position on the virtual pronunciation element image. An electronic musical instrument comprising: a musical tone of a first timbre of the keyboard instrument generated in response to supply of information is changed to a musical tone of the second timbre associated with a position on the virtual pronunciation element image. Display means for displaying a screen imitating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound, which the sound generation mechanism has,
Arrangement means for arranging an arbitrary object image with respect to the virtual pronunciation element image in the screen displayed on the display means;
Detecting means for detecting an arrangement mode of an arbitrary object image with respect to the virtual pronunciation element image in the screen;
Supply means for supplying performance information;
A tone generation means for generating a tone of a second tone different from the first tone of the keyboard instrument simulating the sound generation mechanism, wherein the tone generation means is configured to supply the object image according to the performance information supplied from the supply means. An electronic musical instrument that generates a second tone color tone corresponding to the detected arrangement state of the object image from the second tone color tone sounds associated with the arrangement mode. On the computer,
A procedure for displaying on the display means a screen simulating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound possessed by the sound generation mechanism;
A procedure for detecting a user operation on the screen displayed on the display means;
In the screen displayed on the display means, the operation position corresponds to any position on the virtual pronunciation element image displayed corresponding to the operation position in the screen where the detected operation by the user is performed. A procedure to identify
A procedure for generating a musical tone of a second tone different from the first tone of the keyboard instrument that imitates the sound generation mechanism, the procedure comprising: generating an arbitrary tone on the virtual pronunciation element image in response to detection of the user operation. A program for executing a musical tone of a second tone color corresponding to a position on the identified virtual pronunciation element image from the musical sounds of a second tone color associated with each position. On the computer,
A procedure for displaying on the display means a screen simulating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound possessed by the sound generation mechanism;
A procedure for detecting a user operation on the screen displayed on the display means;
In the screen displayed on the display means, the operation position corresponds to any position on the virtual pronunciation element image displayed corresponding to the operation position in the screen where the detected operation by the user is performed. A procedure to identify
Procedures for supplying performance information;
A procedure for generating a tone of a second tone different from the first tone of a keyboard instrument simulating the pronunciation mechanism, wherein the performance information is stored in a state where the position on the virtual tone generation element image is specified. A program for generating a musical tone of the second tone color associated with a position on the virtual pronunciation element image at a pitch based on the performance information in accordance with the supplied sound. On the computer,
A procedure for displaying on the display means a screen simulating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound possessed by the sound generation mechanism;
A procedure for detecting a user operation on the screen displayed on the display means;
In the screen displayed on the display means, the operation position corresponds to any position on the virtual pronunciation element image displayed corresponding to the operation position in the screen where the detected operation by the user is performed. A procedure to identify
Procedures for supplying performance information;
A procedure for generating a tone of a second tone different from the first tone of the keyboard instrument simulating the tone generation mechanism, the procedure being used to supply the performance information according to the specification of the position on the virtual tone generation element image. A program for executing a musical tone of the first timbre of the keyboard instrument generated in response to the musical tone of the second timbre associated with the position on the virtual tone generation element image. On the computer,
A procedure for displaying on the display means a screen simulating the sound generation mechanism of a keyboard instrument, wherein the screen includes at least a virtual sound generation element image showing a sound generation element that vibrates and emits sound possessed by the sound generation mechanism;
A procedure for arranging an arbitrary object image with respect to the virtual pronunciation element image in the screen displayed on the display means;
A procedure for detecting an arrangement mode of an arbitrary object image with respect to a virtual pronunciation element image in the screen;
Procedures for supplying performance information;
A procedure for generating a musical tone of a second tone different from the first tone of the keyboard instrument imitating the sound generation mechanism, the procedure being associated with the arrangement mode of the object image according to the supply of the performance information A program for executing a second tone color tone that generates a second tone color tone corresponding to the detected arrangement of the object image from the second tone color tones.

Images