JP2016018107A - Musical sound generation instruction device, musical sound generation instruction method, program, and electric musical instrument - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a musical sound generation device, which generates a musical sound of a musical instrument kind corresponding to a performance form.SOLUTION: A musical sound generation instruction device includes steps of: acquiring a state of a housing 10 on the basis of each output of three attitude sensors 16a-16c provided inside of the housing 10; discriminating whether the housing 10 corresponds to any performance form of a "guitar", a "violin", a "piano", and a "clarinet" from the acquired state; displaying an image of a musical instrument kind corresponding to the discriminated performance form on display part 14; and instructing a sound source to generate a sound corresponding to performance operation made in a touch panel 15 corresponding to the discriminated musical instrument kind.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a musical sound generation instruction device, a musical sound generation instruction method, a program, and an electronic musical instrument that generate musical sounds of musical instrument types that match a performance form.

  There is known a technique in which a touch panel for detecting a touch operation is provided on a display screen, and musical sound control is performed according to the touch operation of the touch panel. As this type of device, for example, in Patent Document 1, when a musical instrument position (sound source position) such as a piano is designated by a touch operation on the touch panel, the designated position is displayed on the display panel (display screen), and the designated position is also displayed. Is converted into control information such as sound image position, reverb effect, sound frequency characteristics, etc., and the parameters of the musical sound signal generated by each instrument (sound source) are controlled based on the converted control information to enrich the presence A technique for reproducing a simple sound field is disclosed.

JP 07-005873 A

  By the way, in the technique disclosed in Patent Document 1, control representing a sound image position, a reverb effect, a sound frequency characteristic, and the like for each instrument (sound source) according to each instrument position (sound source position) specified on the touch panel. Since only information is generated and the musical sound generated by each instrument (sound source) is controlled according to this control information to reproduce a realistic sound field, it is not possible to generate musical sounds of instrument types that match the performance form. There is a problem.

  The present invention has been made in view of such circumstances, and it is an object of the present invention to provide a musical sound generating device, a musical sound generating method, a program, and an electronic musical instrument that can generate musical sounds of musical instrument types that match a performance form. Yes.

In order to achieve the above object, the musical sound generating device of the present invention comprises:
Obtaining means for obtaining posture information representing the posture of the housing;
Instrument type discrimination means for discriminating a type of instrument based on the posture information acquired by the acquisition means;
A display unit provided on the housing for displaying an image indicating the type of instrument determined by the instrument type determination unit;
A performance operation determining means for determining whether or not a performance operation defined based on the image displayed by the display means has been performed;
Musical sound generation instruction means for instructing the sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed by the display means when it is determined that the performance operation has been performed by the performance operation determination means;
It is characterized by comprising.

The musical sound generation method of the present invention includes:
The musical sound generator
Obtain posture information that represents the posture of the skeleton,
Determine the type of instrument based on the acquired posture information,
The display means provided on the housing displays an image showing the determined type of musical instrument,
Determining whether a performance operation defined based on the image displayed on the display means has been performed;
When it is determined that the performance operation has been performed, the sound source is instructed to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed on the display means.
It is characterized by that.

The program of the present invention
In a computer used as a musical sound generation instruction device having a housing and a display means provided on the housing,
An acquisition step of acquiring posture information representing the posture of the housing;
A musical instrument type determination step of determining a type of musical instrument based on the acquired posture information;
A display step of causing the display means to display an image indicating the determined type of instrument;
A performance operation determining step for determining whether or not a performance operation defined based on the image displayed on the display means has been performed;
A musical sound generation instruction step for instructing the sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed on the display means when it is determined that the performance operation has been performed;
Is executed.

  In the present invention, it is possible to generate musical tones of musical instrument types that match the performance form.

It is an external view which shows the external appearance of the musical sound generator 100 by one Embodiment of this invention. 2 is a block diagram showing a configuration of a musical sound generator 100. FIG. It is a flowchart which shows operation | movement of a main routine. It is a flowchart which shows the operation | movement of a switch process. It is a flowchart which shows operation | movement of an initial switch process. It is a flowchart which shows operation | movement of a fixed switch process. It is a flowchart which shows the operation | movement of a display process. It is a flowchart which shows the operation | movement of the display process following FIG. It is a flowchart which shows the operation | movement of a performance process. FIG. 10 is a flowchart showing the performance processing operation following FIG. 9. FIG. It is a figure which shows an example of the body posture which satisfy | fills the conditions 1 which discriminate | determine an instrument type, and is identified as "guitar". It is a figure which shows an example of the body posture which satisfy | fills the conditions 2 which discriminate | determine an instrument kind, and is identified as "violin". It is a figure which shows an example of the body posture which satisfy | fills the conditions 3 which discriminate | determine a musical instrument kind, and is identified as "piano". It is a figure which shows an example of the body posture which satisfy | fills the conditions 4 which discriminate | determine a musical instrument type, and is identified as "clarinet". FIG. 10 is a diagram showing an example of a display form displayed on the display unit 14 when “guitar” is specified. FIG. 6 is a diagram showing an example of a display form displayed on the display unit 14 when it is specified as “violin”. FIG. 10 is a diagram illustrating an example of a display form displayed on the display unit 14 when “piano” is specified. FIG. 11 is a diagram illustrating an example of a display form displayed on the display unit 14 when “Clarinet” is specified.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
A. FIG. 1 is an external view showing an external appearance of a musical sound generating device 100 according to an embodiment of the present invention. FIG. 1 (a) is a top view, FIG. 1 (b) is a side view, and FIG. (C) is a rear view. A musical sound generator 100 shown in FIG. 1 has a substantially rectangular casing 10, and a display unit 14 composed of a color LCD panel on the upper surface side thereof and a touch panel 15 integrally formed with the screen of the display unit 14. Is provided. Three posture sensors 16 a to 16 c are provided inside the housing 10. Further, a switch unit 17 including various switches (described later) operated by the user is disposed on the rear side of the housing 10.

  As will be described later, in this embodiment, the instrument type (musical instrument type) corresponding to the performance mode is determined. The performance form mentioned here corresponds to the attitude of the chassis 10 held by the user during performance or the attitude of the chassis 10 placed. The posture of the housing 10 is acquired based on the outputs of the three posture sensors 16a to 16c disposed inside. Specifically, the posture of the housing 10 based on the outputs of the three posture sensors 16a to 16c provided in the housing 10 is any performance of "guitar", "violin", "piano", and "clarinet". Determine if it matches the form.

  The display unit 14 displays an instrument type that matches the determined performance form as an image. Specifically, if the determined performance form is “guitar”, a virtual guitar image (fingerboard, string and fret) as a musical instrument type is displayed on the display unit 14 as in the example shown in FIG. Is displayed. In this case, the touch panel 15 provided on the display unit 14 inputs a fret string (pitch designation) by a touch operation, and inputs a string chord by a flick operation (an operation to quickly touch the screen with a fingertip). Functions as an operator.

  If the determined performance form is “violin”, an image (fingerboard, string and bridge (piece)) imitating a virtual violin as an instrument type is displayed on the display unit, as in the example shown in FIG. 14 is displayed. In this case, the touch panel 15 provided on the display unit 14 inputs a string (pitch designation) by a touch operation and inputs a string string by a flick operation (an operation for quickly paying the screen with a fingertip). Function as.

  Further, if the determined performance form is “piano”, a keyboard image imitating a virtual piano as an instrument type is displayed on the display unit 14 as in the example shown in FIG. In this case, the touch panel 15 provided on the display unit 14 inputs a key press (key-on) by a touch operation at a position corresponding to the key in the keyboard image, and releases the key (key-off) by releasing the pressed touch operation. ) Function as a performance operator.

  In addition, if the discriminated performance form is “Clarinet”, an image simulating a virtual clarinet as a musical instrument type (upper and lower pipe keys (ring keys)) as in the example shown in FIG. Or finger plate) is displayed on the display unit 14. In this case, the touch panel 15 provided on the display unit 14 functions as a performance operator that specifies a pitch by a touch operation at a position corresponding to each key.

B. Configuration Next, the configuration of the embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing the configuration of the musical sound generating device 100. In FIG. 2, the CPU 11 sets the operation state of each part of the apparatus based on various switch events supplied from the switch part 17, and determines the performance form based on each output of the attitude sensors 16 a to 16 c as described above. At the same time, note-on / note-off events to be supplied to the sound source 18 are generated based on the output of the touch panel 15 that functions as a performance operator in the musical instrument type that matches the determined performance form. The characteristic processing operation of the CPU 11 according to the gist of the present invention will be described in detail later.

  The ROM 12 stores various programs loaded on the CPU 11. The various programs include a main routine described later, switch processing called from the main routine, display processing, and performance processing. The switch process includes an initial switch process and a fixed switch process. The RAM 13 is used as a work area for the CPU 11 and temporarily stores various register / flag data.

  The display unit 14 displays images simulating instrument types (“guitar”, “violin”, “piano”, and “clarinet”) that match the performance form based on the display control signal supplied from the CPU 11. The touch panel 15 is provided on the screen of the display unit 14 and has a capacitance type multi-touch detection function using transparent electrodes arranged in a two-dimensional matrix. As described above, the touch panel 15 functions as a performance operator corresponding to each instrument type (“guitar”, “violin”, “piano”, and “clarinet”) displayed on the display unit 14.

  The posture detection unit 16 includes posture sensors 16 a to 16 b arranged in parallel on the base end side of the housing 10 and a posture sensor 16 c arranged on the distal end side of the housing 10. Each of the posture sensors 16a to 16c includes an acceleration sensor that detects acceleration of the orthogonal three-axis component, a gyro sensor that detects angular velocity of the orthogonal three-axis component, and a magnetic sensor that detects geomagnetism of the orthogonal three-axis component.

  In the attitude sensors 16a to 16c, triaxial component attitude information is estimated based on the angular velocity detected by the gyro sensor, and the estimated attitude information for each triaxial component is detected by the acceleration sensor using a triaxial component acceleration and a geomagnetic sensor. The output is corrected by the detected geomagnetic field of the three-axis component. The posture information of the three-axis components output from the posture sensors 16a to 16c is taken into the CPU 11. The CPU 11 discriminates the musical instrument type that matches the performance form based on the outputs of the attitude sensors 16a to 16c (corrected triaxial component attitude information).

  Although not shown, the switch unit 17 fixes an initial switch for initializing detection outputs of the attitude sensors 16a to 16b and a performance form (instrument type) in addition to a power switch for powering on / off the power source. It has various switches such as a fixed switch, and generates a switch event corresponding to the switch type to be operated. The switch event generated by the switch unit 17 is captured by the CPU 11.

  The sound source 18 includes a plurality of tone generation channels (MIDI channels) configured by a well-known waveform memory reading method, and generates musical sound waveform data W according to a note-on / note-off event supplied from the CPU 11. The sound system 19 converts the musical sound waveform data W output from the sound source 18 into an analog musical sound signal, performs filtering such as removing unnecessary noise from the musical sound signal, and then amplifies it and releases it from the speaker. Let it sound.

C. Operation Next, operations of the main routine, the switch process, the display process, and the performance process executed by the CPU 11 of the musical tone generating apparatus 100 having the above-described configuration will be described with reference to FIGS. The subject of the operation described below is the CPU 11 unless otherwise specified.

(1) Operation of Main Routine FIG. 3 is a flowchart showing the operation of the main routine. When the apparatus power supply is powered on, the CPU 11 starts this routine, proceeds to step SA1 shown in FIG. 3, and executes an initialization process for initializing each section of the apparatus. When the initialization process is completed, the process proceeds to step SA2, and based on the switch event corresponding to the switch type operated by the user at the switch unit 17, for example, the outputs of the attitude sensors 16a to 16b are initialized according to the operation of the initial switch. Switch processing is performed, such as instructing to fix or release the performance form (musical instrument type) according to the operation of the fixed switch.

  Next, in step SA3, the performance conforms to any performance form of “guitar”, “violin”, “piano”, and “clarinet” based on the outputs of the three attitude sensors 16a to 16c provided in the housing 10. And display processing for displaying an image of the instrument type that matches the determined performance form on the display unit 14 is executed.

  Subsequently, when the process proceeds to step SA4, it is determined whether the mode (instrument type) determined in the display process of step SA3 is “guitar”, “violin”, “piano”, or “clarinet”. In response to the performance operation performed on the touch panel 15 corresponding to the determined instrument type, display processing for instructing the tone generator 18 to generate musical sounds is executed. Thereafter, the process proceeds to step SA5, and other processes such as applying the type of effect designated by the user operation are executed, and the process returns to step SA2. Thereafter, the above-described steps SA2 to SA5 are repeatedly executed until the apparatus power is turned off.

(2) Operation of Switch Process Next, the operation of the switch process will be described with reference to FIGS. 4 is a flowchart showing the operation of the switch process, FIG. 5 is a flowchart showing the operation of the initial switch process, and FIG. 6 is a flowchart showing the operation of the fixed switch process.

  When the switch process is executed via step SA2 (see FIG. 3) of the main routine described above, the CPU 11 executes the initial switch process via step SB1 shown in FIG. When the initial switch process is executed, the CPU 11 advances the process to step SC1 shown in FIG. 5, and determines whether or not the initial switch is turned on. If the initial switch is not turned on, the determination result is “NO”, and this process is completed. If the initial switch is turned on, the determination result of step SC1 is “YES”, and the process proceeds to step SC2. The output values of the three attitude sensors 16a to 16c disposed in the housing 10 are reset to initial values, and this process is finished.

  When the initial switch process is completed, the CPU 11 executes the fixed switch process via step SB2 shown in FIG. When the fixed switch process is executed, the CPU 11 proceeds to step SD1 shown in FIG. 6 and determines whether or not the fixed switch for instructing the fixation or release of the determined performance form (musical instrument type) has been turned on. . If the fixed switch is not turned on, the determination result is “NO”, and the present process ends.

  On the other hand, if the fixed switch is turned on, the determination result in step SD1 is “YES”, the process proceeds to step SD2, the fixed flag is inverted, and the process is terminated. That is, if the fixed flag inverted according to the ON operation of the fixed switch is “0”, it indicates a state in which the discriminated performance form (instrument type) is instructed to be released, while the inverted fixed flag is “1”. ”Represents a state in which fixing of the determined performance form (instrument type) is instructed.

  When the fixed switch process is completed, the CPU 11 proceeds to step SB3 shown in FIG. 4, and executes other switch processes such as an effect selection switch process for selecting the effect type to be applied to the musical tone, and the process is completed.

(3) Display Processing Operation Next, the display processing operation will be described with reference to FIGS. 7 to 8 are flowcharts showing the operation of the display process. When this processing is executed through step SA3 (see FIG. 3) of the main routine described above, the CPU 11 proceeds to step SE1 shown in FIG. 7, and determines whether the fixed flag is “1”, that is, the performance form (instrument). Judge whether the seeds are fixed. Here, if the fixed flag is “0”, that is, if the performance form (instrument type) is not fixed, the determination result is “NO”, and the present process ends.

  On the other hand, if the fixed flag inverted according to the ON operation of the fixed switch is “1”, that is, if the performance form (instrument type) is fixed, the determination result in step SE1 is “YES”. The process proceeds to step SE2. In step SE2, it is determined whether or not the performance flag is “0”, that is, whether the sound generation period is complete. Here, if the performance flag is “1” (sounding), the determination result is “NO”, and this processing is terminated. If the performance flag is “0” (silenced state), the determination result is “YES”. And go to step SE3.

  In step SE3, the outputs of the posture sensors 16a to 16c are acquired. In subsequent steps SE4, SE6, SE8, and SE10, the instrument type (“guitar”) that matches the performance form based on the acquired outputs of the posture sensors 16a to 16c. ”,“ Violin ”,“ piano ”and“ clarinet ”).

  In step SE4, it is determined whether or not the condition 1 is cleared, that is, whether or not it corresponds to the performance form of the guitar. The condition 1 is a posture in which the user holds the casing 10 as in the actual guitar performance form. Specifically, the posture sensors 16a to 16c do not exist on the same plane as in the example illustrated in FIG. The posture sensor 16b is positioned above the posture sensor 16c on the Y axis, and the posture sensors 16a and 16b are positioned on the + X axis side of the posture sensor 16c.

  When the outputs of the posture sensors 16a to 16c satisfy such a condition 1, the determination result in Step SE4 is “YES”, and the process proceeds to Step SE5, where the provisional mode representing the instrument type is set to “Guitar”. Thereafter, the process proceeds to Step SE12 described later.

  On the other hand, when the outputs of the posture sensors 16a to 16c do not satisfy the condition 1, the determination result in the step SE4 is “NO”, the process proceeds to the step SE6, and whether or not the condition 2 is cleared, that is, the violin It is determined whether or not it corresponds to a performance form. Condition 2 represents a posture in which the proximal end side of the housing 10 is supported by the user's chin and the distal end side is held by the user's left hand in the same manner as in an actual violin performance. As in the example illustrated in FIG. 12, the posture sensors 16a to 16c do not exist on the same plane, the posture sensor 16a is positioned above the posture sensor 16b on the Y axis, and the posture sensor 16c is the posture sensor. The posture is located on the + X axis side from 16a and 16b.

  When the outputs of the posture sensors 16a to 16c satisfy such a condition 2, the determination result in step SE6 is “YES”, and the process proceeds to step SE7, where the temporary mode representing the instrument type is set to “violin”. Thereafter, the process proceeds to Step SE12 described later.

  On the other hand, when the outputs of the posture sensors 16a to 16c do not satisfy the condition 2, the determination result of the step SE6 is “NO”, and the process proceeds to a step SE8 to determine whether or not the condition 3 is cleared. It is determined whether or not it corresponds to a piano performance form. The condition 3 represents the posture in which the housing 10 is placed on a plane, as in the actual piano performance form. Specifically, as in the example illustrated in FIG. 13, the posture sensor 16a. -16c exist on the same plane, and the posture sensor 16a is located above the posture sensor 16b on the Y axis, and the posture sensor 16c is located on the + X axis side from the posture sensors 16a and 16b. .

  When the outputs of the posture sensors 16a to 16c satisfy such condition 3, the determination result in step SE8 is “YES”, and the process proceeds to step SE9, where the temporary mode representing the instrument type is set to “piano”. Thereafter, the process proceeds to Step SE12 described later.

  On the other hand, if the outputs of the posture sensors 16a to 16c do not satisfy the condition 3, the determination result in the above step SE8 is “NO”, the process proceeds to step SE10, and whether or not the condition 4 is cleared, that is, the clarinet It is determined whether or not it corresponds to a performance form. Condition 4 represents a posture in which the base end side of the housing 10 is supported toward the user's face and the front end side is held downward, as in the actual clarinet performance form. 14, the posture sensor 16a is positioned on the + X axis side with respect to the posture sensor 16b, and the posture sensors 16a and 16b are positioned on the + Z axis side with respect to the posture sensor 16c.

  If the outputs of the posture sensors 16a to 16c satisfy such condition 4, the determination result in step SE10 is “YES”, the process proceeds to step SE11, and the temporary mode indicating the instrument type is set to “clarinet”. Thereafter, the process proceeds to Step SE12 described later.

  When the outputs of the posture sensors 16a to 16c do not satisfy any of the above conditions 1 to 4, the determination results of the above steps SE4, SE6, SE8, and SE10 are “NO”, and this process is performed. Finish.

  Next, in step SE12, it is determined whether or not the temporary mode (instrument type) determined in any of the above-described steps SE5, SE7, SE9, and SE11 is different from the previous time. If the determined temporary mode is an instrument type change different from the previous one, the determination result is “YES”, the process proceeds to the next step SE13, and after the mode change flag is set to “1”, in the subsequent step SE14, The timer 1 is cleared and set to the instrument type change state for starting the time measurement by the timer 1, and this processing is finished.

  Now, it is assumed that after the instrument type change state is set in this way, this processing is executed again, and the provisional mode determined by this processing becomes the same as the previous time. Then, the determination result at step SE12 is “NO”, and the process proceeds to step SE15 shown in FIG. In steps SE15 to SE16, it is determined whether or not the instrument type is changed (the mode change flag is set to “1” and the timer 1 is counting up).

  If the instrument type is not changed (the mode change flag is set to “1” and the timer 1 is counting up), the determination result of any of the above step SE15 (or step SE16) is “NO”. When the process is finished, but in the instrument type change state, the determination results in steps SE15 to SE16 are “YES”, and the process proceeds to step SE17.

  In step SE17, the count of the timer 1 is stopped, and in step SE18, the mode change flag is reset to zero to cancel the instrument type change state. Thereafter, the process proceeds to step SE19, where the temporary instrument mode is set to the present mode and the current instrument type is determined. Next, in step SE20, an image of the instrument type corresponding to the present mode is displayed on the display unit 14, and the present process ends.

  For example, if this mode (instrument type) is “guitar”, an image of a fingerboard, strings and frets simulating an actual guitar is displayed on the display unit 14 as in the example shown in FIG. If this mode is “violin”, an image of a fingerboard, a string, and a bridge (piece) simulating an actual violin is displayed on the display unit 14 as in the example shown in FIG. Further, if this mode is “piano”, an image of a keyboard simulating an actual piano is displayed on the display unit 14 as in the example shown in FIG. In addition, if this mode is “Clarinet”, images of the upper and lower pipe keys (ring keys) and finger plates simulating an actual clarinet are displayed on the display unit 14 as in the example shown in FIG. indicate.

  As described above, in the display processing, any performance form of “guitar”, “violin”, “piano”, and “clarinet” is set based on the outputs of the three posture sensors 16a to 16c provided in the housing 10. It is determined whether they match, and an image of the instrument type that matches the determined performance form is displayed on the display unit 14.

  As described above, in this embodiment, if the determined temporary mode is different from the previous time, the instrument type change state is maintained for a certain period, and if the determined temporary mode is the same as the previous time, Since the seed change state is canceled and the temporary mode is determined to be the present mode (current instrument type), it is possible to prevent erroneous determination when changing the instrument type.

(4) Performance Processing Operation Next, performance processing operation will be described with reference to FIGS. 9 to 10 are flowcharts showing the performance processing operation. When this process is executed through step SA4 (see FIG. 3) of the main routine described above, the CPU 11 determines in the above-described display process in steps SF1, SF4, SF7 and SF11 shown in FIGS. It is determined whether the book mode is “guitar”, “violin”, “piano”, or “clarinet”. In the following, the description will be divided into cases where the mode is “guitar”, “violin”, “piano”, and “clarinet”.

a. In the case of “Guitar” If this mode is “Guitar”, the determination result in Step SF1 is “YES”, the process proceeds to Step SF2, and the operation corresponding to the string is performed, that is, provided on the display unit 14. On the touch panel 15, it is determined whether or not the user has input a fret string (pitch designation) by a touch operation, and has input a string chord by a flick operation (an operation for quickly paying the screen with a fingertip).

  When an operation corresponding to a string (fret touch operation and string flick operation) is performed, the determination result in step SF2 is “YES”, and the flow proceeds to step SF3. In step SF3, the sound source 18 is instructed to sound a musical tone having a pitch specified by the touch operation at a volume corresponding to the flick operation. As a result, the sound source 18 generates a musical tone of a guitar tone corresponding to an operation corresponding to a string.

  Thereafter, the process proceeds to step SF14 shown in FIG. 10, and the performance flag is set to “1” to indicate that the sound is being generated. In the subsequent step SF15, after timer 2 is cleared, the timer 2 starts measuring time and generates sound. This process is finished once by starting to measure the period.

  Then, when this process is executed again and the process of step SF2 is reached, if the operations corresponding to the string are not performed (fret touch operation and string flick operation), the determination result of step SF2 is “ "NO", the process proceeds to step SF16 shown in FIG. In step SF16, it is determined whether or not the performance flag is "1", that is, whether sounding is in progress.

  If the performance flag is not “1” (sounding), the determination result in step SF16 is “NO”, and the process is terminated. If the performance flag is “1” (sounding), step SF16 is performed. The determination result is “YES”, and the process proceeds to Step SF17. In step SF17, it is determined whether or not the timer 2 has counted up, that is, whether or not the sound generation period has been completed. If it is during the sound generation period, the determination result is “NO”, and this processing is finished. However, when the timer 2 is counted up and the sound generation period is completed, the determination result in step SF17 becomes “YES”, and the process returns to step SF18. Then, the performance flag is reset to zero and the process is terminated.

  In the present embodiment, since the actual guitar sound is a decaying sound, the sound source 18 is muted when the predetermined sound generation period is completed from the sound generation (note-on). Instead, the CPU 11 may generate a note-off event and supply it to the sound source 18 when the timer 2 counts up and the sound generation period is completed and the performance flag is reset to zero.

b. In the case of “violin” When this mode is “violin”, the result of determination in step SF4 shown in FIG. In the touch panel 15 provided on the upper side, it is determined whether or not a string (pitch designation) is input by a touch operation, and a string string is input by a flick operation (an operation for quickly paying the screen with a fingertip).

  When an operation corresponding to a string is performed (fret touch operation and string flick operation), the determination result in step SF5 is “YES”, and the process proceeds to step SF6. In step SF6, the sound source 18 is instructed to sound a musical tone having a pitch specified by the touch operation at a volume corresponding to the flick operation. As a result, the sound source 18 generates a violin tone tone corresponding to the operation corresponding to the string.

  Thereafter, the process proceeds to step SF14 shown in FIG. 10, and the performance flag is set to “1” to indicate that the sound is being generated. In the subsequent step SF15, after timer 2 is cleared, the timer 2 starts measuring time and generates sound. This process is finished once by starting to measure the period.

  When this process is executed again and the process of step SF2 is reached, if the operation corresponding to the string is not performed (fret touch operation and string flick operation), the determination result of step SF2 is “NO”. The process proceeds to step SF16 shown in FIG. In step SF16, it is determined whether or not the performance flag is "1", that is, whether sounding is in progress.

  If the performance flag is not “1” (sounding), the determination result in step SF16 is “NO”, and the process is terminated. If the performance flag is “1” (sounding), step SF16 is performed. The determination result is “YES”, and the process proceeds to Step SF17. In step SF17, it is determined whether or not the timer 2 has counted up, that is, whether or not the sound generation period has been completed. If it is during the sound generation period, the determination result is “NO”, and this processing is finished. However, when the timer 2 is counted up and the sound generation period is completed, the determination result in step SF17 becomes “YES”, and the process returns to step SF18. Then, the performance flag is reset to zero and the process is terminated.

c. In the case of “Piano” When this mode is “Piano”, the determination result in Step SF7 shown in FIG. 9 is “YES”, and the process proceeds to Step SF8, where there is a key operation, that is, provided on the display unit 14. On the touch panel 15, it is determined whether the key is pressed by a touch operation at a position corresponding to the key in the keyboard image, the key is released to release the pressed touch operation, or there is no key operation (no touch operation).

  When the key is pressed by the touch operation, the process proceeds to step SF9, and the sound source 18 is instructed to generate a musical tone having a pitch corresponding to the pressed key. Thereafter, the process proceeds to step SF14 shown in FIG. 10, and the performance flag is set to “1” to indicate that sound is being generated. Subsequently, in step SF15, after the timer 2 is cleared, the timer 2 starts to be timed, the sounding period starts to be counted, and the present process is temporarily ended.

  When this process is executed again and the process of step SF8 is reached, if a key release is performed to release the pressed touch operation, the process proceeds to step SF10, and a musical tone having a pitch corresponding to the released key is reached. Is instructed to the sound source 18. Thereafter, the process proceeds to step SF18 shown in FIG. 10, the performance flag is reset to zero, and this process is terminated.

  On the other hand, if there is no key operation (no touch operation), the process proceeds to step SF16 shown in FIG. 10 through step SF8, and it is determined whether or not the performance flag is “1”, that is, whether sounding is in progress. If the performance flag is not “1” (sounding), the determination result in step SF16 is “NO”, and the process is terminated. If the performance flag is “1” (sounding), step SF16 is performed. The determination result is “YES”, and the process proceeds to Step SF17.

  In step SF17, it is determined whether or not the timer 2 has counted up, that is, whether or not the sound generation period has been completed. If it is during the sound generation period, the determination result is “NO”, and this processing is finished. However, when the timer 2 is counted up and the sound generation period is completed, the determination result in step SF17 becomes “YES”, and the process returns to step SF18. Then, the performance flag is reset to zero and the process is terminated.

d. In the case of “Clarinet” When this mode is “Clarinet”, the determination result in Step SF11 shown in FIG. 10 is “YES”, and the process proceeds to Step SF12 to turn on the pitch designation switch, that is, on the display unit 14 In the touch panel 15 provided on the touch panel 15, whether or not a touch operation is performed at a position corresponding to each key is determined.

  When a touch operation is performed at a position corresponding to the key, the determination result in step SF12 is “YES”, and the process proceeds to step SF13, where the tone of the musical tone having the pitch specified by the touch-operated key is generated. 18 is instructed. Note that in an actual clarinet, the volume is controlled by the breath pressure blown into the singing mouth, but in the case of this embodiment, a musical tone is generated at a constant volume by a predetermined breath pressure.

  Next, in step SF14, the performance flag is set to “1” to indicate that sound is being generated. Subsequently, in step SF15, after the timer 2 is cleared, the timer 2 starts to be timed, the sounding period starts to be counted, and the present process is temporarily ended.

  When this process is executed again and the process of step SF11 is reached, if the touch operation at the position corresponding to the key is not performed, the determination result of step SF11 is “NO”, and the process proceeds to step SF16. Then, it is determined whether or not the performance flag is “1”, that is, the sound is being generated. If the performance flag is not “1” (sounding), the determination result in step SF16 is “NO”, and the process is terminated. If the performance flag is “1” (sounding), step SF16 is performed. The determination result is “YES”, and the process proceeds to Step SF17.

  In step SF17, it is determined whether or not the timer 2 has counted up, that is, whether or not the sound generation period has been completed. If it is during the sound generation period, the determination result is “NO”, and this processing is finished. However, when the timer 2 is counted up and the sound generation period is completed, the determination result in step SF17 becomes “YES”, and the process returns to step SF18. Then, the performance flag is reset to zero and the process is terminated.

  In this way, in the performance processing, it is determined whether the mode (instrument type) determined in the display processing is “guitar”, “violin”, “piano”, or “clarinet”, and the determined instrument type In response to this, the sound source 18 is instructed to generate a musical sound in accordance with a performance operation performed on the touch panel 15.

  As described above, in the present embodiment, the state of the casing 10 is acquired based on the outputs of the three posture sensors 16a to 16c provided inside the casing 10, and the casing 10 is “guitar” from the acquired state. ”,“ Violin ”,“ piano ”, and“ clarinet ”are discriminated to match. Then, an image of the musical instrument type that matches the determined performance type is displayed on the display unit 14 and instructs the sound source 18 to generate a musical tone according to a performance operation performed on the touch panel 15 corresponding to the determined musical instrument type. Therefore, it is possible to generate musical sounds of musical instrument types that match the performance form.

  As mentioned above, although one Embodiment of this invention was described, this invention is not limited to it, It is included in the invention described in the claim of this-application, and its equivalent range.

Hereinafter, each invention described in the scope of claims at the beginning of the present application will be additionally described.
(Appendix)
[Claim 1]
Obtaining means for obtaining posture information representing the posture of the housing;
Instrument type discrimination means for discriminating a type of instrument based on the posture information acquired by the acquisition means;
A display unit provided on the housing for displaying an image indicating the type of instrument determined by the instrument type determination unit;
A performance operation determining means for determining whether or not a performance operation defined based on the image displayed by the display means has been performed;
Musical sound generation instruction means for instructing the sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed by the display means when it is determined that the performance operation has been performed by the performance operation determination means;
A musical tone generation instructing device comprising:

[Claim 2]
The acquisition means includes
A plurality of acceleration sensors for detecting the acceleration of orthogonal three-axis components provided inside the housing;
A plurality of gyro sensors for detecting angular velocities of orthogonal three-axis components;
A geomagnetic sensor that detects the geomagnetism of orthogonal three-axis components,
Based on the angular velocity detected by the gyro sensor, the posture information of the triaxial component is estimated, and the posture information of each estimated triaxial component is detected by the acceleration of the triaxial component detected by the acceleration sensor and the three detected by the geomagnetic sensor. The musical tone generation instruction device according to claim 1, wherein the musical sound generation instruction device is corrected by the geomagnetism of the axial component.

[Claim 3]
The musical instrument type determining means searches for posture information that matches the posture information acquired by the acquiring means from posture information representing postures of the housing corresponding to various different musical instruments stored in advance, and the searched The musical tone generation instruction apparatus according to claim 1 or 2, wherein a musical instrument of a type corresponding to the posture information is discriminated.

[Claim 4]
The instrument type discrimination means discriminates a corresponding type of instrument for each fixed period, and if the currently determined type of instrument is different from the previously determined type of instrument, the currently determined type of instrument is The discriminating result of the current discriminated type is used only when the discriminating operation is the same as the discriminating type of the discriminating instrument after stopping the discriminating operation for a predetermined time. Item 4. The musical tone generation instruction device according to any one of Items 1 to 3.

[Claim 5]
The performance operation determining means has a touch panel provided on the display means,
It is determined whether or not a touch operation mode performed on the touch panel matches a predetermined touch operation mode for each type of image indicated by the image displayed on the display unit. The musical sound generation instruction device according to any one of claims 1 to 4.

[Claim 6]
The musical sound generator
Obtain posture information that represents the posture of the skeleton,
Determine the type of instrument based on the acquired posture information,
The display means provided on the housing displays an image showing the determined type of musical instrument,
Determining whether a performance operation defined based on the image displayed on the display means has been performed;
A musical sound generation instruction method of instructing a sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed on the display means when it is determined that the performance operation has been performed.

[Claim 7]
In a computer used as a musical sound generation instruction device having a housing and a display means provided on the housing,
An acquisition step of acquiring posture information representing the posture of the housing;
A musical instrument type determination step of determining a type of musical instrument based on the acquired posture information;
A display step of causing the display means to display an image indicating the determined type of instrument;
A performance operation determining step for determining whether or not a performance operation defined based on the image displayed on the display means has been performed;
A musical sound generation instruction step for instructing the sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed on the display means when it is determined that the performance operation has been performed;
A program characterized by having executed.

[Claim 8]
A musical sound generation instruction device according to any one of claims 1 to 5,
A sound source that produces a musical sound instructed by the musical sound generation instruction device;
An electronic musical instrument characterized by comprising:

11 CPU
12 ROM
13 RAM
DESCRIPTION OF SYMBOLS 14 Display part 15 Touch panel 16 Posture detection part 16a-16c Posture sensor 17 Switch part 18 Sound source 19 Sound system 100 Musical sound generator

Claims (8)

Obtaining means for obtaining posture information representing the posture of the housing;
Instrument type discrimination means for discriminating a type of instrument based on the posture information acquired by the acquisition means;
A display unit provided on the housing for displaying an image indicating the type of instrument determined by the instrument type determination unit;
A performance operation determining means for determining whether or not a performance operation defined based on the image displayed by the display means has been performed;
Musical sound generation instruction means for instructing the sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed by the display means when it is determined that the performance operation has been performed by the performance operation determination means;
A musical tone generation instructing device comprising: The acquisition means includes
A plurality of acceleration sensors for detecting the acceleration of orthogonal three-axis components provided inside the housing;
A plurality of gyro sensors for detecting angular velocities of orthogonal three-axis components;
A geomagnetic sensor that detects the geomagnetism of orthogonal three-axis components,
Based on the angular velocity detected by the gyro sensor, the posture information of the triaxial component is estimated, and the posture information of each estimated triaxial component is detected by the acceleration of the triaxial component detected by the acceleration sensor and the three detected by the geomagnetic sensor. The musical tone generation instruction device according to claim 1, wherein the musical sound generation instruction device is corrected by the geomagnetism of the axial component and output.   The musical instrument type determining means searches for posture information that matches the posture information acquired by the acquiring means from posture information representing postures of the housing corresponding to various different musical instruments stored in advance, and the searched The musical tone generation instruction apparatus according to claim 1 or 2, wherein a musical instrument of a type corresponding to the posture information is discriminated.   The instrument type discrimination means discriminates a corresponding type of instrument for each fixed period, and if the currently determined type of instrument is different from the previously determined type of instrument, the currently determined type of instrument is The discriminating result of the current discriminated type is used only when the discriminating operation is the same as the discriminating type of the discriminating instrument after stopping the discriminating operation for a predetermined time. Item 4. The musical tone generation instruction device according to any one of Items 1 to 3. The performance operation determining means has a touch panel provided on the display means,
It is determined whether or not a touch operation mode performed on the touch panel matches a predetermined touch operation mode for each type of image indicated by the image displayed on the display unit. The musical sound generation instruction device according to any one of claims 1 to 4. The musical sound generator
Obtain posture information that represents the posture of the skeleton,
Determine the type of instrument based on the acquired posture information,
The display means provided on the housing displays an image showing the determined type of musical instrument,
Determining whether a performance operation defined based on the image displayed on the display means has been performed;
A musical sound generation instruction method of instructing a sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed on the display means when it is determined that the performance operation has been performed. In a computer used as a musical sound generation instruction device having a housing and a display means provided on the housing,
An acquisition step of acquiring posture information representing the posture of the housing;
A musical instrument type determination step of determining a type of musical instrument based on the acquired posture information;
A display step of causing the display means to display an image indicating the determined type of instrument;
A performance operation determining step for determining whether or not a performance operation defined based on the image displayed on the display means has been performed;
A musical sound generation instruction step for instructing the sound source to generate a musical sound corresponding to the type of musical instrument indicated by the image displayed on the display means when it is determined that the performance operation has been performed;
A program characterized by having executed. A musical sound generation instruction device according to any one of claims 1 to 5,
A sound source that produces a musical sound instructed by the musical sound generation instruction device;
An electronic musical instrument characterized by comprising:

Images