JP5277816B2 - Electronic music apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic musical instrument capable of performing various musical sound control according to user's operation mode. <P>SOLUTION: When the user's operation is a prescribed operation mode, a display position of a first and/or a second display object is controlled and changed so that a time-continuous moving operation according to an action mode which is made to cope with the operation mode beforehand may be autonomously performed, even if the user's operation is not continuously performed. According to display position relation of the first object and the second object, which perform autonomous moving operation, a pitch or a control value of a tone effect parameter of musical sound, which is made to cope with the second display object is determined, and on the basis of the pitch and the control value, the musical sound is controlled. Thus, since the musical sound is controlled according to the display position relation of each object which autonomously moves, a user visually enjoys himself or herself, and various musical sound control is performed according to the operation mode. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to an electronic music apparatus and a program for controlling a musical sound by operating an object displayed on a screen. In particular, the present invention relates to a technique in which an object is automatically moved according to a different characteristic for each operation mode of a user, and a musical sound is controlled according to the movement of the object.

Conventionally, in an electronic music apparatus such as an electronic musical instrument, for example, objects that simulate performance operators such as a keyboard and control operators such as a modulation wheel and a slider are displayed in advance on the screen, and the objects on the screen are displayed. Is known to perform control of musical sound by determining control values (parameter values) of various timbre effect parameters such as pitch, volume, pitch, LFO, etc., which are associated in advance when the user is directly operated by the user. It has been. For example, devices described in Non-Patent Document 1 and Non-Patent Document 2 shown below are examples of such devices. In this specification, the term “musical sound” is not limited to musical sound, but is used in the sense that it may include voice or any other sound.
“MOTIF XS 6/7/8 Instruction Manual”, 2007, Yamaha Corporation, Internet <http://www2.yamaha.co.jp/manual/pdf/emi/japan/synth/motifxs_ja_om_c1.pdf> “XGworks V4.0 Catalog”, 2002, Yamaha Corporation, Internet <http://www.yamaha.co.jp/product/syndtm/p/soft/xgwv4w/xgwv4w.pdf>

  By the way, in the conventional apparatus as described in Non-Patent Documents 1 and 2 described above, an object displayed on the screen is an actual performance operator or a control operator (hereinafter simply referred to as an operation) provided in the apparatus. In addition to being displayed in a manner similar to the shape of a child), it is easy for the user to operate by making the operation mode for the operator the same. However, even if the user operates an object that imitates an actual operation element, the user's operation mode for the object is not different from that of an actual operation element, and therefore the user can control the musical sound that is performed according to the operation. Naturally, it can be predicted to some extent, so there is no surprise and no interest. Therefore, there has been a demand for a device that can be enjoyed visually by the user and that can control the tone of the sound even if the operation is performed on the same object according to the user's operation mode. However, such a device is still realized. It has not been.

  The present invention has been made in view of the above points, and provides an electronic music apparatus and program that can be enjoyed visually by a user and can perform various musical tone controls according to the user's operation mode. The purpose is to provide.

The electronic music apparatus according to the present invention displays a screen including at least a first display object representing a virtual operator and a second display object associated with a tone pitch effect parameter relating to tone pitch or tone control. A display that detects a plurality of first display objects displayed at arbitrary positions on the screen and a user operation performed in the screen, and the detected user operation is predetermined; Determining means for determining whether or not the operation mode is, and when the detected user operation is a predetermined operation mode, a moving operation that continues in time according to an operation mode associated with the operation mode in advance A table for changing and controlling the display position of the first display object and / or the second display object so that the user operation is autonomously performed even if it is not continuously performed. And control means, in accordance with the combined value of the relative display position relationship between the with each of the plurality of the first display object second display object, the pitch of a musical tone associated with the second display object Alternatively, it comprises determining means for determining the control value of the tone color effect parameter, and tone control means for executing tone control based on the determined tone pitch or tone value parameter control value.

According to the present invention, when a user operation performed on the screen is a predetermined operation mode, the user operation continuously performs a moving operation that continues in time according to an operation mode previously associated with the operation mode. The display position of the first display object and / or the second display object is changed and controlled so as to be performed autonomously even if not performed. And it was matched with the 2nd display object according to the synthetic value of the relative display position relation between each of a plurality of said 1st display objects which perform this autonomous movement operation, and the 2nd display object. The control value of the tone pitch or tone color effect parameter is determined, and the tone is controlled based on these values. In this way, even if the user operation is not continuously performed, the musical sound is controlled according to the composite value of a plurality of relative display positional relationships between these objects that move autonomously. The user can enjoy visually and can perform various musical tone controls according to the operation mode.

  The present invention can be constructed and implemented not only as a device invention but also as a method invention. Further, the present invention can be implemented in the form of a program of a processor such as a computer or a DSP, or can be implemented in the form of a storage medium storing such a program.

According to the present invention, the user controls the musical sound according to the composite value of the plurality of relative display positional relationships between the objects that move autonomously even if the user operation is not continuously performed. There is an effect that it can be enjoyed visually and various musical tone controls can be performed according to the operation mode.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a hardware configuration block diagram showing an embodiment of the overall configuration of an electronic music apparatus according to the present invention. The electronic music apparatus shown in this embodiment is, for example, an electronic musical instrument, and is controlled by a microcomputer including a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3. The CPU 1 controls the operation of the entire electronic music apparatus. ROM 2, RAM 3, detection circuits 4 and 5, display circuit 6, sound source / effect circuit 7, storage device 8, and communication interface (I / F) 9 are connected to the CPU 1 via a data and address bus 1D. ing.

  The ROM 2 stores various control programs executed by or referred to by the CPU 1, various data, and the like. The RAM 3 is used as a working memory for temporarily storing various data generated when the CPU 1 executes a predetermined program, or as a memory for temporarily storing a currently executing program and related data. The A predetermined address area of the RAM 3 is assigned to each function and used as a register, flag, table, memory, or the like. The performance operator 4A is, for example, a keyboard provided with a plurality of keys for selecting the pitch of a musical tone, and has a key switch corresponding to each key. 4A (keyboard or the like) can be used not only for manual playing by the user's own playing but also as a means for selecting a timbre, setting a timbre effect parameter, and the like. The detection circuit 4 generates a detection output by detecting the pressing and release of each key of the performance operator 4A. In the present specification, the “tone” is not limited to a general single tone such as a piano or a guitar, but a so-called “tone element” in the case where one “tone” is composed of a plurality of tone elements. ”And a so-called“ performance ”in which a plurality of single timbres are combined into one timbre set, and so on, including a timbre group composed of one timbre element or a plurality of single timbres.

  The setting operation element (switch, etc.) 5A is a selection switch for selecting a timbre to be used for performance, for example, various timbre effect parameters such as volume, pitch, LFO and the like (for example, 0 to 128, -64 to + 64, etc. (in other words, control values related to various timbre effects used for applying effects to the musical sound are determined according to the operation amount), for example, modulation wheel, pitch bend wheel, after It is configured to include various operators such as control operators such as touch, knob, slider, ribbon controller, and control switches for controlling tone color effect parameters using the “musical tone control screen” (see FIG. 2). . Note that a timbre effect parameter to be controlled by the user can be arbitrarily associated with each control operator.

  Of course, in addition to the above, the setting operator 5A is a numeric keypad for inputting numeric data and a keyboard for inputting character data for selecting / setting / controlling pitches, tones, effects, and the like, or various types displayed on the display 6A. Includes various controls such as a mouse (referred to as a two-dimensional pointing control or object control) that specifies the position of the screen and operates a pointer for clicking and dragging an object displayed on the screen. Also good. The detection circuit 5 detects the operation state of the setting operation element 5A, and outputs switch information and the like corresponding to the operation state to the CPU 1 via the data and address bus 1D.

  The display circuit 6 displays various screens such as a “musical sound control screen” (see FIG. 2) on a display 6A composed of, for example, a liquid crystal display panel (LCD), a CRT or the like, as well as the ROM 2 and the storage device 8. Various data stored in the memory or the control state of the CPU 1 can be displayed. By referring to these various types of information displayed on the display 6A, the user can easily select a timbre and music to be used during performance and set a timbre effect parameter. It should be noted that the display 6A may be a touch panel, and in that case, it is needless to say that the display 6A includes means for detecting that the screen has been touched. In this case, the display 6A includes a so-called soft switch, and a two-dimensional pointing operator (object) that can change and control the display position and shape of each object of the “musical sound control screen” displayed on the display 6A as a mouse or the like as a touch panel. It also serves as an operator.

  The tone generator / effect circuit 7 can simultaneously generate music signals on a plurality of channels, inputs data and performance information given via the address bus 1D, synthesizes music based on the performance information, and generates a music signal. Is generated. Further, when synthesizing a musical sound, various effects can be applied based on the control value (parameter value) for each set tone color effect parameter. The tone signal generated from the sound source / effect circuit 7 is generated from a sound system 7A including an amplifier and a speaker. Any conventional configuration may be used for the configuration of the sound source / effect circuit 7 and the sound system 7A. For example, the tone generator / effect circuit 7 may employ any of various tone synthesis methods such as FM, PCM, physical model, formant synthesis, etc., or may be configured with dedicated hardware, or by software processing by the CPU 1. It may be configured.

  The storage device 8 stores, for example, various control programs executed by the CPU 1 in addition to various data such as a timbre effect parameter set. When the control program is not stored in the ROM 2 described above, the control program is stored in the storage device 8 (for example, a hard disk) and is read into the RAM 3 to store the control program in the ROM 2. It is possible to cause the CPU 1 to perform the same operation. In this way, control programs can be easily added and upgraded. The storage device 8 is not limited to a hard disk (HD), but may be a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), or a DVD (Digital Versatile Disk). Any storage device may be used as long as it uses a storage medium in the form. Alternatively, a semiconductor memory such as a flash memory may be used.

  A communication interface (I / F) 9 is an interface for transmitting and receiving various information such as a control program and data between the apparatus and an external device (not shown). The communication interface 7 may be, for example, a MIDI interface, a LAN, the Internet, a telephone line, or the like, and may include both wired and wireless ones.

  In the electronic music apparatus described above, the performance operator 4A is not limited to the form of a keyboard instrument, but may be any form such as a stringed instrument, a wind instrument, or a percussion instrument. In addition, the electronic music apparatus is not limited to one in which the performance operator 4A, the display 6A, the sound source / effect circuit 7 and the like are built in one apparatus body, but each is configured separately, and communication means such as a MIDI interface and various networks are provided. Needless to say, the apparatus may be configured to be connected to each other. Furthermore, the electronic music apparatus according to the present invention is not limited to an electronic musical instrument, and any form can be used as long as it can control musical sounds, such as a mixer, a personal computer, a portable communication terminal such as a mobile phone, a karaoke apparatus, or a game apparatus. The apparatus / equipment may be used.

  Next, the “musical sound control screen” displayed on the display 6A will be described. FIG. 2 is a conceptual diagram showing an example of a “musical sound control screen”. The “musical sound control screen” is a user interface for musical sound control, and can simultaneously display a plurality of source objects OS (first display objects) and a plurality of destination objects OD (second display objects). Here, as an example, a case where two source objects OS (S1, S2) and three destination objects OD (D1-D3) are displayed is shown. Here, the source object OS is associated with the control operator, and when the control operator is operated, it moves only to an appropriate position on the rail object R, while the object operator is operated. An example is shown in which is freely moved to an appropriate position in the screen.

  The source object OS is a virtual operator and represents a control source capable of controlling various tone effect parameters. For example, control operations such as a modulation wheel, a pitch bend wheel, an after touch, a knob, a slider, and a ribbon controller. A child is associated as a control source. On the other hand, the destination object OD represents a timbre effect parameter to be controlled that determines a control value according to a user operation. For example, various timbres that can be added to a musical tone such as volume, pitch, LFO, and vibrato. It is associated with one of the parameters related to the effect.

  The rail object R is attached to the source object OS. The rail object R defines a trajectory when the source object OS associated with the control operation element is moved and displayed on the screen. (Source object OS) is associated with a timbre effect parameter (destination object OD) for which a control value is determined according to the operation of the control operator. That is, the source object OS is displayed and controlled so as to move on the rail object R according to the operation of the control operator, and the operation amount of the control operator is “minimum” (for example, 0, -64) so that it is located at the rail start point, and when the operation amount is "max" (for example, 128, +64, etc.), it is located at the rail end point. The display control of the source object OS is performed by moving on the rail object R by an amount corresponding to an increase or decrease in the amount of operation of the control operator from time to time (such as a predetermined position and control on the line segment of the rail object R). A correspondence relationship with the operation amount of the operator (for example, 0 to 128, -64 to +64, etc.) is formed). The rail object R may or may not be displayed.

Note that the target source object OS and the destination object OD to be displayed on the “musical sound control screen” may be arbitrarily selected by the user, and the user can select an initial display position for each of the source object OS and the destination object OD. Can be specified arbitrarily. Further, the user can adjust the direction and the line segment length of the rail object R.
The display mode of the source object OS is not limited to a circular graphic display as shown in the figure, and may be a graphic display of an arbitrary shape such as a polygon or a star, or a shape of a control operator. It may be a graphic display such as an icon. Although omitted in the illustrated example, not only the graphic display but also the names of control operators associated with the source object OS, their abbreviations, and symbols may be displayed. Further, when a plurality of source objects OS are displayed at the same time, the display modes such as colors and shapes may be different for each source object OS. As with the source object OS, the destination object OD may be displayed in an appropriate shape, or the name of the timbre effect parameter associated with the destination object OD may be displayed.

  Here, the musical tone control using the “musical tone control screen” will be described. User operations for musical tone control on the “musical sound control screen” include direct operation of objects on the screen by operating a control operator and two-dimensional pointing operator (object operator) such as a mouse or user touch operation. There is a case to do. When operating the control operator, the source object OS corresponding to the operated control operator moves on the rail object R. Corresponding to the distance (display interval) between the display position of the source object OS and the display position of the destination object OD that change according to this movement, the control value of the timbre effect parameter is determined to control the tone.

  On the other hand, when an object on the screen is directly operated by an object operator or a user touch operation, one or more source objects OS can be removed from each rail object R and moved to an appropriate position. At that time, one or more source objects OS are automatically moved according to the user operation mode (gesture), and the display position of the source object OS and the destination object OD that change according to the automatic movement of the source object OS. The control value of the timbre effect parameter is determined in accordance with the distance (display interval) to the display position, and the tone is controlled. As described above, the source object OS is not limited to the rail object R, and can automatically move freely in the screen according to various characteristics determined by the user's operation mode (called a gesture).

  FIG. 2 shows an example of movement display when a gesture for quickly dragging the designated source object OS is performed. As can be understood from FIG. 2, a single source object OS (in the figure, a gesture in which an autonomous inertia movement is indicated) is performed by quickly dragging from the upper left to the lower right of the screen, for example. The slanted line S1) temporarily deviates from the rail object R (indicated by a dotted line in the figure) attached to the source object OS, and the dragged direction (see FIG. (In the direction of the arrow indicated by the solid line), the display is moved and displayed so as to continue to move with inertia. At this time, when there are other source objects and destination objects OD in the traveling direction of the source object OS that moves autonomously and they become obstacles, or when they move to the full edge (edge) of the screen Then, the robot moves autonomously by changing its traveling speed and traveling direction so that it bounces upon contact with an obstacle or a heel (edge) of the screen (indicated by a two-dot chain line in the figure). The same applies to autonomous movement (see FIG. 3A) by other gestures described later.

  For the source object OS temporarily removed from the rail object R, a control operator (source object OS) and a timbre effect parameter (destination object OD) that determines a control value in accordance with the operation of the control operator. The association is temporarily released. Then, the control value of the timbre effect parameter is determined according to the distance (display interval) between the display position of the source object OS and the display position of each destination object OD that changes according to the movement of inertia. Musical sound control is performed based on this (details will be described later).

  Note that an effective area KA as illustrated may be arranged in the destination object OD. The effective area KA enables or disables control of the timbre effect parameter associated with the destination object OD having the area by the source object OS (that is, a control value determined according to the distance). It represents the boundary / range (reflected / not reflected) and may or may not be displayed on the screen so that the user can visually recognize it. That is, when the source object OS is located outside the valid area KA, the control of the timbre effect parameter associated with the destination object OD is not validated and the control value is not reflected. When the source object OS is located in the valid area KA, the control of the timbre effect parameter associated with the destination object OD may be validated and the control value may be reflected.

The source object OS temporarily removed from the rail object R by the gesture returns to an appropriate position on the rail object R according to the operation of the associated control operator (a plurality of source objects When the OS is automatically moved simultaneously, all the source objects OS return to the corresponding rail object R in response to one of the control operators corresponding to one of them being operated).
In addition, when the destination object OD does not have the effective area KA and all of the plurality of source objects OS on the screen affect the destination object OD, or the destination object OD has the effective area KA and within the effective area KA. When there are a plurality of source objects OS, a control value for musical tone control is obtained by adding all control values determined according to the distance between each source object OS and the destination object OD for each destination object OD. Decide each time according to the above movement.

  There are various gestures for automatically moving the source object OS and performing musical tone control in addition to the drag operation described above. Accordingly, FIG. 3 shows a specific example of musical tone control associated with various gestures. FIG. 3 is a conceptual diagram for explaining various gestures and movements of a source object executed in association therewith. However, the rail object R is not shown here.

First, as shown in the upper left of FIG. 3A, after specifying a plurality of source objects, an arbitrary point on the screen (attraction point: set to one of the specified source objects) If a gesture is made that does not move for a while (for example, for a few seconds), all the source objects are moved so as to be drawn toward the designated point.
Second, as shown in the upper right of FIG. 3 (A), after specifying a plurality of source objects, an arbitrary point on the screen (repulsive point: set to one of the specified source objects). If a gesture is performed that does not move for a while (for example, for a few seconds), all the designated source objects move so as to repel from the point indicated.

Third, as shown in the lower left of FIG. 3 (A), a gesture (autonomous vibration motion) in which one source object S1 is designated and dragged so as to reciprocate with the destination object D1. Is performed, the dragged source object moves so as to reciprocate repeatedly between the drag start position and the destination object D1, even if the drag operation is not continued.
Fourthly, as shown in the lower right of FIG. 3A, a gesture (instructing an autonomous rotational movement) is specified in which one source object S1 is designated and then dragged so as to surround the destination object D1. When the gesture is performed, the dragged source object moves around the destination object D1 repeatedly even if the drag operation is not continuously performed.

Fifth, as shown on the left side of FIG. 3B, when a gesture of dragging in the vertical direction of the screen is performed at a specific location on the screen where no object is displayed, all the source objects are like gravity. To move downward so that it falls down (or rises up against the screen). In the illustrated example, dragging from the top to the bottom of the screen causes the source objects S1 and S2 to fall from top to bottom.
Sixth, as shown on the right side of FIG. 3B, when a gesture of dragging in the horizontal direction of the screen is performed at a specific location on the screen where no object is displayed, all the source objects are like wind. To move the screen to the left and right. In the illustrated example, dragging from the right to the left of the screen causes the source objects S1 and S2 to move from the right to the left of the screen.
In this case, a simple icon indicating that virtual gravity or wind has an influence on the source object OS in the screen as a characteristic according to the gesture is displayed in the right corner of the screen or the like. A figure including an arrow whose display mode changes depending on the direction and size of the wind may be displayed. Of course, character display may be used. Further, the background color of the screen may be changed according to virtual gravity or the direction and size of the wind, a gradation may be applied, and a display in which a shading pattern flows like a wave may be performed.

  Next, in the electronic music apparatus shown in the present embodiment, the source object OS is automatically moved according to the user's operation mode (gesture) on the “musical sound control screen” to determine the control value of the timbre effect parameter, Based on this, a process for controlling a musical sound will be described. FIG. 4 is a flowchart showing an example of “main processing”. This process starts when the electronic music apparatus is turned on and ends when the power is turned off.

  Step S1 performs initial setting. For example, a “musical sound control screen” is displayed on the display 6A as an initial setting. In step S2, object addition / deletion is executed. When a source object is added, associate a control operator. When a destination object is added, a timbre effect parameter is associated. In addition, the virtual physical properties of the source object and destination object are assigned an amount equivalent to mass, friction, resistance, etc., an amount equivalent to rebound or slipperiness, and set the initial speed to zero. (That is, memorize such characteristic parameters for each object). Furthermore, the “musical sound control screen” is updated according to the object addition / deletion.

  Step S3 executes processing based on the direct manipulation of the object. Here, the direct operation of the object is not a control operation described above, but a click and drag operation (excluding an operation corresponding to a gesture) by a two-dimensional pointing operation (object operation), for example. The object, rail object, and destination object are directly specified and their movement / deformation operations are performed. In this case, the display of each object displayed on the “musical sound control screen” is updated according to the operation of the object operator.

  In step S4, an attractive point / repulsive point setting process is executed. In step S5, a spatial parameter setting process is executed. Step S6 executes gesture processing. Step S7 executes an object autonomous movement process. In step S8, a tone generation process is executed. Detailed description of each process described in steps S4 to S8 will be described later (see FIGS. 5 to 9).

  FIG. 5 is a flowchart showing an example of “attraction / repulsion point setting processing” (see step S4 in FIG. 4). In step S21, it is determined whether or not a point on the plane having no object is touched. If it is determined that one point on the plane having no object is not touched (no in step S21), the process jumps to the process in step S23. If it is determined that a point on the screen without an object is touched (yes in step S21), the point on the touched screen is set as an attractive point. When an attractive point is set, while this point is specified, all source objects receive a predetermined amount of force in the direction toward this point and are reflected in the object position update (FIG. 3). (A) Refer to the upper left).

  In step S23, it is determined whether or not two points that are close to each other within a predetermined distance on the screen having no object are touched. If it is determined that two points that are close within a predetermined distance on the screen without an object are not touched (no in step S23), the process ends. If it is determined that two points that are close within a predetermined distance on the screen without an object are touched (yes in step S23), the midpoint of the two touched points is set as a repulsive point. When a repulsive force point is set, while this point is specified, all source objects are reflected in the object position update so as to receive a predetermined amount of force in a direction away from this point (see FIG. 3 (A) See upper right).

  FIG. 6 is a flowchart showing an example of “spatial parameter setting processing” (see step S5 in FIG. 4). In step S31, an attribute of a coefficient of friction or air resistance is set according to a user operation. With this attribute setting, one resistance parameter is determined in the entire virtual space in the screen as a drag against the object moving direction. In step S32, attributes of gravity on / off and gravity strength in the virtual space are set in accordance with a user operation. By this attribute setting, one gravity parameter is determined in the entire virtual space as a force acting in the vertical direction in the virtual space in the screen. In step S43, on / off of the wind in the virtual space, the direction in which the wind blows, and further the wind strength attribute are set according to the user operation. With this attribute setting, one wind parameter is determined in the entire virtual space as a force acting in the horizontal direction in the virtual space in the screen. In step S44, the background display on the screen is updated in accordance with the set attribute values (see FIG. 3B).

  FIG. 7 is a flowchart showing an example of “gesture processing” (see step S6 in FIG. 4). In step S41, it is determined whether there is a source object on which an operation for instructing an autonomous rotational motion is performed. If it is determined that there is a source object for which an operation for instructing autonomous rotational motion has been performed (yes in step S41), the operated object is set as an autonomous rotational motion target, and the centripetal force coefficient, initial velocity, etc. A parameter is assigned (step S42). Specifically, it is determined that an autonomous rotational motion has been instructed if the rotational operation is continuously performed three times or more during the operation from a predetermined time before to the latest. From the operation, the centripetal force and the initial speed are obtained corresponding to the turning radius, and the centripetal force is applied to the object after the start of the movement according to the initial speed and is reflected in the object autonomous movement (see the lower right in FIG. 3A).

  In step S43, it is determined whether there is a source object on which an operation for instructing autonomous vibration motion is performed. When it is determined that there is a source object for which an operation for instructing autonomous vibration motion is performed (yes in step S43), the operated object is set as an autonomous vibration motion target, and a reciprocal range, initial speed, and the like are set. A parameter is assigned (step S44). For example, if the reciprocating vibration operation is continuously performed three times or more during the operation from a predetermined time before to the latest, it is determined that the autonomous vibration motion is instructed. From the operation, the effectiveness coefficient and the initial speed for the traveling direction are obtained, and after the start of movement according to the initial speed, the effect according to the efficiency coefficient is applied to the object and reflected in the object autonomous movement (see the lower left of FIG. 3A). ).

  In step S45, it is determined whether there is a source object on which an operation for instructing an autonomous inertia movement is performed. If it is determined that there is a source object for which an operation for instructing an autonomous inertia motion has been performed (yes in step S45), the operated object is set as an autonomous inertia motion target, and parameters such as initial velocity are assigned. (Step S46). Specifically, if the drag operation has been stopped most recently and the finger or pointer is released, and if the amount of movement per unit time is greater than or equal to a predetermined value, autonomous inertial motion is indicated. It is determined that Further, the initial speed is obtained from the operation and reflected in the autonomous movement of the object (see FIG. 2).

  If the operation for instructing any of the above movements has not been performed (no in steps S41, S43, S45), the process of step S47 is performed without performing any of the processes of steps S42, S44, S46. Go to. In step S47, when there is an object touched among the objects whose display is updated according to any of the above motions, the object is excluded from each autonomous operation target.

  FIG. 8 is a flowchart showing an example of the “object autonomous movement process” (see step S7 in FIG. 4). In step S51, source objects are selected one by one in order. In step S52, the resultant force of the force applied to the source object selected according to the attribute or the like is obtained. The force applied to the source object includes a force due to a spatial parameter (resistance, gravity, and wind parameters), a force due to an attractive point / repulsive point, a centripetal force and a drag force for autonomous movement, and the like. In step S53, acceleration is obtained based on the attribute, the mass of the source object, and the like. That is, acceleration is determined according to all the forces applied to the source object and the attributes of the object itself (characteristic parameters such as mass and slipperiness). In step S54, the traveling speed is updated according to the obtained acceleration. A step S55 updates the display position according to the updated traveling speed.

  In step S56, it is determined whether or not another object or the edge (end / wall) of the screen is touched. If it is determined that the object touches another object or the edge of the screen (Yes in step S56), the self (and the other party) according to the physical attributes of the object (and the touched object) (for example, the mass and the rebound coefficient). ) Is updated (step S57). A step S58 decides whether or not each of the above processes has been executed for all the source objects. If it is determined that the above processes are not executed for all the source objects (no in step S58), the process returns to step S51 and is repeatedly executed. If it is determined that the above-described processes have been executed for all the source objects (yes in step S58), the processes are terminated.

  FIG. 9 is a flowchart showing an example of the “musical sound generation process” (see step S8 in FIG. 4). In step S 61, the parameter value is determined from the positional relationship with the source object for the destination object to which the parameter control function is assigned, and is set in the sound source / effect circuit 7. That is, the control value of the corresponding timbre effect parameter is determined according to the distance (display interval) between the source object OS and the destination object OD displayed on the “musical sound control screen”, and the determined control value is used as the sound source. Supply to the effect circuit 7 A step S62 instructs the sound source / effect circuit to reproduce a musical sound in accordance with the user's performance operation. For example, a note event generated in response to the operation of the performance operator 4 by the user, a note event generated in response to the reproduction of song data stored in the storage device 8 or the like, and further via the communication interface 9. Based on a note event or the like acquired from an external device, the tone generator / effect circuit 7 is instructed to generate a musical tone.

  As described above, when the user operation performed on the screen is in a predetermined operation mode, even if the user operation is not continuously performed, the operation mode associated with the operation mode in advance is temporally determined. The display position of the first display object and / or the second display object in the screen is changed and controlled so as to autonomously perform the continuous movement operation. Then, the control value of the timbre effect parameter associated with the second display object is determined according to the display positional relationship between the first display object and the second display object that perform the autonomous moving operation, and the determined timbre The tone is controlled based on the control value of the effect parameter. Accordingly, the user can perform various musical tone controls according to the operation mode while visually enjoying the user.

For gestures such as “Attracted” and “Repel”, the source object is not moved autonomously around the specified point, but is pulled or repelled according to the movement of the pointer on the screen. Thus, the source object may be moved autonomously. Further, the source objects to be “attracted” and “repel” may be grouped in advance by the user, or may be all of the displayed objects.
Obstacle objects are fixedly displayed at an arbitrary predetermined position (the user may set them arbitrarily), and when the autonomously moving source object touches the obstacle object, it is displayed at the edge of the screen. You may make it update own speed and advancing direction similarly to the case where it contacts.
Note that a pitch is assigned to the destination object, and a musical tone having the assigned pitch is generated when the source object touches the destination object or when the boundary of the effective area is crossed. It may be. In this case, the volume may be adjusted simultaneously according to the distance between the display position of the source object and the display position of the destination object. Also, different pitches may be assigned for each distance so that different pitches are generated according to the distance between the display position of the source object and the display position of the destination object.

In the above-described embodiment, the source object is associated with the control operator, and the control operator is not moved only on the rail object, but the object operator is operated to freely move within the screen. However, the present invention is not limited to this, and the source object may be simply a virtual operator that is not associated with the control operator, and can only be directly operated by the user with the object operator. Needless to say, the rail object is not necessary in this case.
In the above-described embodiment, an example in which only the source object moves autonomously has been described. However, the present invention is not limited thereto, and it is needless to say that the destination object may be moved autonomously.
Note that the two-dimensional pointing operator (object operator) is not limited to the above-described mouse or touch panel. For example, it may be an arrow key or a pad.

1 is a block diagram of a hardware configuration showing an example of the overall configuration of an electronic music apparatus according to the present invention. It is a conceptual diagram which shows one Example of a musical tone control screen. It is a conceptual diagram for demonstrating various gestures and the movement of the source object performed in connection with it. It is a flowchart which shows one Example of a main process. It is a flowchart which shows one Example of the setting process of an attractive point / repulsive point. It is a flowchart which shows one Example of the setting process of a spatial parameter. It is a flowchart which shows one Example of a gesture process. It is a flowchart which shows one Example of an object autonomous movement process. It is a flowchart which shows one Example of a musical tone production | generation process.

Explanation of symbols

1 ... CPU, 2 ... ROM, 3 ... RAM, 4,5 ... detection circuit, 4A ... performance operator, 5A ... setting operator, 6 ... display circuit, 6A ... display, 7 ... sound source / effect circuit, 7A ... sound System, 8 ... Storage device, 9 ... Communication interface, 1D ... Data and address bus, OS ... Source object, OD ... Destination object, R ... Rail object, KA ... Effective area

Claims (3)

A display for displaying a screen including at least a first display object representing a virtual operation element and a second display object associated with a tone color effect parameter relating to tone pitch or tone control of a tone , The indicator on which each first display object is displayed at an arbitrary position on the screen;
Determining means for detecting a user operation performed in the screen and determining whether the detected user operation is in a predetermined operation mode;
When the detected user operation is a predetermined operation mode, a movement operation that continues in time according to an operation mode previously associated with the operation mode is autonomously performed even if the user operation is not continuously performed. Display control means for changing and controlling the display position of the first display object and / or the second display object,
The relative display position in accordance with the combined value of the relationship, the second pitch or tone effect parameters of tone associated with the display object between each said second display objects of a plurality of the first display object Determining means for determining a control value of;
An electronic music apparatus comprising a musical sound control means for performing musical sound control based on the determined musical tone pitch or the control value of the tone color effect parameter.   An attribute value corresponding to a virtual physical quantity is associated with each of the first display object and the second display object displayed on the display unit or the operation mode, and the display control unit is configured to respond to the attribute value. 2. The electronic music apparatus according to claim 1, wherein the display position of the first display object and / or the second display object is changed and controlled so as to perform a moving operation according to the virtual physical characteristic. On the computer,
A procedure for displaying a screen including at least a first display object representing a virtual operation element and a second display object associated with a tone color effect parameter relating to tone pitch or tone control on a predetermined display. , The procedure in which a plurality of the first display objects are respectively displayed at arbitrary positions on the screen;
A procedure for detecting a user operation performed in the screen and determining whether or not the detected user operation is a predetermined operation mode;
When the detected user operation is a predetermined operation mode, a movement operation that continues in time according to an operation mode previously associated with the operation mode is autonomously performed even if the user operation is not continuously performed. A procedure for changing and controlling the display position of the first display object and / or the second display object,
The relative display position in accordance with the combined value of the relationship, the second pitch or tone effect parameters of tone associated with the display object between each said second display objects of a plurality of the first display object The procedure for determining the control value of
A program for executing a musical sound control procedure based on the determined musical tone pitch or the control value of the tone color effect parameter.

Images