JP5011563B2 - Sound data generating apparatus and program - Google Patents

Description

  The present invention relates to a sound data generation device and a program.

In recent years, more and more realistic sounds have been generated by computers. For example, sounds associated with natural phenomena such as “rainfall sound” and “breeze sound” can be reproduced very skillfully on a computer (see Patent Document 1).
For example, there is a sound having a characteristic waveform for each natural phenomenon, such as “zazer” for “raining sound” and “hugh” for “breeze sound”. The sound of the natural phenomenon is reproduced by repeatedly converting the waveform data simulating the characteristics of the sound into sound.
Japanese Patent Application Laid-Open No. 07-140973

  By the way, it is clear from the example that the above-mentioned sound of rain comes from the collision of a lot of raindrops with the ground, and the sound of the breeze comes from the flow and vibration of many gas molecules existing in the air. As described above, most of the sounds generated in nature are generated by the frequent interaction of many particles when viewed on a small scale.

For example, when a single raindrop collides with the ground, sounds such as “pot”, “petti”, and “pachi” are generated according to the collision situation between each raindrop and the ground and the interaction between raindrops. . When countless raindrops collide with the ground continuously, a sound is generated in which different sounds are superimposed on each other. As described above, a large number of various sounds derived from each raindrop are overlapped, and as a result, the sound is perceived by humans as a sound of “za,” which is the sound of rain (a large number of raindrops).
In this way, sounds that occur in nature are not listened with distinct sound components derived from individual interactions when listened as a whole, but they are actually composed of different sounds each time. Sounds that cannot be reproduced again are generated. It is thought that the “randomness” and “non-reproducibility” of such sounds give “naturalness” to sounds in nature.

  However, since the sound generated by the conventional computer including the above-mentioned Patent Document 1 is a sound in which predetermined waveform data is repeatedly read, the “randomness” and “non-reproduction” described above are included in the sound. There is a problem that the so-called “naturalness” cannot be felt due to lack of “sexuality”.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a sound data generation device and a program for generating a natural sound associated with the behavior of a large number of particles under a certain law. .

  The sound data generation device according to the present invention includes a virtual space setting unit that sets a virtual space, a virtual particle emitting unit that performs an operation of continuously releasing virtual particles to the virtual space, and the virtual particle emitting unit. Orbital calculation means for calculating the trajectory of each virtual particle released by the calculation including collision between the virtual particles, virtual sounding body setting means for setting a virtual sounding body in the virtual space, and the virtual sounding body Control means for controlling the movement of the sound, and when the virtual sounding body is moved by the control means, accompanying sounding body control means for generating the accompanying sounding body based on the movement and moving the accompanying sounding body, Sound data generation means for calculating an interaction between the virtual particle and at least one of the virtual sound generator and the accompanying sound generator and generating the sound data based on the interaction. To. In the above configuration, the accompanying sounding body control means may move the accompanying sounding body along a movement path of the virtual sounding body.

  In the above configuration, the accompanying sound generator control means generates a plurality of the accompanying sound generators and moves the accompanying sound generators, and the sound data generating means determines the characteristics of the plurality of accompanying sound bodies that appear. By making them different from each other, a sound having a different characteristic may be generated for each accompanying sounding body when the interaction between each accompanying sounding body and the virtual particle is calculated.

  The program according to the present invention includes a virtual space setting unit that sets a virtual space, a virtual particle discharge unit that performs an operation of continuously releasing virtual particles to the virtual space, and a virtual particle discharge unit. Orbital calculation means for calculating the trajectory of each virtual particle released by the calculation including collision between the virtual particles, virtual sounding body setting means for setting a virtual sounding body in the virtual space, and the virtual sounding body Control means for controlling the movement of the sound, and when the virtual sounding body is moved by the control means, accompanying sounding body control means for generating the accompanying sounding body based on the movement and moving the accompanying sounding body, Functions as sound data generating means for calculating the interaction of the virtual particles with at least one of the virtual sounding body and the accompanying sounding body and generating sound data based on the interaction And characterized in that.

  According to the sound data generation apparatus or program according to the present invention, it is possible to generate a natural sound associated with the behavior of a large number of particles under a certain law.

(Outline of the present invention)
The sound data generation device according to the present invention emits a large number of virtual particles into a virtual space formed by computation of a computer and moves a vibrating body (such as a string) in the virtual space. Then, the state of interaction (collision, etc.) between the virtual particles and the vibrating body is calculated, and sound data is generated based on the vibration state of the vibrating body based on the calculation result.

  FIG. 1 is an example of a monitor display in the sound data generation process. The virtual particles 200 are emitted into the virtual space 100 from the tip portion of the sprinkler 150. Then, the virtual particles 200 “drop” toward the lower side of the screen according to the gravity set in the virtual space 100, bounce off the wall surface of the virtual space 100, or collide with each other. In such a virtual space 100 in which a large number of virtual particles 200 are moving randomly, a “string” is provided as a vibrating body (sound generator). The string is generated according to the operation content by the user and moves in the virtual space 100. When each virtual particle 200 passes through the string region and “repels” the string, the string vibrates, and sound data is generated based on the vibration state of the string.

(A: Configuration)
Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.

(A-1: Overall configuration)
FIG. 2 is a diagram showing the overall configuration of the sound data generation system 1 according to the present invention. The sound data generation system 1 includes a sound data generation device 10 as a program execution device, a mouse 20, a monitor 30, and a multipoint controller 40.

(A-2; Configuration of each device)
First, the hardware configuration of the sound data generation device 10 will be described with reference to FIG.
The sound data generation device 10 includes a control unit 101, an optical disc playback unit 102, a ROM (Read Only Memory) 103, a RAM (Random Access Memory) 104, and an I / O unit 105. These units are connected to each other via a bus 109.

  A control unit 101 shown in the figure is, for example, a CPU (Central Processing Unit), and executes various control programs read from the ROM 103 to perform sound and video signal processing and control of each unit.

The optical disk reproducing unit 102 reads data from an optical disk such as a CD-ROM / DVD-ROM.
The ROM 103 stores various control programs executed by the control unit 101.
The RAM 104 is used as a work area by the control unit 101.

The I / O unit 105 mediates transmission / reception of signals with the device connected to the sound data generation device 10. Specifically, a signal indicating the operation content from the mouse 20 and the multipoint controller 40 is received and output to the control unit 101, and sound data and video data received from the control unit 101 are output to the monitor 30.
The above is the configuration of the sound data generation device 10.

  Next, the configuration of the mouse 20 will be described with reference to FIG. The mouse 20 has a button 22 on the upper surface (see (a) in the figure) of the main body 21 and a movement detection means 24 on the lower surface (see (b) in the figure). In addition, the mouse 20 is connected to the sound data generation device 10 via the communication cable 23, and data indicating the operation content is transmitted to the sound data generation device 10 via the communication cable 23.

In the mouse 20, when the main body 21 is moved, the movement detection unit 24 generates an operation signal indicating the movement direction and the movement amount, and outputs the operation signal via the communication cable 23. The control unit 101 that has received the signal performs a process of moving the cursor on the screen of the monitor 30 based on the operation signal.
When the button 22 is pressed (hereinafter referred to as “click”), the mouse 20 generates a click operation signal indicating that the click operation has been performed and outputs the click operation signal via the communication cable 23. Receiving the click operation signal, the control unit 101 recognizes the coordinate where the cursor is located at the time of clicking, and recognizes that the selection process has been performed on the icon or the like displayed at the coordinate.
In addition, when the main body 21 is moved in a state where the button 22 is pressed and an operation for releasing the pressing of the button 22 (hereinafter, dragging) is performed, the moving direction and movement of the main body 21 while the button 22 is being pressed are moved. An amount and a signal indicating that a drag operation has been performed are generated and output via the communication cable 23. The control unit 101 that has received the signal recognizes that the selection process has been performed on the area on the screen selected by the drag operation, the icon included in the area, and the like.

Next, the configuration of the monitor 30 will be described with reference to FIG. The monitor 30 displays a video based on the video data received from the sound data generation device 10. Each point on the monitor screen is set with coordinates having coordinates (0, 0) at the upper left of the screen and coordinates (756, 1024) at the lower right as shown in FIG.
As shown in FIG. 5, a sound data reproducing unit 30 a is provided below the monitor screen, and sounds are emitted based on the sound data received from the sound data generating device 10.

  Next, the configuration of the multipoint controller 40 will be described with reference to FIG. As illustrated in FIG. 6A, the multipoint controller 40 includes a touch panel 42. As shown in the figure, the touch panel 42 is set with coordinates having the upper left corner of the screen as coordinates (0, 0) and the lower right corner as coordinates (756, 1024). The touch panel 42 has sensing means for sensing that a specific point on the touch panel is pressed. When the sensing means senses that a specific point on the panel is pressed, the position of the pressed point is displayed. The pressed position information including the indicated coordinates is output to the sound data generation device 10 via the communication cable 41. When a plurality of points are pressed at the same time, the pressed position information is generated and output in parallel for each of the plurality of pressed points.

  When receiving the pressed position information from the multipoint controller 40, the control unit 101 of the sound data generation device 10 reads the coordinates included in the pressed position information and determines that a point corresponding to the coordinates is selected on the monitor 30 screen. To do. FIG. 6B is a diagram showing a screen display of the monitor 30. For example, when the hand A and the hand B press the touch panel 42 as shown in FIG. 6A, the coordinates indicating the position pressed by the hand A or the coordinates indicating the position pressed by the hand B are written. The pressed position information is continuously output to the control unit 101 while each point is pressed. When receiving the pressed position information, the control unit 101 determines that the points A and B on the monitor screen shown in FIG. 6B have been selected.

(A-3: Program structure)
Next, the control program stored in the ROM 103 will be described. The control program includes various programs that are executed by the control unit 101 of the sound data generation apparatus 10 to generate sound data. Only the main programs will be described below.

The control program includes a space characteristic control program, an object control program, a particle motion control program, a string vibration control program, a video control program, a sound data generation program, and the like.
The spatial characteristic control program controls various characteristics that are set in the virtual space 100 such as gravity and affect the motion of the virtual particles 200. The object control program controls the object (sprinkler 150) that causes the virtual particles 200 to appear in the virtual space 100, the arrangement of the strings, and the like. The particle motion control program calculates the motion of the virtual particle 200 in the virtual space 100. The string vibration control program calculates a vibration state of a vibrating body (for example, a string) provided in the virtual space 100. The video control program displays behaviors such as the movement of the virtual particles 200 in the virtual space 100 and the vibration of the vibrating body, which are given as the calculation results, on the television monitor screen. The sound data generation program generates sound data based on the vibration state of the vibrating body.

(A-4; control of virtual space)
Hereinafter, control of the virtual space 100 by the space characteristic control program will be described.
FIG. 7 is a diagram illustrating an example of the screen of the monitor 30. On the screen, the framework of the virtual space 100 is displayed. A control panel 400 is displayed on the right side of the virtual space 100. The virtual space 100 is controlled as follows based on an operation on the control panel 400 by the user.

  In the virtual space 100, “space characteristics” as exemplified below are set. When the space characteristic icon 404 at the bottom of the control panel 400 is pressed, the control unit 101 displays a predetermined option on the screen of the monitor 30. FIG. 8 is a diagram showing an example of the display. The user selects an option related to the direction of gravity displayed on the screen and writes the magnitude of the gravitational acceleration. Further, it is assumed that the resistance force acting when the virtual particle 200 moves is proportional to the speed of the virtual particle 200, and a proportional constant for determining the resistance force corresponding to the speed is written. The control unit 101 reflects the input content in the calculation of the behavior of the particle motion in the particle motion control program.

  The settings related to the virtual space 100 may be written in advance as a template in a control program or the like. For example, in a certain template, the gravitational field is set at the lower part of the screen, and a resistance force proportional to the speed acts on the virtual particle 200 moving in the virtual space 100, contrary to the direction of movement, and the proportionality constant is “ If a large value corresponding to “underwater” is set, the user simply selects the template, and the virtual space 100 is a container filled with water installed in a space with gravity. Such a setting can be easily performed.

(A-5: Virtual particle motion)
Below, the control method of the motion of the virtual particle 200 by a particle motion control program is demonstrated.
(1) Appearance of Virtual Particle 200 First, the appearance of the virtual particle 200 will be described with reference to FIG. In the virtual space 100 according to the present embodiment, a sprinkler 150 is provided as a device for generating the virtual particles 200 in the virtual space 100.

  The sprinkler 150 is set by clicking the sprinkler icon 401 after the values of the initial speed 402 and the frequency 403 of the control panel 400 shown in FIG.

  The sprinkler 150 has a discharge port 150 a, and each virtual particle 200 is discharged from the discharge port 150 a at the initial velocity written at the initial velocity 402 and the frequency written at the frequency 403. The virtual particles 200 are randomly emitted so that the average is the number written in the frequency 403 per unit time.

(2) Motion of Virtual Particle 200 The particle motion control program stored in the ROM 103 controls the motion of the virtual particle 200 in the virtual space 100 according to rules (a) to (c) described below. The following rules imitate the mechanical properties and laws of objects on the earth.
(A) The virtual particle 200 has a predetermined volume (v) and mass (m).
(B) There is a relationship of F = mα between the force F acting on the virtual particle 200, the mass m of the virtual particle 200, and the acceleration α. For example, in this embodiment, since a gravity field exists downward in the virtual space 100, a force having a magnitude of mg (g is gravitational acceleration) always acts downward on the virtual particle 200.
(C) When the virtual particles 200 collide with each other and the framework of the virtual particles 200 and the virtual space 100 collide, a complete elastic collision is performed with a rebound coefficient of 1.

(3) Disappearance of Virtual Particle 200 The virtual particle 200 that has reached the bottom of the framework of the virtual space 100 is set to disappear.

(A-6: Generation of sound data)
The sound data generation device 10 generates sound data as described below by a sound data generation program stored in the ROM 103.

  The vibration of the vibrating body (string) is calculated by a string vibration control program stored in the ROM 103. Specifically, physical simulation is performed based on the elasticity (material) of the strings, the cross-sectional area of the strings, the tension of the strings, the amount of displacement of the strings. As a result of the simulation, the displacement amount of each part of the string at each time is calculated, and the amplitude, frequency, attenuation mode, and the like of the sound generated from the string are derived from the calculation result.

  Note that the sound data generation device 10 generates sound data using MAX / MSP. Note that MAX / MSP includes a music programming language MAX and an extension MSP for acoustic signal processing. According to MAX / MSP, various modules can be connected to create synthesizers, effectors, sequencers, etc., and music can be automatically generated by patching. Intuitive programming and operation through a visual programming environment Can do.

(B: Operation)
Below, operation | movement of each part at the time of the sound data generation apparatus 10 producing | generating sound data is demonstrated.
First, when the sound data generating apparatus 10 is turned on, the control unit 101 reads various control programs from the ROM 103 and loads them into the RAM 104.

(B-1: Initial setting process)
First, the control unit 101 performs an initial setting process. FIG. 10 is a flowchart showing the flow of the initial setting process.
In step SA100, the spatial characteristics of the virtual space 100 are set. The user of the sound data generation system 1 presses the space characteristic icon 404 of the control panel 400 shown in FIG. 9, and causes the monitor 30 to display a screen for parameter setting shown in FIG. And the control part 101 sets the space characteristic of the virtual space 100 according to the input content, ie, the gravity field and resistance force in the virtual space 100.

In the present embodiment, in setting the gravitational field, the downward direction of the drawing is selected as the direction of gravity, and the value of the gravitational acceleration is written. As a result, gravity of a value set in the lower direction of the screen acts on the virtual particle 200, and the virtual space 100 is set as if it were a space provided in the vertical direction.
In addition, when the value of the proportionality constant is written in the setting of the resistance force, the resistance force proportional to the moving speed of the virtual particle 200 works in the direction opposite to the movement. Then, the environment is set as if the virtual space 100 is filled with air and water corresponding to the proportionality constant.

  In step SA110, a means (sprinkler 150) for causing the virtual particles 200 to appear in the virtual space 100 is set. After the parameters are written on the control panel 400 by the user, when the sprinkler icon 401 is clicked and an area in the virtual space 100 is designated, the sprinkler 150 is set.

(B-2; vibrator setting processing)
Before starting the description of the process for releasing the virtual particles 200 into the virtual space 100, the vibration body setting process for setting the vibration body that generates sound by the interaction with the virtual particles 200 in the virtual space 100 will be described with reference to FIG. To do. The vibrating body setting process is performed as needed as an interruption process during the sound data generation process described later.

  In step SC100, the control unit 101 determines whether or not the pressed position information is received from the multipoint controller 40. If the determination result of step SC100 is “NO”, the process of step SC100 is repeated. If the determination result of step SC100 is “YES”, the process of step SC110 is performed.

  The control unit 101 reads the coordinates included in the pressed position information received from the multipoint controller 40 and temporarily stores the coordinates in the RAM 104. Then, the operation string 120 (vibrating body) is provided in the virtual space 100 so that the two positions (coordinates) included in the pressed position information are at both ends (step SC110). Thus, in the present embodiment, the vibrating body directly controlled by the user is the operation string 120.

  The operation string 120 thus provided is continuously provided while the touch panel 42 is pressed. Here, the operation string 120 can be moved in the virtual space 100. In step SC120, control unit 101 determines whether or not the coordinates included in the pressed position information have been changed. When the determination result of step SC120 is “NO”, the process of step SC120 is repeated, and the operation string 120 is continuously provided at the same position. On the other hand, when the position of the touch panel 42 pressed by the user is slid, the determination result in step SC120 is “YES”, and processing for moving the installation position of the operation string 120 is performed. That is, a process of changing the installation position of the operation string 120 corresponding to the pressed position that changes every moment is performed (step SC130).

  Here, when the process of step SC130 is executed, an accompanying vibrator is set in step SC140. The accompanying vibrating body is provided with a vibrating body (attaching string 125) different from the operating string 120 in response to the movement of the vibrating body (operating string 120) directly operated by the user. This is a process of accompanyingly moving the operation string 120 moved by the user.

Details of the processing will be described with reference to FIGS. 9 and 13. The state of the virtual space 100 immediately after the touch panel 42 of the multipoint controller 40 is pressed by the user is shown in FIG. At that stage, the operation string 120 is stationary at the illustrated position.
Therefore, when the user moves the pressed point while pressing the touch panel 42, the operation string 120 moves as shown in FIG. 13 (see the arrow in the figure). When the movement is finished and it is determined that the operation string 120 is stationary at the movement destination, the associated string 125 is generated at the point where the movement of the operation string 120 is started. The generated accompanying string 125 moves along the same path as the operation string 120 at a speed three times that of the operation string 120, and the operation string after the operation string 120 has moved in one third of the time required for the operation string 120 to move. The position 120 is reached. At the same time as the associated string 125 reaches the position of the operation string 120, it returns to the start position of the movement and starts moving in the same manner again. The associated string 125 performs the process of repeating such movement of the operation string 120 at a triple speed three times.
FIG. 14 is a diagram showing a time schedule for the movement of the operation string 120 and the associated string 125 described above. As is apparent from the figure, the associated string 125 moves three times during the same time (T) as the time required for the operation string 120 to move. In the virtual space 100 shown in FIG. 13, the associated string 125 crosses the trajectory of the virtual particle 200 at each of the three movements, so that the associated string 125 and the virtual particle 200 interact multiple times. Note that FIG. 13 corresponds to the state of the virtual space 100 at the time t1, t2, or t3, for example.

In step SC150, the control unit 101 determines whether or not the supply of the pressed position information that instructs installation of the operation string 120 is stopped. When the user stops pressing the touch panel 42, the pressed position information is not supplied to the control unit 101, the determination result in step SC150 is “YES”, and the operation string 120 corresponding to the position where the pressing is stopped disappears ( Step SC160). On the other hand, when the button is continuously pressed (step SC150; “NO”), the processes after step SC120 are repeated.
In step SC170, the control unit 101 determines whether or not the vibrator setting process has been completed. If the determination result in step SC170 is “YES”, the vibrator setting process is terminated. If the determination result in step SC170 is “NO”, the processes in and after step SC100 are performed again. The above is the flow of the vibrator setting process.

(B-3; sound data generation processing)
When the initial setting process is performed, the control unit 101 starts the sound data generation process. FIG. 11 is a flowchart showing the flow of sound data generation processing.

  In step SB110, the sprinkler 150 releases the virtual particles 200 to the virtual space 100. Then, for each of the appearing virtual particles 200, the processing from step SB120 onward is performed in parallel.

In step SB120, the motion of the virtual particle 200 after a minute unit time is calculated. When the virtual particle 200 collides with the wall of the virtual space 100 or another virtual particle 200, the virtual particle 200 rebounds with a complete elastic collision, and a new velocity is set for the virtual particle 200. Further, when no collision occurs, the virtual particle 200 moves to a new position by multiplying the speed of the virtual particle 200 by a minute time.
Note that in step SB120, the trajectory is calculated simultaneously for all the virtual particles 200 that appear in the virtual space 100 in step SB110, so that a large number of randomly appearing virtual particles 200 frequently interact with each other. It will be repeated. Therefore, even if various settings of the virtual space 100 are the same, different behaviors of the virtual particles 200 are caused each time.

  In step SB130, it is determined whether or not the bottom surface of the virtual space 100 is reached and disappears by the processing in step SB120. If the determination result in step SB130 is “YES”, the virtual particle 200 is erased from the screen, and the process for the virtual particle 200 is terminated. When the determination result of step SB130 is “NO”, the processes after step SB140 are performed.

  In step SB140, it is determined whether or not the virtual particle 200 collides with the associated string 125. In the vibration body setting process (interrupt process) described above, when the accompanying string 125 generated along with the movement of the operation string 120 interacts with the virtual particle 200, the determination result in step SB140 is “YES”, and the process proceeds to step SB150. Processing is performed. On the other hand, when the determination result of step SB140 is “NO”, the processes after step SB120 are performed again.

In step SB150, the vibration state of the associated string 125 that interacted with the virtual particle 200 in step SB140 is calculated by simulation. Then, from the result of the simulation calculation, the amplitude, frequency, tone color, and the like of the sound generated in the accompanying string 125 are analyzed, and sound data representing the sound is generated. In this case, even when the associated string 125 interacts with the virtual particle 200 while moving in the virtual space 100, the associated string 125 is the same as when the associated string 125 interacts with the virtual particle 200 when stationary. Vibrate.
In step SB160, sound data is generated based on the vibration state of the associated string 125.

As described above, when the operation string 120 is operated by the user, the associated string 125 is provided with a time lag from the operation, and the associated string 125 is moved a plurality of times in the virtual space 100 so as to trace the movement path of the operation string 120. To move. Therefore, the user can control the plurality of associated strings 125 and generate various sounds simply by specifying the movement of the operation string 120. Furthermore, although the movement mode of the associated string 125 is uniquely determined from the operation of the operation string 120, the user pays attention to the operation of the operation string 120. Therefore, the associated string 125 moves in a manner that the user does not expect. As a result, the randomness and unexpectedness of the generated sound is increased.
When step SB160 ends, the processing after step SB120 is executed again for the virtual particle 200 that interacts with the associated string 125.

  In parallel with the above sound data generation process, the motion of the virtual particles 200 in the virtual space 100 is displayed on the monitor 30. In addition, the generation and movement of the operation string 120 and the associated string 125 and the vibration state of the associated string 125 are displayed on the monitor 30. Since the generated sound data is based on the display, the user can see the screen display corresponding to the sound that has been emitted as it is.

The sound data generated in step SB160 is output to the sound data reproducing unit 30a, and the sound data reproducing unit 30a reproduces the sound data. The control unit 101 also includes information on various parameters related to sound data generation (hereinafter, setting information) such as the arrangement mode of the sprinkler 150, the installation / movement mode of the operation string 120, and the spatial characteristics set in the virtual space 100. Is written to the RAM 104 for each trial.
By reading the setting information written in the RAM 104, the control unit 101 can perform sound data generation processing again under the same condition setting. Even if the sound data is generated again under the same condition setting as described above, the behavior of each virtual particle 200 is different each time, so that microscopically different sound data is generated.

(C: Modification)
As mentioned above, although embodiment of this invention was described, this invention can be implemented with a various aspect as follows.

(1) In the above embodiment, the case where both the operation string 120 and the associated string 125 are displayed on the monitor 30 has been described. However, only one of the operation string 120 and the associated string 125 may be displayed. In that case, sound data may be generated assuming that strings that are not displayed exist in the virtual space 100.

(2) In the above embodiment, the case where sound data is generated when the associated string 125 interacts with the virtual particle 200 has been described. However, either the operation string 120 or the associated string 125 interacts with the virtual particle 200. You may also pronounce it when

(3) In the above embodiment, when the operation string 120 is moved by the operation of the multipoint controller 40, the timing at which the plurality of associated strings 125 are provided is determined based on the period from the start to the end of the movement. Explained the case. However, the timing at which the associated string 125 is provided is not limited to the above. For example, only one associated string 125 may be provided continuously, and the associated string 125 may be arranged at a position where the operation string 120 was present a predetermined time ago. That is, when the operation string 120 is not moved, the operation string 120 and the associated string 125 are provided at the same position, and when the operation string 120 is moved, the associated string 125 moves so as to follow the operation string 120. You may make it do.

(4) In the above embodiment, sound is generated only when there is an interaction between the associated string 125 and the virtual particle 200, but sound is also generated in the interaction between the operation string 120 and the virtual particle 200. You may do it. In this case, the values of various parameters (string material, string length, tension, etc.) in the physical simulation are made different between the operation string 120 and the accompanying string 125, or various effects (volume adjustment) are applied to the generated sound data. , Echo processing, etc.) may be performed to generate different sounds between the operation string 120 and the associated string 125.
Further, in the above embodiment, the accompanying string 125 appears three times repeatedly. In this case, different sounds are generated continuously by changing the sound generation mode of the accompanying string 125 as described above for each appearance. You may make it. For example, if the amplitude of the sound generated by the accompanying string 125 is reduced every time, an effect similar to the echo effect can be provided.
Also, as described above, when different characteristics are set between the operation string 120 and the associated strings 125, or when different characteristics are set between a plurality of associated strings 125, the operation strings 120 and the associated strings 125 are mutually connected. You may display on the monitor 30 in a different aspect. For example, the length of the operation string 120 and the associated string 125, the shape of the bow, and the like may be displayed so as to correspond to the various parameters in the physical simulation.

(5) In the above-described embodiment, it has been described that the operation string 120 moves so that the associated string 125 traces at a triple speed. However, the movement mode of the associated string 125 is not limited to the above-described mode, and any mode that moves according to the movement of the operation string 120 may be used. For example, the accompanying string 125 may be provided in the manner exemplified below.
(A) A plurality of associated strings 125 may be simultaneously provided for one operation string 120. If a plurality of accompanying strings 125 are provided, various sounds (such as chords) can be generated by operating the operation string 120.
(B) The number of repetitions of movement of the associated string 125 is not limited to three, and may be 1, 2, 4 or more.
(C) The locus of movement of the associated string 125 may not be the same as the locus of the operation string 120. For example, the operating string 120 may be moved on a straight line connecting the positions before and after the movement. (D) The associated string 125 may be moved so as to return from the position after the operation string 120 is moved to the position before the movement.
(E) The speed at which the movement of the associated string 125 is repeated may be repeated at any other speed instead of three times. As for the speed control method, it may be moved at a predetermined number of times the moving speed of the operation string 120 as in the above embodiment, or the operation string 120 may be tracked with acceleration applied.

(6) Particles that generate sound by interaction with the operation string 120 in the virtual particle 200, particles that generate sound by interaction with the associated string 125, and interaction between any of the operation string 120 and the associated string 125 Also, the sounding may be performed in a different manner between the operation string 120 and the associated string 125 by including particles that generate sound. For example, when 90% of the virtual particles 200 are sounded by interaction with the operation string 120 and the remaining 10% of the virtual particles 200 are sounded by interaction with the associated string 125, the operation string 120 is used. Crosses the virtual particle 200, first, the operation string 120 generates a sound in which a large number of sound components based on the collision with the majority of the virtual particles 200 are produced, and then the associated string 125 is connected to the few virtual particles 200. Characteristic sounds can be generated, such as producing sparse sounds based on collisions.

(7) In the above embodiment, the case where the string-like vibrating body such as the operation string 120 and the accompanying string 125 is provided as the vibrating body has been described. However, the vibrating body is not limited to a string, and for example, a vibrating body (hereinafter referred to as a surface) having a vibrating surface simulating a drum or a cymbal may be provided. Hereinafter, the configuration of the “surface” and the control of the vibration will be described.
In the case where the surface is provided in the virtual space 100, it is only necessary to perform a physical simulation on the vibration surface during the interaction between the surface and the virtual particle 200 to generate sound data peculiar to the surface. Since the display of the virtual space 100 is two-dimensional, the surface may be displayed as a cross-sectional view of the surface. That is, for example, when a start point and an end point are specified in the virtual space 100, a straight line connecting the specified start point and the end point is a cross section of the surface, and the display screen of the surface and the virtual space 100 is orthogonal. What is necessary is just to provide a surface so that.
In the above embodiment, the case where the virtual particle 200 interacts with the associated string 125 has been described as passing through the associated string 125 without being repelled. However, in the interaction with the surface, the virtual particle 200 is A condition to bounce may be provided.

(8) In the above embodiment, the case where a string is attached to the operation string 120 has been described. However, an object different from the string may be provided. For example, instead of the associated string 125, an associated surface having the same characteristics as the “surface” described in the modification (7) may be provided in the same manner as the associated string 125.

(9) In the above embodiment, the case where the vibration of the associated string 125 is calculated by simulation of a physical model has been described. However, waveform data representing a string-specific sound may be stored in the ROM 103 in advance, and the waveform data may be read each time the virtual particle 200 and the associated string 125 collide. In that case, multiple types of waveform data are stored so that different waveform data can be selectively read for each string according to the characteristics of the string (string thickness, length, etc.), amplitude, pitch, etc. May be converted into pronunciation.

(10) In the above-described embodiment, the case where the virtual particle 200 passes through the associated string 125 even if it approaches the associated string 125 has been described. Similar to the action, collision and rebound may occur.

(11) In the above embodiment, the case where the virtual particle 200 freely falls according to the gravity set in the virtual space 100 has been described. However, a structure (regulator) that affects the motion of the virtual particle 200 may be provided in the virtual space 100.
FIG. 15 is an example of a screen display of the monitor 30 when the wall 160 which is an example of a regulatory body is disposed. When the user clicks the wall icon 405 at the bottom of the control panel 400 and then performs a drag operation, the control unit 101 displays a rectangular area with the start and end points of the drag operation as diagonal lines on the screen as a wall 160. For example, when the cursor 170 is dragged from 170 (a) to 170 (b) in the figure, the wall 160 (a) is set.
Further, when the cursor 170 is moved to the apex of the wall 160 that has been set and the button 22 is pressed and the mouse 20 is moved while the button is pressed, the cursor 170 moves with the center of gravity of the wall 160 as the center. The wall 160 is rotated. For example, when the cursor 170 is moved to the apex (the position of the cursor 170 (c)) of the wall 160 (c) and moved to the position indicated by the cursor 170 (d) while the button 22 is pressed, the wall 160 is moved to the wall 160 (c). It is rotated to the position indicated by (d).
When the same operation is performed with the cursor 170 positioned on the inner area of the wall 160, the wall 160 is moved as the cursor 170 moves. For example, when the cursor 170 is moved to the inner area of the wall 160 (e) (the position of the cursor 170 (e)) and moved to the position indicated by the cursor 170 (f) while the button 22 is pressed, the wall 160 is moved to the wall 160 (e). It is moved to the position indicated by 160 (f).
Further, when the wall 160 is double-clicked during the sound data generation process, the selected wall 160 may disappear.
By providing the restricting body in this way, it is possible to control the trajectory / existing position of the virtual particle 200 in various ways, and it is possible to generate various sound data based on the arrangement form of the restricting body.

(12) In the above-described embodiment, when the virtual particles 200 collide with each other and the framework of the virtual particles 200 and the virtual space 100 collide, the case where a complete elastic collision is performed with the rebound coefficient 1 is described. A value other than 1 may be used. That is, an inelastic collision with a rebound coefficient of 0 to 1 may be performed. Although it is contrary to the laws of nature, a value exceeding 1 may be used as the rebound coefficient when calculating the speed of each object after the collision.

(13) In the above embodiment, a case has been described in which a program for realizing a characteristic function of the sound data generation device 10 according to the present invention is written in the ROM 103 in advance, but a magnetic tape, a magnetic disk, a flexible The program may be recorded and distributed on a computer-readable recording medium such as a disk, optical recording medium, magneto-optical recording medium, RAM, ROM, etc., and the program is distributed by downloading via an electric communication line such as the Internet network. You may make it do.

It is the figure which showed an example of the screen display of the monitor 30 in a sound data generation process. 1 is a diagram illustrating an overall configuration of a sound data generation system 1. FIG. 1 is a diagram illustrating a configuration of a sound data generation device 10. FIG. FIG. 3 is a diagram showing the appearance of a mouse 20. It is the figure which showed the screen of the monitor. 4 is a diagram for explaining functions of a multipoint controller 40. FIG. 6 is a diagram showing an example of a screen display of a monitor 30. FIG. It is the figure which showed the screen display for setting a spatial characteristic. It is the figure which showed an example of the screen display of the monitor 30 in a sound data generation process. It is the flowchart which showed the flow of the initial setting process. It is the flowchart which showed the flow of the sound data generation process. It is the flowchart which showed the flow of the vibrating body setting process. It is a figure for demonstrating the movement of the operation string 120 and the accompanying string 125. FIG. It is the figure which showed an example of the time schedule of the movement of the operation string 120 and the accompanying string 125. FIG. It is the figure which showed the installation method of a control body.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Sound data generation system, 10 ... Sound data generation apparatus, 20 ... Mouse, 21 ... Main body, 22 ... Button, 23 ... Communication cable, 24 ... Movement detection means, 30 ... Monitor, 40 ... Multipoint controller, 41 ... Communication Cable, 42 ... Touch panel, 100 ... Virtual space, 101 ... Control part, 102 ... Optical disk playback part, 103 ... ROM, 104 ... RAM, 105 ... I / O part, 109 ... Bus, 120 ... String, 125 ... Attached string, 150 ... Sprinkler, 160 ... Wall, 170 ... Cursor, 200 ... Virtual particle, 400 ... Control panel

Claims (4)

Virtual space setting means for setting a virtual space;
Virtual particle emitting means for performing computation to continuously release virtual particles to the virtual space;
A trajectory computing means for computing the trajectory of each virtual particle emitted by the computation of the virtual particle emitting means, including the collision between the virtual particles;
Virtual sound generator setting means for setting a virtual sound generator in the virtual space;
Control means for controlling movement of the virtual sounding body;
When the virtual sounding body is moved by the control means, an accompanying sounding body control means for generating an accompanying sounding body based on the movement and moving the accompanying sounding body;
Sound data generating means for calculating an interaction between the virtual particle and at least one of the virtual sounding body and the accompanying sounding body and generating sound data based on the interaction Data generator.   The sound data generating apparatus according to claim 1, wherein the accompanying sound generator control means moves the accompanying sound generator along a movement path of the virtual sound generator. The accompanying sounding body control means generates a plurality of the accompanying sounding bodies and moves the accompanying sounding body,
The sound data generating means has different characteristics for each accompanying sounding body when calculating the interaction between each accompanying sounding body and the virtual particle by making the characteristics of the plurality of accompanying sounding bodies different from each other. The sound data generation apparatus according to claim 1, wherein the sound data generation apparatus generates a sound. Computer
Virtual space setting means for setting a virtual space;
Virtual particle emitting means for performing computation to continuously release virtual particles to the virtual space;
A trajectory computing means for computing the trajectory of each virtual particle emitted by the computation of the virtual particle emitting means, including the collision between the virtual particles;
Virtual sound generator setting means for setting a virtual sound generator in the virtual space;
Control means for controlling movement of the virtual sounding body;
When the virtual sounding body is moved by the control means, an accompanying sounding body control means for generating an accompanying sounding body based on the movement and moving the accompanying sounding body;
A program for calculating an interaction between the virtual particle and at least one of the virtual sounding body and the accompanying sounding body and generating sound data based on the interaction.

Images