JP4858777B2 - Sound data generating apparatus and program - Google Patents

Description

  The present invention relates to a sound data generation device and a program.

In recent years, more and more realistic sounds have been generated by computers. For example, a sound that accompanies a natural phenomenon such as a “river sound of a river” or a “breeze sound” can be reproduced very skillfully by a computer (see Patent Document 1).
Japanese Patent Application Laid-Open No. 07-140973

By the way, when the natural phenomenon of sound is seen on a large scale, it is grasped as an approximately constant phenomenon in accordance with the law of nature. Also in the above-mentioned Patent Document 1, sound is reproduced by repeatedly converting waveform data simulating sound in a natural phenomenon into sound.
However, it is clear from the example that the above-mentioned sound of the river breeze comes from the movement of many water molecules, and the sound of the breeze comes from the flow and vibration of many gas molecules in the air. As described above, most of the sounds generated in nature are generated by the frequent interaction of many particles when viewed on a small scale. Therefore, it is considered that the resulting sound has “randomness” and “non-reproducibility”, which give the sound “naturalness”.

  On the other hand, sound generated by a computer lacks the above-mentioned “randomness” and “non-reproducibility”, and even if the technique described in Patent Document 1, for example, is used, so-called “naturalness” is present. There was a problem that I couldn't feel it.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a sound data generation device and a program for generating natural sound by skillfully controlling the behavior of a large number of particles.

The sound data generation device according to the present invention includes a virtual space setting unit that sets a virtual space, a virtual particle setting unit that sets a plurality of virtual particles movable in the virtual space, and the virtual space in the virtual space. A regulating element generating unit that generates a regulating element that affects the movement of particles, an operating unit that is operated by an operator, an operation signal generating unit that generates an operation signal according to the operation content of the operating unit, and the operation Based on the operation signal generated by the signal generation means, the force setting means sets the force that works in common on the virtual particles existing in the virtual space, and the trajectory of each virtual particle is set by the force setting means. a trajectory calculation means for calculating including impact and the collision between the virtual particles to movement of the virtual particles by force and the restriction element is moved based on the calculation of the trajectory calculation means Serial and virtual particles, comprising a sound data generating means for generating sound data on the basis of the state of interaction with the regulating element, said force setting means, in parallel with generation of the sound data by the sound data generating means Then, the set force is updated based on the operation signal .

The force setting means sets a force that acts in common on the virtual particles corresponding to each position in the virtual space, and sets the setting for each position in the virtual space based on the operation signal. You may update the power that was given.
The operation signal generation means outputs an angle sensor that outputs a detection signal corresponding to the inclination of the operation means with respect to a reference posture, and a force instruction signal that indicates the direction and magnitude of the force according to the detection signal of the angle sensor. Signal generating means for generating may be provided, and the force setting means may set a force acting on the virtual space based on the force instruction signal.
The virtual space setting means sets a virtual space filled with a predetermined type of medium, and the force set by the force setting means is further determined based on the type of the medium, and the sound data The sound data generated by the generation unit may be further determined based on the type of the medium.
The force may be at least one of gravity, electrostatic force, magnetic force, and fluid resistance.

  Further, the sound data generation means, instead of sound data generation based on the interaction state of the virtual particles and the restriction element, or together with sound data generation based on the interaction state of the virtual particles and the restriction element, Sound data may be generated based on the interaction between the virtual particles according to the calculation of the trajectory calculation means.

Program according to the present invention, a computer, a virtual space setting means for setting a virtual space, a virtual particle setting means for setting a plurality of virtual particle moveable within the virtual space, in the virtual space, the virtual a restricting element generating means for generating a regulating element influencing the movement of the particles, and the operation signal generation means for generating an operation signal in accordance with operation content by the operator, based on the operation signal generated in said operating signal generating means the virtual particles and the force setting means for setting a force acting in common, the trajectory of each virtual particle, by the set force and the regulating element in the force setting means to the virtual particles present in the virtual space Te a trajectory calculation means for calculating including impact and the collision between the virtual particles to move, the virtual particles moving on the basis of the calculation of the trajectory calculation means The made to function as a sound data generating means for generating a sound data based on the state of the interaction with the regulatory elements, the force setting means, in parallel with generation of the sound data by the sound data generating means, and the setting The force is updated based on the operation signal .

  According to the sound data generation device or program according to the present invention, it is possible to generate natural sound by skillfully controlling the behavior of many particles.

(A: Outline of the present invention)
The sound data generation device according to the present invention causes a large number of virtual particles to be emitted into a virtual space formed by computer computation, and a restricting element that restricts the movement of the virtual particles is disposed in the virtual space. And the interaction between the control elements (collision situation, etc.) and the interaction between virtual particles, and sound data is generated based on the calculation result.

  FIG. 1 is an example of a monitor display in the sound data generation process. In the virtual space 100, conditions that affect the motion of the virtual particles 200, such as a sound wall 160 that is a virtual obstacle (regulatory element), are set. In addition, an angle sensor is connected to the sound data generation device, and spatial characteristics such as acceleration received by the virtual particles 200 are set according to information related to the inclination of the angle sensor.

  The virtual particles 200 are emitted from the throw-in area 110 into the virtual space 100. Each of the emitted virtual particles 200 moves according to the above-described regulatory element, the interaction (collision, etc.) between the virtual particles 200, the set spatial characteristics, and the like. As a result, a complicated motion of the virtual particle 200 is caused in the virtual space 100. When each moving virtual particle 200 interacts with the sound wall 160, sound data is generated based on the interaction.

(B: Configuration)
Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.

(B-1: Overall configuration)
FIG. 2 is a diagram showing the overall configuration of the sound data generation system 1 according to the present invention. The sound data generation system 1 includes a sound data generation device 10 as a program execution device, a mouse 20, an angle sensor 50, and a monitor 30.

(B-2: Configuration of each device)
First, the hardware configuration of the sound data generation device 10 will be described with reference to FIG.
The sound data generation device 10 includes a control unit 101, an optical disc playback unit 102, a ROM (Read Only Memory) 103, a RAM (Random Access Memory) 104, and an I / O unit 105. These units are connected to each other via a bus 109.

  The control unit 101 shown in the figure is, for example, a CPU (Central Processing Unit), and executes audio and video signal processing by executing various control programs read from an optical disk such as a ROM 103, CD-ROM, DVD-ROM, or the like. And control each part.

The optical disc playback unit 102 reads data from an optical disc such as a CD-ROM / DVD-ROM.
The ROM 103 stores a control program executed by the control unit 101.
The RAM 104 is used as a work area by the control unit 101.

The I / O unit 105 mediates transmission / reception of signals with the device connected to the sound data generation device 10. Specifically, a signal indicating the operation content from the mouse 20 and the angle sensor 50 is received and output to the control unit 101, and audio data and video data received from the control unit 101 are output to the monitor 30.
The above is the configuration of the sound data generation device 10.

  Next, the configuration of the mouse 20 will be described with reference to FIG. The mouse 20 has a button 22 on the upper surface (see (a) in the drawing) of the main body 21 and a movement detection means 24 on the lower surface (see (b) in the drawing). In addition, the mouse 20 is connected to the sound data generation device 10 via the communication cable 23, and data indicating the operation content is transmitted to the sound data generation device 10 via the communication cable 23.

  In the mouse 20, when the main body 21 is moved, the movement detection unit 24 generates an operation signal indicating the movement direction and the movement amount, and outputs the generated operation signal via the communication cable 23. The control unit 101 that has received the signal performs a process of moving the cursor on the screen of the monitor 30 based on the operation signal.

  When the button 22 is pressed (hereinafter referred to as “click”), the mouse 20 generates a click operation signal indicating that the click operation has been performed and outputs the click operation signal via the communication cable 23. Receiving the click operation signal, the control unit 101 recognizes the coordinate where the cursor is located at the time of clicking, and recognizes that the selection process has been performed on the icon or the like displayed at the coordinate.

  In addition, when the main body 21 is moved in a state where the button 22 is pressed and an operation for releasing the pressing of the button 22 (hereinafter, dragging) is performed, the moving direction and movement of the main body 21 while the button 22 is being pressed are moved. An amount and a signal indicating that a drag operation has been performed are generated and output via the communication cable 23. The control unit 101 that has received the signal recognizes that the selection process has been performed on the area on the screen selected by the drag operation, the icon included in the area, and the like.

  Next, the configuration of the monitor 30 will be described. The monitor 30 displays a video based on the video data received from the sound data generation device 10. As shown in FIG. 2, the monitor 30 has a sound data reproducing unit 30 a (see FIG. 2), and emits sound based on the sound data received from the sound data generating device 10.

  Next, the configuration of the angle sensor 50 will be described with reference to FIG. As shown in FIG. 5A, the angle sensor 50 includes a main body 51, a sensor unit 52, a signal generation unit 53, and a communication cable 54. The sensor unit 52 is a biaxial angle sensor, detects the inclination of the main body 51, and generates angle information indicating the angle of the inclination. The signal generation unit 53 calculates an inclination vector based on the angle information generated by the sensor unit 52, generates inclination information including the inclination vector, and outputs it from the communication cable 54.

  FIGS. 5B and 5C show the angle sensor 50 when the vertexes C and D of the main body 51 are lifted on the horizontal table Z and the angle that the surface ABCD makes with the table Z becomes θ. It is the figure seen from the drawing front and the left side in 5 (a). 5D and 5E show the angle sensor 50 when the vertexes A and D of the main body 51 are lifted on the horizontal table Z and the angle that the surface ABCD makes with the table Z becomes Φ. FIGS. 6A and 6B are views seen from the front and left sides of FIG. 5A, respectively.

  The sensor unit 52 detects the inclination of the surface ABCD based on the state in which the surface ABCD is placed horizontally. That is, the sensor unit 52 has an angle θ in which the surface ABCD is rotated in parallel with the surface BCGF as shown in FIG. 5B, and the surface ABCD is rotated in parallel with the surface ABFE as shown in FIG. The angle Φ is detected. In the present description, for the sake of simplification, the angles θ and Φ have been described independently. However, in the actual operation of the angle sensor 50, the rotation of the surface ABCD includes a component parallel to the surface BCGF and a parallel to the surface ABFE. Since both of the components are included, the sensor unit 52 generates angle information obtained by combining (θ, Φ) and outputs the angle information to the signal generation unit 53.

  The signal generation unit 53 generates an “inclination vector” based on the angle information received from the sensor unit 52. The inclination vector is a vertically-downward vector (however, a unit vector having a magnitude of 1) when the table Z is used as a reference, and the components in the directions of vertices A to B and vertices A to D of the angle sensor 50 are extracted. To generate. For example, in the example of FIGS. 5B and 5C, the generated gradient vector is (0, −sin θ). In the examples of FIGS. 5D and 5E, the generated gradient vector is (cosΦ, 0). “Inclination information” including the calculated inclination vector is output to the sound data generation device 10 via the communication cable 54.

(B-3: Configuration of control program)
Next, the configuration of the control program stored in the ROM 103 will be described with reference to FIG. The control program includes an object control program, a particle motion control program, a video control program, a sound data generation program, and the like that are executed by the control unit 101 of the sound data generation device 10 to generate sound data.

  The object control program controls the arrangement of regulatory elements (such as the sound wall 160) that affect the motion of the virtual particles 200 in the virtual space 100. The particle motion control program calculates the motion of the virtual particle 200 in the virtual space 100. The video control program displays on the screen of the monitor 30 the behavior of the virtual particles 200 in the virtual space 100 given as a calculation result. The sound data generation program generates sound data based on the interaction between the restriction element and the virtual particle 200.

(B-4; control of virtual space)
Hereinafter, control of the virtual space 100 by the object control program will be described.
FIG. 7 is a diagram illustrating an example of the screen of the monitor 30. On the screen, the framework of the virtual space 100 is displayed. A control panel 400 having various icons is displayed on the right side of the virtual space 100. The virtual space 100 is controlled as follows based on an operation on the control panel 400 by the user.

(1) Arrangement of Restriction Elements FIG. 8 is an example of a screen display of the monitor 30 when the sound wall 160 is arranged. When the user performs a drag operation after clicking the “sound wall” icon 400C at the bottom of the control panel 400, the control unit 101 uses the rectangular area having the start and end points of the drag operation as a diagonal line as a sound wall 160 on the screen. To display. For example, when the cursor is dragged from the position 40 (a) to the position 40 (b) in the figure, the sound wall 160 (a) is set.

  Further, when the button 22 is pressed while the cursor 40 is set at the apex of the sound wall 160 once set and the mouse 20 is moved as it is, the sound wall 160 moves the cursor 40 around its center of gravity. Rotate with it. For example, the cursor 40 is moved to the apex (the position of the cursor 40 (c)) of the sound wall 160 (c), and the cursor 40 is moved to the position indicated by the cursor 40 (d) while the button 22 is pressed. Then, the sound wall 160 (c) rotates to the position indicated by the sound wall 160 (d).

When the cursor 40 is moved to the inner area of the sound wall 160 and the same operation is performed, the sound wall 160 moves as the cursor 40 moves. For example, when the cursor 40 is moved to the position indicated by the cursor 40 (f) while the button 22 is pressed while the cursor 40 is moved to the internal area of the sound wall 160 (e) (the position of the cursor 40 (e)), The sound wall 160 moves to the position indicated by the sound wall 160 (f).
Further, when the sound wall 160 is double-clicked during sound data generation processing to be described later, the selected sound wall 160 disappears.

(2) Control of spatial characteristics In the virtual space 100, acceleration acting on the virtual space 100 is set as exemplified below. When the control unit 101 of the sound data generation device 10 receives the tilt information from the angle sensor 50, the control unit 101 reads the tilt vector included in the tilt information. Then, the acceleration is set in the virtual space 100 by causing the components in the vector AB direction and the vector AD direction in the inclination vector to correspond to the components from the upper left to the lower left and from the upper left to the upper right on the screen of the monitor 30.

Specifically, when the inclination vector received by the control unit 101 is (k _X , k _Y ), the virtual particle 200 has gk _X downward and gk right in the virtual space 100 displayed on the monitor 30. It is controlled so that the acceleration of _Y works. For example, when the angle sensor 50 is held as shown in FIG. 5B, inclination information of (0, −sin θ) is generated. The control unit 101 receives the tilt information and provides an acceleration having a magnitude of g sin θ in the virtual space 100 toward the left side of the screen. As a result, a force having a magnitude of mg sin θ (m: mass of the virtual particle 200) always acts on the virtual particle 200 in the left direction of the screen.

(B-5; Motion of virtual particles)
Below, the motion control of the virtual particle 200 by a particle motion control program is demonstrated.
(1) Appearance of Virtual Particle 200 First, the appearance of the virtual particle 200 will be described with reference to FIG. In the virtual space 100 according to the present embodiment, a throw-in area 110 is provided as a device for generating the virtual particles 200 in the virtual space 100.

  In the throw-in area 110, after the values of the initial speed 400A-2 and the frequency 400A-3 of the control panel 400 shown at the right end of the screen are written, the “throw-in area” icon 400A-1 is clicked, and then the framework of the virtual space 100 Is set by dragging. For example, when the user drags from the position (a) to the position (b) in the figure, the throw-in area 110 is set as shown in the figure. A plurality of throw-in areas 110 are provided by performing a plurality of the above operations.

  The throw-in area 110 throws individual virtual particles 200 into the virtual space 100 at a set initial speed. The throw-in frequency is set to the value written in the frequency 400A-3 per unit length and unit time of the throw-in area 110. However, it is randomly selected as to which part of the throw-in area 110 the virtual particle 200 is emitted from.

  The throw-in area 110 causes the virtual particles 200 to appear with an upper limit on the number of virtual particles 200 existing per unit area (hereinafter, pressure). That is, as shown on the right side of the virtual space 100 in FIG. 9, when the pressure in the region including the throwing area 110-2 surrounded by the sound wall 160 reaches a predetermined threshold value, the throwing area 110 further increases the virtual particles 200. Does not release.

(2) Motion of Virtual Particle 200 The particle motion control program stored in the ROM 103 controls the motion of the virtual particle 200 in the virtual space 100 according to rules (a) to (c) described below. The following rules imitate the mechanical properties and laws of objects on the earth.
(A) The virtual particle 200 has a predetermined volume (v) and mass (m).
(B) There is a relationship of F = mα between the force vector F acting on the virtual particle 200, the mass m of the virtual particle 200, and the acceleration vector α.
(C) When the virtual particles 200 collide, the framework of the virtual particles 200 and the virtual space 100, and the virtual particles 200 and the sound wall 160 collide with each other, a complete elastic collision is performed with a rebound coefficient of 1.

(3) Disappearance of Virtual Particle 200 In the framework of the virtual space 100, as shown in FIG. When the virtual particle 200 crosses the set region of the hole 130, the virtual particle 200 disappears (sucked into the hole). The hole 130 is set by clicking the “hole” icon 400B of the control panel 400 shown at the right end of the screen and dragging the framework of the virtual space 100. For example, when the “hole” icon 400B in FIG. 9 is clicked and then dragged from (c) to (d), the hole 130 is set as shown. When a plurality of holes 130 are provided, the above operation is performed for each of the plurality of holes 130.

  The hole 130 may be set so as to be provided inside the framework of the virtual space 100. In this case, the area of the hole 130 is set by a drag operation in the same procedure as that for setting the sound wall 160.

(B-6; Sound data generation)
The sound data generation device 10 generates sound data as described below by a sound data generation program stored in the ROM 103.
The control unit 101 generates sound data based on the interaction between the virtual particle 200 and the sound wall 160. At this time, sound data having a higher volume level is generated as the speed at which the virtual particle 200 collides with the sound wall 160 is higher. Further, sound data having a higher pitch is generated as the area of the sound wall 160 is smaller. These conditions mimic the acoustic characteristics commonly found in percussion instruments. For example, in a xylophone, the pitch is lower as the sound board is larger, and is higher as the sound board is smaller. By setting the acoustic characteristics of the sound wall 160 in this manner, the correspondence between the form of the sound wall 160 displayed on the monitor 30 and the collision state with the virtual particles 200 and the generated sound data is natural for the user. There is an effect to make.

  The sound data generation device 10 generates sound data using MAX / MSP according to the above rules. Note that MAX / MSP includes a music programming language MAX and an extension MSP for acoustic signal processing. According to MAX / MSP, various modules can be connected to create synthesizers, effectors, sequencers, etc., and music can be automatically generated by patching. Intuitive programming and operation through a visual programming environment Can do.

(C; operation)
Below, operation | movement of each part at the time of the sound data generation apparatus 10 producing | generating sound data is demonstrated. First, when the sound data generating apparatus 10 is turned on, the control unit 101 reads various control programs from the ROM 103 and loads them into the RAM 104. Subsequently, the control unit 101 receives a user instruction from the mouse 20 and performs an initial setting process.

(C-1: Initial setting process)
FIG. 10 is a flowchart showing the flow of the initial setting process. First, in step SA100, the sound wall 160 is set in the virtual space 100. When the “sound wall” icon 400C on the control panel 400 is pressed by the user and an area in the virtual space 100 is designated, the control unit 101 provides a sound wall 160 according to the input content.

  In step SA110, the control unit 101 sets a means for causing the virtual particles 200 to appear in the virtual space 100. After the parameters are written in the control panel 400 by the user, when the “throwing area” icon 400A-1 is clicked and an area in the virtual space 100 is designated, the throwing area 110 is set.

(C-2; sound data generation process)
When the above initial setting process is performed, the control unit 101 starts the sound data generation process. FIG. 11 is a flowchart showing the flow of sound data generation processing. A plurality of virtual particles 200 exist in the virtual space 100, and sound data generation processing is executed for each of the virtual particles 200.

  Prior to the description of the sound data generation process, the spatial characteristic setting process in the virtual space 100 under the control of the angle sensor 50 will be described. The spatial characteristic setting process is executed in real time in parallel with the sound data generation process, and new spatial characteristics are constantly updated.

  FIG. 12 is a flowchart showing the flow of the spatial characteristic setting process. When the user holds the main body 51 of the angle sensor 50 at a certain angle, angle information indicating the inclination of the angle sensor 50 is generated by the sensor unit 52 (step SC100). Next, an inclination vector is generated from the angle information generated in step SC100 by the signal generation unit 53 (step SC110), and is output to the sound data generation device 10 as inclination information. The control unit 101 sets an acceleration in the virtual space 100 with reference to the inclination vector included in the inclination information (step SC120). For example, when the inclination vector received by the control unit 101 is (0, −sin θ) generated in the situation of FIGS. 5B and 5C, the acceleration of g sin θ is set in the “left” direction of the virtual space 100. Is done.

  Incidentally, if it is assumed that an object of mass m is actually on the surface ABCD of the angle sensor 50 held as shown in FIGS. 5B and 5C, the force acting on the object is virtually The magnitude of mgsin θ is in the left direction of the space 100. As such, it is assumed that when the angle sensor 50 is held at a certain angle, the force acting on the virtual particle 200 in the virtual space 100 and an object of mass m are on the surface ABCD of the angle sensor 50. In this case, since the force acting on the object matches in size and direction, the user changes the inclination of the angle sensor 50 as if the virtual particle 200 is on the surface ABCD. The angle sensor 50 may be operated as in

  In FIG. 11 again, in step SB100, it is determined whether or not the particle density (pressure) at the discharge location of the throw-in area 110 is equal to or less than a threshold value. If the determination result of step SB100 is “Yes”, the process of step SB110 is performed. When the determination result of step SB100 is “No”, step SB100 is repeated until the determination result of step SB100 becomes “Yes”.

  In step SB110, the throw-in area 110 causes the virtual particles 200 to appear in the virtual space 100. Then, the processing from step SB120 onward is performed for each of the appearing virtual particles 200.

  In step SB120, the position and velocity of the virtual particle 200 after a minute unit time are calculated. At that time, the acceleration set by the control of the angle sensor 50 and the interaction with other objects are used for the calculation. When it collides with the wall of the virtual space 100, the sound wall 160, or other virtual particles 200, it rebounds with complete elastic collision, and a new velocity is set for the virtual particles 200. Further, when no collision occurs, the virtual particle 200 moves to a new position by multiplying the speed of the virtual particle 200 by a minute time.

  The virtual particles 200 are not only randomly emitted from the throw-in area 110 but also move under an acceleration condition that changes every moment according to the state of the angle sensor 50. In addition, a large number of virtual particles 200 are released from the throw-in area 110, and these virtual particles 200 repeat interaction with each other with high frequency. Therefore, even if various settings of the virtual space 100 are the same, different behaviors of the virtual particles 200 are caused each time.

  In step SB130, it is determined whether or not the virtual particle 200 disappears by entering the hole 130 by the process of step SB120. If the determination result in step SB130 is “Yes”, the virtual particle 200 is erased from the screen, and the process for the virtual particle 200 is terminated. When the determination result in step SB130 is “No”, the control unit 101 performs the processing after step SB140.

In step SB140, the control unit 101 determines whether or not the virtual particle 200 collides with the sound wall 160. If the determination result of step SB140 is “Yes”, the process of step SB150 is executed. If the determination result of step SB140 is “No”, the processes after step SB120 are executed again.
In step SB150, the control unit 101 generates sound data based on the collision state between the sound wall 160 and the virtual particles 200.
When step SB150 is completed, the processing after step SB120 is executed again for the virtual particles 200 that interact with the sound wall 160.

  In parallel with the above sound data generation process, the motion of the virtual particles 200 in the virtual space 100 is displayed on the monitor 30. Since the generated sound data is based on the display, the user can see the screen display corresponding to the sound that has been emitted as it is.

When the above sound data generation processing is completed, the control unit 101 outputs the generated sound data to the sound data reproduction unit 30a, and the sound data reproduction unit 30a reproduces the sound data. In addition, the control unit 101 forms and arrangements of various objects such as the virtual particle 200 emission means and the sound wall 160, and the spatial characteristics set in the virtual space 100 (time change of the acceleration vector set in the virtual space 100). For example, information on various parameters related to sound data generation (hereinafter referred to as setting information) is written in the RAM 104 for each trial.
Therefore, the control unit 101 can perform the sound data generation process again under the same condition setting by reading the setting information written in the RAM 104. Even if the sound data is generated again under the same condition setting as described above, the behavior of each virtual particle 200 is different each time, so that microscopically different sound data is generated.

(D: Modification)
As mentioned above, although embodiment of this invention was described, this invention can be implemented with a various aspect as follows.

(1) In the above embodiment, a computer that executes a program related to generation of sound data has been described. However, the present invention includes the program and a recording medium on which the program is recorded.

(2) In the acoustic processing in the above embodiment, an echo effect may be given to the sound emitted from the sound wall 160 that is repeatedly generated with a certain delay. In that case, the larger the area of the space in which the sound wall 160 is provided (corresponding to the volume in three dimensions), the larger the echo may be generated in the sound data generated by the collision.
In addition to echo, various acoustic effects such as reverberation effect where sound reverberates in space, chorus effect where sound phase, pitch and sound quality are slightly shifted and combined, distortion effect which distorts sound, etc. Thus, sound data as if the vibration of the sound wall 160 is occurring in various spaces may be generated. For example, it is possible to generate a reverberation like underwater or a reverberation like a concert hall. Which of these acoustic effects is selected, or the amount of the selected acoustic effect (ratio of applying the effect to the sound data) can also be set according to the shape of the restriction element such as the sound wall 160.

(3) In the above embodiment, the virtual particle 200 has been described as a sphere having a specific mass and volume. However, the user may be able to freely set the shape, size, and the like. Further, the case where each virtual particle 200 has uniform characteristics has been described. However, the characteristics may be changed for each virtual particle 200. For example, when a plurality of throw-in areas 110 are provided, the characteristics of the virtual particles 200 may be changed for each throw-in area 110 from which the virtual particles 200 are released. In that case, the display such as the color of the virtual particles 200 may be changed.

(4) In the above-described embodiment, the case where no sound is produced in the collision between the virtual particles 200 has been described. However, sound data may be generated by the collision between the virtual particles 200.

(5) In the above embodiment, the case where the user sets the sound wall 160, the throw-in area 110, and the like has been described. However, these objects may be set based on data stored in advance. Even in that case, since the angle sensor 50 is controlled in various ways by the user, the resulting sound is different each time.

(6) In the above embodiment, the case where only the throw-in area 110 and the sound wall 160 provided in the initial setting process are used in the sound data generation process has been described. good. In that case, the sound data generation process may be set by performing the same process as when those objects are set in the initial setting process.

(7) In the above embodiment, the throw-in area 110 has been described as a means for causing the virtual particles 200 to appear. However, the means for causing the virtual particles 200 to appear is not limited to these means. For example, there may be provided means for continuously releasing the virtual particles 200 in one direction from the tip, or means for appearing so that the virtual particles 200 spring out from one point and radiate to the surroundings. When these means are provided, randomness may be given to the release speed, release frequency, etc. of the virtual particles 200.

(8) In the said embodiment, the case where the appearance pattern of the virtual particle 200 which appears from the throw-in area 110 was random was demonstrated. However, the frequency and appearance location of the appearance pattern may be constant or may have a certain periodicity. Moreover, although the case where the initial velocity was uniform for every virtual particle 200 was demonstrated, you may give dispersion | variation between the virtual particles 200. FIG. In short, any parameter relating to the appearance of the virtual particles 200 may be given randomness so that the appearance pattern of the virtual particles 200 has randomness.

(9) In the above embodiment, the motion control of the virtual particles 200 mainly by controlling the acceleration (gravity field) has been described. However, the spatial characteristics that can be set in the virtual space 100 are not limited to acceleration. For example, a computer program may be created so that the virtual particles 200 are charged and an electric field is provided in the virtual space 100. In that case, the following embodiments are possible. In the initial setting process, a charge having a specified charge amount and form is provided in the virtual space 100. Then, the virtual particles 200 having the same or different charges as the charges are discharged from the throw-in area 110. When the virtual particle 200 approaches the provided charge, it undergoes a repulsive force or attractive force to cause a complicated movement. Further, the virtual particles 200 may be magnetized, and a magnetic field may be provided in the virtual space 100.

  Further, a means for changing the shape of the framework of the virtual space 100 or a means for causing the virtual space 100 to be distorted may be provided. For example, a “dent” that causes distortion in the space may be provided at a specific position in the virtual space 100, and an attractive force may act on the recess and the virtual particle 200, so that the virtual particle 200 “rolls” into the recess. Further, as the virtual particle 200 moves, a resistance force opposite to the moving direction may be applied to the virtual particle 200. These processes may be performed in the initial setting process or may be performed in the sound data generation process.

(10) In the above embodiment, the case where the spatial characteristics (acceleration) of the virtual space 100 is controlled by controlling the inclination of the angle sensor 50 has been described. However, the means for controlling those spatial characteristics is not limited to the angle sensor 50. In the modification (9), spatial characteristics such as an electric field, a magnetic field, a dent, and a resistance force are described. However, various modes are possible for the control means for these spatial characteristics. As an example, the pressure sensor 60 shown in FIG. 13 and the operation panel 70 shown in FIG. 14 will be described.

  First, a control method using the pressure sensor 60 will be described. As shown in FIG. 13, the pressure sensor 60 includes a main body 61, a touch panel 62, a communication cable 63, and a touch pen 64. When the user presses the surface of the touch panel 62 with the tip of the touch pen 64, the touch panel 62 detects the pressed position and outputs the pressed position information indicating the position to the sound data generation device 10. The control unit 101 has means for associating the position on the surface of the touch panel 62 with the position in the virtual space 100, and selects the corresponding position in the virtual space 100 when receiving the pressed position information. The charge, magnetic material, or indentation shown in the modification (9) may be provided at the position or range in the virtual space 100 selected as described above.

  Next, a control method using the operation panel 70 will be described. As shown in FIG. 14, the operation panel 70 includes a main body 71, a button 72, a slider 73, a stick 74, and a communication cable 75. When the user presses the button 72, the slider 73 is slid, or the stick 74 is tilted, an operation signal indicating the operation content is output to the sound data generation device 10. The control unit 101 reads the number and timing of pressing the button 72 included in the received operation signal, the numerical value of the slider 73, the direction and angle of the tilt of the stick 74, and reflects them in the setting of the space characteristics in the virtual space 100.

  For example, when the acceleration is set in advance in a specific direction (for example, the lower direction of the screen) in the virtual space 100 and the setting is made such that the acceleration can be variously set, the slider 73 is slid. Thus, the magnitude of the acceleration may be adjusted in real time. Further, the magnitude and direction of such acceleration may be controlled by the magnitude and direction of the tilt of the stick 74. Further, each time the button 72 is pressed, the resistance force acting on the virtual particle 200 moving in the virtual space 100 changes in three stages, and the kind of medium filling the virtual space 100 may change. .

  As described above, the means for controlling the spatial characteristics is not limited to the angle sensor 50, and various modes are possible. As described in the modification (9), since various types of spatial characteristics can be controlled in the virtual space 100, a means for controlling the spatial characteristics may be used in accordance with the controlled spatial characteristics.

(11) In the above embodiment, the case where the virtual particles 200 are continuously released from the throw-in area 110 into the virtual space 100 has been described. However, an appropriate number of virtual particles 200 appear in advance at the start of the sound data generation process, and sound data is generated by controlling the movement of the limited number of virtual particles 200 with the angle sensor 50. Also good.

(12) In the above-described embodiment and modification, acceleration (gravity), electric force, magnetic force, resistance force by fluid, and the like are described independently, but a plurality of elements are provided in the virtual space 100 at the same time. It is also good.

(13) The medium that fills the virtual space 100 in the above embodiment is not limited to gas, and may be a liquid or a solid, or may be a vacuum. For example, when the medium filling the virtual space 100 is a liquid, the resistance acting on the moving virtual particle 200 is set to be larger than that in the case of gas, and an acoustic effect as if sound is transmitted in water is used as sound data. It may be given. At the same time, “buoyancy” calculated according to the volume of the virtual particle 200 and the density of the liquid filling the virtual space 100 may be reflected in the trajectory calculation of the virtual particle 200.

(14) In the above embodiment, the collision has been described as one aspect of the “interaction” between the virtual particles 200 and the sound wall 160 and the “interaction” between the virtual particles 200. However, the interaction between these objects is not limited to collision. For example, a force (attractive force, repulsive force, etc.) that works according to the distance between the virtual particles 200 may be set, and the control unit 101 may generate sound data based on the force. For example, when the virtual particles 200 are close to each other, and a repulsive force inversely proportional to the distance is set, when another virtual particle 200 passes through the vicinity of the virtual particle 200, The trajectory is bent by the repulsive force, but sound data representing the repulsive force that has worked at that time may be generated according to the magnitude of the repulsive force.

(15) In the above embodiment, the case where sound data is generated according to the interaction between objects provided in the virtual space 100 has been described. However, sound data may be generated even when there is no interaction between objects. For example, when the medium or the sound wall 160 that fills the virtual space 100 is an aggregate of particles such as the virtual particles 200 in the above embodiment, the particles vibrate in a steady state, for example. Sound data may be generated according to the above. In another example, sound data may be generated according to the total number of particles only by the presence of the particles.

(16) In the above embodiment, the sensor unit 52 has been described with reference to the case where the surface ABCD is in a horizontal state and the inclination from the basic posture is detected. However, the basic posture is in a horizontal state. Not limited. For example, the basic posture may be a state in which the surface ABCD of the angle sensor 50 is the lower surface and the surface ABCD is held vertically.

(17) In the above embodiment, the case where the rebound coefficient is 1 in the collision between the virtual particles 200, the wall of the virtual particle 200 and the virtual space 100, and the collision between the virtual particle 200 and the sound wall 160 has been described. The coefficient value is not limited to 1 as long as it is set to a desired value by the user.

(18) Although the case where both the mouse 20 and the angle sensor 50 are provided has been described in the above embodiment, only one of them may be provided as long as the processing described in the above embodiment can be performed.

It is the figure which showed an example of the screen display of the monitor 30 in the middle of sound data generation processing. 1 is a diagram illustrating an overall configuration of a sound data generation system 1. FIG. 1 is a diagram illustrating a configuration of a sound data generation device 10. FIG. FIG. 3 is a diagram showing the appearance of a mouse 20. It is a figure for demonstrating the function of the angle sensor. It is the figure which showed the structure of the control program. It is the figure which showed the screen of the monitor. It is a figure for demonstrating the arrangement | positioning method of a control element. It is a figure for demonstrating the installation method of the appearance means of the virtual particle. It is the flowchart which showed the flow of the initial setting process. It is the flowchart which showed the flow of the sound data generation process. It is the flowchart which showed the flow of the space characteristic setting process. FIG. 4 is a diagram showing a configuration of a pressure sensor 60. 3 is a diagram showing a configuration of an operation panel 70. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Sound data generation system, 10 ... Sound data generation apparatus, 20 ... Mouse, 21 ... Main body, 22 ... Button, 23 ... Communication cable, 24 ... Movement detection means, 30 ... Monitor, 40 ... Cursor, 50 ... Angle sensor, DESCRIPTION OF SYMBOLS 51 ... Main body, 52 ... Sensor part, 53 ... Signal generation part, 54 ... Communication cable, 60 ... Pressure sensor, 61 ... Main body, 62 ... Touch panel, 63 ... Communication cable, 64 ... Touch pen, 70 ... Control panel, 71 ... Main body , 72 ... button, 73 ... slider, 74 ... stick, 75 ... communication cable, 100 ... virtual space, 101 ... control unit, 102 ... optical disc playback unit, 103 ... ROM, 104 ... RAM, 105 ... I / O unit, 109 ... bus, 110 ... throw-in area, 130 ... hole, 160 ... sound wall, 200 ... virtual particles, 400 ... control panel

Claims (7)

Virtual space setting means for setting a virtual space;
Virtual particle setting means for setting a plurality of virtual particles movable in the virtual space;
In the virtual space, a restriction element generating means for generating a restriction element that affects the movement of the virtual particles,
An operation means operated by an operator;
Operation signal generating means for generating an operation signal according to the operation content of the operation means;
Force setting means for setting a force acting in common on the virtual particles existing in the virtual space based on the operation signal generated by the operation signal generating means;
A trajectory calculating means for calculating the trajectory of each virtual particle including the force set by the force setting means and the influence of the restricting element on the movement of the virtual particle and the collision between the virtual particles;
Comprising said virtual particles moving on the basis of the calculation of the trajectory calculation means, and a sound data generating means for generating sound data on the basis of the state of interaction with the regulating element,
The said force setting means updates the said set force based on the said operation signal in parallel with the production | generation of the sound data by the said sound data production | generation means . The sound data generation apparatus characterized by the above-mentioned . The force setting means sets a force commonly acting on the virtual particles corresponding to each position in the virtual space, and is set for each position in the virtual space based on the operation signal. The sound data generating device according to claim 1, wherein the force is updated . The operation signal generation means outputs an angle sensor that outputs a detection signal corresponding to the inclination of the operation means with respect to a reference posture, and a force instruction signal that indicates the direction and magnitude of the force according to the detection signal output by the angle sensor. Having signal generating means for generating,
The sound data generation device according to claim 1, wherein the force setting unit sets a force acting on the virtual space based on the force instruction signal. The virtual space setting means sets a virtual space filled with a predetermined type of medium,
The force set by the force setting means is further determined based on the type of the medium,
The sound data generated by the sound data generating means is further determined based on the type of the medium.
The sound data generation apparatus according to claim 1, wherein the sound data generation apparatus is a sound data generation apparatus. The sound data generation device according to any one of claims 1 to 4, wherein the force is at least one of gravity, electrostatic force, magnetic force, and fluid resistance. The sound data generating means may replace the sound data generation based on the interaction state between the virtual particle and the restriction element, or in combination with sound data generation based on the interaction state between the virtual particle and the restriction element. The sound data generation device according to any one of claims 1 to 5, wherein sound data is generated based on an interaction between the virtual particles according to an operation of an operation means. The computer,
Virtual space setting means for setting a virtual space;
Virtual particle setting means for setting a plurality of virtual particles movable in the virtual space;
In the virtual space, a restriction element generating means for generating a restriction element that affects the movement of the virtual particles,
Operation signal generating means for generating an operation signal according to the operation content by the operator;
Force setting means for setting a force acting in common on the virtual particles existing in the virtual space based on the operation signal generated in the operation signal generating means ;
A trajectory calculating means for calculating the trajectory of each virtual particle including the force set in the force setting means and the influence on the movement of the virtual particle by the restriction element and the collision between the virtual particles;
Wherein the virtual particles, sound data generating means for generating sound data based on the state of the interaction with the regulatory element which moves on the basis of the calculation of the trajectory calculation means
Function as
The force setting means updates the set force based on the operation signal in parallel with the generation of sound data by the sound data generation means.
A program characterized by that .

Images