JP2023092583A - Information processing device, sound output device, information processing method and program - Google Patents

Abstract

To provide an information processing device, a sound output device, an information processing method and a program, which can achieve natural sound corresponding to a position of a user.SOLUTION: An information processing device includes a processing unit for adjusting a musical sound signal for outputting musical sound corresponding to depression of keys of a keyboard instrument from a sound output device worn and used by a user on the basis of the depressed key and position information related to a position of the sound output device. Thus, natural sound corresponding to the position of the user is realized.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device, a sound output device, an information processing method, and a program.

2. Description of the Related Art Conventionally, there is an information processing apparatus that supplies a musical sound signal corresponding to the depression of a key of a keyboard instrument such as an electronic piano to a sound output device such as a speaker, and causes the sound output device to output the musical sound corresponding to the depression of the key. known (for example, Patent Document 1). Some of such information processing apparatuses are capable of outputting musical sounds from wearable sound output devices (for example, headphones and earphones) that are worn by the user.

JP 2010-271436 A

However, when a wearable sound output device is used, the output position of the musical sound is fixed near the ear, so that the musical sound is heard in a constant way regardless of the position of the user with respect to the keyboard instrument, which may feel unnatural, Sometimes it feels monotonous.

SUMMARY OF THE INVENTION An object of the present invention is to provide an information processing device, a sound output device, an information processing method, and a program capable of realizing natural sound according to the user's position.

In order to solve the above problems, an information processing apparatus according to the present invention includes:
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. and a processing unit that adjusts based on .

Further, in order to solve the above problems, the sound output device according to the present invention includes:
A sound output device worn by a user and used,
a processing unit that adjusts a musical tone signal for outputting a musical tone corresponding to the depression of a key of a keyboard instrument, based on the depressed key and position information relating to the position of the device itself;
a sound output unit for outputting the musical sound based on the musical sound signal adjusted by the processing unit;
characterized by comprising

Further, in order to solve the above problems, an information processing method according to the present invention includes:
An information processing method executed by a computer provided in an information processing device,
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. , is adjusted based on.

Further, in order to solve the above problems, the program according to the present invention is
In the computer provided in the information processing device,
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. , to perform adjustment processing based on .

According to the present invention, it is possible to realize natural sound according to the position of the user.

1 is a diagram showing a musical sound output system; FIG. 1 is a block diagram showing the functional configuration of an electronic piano; FIG. 3 is a block diagram showing the functional configuration of headphones; FIG. FIG. 4 is a diagram illustrating a method of identifying the position of headphones; FIG. 4 is a diagram showing an example of the positional relationship between the position of a sound source and the position of headphones; FIG. 13 shows the panning volume factor as a function of the headphone y-coordinate, corresponding to the C7 key; FIG. 10 shows the absolute volume factor as a function of the headphone y-coordinate, corresponding to the C7 key; 4 is a flowchart for explaining a control procedure for musical tone output processing; 10 is a flowchart for explaining a control procedure of tone output processing according to Modification 1; FIG. 12 is a diagram showing delay times of output timings of musical tones according to Modification 2;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments according to the present invention will be described with reference to the drawings.

<Configuration of musical sound output system>
FIG. 1 is a diagram showing a musical sound output system 100 of this embodiment.
A musical sound output system 100 includes an electronic piano 1 (information processing device, keyboard instrument), and headphones 2a and 2b connected to the electronic piano 1 so as to enable wireless data communication. The headphone 2 is one aspect of a sound output device that is used by being worn on the user's head. In the following, a mode in which the user Ua uses the headphones 2a and the user Ub uses the headphones 2b to play duets on the electronic piano 1 will be described as an example. Also, when referring to any one of the headphones 2a and 2b, it is described as "headphone 2", and when referring to any one of the users Ua and Ub, it is described as "user U".

The electronic piano 1 includes a housing 10, an array antenna 17 provided in the housing 10, a keyboard 18, and the like. The array antenna 17 has a first antenna 171 and a second antenna 172 and is used for wireless signal transmission/reception with the headphones 2 . The keyboard 18 has a plurality of keys 181 including white keys and black keys. When a key 181 of the keyboard 18 is pressed by a user Ua or Ub, the electronic piano 1 outputs musical tones having a volume (loudness), pitch and tone color corresponding to the key pressing of the key 181 from the headphones 2a and 2b. A musical tone signal for making the music sound is transmitted to the headphones 2a and 2b.

The headphone 2 includes a left speaker 24L (first sound output section), a right speaker 24R (second sound output section), and a headphone antenna 26 used for wireless signal transmission/reception between the electronic piano 1 and the like. Prepare. The left speaker 24L outputs a musical tone (first musical tone) to the user's U left ear based on the first musical tone signal received from the electronic piano 1 . The right speaker 24R outputs a musical tone (second musical tone) to the right ear of the user U based on the second musical tone signal received from the electronic piano 1. FIG. Thus, the musical tone signals transmitted from the electronic piano 1 to the headphones 2 include the left channel first musical tone signal for outputting the musical tone from the left speaker 24L and the right channel first musical tone signal for outputting the musical tone from the right speaker 24R. A second tone signal for the channel is included. The headphone 2 is a stereo headphone that separately outputs musical tones from the left speaker 24L and the right speaker 24R based on the first musical tone signal and the second musical tone signal.

In the present embodiment, the y-axis is parallel to the arrangement direction of the keys 181 on the keyboard 18 (the long side direction of the housing 10) and in the direction from the key 181 on the bass side to the key 181 on the treble side. Also, on a plane passing through the y-axis and the headphone antenna 26, the axis orthogonal to the y-axis and extending from the electronic piano 1 to the seating positions of the users Ua and Ub is defined as the x-axis. Also, the origin O of the x-axis and the y-axis is assumed to be the middle point between the first antenna 171 and the second antenna 172 . Also, the position of the headphone antenna 26 in the xy plane is the position of the headphone 2 . The position of the headphone antenna 26 can be the position of one predetermined point (representative point) within the headphone antenna 26 . The positions of the headphones 2a, 2b are usually not on the same plane, and an xy plane is set for each of the headphones 2a and 2b. That is, the x-axis is set separately for each headphone 2 . Let the position of headphone 2a on the xy plane corresponding to headphone 2a be position P1 (x ₁ , y ₁ ), and the position of headphone 2b on the xy plane corresponding to headphone 2b be position P2 (x ₂ , y ₂ ). In FIG. 1, for convenience of explanation, the two xy planes corresponding to the headphones 2a and 2b are depicted as one xy plane without distinction (the same applies to FIGS. 4 and 5). Below, the position of the headphone 2 on the xy plane corresponding to an arbitrary headphone 2 is referred to as "position P". It is also assumed that the user U faces the -x direction, that is, the direction of the keyboard 18, and that the right speaker 24R of the headphone 2 is located on the +y direction side of the left speaker 24L.

In the musical sound output system 100 of this embodiment, the electronic piano 1 detects the positions P1 and P2 of the headphones 2a and 2b on the xy plane, and adjusts the musical sound signals to be transmitted to the headphones 2a and 2b according to the detected positions. . A method for adjusting the tone signal will be described later.

<Configuration of electronic piano>
FIG. 2 is a block diagram showing the functional configuration of the electronic piano 1. As shown in FIG.
The electronic piano 1 includes a CPU 11 (Central Processing Unit), a RAM 12 (Random Access Memory), a ROM 13 (Read Only Memory), a volume sensor 14, a pitch designation switch 15, a wireless communication section 16, and an array antenna 17. , a bus 19 and the like. Each part of the electronic piano 1 is connected via a bus 19 .

The CPU 11 is a processor that reads out and executes a program 131 stored in the ROM 13 and performs various arithmetic processing to control the operation of each part of the electronic piano 1 . The CPU 11 corresponds to a "processing section". Note that the processing unit may have a plurality of processors (for example, a plurality of CPUs), and the plurality of processors may perform the plurality of processes performed by the CPU 11 of the present embodiment. In this case, the multiple processors correspond to the "processing unit". In this case, multiple processors may be involved in common processing, or multiple processors may independently execute different processing in parallel.

The RAM 12 provides a working memory space for the CPU 11 and stores temporary data. RAM 12 may include non-volatile memory. Position data 121 (position information) relating to the position of the headphone 2 is stored in the RAM 12 .

The ROM 13 is a non-temporary recording medium readable by the CPU 11 as a computer. The ROM 13 stores the program 131 as well as data referred to when the program 131 is executed. The program 131 is stored in the ROM 13 in the form of computer-readable program code.

Volume sensor 14 detects the strength of key depression of key 181 and outputs a detection signal corresponding to the detected strength of key depression to CPU 11 . An unillustrated ADC (analog-to-digital converter) or a digital input port is provided between the volume sensor 14 and the bus 19 .

The pitch specifying switch 15 detects a depressed key 181 among a plurality of keys 181 included in the keyboard 18, and outputs to the CPU 11 a detection signal indicating the pitch of the tone of the key 181 whose depression is detected. . A digital input port (not shown) is provided between the pitch designation switch 15 and the bus 19 .

The wireless communication unit 16 includes a wireless IC having a modulation/demodulation circuit, a signal processing circuit, etc., and performs wireless communication with the headphones 2 via the array antenna 17 according to a predetermined communication standard. The communication standard can be, for example, Bluetooth (registered trademark), but is not limited to this. The wireless communication unit 16 modulates a musical tone signal for outputting a musical tone from the headphone 2 by frequency shift keying and transmits the modulated tone signal from the array antenna 17 . Further, when the array antenna 17 (the first antenna 171 and the second antenna 172) receives the position detection signal transmitted from the headphones 2 in a state modulated by frequency shift keying, the wireless communication unit 16 The received signal is demodulated to acquire and analyze a position detection signal to identify the position of the headphone 2 . At least part of the process of analyzing the position detection signal to specify the position of the headphone 2 may be executed by the CPU 11 . A method of detecting the position of the headphone 2 will be described later. A digital input/output port (not shown) for controlling data input/output to/from the wireless communication unit 16 is provided between the wireless communication unit 16 and the bus 19 .

Note that the components of the electronic piano 1 are not limited to those described above. For example, the electronic piano 1 may include setting buttons for setting tone colors of musical tones to be output in response to key depressions of the keys 181, and a display section for displaying settings made by the setting buttons.

<Headphone configuration>
FIG. 3 is a block diagram showing the functional configuration of the headphone 2. As shown in FIG.
The headphone 2 includes a CPU 21, a RAM 22, a ROM 23, a left speaker 24L having a signal conversion amplifier 241L and a coil 242L, a right speaker 24R having a signal conversion amplifier 241R and a coil 242R, a high frequency signal processor 25, A headphone antenna 26, a bus 27, and the like are provided. Each part of the headphone 2 is connected via a bus 27 .

The CPU 21 is a processor that reads out and executes a program 231 stored in the ROM 23 and performs various arithmetic processing to control the operation of each part of the headphone 2 . Note that the headphones 2 may have a plurality of processors (for example, a plurality of CPUs), and the plurality of processors may perform the plurality of processes performed by the CPU 21 of the present embodiment. In this case, multiple processors may be involved in common processing, or multiple processors may independently execute different processing in parallel.

The RAM 22 provides a working memory space for the CPU 21 and stores temporary data. RAM 22 may include non-volatile memory.

The ROM 23 is a non-temporary recording medium readable by the CPU 21 as a computer. The ROM 23 stores the program 231 as well as data referred to when the program 231 is executed. The program 231 is stored in the ROM 23 in the form of computer-readable program code.

The signal conversion amplifier 241L includes a DAC (digital-to-analog converter) that converts the digital musical tone signal input from the CPU 21 into an analog musical tone signal, and a headphone that amplifies the converted analog musical tone signal and outputs it as a drive current to the coil 242L. Equipped with an amplifier. A magnetic flux is generated by inputting a drive current to the coil 242L, and electromagnetic induction vibrates a magnetic core (not shown) and a vibrating portion connected to the magnetic core, thereby outputting a musical tone from the left speaker 24L. The structures and operations of the signal conversion amplifier 241R and the coil 242R of the right speaker 24R are the same as the structures and operations of the signal conversion amplifier 241L and the coil 242L, respectively.

The high-frequency signal processing unit 25 processes radio waves transmitted from the electronic piano 1 and detected by the headphone antenna 26 , converts them into digital musical tone signals, and outputs them to the CPU 21 . Specifically, the high-frequency signal processing unit 25 demodulates the received signal modulated by the frequency shift keying to restore it to a baseband signal, converts it to a digital musical tone signal by an ADC, and outputs it to the CPU 21 . Further, the high-frequency signal processing unit 25 modulates a position detection signal used to detect the position of the headphone 2 by frequency shift keying and transmits the modulated signal from the headphone antenna 26 .

<Operation of musical sound output system>
Next, the operation of the musical tone output system 100 will be described, centering on the operation of adjusting the musical tone signal according to the position of the headphone 2. FIG.

If the musical sound corresponding to the depressed key 181 of the electronic piano 1 is output from the headphone 2 as it is, since the output position of the musical sound is fixed near the ear, the user U (the ear of the user U) and the electronic piano 1 The way in which musical tones are heard (volume, etc.) is constant regardless of the positional relationship between the For this reason, it is difficult to reproduce natural sounds that change according to the positional relationship between the user U and the musical instrument, such as when playing an acoustic musical instrument.

Therefore, in the musical tone output system 100 of the present embodiment, the position of the headphone 2 is detected, and the musical tone signal to be transmitted to the headphone 2 is adjusted so that the sound becomes natural according to the detected position. Specifically, the musical tone signal is adjusted based on the pressed key 181 and the position data 121 relating to the position of the headphone 2 . The operation related to this adjustment will be described below.

FIG. 4 is a diagram explaining a method of identifying the position of the headphones 2. As shown in FIG.
FIG. 4 shows the positions of the first antenna 171 and the second antenna 172 on the xy plane, and the position P1 of the headphone 2a (headphone antenna 26). The first antenna 171 and the second antenna 172 are provided in different directions from the position P of the headphone 2a. When the distance between the position P1 of the headphone 2a and the first antenna 171 and the distance between the position P2 of the headphone 2a and the second antenna 172 are different, the radio wave of the position detection signal transmitted by the headphone antenna 26 is transmitted to the first antenna. Since the reception timings of 171 and the second antenna 172 are different from each other, the received radio waves have a phase difference corresponding to the difference in distance. Based on this phase difference, the angle θ of the direction from the origin O toward the position P1 of the headphones 2a from the x-axis (the direction of the headphones 2 viewed from the origin O) can be identified. Further, the strength of the radio wave of the position detection signal received by the first antenna 171 and the second antenna 172 decreases as the distance to the position P1 of the headphone 2a increases. Therefore, based on the strength of the radio waves received by the first antenna 171 and the second antenna 172 (for example, the average value of the strength of the reception by the first antenna 171 and the strength of the reception by the second antenna 172), the headphone 2a can be detected from the origin O. can specify the distance r to the position P1 of . Once the angle θ and the distance r are specified, the coordinates (x ₁ , y ₁ ) of the position P1 in the xy coordinate system can be specified. Similarly, the coordinates (x ₂ , y ₂ ) of the position P2 of the headphone 2b can also be specified. The identified positions (coordinates) of the headphones 2 a and 2 b are stored in the RAM 12 as the position data 121 . As described above, in the present embodiment, the position of the headphone 2 is determined based on the reception timing and reception strength of the position detection signal by the first antenna 171 and the reception timing and reception strength of the position detection signal by the second antenna 172 . is generated.

Once the position P1 of the headphones 2 is specified, the positional relationship between the sound source position corresponding to each key 181 of the keyboard 18 and the positions P1 and P2 of the headphones 2 in the position data 121 is specified.

FIG. 5 is a diagram showing an example of the positional relationship between the sound source position Ps and the position of the headphones 2. As shown in FIG.
In this embodiment, as the sound source position Ps corresponding to each key 181, the position of the string S of the grand piano GP corresponding to each key 181 is used assuming that the keyboard 18 is the keyboard of the grand piano GP. For example, as shown in FIG. 5, when the key 181C corresponding to the scale of "C7" on the high-pitched side is pressed, the string S corresponding to the key 181C of "C7" in the virtual grand piano GP is pressed. The position (for example, the position where the string S is hit by the hammer) is the sound source position Ps.

In this embodiment, the user Ua is sitting in front of the key 181C, and the y-coordinate of the position P1 of the headphone 2a used by the user Ua is equal to the y-coordinate of the sound source position Ps. Moreover, the user Ub is seated on the bass side of the user Ua, and the y coordinate of the position P2 of the headphone 2b used by the user Ub is on the -y direction side of the y coordinate of the sound source position Ps. do.

It is natural for the user U who uses the headphones 2 to hear musical tones that become quieter as they are farther from the sound source position Ps. More specifically, when the left and right ears are at different distances from the sound source position Ps, it is natural that the ear closer to the sound source position Ps hears the musical tone louder than the far ear. In order to reproduce such sound, the CPU 11 of the electronic piano 1 according to the present embodiment, when a certain key 181 is pressed, generates sound based on the sound source position Ps corresponding to the pressed key 181 and the position data 121. The musical tone signal is adjusted based on the positional relationship with the position P of the headphone 2. - 特許庁Specifically, the CPU 11 adjusts the tone signal so that the volume of the tone decreases as the distance between the sound source position Ps and the position P of the headphone 2 increases. Further, based on the position data 121, the CPU 11 specifies a first positional relationship between the sound source position Ps and the position of the left speaker 24L and a second positional relationship between the sound source position Ps and the position of the right speaker 24R, Based on the first positional relationship and the second positional relationship, the first musical tone signal (left channel) for the left speaker 24L and the second musical tone signal (right channel) for the right speaker 24R are adjusted. . Specifically, based on the first positional relationship, the CPU 11 generates the first musical tone signal so that the volume of the musical tone output from the left speaker 24L decreases as the distance between the sound source position Ps and the left speaker 24L increases. to adjust. The CPU 11 also adjusts the second musical tone signal based on the second positional relationship so that the volume of the musical tone output from the right speaker 24R decreases as the distance between the sound source position Ps and the right speaker 24R increases. .

Specifically, as shown in FIGS. 1 and 5, the case where the key 181C corresponding to the scale of "C7" on the high-pitched side is pressed will be described as an example.
Since the headphones 2a at the position P1 have the same y-coordinate as the sound source position Ps, the musical tone signals are adjusted so that musical tones of the same volume can be heard from the left speaker 24L and the right speaker 24R.
On the other hand, since the headphone 2b at the position P2 is located on the -y direction side of the sound source position Ps, the left speaker 24L is farther from the sound source position Ps than the right speaker 24R. Therefore, the musical tone signal is adjusted so that the volume of the musical tone output from the left speaker 24L is smaller than the volume of the musical tone output from the right speaker 24R.

Adjustment of the volume of the left and right musical tone signals is performed by multiplying the volume of the elements included in the musical tone signal by a panning volume coefficient. In the example shown in FIG. 5, for the headphone 2a at the position P1, the same panning volume coefficient is multiplied by the first musical tone signal of the left channel and the second musical tone signal of the right channel. For the headphone 2b located at the position P2, the left channel first musical tone signal is multiplied by a smaller pan volume coefficient than the right channel second musical tone signal. As a result, the volume of the musical tone output from the left speaker 24L becomes smaller than the volume of the musical tone output from the right speaker 24R.

FIG. 6 shows the panning volume factor as a function of the headphone 2 y-coordinate, corresponding to key 181 of C7.
The dashed line in FIG. 6 indicates the panning volume factor applied to the left channel first tone signal, and the solid line indicates the panning volume factor applied to the right channel second tone signal. As shown in FIG. 6, when the y-coordinate matches the coordinate=y ₁ of the sound source position Ps corresponding to key 181C of "C7", the left and right channel panning volume factors are equal. Also, as the position of the y-coordinate moves away from _y1 , the difference between the pan volume coefficients of the left channel and the right channel increases. Thus, for headphones 2a with a y coordinate of y ₁ , the left and right panning volume factors are equal, and for headphones 2b with a y coordinate of y ₂ , the panning volume factor for the left channel is equal to the panning volume factor for the right channel. be smaller than
The pan volume coefficient data shown in FIG. 6 is generated in advance corresponding to each of the plurality of keys 181 included in the keyboard 18 and stored in the ROM 13 .

Also, in the example shown in FIG. 5, the headphone 2b at the position P2 is farther from the sound source position Ps than the headphone 2a at the position P1. Therefore, the musical tone signal is adjusted so that the volume of the musical tone output from the headphone 2b (average volume of the left and right musical tones) is smaller than the volume of the musical tone output from the headphone 2a (average volume of the left and right musical tones). be.

Absolute volume adjustment is performed by multiplying the volume of the tone signal by an absolute volume coefficient. In the example shown in FIG. 5, the musical tone signal output to the headphone 2b is multiplied by a smaller absolute volume coefficient than the musical tone signal output to the headphone 2a. As a result, the volume of the musical tone output from the headphone 2b becomes lower than the volume of the musical tone output from the headphone 2a.

FIG. 7 shows the absolute volume coefficient as a function of the y-coordinate of the headphones 2, corresponding to the key 181 of C7.
As shown in FIG. 7, the absolute volume coefficient is largest when the y-coordinate coincides with the y-coordinate=y ₁ of the sound source position Ps corresponding to the key 181C of “C7”, and the y-coordinate is away from y ₁ . becomes smaller according to In FIG. 7, the difference in y-coordinate between the sound source position Ps and the position of the headphones 2 is regarded as the distance between the sound source position Ps and the position of the headphones 2. However, the present invention is not limited to this. The absolute volume coefficient may be determined according to the actual distance considering even the difference in the x-coordinate from the position of . That is, the horizontal axis of the graph in FIG. 7 may be the actual distance from the sound source position Ps on the xy plane.
The absolute volume coefficient data shown in FIG. 7 is generated in advance corresponding to each of the plurality of keys 181 included in the keyboard 18 and stored in the ROM 13 .

<Control Procedure for Musical Sound Output Processing>
Next, a control procedure by the CPU 11 for musical tone output processing for outputting musical tones from the headphones 2 will be described.
FIG. 8 is a flow chart for explaining the control procedure of the tone output process.
The musical tone output processing is executed in parallel for each of the headphones 2a and 2b.
When the tone output process is started, the CPU 11 of the electronic piano 1 determines whether it is time to detect the position of the headphone 2 (step S101). The detection timing of the position of the headphone 2 can be appropriately determined within a frequency range at which it is felt that the sound changes following the change in position or posture of the user U. For example, once every 0.1 second It may be about once per second. Note that when step S101 is executed for the first time (that is, when the pan volume coefficient and the absolute volume coefficient have not yet been acquired in steps S103 and S104 described later), the CPU 11 determines that it is time to detect the headphones 2. , branch to "YES" in step S101.

When it is determined that it is time to detect the position of the headphone 2 ("YES" in step S101), the CPU 11 causes the wireless communication unit 16 to detect the position of the headphone 2 using the algorithm described above, and the detected headphone 2 is detected. is acquired (step S102). Further, the CPU 11 stores the obtained data related to the position of the headphones 2 in the position data 121 . Moreover, the headphone 2 repeatedly transmits the position detection signal at such a frequency that the array antenna 17 can receive the position detection signal from the headphone 2 at the execution timing of step S102.

The CPU 11 acquires pan volume coefficients corresponding to each of the plurality of keys 181 based on the y-coordinate of the headphone 2 (step S103). For example, for the "C7" key 181C, the CPU 11 acquires values corresponding to the y-coordinate of the headphone 2 in the graph of the pan volume coefficient shown in FIG. 6 for each of the left channel and the right channel. Similarly, for each of the other keys 181, the panning volume coefficient corresponding to the y-coordinate of the headphone 2 is obtained for each of the left and right channels.

The CPU 11 acquires an absolute volume coefficient corresponding to each of the plurality of keys 181 based on the y-coordinate of the headphone 2 (step S104). For example, the CPU 11 acquires the value corresponding to the y-coordinate of the headphone 2 from the graph of the absolute volume coefficient shown in FIG. 7 for the key 181C of "C7". Similarly, for each of the other keys 181, we obtain the absolute volume coefficient corresponding to the headphone 2 y-coordinate.

When step S104 ends, or when it is determined in step S101 that it is not time to detect the position of the headphone 2 ("NO" in step S101), the CPU 11 shifts the process to step S105. Here, if the branched to "NO" in step S101, since steps S103 and S104 have already been executed at least once, the panning volume section finally acquired in step S103, and finally the pan volume section acquired in step S104. The obtained absolute loudness coefficient is retained and used for subsequent processing. In step S105, the CPU 11 determines whether or not each of the plurality of keys 181 of the keyboard 18 is in a depressed state. When the CPU 11 determines that the key 181 is not depressed ("NO" at step S105), it determines whether the tone volume is "0" (step S106). At step S106, the CPU 11 discriminates that the musical tone volume is not "0" if, for example, the damper pedal is depressed at the end of the key depression and the sound continues after the key depression ends. do. If it is determined that the tone volume is "0" ("YES" in step S106), the CPU 11 returns the process to step S101.

If it is determined in step S105 that the key is depressed ("YES" in step S105), or if it is determined in step S106 that the tone volume is not "0" ("NO" in step S106). , the CPU 11 synthesizes a musical tone corresponding to the key depression (the last key depression if the step S106 branches to "NO") (step S107). More specifically, the CPU 11 detects the key depression strength detected by the volume sensor 14 at the time of key depression, and the elapsed time from the start of key depression (if branched to "NO" in step S106, the elapsed time from the end of key depression). to specify the volume of the musical tone at that time, specify the musical tone of the pitch corresponding to the pressed key 181, and generate a musical tone signal of the musical tone having the specified volume and pitch of the sound. .

The CPU 11 multiplies the volume of the tone by the panning volume coefficient corresponding to the pressed key 181 among the panning volume coefficients acquired in step S103, The volume of the tone is multiplied by the absolute volume coefficient corresponding to 181 (step S108). As for the pan volume coefficient, the first tone signal of the left channel is multiplied by the pan volume coefficient of the left channel, and the second tone signal of the right channel is multiplied by the pan volume coefficient of the right channel. As a result, the element related to the volume of the musical tone in the musical tone signal is adjusted.

The CPU 11 causes the wireless communication section 16 to transmit the volume-adjusted tone signal to the headphones 2 (step S109). As a result, the left speaker 24L of the headphone 2 that has received the musical tone signal outputs a musical tone having a volume corresponding to the first musical tone signal of the left channel, and the right speaker 24R outputs a musical tone corresponding to the second musical tone signal of the right channel. Musical tones of volume are output.

The CPU 11 determines whether or not an instruction to terminate the tone output has been issued (step S110). For example, when the electronic piano 1 or the headphone 2 is operated to turn off the power, the CPU 11 determines that an instruction to end the musical tone output has been issued. If it is determined that an instruction to end the tone output has not been given ("NO" in step S110), the CPU 11 returns the process to step S101. The CPU 11 repeatedly executes the processes of steps S101 to S110 at a predetermined sampling period.

If it is determined that an instruction to end the tone output has been given ("YES" in step S110), the CPU 11 terminates the tone output process.

<Modification 1>
Next, Modification 1 of the above embodiment will be described. In the following, the points of difference from the above embodiment will be explained, and the explanation of the points in common with the above embodiment will be omitted.
In the above embodiment, the CPU 11 of the electronic piano 1 adjusts the musical tone signal based on the position of the headphone 2 , but in Modification 1, the CPU 21 of the headphone 2 adjusts the musical tone signal based on the position of the headphone 2 . In Modification 1, the CPU 21 of the headphone 2 corresponds to the "processing section".

FIG. 9 is a flow chart for explaining the control procedure of the tone output process according to Modification 1. As shown in FIG.
The musical tone output processing of FIG. 9 is executed by the CPU 21 of the headphone 2. FIG.
When the tone output process is started, the CPU 21 determines whether it is time to detect the position of the headphone 2 (step S201). The process of step S201 is the same as the process of step S101 in FIG.

When it is determined that it is time to detect the position of the headphone 2 ("YES" in step S201), the CPU 21 acquires position information relating to the position of the headphone 2 (step S202). The position of the headphones 2 may be specified by the wireless communication unit 16 and the array antenna 17 of the electronic piano 1 as in the above embodiment. Data is sent. Also, the position of the own device may be specified on the headphone 2 side. That is, the headphone 2 is provided with an array antenna similar to the array antenna 17 of the above embodiment, and the positional relationship between the headphone 2 and the electronic piano 1 is specified according to the reception of the position specifying signal transmitted from the electronic piano 1. , the position of the headphones 2 may be specified from the specified positional relationship.

The CPU 21 acquires pan volume coefficients corresponding to each of the plurality of keys 181 based on the y-coordinate of the headphone 2 (step S203). Also, the CPU 21 acquires an absolute volume coefficient corresponding to each of the plurality of keys 181 based on the y-coordinate of the headphone 2 (step S204). The processing of steps S203 and S204 is the same as the processing of steps S103 and S104 in FIG.

When step S204 has ended, or when it is determined in step S201 that it is not time to detect the position of the headphone 2 ("NO" in step S201), the CPU 21 determines whether or not the musical tone signal has been received from the electronic piano 1. (step S205). In the first modification, the electronic piano 1 transmits musical tone signals to the headphones 2 without adjusting the musical tone signals based on the position of the headphones 2 .

If it is determined that a musical tone signal has been received ("YES" in step S205), the CPU 21 selects the panning volume coefficient corresponding to the depressed key 181 from among the panning volume coefficients acquired in step S203 as the musical tone. Of the absolute volume coefficients obtained in step S204, the volume of the tone is multiplied by the absolute volume coefficient corresponding to the depressed key 181 (step S206). The processing of step S206 is the same as the processing of step S108 in FIG.

The CPU 21 supplies the volume-adjusted first musical tone signal to the left speaker 24L, and supplies the volume-adjusted second musical tone signal to the right speaker 24R to output musical tones (step S207).

The CPU 21 determines whether or not an instruction to terminate the tone output has been issued (step S208). If it is determined that an instruction to end the tone output has not been issued ("NO" in step S208), the CPU 21 returns the process to step S201. If it is determined that an instruction to terminate the tone output has been given ("YES" in step S208), the CPU 21 terminates the tone output process.

<Modification 2>
Next, Modification 2 of the above embodiment will be described. Modification 2 differs from the above embodiment in that the output timings of the musical tone signals respectively output from the left speaker 24L and the right speaker 24R of the headphone 2 are adjusted based on the position of the headphone 2. FIG. In the following, the points of difference from the above embodiment will be explained, and the explanation of the points in common with the above embodiment will be omitted. Modification 2 may be combined with Modification 1.

If the distance from the sound source position Ps to the right ear is different from the distance from the sound source position Ps to the left ear, strictly speaking, the timing at which the musical sound output from the sound source position Ps is heard differs between the left and right ears. In Modified Example 2, in order to reproduce this phenomenon, the CPU 11 increases the difference between the distance between the sound source position Ps and the left speaker 24L and the distance between the sound source position Ps and the right speaker 24R, the left speaker 24L and the right speaker 24R. 24R, the first tone signal of the left channel and the tone signal of the right channel are arranged so that the delay time of the output start timing of the tone from the one farther from the sound source position Ps with respect to the output start timing of the tone from the one closer to the sound source position Ps is longer. Adjust the second tone signal of the channel. Specifically, the phases of the left channel first musical tone signal and the right channel second musical tone signal are shifted so that the delay time described above occurs. As a method of specifying the positions of the left speaker 24L and the right speaker 24R, there is a method of separately specifying the positions by providing the headphone antennas 26 for the left speaker 24L and the right speaker 24R, respectively. Alternatively, the headphone 2 is provided with one headphone antenna 26 and a sensor for detecting the direction of the headphone 2, and the specified position of the headphone antenna 26 (representative position of the headphone 2) and the sensor detection result specified The positions of the left speaker 24L and the right speaker 24R may be derived based on the orientation of the headphones 2 and.

FIG. 10 is a diagram showing delay times of output timings of musical tones according to Modification 2. In FIG.
The horizontal axis of FIG. 10 is the difference between the distance from the sound source position Ps to the left speaker 24L and the distance from the sound source position Ps to the right speaker 24R. The difference may be a difference in distance in the y direction, or may be a value (difference in distance in the xy plane) in consideration of the difference in distance in the x direction. Moreover, the vertical axis of FIG. 10 is the above-described delay time.
As shown in FIG. 10, the output timings of the left and right musical tone times are adjusted so that the delay time increases in proportion to the difference in distance from the sound source position Ps to the left and right speakers.

It should be noted that, in modification 2 as well, the volume of musical tones output from the left speaker 24L and the volume of musical tones output from the right speaker 24R are adjusted based on the position of the headphone 2, as in the above-described embodiment. good.

<effect>
As described above, the electronic piano 1 as an information processing apparatus according to the present embodiment outputs musical sounds corresponding to the depression of the keys 181 of the electronic piano 1 from the headphones 2 worn by the user U. It has a CPU 11 that adjusts the signal based on the pressed key 181 and the position data 121 relating to the position of the headphone 2 . As a result, even when listening to the musical tones of the keyboard instrument using the headphones 2, it is possible to realize natural sound according to the position of the user U with respect to the keyboard instrument, just like when playing a live keyboard instrument. can.

Based on the position data 121, the CPU 11 also adjusts the tone volume component of the tone signal. As a result, even when listening to the musical tones of the keyboard instrument using the headphones 2, the headphones 2 can reproduce the musical tones with a natural volume corresponding to the position of the user U with respect to the keyboard instrument, just like when playing the keyboard instrument live. can be output from

The CPU 11 also adjusts the tone signal based on the positional relationship between the sound source position Ps corresponding to the pressed key 181 and the position of the headphone 2 based on the position data 121 . As a result, when the key 181 is pressed, the musical tone of the key 181 can be output with natural sound according to the positional relationship between the sound source position Ps corresponding to the key 181 and the position of the user U.

Further, the CPU 11 adjusts the tone signal so that the volume of the tone decreases as the distance between the sound source position Ps and the position of the headphone 2 increases. As a result, when the key 181 is pressed, a musical tone with a natural volume corresponding to the distance between the sound source position Ps corresponding to the key 181 and the position of the user U can be output.

The headphone 2 also includes a left speaker 24L for outputting the first musical sound to the left ear of the user U based on the first musical sound signal, and a second musical sound for the right ear of the user U based on the second musical sound signal. Based on the position data 121, the CPU 11 establishes a first positional relationship between the sound source position Ps and the position of the left speaker 24L, and a relationship between the sound source position Ps and the position of the right speaker 24R. A second positional relationship is specified, and the first musical tone signal and the second musical tone signal are adjusted based on the first positional relationship and the second positional relationship. As a result, it is possible to output natural sounds corresponding to the position of the user U from the left speaker 24L and the right speaker 24R of the stereo headphones.

Further, the CPU 11 adjusts the first musical tone signal based on the first positional relationship so that the volume of the first musical tone decreases as the distance between the sound source position Ps and the left speaker 24L increases, and the second musical tone Based on the positional relationship, the second musical tone signal is adjusted so that the volume of the second musical tone decreases as the distance between the sound source position Ps and the right speaker 24R increases. As a result, the volume of the musical tone output to the ear closer to the sound source position Ps corresponding to the key 181 can be made higher than the volume of the musical tone output to the distant ear. Therefore, like when playing a live keyboard instrument, according to the positional relationship between the sound source position Ps corresponding to the key 181 and the user U, it is possible to realize sound with a natural volume balance between the left and right ears. can be done.

Further, the CPU 11 according to Modification 2 determines that the difference between the distance between the sound source position Ps and the left speaker 24L and the distance between the sound source position Ps and the right speaker 24R is determined based on the first positional relationship and the second positional relationship. The delay time of the output start timing of the musical sound from the left speaker 24L or the right speaker 24R from the one farther from the sound source position Ps with respect to the output start timing of the musical sound from the one closer to the sound source position Ps increases as the delay time increases. The first tone signal and the second tone signal are adjusted. As a result, the output timing of the musical sound for the ear farther from the sound source position Ps corresponding to the key 181 can be delayed from the output timing of the musical sound for the near ear. Therefore, musical tones can be output to the left and right ears at natural timings according to the positional relationship between the sound source position Ps corresponding to the key 181 and the user U, just like playing a live keyboard instrument. can be done.

Further, the position data 121 includes information relating to the position of each of the plurality of headphones 2, and based on the position data 121, the CPU 11 generates a plurality of musical tone signals for outputting musical tones from each of the plurality of headphones 2, Adjustments are made based on information relating to the position of the corresponding headphone 2 among the position data 121 . As a result, each user U playing a duet and each headphone 2 used by a plurality of users U listening to the performance can output musical tones with natural sound according to the position of each user U.

Further, the CPU 11 includes a first antenna 171 and a second antenna 172 which are provided at positions facing different directions from the headphones 2 and receive position detection signals transmitted from the headphones 2 . The tone signal is adjusted based on the position data 121 generated based on the reception timing and reception intensity of the signal for position detection and the reception timing and reception intensity of the signal for position detection by the second antenna 172 . As a result, the position of the headphone 2 can be detected in real time, and the tone signal can be adjusted in real time so as to reflect the detected position.

Also, the headphone 2 as a sound output device according to the first modification is the headphone 2 worn by the user U and used, and is a musical sound signal for outputting a musical sound corresponding to the depression of the key 181 of the electronic piano 1. are adjusted based on the pressed key 181 and the position data 121 relating to the position of the device itself, and the left speaker 24L and the right speaker 24R output musical tones based on the musical tone signals adjusted by the CPU 21. And prepare. As a result, even when listening to the musical tones of the keyboard instrument using the headphones 2, it is possible to realize natural sound according to the position of the user U with respect to the keyboard instrument, just like when playing a live keyboard instrument. can. Further, by adjusting the musical tone signal on the headphone 2 side, the processing load on the CPU 11 of the electronic piano 1 can be reduced when the musical tone of the electronic piano 1 is output from a large number of headphones 2, for example.

Further, the information processing method according to the present embodiment is an information processing method executed by the CPU 11 as a computer provided in the electronic piano 1 as an information processing apparatus. A musical tone signal for outputting a musical tone corresponding to the depression of the key 181 of the piano 1 is adjusted based on the depressed key 181 and position data 121 relating to the position of the headphone 2 . As a result, even when listening to the musical tones of the keyboard instrument using the headphones 2, it is possible to realize natural sound according to the position of the user U with respect to the keyboard instrument, just like when playing a live keyboard instrument. can.

Further, the program 131 according to the present embodiment is stored in the CPU 11 as a computer provided in the electronic piano 1 as an information processing device, and the headphones 2 worn by the user U are used to press the keys 181 of the electronic piano 1. Based on the pressed key 181 and the position data 121 relating to the position of the headphone 2, a process of adjusting a musical tone signal for outputting a corresponding musical tone is executed. As a result, even when listening to the musical tones of the keyboard instrument using the headphones 2, it is possible to realize natural sound according to the position of the user U with respect to the keyboard instrument, just like when playing a live keyboard instrument. can.

<Others>
It should be noted that the descriptions in the above embodiments are examples of the information processing device, the sound output device, the information processing method, and the program according to the present invention, and are not limited to these.
For example, in the above embodiment, the electronic piano 1 was exemplified as the information processing device, but the present invention is not limited to this. The information processing device may be a device such as a PC (personal computer) provided separately from a keyboard instrument such as an electronic piano.

Also, the sound output device is not limited to the headphones 2 as long as it is used by being worn by the user. For example, the sound output device may be earphones, bone conduction speakers, or the like. Also, the attachment site is not limited to the head, and may be, for example, a neck speaker that is worn around the neck. Also, the left speaker 24L and the right speaker 24R are not limited to outputting musical tones directly to the left ear and right ear, respectively. For example, like the bone conduction speaker or neck speaker, the left speaker 24L outputs the first musical sound to the user's left ear, and the right speaker 24R outputs the second musical sound to the user's right ear. good too. Further, the present invention is not limited to a stereo method in which musical tones are output from left and right speakers based on separate musical tone signals, but may be a monaural method in which musical tones are output from left and right speakers based on the same musical tone signal.

Also, the keyboard instrument is not limited to the electronic piano, and may be any instrument having a keyboard. For example, the keyboard instrument may be an organ, an electone, an accordion, or the like.

Moreover, although the position of the string S corresponding to the key 181 in the virtual grand piano GP was illustrated as the sound source position Ps corresponding to the key 181, it is not restricted to this. For example, the position of the key 181 itself may be the sound source position Ps.

In the above embodiment, an example in which the volume of a musical tone is adjusted based on the position of the headphone 2 has been described. That is, the CPU 11 may adjust at least one of the tone volume, pitch, timbre, and output start timing of the musical tone signal based on the positional information about the position of the headphone 2 .

Further, in the above embodiment, the musical tone signal is adjusted for the purpose of reproducing natural (realistic) sound such as when playing an acoustic musical instrument, but the present invention is not limited to this. For example, when the user U moves his/her head (headphones 2) to perform a specific gesture, it may be possible to change the tone by operating parameters of a specific effector according to the gesture.

Also, the headphones 2 may be worn by listeners other than the player of the electronic piano 1 . Also, when the user U who is in the audience moves during the performance, the volume of the musical tones output from the headphones 2 may be adjusted according to the movement. Also, it is possible to realize a performance effect such that the overall pitch of the musical tones changes to modulate or change the timbre in accordance with the movement.

Further, the number of headphones 2 to which the electronic piano 1 transmits musical tone signals is not limited to two, and musical tone signals adjusted based on the position of each headphone 2 may be transmitted to three or more headphones 2. .

Also, in the above embodiment, an example in which the musical tone signal is transmitted by wireless data communication has been described, but the present invention is not limited to this, and the musical tone signal may be transmitted from the electronic piano 1 to the headphones 2 by wired data communication.

Moreover, the number of antennas that the array antenna 17 has is not limited to two, and the array antenna 17 has three or more antennas that are provided at different positions from the headphone 2 (headphone antenna 26). good too.

Further, in the above embodiment, as shown in FIG. 1, the headphone antenna 26 is provided in the headphone 2 at an intermediate position between the left speaker 24L and the right speaker 24R. A headphone antenna 26 may be provided on the left speaker 24L or the right speaker 24R.

In the above embodiment, the musical sound signal is adjusted based on the position of the headphone 2 on the xy plane passing through the y-axis and the headphone antenna 26. However, the present invention is not limited to this. The musical tone signal may be adjusted based on the coordinates on the horizontal plane when projected onto the plane parallel to the upper surface of the 18 keys 181 .

Further, in the above embodiment, on the premise that the user U faces the -x direction, that is, the direction of the keyboard 18, it is assumed that the right speaker 24R of the headphone 2 is located on the +y direction side of the left speaker 24L. , but not limited to this. For example, a sensor that detects the orientation of the headphone 2 is provided in the headphone 2, the orientation of the headphone 2 is identified based on the detection result of the sensor, and the positions of the left speaker 24L and the right speaker 24R are identified based on the identified orientation. You may

Further, although the example in which the position information related to the position of the headphone 2 is obtained based on the reception result of the position detection signal by the array antenna 17 has been described, the present invention is not limited to this. For example, information indicating whether the user U using the headphones 2 is on the left side or the right side may be used as the positional information of the headphones 2 during a duet. Also, when the audience uses the headphones 2 , the location of the audience's seat may be used as the position information of the headphones 2 .

Also, in the above description, an example of using the ROMs 13 and 23 as a computer-readable medium for the program according to the present invention has been disclosed, but the present invention is not limited to this example. As other computer-readable media, it is possible to apply information recording media such as HDDs, SSDs, flash memories, and CD-ROMs. A carrier wave is also applied to the present invention as a medium for providing program data according to the present invention via a communication line.

Further, it goes without saying that the detailed configurations and detailed operations of the constituent elements of the musical sound output system 100, the electronic piano 1, and the headphones 2 in the above embodiment can be changed as appropriate without departing from the scope of the present invention. be.

Although embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims originally attached to the application form of this application is additionally described below. The claim numbers in the appendix are as in the claims originally attached to the filing of this application.
[Appendix]
<Claim 1>
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. An information processing apparatus comprising: a processing unit that adjusts based on .
<Claim 2>
2. The processing unit adjusts, based on the position information, an element related to at least one of volume, pitch, timbre, and output start timing of the musical tone signal among the musical tone signals. The information processing device according to .
<Claim 3>
2. The processing unit adjusts the musical tone signal based on the positional relationship between the position of the sound source corresponding to the depressed key and the position of the sound output device based on the positional information. 3. The information processing device according to 2.
<Claim 4>
4. The information processing according to claim 3, wherein the processing unit adjusts the musical tone signal so that the volume of the musical tone decreases as the distance between the position of the sound source and the position of the sound output device increases. Device.
<Claim 5>
The sound output device comprises: a first sound output unit for outputting the first musical sound to the user's left ear based on the first musical sound signal; a second sound output unit that outputs the second musical sound to the right ear side,
The processing unit is
Based on the position information, a first positional relationship between the position of the sound source and the position of the first sound output section, and a second positional relationship between the position of the sound source and the position of the second sound output section are determined. identify,
adjusting the first musical tone signal and the second musical tone signal based on the first positional relationship and the second positional relationship;
5. The information processing apparatus according to claim 3, wherein:
<Claim 6>
The processing unit is
adjusting the first musical tone signal based on the first positional relationship so that the volume of the first musical tone decreases as the distance between the sound source position and the first sound output unit increases;
adjusting the second musical tone signal based on the second positional relationship so that the volume of the second musical tone decreases as the distance between the sound source position and the second sound output unit increases;
6. The information processing apparatus according to claim 5, characterized by:
<Claim 7>
Based on the first positional relationship and the second positional relationship, the processing unit determines the distance between the sound source position and the first sound output unit, and the distance between the sound source position and the second sound output unit. The greater the difference in the distances from the first sound output unit and the second sound output unit, the more likely the output of the musical sound from the one farther from the sound source position relative to the output start timing of the musical sound from the one closer to the sound source position. 6. An information processing apparatus according to claim 5, wherein said first musical tone signal and said second musical tone signal are adjusted so as to increase the delay time of output start timing.
<Claim 8>
the position information includes information relating to the position of each of the plurality of sound output devices;
Based on the position information, the processing unit generates a plurality of musical sound signals for outputting the musical sound from each of the plurality of sound output devices according to the position of the corresponding sound output device among the position information. 8. The information processing apparatus according to any one of claims 1 to 7, wherein each adjustment is made based on information.
<Claim 9>
A first antenna and a second antenna provided at positions with different directions from the sound output device and receiving a position detection signal transmitted from the sound output device,
The processing unit generates the position information based on the reception timing and reception strength of the position detection signal by the first antenna and the reception timing and reception strength of the position detection signal by the first antenna. ,
The information processing apparatus according to any one of claims 1 to 8, characterized by:
<Claim 10>
A sound output device worn by a user and used,
a processing unit that adjusts a musical tone signal for outputting a musical tone corresponding to the depression of a key of a keyboard instrument, based on the depressed key and position information relating to the position of the device itself;
a sound output unit for outputting the musical sound based on the musical sound signal adjusted by the processing unit;
A sound output device comprising:
<Claim 11>
An information processing method executed by a computer provided in an information processing device,
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. A method of processing information, characterized by adjusting based on .
<Claim 12>
In the computer provided in the information processing device,
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. A program characterized by executing a process of adjusting based on .

1 Electronic piano (information processing device, keyboard instrument)
10 housing 11 CPU (processing unit)
12 RAMs
121 location data (location information)
13 ROMs
131 Program 14 Volume sensor 15 Pitch designation switch 16 Wireless communication unit 17 Array antenna 171 First antenna 172 Second antenna 18 Keyboard 181, 181C Key 19 Buses 2, 2a, 2b Headphones (sound output device)
21 CPU (processing unit)
22 RAMs
23 ROMs
231 program 24L left speaker (first sound output unit)
24R right speaker (second sound output part)
241L, 241R Signal conversion amplifier 242L, 242R Coil 25 High-frequency signal processor 26 Headphone antenna 27 Bus 100 Musical sound output system GP Grand piano Ps Sound source position S Strings U, Ua, Ub User

Claims (12)

A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. An information processing apparatus comprising: a processing unit that adjusts based on . 2. The processing unit adjusts, based on the position information, an element related to at least one of volume, pitch, timbre, and output start timing of the musical tone signal among the musical tone signals. The information processing device according to . 2. The processing unit adjusts the musical tone signal based on the positional relationship between the position of the sound source corresponding to the depressed key and the position of the sound output device based on the positional information. 3. The information processing device according to 2. 4. The information processing according to claim 3, wherein the processing unit adjusts the musical tone signal so that the volume of the musical tone decreases as the distance between the position of the sound source and the position of the sound output device increases. Device. The sound output device comprises: a first sound output unit for outputting the first musical sound to the user's left ear based on the first musical sound signal; a second sound output unit that outputs the second musical sound to the right ear side,
The processing unit is
Based on the position information, a first positional relationship between the position of the sound source and the position of the first sound output section, and a second positional relationship between the position of the sound source and the position of the second sound output section are determined. identify,
adjusting the first musical tone signal and the second musical tone signal based on the first positional relationship and the second positional relationship;
5. The information processing apparatus according to claim 3, wherein: The processing unit is
adjusting the first musical tone signal based on the first positional relationship so that the volume of the first musical tone decreases as the distance between the sound source position and the first sound output unit increases;
adjusting the second musical tone signal based on the second positional relationship so that the volume of the second musical tone decreases as the distance between the sound source position and the second sound output unit increases;
6. The information processing apparatus according to claim 5, characterized by: Based on the first positional relationship and the second positional relationship, the processing unit determines the distance between the sound source position and the first sound output unit, and the distance between the sound source position and the second sound output unit. The greater the difference in the distances from the first sound output unit and the second sound output unit, the more likely the output of the musical sound from the one farther from the sound source position relative to the output start timing of the musical sound from the one closer to the sound source position. 6. An information processing apparatus according to claim 5, wherein said first musical tone signal and said second musical tone signal are adjusted so as to increase the delay time of output start timing. the position information includes information relating to the position of each of the plurality of sound output devices;
Based on the position information, the processing unit generates a plurality of musical sound signals for outputting the musical sound from each of the plurality of sound output devices according to the position of the corresponding sound output device among the position information. 8. The information processing apparatus according to any one of claims 1 to 7, wherein each adjustment is made based on information. A first antenna and a second antenna provided at positions with different directions from the sound output device and receiving a position detection signal transmitted from the sound output device,
The processing unit generates the position information based on the reception timing and reception strength of the position detection signal by the first antenna and the reception timing and reception strength of the position detection signal by the first antenna. ,
The information processing apparatus according to any one of claims 1 to 8, characterized by: A sound output device worn by a user and used,
a processing unit that adjusts a musical tone signal for outputting a musical tone corresponding to the depression of a key of a keyboard instrument, based on the depressed key and position information relating to the position of the device itself;
a sound output unit for outputting the musical sound based on the musical sound signal adjusted by the processing unit;
A sound output device comprising: An information processing method executed by a computer provided in an information processing device,
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. An information processing method, characterized by adjusting based on . In the computer provided in the information processing device,
A musical sound signal for outputting a musical sound corresponding to the depression of a key of a keyboard instrument from a sound output device worn by a user is generated from the depressed key and position information relating to the position of the sound output device. A program characterized by executing a process of adjusting based on .

Images