JP2012195883A - Electronic music apparatus and signal process characteristic control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To control setting/changing of an audio signal process characteristic in a simple and intuitive manner according to user's operation on a two-dimensional display surface in which a parameter of audio signal is developed.SOLUTION: In the signal process characteristic control system, audio signals sL and sR are analyzed to acquire two parameters, which are developed on a two-dimensional plane (screen) Pn to be displayed on a touch panel 12. When points pa and pb on the two-dimensional plane Pn are touched, a specified parameter region Ar having a predetermined shape is set on the plane Pn to correspond to operation points pa and pb, and a predetermined signal process is applied in a parameter range corresponding to the set region Ar. Then when touch operation points pa and pb are rotated (Ac1), a predetermined signal process characteristic is changed. When one or more operation points pc, pd, ... are moved by a user in the specified parameter region Ar (Ac2-Ac5), the movement operations Ac2-Ac5 are detected and a predetermined signal process characteristic is controlled.

Description

  The present invention relates to a signal processing characteristic control system that develops audio signal parameters on a two-dimensional plane, applies predetermined signal processing to the audio signal in accordance with a user operation on the two-dimensional plane, and controls signal processing characteristics.

  Conventionally, an electronic music apparatus such as a music synthesizer has been subjected to signal processing for controlling the characteristics of an audio tone signal. For example, in Non-Patent Document 1, for a music synthesizer “MOTIF XF” of Yamaha Corporation, as such signal processing, for example, a bandpass filter (BPF) that allows only a predetermined frequency component to pass, A band-eliminating filter (BEF) or the like for attenuating only the region is shown, and these signal processing characteristics are generally controlled by specifying parameters by numerical values.

  Further, in an electronic music apparatus such as an audio apparatus, a localization position (referred to as “panpot” in this specification) for each frequency band in a supplied stereo audio signal is analyzed and displayed on a two-dimensional plane. A technique is also known. For example, in the characteristic display device of Patent Document 1, a localization position and a power level for each frequency band (band) are calculated from an input stereo signal, and a localization position-frequency two-dimensional plane is displayed. In the section, a figure having a size corresponding to the calculated power level is displayed at the localization position for each calculated frequency band.

  However, on the two-dimensional parameter display surface as shown in Patent Document 1, setting of signal processing characteristics such as a bandpass filter and a band eliminate filter as found in the music synthesizer of Non-Patent Document 1 (resonance setting, etc.) It is preferable to be able to perform this easily and intuitively, but no such proposal has been made so far.

Japanese Patent No. 3912386

“MOTIF XF Reference Manual”, Yamaha Corporation, 2010, pages 74-76 (http://www2.yamaha.co.jp/manual/pdf/emi/japan/synth/motifxf_ja_rm_a0.pdf)

  In view of such circumstances, the present invention sets and sets predetermined signal processing characteristics for an audio signal in a simple and intuitive manner in accordance with a user operation on a two-dimensional display surface on which audio signal parameters are expanded. It is an object of the present invention to provide a signal processing characteristic control system capable of performing control for changing the signal processing characteristic.

  According to one aspect of the present invention, signal analysis means (BL, BR; Fa) for analyzing the supplied audio signal (sL, sR) to obtain at least two parameters, and the obtained two parameters in two dimensions. Parameter display means (Ga; 12) that expands and displays on the plane [Pn (FIG. 3)], operation detection means (Ga; S1; 6) that detects user operations on the two-dimensional plane (Pn), and detection Region setting means (Ga; S2 = YES → S3) for setting and displaying a region (Ar) having a predetermined shape on the two-dimensional plane (Pn) corresponding to the user operation point (pa, pb), and the region Detection is performed by signal processing means (Ga, CL, CR; S3) for performing predetermined signal processing on a parameter range corresponding to (Ar) and a rotation operation (Ac1) of the outer edge (Ed) of the region (Ar). To have been And an electronic music apparatus (computer) comprising processing characteristic control means (Ga, CL, CR; S4 = YES → S5) for controlling the characteristic of signal processing, and the supplied audio signal The signal analysis step (BL, BR; Fa) for analyzing (sL, sR) to obtain at least two parameters, and the obtained two parameters are developed and displayed on a two-dimensional plane [Pn (FIG. 3)]. A parameter display step (Ga), an operation detection step (Ga; S1) for detecting a user operation on the two-dimensional plane (Pn), and a two-dimensional plane (pa, pb) corresponding to the detected user operation point (pa, pb) An area setting step (Ga; S2 = YES → S3) for setting and displaying an area (Ar) having a predetermined shape on (Pn), and a predetermined parameter range corresponding to the area (Ar) Signal processing characteristics are controlled in response to detection of a signal processing step (Ga, CL, CR; S3) for performing signal processing and a rotation operation (Ac1) of the outer edge (Ed) of the region (Ar). There is provided a signal processing characteristic control program (Claim 3) for causing a computer (electronic music apparatus) to execute a procedure comprising processing characteristic control steps (Ga, CL, CR; S4 = YES → S5). Note that the parentheses indicate reference symbols, terms, parts, and the like of the examples added for convenience of understanding, and the same applies to the following.

  According to another feature of the present invention, signal analysis means (BL, BR; Fa) for analyzing the supplied audio signal (sL, sR) to obtain at least two parameters, and the obtained two parameters in two dimensions Parameter display means (Ga; 12) that expands and displays on the plane [Pn (FIG. 3)], operation detection means (Ga; S1; 6) that detects user operations on the two-dimensional plane (Pn), and detection Region setting means (Ga; S2 = YES → S3) for setting and displaying a region (Ar) having a predetermined shape on the two-dimensional plane (Pn) corresponding to the user operation point (pa, pb), and the region Signal processing means (Ga, CL, CR; S3) that performs predetermined signal processing on the parameter range corresponding to (Ar), and one to a plurality of points (pc, pd,...) In the region (Ar). Move operation (A 2, Ac 3,...), An electronic music apparatus (computer) comprising processing characteristic control means (Ga, CL, CR; S 6 = YES → S 7) for controlling signal processing characteristics in response to detection. 2), a signal analysis step (BL, BR; Fa) for analyzing the supplied audio signal (sL, sR) to obtain at least two parameters, and the obtained two parameters on a two-dimensional plane [ Pn (FIG. 3)] a parameter display step (Ga) to be developed and displayed on the display, an operation detection step (Ga; S1) to detect a user operation on the two-dimensional plane (Pn), and a detected user operation point ( an area setting step (Ga; S2 = YES → S3) for setting and displaying an area (Ar) of a predetermined shape on the two-dimensional plane (Pn) corresponding to pa, pb), and the set area ( r) a signal processing step (Ga, CL, CR; S3) for performing predetermined signal processing on the parameter range corresponding to r), and movement of one to a plurality of points (pc, pd,...) in the region (Ar). In accordance with the detection of the operation (Ac2, Ac3,...), A procedure comprising a processing characteristic control step (Ga, CL, CR; S6 = YES → S7) for controlling the characteristics of signal processing is performed by a computer (electronic music). A signal processing characteristic control program to be executed by the apparatus is provided.

  In the signal processing characteristic control system according to one aspect of the present invention (claims 1 and 3), at least two parameters are obtained by analyzing the supplied audio signal (sL, sR) (BL, BR; Fa). The obtained two parameters are developed and displayed on the two-dimensional plane [Pn (FIG. 3)] of the touch panel (12) (Ga). Here, when the user performs an operation on the two-dimensional plane (Pn), the user operation is detected (Ga; S1; 6), and the two-dimensional plane (corresponding to the detected user operation point (pa, pb) ( An area (Ar) having a predetermined shape is set and displayed on (Pn) (Ga; S2 = YES → S3), and a predetermined signal is output for a parameter range (for example, a filter range) corresponding to the set area (Ar). Processing (for example, filter processing) is performed (Ga, CL, CR; S3). Further, when the user performs an operation (Ac1) for rotating the outer edge (Ed) of the area (Ar), the rotation operation (Ac1) is detected, and a signal processing characteristic (for example, resonance) is detected accordingly. (Ga, CL, CR; S4 = YES → S5).

  In the present invention, as described above, the audio signal (sL, sR) is analyzed to obtain at least two parameters (BL, BR; Fa), and the obtained parameters are developed on a two-dimensional plane [Pn (FIG. 3)]. The parameter area (Ar) having a predetermined shape is set and displayed on the two-dimensional plane (Pn) corresponding to the user operation point (pa, pb) (Ga; S2 = YES → S3). ), Predetermined signal processing is performed on the parameter range corresponding to the set area (Ar) (Ga, CL, CR; S3), and the outer edge (Ed) of the set area (Ar) is further rotated by the user. And (Ac1), the signal processing characteristics are changed (Ga, CL, CR; S4 = YES → S5). Therefore, according to the present invention, an audio signal in which parameters are developed on a two-dimensional plane by a simple and intuitive operation of setting a parameter area by an initial user operation and further rotating the outer edge of the set parameter area. On the other hand, a predetermined signal processing characteristic can be set and the set signal processing characteristic can be changed.

  In the signal processing characteristic control system according to another aspect of the present invention (claims 2 and 4), at least two parameters are obtained by analyzing the supplied audio signal (sL, sR) (BL, BR; Fa). The obtained two parameters are developed and displayed on the two-dimensional plane [Pn (FIG. 3)] of the touch panel (12) (Ga). Here, when the user performs an operation on the two-dimensional plane (Pn), the user operation is detected (Ga; S1; 6), and the two-dimensional plane (corresponding to the detected user operation point (pa, pb) ( An area (Ar) having a predetermined shape is set and displayed on (Pn) (Ga; S2 = YES → S3), and a predetermined signal is output for a parameter range (for example, a filter range) corresponding to the set area (Ar). Processing (for example, filter processing) is performed (Ga, CL, CR; S3). Further, when the user performs an operation (Ac2 to Ac5) for moving one to a plurality of points (pc, pd,...) In this area (Ar), the movement operations (Ac2 to Ac5) are detected, and accordingly Thus, the characteristics of signal processing (for example, the magnitude of resonance) are controlled (Ga, CL, CR; S6 = YES → S7).

  In the present invention, as described above, the audio signal (sL, sR) is analyzed to obtain at least two parameters (BL, BR; Fa), and the obtained parameters are developed on a two-dimensional plane [Pn (FIG. 3)]. The parameter area (Ar) having a predetermined shape is set and displayed on the two-dimensional plane (Pn) corresponding to the user operation point (pa, pb) (Ga; S2 = YES → S3). ), Predetermined signal processing is performed on the parameter range corresponding to the set area (Ar) (Ga, CL, CR; S3), and one or more points (pc, pd) are set by the user in the set area (Ar). ,... Are moved (Ac2 to Ac5), the signal processing characteristics are changed (Ga, CL, CR; S6 = YES → S7). Therefore, according to the present invention, a parameter area is set on a two-dimensional plane by a simple and intuitive user operation in which a parameter area is set by an initial user operation and one or more points are moved within the set parameter area. A predetermined signal processing characteristic can be set for the set audio signal, and the set signal processing characteristic can be changed.

It is a hardware block diagram of the electronic music apparatus by one Example of this invention. It is a functional block diagram of LR channel touch control (LR channel signal processing characteristic control) by one Example of this invention. An example of parameter two-dimensional display and operation on a touch panel according to an embodiment of the present invention will be described. It is a functional block diagram of multiple channel touch control (LR channel signal processing characteristic control) according to one embodiment of the present invention. An example of parameter display and operation of a plurality of channels in one embodiment of the present invention will be shown. It is a flowchart which shows the touchscreen process by one Example of this invention.

[Overview of system configuration]
FIG. 1 is a block diagram showing a hardware configuration example of an electronic music apparatus constituting a signal processing characteristic control system according to an embodiment of the present invention. An electronic music apparatus according to an embodiment of the present invention is a kind of computer having an electronic music information processing function, and typically a dedicated music device such as a music synthesizer or an electronic musical instrument is used. As shown in FIG. 1, the electronic music apparatus includes a central processing unit (CPU) 1, a random access memory (RAM) 2, a read only memory (ROM) 3, a storage device 4, a performance and setting operation detection circuit 5, a touch panel. A detection circuit 6, a display circuit 7, a sound source / effect circuit 8, a communication interface (I / F) 9, and the like are provided, and these elements 1 to 9 are connected to each other via a bus 10.

  The CPU 1 constitutes a data processing unit together with the RAM 2 and the ROM 3 and executes various information processing including signal processing characteristic control processing according to a predetermined control program including a signal processing characteristic control processing program. The RAM 2 is used as a work area for temporarily storing various data necessary for these processes, and the ROM 3 has various control programs including a signal processing characteristic control processing program for executing these processes. Various control data and the like are stored in advance.

  The storage device 4 includes a storage medium such as an HD (hard disk), an FD (flexible disk), a CD (compact disk), a DVD (digital multipurpose disk), a semiconductor memory such as a flash memory, and a drive device for the storage medium. Various music data such as an arbitrary control program, automatic performance data (MIDI), and audio data can be stored in an arbitrary storage medium. Further, the storage medium may be detachable or may be built in the electronic music device. The removable recording medium includes a USB memory.

  The performance and setting operation detection circuit 5 constitutes an operation input section together with an operation section 11 including a performance operation section such as a keyboard and a setting operation section (panel operation section) such as a switch, and operates the performance operation section or the setting operation section. Is detected, and performance operation information or setting operation information corresponding to the detected content is introduced into the data processing units (1 to 3). The setting operator is provided with a mode selection switch for selecting “LR channel touch control mode” or “multiple channel touch control mode” in signal processing characteristic control. The data processing unit generates actual performance information based on the performance operation information and sends it to the sound source / effect circuit 8 or performs various settings based on the setting operation information.

  The touch panel display 12 connected to the touch panel detection circuit 6 and the touch panel display circuit 7 includes display elements such as liquid crystal (LC), organic EL, and electronic paper, and touch sensors such as a capacitance type and a resistance film type. The methods of these display elements and touch sensors are not limited to these. Moreover, what can detect two or more points | pieces simultaneously is preferable. The touch panel display circuit 7 controls the display content of the display 12 according to a command from the CPU 1, and the touch panel detection circuit 6 detects a touch operation on the screen of the touch panel display 12 by determining an output signal of the touch sensor. The touch operation information corresponding to the detected content is introduced into the data processing unit.

  For example, in the signal processing characteristic control process, the parameters obtained by analyzing the audio tone signal processed by the sound source / effect circuit 8 are two-dimensionally displayed on the screen of the display 12 via the display circuit 7. The signal processing characteristic change instruction information based on the touch operation on the parameter-displayed screen can be displayed from the detection circuit 6 to the data processing unit, and the signal processing characteristic in the sound source / effect circuit 8 can be changed. Can be directed. In addition, various setting screens for setting various conditions necessary for musical tone generation such as performance and signal processing can be displayed on the display 12 to provide display assistance related to various settings.

  The sound source / effect circuit 8 includes a sound source unit, an audio input unit, and an effect circuit unit. The sound source unit is an audio musical tone based on actual performance information based on performance operation information and automatic performance data from the storage device 4 or the communication I / F 9. A signal is generated and supplied to the effect circuit unit, and the audio input unit supplies an audio tone signal based on audio data input from an external digital audio signal source such as the storage device 4 or the communication I / F 9 to the effect circuit unit. . The effect circuit unit includes a DSP, performs predetermined digital signal processing on the audio tone signal supplied from the sound source unit or the audio input unit, and outputs an audio tone signal with a predetermined effect to the sound system 13. The sound system 13 includes a D / A converter, an amplifier, a speaker, and the like, and generates a musical sound based on an audio musical sound signal output from the sound source / effect circuit 8.

  The communication I / F 9 includes a music-only wired I / F such as MIDI, a general-purpose short-distance wired I / F such as USB and IEEE1394, a general-purpose network I / F such as Ethernet (registered trademark), a wireless Lan, and Bluetooth (registered trademark). Including one or a plurality of general-purpose short-range wireless I / Fs, etc., and exchange music data such as MIDI performance data and audio data with other music devices, or control programs from external devices such as server computers, etc. Music data can be received and necessary data can be stored in the storage device 4. Various information can be exchanged with an external USB device through the USB I / F included in the general-purpose short-distance wired I / F, and a USB memory can be attached (connected) to the connection slot of the USB I / F. The USB memory is handled as a removable storage medium and is included in the storage device 4.

[LR channel touch control (LR channel signal processing characteristic control)]
An electronic music apparatus according to an embodiment of the present invention operates as a signal processing characteristic control system by executing signal processing characteristic control processing according to a signal processing characteristic control processing program, and at this time, an LR channel is controlled by a mode selection switch. Operates in touch control mode or multi-channel touch control mode. In the LR channel touch control mode, the audio signal of the LR channel processed by the sound source / effect circuit 8 is analyzed to obtain at least two parameters, and the obtained parameters are developed and displayed on the two-dimensional plane of the touch panel. According to a predetermined touch operation by the user, an area of a predetermined shape can be set on a two-dimensional plane, and LR channel signal processing characteristic control for performing predetermined signal processing on a parameter range corresponding to the area can be performed. The control is called “LR channel touch control”. FIG. 2 is a functional block diagram of LR channel touch control according to an embodiment of the present invention.

  In FIG. 2, stereo digital audio tone signals, that is, L (left) and R (right) channel signals sL and sR supplied from the sound source section or audio input section of the sound source / effect circuit 8 are input to the L and R channels, respectively. The L and R channel signals supplied to the FFT (fast Fourier transform) units BL and BR through the units AL and AR and subjected to the fast Fourier transform (FFT) in the FFT units BL and BR are controlled by signal processing characteristics. In the parts CL and CR, digital signal processing such as filter processing and effect processing is performed according to preset conditions. The L and R channel signals subjected to signal processing are respectively subjected to inverse fast Fourier transform (fast Fourier inverse transform, also called inverse FFT) in iFFT (inverse fast Fourier transform) portions DL and DR. Are output to the sound system 13 via the L and R channel output units EL and ER. (Note that the single reference symbols “s”, “A”, “B”, “C”, “D”, and “E” are input audio signal, channel input unit, FFT unit, and signal processing characteristic control, respectively. This is used to representatively show the unit, iFFT unit, and channel output unit.)

  In the LR channel touch control, the audio signals sL and sR input from the channel output units AL and AR of the LR are FFTed by the FFT units BL and BR, respectively, and components for each frequency are obtained. It supplies to the pot analysis part Fa. The frequency-panpot analysis unit Fa analyzes the volume and phase of L (left) and R (right) of each frequency component, and shows the relationship between the frequency and the panpot (meaning stereo location, also referred to as stereo panning). The frequency-panpot information representing the obtained frequency / panpot relationship is supplied to the two-dimensional display and characteristic designating unit Ga. The two-dimensional display and characteristic designating unit Ga displays the frequency-panpot characteristic indicated by the frequency-panpot information two-dimensionally on the screen of the touch panel 12, and in response to a user operation on this screen, the signal processing characteristic control unit CL, Specifies the characteristics of signal processing in CR. Then, the signal processing characteristic control units CL and CR control the frequency component characteristics of each channel so as to match the specified characteristics, and the frequency components whose signal processing characteristics are controlled are inverse FFTed by the iFFT units DL and DR. Then, it is returned to the audio signal and outputted from the channel output portions EL and ER of the LR. (Note that the single reference symbols “F” and “G” are used to represent the frequency-panpot analysis unit, the two-dimensional display, and the characteristic designation unit, respectively.)

  FIG. 3 shows an example of parameter two-dimensional display and operation on the touch panel in one embodiment of the present invention. As described above, the FFT units BL and BR and the frequency-panpot analysis unit Fa analyze the supplied audio signals sL and sR with respect to two parameters of frequency and panpot, and a two-dimensional display and characteristic designation unit Ga. Displays the analysis result two-dimensionally on the screen Pn of the touch panel display 12 as in the two-dimensional display example of the parameters shown in FIG. That is, regarding the supplied stereo audio signal, the pan parameter is analyzed as the first parameter, the frequency is analyzed as the second parameter, and the analyzed pan pot is displayed on the first axis (horizontal axis) in the horizontal direction on the two-dimensional display surface Pn. The frequency is displayed on the second axis (vertical axis) in the vertical direction.

  On the display screen Pn of the touch panel on which the two parameters are two-dimensionally displayed, a designated parameter area (“parameter area” or Also, simply referred to as “region”.) Ar is set, and a signal processing characteristic corresponding to the parameter value in the set region Ar can be designated. In addition, the designated parameter area Ar that has been set can be visually recognized by the user by displaying the outer edge (also simply referred to as “edge”) Ed as shown in the figure, or by changing the color and density in the area Ar. Displayed as you can. In this example, the area Ar is the inside of a circle whose diameter is two points pa and pb (small circles indicate the touch-on position) designated by the user's touch-on operation on the touch panel. Here, the shape of the designated parameter area Ar is not limited to a circle as shown in the figure, but is a quadrangle (rectangle, parallelogram, trapezoid, etc., for example, two opposing vertices are designated), an ellipse, a star, etc. An arbitrary shape may be used, and the number of operation points touched on the touch panel is not limited to two and may be three or more. For example, a polygon having three or more touched points as vertices may be used as the designated parameter area Ar. Then, the signal processing characteristic control units CL and CR are provided with predetermined filters and effectors for musical tone elements having the first parameter (for example, pan pot) and the second parameter (for example, frequency) existing in the set designated parameter area Ar. By applying this signal processing, a special musical sound effect is given.

Furthermore, as a user operation on the touch panel,
(1) A rotation operation (moving along the outer edge Ed) for rotating a plurality of operation points pa and pb (which may be arbitrary points on the outer edge Ed) designating the area Ar in a predetermined direction, Rotate the center)
(2) Touch one or more points in the area Ar, and perform a moving operation such as moving the touched point up and down, moving left or right, or changing (stretching) the distance between the two touched points. Thus, the characteristics of the filter and the effector are controlled.

  FIG. 3B shows an operation example for the touch panel, and FIGS. 3B and 1A show a plurality of user operation points touched to designate the parameter area Ar, for example, two points pa and pb. In this case, a rotation operation Ac1 is performed in which the rotation operation Ac1 is performed in such a manner that the rotation is performed in a predetermined direction along the outer periphery of the area Ar. In this case, for example, when a clockwise operation is performed, a value of a predetermined signal processing characteristic is increased, and when a counterclockwise operation is performed, the value is decreased (the reverse relationship is also established). Good). Here, the predetermined signal processing characteristics to be controlled are steep as the first signal processing characteristics if filter processing such as band-pass filter (BPF), band-eliminate filter (BEF), or the like is designated as signal processing. If the signal processing is effector processing, the control target differs depending on the type of effector. For example, if reverb is used, the reverb time (reverberation time) ) Etc.

  FIGS. 3B and 2B show a case where one or more touched points pc, pd,... Are further moved in the designated parameter area Ar. There are vertical movement, left-right movement, rotation, and interval change. For example, as shown in (2a), the operation points pa and pb specifying the parameter area Ar are pressed with a finger, and further, the point pc is touched within the area Ar to move the point pc up and down. Ac2 increases or decreases the first signal processing characteristics. Further, the second signal processing characteristic is increased or decreased by the left-right movement operation Ac3 that moves the operation point pc to the left or right. That is, a plurality of signal processing characteristics can be controlled by performing different types of movement operations Ac2 and Ac3 for one additional operation point pc in the designated parameter area Ar.

  Further, as shown in (2b), the first signal is obtained by the turning operation Ac2 of the two points pd and pe further touched in the designated parameter area Ar (the operation turning around the midpoint of the two points pd and pe). The processing characteristic) is increased or decreased, and the second signal processing characteristic is increased or decreased in the interval change (enlargement / reduction) operation Ac5 between the two points pd and pf. That is, a plurality of signal processing characteristics can be controlled by performing a moving operation for each of a plurality of further operation points in the designated parameter area Ar.

  In the LR channel touch control mode, an area moving operation or a touch and paste operation (see FIG. 5) described in the multi-channel touch control mode to be described later is performed on the specified parameter area Ar that has already been set. The area Ar can be moved or copied (copied) to an arbitrary position in the two-dimensional plane Pn, and signal processing characteristics corresponding to the parameter area after the movement or copied (copied) can be controlled.

  As described above, in the LR channel touch control mode of the signal processing characteristic control system according to one embodiment of the present invention, the audio signals sL and sR are analyzed to obtain at least two parameters (BL, BR; F) and obtain. The developed parameters are developed on the two-dimensional plane (screen) Pn and displayed on the touch panel 12 (Ga). Here, when a touch operation for designating the points pa and pb on the two-dimensional plane Pn is performed, a designated parameter area Ar having a predetermined shape is set on the plane Pn corresponding to the operation points pa and pb. Predetermined signal processing (for example, filter processing) is performed on a parameter range (for example, filter range) corresponding to Ar (Ga → CL, CR). Next, when the outer edge Ed of the designated parameter area Ar is rotated (Ac1), predetermined signal processing characteristics (for example, the magnitude of resonance) are changed and controlled according to the rotation operation Ac1 (Ga → CL, CR). When one or more operation points pc, pd,... Are moved by the user within the designated parameter area Ar (Ac2 to Ac5), predetermined signal processing characteristics (for example, for example, according to the movement operations Ac2 to Ac5) The magnitude of resonance is changed and controlled (Ga → CL, CR).

[Multi-channel touch control (multi-channel signal processing characteristic control)]
As described above, the electronic music apparatus according to the embodiment of the present invention operates as a signal processing characteristic control system, and can operate in a multi-channel touch control mode by operating a mode selection switch. In the multi-channel touch control mode, a plurality of independent channels [LR (stereo) channel is one channel. When the audio signal is processed by the sound source / effect circuit, the audio signal of each channel is analyzed to obtain the parameters, and the obtained parameters are developed and displayed on the touch panel screen. According to the operation, it is possible to perform multi-channel signal processing characteristic control for performing predetermined signal processing on an arbitrary plurality of channels, and this control is called “multi-channel touch control”. FIG. 4 is a functional block diagram of multi-channel touch control according to one embodiment of the present invention.

  In FIG. 4, digital audio musical sound signals s1; s2; s3L, s3R; s4L, s4R of a plurality of channels, that is, the first to fourth channels ch1 to ch4 supplied from the sound source section or audio input section of the sound source / effect circuit 8 are After being supplied to the FFT unit B1; B2; B3L, B3R; B4L, B4R via the channel input unit A1; A2; A3L, A3R; A4L, A4R, respectively, the signal processing characteristic control unit C1; C2; C3L , C3R; Digital signal processing such as filter processing and effect processing is performed in accordance with preset conditions in C4L and C4R. The L and R channel signals subjected to the signal processing are subjected to inverse FFT in iFFT units D1; D2; D3L, D3R; D4L, D4R, respectively, and then first to fourth channel output units E1; E2; E3L, E3R. Output to the sound system 13 via E4L and E4R. (Note that the reference symbol “ch” is typically used to indicate a channel.)

  In the illustrated channel configuration example, monaural audio signals s1; s2 are input to the first and second channels ch1; ch2, respectively, and frequencies that are subjected to FFT in the FFT units B1; B2 and indicate components for each frequency. Information is obtained, and the obtained frequency information is supplied to the two-dimensional display and characteristic designating unit Gb as an analysis result of the audio signals s1; s2. On the other hand, for the third and fourth channels ch3; ch4, LR stereo audio signals s3L, s3R; s4L, s4R are input, and are respectively FFTed by FFT units B3L, B3R; B4L, B4R, and FFT Is further supplied to the frequency-panpot analysis unit F3; F4. Then, in the frequency-panpot analysis unit F3; F4, the volume and phase of the LR of each frequency component are analyzed to obtain the relationship between the frequency and the panpot, and the obtained frequency-frequency representing the panpot relationship- The panpot information is supplied to the two-dimensional display and characteristic designation unit Gb as the analysis results of the audio signals s3L, s3R; s4L, s4R.

  For the first and second channels ch1; ch2, the two-dimensional display and characteristic specifying unit Gb displays the frequency characteristics indicated by the frequency information from the FFT unit B1; B2 as an object on the screen of the touch panel 12 in a one-dimensional manner. For the third and fourth channels ch3 and ch4, the frequency-panpot analysis unit F3; the frequency characteristic, the panpot characteristic or the frequency-panpot characteristic indicated by the frequency-panpot information from F4 is displayed on this screen as an object. Display one-dimensionally or two-dimensionally. Furthermore, by setting a designated parameter area (Ar) in response to a touch-on operation on the screen of the touch panel 12, a channel ch to be controlled is selected and its parameter range is designated, and a signal processing characteristic control unit for the channel ch Specifies the characteristics of signal processing performed in C. Then, the signal processing characteristic control unit C controls the frequency component characteristic of the selected channel ch so as to match the specified characteristic, and the frequency component for which the signal processing characteristic is controlled is the iFFT unit D of the channel ch. The inverse FFT is performed to return to the audio signal, which is output from each channel output unit E.

  FIG. 5 shows a parameter display example and an operation example on the touch panel in one embodiment of the present invention. In the multi-channel touch control, display objects related to a plurality of audio channels (for example, ch1 to ch4) are arranged in one two-dimensional plane Pn by the two-dimensional display and characteristic designating unit Gb, and a certain channel (for example, , Ch4) is an object expressing two parameters in two dimensions, and the other channels (for example, ch1 to ch3) are objects expressing any one of the two parameters in one dimension.

  In the parameter display example of FIG. 5, only the fourth channel ch4 of the four channels is a two-dimensional object, and the remaining channels ch1 to ch3 are one-dimensional objects. However, the first and second channels ch1 and ch2 and the third channel ch3 are objects that represent different parameters (the first and second channels ch1 and ch2 are frequencies and the third channel ch3 is a panpot) in one dimension. is there. Here, only frequency analysis or characteristic control is performed for the first and second channels ch1 and ch2, and frequency and panpot analysis (F3) is performed for the third channel ch3. Only the pot direction (that is, the frequency axis has the same characteristic control over the entire area) is performed.

  In the multi-channel touch control, in order to control the signal processing characteristics for the plurality of channels ch1 to ch4, the touch-on operation similar to the region specifying operation described in the LR channel touch control is performed in the two-dimensional plane Pn by 1 A plurality of designated parameter areas Ar having a predetermined shape can be set.

  Here, as a feature of the multi-channel touch control, one parameter area Ar can be set across multiple channel objects. In the illustrated example, the designated parameter area Ar is set across the first and second channels ch1 and ch2, and the designated parameter area Ar is visually recognized by the user by displaying the outer edge Ed on the two-dimensional plane Pn. Can do.

  As another feature of the multi-channel touch control, the parameter area Ar set on the object of a certain channel is moved onto the object of another channel (Ar → Ar ′) or copied and pasted. (Ar → Ar ″), the characteristics of filters and effects set in a certain channel can be easily reflected in other channels.

  For example, regarding the movement of the area, as shown in the figure, the parameter area Ar that has already been set over the objects of the first and second channels ch1 and ch2 is the point where the user touches the outer edge Ed and touches it. Can be moved onto the objects of the other channels ch2 and ch4 by performing the area moving operation Ac6 that moves while maintaining the touch state. In this case, the original parameter area Ar disappears, and a new parameter area Ar ′ extending over the second and fourth channels ch2 and ch4 is set.

  On the other hand, for area copy and paste, for example, a menu display area for instructing copying (copying) is provided at the end of the screen Pn, and the finger of one hand of the user is placed on the outer edge Ed of the parameter area Ar. Touch the menu display area with the finger of the other hand in the touched state to instruct copy (copy), and then move the touched point on the outer edge Ed to the desired position and touch off. Copy and paste operation of area Ar [also simply referred to as “copy (copy) operation”. By performing Ac7, it is possible to copy (copy) onto the objects of the other channels ch3 and ch4. In this case, in addition to the already set parameter area Ar, a new parameter area Ar ″ is set on the third and fourth channels ch3 and ch4.

  In the multi-channel touch control mode, the touch point moving operation [FIG. 3B] in the area described in the LR channel touch control mode is performed for the parameter areas Ar, Ar ′, Ar ″. The signal processing characteristics corresponding to the areas Ar, Ar ′, Ar ″ can be changed and controlled.

  As described above, in the multi-channel touch control mode of the signal processing characteristic control system according to the embodiment of the present invention, the audio signals s1; s2; s3L, s3R; s4L, s4R of the multiple channels ch1 to ch4 are analyzed at least. One or more parameters are obtained (B1; B2; B3L, B3R, F3; B4L, B4R, F4), and the obtained parameters of the channels ch1 to ch4 are expanded on the two-dimensional plane (screen) Pn and displayed on the touch panel 12. When a touch-on operation is performed on the two-dimensional plane Pn, a designated parameter area Ar having a predetermined shape is set on the plane Pn corresponding to the touch-on operation point, and the channel ch corresponding to the set area Ar is set. Predetermined signal processing is performed on the parameter range to control the signal processing characteristics of the channel (Gb → ). In this case, the designated parameter area Ar can be set across a plurality of channels (for example, ch1 and ch2). Further, in response to the detection of the area movement operation Ac6 or the copy (copy) operation Ac7 for the designated parameter area Ar, the designated parameter area Ar is moved from the parameter display area of a certain channel (for example, ch1 and ch2) to another channel. (For example, ch2, ch4, or ch3, ch4) can be moved or copied (copied) to the parameter display area. If moved, the destination parameter is replaced with the designated parameter area Ar. When the designated parameter area Ar ′ is reset or copied, the designated parameter area Ar ″ as the copy destination is additionally set in addition to the designated parameter area Ar as the copy source.

[Example of processing flow]
FIG. 6 is a flowchart showing an example of touch panel processing executed in signal processing characteristic control processing of the electronic music apparatus according to one embodiment of the present invention. This touch panel processing is performed when two parameters of the LR channel are two-dimensionally displayed on the screen of the touch panel display 12 in the LR channel touch control mode or the multi-channel touch control mode (see FIG. 3A), or When parameters of a plurality of channels are displayed (see FIG. 5), the process is started by checking the touch panel 12 with a timer interruption every predetermined time, for example, every 1 μsec.

  In FIG. 6, when the touch panel process is started, the CPU 1 detects a touch operation by a user's operation finger such as touch-on, touch-off, and movement on the screen Pn of the touch panel 12 in Step P1, and in the next Step S2, the screen Pn is displayed on the screen Pn. It is determined whether or not a new parameter area Ar has been set by touch-on operation to a plurality of points. If the designated parameter area Ar has been set (S2 = YES), the process proceeds to step S3. In step S3, a designated parameter area Ar having a predetermined shape is displayed on the screen Pn of the touch panel 12 (multiple channel touch control mode: FIG. 3A, LR channel touch control mode: FIG. 5), and parameters corresponding to the area Ar. Signal processing parameters such as filter processing / effector processing in the signal processing characteristic control unit C are set so as to correspond to the range, and the signal processing characteristics are set to default values.

  When it is determined in step S2 that the designated parameter area Ar is not set by the touch-on operation (S2 = NO), or after the process of step S3, the process proceeds to step S4, and the edge Ed of the area Ar is set by the user operation. It is determined whether or not a “rotation” operation Ac1 that rotates along the edge Ed is performed with the finger touched. If such an operation is performed (S4 = YES), the process proceeds to step S5. In step S5, the value of the signal processing characteristic is changed so as to increase or decrease according to the rotation direction (see FIGS. 3B and 1).

  When it is determined in step S4 that the rotation operation of the designated parameter area outer edge Ed is not performed (S4 = NO), or after the process of step S5, the process proceeds to step S6. "Up / down / left / right movement" operation Ac2, Ac3 to move the operation point up or down or left or right, or rotate a plurality of operation points or change the interval between the plurality of operation points. It is determined whether or not the operations Ac4 and Ac5 have been performed. When these operations Ac2 to Ac6 are performed (S6 = YES), the process proceeds to step S7. In step S7, the value of the signal processing characteristic is changed so as to increase or decrease according to the direction of up / down / left / right movement, the rotating direction or interval of a plurality of points (see FIGS. 3B and 2).

  When it is determined in step S6 that no up / down / left / right movement, rotation of a plurality of points, or an interval changing operation has been performed (S6 = NO), or after the processing of step S7, the process proceeds to step S8, where It is determined whether or not an “area move” operation Ac6 is performed to move the edge Ed of the image to another point on the screen Pn in a state where the user's operation finger is touched, and such an area move operation Ac6 is performed. If so (S8 = YES), the process proceeds to step S9. In step S9, the display location of the area Ar is moved so that the touch point on the area outer edge Ed coincides with another point (see FIG. 5), and the parameter range corresponding to the moved area Ar ′ is accommodated. The signal processing parameters such as filter processing / effector processing in the signal processing characteristic control unit C are reset, and the signal processing characteristics are set to default values.

  When it is determined in step S8 that the area moving operation for moving the designated parameter area outer edge Ed has not been performed (S8 = NO), or after the process of step S9, the process proceeds to step S10 and other operations are performed on the touch panel screen Pn. It is determined whether or not a touch operation has been performed. If another touch operation has been performed (S10 = YES), the process proceeds to step S11, and processing corresponding to the other touch operation is performed.

  For example, as shown in FIG. 5, the edge Ed of the designated parameter area Ar is in a state of being touched by the user's operation finger, and a copy (copying) is instructed and then moved to another point on the screen Pn. When the & paste operation Ac7 is performed, the area Ar is copied (copied) to a place where the touch point on the area outer edge Ed coincides with another point, and a new designated parameter area Ar having the same size as the area Ar is created. For “newly set region Ar” (see FIG. 5), the signal processing parameters such as filter processing / effector processing in the signal processing characteristic control unit C are set so as to correspond to the corresponding parameter range. The signal processing characteristics are set to the same values as the copy source area Ar (S10 = YES → S11).

  When it is determined in step S10 that no other touch operation is performed (S10 = NO), or after the process corresponding to the other touch operation in step S11, the current touch panel process is terminated and the next timer Wait for interrupt.

[Various Embodiments]
The preferred embodiment of the present invention has been described above with reference to the drawings. However, this is merely an example, and the present invention can be variously modified without departing from the spirit of the invention. For example, for the electronic music apparatus, in the embodiment, a dedicated music device such as an electronic musical instrument is used. May be.

  In the embodiment, the example of the frequency and the panpot is shown as the parameter obtained by analyzing the audio signal. However, the present invention is not limited to this, and other parameters may be analyzed and obtained. In addition, other parameters may be obtained.

  Not only the two parameters are displayed on the two-dimensional plane Pn as in the embodiment, but a third parameter may be added and displayed. In this case, the third parameter may be displayed in a three-dimensional manner in a bird's-eye view along the third axis orthogonal to the first axis and the second axis, or the third parameter may be displayed on the two-dimensional plane Pn. In addition, it may be displayed in some form, for example, by expressing the display color or shade.

  In the embodiment, the designated parameter area (Ar) is moved and copied (duplicated) in either the LR channel touch control mode or the multiple channel touch control mode, but only in the multiple channel touch control mode. It may be.

s: sL, sR; s1; s2; s3L, s3R; s4L, s4R input audio signal,
A: AL, AR; A1; A2; A3L, A3R; A4L, A4R channel input section,
B: BL, BR; B1; B2; B3L, B3R; B4L, B4R FFT section,
C: CL, CR; C1; C2; C3L, C3R; C4L, C4R signal processing characteristic control unit,
D: DL, DR; D1; D2; D3L, D3R; D4L, D4R ifFT section,
E: EL, ER; E1; E2; E3L, E3R; E4L, E4R channel output section,
F: Fa; F3, F4 frequency-panpot analysis unit,
G: Ga; Gb two-dimensional display and characteristic designation section,
Pn 2D plane (parameter display screen),
pa, pb; pc; pd, pe User operation point,
Ar, Ar ′, Ar ″ A designated parameter area in which outer edges Ed, Ed ′, Ed ″ are displayed,
Ac1 to Ac7 Various user operations,
ch: ch1 to ch4 channel or its parameter display area (display object).

Claims (4)

Signal analysis means for analyzing the supplied audio signal to determine at least two parameters;
Parameter display means for expanding and displaying the two obtained parameters on a two-dimensional plane;
Operation detecting means for detecting a user operation on the two-dimensional plane;
An area setting means for setting and displaying an area of a predetermined shape on the two-dimensional plane corresponding to the detected user operation point;
Signal processing means for performing predetermined signal processing on a parameter range corresponding to the region;
An electronic music apparatus comprising processing characteristic control means for controlling characteristics of the signal processing in response to detection of a rotation operation of the outer edge of the area. Signal analysis means for analyzing the supplied audio signal to determine at least two parameters;
Parameter display means for expanding and displaying the two obtained parameters on a two-dimensional plane;
Operation detecting means for detecting a user operation on the two-dimensional plane;
An area setting means for setting and displaying an area of a predetermined shape on the two-dimensional plane corresponding to the detected user operation point;
Signal processing means for performing predetermined signal processing on a parameter range corresponding to the region;
An electronic music apparatus comprising processing characteristic control means for controlling characteristics of the signal processing in response to detection of one or more moving operations within the region. Analyzing the supplied audio signal to determine at least two parameters;
A parameter display step for expanding and displaying the obtained two parameters on a two-dimensional plane;
An operation detecting step for detecting a user operation on the two-dimensional plane;
A region setting step for setting and displaying a region of a predetermined shape on the two-dimensional plane corresponding to the detected user operation point;
A signal processing step for performing predetermined signal processing on a parameter range corresponding to the region;
A signal processing characteristic control program for causing a computer to execute a procedure comprising a processing characteristic control step for controlling the characteristic of the signal processing in response to detection of a rotation operation of the outer edge of the region. Analyzing the supplied audio signal to determine at least two parameters;
A parameter display step for expanding and displaying the obtained two parameters on a two-dimensional plane;
An operation detecting step for detecting a user operation on the two-dimensional plane;
A region setting step for setting and displaying a region of a predetermined shape on the two-dimensional plane corresponding to the detected user operation point;
A signal processing step for performing predetermined signal processing on a parameter range corresponding to the region;
A signal processing characteristic control program for causing a computer to execute a procedure including a processing characteristic control step for controlling the characteristic of the signal processing in response to detection of a movement operation of one or a plurality of points in the region.

Images