JP2003114677A - Apparatus and method for information processing and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To actualize multiple operation systems which need to be instantaneous like applications of video and music systems by using a keyboard and a track pad. SOLUTION: A swing box has a two-dimensional operation coordinate system composed of axes A and B, to which parameters are allocated respectively without overlapping with each other. The overall length of each axis corresponds to the maximum value from the minimum value of the allocated parameter. In response to coordinate indicating operation using a mouse or the track pad, the position of an effect point in the swing box moves and the effect balance itself which is applied to music being played also changes in real time.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and an information processing method for editing and playing back audio and other contents, and a storage medium, and more particularly to a keyboard, a mouse or other user input. The present invention relates to an information processing device and an information processing method, and a storage medium for interactively editing and playing sound and other contents using a device and enjoying the contents.

More specifically, the present invention combines a plurality of contents in response to user input via a keyboard, a mouse, or other user input device to interactively edit or reproduce sound or other contents. BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to an information processing device and an information processing method for enjoying, and a storage medium, and in particular, it immediately captures a user input from a user input device and interactively edits sound and other contents by combining a plurality of contents. The present invention relates to an information processing device, an information processing method, and a storage medium for playing back and enjoying.

[0003]

2. Description of the Related Art With recent advances in semiconductor technology and information technology, relatively inexpensive and high-performance computer systems called personal computers (PC) and workstations (WS) have become widespread. On this type of computer system, generally, various applications can be started under an execution environment provided by an operating system (OS).

The types of applications used on computer systems are wide-ranging, including word processors, spreadsheets, databases, communications, and graphics. For example, on a computer system with enhanced computing power and drawing functions, 2D
It is possible to relatively easily create and draw highly realistic graphics such as 3D or 3D, and perform image transformation processing. Alternatively, the sound contents can be edited by synthesizing and outputting a plurality of sound materials on the computer system, further synthesizing a sound effect (effect) with the sound material, and arranging the sound materials in time series. You can In addition, the edited audio content can be played back and enjoyed. Furthermore, when the edited audio content is played back, an image (including a moving image and a still image) that matches the musical tone can be displayed to further enhance the viewing effect.

Here, a personal computer (P
Consider the case of editing and reproducing audio contents on a general computer system such as C).

[0006] The audio content is composed of a plurality of "sound patterns", sound pieces such as "one-shot" such as percussion and shouts, and "effects" such as delays, echoes and other sound effects for these sound pieces. It consists of a performance layer. Then, the sound material of each performance layer is time-sequentially arranged, reproduced at the same time and synthesized, or the synthesized ones are time-sequentially arranged to further configure new acoustic content.

[0007] For example, when editing audio contents with a dedicated hardware device such as a DJ (disc jockey) player, an analog user such as a volume label is used for each parameter such as a voice unit or an effect.
Since the interface is prepared, it has excellent operability. Further, even during the performance / reproduction of the audio content, the operator, that is, the DJ, can correct / change the performance content in real time by operating the analog switch.

On the other hand, when the audio contents are edited by the personal computer, the user operation is based on a traditional user interface such as a mouse and a keyboard. This type of user interface is digital, and is not necessarily suitable for operating audio contents composed of a plurality of sound pieces. If you want to modify or change a voice unit or effect while playing or playing a song, first use the GUI (Grap
hical User Interface) Since the corresponding object on the screen can only be operated after it has been caught with the mouse cursor, it lacks real-time operation.

Further, when a plurality of effects are simultaneously applied to a certain audio content, an on / off switch is prepared for each effect pattern, or parameters of each effect pattern are played during performance. Must be changed by dragging with the mouse cursor. Although this kind of GUI operation is suitable for fine adjustment of parameters, it must be said that the real-time property of content operation is poor.

[0010]

SUMMARY OF THE INVENTION It is an object of the present invention to provide excellent information that enables interactive editing and reproduction of sound and other contents using a keyboard, mouse or other user input device. It is to provide a processing device, an information processing method, and a storage medium.

A further object of the present invention is to synthesize a plurality of contents or arrange them in time series in accordance with a user input via a keyboard, a mouse or other user input devices to produce sounds and other contents. It is to provide an excellent information processing apparatus and information processing method, and a storage medium that allow users to interactively edit and reproduce.

[0012] A further object of the present invention is to immediately capture user input from a user input device and synthesize a plurality of contents or arrange them in time series so as to interactively perform sound or other contents. An object of the present invention is to provide an excellent information processing apparatus, information processing method, and storage medium that can be edited and played back and enjoyed.

[0013]

The present invention has been made in consideration of the above problems, and a first aspect thereof is to provide a plurality of keys using an input device having a plurality of keys and a coordinate pointing device. An information processing apparatus or an information processing method for editing / reproducing content composed of layers, wherein at least one layer comprises a plurality of parameters, and key allocation means or steps for allocating the content to each key, and to each key. User input detecting means or step for detecting a user input operation, content output means or step for outputting content corresponding to the key in which the user input is detected, and parameter operation plane for operating parameters constituting the content. , The parameters that make up the content on the horizontal and vertical axes on the parameter operation plane Parameter assigning means or steps for assigning the coordinate pointing position of the coordinate pointing device to each of the parameter pointing planes in response to detection of a user input to a key assigned to a content including a plurality of parameters. Presetting means or step for presetting at a position corresponding to the parameter value,
Parameter changing means or step for changing the parameter values assigned to the horizontal axis and the vertical axis on the parameter operation plane according to the horizontal and vertical displacement amounts in the coordinate pointing device. And an information processing method.

Here, a user input device such as an input device having a plurality of keys and a coordinate pointing device has, for example, a device having a plurality of push-down keys such as a keyboard, a mouse, a track pad, a track point, and the like. A device having a coordinate designating function, and a game controller having various input means such as a push button and a joystick are included.

The contents handled by the information processing apparatus or the information processing method according to the first aspect of the present invention include, for example, a "pattern" which is a basic constituent element of a content such as a still image, a moving image, a sound, and the like. It is composed of layers such as "effects" that apply various active processes to contents, and "one-shot" consisting of short-time contents. A pattern is a content that is longer in time than one shot. If the content is voice, the pattern is called a "sound pattern"
Equivalent to a loop pattern piece. The sound content is a combination of one or more sound patterns or their repetitions, effects that add sound effects such as delays and echoes to each sound pattern, and one-shots consisting of short pieces of sound such as percussion and drums. It does not output continuously). Further, image contents such as a background movie which is output in accordance with the performance may be additionally provided.

Further, in the information processing apparatus or the information processing method according to the first aspect of the present invention, the parameter operation plane used for parameter operation has a two-dimensional operation coordinate system composed of a horizontal axis and a vertical axis. , The screen is displayed on the display. Further, the parameter assigning means,
Parameters that do not interfere with each other should be assigned to each axis of the operation coordinate system. Further, the total length of each axis of the parameter operation plane displayed on the screen corresponds to the minimum value to the maximum value of the assigned parameter.

The pointing point is displayed at a position corresponding to the current parameter value on the parameter operation plane, and the pointing point is moved according to the horizontal and vertical displacement amounts of the coordinate pointing device.

Further, the content output means or step changes the parameter for content output in response to the detection of the parameter changing operation by the parameter changing means or step.

The content handled by the information processing apparatus or the information processing method according to the first aspect of the present invention is, for example, an acoustic content, and the content is composed of a plurality of performance layers such as sound patterns, one shots, and effects. Become. Of these, the effect is composed of a plurality of parameters, and is composed of, for example, a basic tone effect which is the basic tone of the acoustic effect, and an effect balance which sets the balance of various elements constituting the effect.

In such a case, the parameter assigning means or step assigns a keynote effect to one of the parameter operation planes and effects to the other axis so that the horizontal axis and the vertical axis do not interfere with each other.
All you have to do is assign a balance.

The presetting means or step may preset the coordinate pointing position of the coordinate pointing device in response to detection of a user input to a key assigned to an effect. Also,
The parameter operation plane may be displayed on the display screen in response to the detection of the user input to the key assigned to the effect.

According to the information processing apparatus or the information processing method according to the first aspect of the present invention, it is possible to use a keyboard or a trackpad for a multiple operation system that requires immediacy such as an application of video system or music system. Can be realized.

That is, in response to a coordinate pointing operation with a mouse or a track pad, the position of the pointing point in the parameter operating plane moves, and the effect balance itself applied to the music being played is also changed in real time. be able to.

Further, the second aspect of the present invention is described such that the editing / reproducing process of the contents consisting of a plurality of layers is executed on the computer system by using the input device having a plurality of keys and the coordinate pointing device. A storage medium that physically stores the stored computer software in a computer-readable format, at least one layer comprising a plurality of parameters, the computer software comprising a key assignment step of assigning content to each key. A user input detecting step of detecting a user input operation on each key, a content output step of outputting a content corresponding to the key for which the user input is detected, and a parameter operation plane for operating a parameter forming the content Content on the horizontal and vertical axes of Parameter allocating step for allocating each parameter, and in response to the user input to the key allocated to the content consisting of a plurality of parameters being detected, the coordinate pointing position of the coordinate pointing device on the parameter operating plane is determined. Preset step to preset at the position corresponding to each parameter value,
A parameter changing step of changing the parameter values assigned to the horizontal axis and the vertical axis on the parameter operation plane according to the horizontal and vertical displacement amounts in the coordinate pointing device. It is a storage medium.

The storage medium according to the second aspect of the present invention is a medium for providing computer software in a computer-readable format to a general-purpose computer system capable of executing various program codes, for example.
Such media are, for example, CD (Compact Disc) and F
It is a removable and portable storage medium such as a D (Floppy Disk) or an MO (Magneto-Optical disc). Alternatively, it is technically possible to provide computer software to a specific computer system via a transmission medium such as a network (whether the network is wireless or wired).

Such a storage medium defines a structural or functional cooperative relationship between the computer software and the storage medium for realizing a predetermined computer software function on a computer system. Is. In other words, by installing the predetermined computer software in the computer system via the storage medium according to the second aspect of the present invention, the cooperative action is exerted on the computer system, and the second aspect of the present invention is achieved. The same effects as those of the information processing apparatus and the information processing method according to the first aspect can be obtained.

Further, the third aspect of the present invention is described such that the editing / reproducing process of the contents composed of a plurality of layers is executed on the computer system by using the input device having a plurality of keys and the coordinate pointing device. A computer program, wherein at least one layer comprises a plurality of parameters, a key assigning step for assigning contents to each key, a user input detecting step for detecting a user input operation for each key, and the user A content output step of outputting the content corresponding to the key whose input is detected, and a parameter allocation step of allocating each parameter configuring the content to a horizontal axis and a vertical axis on a parameter operation plane for operating a parameter configuring the content And a multi-parameter A preset step of presetting a coordinate pointing position of the coordinate pointing device to a position corresponding to each parameter value on the parameter operating plane in response to detection of a user input to a key assigned to the tents; A parameter changing step of changing the parameter values assigned to the horizontal axis and the vertical axis on the parameter operation plane according to horizontal and vertical displacements in the coordinate pointing device.・ It is a program.

A computer according to the third aspect of the present invention
The program defines a computer program written in a computer-readable format so as to realize a predetermined process on a computer system. In other words, by installing the computer program according to the third aspect of the present invention in the computer system, a cooperative action is exerted on the computer system, and the information processing according to the first aspect of the present invention is performed. It is possible to obtain the same effects as the device and the information processing method.

Further objects, features and advantages of the present invention are as follows.
It will be clarified by a more detailed description based on embodiments of the present invention described below and the accompanying drawings.

[0030]

BEST MODE FOR CARRYING OUT THE INVENTION The present invention uses a user input device such as a keyboard and a mouse (or a touch pad) on a general computer system such as a personal computer (PC) to perform user input in real time. By incorporating the contents in (1), a plurality of contents can be synthesized or arranged in time series so that the sound and other contents can be interactively edited and reproduced to be enjoyed. Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 schematically shows a hardware configuration of a computer system 100 capable of interactively editing and reproducing contents excellent in real time by applying the present invention. Each constituent module will be described below with reference to FIG.

A CPU (Central Processing Unit) 101, which is a main controller of the system 100, executes various applications under the control of an operating system (OS). The CPU 101 includes, for example, sound content such as "sound pattern", sound pieces such as "one-shot" such as percussion and shouts, and "effect" that gives delay, echo and other sound effects to these sound pieces. It is possible to execute audio content processing software for editing and reproducing. As shown in the figure, the CPU 101 uses the bus 10
8 interconnects with other devices (described later).

The memory 102 is a storage device used to store program codes executed by the CPU 101 and temporarily store work data being executed. The memory 102 shown in the figure should be understood to include both non-volatile and volatile memory.

The display controller 103 is C
It is a dedicated controller for actually processing the drawing command issued by the PU 101. The drawing data processed by the display controller 103 is once written in, for example, a frame buffer (not shown), and then displayed on the screen by the display 111.

The input device interface 104 is a device for connecting user input devices such as the keyboard 112 and the mouse 113 to the computer system 100. Of course, system 100 may be equipped with other forms of coordinate pointing device, such as a trackpad or trackpoint. This type of coordinate pointing device is used for inputting coordinates on a predetermined operation plane.

When a user operation such as a key press or a drag is applied to the keyboard 112 or the mouse 113,
The input device interface 104 issues an interrupt request (IRQ) to the CPU 101. By executing an interrupt handler corresponding to the interrupt request, the CPU 101 side can interpret the contents of the key input and the contents of the user input such as the coordinates designated by the mouse or the displacement thereof. The audio content processing software according to the present embodiment, as will be described later, uses these user input devices 112/1.
It is possible to capture the user input from 13 in real time and reflect it in real time in the editing and reproduction of the audio content.

Network interface 105
Uses a LAN (Local Area Network) to connect the system 100 according to a predetermined communication protocol such as Ethernet.
Local networks such as the Internet, or even wide area networks such as the Internet.

On the network, a plurality of host terminals (not shown) are connected in a transparent state to construct a distributed computing environment. Distribution of software programs and data contents can be performed on the network. For example,
It consists of "sound patterns", which are the basic components of the song, and "one-shot" pieces such as percussion and shouts, and "effects" that add delay, echo, and other acoustic effects to these pieces. The audio content processing software for editing and reproducing the audio content can be downloaded via the network. In addition, sound parts (sound material) such as sound patterns and one-shot sound pieces and effects used for editing and playback of audio contents.
Alternatively, the music, that is, the audio content generated as a result of editing by the audio content processing software, can be distributed via the network.

The external device interface 107 is a device for connecting external devices such as a hard disk drive (HDD) 114 and a media drive 115 to the system 100.

The HDD 114 is an external storage device in which a magnetic disk as a storage carrier is fixedly mounted (well known), and is superior to other external storage devices in terms of storage capacity and data transfer speed. Placing the software program on the HDD 114 in an executable state is called "installing" the program in the system. Usually HD
The D114 stores nonvolatilely the program code of the operating system to be executed by the CPU 101, application programs, device drivers, and the like.

For example, sound contents such as "sound pattern" and sound pieces such as "one shot" such as percussion and shouts, and "effects" that give delay, echo and other sound effects to these sound pieces. The audio content processing software for editing and reproducing can be installed on the HDD 114. In addition, sound parts (sound materials) such as sound patterns and effects such as one-shots used for editing and playback of audio content, and music created as a result of editing by audio content processing software, that is, sound. The content can also be stored on the HDD 114.

The media drive 115 is a CD (Compa
ct Disc), MO (Magneto-Optical disc), DVD (Di
gital Versatile Disc) is a device for loading a portable medium such as a disc and accessing the data recording surface thereof.

The portable medium mainly backs up software programs, data files, etc. as computer-readable data, and moves them between systems (that is, including sales, distribution and distribution).
It is used for the purpose. For example, sound content such as "sound patterns", "one shots" such as percussion and shouts, and "effects" that give delays, echoes, and other acoustic effects to these speech pieces can be edited and edited. The audio content processing software for reproduction processing can be physically distributed / distributed among a plurality of devices by using these portable media. In addition, sound parts (sound materials) such as sound patterns and effects such as one-shots used for editing and playback of audio content, and music created as a result of editing by audio content processing software, that is, sound. Content can be physically distributed and distributed between devices using these portable media.

The audio equipment interface 109 is a device for analog-converting and amplifying the audio data in digital format and outputting it externally via the speaker 116.
In the present embodiment, a "sound pattern" or a piece of sound such as "one shot" such as percussion or shout,
A song, that is, an audio content in which sound parts such as “effects” that give acoustic effects such as delay, echo, and the like to these sound pieces are combined and / or arranged in time series is output as audio through the speaker 116. It

The device expansion interface 117 is a device for expanding the game controller 118 and other user input devices (not shown). The device expansion interface 117 is, for example, a USB (Universal Se
You can dynamically insert and remove multiple peripheral devices that comply with interface standards such as rial bus).

A computer system 1 as shown in FIG.
An example of 00 is a personal computer of IBM Corp.
PC / AT (Personal Computer / Advanced Technolog
y) "compatible machine or a successor machine. Of course, a computer having another architecture can be applied as the computer system 100 according to this embodiment.

Next, processing of audio contents on the computer system 100 will be described. The processing of the audio content is actually realized by executing audio content processing software that edits and reproduces the audio content on the CPU 101 in real time.

The audio content processing software according to the present embodiment produces music by connecting time-sequentially, or appropriately superposing (that is, synthesizing) the respective sound pieces including melody, rhythm, and one-shot. You can go. Furthermore, the computer system 100 can function as a kind of “musical instrument” by outputting the completed music as sound from the speaker 116.

Further, by capturing the user input from the user input device such as the keyboard 112 and the mouse 113 during the performance, that is, during the reproduction of the audio content, and reflecting the input in the performance content of the music in real time,
The user can enjoy a DJ (disc jockey) -like play on the computer system 100.
In addition, the user can play a VJ (visual jockey) like play by using the display 111 screen to output a video that matches the sound output and by reflecting the video content in real time in response to the user input. You can enjoy.

Here, the content handled on the computer system 100 according to the present embodiment is, for example, a “pattern” which is a basic constituent element of the content such as a still image, a moving image or a sound, and a specific content. It is composed of layers such as "effects" that perform various active processes and "one-shots" that consist of temporally short contents. A pattern is a content that is longer in time than one shot. If the content is voice, the pattern is called a "sound pattern" and corresponds to a speech piece of a loop pattern. The sound content is a combination of one or more sound patterns or their repetitions, effects that add sound effects such as delays and echoes to each sound pattern, and one-shots consisting of short pieces of sound such as percussion and drums. It does not output continuously).

Of course, on the computer system 100, in addition to sound, it is also possible to perform editing and reproduction processing of contents such as still images and moving images in real time.

FIG. 2 is a functional block diagram showing the flow from the start to the end of the audio content processing software according to this embodiment.

The audio content processing software is started by the user inputting a predetermined start command such as double-clicking the corresponding application icon on the GUI screen (not shown) prepared on the computer system 100, for example. Processing begins.

Upon startup, after displaying a predetermined "splash" (not shown) that attracts the user's attention, the sound pattern or one shot such as a sound pattern or one shot to be processed by the audio content processing software is displayed. It is determined whether or not there is a "chip list" that enumerates "chips" (sound materials) such as effects to be applied.

If the chip list does not exist, a sound parts browser (described later) appears to prompt the user to create the list.

Next, it is judged whether the contents of the chip list are correct or not, and if they are not correct, the Sound Parts Browser appears to prompt the user to modify the chip list.

Then, the user specifies the sound pack to be used for the performance, and the audio content processing software main body is activated. A sound pack is a combination of sound patterns and key assignments used for playing (pattern pack), a combination of one-shot patterns and key assignments used for playing (one-shot pack), and effects used for playing. And a combination of key assignments (effect pack) (described later). If you want to specify an existing sound pack, check it against the chip list before starting.

The audio content processing software is composed of a "sound player", a "video player", a "system", and other functions.

The user selects "Exit" from the File menu.
The audio content processing software can be ended by selecting or by inputting an end command such as clicking the end button at the right end of the title bar.

In the process of termination processing, it is checked whether or not a sound chip such as a voice unit or an effect has been changed during the activation period, and the sound chip is saved according to the user's request. If there is unsaved record data, it is saved according to the user's request.

Next, each functional module constituting the audio content processing software according to this embodiment will be described in detail.

Sound Player The sound player mainly "plays" the acoustic content.
Is a functional module involved in. When playing, a computer system 1 such as a keyboard 112 and a mouse 113
The user input from the user input device equipped with the 00 is taken in real time.

The sound player uses the keyboard 112.
A chip (sound material) is assigned to each key of. A chip is a sound that is the basic component of a song.
It is a pattern, a piece of sound such as one-shot of percussion or drums, and an effect (acoustic effect) such as delay or echo applied to these pieces of sound. When the user presses a key, the chip corresponding to the pressed key is executed. By pressing down a plurality of keys simultaneously, the corresponding chips can be combined and output. Further, the chips can be combined in time series by sequentially pressing down the keys (or the combination of keys).

By releasing the key depression, execution of the corresponding chip is stopped. However, regarding the sound pattern, by toggling the corresponding key (described later), the same sound pattern is repeatedly output as sound until the toggle is turned off. Keyboard 112
Generally has a hardware constraint that up to three keys can be pressed simultaneously, but in the present embodiment, by utilizing the toggle function, three or more chips are simultaneously designated and combined. be able to.

Although the effect is composed of a plurality of parameters, in the present embodiment, the set value of the parameter is changed in real time by utilizing the coordinate displacement amount by the coordinate pointing device such as the mouse 113. (Described later).

The sound player has a "sound auto adjuster" that automatically corrects the performance contents in response to each key input operation when playing the audio contents, and a "master volume controller" that controls the volume of the entire performance. , "Pattern player" that plays the sound material (chip) registered as a sound pattern, "One-shot player" that plays the sound material (chip) registered as a one-shot, and the sound effect registered as an effect It consists of an "effector" that applies (chips) to the entire song, and a "pack changer" that switches various pattern sets.

When the sound auto adjuster is set to ON, when a user input operation is performed by a pattern player, a one-shot player, an effector, etc., the timing of reflecting the sound content according to the input is automatically corrected.

When the setting of the sound auto adjuster is turned off, the user input operation during the performance is reflected in the performance contents in real time.

When the sound auto adjuster is set to ON, the BP specified in the sound pack
Based on M (Beat per Minute: the number of beats per minute),
Determine the timing up to the 16th note, and then
The sound timing is corrected according to the timing specified in the sound auto adjust setting.

FIG. 3 illustrates how the sound auto adjuster performs timing correction when 1/4 timing is designated. As shown in the figure, one bar is divided into four equal parts, and the key operation during the period is 1/4.
It becomes effective at the timing of. Also, the key operation of the period becomes effective at the timing of 2/4. Also, the key operation during the period becomes effective at the timing of 3/4. Also, the key operation during the period becomes effective at the timing of 4/4.

The master volume controller is a functional module for adjusting the volume of the entire performance.
For example, by setting a volume pointer (described later) realized by using a mouse (or a trackpad) on one axis, it is possible to operate between the minimum volume and the maximum volume according to the coordinate displacement.

The pattern player uses the sound material registered as the pattern chip, that is, the sound pattern,
It is a functional module that reproduces in response to the pressing operation of the corresponding key.

In this embodiment, the frontmost row [Z], [X], and QWERTY keyboard 112 are used.
[C], [V], [B], [N], [M], [<],
[>], [? ] Sound for each of the 10 keys
It is designed to assign patterns. A key to which a sound pattern is assigned is also called a "sound key". In this specification, a combination of sound patterns used for playing and the assignment of these keys is called a "pattern pack". In this embodiment, registration of a maximum of eight types of pattern packs is allowed (described later). Further, in this embodiment, the toggle function can be turned on / off for each key assigned to the sounding of these sound patterns (described later).

While a certain pattern key is pressed, the sound pattern assigned to this pattern is continuously reproduced, and a loop-pattern-like speech piece can be generated. Once the pressed pattern key is released, the reproduction of the sound pattern ends, and when the same key is pressed next time, the same sound pattern is reproduced from the beginning.

When the toggle function (described later) is set to ON, when the pattern key is pressed once, the corresponding sound pattern is continuously reproduced and the same pattern pattern is reproduced.
When the key is input again (or the toggle is released), the continuous reproduction is ended. By simultaneously pressing the pattern keys and setting the toggle, it is possible to simultaneously reproduce or composite output a plurality of sound patterns.

As a function of terminating the reproduction processing of the sound pattern by the pattern player, "pattern.
"Stopper" is prepared. For example, keyboard 11
You can assign the "Back Space" key on 2 to the pattern stopper. Simultaneously press and toggle settings to play multiple sound patterns simultaneously (ie synthetic output)
If so, it is possible to end all at once by activating this pattern stopper.

The one-shot player is a functional module that sounds the sound material registered as "one-shot" such as percussion and shout in one-shot manner (that is, short in time and does not output continuously).

In this embodiment, [A], which is the second row from the front of the QWERTY keyboard 112,
[S], [D], [F], [G], [H], [J],
A one-shot type sound material is assigned to each of the 10 keys of [K], [L], and [+].
A key to which a one-shot is assigned is also called a "one-shot key". In the present specification, a combination of the one-shot pattern used for playing and the assignment of these keys is called a "one-shot pack". In this embodiment, registration of up to eight types of one-shot packs is allowed (described later).

Unlike the sound pattern described above,
The one-shot pattern toggle function is not recognized, and the one-shot pattern can be reproduced (that is, not continuously output) by one key operation. If the same key is repeatedly pressed while the one-shot is being sounded by a certain key operation, the previous one-shot is canceled and the next one-shot is reproduced.

In this embodiment, the one-shot pattern can control the reproduction by a combination of the operation of pressing the corresponding key and the operation of the mouse (or the trackpad). That is, for dragging the mouse (or rubbing the trackpad) while holding down the key,
Playback control function is assigned. This is referred to as "digital scratch effect" in this specification. An example of assigning a play command to a digital scratch is shown below.

(1) When the key is pressed and rubbed in the [X-, Y +] direction, or when the previous input in the [X +, Y-] direction is switched to the [X-, Y +] direction: one Play from the beginning of the shot pattern. (2) When pressing in the [X +, Y-] direction after pressing the key, or when switching from the previous input in the [X-, Y +] direction to the [X +, Y-] direction: one shot
Play from the beginning of the pattern. (3) In addition to the above (1) or (2), the reproduction speed is adjusted according to the rubbing speed.

The XY coordinate system referred to here is, for example,
The current (at the start of the operation) mouse pointer position is set as the origin, and how much it changes with respect to the X-axis (horizontal axis) and Y-axis (vertical axis) based on the pointer position n frames before It is possible to determine the amount of movement based on the above, and to see the amount of change per unit time to determine the amount of change in the parameter.

The reproduction by the digital scratch effect using the mouse or the trackpad is terminated when the one-shot key is released. Alternatively, the reproduction may be ended by hitting the track pad while keeping the one-shot key pressed. further,
The corresponding one-shot may be reproduced again by hitting the trackpad again while the one-shot key is being pressed.

While the digital shot effect is operating while the one-shot key assigned to the one-shot pattern is being pressed, the input of the key assigned to another one-shot pattern is not accepted, Furthermore, even when the key operation assigned to the effect pattern is performed, the swing box (described later) does not appear.

The effector is a functional module for applying an effect (acoustic effect) registered as an effect chip to the entire performance performed by the sound player.

In the present embodiment, [Q], [W], in the third row from the front of the QWERTY array type keyboard 112,
[E], [R], [T], [Y], [U], [I],
A sound effect is assigned to each of a total of 10 keys of [O] and [P]. A key to which a sound effect is assigned is also called an “effect key”. In the present specification, a combination of effects used for playing and the assignment of these effect keys is called an "effect pack". In this embodiment, a maximum of eight types of effect packs are allowed to be registered (described later). A combination of the above-mentioned pattern pack, one-shot pack, and effect pack is called a "sound pack". When starting the audio content processing software according to the present embodiment, the user specifies the sound pack to be used (FIG. 2).
checking).

A swing box (described later) appears on the screen while the effect key is pressed, and the swing box disappears when the key is released.

During the period when the swing box appears on the screen, in response to the coordinate pointing operation with the mouse or the trackpad, the setting value (effect point) of the effect parameter corresponding to the key being pressed is changed. (That is, change the effect balance). Also, the changed value of the parameter is reflected in the performance in real time. Also, while the swing box is appearing, the digital scratch effect described above does not work even if the one-shot key is operated.

Only one kind of effect can be applied to the music being played. Therefore, while a certain one effect key is being pressed, the input of another effect key cannot be accepted.

Regarding the effect, the toggle function can be used as in the case of the sound pattern.
That is, when the toggle function is turned on for a certain effect key, the effect once key-input can be continuously applied to the entire performance. Also, if there is an effect that is operating in the toggled state, pressing the effect key again activates the effect key that was operated later.

When the effect key pressed after is the same as the effect key pressed before (that is, when the same effect key is pressed continuously)
To cancel this effect. Furthermore, at this time,
If you operate the swing box while holding down the effect key, the effect will continue to be valid, and you can change the effect point. In other words, even if the pressed state of the effect key is released, the sound effect corresponding to this is continued.

FIG. 4 shows an example of the structure of a swing box used for changing the effect points. As shown in the figure, the swing box has a two-dimensional operation coordinate system consisting of the A axis and the B axis, and the A axis and the B axis have the balance factor set when the effect chip is created (described later). Are assigned respectively. The total length of each axis is the assigned balance factor min
~ Max, dry ~ wet, cut ~ boost. For each axis of the swing box, for example,
XGA (eXtended) consisting of 1024 x 768 dots
Using the [Graphics Array] screen as [100% x 100%] of the parameter of each effect element, convert it to the parameter of the effect element assigned in each axis direction according to the position of the pointer within that range. , Can be used for real-time editing for playing.

For example, on the A-axis side, Control (m
in <-> max) and Balance (dry <-> w)
A parameter of an effect such as et) is set, and a parameter that does not interfere with each other between the various parameters with the A axis is set on the other B axis side.
If the user tries to set effect parameters that interfere with the A axis and B axis (including the case where the same parameter is assigned to each axis), it is assigned when the OK button is pressed. It is judged whether the contents are correct or not, and a message box (not shown) indicating the error is displayed. Also, parameter selection may be restricted at the pull-down menu level.

The currently set effect point is displayed at the corresponding operation coordinate position in the swing box. Then, in response to the coordinate pointing operation with the mouse or the track pad, the effect in the swing box is displayed.
As the point moves, the effect balance itself applied to the song being played changes in real time.

FIG. 5 shows, in the form of a flowchart, the processing procedure performed by the effector using the swing box. The swing box is operated by a combination of an effect key assigned on the keyboard 112 and a mouse or a trackpad.

When any effect key is pressed on the keyboard 112 (step S1), the operation mode of the effector is switched (step S2), and a swing box (see FIG. 4) is displayed on the screen. Appear.

Although the effect points corresponding to the current set values of the effect parameters are displayed on the swing box (described above), the swing point is set as the default value of the designated coordinates of the mouse or the trackpad.
The corresponding position of the effect point on the operation coordinate system of the box is preset (step S3).

When coordinate pointing is input from a coordinate pointing device such as a mouse or a trackpad (step S4),
The input movement amount is calculated (step S5). Then, the calculated movement amount is converted into the setting value of the effect parameter, and the effect point is moved to the position corresponding to the converted setting value on the swing box (step S6).

After that, when the pressed effect key is released (step S7), the effect point is returned to the original position (step S8), the original mode is restored, and the entire processing routine is completed. finish.

As an alternative to step S8, instead of returning the effect point to its original position, the position of the previous effect point moved on the swing box may be stored.

The pack changer is a functional module for switching the sound pack, one-shot pack, and effect pack registered for each performance layer of sound pattern, one-shot, and effect.

When operating the pack changer on the keyboard 112, for example, the up and down cursor keys of [↑] and [↓] are assigned to the selection of the performance layer, and [←] is selected.
And [→] left / right cursor keys are assigned to pack type selection. Then, the setting becomes effective by pressing the [Enter] key.

When operating the pack changer with a rotary input device such as a jog dial,
[Upper layer: Select layer] → [Decide layer] → [Lower layer:
Each input item may be assigned to a rotation position, such as "selection of pack type or returning to upper layer" ... → [decision of pack type, and at the same time reflecting on performance].

The pack changer always accepts sound packs, that is, assignments of sound patterns to pattern keys, regardless of whether the pack changer is playing. This allows the sound pattern to be changed at all times.

Further, when a sound pattern or an effect pack is switched during a performance by a sound player, there is a sound key or an effect key that is kept pressed before switching, or a toggle function. If there is a key for which is turned on, the sound pattern or effect is continuously executed from before switching. The key operation continued during the pack switching is valid at the time when the key operation is invalidated (that is, when the key is released or the toggle function is turned off). To be done.

Video Player The video player is a functional module mainly related to video, and during the performance by the sound player,
It provides video output according to the song being played or changes in the song.

In the present embodiment, the video player does not directly operate the image, but changes the display pattern of the still image or the moving image in accordance with the sound key input during the performance. Also, in response to the operation of the one-shot key or the effect key, the flash animation is superimposed and displayed.

System The system is a functional module that provides functions related to various settings and customization related to performance by the sound player. The system is "Recorder", "Score Editor", "Sound Parts Browser"
And "File Transport" and "Sound Pack Editor".

The recorder is a functional module for recording the user's performance as a sequence file of a predetermined format.

The recorder can be designated to stand-by (immediately before playing) or stop (immediately after playing) by a coordinate pointing operation using a mouse or a track pad.

When recording of the performance by the recorder is started, a rhythm for adjusting the timing of playing is entered, and when the performance is started, the rhythm stops (the rhythm at this time is not recorded).

When the recording of the performance is finished, the silent bars before and after the performance so far are automatically cut off, and then the silent areas before and after are recorded according to the number of seconds specified in the recording setting. The addition is completed as record data.

The score editor is a functional module for editing the sequence data recorded by the recorder. "Edit" here means "arranging the timing of key operations during performance."
Means In this specification, a series of input information corresponding to a certain key operation during performance is called a "band", and a set of bands is a "score". Editing is the work of dealing with this score.

Editing is performed on each of the sound pattern, one-shot, and effect performance layers. The operations that can and cannot be performed in the score editor are listed below.

(1) Sound pattern 1-1) It is possible to shift the start and end points of the performance. 1-2) When the starting point and the ending point are offset, the bands before and after cannot be overlapped. 1-3) It is impossible to add performance information that does not exist in the sequence data. 1-4) It is possible to cut off a band entirely. 1-5) It is impossible to cut a band.

(2) One shot 2-1) It is possible to shift the band position. 2-2) It is not possible to shift the band position and overlap with the front and back bands. 2-3) It is not possible to add performance information that does not exist in the sequence data. 2-4) It is possible to cut off a band entirely. 2-5) It is impossible to cut a band.

(3) Effect 3-1) It is possible to shift the start and end points of the performance. 3-2) It is not possible to overlap the front and rear bands by shifting the start and end points. 3-3) It is not possible to add performance information that does not exist in the sequence data. 3-4) It is possible to cut off a band entirely. 3-5) It is impossible to cut a band.

The sound parts browser is a functional module for handling sound materials such as sound patterns, one shots and effects, and sequence files recorded by the recorder. The functions provided by the Sound Parts Browser are listed below.

(1) Various chips (sound pattern,
One-shot, effect) list browsing (2) Record (sequence data) list browsing (3) Chip and record list information sorting (4) Chip list management information rewriting (5) Sound currently in use -Swapping the edited chips to the pack (changing the key assignment) (6) Playing chip files and sequence files (7) Stopping chip files and sequence files (8) Temporarily stopping chip files (9) Converting a sequence file (10) Creating and editing a chip list (11) Modifying a chip list (12) Collating a chip list (13) Adding a chip (14) Deleting a chip

The file transporter is a functional module for importing and exporting various files. Management of the information of the imported or exported file is performed by the chip list. A sound parts browser is used for the import and export operation interface (described later).

The sound pack editor is a functional module that integrally manages a pack group, that is, a sound pack, registered for each performance layer such as a sound pattern, one shot, and effect.

A sound pack is a combination of a sound pattern and key assignment used for playing (pattern pack), a combination of one-shot pattern and key assignment used for playing (one-shot pack),
It also consists of the combination of effects used for playing and key assignment (effect pack).

The pattern pack is the front row [Z], [X], in the QWERTY array type keyboard 112.
[C], [V], [B], [N], [M], [<],
[>], [? ], Which is a total of 10 sound pattern patterns assigned to each pattern key, and a maximum of 8 types of pattern packs are allowed to be registered.

Also, the one-shot pack is QWER
[A], [S], [D], [F], [G], [H], in the second row from the front of the TY array type keyboard 112.
It is the assignment of one shot to each of the ten one shot keys of [J], [K], [L], and [+], and registration of a maximum of eight types of one shot packs is allowed. .

The effect pack is QWERT.
[Q], [W], [E], [R], [T], [Y], in the third column from the front of the Y-array keyboard 112.
This is a sound effect assignment to a total of 10 effect keys [U], [I], [O], and [P], and a maximum of eight types of effect packs are allowed to be registered.

A sound pack is a combination of various packs. The sound pack editor performs naming of sound packs, renaming, addition and deletion of various packs, designation and modification of BPM, registration and modification of various packs. Hereinafter, an operation procedure for creating various packs with the sound pack editor will be described.

(1) Creation of pattern pack 1-1) 10 or less sound patterns are collectively registered from the list in the sound parts browser. 1-2) Set the toggle function on / off for each sound pattern. 1-3) Set the playback volume for each sound pattern.

(2) Creation of one-shot pack 2-1) Ten or less one-shots are collectively registered from the list in the sound parts browser. 2-2) Set the playback volume for each one shot.

(3) Creating an effect pack 3-1) Register up to 10 effects together. At this time, the effect may be selected from a chip list registered in advance, or the registered effect may be customized and registered. 3-2) Set the toggle function on / off for each effect.

Next, the configuration of the operation screen in the audio content processing software according to this embodiment will be described.

FIG. 6 shows a configuration example of a main screen displayed on the display 111 when the audio content processing software according to this embodiment is started on the computer system 100.

As shown in the figure, on this main screen, a flash movie display area 1, a sound parts browser call button 2, an option setting window call button 3, a recording start button 4,
Recording end button 5, score editor call button 6, pattern manager call button 7, one-shot manager call button 8,
Effect manager call button 9, pattern play button 10, pattern toggle button 1
1, one-shot play button 12, effect play button 13, master volume controller 15, BPM input box 16, real-time pack changer 17, version information call button 18, help window call Button 1
9 and an end button 20 are included.

In the flash movie display area 1,
Pattern play button 10, one-shot play button 12, effect play button 1 described later
In response to the operation of 3, the flash movie assigned to each key operation is displayed.

By clicking the Sound Parts Browser Call Button 2, the sound parts
The browser is launched. The sound parts browser is a functional module for handling sound materials such as sound patterns, one-shots, effects, and sequence files recorded by the recorder. The screen structure of the sound parts browser will be described in detail later.

When the option setting window call button 3 is clicked, the option setting window appears. The screen configuration of the option setting window will be described later in detail.

After the recording start button 4 is clicked, the performance information instructed via the main screen is recorded as sequence data by the recorder (described above).

When the recording end button 5 is clicked, the recording state of the performance started by the recording start button 4 is ended.

The score editor call button 6
By clicking, the score editor for editing the sequence data recorded by the recorder is activated, and the score editor window appears. The screen configuration of the score editor window will be described in detail later.

By pressing the pattern manager call button 7, a pack manager, which will be described later, is activated, and a combination of sound pattern assignments for each sound key can be edited / changed. In the present embodiment using the QWERTY keyboard 112, [Z], [X] in the front row,
[C], [V], [B], [N], [M], [<],
[>], [? ] Each of the 10 keys is a sound
It is assigned as a key.

Further, by pressing the one-shot manager call button 8, a pack manager, which will be described later, is activated, and the combination of one-shot assignment to each one-shot key can be edited / changed. In the present embodiment using the QWERTY keyboard 112, [A], which is the second row from the front,
[S], [D], [F], [G], [H], [J],
A total of 10 keys of [K], [L], and [+] are assigned as sound keys.

Also, by pressing the effect manager call button 9, a pack manager, which will be described later, is activated, and it is possible to edit / change the combination of effect assignments to each effect key.
In the present embodiment using the QWERTY array type keyboard 112, [Q], [W],
[E], [R], [T], [Y], [U], [I],
Each of the 10 keys, [O] and [P], is a sound.
It is assigned as a key.

The pattern play button 10 uses the QWE
[Z], [X], [C], [V], assigned as sound keys on the RTY array type keyboard 112.
[B], [N], [M], [<], [>], [? ], Each of 10 keys is displayed.

While each sound play button 10 is being pressed, the sound pattern assigned to that key is repeatedly reproduced by the sound player (described above). It is also possible to play a plurality of sound patterns at the same time (that is, to combine the patterns) by simultaneously pressing a plurality of sound keys.
However, the simultaneous pressing operation of the effect keys on the keyboard 113 is limited to 3 keys due to the hardware limitation.

Each pattern play button 10 is provided with a pattern toggle button 11. Pattern toggle on desired pattern play button 10
Click the button 11 to turn on the toggle function for the corresponding sound pattern,
Continuous playback can be performed.

When the key corresponding to the sound pattern being continuously reproduced after the toggle function is turned on is pressed again, the performance is stopped. If the pattern pack is changed by the real-time pack changer 17 (described later) while pressing each pattern play button 10 or while the toggle function is turned on and continuously playing, the pattern It is assumed that the sound pattern before the pack is changed is played back, and once the sound generation is finished, the sound pattern information assigned to the newly changed sound pack becomes valid.

The one-shot play button 12 is Q
[A], [S], [D] assigned as one-shot keys on the WERTY keyboard 112.
[F], [G], [H], [J], [K], [L],
It consists of a display of 10 keys in total, which is [+].

When each one-shot play button 12 is pressed, a one-shot-like sound material such as percussion or shout assigned to the key is reproduced (from beginning to end). If a key assigned to the same sound is overlapped and input while a certain one-shot is being reproduced, the previous sound is canceled and the sound corresponding to the subsequent input is reproduced.

The digital scratch effect (described above) works by rubbing the trackpad (or dragging the mouse) while holding down the one-shot play button 12. That is, when the track pad is rubbed in the [X-, Y +] direction and rubbed in the [X +, Y-] direction, the corresponding one-shot is reproduced from the beginning for both operations. Also, the reproduction speed changes according to the rubbing speed. When the one-shot play button 12 is released, the one-shot playback is stopped. Also, one-shot play button 1
Hitting the trackpad while pressing 2 will replay the corresponding one-shot.

While the one-shot play button 12 is held down (that is, during the operation period of the digital scratch effect), the input of another one-shot key or the one-shot play button is accepted. The swing box (described above) does not appear even if the effect key operation is performed.

The effect play button 13 is QW
[Q], [W], [E] assigned as effect keys on the ERTY keyboard 112
[R], [T], [Y], [U], [I], [O],
It is composed of the display of each of the 10 keys called [P].

While each effect play button 13 is being pressed, the effect assigned to that key, that is, the sound effect, is applied to the entire song being played.
However, only one effect can be applied at a time,
When one effect is in operation and the next effect is layered, the previous effect is canceled and only the subsequently input effect is valid.

When a certain effect play button 13 is pressed, a swing box (described above) appears, and when the button 13 is released, it disappears. If you operate the trackpad while holding down the effect play button 13 or the effect key, you can change the effect point (that is, change the effect balance).
The result can be reflected in the performance in real time (described above). The effect type that can be assigned to the swing box is selected by the effect file maker described later.

For each effect play button 13,
An effect toggle button 14 is provided. Effect on the desired effect play button 13
Click the toggle button 14 to turn on the toggle function for the corresponding effect,
The same sound effect can be applied repeatedly to the performance.

When the toggle function is turned on and the key corresponding to the effect continuously applied to the performance is newly pressed (or pressed and released), the effect is stopped.
At this time, if the effect play button 13 or the effect key is kept pressed and the swing box is operated, the effect continues to be valid.

While holding down the effect play button 13 or the effect key (ie,
(While the swing box is operating), operating the one-shot play button 12 or one-shot key
Digital scratch effect does not work.

While the effect play button 13 or the effect key is being pressed, or while the toggle function is turned on and the same effect is continuously applied, the effect is changed by the real time pack changer 17 (described later). If you change the pack, the effect
It is assumed that the effect before the pack is changed is played back, and once the sound generation is finished, the effect information assigned to the newly changed effect pack becomes valid.

Master Volume Controller 15
Is composed of a triangular volume pointer attached to a horizontal bar, and the volume of the entire performance can be adjusted by dragging the volume pointer with a mouse or the like.

In the BPM input box 16, BPM (Beat per Minute), that is, tempo, used for performance can be input as a numerical value.

Real-time pack changer 17
Is the up / down cursor on the keyboard 112 during performance.
Key [↑], [↓], left / right cursor key [←],
It consists of [→] and [Enter] keys or buttons. You can switch the sound pattern, one-shot, and effect performance layers by pressing the up / down cursor keys [↑], [↓], and also the left / right cursor keys [←], [→]. By pressing, the pack (that is, key assignment) in the specified performance layer can be switched. Then, by pressing the [Enter] key or button, the switching to the currently displayed pack is validated.

When the version information call button 18 is clicked with the mouse, the version information of the audio content processing software is displayed in a dialog.

When the help window call button 19 is clicked with the mouse, a help window (well known) is activated.

When the end button 20 is clicked on with the mouse, the running application is ended.

FIG. 7 shows a configuration example of a window screen of the sound parts browser. As described above, the sound parts browser is activated by pressing the sound parts browser call button 2 on the main screen shown in FIG.

The sound parts browser generally manages sound piece information such as sound patterns, one shots, effects, records, etc. used for performance. As shown in the figure, the Sound Parts Browser has a dedicated information display area 32 for each performance layer such as sound pattern, one shot, effect, record, etc. The display area 32 can be switched. In the illustrated example, the sound pattern tab 31 is selected, and the information display area 32 regarding the sound pattern is displayed on the foreground.

On the window screen of the illustrated sound parts browser, a chip information correction button 33, a new chip creation button 34, and a chip / record import /
Button 35, chip / record export button 36, and record data WAV conversion button 37
It also includes a chip / record player 38 and a browser end button 39.

Sound pattern information display area 32
Includes fields for writing information such as the name of each registered sound pattern, group, BPM, flash file name, flash layer, comment, date and time of import of data file.

In the one-shot information display area (not shown), the name of each registered one-shot, group, flash file name, flash layer,
Fields are provided for writing information such as comments and the date and time of data file import.

In the effect information display area (not shown), there are fields for writing information such as the name of each registered effect, group, flash file name, flash layer, comment, and data file import date and time. It is prepared.

Record information display area (not shown)
Is provided with a field for writing information such as the name of each registered record, BPM, comment, data creation date and time.

By clicking the chip information correction button 33, a chip information window described later is activated, and the information of the selected chip (highlighted or highlighted) in the information display area can be changed. it can.

By clicking the new chip creation button 34, a chip information window described later is activated, and new chip information can be input.

Tip / Record Import Button 3
Clicking on 5 launches an import window, described below, which allows chips or records to be imported from outside the system.

In addition, chip / record export
Click the button 36 to export /
A window (not shown) is launched and the registered chips or records can be exported out of the system.

As the export window, for example, a window for saving a file, which is provided as standard equipment in "Windows" which is an operating system (OS) of Microsoft Corp. of USA, can be applied.
The user inputs a folder name on such a file save window and copies the exported files into the folder. Records are exported by song (multiple records cannot be exported at the same time).

Record data WAV conversion button 37
By pressing, the record data (sequence data recorded by the recorder) selected in the frontmost information display area 32 is converted into WAV format data.

The chip / record player 38 uses Pl
Playback of the record data (sequence data recorded by the recorder) selected in the information display area 32 in response to the button operation, which is made up of a group of buttons related to playback processing such as ay, Stop, and Pause. (Pla
y), stop (Stop), or pause (Pause)
Let

The sound parts browser is closed by pressing the browser end button 39.

FIG. 8 shows a screen configuration example of the chip information window. The chip information window can handle voice piece information in each performance layer such as a sound pattern, one shot, and effect. As shown, the chip information window includes a type information display field 41, a name information field 42, a group name information field 43, a comment information field 44,
WAV data information field 45, flash select button 47, priority field 48, OK button 4
9 and a cancel button 50.

In the type information display field 41, which one of the sound pattern, one shot and effect is the chip is displayed.

In the name information field 42, the chip name of the chip information being displayed is displayed. The name can be changed in the field.

In the group name information field 43, the group name to which the displayed chip information belongs is displayed. The name can be changed in the field.

In the comment information field 44, a comment regarding the displayed chip information is displayed. The content of the comment can be entered / changed in the field.

The WAV data information field 45 displays data file information relating to the selected chip. Import button 46 in the field 45
Press to import a single voice unit file or create an effect tip. If you create a new chip using the Sound Parts Browser (described above), import the WAV file and add the effect
File Maker (described later) is started.

When the flash selection button 47 is pressed, a flash movie selection window described later is activated,
You can select the flash movie to be assigned to the chip. The flash movie selected here is displayed in the flash movie display area 1 of the main screen during the period of reproducing the corresponding chip.

In the priority field 48, the display priority of the flash movie assigned to the chip can be entered. In the flash movie display area 1 (described above) on the main screen, play buttons 10, 12, for sound pattern, one shot, and effect,
Simultaneously with the operation of 13, the corresponding flash movies are also played back in an overlapping manner. The priority order here means the order of stacking the flash movies.

When the OK button 49 is pressed, the chip information input in this chip information window is validated and the window is closed.

When the cancel button 50 is pressed,
The chip information input in this chip information window is canceled and the window is closed.

FIG. 9 shows the effect file maker
The example of a screen of a window is shown. In the effect file maker window, effect information used for playing on the sound player can be created. As shown in the figure, the effect file maker window has a basic tone effect field 51, an effect balance 52, and X and Y input fields 53.
, Test BGM field 54, and OK button 55
And a cancel button 56.

The basic tone effect field 51 is an input field in the form of a combo box, and it is possible to select a sound effect that is the basic tone of the effect from a list box (not shown) that appears by pressing the ▼ button. . As a keynote effect parameter, "Dis
tortion "," Autopan "," RingMod "," Flanger "," Phase
r "," Slice "," Delay "," Echo "," Lo-Fi "," Wah ", and" Plane "are prepared.

The effect balance 52 sets the balance of various elements forming the effect by dragging the pointer on each slider with a mouse or the like. As a component of the effect, "Contro
l "," Balance "," Isolator_Low "," Isolator_Mid "," Is
olator_High "," Filter_Resonance "," Filter_Cut-off "
Is prepared.

The X and Y fields 53 select real-time effectors, ie, effector components to be adjusted in real-time during performance. Each of the X and Y fields 53 has a combo box format, and "Control", "Balance", "Isolator_Low", and "Is" respectively.
olator_Mid "," Isolator_High "," Filter_Resonanc
e "or" Filter_Cut-off "can be selected. The components set in the X and Y fields are
Swing Box (see above and Figure 4) A
It is assigned to each of the axes and the B axis, and the set value can be changed in real time in response to the drag operation of the track pad or the mouse during the performance.

For example, on the A-axis side, Control (m
in <-> max) and Balance (dry <-> w)
A parameter of an effect such as et) is set, and a parameter that does not interfere with each other between the various parameters with the A axis is set on the other B axis side.

The test BGM field 54 is in a combo box format, and a music file which is automatically played when the effect file maker window is activated is input by text or a list box (shown in the figure). No) can be selected. The user
You can adjust the effect balance by referring to the music file played at startup.

When the OK button 55 is pressed, the effect information input in this effect file maker window is validated and the window is closed.

If the cancel button 56 is pressed,
The effect information input in this effect file maker window is canceled and the window is closed.

FIG. 10 shows an example of the screen structure of the flash movie selection window. The flash movie selection window is the tip information window,
Alternatively, it can be called from both option windows described later. As shown in the figure, the flash movie selection window is displayed in the flash movie viewer 61.
, Flash movie list 62, and OK button 6
3 and a cancel button 64.

When called from the chip information window, the flash movie selection window is
It functions as a movie selector for associating a flash movie with the chips of the pattern, one-shot, and effect playing layers. It is possible to select a visual effect movie to be played in the flash display area 1 during performance.

When called from the option window, it is possible to select a background movie to be reproduced on the distribution surface of the flash display area 1 during performance in the flash movie selection window.

The flash movie viewer 61 is an area for displaying a movie of the selected flash.

The flash movie list 62 is an area for displaying a list of selectable flash movies, and the selected movie is highlighted.

When the OK button 63 is pressed, the flash movie selected in this flash movie selection window is associated with the chip and the window is closed.

When the cancel button 64 is pressed,
The flash movie selected in this flash movie selection window is canceled and the window is closed.

FIG. 11 shows an example of the screen structure of the import window. On the import window, various files used as chips (speech blocks) for playing can be imported from outside the system. As shown,
In the import window, specify folder field 7
1, a file information field 72, and an OK button 73
And a cancel button 74.

In the folder designation field 71, the folder storing the files to be imported is designated.

[0205] In the file information field 72, information on files in the folder designated in the folder designation field 71 is displayed in a list.

When the OK button 73 is pressed, various files in the currently selected folder are imported and the window is closed.

If the cancel button 74 is pressed,
Closes the window without importing various files in the currently selected folder.

FIG. 12 shows a screen configuration example of the option window. Various settings can be changed in the illustrated option window. As shown in the figure, the options window includes a sound pack selection field 81, a new sound pack creation button 82, a background movie selection field 83, a quantize timing specification field 84, and a recording. Silent time setting field 85
And an OK button 86 and a cancel button 87.

Sound pack selection field 81
Has a combo box format, and a sound pack to be used for playing can be input by text or can be selected from a list box (not shown).

A sound pack is a combination of a sound pattern and key assignment used for playing (pattern pack), a combination of one-shot pattern and key assignment used for playing (one-shot pack),
It also consists of combinations of effects and key assignments used for playing (effect packs) (described above). The sound pack is key assignment information about the sound material that holds these collectively, and one sound pack is one file.

In this embodiment, a maximum of 8 types of pattern packs, one-shot packs, and effect packs can be registered. Therefore, the maximum number of sound packs is 8 × 8 × 8 = 512.

When a new sound pack creation button 82 is pressed, a new sound pack can be created.

The background movie selection field 83 consists of five buttons A to E, each of which is assigned a background movie. By pressing the button during performance, the flash display area is displayed. You can select the background movie to play in step 1.

In the quantize timing designation field 84, performance timing correction can be designated. In the illustrated example, the quantize timing designation field 84 is composed of four radio buttons, and the timing can be selectively selected from 1/4, 1/8, and 1/16. . When timing correction is not performed, real time is selected.

When the OK button 86 is pressed, the information selected in this option window is validated and the window is closed.

If the cancel button 87 is pressed,
Cancels the information selected in this option window and closes the window.

FIG. 13 shows an example of the screen structure of the pack manager window. The pack manager window is a screen for editing a sound pack, a one-shot pack, or an effect pack.

When called from the pattern manager call button 7 on the main screen, the display contents of the pattern manager window correspond to combinations for assigning sound patterns to each sound key, that is, editing / changing of a sound pack. Becomes

When called from the one-shot manager call button 8 on the main screen, the displayed contents of the pattern manager window are
This corresponds to the combination of assigning one shot to the key, that is, editing / changing the one shot pack.

When called from the effect manager call button 9 on the main screen, the pattern
The display content of the manager window corresponds to the combination of assigning effects to each effect key, that is, editing / changing of an effect pack.

In the example shown in FIG. 13, the display of the pattern manager window corresponds to a combination in which a sound pattern is assigned to a sound key, that is, to edit / change a sound pack. The pattern manager window shown in the figure includes a pack selection field 91, a new pack creation button 92, a chip list display field 93, an assignment information field 94, an OK button 95, and a cancel button 96. Contains.

The pack selection field 91 is constructed in a combo box format, and is used for key assignment patterns.
You can select the name of the pack (or one-shot pack, effect pack).

When the new pack button 92 is pressed, a pattern pack (or one-shot pack or effect pack) is newly created. It is also possible to change the name by directly entering it. Up to eight packs can be added to each performance layer of pattern packs, one-shot packs, and effect packs.

In the chip list display field 93,
A list of chips (sound materials) that can be selected in each performance layer is displayed.

In the assign information field 94, the name of the chip (sound material) assigned to each key is displayed. The key display switches according to the pack of the playing layer being operated. In the example shown in the figure, since the sound pattern key assignment is in operation, the front row [Z], [X], [C], [V], assigned as sound keys on the QWERTY array type keyboard 112, [B],
[N], [M], [<], [>], [? ] Total 1
Zero pattern keys are displayed. When changing the key assignment, the chip name may be directly text-entered in the assignment information field 94 of the corresponding key, or the desired chip in the chip list may be dragged to the assignment information field of the corresponding key.・ You may drop it.

When the OK button 95 is pressed, the assignment information currently set is validated and the window is closed.

When the cancel button 96 is pressed,
Cancel the currently set assignment information and close the window.

Lastly, performance processing by the audio content processing software according to this embodiment will be described.

On the computer system 100 that executes the audio content processing software, it is possible to capture the user input via the user input device such as the keyboard 112 and the mouse 113 in real time and play the music. FIG. 14 shows, in the form of a flow chart, a processing procedure for capturing a user input via a user input device such as the keyboard 112 or the mouse 113 in real time to play a song.

In the computer system 100, when a user operation such as a key press or a drag is applied to the keyboard 112 or the mouse 113, the input device interface 104 issues an event, that is, an interrupt request (IRQ) to the CPU 101. . By executing an interrupt handler corresponding to the interrupt request, the CPU 101 side can interpret the contents of the key input (scan code), the coordinates designated by the mouse, or the displacement amount thereof (step S11).

If the generated event is a pattern key pressing operation (step S12), the sound pattern file assigned to the pattern key is selected via the pack manager (step S1).
3) Then, this sound pattern is reproduced and output (step S14). If there is a sound material that is already being reproduced, it is added to this and composite output is performed. Here, when the toggle function is turned on for the pattern key, the corresponding sound pattern is continuously reproduced.

If the event that has occurred is the release of the depression of the pattern key (including the release of the toggle function) (step S15), the released pattern key is selected from the sound material being reproduced. The corresponding sound pattern is deleted and played (step S16).

Also, the event that occurred is a one-shot event.
If it is a key pressing operation (step S17), the one-shot file assigned to the one-shot key is selected via the pack manager (step S18) and is combined with the music being played (step S18). Step S1
9). If there is a one-shot that is already being reproduced, this is invalidated and the newly input one-shot is reproduced.

If the generated event is an effect key pressing operation (step S20), the effect assigned to the effect key via the pack manager is applied to the music being played (step S20). S
21). Here, when the toggle function is turned on for the effect key, the corresponding effect is continuously applied to the entire performance.

If the generated event is the release of the depression of the effect key (including the release of the toggle function) (step S22), the application of the effect to the performance is stopped (step S23).

[Supplement] The present invention has been described in detail with reference to the specific embodiments. However, it is obvious that those skilled in the art can modify or substitute the embodiments without departing from the scope of the present invention. That is, the present invention has been disclosed in the form of exemplification, and the contents of this specification should not be construed in a limited manner. In order to determine the gist of the present invention, the section of the claims described at the beginning should be taken into consideration.

[0237]

As described above in detail, according to the present invention,
(EN) Provided are an excellent information processing apparatus and information processing method, and a storage medium, which allow users to interactively edit and reproduce sounds and other contents by using a keyboard, a mouse, or other user input devices and enjoy them. it can.

Further, according to the present invention, a plurality of contents are combined or arranged in time series in accordance with a user input via a keyboard, a mouse, or other user input device to output sound or other contents. It is possible to provide an excellent information processing apparatus and information processing method, and a storage medium that can be enjoyed by interactively editing and reproducing.

Further, according to the present invention, the user input from the user input device is immediately taken in, and a plurality of contents are combined or arranged in time series to interactively reproduce the sound and other contents. It is possible to provide an excellent information processing apparatus and information processing method and a storage medium that can be edited and played back and enjoyed.

According to the present invention, a multi-operation system such as a disc jockey that requires real-time operation can be used for coordinate instruction such as a general keyboard or mouse / track pad connected to a personal computer (PC). It can be realized using a device. INDUSTRIAL APPLICABILITY The present invention can be applied to a use environment in which a relationship between an operation and a time axis is strong and an immediacy is required, such as a video system and a music system application.

[Brief description of drawings]

FIG. 1 is a computer system 1 suitable for implementing the present invention.
It is the figure which showed the hardware constitutions of 00 typically.

FIG. 2 is a functional configuration diagram showing a flow from activation to termination of the audio content processing software according to the present embodiment.

[Figure 3] 1/4 in the sound auto adjuster
6 is a diagram for explaining how to perform timing correction when the timing of FIG.

FIG. 4 is a diagram showing a configuration example of a swing box used for an effector.

FIG. 5 is a flowchart showing a processing procedure performed by an effector using a swing box.

FIG. 6 is a diagram showing a configuration example of a main screen displayed on a display 111 when the audio content processing software according to the present embodiment is started on the computer system 100.

FIG. 7 is a diagram showing a configuration example of a window screen of a sound parts browser.

FIG. 8 is a diagram showing a screen configuration example of a chip information window.

FIG. 9 is a diagram showing a screen configuration example of an effect file maker window.

FIG. 10 is a diagram showing a screen configuration example of a flash movie selection window.

FIG. 11 is a diagram showing a screen configuration example of an import window.

FIG. 12 is a diagram showing a screen configuration example of an option window.

FIG. 13 is a diagram showing a screen configuration example of a pack manager window.

FIG. 14 is a processing procedure for playing a song by capturing user input in real time through a user input device such as a keyboard 112 or a mouse 113 on the computer system 100 that executes the audio content processing software according to the present embodiment. It is a flowchart showing.

[Explanation of symbols]

1 ... Flash movie display area 2 ... Sound parts browser call button 3 ... Option setting window call button 4 ... Recording start button, 5 ... Recording end button 6 ... Score editor call button 7 ... Pattern manager call button 8 ... One Shot manager call button 9 ... Effect manager call button 10 ... Pattern play button 11 ... Pattern toggle button 12 ... One shot play button 13 ... Effect play button 14 ... Effect toggle button 15 ... Master volume controller 16 ... BPM input box 17 ... Real-time pack changer 18 ... Version information call button 31 ... Tab, 32 ... Information display area 33 ... Information correction button 34 ... New chip creation button 35 ... Import button, 36 ... Export button 37 ... WAV conversion button 38 ... Chip / record player 41 ... Type information display field, 42 ... Name information field 43 ... Group name information field , 44 ... Comment information field 45 ... WAV data information field, 47 ... Flash selection button 48 ... Wired order field 51 ... Keynote effect field 52 ... Effect balance, 53 ... Real-time effector 54 ... Test BGM field 61 ... Flash movie Viewer 62 ... Flash movie list 71 ... Folder designation field, 72 ... File information field 81 ... Sound pack selection field 82 ... New sound pack creation button 8 ... Background movie selection field 84 ... Quantize timing designation field 91 ... Pack selection field 92 ... Pack new creation button 93 ... Chip list display field 94 ... Assign information field 100 ... Computer system 101 ... CPU, 102 ... Memory 103 ... Display controller 104 ... Input device interface 105 ... Network interface 107 ... External device interface, 108 ... Bus 109 ... Audio device interface 111 ... Display, 112 ... Keyboard, 113 ...
Mouse 114 ... Hard disk device 115 ... Media drive 116 ... Speaker 117 ... Equipment expansion interface, 118 ... Game controller

Front page continuation (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/91 H04N 5/91 CL (72) Inventor Junichiro Sakata 6-735 Kitashinagawa, Shinagawa-ku, Tokyo Soni -In-house F-term (reference) 5C025 AA30 CA02 CA09 CA18 CB10 DA10 5C053 FA14 FA23 GB06 GB11 JA01 KA05 KA24 LA06 LA11 LA15 5D378 CC01 SE35 TT00 TT22 TT31 XX05 XX11

Claims (16)

[Claims] 1. Editing / composition of contents composed of a plurality of layers by using an input device having a plurality of keys and a coordinate pointing device.
An information processing device for reproducing, wherein at least one layer is made up of a plurality of parameters, key assigning means for assigning content to each key, user input detecting means for detecting a user input operation for each key, Content output means for outputting the content corresponding to the key for which the user input is detected, a parameter operation plane for operating the parameters configuring the content, and configuring the content on the horizontal axis and the vertical axis on the parameter operation plane. Parameter assigning means for assigning each parameter, and in response to detecting a user input to a key assigned to a content made up of a plurality of parameters,
Preset means for presetting a coordinate pointing position of the coordinate pointing device to a position corresponding to each parameter value on the parameter operating plane, and the parameter operation according to each horizontal and vertical displacement amount in the coordinate pointing device. An information processing apparatus comprising: a parameter changing unit that changes parameter values assigned to a horizontal axis and a vertical axis on a plane. 2. The information processing apparatus according to claim 1, wherein the parameter assigning unit assigns parameters that do not interfere with each other to each axis. 3. The information processing apparatus according to claim 1, wherein the content output unit changes a parameter for content output in response to detection of a parameter changing operation by the parameter changing unit. . 4. A parameter operation plane display means for displaying the parameter operation plane on the screen is further provided, and an instruction point is displayed at a position corresponding to a current parameter value on the parameter operation plane, and a horizontal direction in the coordinate instruction device. The information processing apparatus according to claim 1, wherein the instruction point is moved according to each displacement amount in the vertical direction. 5. The content is an acoustic content including a plurality of performance layers such as a sound pattern, a one shot, and an effect, the effect is composed of a plurality of parameters, and the preset means corresponds to a key assigned to the effect. The information processing apparatus according to claim 1, wherein a coordinate pointing position of the coordinate pointing device is preset in response to detection of a user input. 6. The effect comprises a basic tone effect which is a basic tone of an acoustic effect, and an effect balance which sets a balance of various elements constituting the effect, wherein the parameter assigning means has an axis on one of the parameter operation planes. 6. The information processing apparatus according to claim 5, wherein the keynote effect is assigned to and the effect balance is assigned to the other axis. 7. The parameter operation plane display means displays the parameter operation plane on a screen in response to a user input to a key assigned to an effect being detected. The information processing device described. 8. An editing / editing of contents composed of a plurality of layers by using an input device having a plurality of keys and a coordinate pointing device.
An information processing method for reproducing, wherein at least one layer is composed of a plurality of parameters, a key assigning step for assigning content to each key, a user input detecting step for detecting a user input operation for each key, A content output step of outputting the content corresponding to the key in which the user input is detected, and a parameter assignment for allocating each parameter configuring the content to the horizontal axis and the vertical axis on the parameter operation plane for operating the parameters configuring the content In response to detecting user input for a step and a key assigned to a multi-parameter content,
A preset step of presetting a coordinate pointing position of the coordinate pointing device to a position corresponding to each parameter value on the parameter operation plane; and the parameter according to each horizontal and vertical displacement amount in the coordinate pointing device. A parameter changing step of changing a parameter value assigned to a horizontal axis and a vertical axis on the operation plane, the information processing method. 9. The information processing method according to claim 8, wherein in the parameter assigning step, parameters that do not interfere with each other are assigned to each axis. 10. The information processing method according to claim 8, wherein in the content output step, the parameter of the content output is changed in response to the detection of the parameter changing operation in the parameter changing step. . 11. A parameter operation plane display step of displaying the parameter operation plane on a screen is further provided, wherein an instruction point is displayed at a position corresponding to a current parameter value on the parameter operation plane, and a horizontal direction in the coordinate instruction device is displayed. 9. The information processing method according to claim 8, wherein the designated point is moved in accordance with each displacement amount in the vertical direction. 12. The content is acoustic content composed of a plurality of performance layers such as a sound pattern, one shot, and effect. The effect is composed of a plurality of parameters, and in the preset step, a key assigned to the effect. 9. The information processing method according to claim 8, wherein the coordinate pointing position of the coordinate pointing device is preset in response to the detection of a user input to the. 13. The effect comprises a basic tone effect which is a basic tone of an acoustic effect, and an effect balance for setting a balance of various elements constituting the effect. 13. The information processing method according to claim 12, further comprising allocating a basic tone effect to, and assigning an effect balance to the other axis. 14. The parameter operation plane display step displays the parameter operation plane on a screen in response to a user input to a key assigned to an effect being detected. Information processing method described. 15. A computer-readable form of computer software, which is described so as to execute edit / playback processing of content composed of a plurality of layers on a computer system using an input device having a plurality of keys and a coordinate pointing device. A storage medium physically stored in the computer, wherein at least one layer comprises a plurality of parameters, and the computer software detects a key assignment step of assigning contents to each key and a user input operation for each key. User input detection step, a content output step of outputting the content corresponding to the key for which the user input is detected, and a content operation on a horizontal axis and a vertical axis on a parameter operation plane for operating parameters constituting the content. Assign each constituent parameter Parameter assignment step and in response to detecting user input for a key assigned to a multi-parameter content,
A preset step of presetting a coordinate pointing position of the coordinate pointing device to a position corresponding to each parameter value on the parameter operating plane; A parameter changing step of changing a parameter value assigned to a horizontal axis and a vertical axis on a plane. 16. A computer program written so as to execute, on a computer system, an editing / reproducing process of content composed of a plurality of layers by using an input device having a plurality of keys and a coordinate pointing device. At least one layer is composed of a plurality of parameters and corresponds to a key assigning step for assigning contents to each key, a user input detecting step for detecting a user input operation for each key, and a key for which the user input is detected. A content output step of outputting the content, a parameter assigning step of assigning each parameter configuring the content to a horizontal axis and a vertical axis on a parameter operation plane for operating a parameter configuring the content, and a content consisting of a plurality of parameters. Assigned In response to the user input to the key is detected,
A preset step of presetting a coordinate pointing position of the coordinate pointing device to a position corresponding to each parameter value on the parameter operating plane; and the parameter operation according to horizontal and vertical displacement amounts in the coordinate pointing device. A parameter changing step of changing a parameter value assigned to a horizontal axis and a vertical axis on a plane.