JP4382786B2 - Audio mixdown device, audio mixdown program - Google Patents

Description

  The present invention relates to an audio mixdown device that synthesizes audio input in a karaoke device or the like, and an audio mixdown program.

Conventionally, a communication karaoke system has been conceived in which a user's singing voice is recorded prior to karaoke use, and even one person can enjoy chorus during karaoke performance (see Patent Document 1). In the communication karaoke system described in Patent Literature 1, the user records a singing voice while outputting the accompaniment music of the desired song at the user terminal prior to using the karaoke. The user terminal creates a singing track recording file including information such as the tempo and key at the time of recording, and associates the user ID and the music ID with each other and delivers them to the file storage server for storage. The karaoke performance device accesses the file storage server, obtains the song track recording file specified by the user ID and the song ID, takes out the accompaniment music of the same song recorded in the file from the karaoke database, The music and sound recorded in the file are acoustically output in synchronism, and the sound input to the microphone is mixed to output sound.
JP 2004-53736 A

  In the conventional communication karaoke system, the user himself / herself has to record a singing voice in advance at the user terminal and store it in a file storage server. In addition, the user can only use his / her singing voice (song track recording file) stored in the file storage server in advance when singing in the karaoke performance device. That is, it was not possible to perform chorus (including duets) with other users.

  The present invention has been made in view of the above-described circumstances, and an object of the present invention is to generate a sound of one piece of music by synthesizing a plurality of sounds including sounds recorded by other users. It is to provide a mixdown device.

The present invention relates to an audio file recorded from a plurality of devices connected via a network and recorded by a user singing along with a song in the device, and identification for each song added to the audio file. Voice file input means for inputting data and user data including gender and age related to the individual user who has input the voice of the voice file, and a plurality of voice files input by the voice file input means are added to the voice file. The identification data and the user data are stored in association with each other, and the identification data indicating the music to be synthesized and the user data are input from the device requesting synthesis of the audio file. Identification data input means; the identification data input by the identification data input means; and A plurality of audio files to which the common identification data and the user data stored in the audio file storage unit are added according to user data; and the plurality of audio files selected by the selection unit A synthesis target file designating unit that provides a file name list of the audio file to the device that requests synthesis of the audio file, and that allows the user of the device to designate the audio file to be synthesized from the file name list; Synthetic voice data generating means for performing effect processing on a plurality of audio files specified by the target file specifying means and synthesizing them to generate synthesized voice data; and synthesized voice data generated by the synthesized voice data generating means Synthetic voice data output to be output to the device that requires voice file synthesis Characterized by comprising and.

  According to the present invention, a plurality of audio files to which identification data (for example, song names) are added are stored, and a plurality of audio files to which common identification data is added are selected and synthesized from the plurality of audio files. Therefore, it is possible to synthesize a plurality of voices including voices recorded by other users, and generate voices of one piece of music as if, for example, chorus or duet is performed.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a system in the present embodiment. In the system shown in FIG. 1, the audio mixdown server 10 is connected to various devices such as a karaoke device 14, a mobile phone 16, a personal computer 18, and the like via a network 12. The network 12 includes various communication networks such as the Internet, a public line network (telephone line network), and a LAN (Local Area Network).

  The audio mixdown server 10 inputs and stores an audio file (hereinafter referred to as a recorded audio file) recorded in accordance with karaoke (accompaniment audio) from an apparatus connected via the network 12. A service is provided for synthesizing a plurality of recorded audio files selected in accordance with an instruction from a user received through the terminal, and generating, for example, the sound of one piece of music in which a plurality of users are choiring or duet. .

  The karaoke device 14, the mobile phone 16, and the mobile phone 16 have a communication function for connecting to the audio mixdown server 10 via the network 12. Further, the karaoke device 14, the mobile phone 16, and the mobile phone 16 output karaoke voice and record the karaoke function for inputting the voice sung by the user in accordance with the karaoke voice and the voice input by the karaoke function. It has a recording function. The recorded voice file of the voice recorded by this recording function is transmitted to the voice mixdown server 10 by the communication function.

  FIG. 2 is a block diagram showing a functional configuration of the audio mixdown server 10. The audio mixdown server 10 is realized by a computer, and implements various functions by executing a program stored in a storage device by a processor. The program prepared in the audio mixdown server 10 includes an audio mixdown program for realizing a function for synthesizing the audio of the recorded audio file.

  As shown in FIG. 2, the audio mixdown server 10 includes an audio file input unit 20, a mixdown control unit 21, a synthesis pattern list storage unit 22, an effect processing unit 23, a synthesized audio data output unit 24, and a list list output unit. 25, functions of a voting input unit 26, a totaling unit 27, and a recorded audio file database 28 are provided.

  The audio file input unit 20 inputs a recorded audio file transmitted from each device such as the karaoke device 14, the mobile phone 16, and the personal computer 18 through the network 12, and stores it in the recorded audio file database 28. The audio file input unit 20 also inputs caption data including various types of information related to the audio stored as the recorded audio file and user data including information related to the user (device user) who recorded the audio, along with the recorded audio file. Then, it can be stored in the recorded voice file database 28 in association with the recorded voice file.

  The mixdown control unit 21 synthesizes a plurality of recorded sound files stored in the recorded sound file database 28 in response to a sound mixdown request from the karaoke device 14, the mobile phone 16, the personal computer 18, etc. via the network 12. Down) to control the mixdown process for generating the sound of one piece of music. In addition, the mixdown control unit 21 stores the data in the database 28 based on the composite pattern list generated by executing the mixdown process in response to a request from the karaoke device 14, the mobile phone 16, the personal computer 18, or the like. A synthesized voice data output process for synthesizing the recorded voice file is controlled. In addition, the mixdown control unit 21 generates list list data by the list list output unit 25 and outputs the list list data, and the vote input by the user for the music corresponding to the list list data. Evaluation of the totaling result by the totaling unit 27 for data is executed. For example, an evaluation vote by a user who has listened to a music synthesized by the audio mixdown server 10 is accepted, and a virtual choral contest realized on the network is performed.

  The composite pattern list storage unit 22 stores the composite pattern list generated in the mixdown process. The synthesis pattern list includes data necessary for synthesizing a plurality of recording sound files stored in the recording sound file database 28 to generate sound of one music piece (see FIG. 4).

  The effect processing unit 23 synthesizes sounds of a plurality of recorded sound files stored in the recorded sound file database 28 under the control of the mixdown control unit 21 and applies various effects to the sound. Execute the process. The effect processing unit 23 performs not only individual effects that individually apply effects to a recording audio file to be synthesized, but also overall effects that apply effects to the entire audio after synthesizing the audio of a plurality of recording audio files. Can be executed.

  The synthesized voice data output unit 24 synthesizes (mixed down) the voice data (hereinafter referred to as synthesized voice data) by the effect processing unit 23 via the network 12, the karaoke equipment 14, the mobile phone 16, the personal computer 18, and the like. Output to.

  The list list output unit 25 generates list list data for displaying the combined pattern list based on the plurality of combined pattern lists stored in the combined pattern list storage unit 22, and the karaoke device 14, the mobile phone 16. Output to personal computer 18 or the like. In the karaoke device 14, the mobile phone 16, the personal computer 18, etc., the list list is displayed based on the list list data, and the user inputs an instruction to select the synthesized pattern list (synthesized music) and mixes the voice. Send to server 10.

  The voting input unit 26 inputs voting data indicating an evaluation result for the voice of the music synthesized by the voice mixdown server 10 (synthesized voice data) from the karaoke device 14, the mobile phone 16, the personal computer 18, and the like.

  The totaling unit 27 totals evaluation data from a plurality of devices (the karaoke device 14, the mobile phone 16, the personal computer 18, etc.) input by the voting input unit 26. For example, the evaluation data is aggregated for each of a plurality of songs that are the targets of the list list by the list list output unit 25, and the score is obtained, for example, as a virtual choral contest.

  The recorded voice file database 28 stores recorded voice files, caption data, user data, and the like input from the karaoke device 14, the mobile phone 16, the personal computer 18, and the like.

FIG. 3 is a diagram showing an example of the data format of data stored in the recorded audio file database 28.
As shown in FIG. 3, the recorded voice file database 28 stores a recorded voice file input through the voice file input unit 20, caption data input together with the recorded voice file, and user data in association with each other. The caption data includes, for example, data such as a music ID, a title, and an artist name as identification data for identifying a music stored as a recorded audio file. As this identification data, for example, data set for karaoke (voice data) used when voice is recorded in the karaoke device 14, the mobile phone 16, the personal computer 18, or the like is used. The caption data includes part data (soprano, alto, tenor, bass, chorus, narrative, etc.) and data indicating the presence / absence of effects as attribute data about the voice recorded by the user. When there is an effect, data indicating the effect type (reverb etc.) is added. It is assumed that the attribute data is input by the user's operation on an input device (button, keyboard, etc.) of the device when recording a sound in the device used by the user.

  The user data is data relating to the individual user who has input the voice of the recorded voice file, and includes data such as sex and age, for example. The user data may be input together with the caption data attribute data when recording the voice in the device used by the user, or registered in advance in the voice mixdown server 10 and the registered data is used. You may do it. When the audio mixdown server 10 is used through another system, for example, when the audio mixdown server 10 is accessed through a server that provides SNS (Social Networking Service), the server that provides this SNS User data registered in advance may be used.

FIG. 4 is a diagram illustrating an example of a data format of the composite pattern list stored in the composite pattern list storage unit 22.
The synthesis pattern list is generated when a plurality of voices are synthesized by a mixdown process to generate a voice of one music piece. In the synthesized voice data output process, a plurality of voices can be synthesized based on the synthesized pattern list in the same manner as the mixdown process to generate the voice of one piece of music.

  The synthesis pattern list shown in FIG. 4 is for the sound of one piece of music synthesized by the audio mixdown server 10, and the song data for identifying the synthesized voice and the recorded voice file to be synthesized are recorded. The file name, the individual effect indicating the effect type individually applied to the recorded audio file at the time of synthesis, and the entire effect data indicating the effect type applied to the entire synthesized audio are set in association with each other. . The song data includes, for example, a unique synthesized song ID set for the synthesized song and identification data (song ID, title) included in the recorded audio file to be synthesized. Shall.

Next, the operation in this embodiment will be described.
FIG. 5 is a diagram conceptually showing the mixdown process executed in the audio mixdown server 10. In the audio mixdown server 10, a plurality of recorded audio files input from the karaoke device 14, the mobile phone 16, the personal computer 18, etc. are stored in the recorded audio file database 28. Identification data for identifying the karaoke (musical piece) used when recording in each device is added to the recorded audio file. The voice mixdown server 10 selects a recorded voice file to which common identification data is added, that is, a voice to be synthesized from a plurality of voices recorded in accordance with the karaoke of the same music according to an instruction from the user. The audio mixdown server 10 performs a predetermined effect process on the selected plurality of recorded audio files and synthesizes them, so that the audio of one song is recorded by the recorded audio files registered by the plurality of users in the audio mixdown server 10. Is generated. Therefore, the user can arbitrarily select a recorded sound file recorded by another user to create a sound of a duet music that suits his / her preference, or has been sung by a number of people that cannot be realized in practice. You can also create music audio. Since the audio mixdown server 10 can perform effect processing when synthesizing the audio of a plurality of recorded audio files, the audio mixdown server 10 matches the plurality of recorded audio files to be synthesized, and combines them into one synthesized audio. An uncomfortable feeling can be prevented and an effect desired by the user can be added.

  First, a process for storing a recorded audio file in the audio mixdown server 10 from various devices such as the karaoke device 14, the mobile phone 16, and the personal computer 18 will be described. Hereinafter, a case where the program is executed in the personal computer 18 will be described as an example (assumed to be executed similarly in other devices such as the karaoke device 14 and the mobile phone 16).

  For example, when using a service provided by the audio mixdown server 10, that is, when trying to create a duet or choral voice with another person for a certain piece of music, the network 12 (Internet or the like) is used as a method of collecting the friends. SNS (Social Networking Service) provided via the Internet is used. For example, in a user who uses SNS, for example, a community related to a certain artist is created, and a song or artist to be duet or choral is presented in the community, and participants are recruited. Then, it requests the participants who wish to participate to transmit the recorded audio files of the voices sung for the corresponding music to the audio mixdown server 10. Also, instead of creating a specific community and recruiting participants, on the electronic bulletin board for unspecified users, present the music or artist that you want to duet or chorus, and request the provision of recorded audio files for the music You may do it.

  First, recording processing for creating a recorded audio file to be transmitted to the audio mixdown server 10 in a device such as the personal computer 18 will be described with reference to the flowchart shown in FIG.

  First, the personal computer 18 is activated with the karaoke function, and selects a karaoke (musical piece) to be used for recording sound according to an instruction from the user (step A1). For example, each music for which karaoke is prepared has a unique music ID (multi-digit number or the like), and the music is selected by specifying the music ID. It is assumed that karaoke (performance sound) used to create a recorded audio file to be transmitted to the audio mixdown server 10 is, for example, one created by a specific manufacturer. That is, even if it is the same music, since the karaoke length, composition, etc. differ for every maker, the user who uses the service of the audio mixdown server 10 uses karaoke that is shared with other predetermined users. To do.

  Next, the personal computer 18 selects the effect type used when recording the sound according to the user designation (step A2). The effect type includes, for example, reverb and can be arbitrarily designated by the user. Note that when synthesizing a plurality of recorded audio files in the audio mixdown server 10, individual effects can be specified for each recorded audio file, and therefore it is not always necessary to execute the effect processing.

  The personal computer 18 outputs karaoke voice and records voice by singing inputted by a microphone (not shown) (step A3). Here, the sung voice including the karaoke voice may be inputted and recorded by the microphone, or the karaoke voice is outputted from the headphones so that only the singer can listen, and only the sung voice is heard by the microphone. You may make it input and record. When recording including karaoke sound, when synthesizing multiple recorded sound files, some processing is required to prevent the karaoke sound part from affecting the sound of singing, so preferably only the singing sound is input. Shall be. In the following description, it is assumed that a recorded voice file is created only by voice from singing. The personal computer 18 records the input voice while outputting the karaoke voice (step A3). Here, when the type of effect processing to be executed at the time of recording is designated in advance, recording is performed while performing the designated effect processing on the input sound.

  When the karaoke voice ends, the personal computer 18 generates a recorded voice file of the recorded voice (step A4). Also, caption data and user data relating to the voice of the recorded voice file are input (steps A5 and A6). The caption data uses, for example, a song ID, title, and artist that are preset for karaoke used at the time of voice recording. In addition, for the data on the presence / absence of effect (effect type), the content specified by the user in step A2 is used. In addition, data such as a recorded voice part is input by an operation on an input device (such as a keyboard) by a user.

  The personal computer 18 transmits (uploads) the recorded audio file, caption data, and user data to the audio mixdown server 10 via the network 12 (step A7).

  When the audio file input unit 20 of the audio mixdown server 10 receives a recorded audio file, caption data, and user data from the personal computer 18, the audio file input unit 20 stores the audio file in association with the recorded audio file database 28.

Next, the mixdown process in the audio mixdown server 10 will be described with reference to the flowchart shown in FIG.
First, a file to be synthesized (mixed down) is selected from a plurality of recorded sound files stored in the recorded sound file database 28 (step B1). For example, the mixdown control unit 21 of the audio mixdown server 10 inputs data for designating music from the personal computer 18, for example, identification data such as music ID, title, artist name, and the like. The mixdown control unit 21 searches the caption data in the recorded voice file database 28 based on the identification data input from the personal computer 18 and extracts the corresponding recorded voice file.

  In addition, the mixdown control unit 21 inputs not only the identification data but also data such as the recorded voice part and the presence / absence of effects, and data specifying the gender and age of the recorded user from the personal computer 18. Thus, the recorded sound files searched from the recorded sound file database 28 can be narrowed down.

  The mixdown control unit 21 provides the personal computer 18 with a list of file names of the recorded sound files extracted from the recorded sound file database 28, and the user of the personal computer 18 uses the list of file names to be synthesized. To specify. Here, when the audition for the designated recorded audio file is requested (step B2, Yes), the mixdown control unit 21 reproduces the corresponding recorded audio file (part or all), and converts the audio data into The data is transmitted to the personal computer 18 via the network 12 (step B3). The personal computer 18 outputs a voice based on the voice data to make the user confirm.

  In response to the transmission of the music data, the mixdown control unit 21 confirms the recorded audio file as a synthesis target when a selection confirmation instruction is input from the personal computer 18 (step B4, Yes).

  Here, if the end of the selection of the recorded audio file is not instructed (No at Step B5), the mixdown control unit 21 causes the user to specify what is to be synthesized from the list in the file in the same manner as described above. By repeatedly executing the above processing, the user can specify an arbitrary number of recorded audio files. Here, since the user can audition the recorded voice file stored in the recorded voice file database 28 of the voice mixdown server 10, a plurality of voices can be synthesized (mixed down) according to his / her preference. It is possible to arbitrarily specify the recorded audio file.

  When the end of selection of the recorded audio file is instructed (step B5, Yes), the mixdown control unit 21 transmits data for displaying the effect type selection screen on the personal computer 18 to the personal computer 18. The personal computer 18 displays an effect type selection screen based on the data received from the mixdown control unit 21.

  FIG. 8A shows an example of an effect type selection screen (menu). In the example shown in FIG. 8A, a plurality of effect types such as compressor, reverb, chorus, time stretch,... Are listed as effect types. In addition, the effect type selection screen is provided with buttons that can be used to instruct whether to execute individual effects that apply effects to each recorded audio file or to execute overall effects that apply effects to the entire synthesized sound. (Not shown).

  Here, when an individual effect is selected through the effect type selection screen (step B7, Yes), the mixdown control unit 21 determines which of a plurality of previously selected recording audio files is to be subjected to the effect processing. Also, the effect type is designated by the user (steps B8 and B9). Depending on the effect type, the level can be specified separately. For example, in the case of reverb, a plurality of levels prepared in advance can be arbitrarily designated. The compressor adjusts the volume, and can adjust the volume level for each recorded audio file. Note that the time stretch is to adjust the length of the sound, and for example, the entire sound length is adjusted to be the same among a plurality of sounds. Time stretch is an effect for the entire effect, and cannot be specified for individual effects.

  The mixdown control unit 21 selects a recording sound file stored in the recording sound file database 28 in accordance with an instruction input from the personal computer 18 and also selects a type of effect processing executed by the effect processing unit 23. To do.

  Here, when the audition for the designated recorded audio file is requested (step B10, Yes), the mixdown control unit 21 performs the effect processing on the corresponding recorded audio file (part or all) by the effect processing unit 23. And the audio data is transmitted to the personal computer 18 via the network 12 (step B11). The personal computer 18 outputs a sound to which an effect has been applied based on the sound data and allows the user to confirm the sound.

  In response to the audio data transmission for trial listening, when the selection confirmation instruction is input from the personal computer 18, the mixdown control unit 21 determines the type of individual effect for the recorded audio file. On the other hand, if the user is not satisfied as a result of trial listening to the sound to which the effect has been applied, the user can set and listen to the individual effect in the same manner as described above. Here, in the same manner, individual effects can be set for a plurality of recorded audio files (steps B7 to B11).

  When the entire effect is selected through the effect type selection screen (step B12, Yes), the mixdown control unit 21 determines which type of effect processing is to be performed on a plurality of previously selected recording audio files. Designated by the user (step B13).

  Note that the overall effect is also specified by the user from the effect type selection screen shown in FIG. In the effect type selection screen, only effect types that can be used as overall effects can be specified. Further, when any effect is specified on the effect type selection screen, a selection screen (menu) that allows the user to easily specify the details of the effect may be prepared.

  FIG. 8 shows a display example of the selection screen when reverb is selected on the effect type selection screen. The selection screen shown in FIG. 8B is provided with a plurality of items for selecting how to apply reverb. In the example shown in FIG. 8B, buildings such as “XXX Hall” and “XX Hall” are prepared as items. That is, for example, an effect can be designated so as to generate a sound like a chorus by a plurality of users in a designated building. Thereby, even if the user does not have detailed knowledge about the effect, the user can acquire the sound to which the desired effect is added.

  The mixdown control unit 21 selects a recorded audio file stored in the recorded audio file database 28 in accordance with an instruction input from the personal computer 18 and is designated on the effect type selection screen for the effect processing unit 23. Set the type of effect processing.

  Here, when the audition about the designated recording sound file is requested (step B14, Yes), the mixdown control unit 21 applies the individual effect set to each of the corresponding plurality of recording sound files, Further, the sound after synthesizing (mixing down) the voices of a plurality of recorded voice files is reproduced after being subjected to the overall effect, and the voice data is transmitted to the personal computer 18 via the network 12 (step B15). . The personal computer 18 outputs a sound to which an effect has been applied based on the sound data and allows the user to confirm the sound.

  In response to the audio data transmission for trial listening, when the selection confirmation instruction is input from the personal computer 18, the mixdown control unit 21 determines the type of the entire effect for the recorded audio file. On the other hand, if the user is unsatisfied as a result of trial listening to the sound to which the effect has been applied, the user can set the individual effect or the entire effect in the same way as described above to make a trial listening.

  Here, when the selection of the effect type selection is instructed (step B16, Yes), the mixdown control unit 21 generates a synthesis pattern list as shown in FIG. 4 according to the contents selected so far. Then, it is stored in the composite pattern list storage unit 22 (step B17). It is assumed that unique data is set for the composite music ID included in the music data of the composite pattern list every time a new composite pattern list is created.

  In accordance with the contents set in the synthesis pattern list, the mixdown control unit 21 causes the effect processing unit 23 to synthesize the sounds of a plurality of recorded audio files with a predetermined effect. That is, the effect processing unit 23 applies the individual effect set to each of the plurality of recorded sound files selected as the synthesis target, and further synthesizes (mixes down) the sound of the plurality of recorded sound files. The synthesized voice data is generated by applying the entire effect to the. The synthesized voice data output unit 24 transmits (downloads) the synthesized voice data generated by the effect processing unit 23 to the personal computer 18 via the network 12 (step B18).

  Note that in the synthesis of sound for a plurality of recorded sound files by the effect processing unit 23, not only the individual effect specified by the user and the whole effect but also the effect processing for matching the plurality of recorded sound files is performed by the user. Even if there is no instruction from, it will be executed automatically. For example, by simply synthesizing a plurality of sounds, the sound may be distorted outside a predetermined dynamic range. For this reason, the effect processing unit 23 reduces the volume of the sound of each recorded sound file in accordance with the number of recorded sound files to be combined so that the combined sound falls within the dynamic range. For example, the greater the number of recorded audio files to be synthesized, the greater the volume reduction for the audio of each recorded audio file.

  Moreover, even if the voice length of the recorded voice file is recorded using the same karaoke voice, there is a possibility that variations may occur due to differences in performance or operating environment of the device that performed the recording. For this reason, in the overall effect, even if the execution of time stretching is not specified by the user, the sound length variation of a plurality of recorded sound files exceeds the preset allowable range (for example, 0.5 seconds). Alternatively, time stretching may be automatically executed. It should be noted that it can be omitted when the length variation of the entire voice is within the allowable range. In addition, the length of the voice can be adjusted as a target of time stretching partially, for example, for a predetermined time at the end of the voice, instead of the entire voice. In addition to simply adjusting the audio length, the audio length of each recorded audio file should be adjusted to match the change in audio, for example, the time when the volume of the corresponding audio part peaks. May be.

  For effects such as reverb, even when individual effects and overall effects are not set, effect processing with preset default settings may be automatically executed.

  In addition to the volume and length of the sound of the recorded sound file, as described above, the processing for matching is performed when combining multiple recorded sound files, such as the pitch of the recorded sound. And

  In the above description, trial listening is possible for each of the individual effects and the entire effect. However, if the processing load is large and processing takes time, the processing for trial listening may be omitted. In other words, the user can specify the types of individual effects and overall effects for a plurality of recorded audio files selected for synthesis, apply the effect processing according to this specification, and synthesize and synthesize the audio of each recorded audio file Generate audio data.

  In this way, the user of the personal computer 18 can obtain synthesized voice data for one piece of music generated using a recorded voice file uploaded by another user stored in the voice mixdown server 10. it can. The personal computer 18 can output sound such as duet or choral with other users based on the synthesized sound data downloaded from the sound mixdown server 10.

Next, the synthesized voice data output process in the voice mixdown server 10 will be described with reference to the flowchart shown in FIG.
When the voice mixdown server 10 generates synthesized voice data based on a plurality of recorded voice files by the mixdown process, a synthesized pattern list including data necessary for generating the synthesized voice data is stored in the synthesized pattern list. Store in the unit 22. The audio mixdown server 10 can generate the same data as the synthesized audio data generated in the mixdown process based on the synthesis pattern list stored in the synthesis pattern list storage unit 22 at an arbitrary timing. . Therefore, the user can obtain a song created (mixed down) by another user based on a plurality of recorded audio files by designating the synthesis pattern list. Moreover, even if the audio | voice mixdown server 10 in this embodiment produces | generates synthetic | combination audio | voice data according to the request | requirement from many users, since synthetic | combination audio | voice data itself is not accumulate | stored, it is not necessary to consume a large amount of storage capacity.

  This embodiment demonstrates as what implements the virtual choral contest for the music which the some user created (mixed down), for example.

  It is assumed that the audio mixdown server 10 is set in advance with music (synthetic pattern list) that is the subject of the choral competition. For example, a synthetic pattern list of songs that meet conditions such as the same music (title) and the same artist may be extracted and set as the target of the choral contest, or the user may request participation in the choral contest and participate You may set the synthetic pattern list of the target music. Other setting methods may be used.

  The list list output unit 25 receives, for the personal computer 18, list data (list list data) for music (synthetic pattern list) set in advance as a target of the choral contest under the control of the mixdown control unit 21. Output (step C1). Based on the list list data, the personal computer 18 displays a list list of songs generated by the mixdown in the audio mixdown server 10.

  The personal computer 18 notifies the audio mixdown server 10 when any one of the lists is selected according to an instruction from the user. In response to the notification from the personal computer 18, the mixdown control unit 21 selects a corresponding composite pattern list stored in the composite pattern list storage unit 22 (step C2), and the effect processing unit 23 according to this composite pattern list. A composite pattern list is generated (step C3). The effect processing unit 23 generates synthesized voice data by synthesizing voices of a plurality of recorded voice files in the same manner as the above-described mixdown process.

  The synthesized voice data output unit 24 outputs the synthesized voice data generated by the effect processing unit 23 to the personal computer 18. The personal computer 18 inputs and reproduces the synthesized voice data from the voice mixdown server 10.

  The personal computer 18 receives the synthesized voice data corresponding to this list by the user specifying the synthesized pattern list from the list list in the same manner as described above, and the synthesized voice data generated by the mixdown. Can be input and played.

  In this way, the user of the personal computer 18 can check the music generated on the audio mixdown server 10 based on the plurality of recorded audio files. Then, the voting data representing the evaluation for each song can be transmitted to the audio mixdown server 10.

  The voting input unit 26 of the audio mixdown server 10 inputs the voting data transmitted from the personal computer 18 (step C6). The totaling unit 27 totals the voting data input by the voting input unit 26 for each composite pattern list included in the list list transmitted by the list list output unit 25 (step C7).

  The tabulation unit 27 tabulates the voting data transmitted by a plurality of users for each composite pattern list, determines the tabulation result within a predetermined period, for example, and determines the rank, for example. The audio mixdown server 10 transmits the count result (rank) to the user who transmitted the voting data or the user who generated the music to be the subject of the choral contest.

  In this way, the audio mixdown server 10 generates synthesized audio data based on the synthesis pattern list, transmits it to devices such as the karaoke device 14, the mobile phone 16, the personal computer 18, and the like, and generates it by the mixdown. It is possible to input and aggregate evaluations for the selected music pieces. Thereby, it can be expected that more users will use the service provided by the audio mixdown server 10 with interest.

  In the above description, the voting data is received in the virtual choral contest. However, the list of the composite pattern list stored in the composite pattern list storage unit 22 can be arbitrarily viewed by the user through the network 12. Therefore, it is also possible to output the synthesized voice data generated according to the selected synthesis pattern list and accept the evaluation result.

  Further, in the above description, the audio mixdown server 10 is described as inputting a recording audio file from the karaoke device 14, the mobile phone 16, the personal computer 18, and the like and synthesizing (mixing down) the karaoke device. 14. In the devices such as the mobile phone 16 and the personal computer 18, the recording voice file may be synthesized as described above. For example, the karaoke device 14 stores a voice input in accordance with karaoke in normal use in a recorded voice file database as a recorded voice file. The karaoke device 14 synthesizes a plurality of recording sound files (sounds of the same music with common identification data) designated by the user from the recording sound file database to generate sound of one music. The generated voice may be output from the karaoke device 14 or may be output to the outside as a voice file. Further, the karaoke device 14 may synthesize the voice generated based on the plurality of recorded voice files and the karaoke of the corresponding music and output the synthesized voice as karaoke voice. Further, the karaoke device 14 may synthesize a sound not only for a directly recorded audio file but also for a recorded audio file input from another device via the network 12. The same processing as described above can also be executed in devices such as the mobile phone 16 and the personal computer 18.

  In the above description, the case of synthesizing (mixing down) a voice by singing has been described as an example. However, the present invention can also be applied to the case of synthesizing other sounds such as instrument sounds.

  Further, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  In addition, the method described in the embodiment uses, as a program (software means) that can be executed by a computer, for example, a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), and a semiconductor memory. It can also be stored in a storage medium (ROM, RAM, flash memory, etc.) or transmitted via a communication medium for distribution. The program stored on the medium side also includes a setting program that configures in the computer software means (including not only the execution program but also a table and data structure) that is executed by the computer. A computer that implements the present apparatus reads the program stored in the storage medium, constructs software means by a setting program in some cases, and executes the processing described above by controlling the operation by the software means. The storage medium referred to in this specification is not limited to distribution, and includes storage media such as a magnetic disk and a semiconductor memory provided in a computer or in a device connected via a network.

The block diagram which shows the structure of the system in embodiment of this invention. The block diagram which shows the function structure of the audio | voice mixdown server 10 in this embodiment. The figure which shows an example of the data format of the data memorize | stored in the sound recording file database. The figure which shows an example of the data format of the synthetic pattern list memorize | stored in the synthetic pattern list memory | storage part 22. FIG. The figure which shows notionally the mixdown process performed in the audio | voice mixdown server 10. FIG. The flowchart for demonstrating the recording process which produces a recording audio | voice file. The flowchart for demonstrating a mixdown process. The figure which shows an example of an effect kind selection screen (menu). The flowchart for demonstrating a synthetic | combination audio | voice data output process.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Voice mixdown server, 12 ... Network, 14 ... Karaoke apparatus, 16 ... Mobile phone, 18 ... Personal computer, 20 ... Voice file input part, 21 ... Mixdown control part, 22 ... Synthetic pattern list storage part, 23 ... Effect processing unit 24... Synthesized voice data output unit 25. List list output unit 26. Voting input unit 27 27 totaling unit 28.

Claims (6)

An audio file recorded from a plurality of devices connected via a network and recorded by the user in accordance with the music sung by the user, identification data for each music added to the audio file, and the audio Audio file input means for inputting user data including gender and age related to the individual user who has input the audio of the file;
Voice file storage means for storing a plurality of voice files input by the voice file input means in association with the identification data added to the voice file and the user data;
Identification data input means for inputting the identification data indicating the music to be synthesized and the user data from the device that requests synthesis of the audio file;
In accordance with the identification data and the user data input by the identification data input means, a plurality of audio files to which the common identification data and the user data stored in the audio file storage means are added are selected. Selection means to
A file name list of the plurality of audio files selected by the selection unit is provided to the device requesting synthesis of the audio file, and the audio file to be synthesized is designated by the user of the device from the file name list A synthesis target file specifying means to be
A synthesized voice data generating means for generating a synthesized voice data by performing effect processing and synthesizing a plurality of voice files designated by the synthesis target file designation means;
An audio mixdown apparatus, comprising: synthesized voice data output means for outputting the synthesized voice data generated by the synthesized voice data generating means to the device that requests synthesis of a voice file. The synthesized voice data generating means includes
From the device that requests the synthesis of the audio file, execution of individual effects for individually performing the effect processing on the plurality of audio files designated as synthesis targets and the overall effect for performing the effect processing on the entire synthesized audio 2. The audio mixdown device according to claim 1, wherein an instruction is input, and the individual effect and the overall effect are selectively executed in accordance with the instruction. List generation means for generating a synthesis pattern list in which data necessary for generating synthesized voice data by the synthesized voice data generating means is stored;
A synthetic pattern list storage unit that stores the synthetic pattern list generated by the list generation unit;
The synthesized voice data generation unit generates the synthesized voice data by synthesizing a plurality of voice files stored in the voice file storage unit based on a synthesis pattern list stored in the synthesis pattern list storage unit. The audio mixdown device according to claim 1. Further comprising effect type input means for inputting designation of the type of effect processing executed by the synthesized voice data generating means,
3. The audio mixdown apparatus according to claim 1, wherein the synthesized audio data generation unit executes an effect process of a type corresponding to the designation input by the effect type input unit. Input means for inputting data indicating evaluation of the synthesized voice data output by the synthesized voice data output means;
4. A tally unit for tallying evaluation results for each of a plurality of synthetic pattern lists stored in the synthetic pattern list storage unit based on data input by the input unit. The audio mixdown device described. Computer
An audio file recorded from a plurality of devices connected via a network and recorded by the user in accordance with the music sung by the user, identification data for each music added to the audio file, and the audio Audio file input means for inputting user data including gender and age related to the individual user who has input the audio of the file;
Voice file storage means for storing a plurality of voice files input by the voice file input means in association with the identification data added to the voice file and the user data;
Identification data input means for inputting the identification data indicating the music to be synthesized and the user data from the device that requests synthesis of the audio file;
In accordance with the identification data and the user data input by the identification data input means, a plurality of audio files to which the common identification data and the user data stored in the audio file storage means are added are selected. Selection means to
A file name list of the plurality of audio files selected by the selection unit is provided to the device requesting synthesis of the audio file, and the audio file to be synthesized is designated by the user of the device from the file name list A synthesis target file specifying means to be
A synthesized voice data generating means for generating a synthesized voice data by performing effect processing and synthesizing a plurality of voice files designated by the synthesis target file designation means;
A voice mixdown program for causing the synthesized voice data generated by the synthesized voice data generating means to function as a synthesized voice data output means for outputting the synthesized voice data to the device that requests synthesis of a voice file.

Images