JP2014063145A - Environmental sound synthesizer, environmental sound transmission system, environmental sound synthesizing method, environmental sound transmission method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently transmit environmental sound such as applause, hand-clapping sound, cheering, calling out or the like recorded at a transmission source and to reproduce the atmosphere of the transmission source at a transmission destination.SOLUTION: An environmental sound synthesizer that produces environmental sound by acquiring environmental sound volume parameter relating to the sound volume of an acoustic signal of a transmission source from an environmental sound analysis apparatus, comprises: a data reception part configured to receive an environmental sound volume parameter from the environmental sound volume analysis apparatus; a data reception part configured to receive an environmental sound volume parameter from the environmental sound analysis apparatus; a template storage section configured to store a template for environmental sound for one frame (hereinafter referred to as template) and information corresponding to the volume of the environmental sound of the template; and an audio source synthesizing section configured to produce environmental sound by selecting from the template storage section a template that has the same sound volume as the environmental sound volume parameter and synthesizing the selected template.

Description

  The present invention relates to an environmental sound synthesizer, an environmental sound transmission system, an environmental sound synthesis method, an environmental sound transmission method, and a program for reproducing environmental sound collected at a transmission source at a transmission destination.

  A technique for synthesizing and outputting multiple applause sounds to synchronize with a single user using individual differences calculated based on measured data and the degree of fluctuation in speed and size has been proposed (non- Patent Document 1). Also, an acoustic coding technique is known as a technique for transmitting and reproducing sound at a certain point to another place. For example, in Non-Patent Document 2, a low bit rate is achieved by a model that uses sound masking skillfully and copies the low-frequency component to the high frequency using the characteristics of the musical instrument. High quality acoustic coding techniques have been proposed.

Ryuichi Nishimura, Tsutomu Miyazato, “Synthesis of clap sound by virtual group”, IEICE Technical Report, IEICE, March 1999, MVE, Multimedia and Virtual Environment Basics, 98 (684), p .17-24, Stefan Meltzer and Gerald Moser, "MPEG-4 HE-AAC v2-audio coding for today's digital media world," EBU technical review, Jan., 2006.

  Non-Patent Document 1 is intended to virtually realize an environment in which a plurality of people who are synchronized with a user are present, and a virtual applause sound is generated in accordance with the pitch of a user's applause. It is a technology to synthesize, and it was impossible to transmit and reproduce the actual situation of the remote place (applause sound and clapping) to another place. Also, it is not intended to transmit and reproduce environmental sounds other than clapping sounds such as cheering and shouting. In addition, environmental sounds such as applause, cheering, and cheering sounds are close to white noise, unlike pure voices and instrument sounds, so they cannot be expressed well with conventional acoustic coding techniques such as Non-Patent Document 2 and sound quality deteriorates. Was. Therefore, in the present invention, an environmental sound synthesizer capable of efficiently transmitting environmental sounds such as applause, hand clapping, cheering and shout collected at the transmission source, and reproducing the atmosphere of the transmission source at the transmission destination. The purpose is to provide.

  An environmental sound synthesizer according to the present invention is characterized in that an environmental sound is generated by acquiring an environmental sound volume parameter related to a sound volume of a transmission source acoustic signal from an environmental sound analyzer, and a data receiving unit, a template storage unit, a sound source And a synthesis unit.

  The data receiving unit receives an environmental sound volume parameter from the environmental sound analyzer. The template storage unit stores an environmental sound template for one frame (hereinafter referred to as a template) and information corresponding to the volume of the environmental sound of the template in association with each other. The sound source synthesis unit selects a template having the same volume level as the environmental volume parameter from the template storage unit, and synthesizes the selected template to generate an environmental sound.

  According to the environmental sound synthesizer of the present invention, it is possible to efficiently transmit environmental sounds such as applause, hand clapping sound, cheering and shout collected at the transmission source, and to reproduce the atmosphere of the transmission source at the transmission destination. it can.

The block diagram which shows the structural example of the environmental sound transmission system of this invention. 1 is a block diagram showing a configuration of an environmental sound analyzer of Example 1. FIG. 3 is a flowchart showing the operation of the environmental sound analysis apparatus according to the first embodiment. FIG. 6 is a block diagram illustrating a configuration of an environmental sound analysis apparatus according to a second embodiment. 9 is a flowchart showing the operation of the environmental sound analysis apparatus according to the second embodiment. The figure which illustrates the parameter production | generation procedure of the parameter conversion part of Example 2. FIG. 9 is a block diagram illustrating a configuration of an environmental sound analyzer according to a first modification of the second embodiment. 9 is a flowchart showing the operation of the environmental sound analysis apparatus according to the first modification of the second embodiment. FIG. 9 is a block diagram illustrating a configuration of an environmental sound synthesizer according to a third embodiment. 9 is a flowchart illustrating the operation of the environmental sound synthesizer according to the third embodiment. FIG. 9 is a block diagram illustrating a configuration of an environmental sound synthesizer according to a fourth embodiment. 10 is a flowchart showing the operation of the environmental sound synthesizer of the fourth embodiment. The figure which illustrates the environmental sound segment template synthetic | combination procedure of the sound source synthetic | combination part of Example 4. FIG. The block diagram which shows the structure of Example 5 and the environmental sound analyzer of the modification. The flowchart which shows operation | movement of the environmental sound analyzer of Example 5 and its modification. The figure which illustrates the time change of the frequency component of a clapping sound and a clapping sound. FIG. 10 is a block diagram illustrating a configuration of an environmental sound synthesizer according to a sixth embodiment. 10 is a flowchart showing the operation of the environmental sound synthesizer of the sixth embodiment. The block diagram which shows the structure of the environmental sound synthesizer of Example 7,8. 10 is a flowchart showing the operation of the environmental sound synthesizer according to the seventh and eighth embodiments. The figure which illustrates the example which matches and memorize | stores an environmental sound segment template and an output probability in a template memory | storage part.

  Hereinafter, embodiments of the present invention will be described in detail. In addition, the same number is attached | subjected to the structure part which has the same function, and duplication description is abbreviate | omitted.

  The total volume of environmental sounds such as clapping, clapping, cheering and shouting increases as the number of spectators increases. In the present invention, the environmental sound itself is not transmitted, but only information representing the volume of the environmental sound is transmitted. Then, the environmental sound template stored in advance at the transmission destination is converted in accordance with the information indicating the volume, thereby reproducing the environmental sound (similar sound) of the transmission source.

  In addition, a single applause or one beat of a clapping sound (to strike both hands once) has a small individual difference in acoustic power. Moreover, the individual difference of the time interval between 1 beat and 1 beat (henceforth an applause interval) is also small, and is about 200 ms-300 ms. Therefore, a certain person's applause sound (for one beat) is prepared as an environmental sound segment template, and it is repeatedly reproduced at intervals given fluctuations (200 ms to 300 ms) according to individual differences. A sound similar to a human applause sound can be formed.

<Environmental sound transmission system>
The environmental sound transmission system of the present invention will be described below with reference to FIG. FIG. 1 is a block diagram showing a configuration example of an environmental sound transmission system according to the present invention. As shown in FIG. 1, the environmental sound transmission system according to the present invention includes a transmission source environmental sound analysis device and a transmission destination environmental sound synthesis device. The environmental sound analyzer extracts and outputs information corresponding to the volume of the input acoustic signal (environmental sound) (environmental volume parameter P _j , also simply referred to as parameter hereinafter). The environmental sound synthesizer synthesizes and outputs the environmental sound by converting the template according to the input environmental sound volume parameter P _j using the environmental sound template stored in advance. Hereinafter, the environmental sound analysis device 1 in the first embodiment, the environmental sound analysis device 2 in the second embodiment, the environmental sound analysis device 2 ′ in the first modification of the second embodiment, the environmental sound synthesis device 3 in the third embodiment, and the fourth embodiment. Environmental sound synthesizer 4 in Example 5, environmental sound analysis device 5 in Example 5, environmental sound synthesizer 6 in Example 6, environmental sound synthesizer 7 in Example 7, environmental sound synthesizer 8 in Example 8, and Example 9 The environmental sound synthesizer 9 and the environmental sound synthesizer 10 in the tenth embodiment will be described. The combination of the environmental sound analysis device 1 and the environmental sound synthesis device 3 is the environmental sound transmission system 1000, and the combination of the environmental sound analysis device 2 and the environmental sound synthesis device 3 is the environmental sound transmission system 2000, and the environmental sound analysis device 2 ′. The combination of the environmental sound synthesizer 3 and the environmental sound transmission system 2000 ', and the combination of the environmental sound analysis device 1 and the environmental sound synthesizer 4 are the environmental sound transmission system 3000, the environmental sound analysis device 2 and the environmental sound synthesizer 4. The environmental sound transmission system 4000, the combination of the environmental sound analysis device 2 ′ and the environmental sound synthesis device 4 is the environmental sound transmission system 4000 ′, and the combination of the environmental sound analysis device 5 and the environmental sound synthesis device 6 is the environmental sound transmission. Called system 5000.

  Hereinafter, the environmental sound analysis apparatus according to the first embodiment of the present invention will be described with reference to FIGS. FIG. 2 is a block diagram showing the configuration of the environmental sound analyzer 1 of this embodiment. FIG. 3 is a flowchart showing the operation of the environmental sound analyzer 1 of the present embodiment. As shown in FIG. 2, the environmental sound analyzer 1 according to the present embodiment includes a sound collection unit 11, a volume calculation unit 12, a parameter conversion unit 13, and a data transmission unit 14.

<Sound Collection Unit 11>
The sound collection unit 11 collects the transmission source sound (S11). Here, it is assumed that the applause sound of the transmission source is input to the sound collection unit 11.

<Volume calculator 12>
The volume calculation unit 12 acquires an acoustic signal of applause sound. The sound signal of the clap sound acquired by the volume calculation unit 12 is a signal sequence sampled at a predetermined sampling frequency. Here, X _j is an acoustic signal of the j-th frame, and X _j = (x _j (1), x _j (2),..., X _j (N)) (N is the number of samples per frame). For example, if 8 frames are sampled and one frame is 20 ms, N = 160. If a shorter delay is better, the frame length is shortened. If a longer delay is acceptable, the frame length is increased. The volume calculation unit 12 obtains and outputs a value corresponding to the volume of the input sound signal of the applause sound (hereinafter also referred to as “value corresponding to the applause volume”) for each frame. Specifically, the volume calculation unit 12 calculates the average energy of the input clapping sound signal X _j = (x _j (1), x _j (2),..., X _j (N)) for each frame.

Is calculated (S12).

<Parameter converter 13>
The parameter conversion unit 13 acquires a value corresponding to the applause volume output from the volume calculation unit 12. The parameter conversion unit 13 quantizes the value corresponding to the acquired applause volume and outputs an environmental volume parameter. Specifically, the parameter conversion unit 13 sets the minimum value to 0 and the maximum when the range (for example, x _j (i) (i = 1, 2,..., N)) that can be taken by the average energy E _j is 16 bits with a sign. value is quantized to the number (e.g. 16bit) when predetermined to be 2 ^ 30), and outputs the index as the environmental sound level parameter _{P j} (S13).

<Data transmission unit 14>
The data transmission unit 14 transmits the environmental sound volume parameter P _j output from the parameter conversion unit 13 to the environmental sound synthesizer 3 (or 4) as the transmission destination (S14). The environmental sound synthesizer 3 is described in the third embodiment, and the environmental sound synthesizer 4 is described in the fourth embodiment.

  Thus, according to the environmental sound analyzer 1 of the present embodiment, the applause sound collected at the transmission source can be efficiently transmitted with low delay.

[Operation Example 2 of Example 1]
In the first embodiment described above, an example of the operation of the environmental sound analysis apparatus 1 that analyzes the applause sound of the transmission source has been described as an example of the environmental sound of the transmission source. However, the present invention is not limited to this. It is also possible to target environmental sounds. For example, cheering or shouting may be used as the environmental sound, or an acoustic signal (including noise) obtained by removing the main content sound at the transmission source site from the sound collected at the transmission source may be used as the environmental sound.

  The environmental sound analysis apparatus 1 in the operation example 2 of the first embodiment includes the applause sound and the applause volume handled by each of the sound collection unit 11, the volume calculation unit 12, the parameter conversion unit 13, and the data transmission unit 14 of the environmental sound analysis device 1. However, it is the same as the above-described operation example except that it is replaced with the environmental sound and the volume of the environmental sound.

  While applause, cheering, cheering, and noise are all important factors that determine the atmosphere of the venue of the transmission source, they are signals close to white noise mixed with various acoustic signals. As described above, these sounds are called environmental sounds. If the timing and volume at which the environmental sound is generated at the transmission source are maintained, the atmosphere of the field can be reproduced even if the signal itself is not exactly the same signal as the environmental sound of the transmission source. Thus, the environmental sound analyzer 1 can efficiently transmit the environmental sound collected at the transmission source with low delay by extracting the parameter related to the volume of the environmental sound of the transmission source.

  Hereinafter, the environmental sound analysis apparatus according to the second embodiment of the present invention will be described with reference to FIGS. 4, 5, and 6. FIG. 4 is a block diagram showing the configuration of the environmental sound analyzer 2 of this embodiment. FIG. 5 is a flowchart showing the operation of the environmental sound analyzer 2 of the present embodiment. FIG. 6 is a diagram illustrating a parameter generation procedure of the parameter conversion unit 23 of the present embodiment. As shown in FIG. 4, the environmental sound analysis device 2 of this embodiment includes a sound collection unit 11, a volume calculation unit 12, a parameter conversion unit 23, and a data transmission unit 14. Since the sound collection unit 11, the sound volume calculation unit 12, and the data transmission unit 14 are the same as the components having the same numbers in the environmental sound analyzer 1 of the first embodiment, the description thereof will be omitted as appropriate.

<Volume calculator 12>
The sound volume calculation unit 12 is a signal sequence sampled by 48 kHz sampling, and a signal sequence X _j = (x _j (1), x _j (2),. x _j (6)) is acquired. For each frame, the volume calculation unit 12 calculates the average energy from the input applause sound signal X _j = (x _j (1), x _j (2),..., X _j (6)).

Is calculated (S12).

<Parameter converter 23>
The parameter conversion unit 23 obtains a sequence F _j obtained by transforming the obtained average energy E _j by the following expression.

That is, as shown in FIG. 6, a negative sign is given to an odd value among the possible values (0 to 32768) of F _j converted to an integer value by a Gaussian function or a floor function, and 1 is further reduced. As a result, all F _j take even values. Next, each of F _j , which is all even, is divided by 2 (a 1-bit shift to the right may be used). This value is set to G. In order to keep within the range of 711, if μ-law is used, a value G _j is obtained by further dividing by 2 (may be shifted to the right by 1 bit). For G, ITU-T_G. 711 is performed, and G _{j is changed} to G.G. It is converted into a code (number) 711. Since equivalent to one sample of 8kHz when the 48kHz sampling 6 samples in loaf (1 frame), G. per above _{G j} One of 711 symbols can be assigned. The assigned symbol string is output as the parameter P _j (S23). When the parameter P _j is transmitted using a fixed telephone line as in the case of normal voice, the delay is shortened. A logarithm may be used instead of equation (1) as in equation (2).

  In addition, square root calculation and logarithmic calculation may reduce the amount of calculation by polynomial approximation (Taylor expansion etc.).

[Modification 1 of Embodiment 2]
Hereinafter, a description will be given of an environmental sound analysis apparatus according to Modification 1 in which the parameter conversion unit 23 according to Embodiment 2 is modified with reference to FIGS. 7 and 8. FIG. 7 is a block diagram showing the configuration of the environmental sound analyzer 2 ′ of the present modification. FIG. 8 is a flowchart showing the operation of the environmental sound analysis apparatus 2 ′ of this modification. As shown in FIG. 7, the environmental sound analysis device 2 ′ of the present modification includes a sound collection unit 11, a sound volume calculation unit 12, a parameter conversion unit 23 ′, and a data transmission unit 14. Since the sound collection unit 11, the sound volume calculation unit 12, and the data transmission unit 14 are the same as the components with the same numbers in the environmental sound analysis device 2 of the second embodiment, description thereof will be omitted as appropriate.

<Parameter converter 23 '>
Parameter conversion unit 23 ', instead of mapping operations as in FIG. 6, has previously provided a mapping table 23A that maps directly 8bit symbol value of 0 to 32,768 which can be taken of the _{F j,} referring to the mapping table 23A Then, the parameter P _j is obtained (S23 ′). Alternatively, the parameter conversion unit 23 ′ may obtain the parameter P _j by using the mapping table 23A after reducing the number of cases where the value of F _j can be 0 to 32768 by bit shift or the like in advance. In this case, the size of the mapping table 23A can be reduced. F _j converted to decibel units may be used.

The environmental sound analyzers according to the second embodiment and the first modification have the following effects. Since the acoustic signal of the collected clap sound has a positive value, the range of the value of the square root of E _j is a positive integer value, for example, x _j (n) (n = 1, 2,..., N) When 16 bits are signed, the minimum value is 0 and the maximum value is 32768. As it is, the parameter conversion unit performs ITU-T_G. When the encoding of 711 is performed, there is a problem that the encoding efficiency deteriorates. When the above formula (1) is modified, for example, when x _j (n) (n = 1, 2,..., N) is 16 bits with a sign, the range that F _j can take is from 16384 to 16384. Therefore, the encoding efficiency can be improved by using the value F _j converted so that the range that E _j can take from the negative integer value to the positive integer value in the parameter conversion unit, and the parameter P The information amount of _j can be reduced. That is, transmission delay can be further reduced.

[Operation Example 2 of Example 2]
In the above-described second embodiment and the first modification of the second embodiment, an example of the operation of the environmental sound analysis apparatus 2 (2 ′) that analyzes the applause sound as an example of the environmental sound of the transmission source. Although described, the present invention is not limited to this, and environmental sounds other than applause sounds may be targeted. For example, cheering or shouting may be used as the environmental sound, or an acoustic signal (including noise) obtained by removing the main content sound at the transmission source site from the sound collected at the transmission source may be used as the environmental sound.

  In the operation example 2 of the second embodiment, applause sounds handled by the sound collection unit 11, the sound volume calculation unit 12, the parameter conversion unit 23 or 23 ′, and the data transmission unit 14 of the environmental sound analysis device 2 (2 ′) It is the same as the above-described operation example, except that the applause volume is replaced with the environmental sound and the environmental sound volume.

  Hereinafter, an environmental sound synthesizer according to a third embodiment of the present invention will be described with reference to FIGS. 9 and 10. FIG. 9 is a block diagram showing the configuration of the environmental sound synthesizer 3 of this embodiment. FIG. 10 is a flowchart showing the operation of the environmental sound synthesizer 3 of this embodiment. As shown in FIG. 9, the environmental sound synthesizer 3 according to the present embodiment includes a data reception unit 31, a sound source synthesis unit 32, a template storage unit 33, and a reproduction unit 34. The environmental sound synthesizer 3 is an apparatus that generates an environmental sound by acquiring an environmental volume parameter related to the volume of the transmission source acoustic signal from the environmental sound analyzer 1 (2, 2 '). Hereinafter, in accordance with the operation example described in detail in the first and second embodiments, the explanation will be made using applause sound as an example of the environmental sound.

<Data receiving unit 31>
Data receiving unit 31 receives the environmental sound level parameters _{P j} from the environmental sound analysis device (S31).

<Template storage unit 33>
The template storage unit 33 stores templates of a plurality of clap sounds (for one frame) for each volume variation of the clap sounds. That is, in the template storage unit 33, when i is a frame index, an environmental sound template T _i including applause sound for one frame and information E ′ _i corresponding to the volume of the environmental sound of the template are stored. Assume that they are stored in association with each other. Note that the value corresponding to the volume of the environmental sound of the template can be obtained by the same method as the volume calculation unit 12 and the parameter conversion unit 13 (23) of the first or second embodiment with each template _Ti as an input. It should be noted that which method of Embodiment 1 or 2 is used is unified between the environmental sound analyzer and the environmental sound synthesizer.

<Sound source synthesis unit 32>
The sound source synthesis unit 32 randomly selects one of the templates having the same volume level as the input environmental volume parameter P _j from the template storage unit 33. That is, one of the templates T _{i associated} with E ′ _i satisfying P _j = E ′ _i is selected at random. The sound source synthesizer 32 interpolates the selected template with the previous frame as necessary, and synthesizes an acoustic signal for one frame to generate an environmental sound (applause sound in this operation example) (S32). . For example, if there is an 8-bit variation in the environmental sound volume parameter per 20 ms frame, the applause sound can be transmitted at 400 bits / sec.

<Playback unit 34>
The reproducing unit 34 reproduces the clap sound synthesized by the sound source synthesizing unit 32 (S34).

  Thus, according to the environmental sound synthesizer 3 of the present embodiment, the template storage unit 33 holds a plurality of templates for each volume variation of the applause sound, and the sound source synthesizer 32 satisfies the volume condition. Since one template is randomly selected from a plurality of templates, the synthesized applause sound can be prevented from being heard as a steady pattern.

[Operation Example 2 of Example 3]
In the third embodiment, an example of the operation of the environmental sound synthesizer 3 that generates applause sound at a transmission destination by acquiring a parameter related to the volume of the applause sound as a transmission source as an example of the environmental sound of the transmission source. Although described, the present invention is not limited to this, and environmental sounds other than applause sounds may be targeted. For example, a sound signal (including noise) obtained by excluding the sound of the main content at the transmission source site from the sound collected at the transmission source, such as cheering and cheering, is used as the environmental sound, and the environmental volume parameter of the transmission source is input. Environmental sound may be synthesized at the transmission destination.

  In the operation example 2 of the third embodiment, the applause sound is replaced with the environmental sound in the data reception unit 31, the sound source synthesis unit 32, the template storage unit 33, and the reproduction unit 34 of the environmental sound synthesizer 3 of the third embodiment. Is the same as the above-described operation example.

  Hereinafter, an environmental sound synthesizer according to a fourth embodiment of the present invention will be described with reference to FIGS. 11, 12, and 13. FIG. 11 is a block diagram showing the configuration of the environmental sound synthesizer 4 of this embodiment. FIG. 12 is a flowchart showing the operation of the environmental sound synthesizer 4 of this embodiment. FIG. 13 is a diagram exemplifying a procedure for synthesizing the environmental sound element template of the sound source synthesizing unit 42 of the present embodiment. As shown in FIG. 11, the environmental sound synthesizer 4 of the present embodiment includes a data receiving unit 31, a sound source synthesizing unit 42, a template storage unit 43, a playback unit 34, a number estimating unit 45, and a template volume storage. Part 46. Since the data receiving unit 31 and the reproducing unit 34 are the same as the components having the same numbers in the environmental sound synthesizer 3 of the third embodiment, the description thereof is omitted.

<Template storage unit 43>
The template storage unit 43 stores a plurality of variations of a one-beat applause sound (about 300 ms) by one person. In this embodiment, a clap sound is treated as an example of the environmental sound, and therefore the template of the clapping sound is one of the variations of the environmental sound segment template. Accordingly, in the following, the applause sound template is also referred to as an environmental sound segment template. For example, applause sounds for one beat of different people are stored as different environmental sound segment templates. Hereinafter, the term “template” refers to a template that contains the entire applause sound (environmental sound) of a plurality of people with a predetermined frame length, and the term “environmental phoneme template” refers to applause for one beat by one person. It shall be a sound (environmental sound) template.

<Template Volume Storage Unit 46>
The template volume storage unit 46 stores information corresponding to the volume of the environmental phoneme template stored in the template storage unit 43 (specifically, the average energy calculated by the volume calculation unit 12 of the first or second embodiment). ) Is stored. Since the difference in volume of applause sound for one person is small, the average energy calculated for any one of the environmental phoneme templates stored in the template storage unit 43 corresponds to the volume of the environmental phoneme template. It may be stored as information. Further, the average value of the average energy of all environmental phoneme templates stored in the template storage unit 43 may be stored in the template volume storage unit 46 as information corresponding to the volume of the environmental phoneme template. Alternatively, a predetermined constant may be stored in the template volume storage unit 46 as information corresponding to the volume.

  In addition, the template volume storage unit 46 does not store information corresponding to the volume of the environmental phoneme template in advance, and the average energy calculated for the environmental phoneme template randomly selected from the template storage unit 43 each time is stored in the template phoneme template. You may use as information corresponding to a volume.

<Number of people estimation unit 45>
Number estimating unit 45 is configured for adjusting the gain of the sound volume in accordance with the environmental sound level parameters P _j. The number-of-people estimation unit 45 acquires the environmental sound volume parameter P _j output from the transmission source, and obtains information E ′ _j corresponding to the sound volume from the environmental sound volume parameter P _j . Specifically, information E ′ _j corresponding to the sound volume is obtained by performing the reverse process of the parameter conversion unit 13 (23) of the first or second embodiment. The number-of-persons estimation unit 45 outputs an integer value (a value obtained by rounding off or rounding off the decimal point) as information M 'of applause by dividing the information E ′ _j corresponding to the volume by the information corresponding to the volume of the environmental phoneme template. (S45).

<Sound source synthesis unit 42>
The sound source synthesizing unit 42 randomly selects and synthesizes the environmental phoneme template from the template storage unit 43 (S42). When applause for one person is synthesized based on the environmental volume parameter (when M = 1 in the number estimation unit 45), the environmental sound segment template T _i selected at random intervals of about 300 ms is obtained as shown in FIG. 13A. The synthesized waveform is output as applause sound. As described above, the synthesis time interval may be about 300 ms, but more preferably, the time interval may have fluctuations around 300 ms. By giving fluctuation to the time interval, a more natural applause sound can be synthesized. For example, a fluctuation of ± several tens of ms may be given by a random number according to a Gaussian distribution centering on 300 ms. For example, the sound source synthesis unit 42

The applause sound Y _i (i = 0, 1, 2,...) Obtained by converting the template is output (S42). In other words, the time series template signal T _i = (t _i [1] t _i [2]... T _i [P]) and the impulse δ (i · τ + σ _i ) representing the applause timing are convolved. Let Y _i be the output.

Here, * represents a convolution operation. Here, τ = 300 ms, and σ _i is a random number generated in a range of −10 ms ≦ σ _i ≦ + 10 ms. When synthesizing applause for M persons using the environmental volume parameter, as shown in FIG. 13B, a waveform synthesized using an environmental phoneme template that is randomly selected at intervals of about 300 / M (ms) is used. Output as applause sound. By setting the time interval to about 300 / M (ms) using the reciprocal of the number of people M, the time interval can be set to decrease as the number M of applause increases. In this case as well, fluctuations can be given by random numbers according to the Gaussian distribution or Laplace distribution. For example, the sound source synthesis unit 42

The environmental sound Y _i (i = 0, 1, 2,...) Converted from the template is output (S42).

  Thus, according to the environmental sound synthesizer 4 of the present embodiment, it is not necessary to prepare a template for each volume as in the third embodiment, and the environmental sound segment template stored in the template storage unit 43 is not necessary. Since the number may be small, the memory amount of the environmental sound synthesizer 4 can be reduced.

[Operation Example 2 of Example 4]
The fourth embodiment targets an applause sound as an example of a transmission source environmental sound, obtains a parameter related to the volume of the transmission applause sound, and generates an applause sound at the transmission destination. Although described, the present invention is not limited to this, and environmental sounds other than applause sounds may be targeted. In the above description, a template of applause sound for one beat (about 300 ms) by one person is shown as an example of an environmental sound segment template. However, the template is not limited to this. The template may be an environmental sound segment template.

  In the operation example 2 of the fourth embodiment, the data reception unit 31, the sound source synthesis unit 42, the template storage unit 43, the playback unit 34, the number of people estimation unit 45, and the template volume of the environmental sound synthesizer 4 of the fourth embodiment. The operation example is the same as that described above except that the data handled in the storage unit 46 is replaced with the ambient sound from the applause sound.

In the sound source synthesis unit 42, instead of the equation (3), the time-series template signal T _i = (t _i [1] t _i [2]... T _i [P]) and the impulse δ ( It is also possible to output Y _i by the convolution operation of m · τ + σ _m ).

Here, * represents a convolution operation.

  Further, the energy of the waveform of the environmental sound segment template stored in the template storage unit 43 may be normalized in advance. In that case, the volume (gain) may be adjusted according to the parameter of the number of persons estimation unit 45. In this case as well, variations can be increased while reducing the amount of memory.

  Hereinafter, an environmental sound analysis apparatus according to a fifth embodiment of the present invention and a modification thereof will be described with reference to FIGS. 14, 15, and 16. FIG. 14 is a block diagram showing the configuration of the environmental sound analyzer 5 of the present embodiment and its modification. FIG. 15 is a flowchart showing the operation of the environmental sound analyzer 5 of the present embodiment and its modification. FIG. 16 is a diagram illustrating time variation of frequency components of applause sound and clapping sound. FIG. 16A is a diagram illustrating an example of a time change of the frequency component when the applause sound stops and the state shifts to the silent state. FIG. 16B is a diagram illustrating an example of a time change of a frequency component when hand clapping is performed. FIG. 16C is a diagram illustrating an example of a time change of the frequency component when applause is performed. As shown in FIG. 14, the environmental sound analysis device 5 of the present embodiment includes a sound collection unit 11, a volume calculation unit 12, a parameter conversion unit 13, a data transmission / reception unit 54, a clap section detection unit 55, and a cycle. A sex determination unit 56. As a modification of the present embodiment, the parameter converter 13 can be appropriately changed to the parameter converters 23 and 23 '. In addition, the sound collection unit 11, the volume calculation unit 12, and the parameter conversion units 13, 23, and 23 ′ are components having the same numbers in the environmental sound analyzers 1, 2, and 2 ′ of the first, second, and first modification examples. Since it is the same as the part, description will be omitted as appropriate.

<Applause section detector 55>
The applause section detection unit 55 has a function of determining whether or not the acoustic signal is a clap sound. Specifically, the applause section detection unit 55 analyzes an acoustic signal input for each frame using VAD (Voice_Activity_Detection) or SAD (Sound_Activity_Detection), and performs “silent section”, “voice (music) section”, “others”. If the sound signal is determined to be a silent section or a speech section, the environmental volume parameter P _j = 0 is set. For example, the applause section detection unit 55 receives the ITU-T_G. When VAD / GSAD analysis is performed using 720.1, the applause section detection unit 55 generates a flag of 0: silence, 1: noise, 2: music, or 3: voice as a discrimination result. In this case, when the determination result is a silent section (flag 0) or a voice section (flag 2 or 3) (that is, not a clapping sound), the applause section detection unit 55 sets the environment volume parameter P _j = 0. Set. On the other hand, if the determination result is noise (flag 1), the applause section detection unit 55 sets the flag = 1 as a clap sound.

When the environmental volume parameter P _j = 0 (S5Y), the applause interval detection unit 55 outputs the environmental volume parameter P _j = 0 and the period information T = 0 or the period information indicating no period to the data transmission unit 54, Control goes to step S54. On the other hand, when the environmental sound volume parameter P _j is not 0 (flag = 1) (S5N), the flag = 1 is output and the process proceeds to step S56.

<Periodicity determination unit 56>
When the environmental sound volume parameter P _j is not 0 (when VAD / GSAD analysis is performed using G.720.1, flag 1: when determined as noise), the periodicity determination unit 56 is 1 second to several seconds. The analysis is performed with a window width of about (for example, 300 frames: 3 seconds). When the analyzed frame has a certain periodicity as shown in FIG. 16B, the periodicity determining unit 56 determines that the acoustic signal of the frame is an acoustic signal of a clapping time, and when the period is detected, The peak interval of the autocorrelation function is output as period information (S56). In order to reduce the amount of calculation, G.I. The autocorrelation function for 300 frames may be obtained using the RMS value (square root of the power of the frame) which is an internal variable of 720.1, and the period T may be obtained (not the autocorrelation of the frame but the autocorrelation of the signal) May be used).

  For example, the following method is used to detect the period information. G. Let R (i) (i = 0, 1, 2,..., 300) be an autocorrelation function of an RMS value (square root of frame power) every 10 ms, which is an internal variable of 720.1. In this example, the analysis is performed in an analysis frame of 3 seconds. In this example, if it has a period of 100 ms or more, it is determined to be clapping, and otherwise it is determined to be clapping. Assuming that the clapping interval is 100 ms or more, the value of i of R (i) is increased, and i when the correlation value R (i) changes from increasing to decreasing is set to T1. Further, the value of i is further increased, and i when the correlation value R (i) changes from increasing to decreasing is assumed to be T2. If the value of T2-T1 is within the threshold value range (for example, 11 to 265), T = T2-T1 is output with T2-T1 as the period. Note that there are various methods for detecting the peak, such as detecting the RR interval of the electrocardiogram, so existing techniques may be used as appropriate.

  When the period is not detected, the periodicity determination unit 56 outputs period information indicating T = 0 or no period. For example, if the index representing the period is 11 to 265 as described above, 255 periods can be represented, and an index indicating that there is no period may be added to transmit 8 bits representing 256 conditions.

The sound volume calculation unit 12 and the parameter conversion unit 13 (23, 23 ′) have the environment sound volume parameter P _j not 0 (when the VAD / GSAD analysis is performed using G.720.1, it is determined that the flag 1 is noise). For the frame, the environment volume parameter P _j is calculated and output by performing the same processing as the volume calculation unit 12 and the parameter conversion unit 13 (23, 23 ′) of the first embodiment, the second embodiment, or the modification 2. (S12, S13, S23, S23 ′). As E _j output from the volume calculation unit 12, G. The RMS value (square root of the power of the frame) which is an internal variable of 720.1 may be output.

<Data transmission unit 54>
The data transmission unit 54 transmits the period information together with the environmental sound volume parameter P _j to the environmental sound synthesizer 6 described later (S54).

  The environmental sound synthesizer according to the sixth embodiment of the present invention will be described below with reference to FIGS. The environmental sound synthesizer 6 according to the sixth embodiment is an apparatus corresponding to the environmental sound analyzer 5 according to the fifth embodiment. FIG. 17 is a block diagram showing the configuration of the environmental sound synthesizer 6 of this embodiment. FIG. 18 is a flowchart showing the operation of the environmental sound synthesizer 6 of this embodiment. As shown in FIG. 17, the environmental sound synthesizer 6 of the present embodiment includes a data receiving unit 61, a sound source synthesizing unit 62, a template storage unit 43, a playback unit 34, a number estimating unit 45, and a template sound volume storage. Part 46. Since the components other than the data receiver 61 and the sound source synthesizer 62 are the same as the components having the same numbers in the environmental sound synthesizers 3 and 4 of the third embodiment or the fourth embodiment, description thereof is omitted.

<Data receiving unit 61>
The data receiving unit 61 receives the period information together with the environmental sound volume parameter P _j from the environmental sound analyzer 5 (S61).

<Sound source synthesis unit 62>
Sound synthesizing unit 62, the environmental sound level parameters _{P j} of the audio signal of a certain frame is not 0 (S6AN), when the period information indicates that there is no T = 0 or period, (S6BN), the frame Are determined to be applause sounds, the same processing as the sound source synthesis unit 42 of the environmental sound synthesizer 4 of Example 4 is performed, and applause sounds are output (S62A). On the other hand, the sound source synthesizing section 62 is not an environmental sound level parameters _{P j} of the audio signal of a certain frame is 0 (S6AN), the period information is a T ≠ 0 (indicating that there is period information) in the case (S6BY), the frame Synthesizes a waveform having fluctuations according to a Gaussian distribution or a Laplace distribution having a smaller dispersion than in the case of Example 4 in which the period (for example, 500 ms) is the center. It outputs as a clapping sound (actually a clapping sound) (S62B). The sound source synthesizing unit 62, for example, in the above formula (3) or (4), the applause sound Y _i (i = 0, 1, 2,...) Obtained by converting the template using the value of τ as period information (for example, τ = 500 ms). .) Is output (S62B). In this example, since τ = 500 (ms) in the clapping sound is set to a time interval longer than τ = 300 (ms) set in the above-described synthesis of the clapping sound, it is determined that the sound is a clapping sound. The environmental sound segment template is arranged and synthesized so that the time interval when it is determined to be a clapping sound is longer than that of.

  As described above, according to the environmental sound transmission system 5000 including the environmental sound analysis device 5 according to the fifth embodiment and the environmental sound synthesis device 6 according to the present embodiment, the periodicity determination unit 56 analyzes the frame to obtain the periodic information. In addition to the effect of efficiently transmitting applause and hand clapping sounds collected at the transmission source, the sound source synthesizer 62 generates an acoustic signal of either applause or hand clapping in consideration of the presence or absence of periodic information. Thus, both applause and clapping can be synthesized more accurately.

  The environmental sound synthesizer according to the seventh embodiment of the present invention, which is a modified embodiment of the fourth embodiment, will be described below with reference to FIGS. FIG. 19 is a block diagram showing the configuration of the environmental sound synthesizer 7 of this embodiment. FIG. 20 is a flowchart showing the operation of the environmental sound synthesizer 7 of this embodiment. As shown in FIG. 19, the environmental sound synthesizer 7 of this embodiment includes a data receiving unit 31, a sound source synthesizing unit 72, a template storage unit 73, a playback unit 34, a number estimating unit 45, and a template volume storage. Part 46. The difference from the fourth embodiment is only that the sound source synthesizing unit 42 and the template storage unit 43 in the fourth embodiment are changed to a sound source synthesizing unit 72 and a template storage unit 73 in this embodiment, respectively. Therefore, description of each component other than the sound source synthesis unit 72 and the template storage unit 73 is omitted.

  In the fourth embodiment, the sound source synthesis unit 42 randomly selects one environmental sound segment template from the template storage unit 43 and synthesizes the environmental sound at the transmission destination. Instead, the sound source synthesis unit 72 selects and synthesizes one or more environmental phoneme templates from the template storage unit 73 according to the output probability (S72).

  In particular, cheering and shouting are more individually different than applause sounds, and there are several variations in their content. For example, when there are a plurality of performers, the personal names and nicknames of the performers may be included in the cheering and shouting, and there are different cheering and shouting patterns for each performer.

  However, cheering and cheering sound patterns (also expressed as hitting a mix) are often determined by the content, and there are not many variations of cheering and cheering lines. Moreover, it is often emitted at a predetermined timing of a certain song, and the time difference of sound power is small. Therefore, the same type of support is provided each time by preparing multiple types of cheering and cheering phrases as environmental sound segment templates and playing them as mixed sounds with fluctuations according to the volume instead of a single template. A sound similar to another environmental sound can be formed according to the timing at which it is emitted instead of the sound of shout or shout.

  In the following, an environmental sound synthesizer 7 that synthesizes environmental sound at a transmission destination venue different from the transmission source, taking as an example a case where content including a plurality of performers is played (or reproduced) at the transmission source. An example of the operation will be described.

  As described above, the environmental sound synthesizer 7 according to the present embodiment has almost the same configuration as the environmental sound synthesizer 4 according to the fourth embodiment. However, the difference is that the template storage unit 73 stores plural types of environmental sound element templates and output probabilities of the environmental sound element templates in association with each other. The plurality of types of environmental sound segment templates are, for example, cheering and shouting sound signals corresponding to the individual names and nicknames of the performers of the content, and are prepared in advance.

  Hereinafter, the description will be continued with reference to FIG. FIG. 21 is a diagram illustrating an example in which the environmental phoneme template and the output probability are stored in the template storage unit in association with each other.

  In FIG. 21A, Pi (i = 1, 2,..., N) after the environmental phoneme template, for example, P1 after “Alice” is the probability that the corresponding environmental phoneme template is output. , P1 + P2 +... + Pn = 1. The operation example 2 of the fourth embodiment has the same probability (P1 = P2 =... = Pn = 1 / n) and corresponds to a case where one environmental phoneme template is selected and synthesized at random. In this embodiment, this probability is different for each template. FIG. 21A is an example in which one environmental sound template is stored for each performer. However, a plurality of environmental sound templates are stored for each performer as shown in FIG. An output probability may be associated with the sound template. The probability of each template may be set in advance. For example, you can vote for the performers you want to support at the transmission hall or destination concert hall, or have them registered in advance, and obtain the popularity ranking of the performers for the audience at the venue, What is necessary is just to determine the output probability of each template so that an output probability becomes high, so that the order | rank is high. Alternatively, it may be based on the popularity ranking acquired without being limited to the audience of the transmission destination. In addition, in consideration of special events such as a performer's birthday or retirement, a bias may be applied to increase the output probability of the environmental sound segment template to the performer.

  These output probabilities may be changed in real time while operating the system. For example, the output probability value may be temporally changed according to the number of votes in real time such as when the listener presses a button.

The sound source synthesizing unit 72 selects one or more templates according to the output probability stored in the template storage unit 73, and synthesizes the acoustic signal of the environmental sound according to the equation (3 ′) or the equation (4). It is assumed that the number of persons M estimated by the number-of-persons estimation unit 45 is two or more, and two or more templates are selected. If the number of templates to be selected for the frame i is S _i (S is an integer of 2 or more), the sound source synthesis unit 72

The acoustic signal Y _i synthesized by the above is output. Where T _{i, k} is the kth template selected for frame i,

It is. Here, M _k is the number of people corresponding to the template T _{i, k} ,

Thus, the value of each M _k is determined according to the output probability of the template T _{i, k} .

  According to the above configuration, since the environmental sound corresponding to each performer is synthesized at a volume that reflects the popularity of the performer, it is possible to synthesize the environmental sound that more reflects the excitement and atmosphere of the place.

  Next, the environmental sound synthesizer 8 according to the eighth embodiment will be described with reference to FIGS. 19, 20, and 21. As shown in FIG. 19, the environmental sound synthesizer 8 according to the present embodiment includes a data receiving unit 31, a sound source synthesizing unit 82, a template storage unit 83, a playback unit 34, a number estimating unit 45, and a template volume storage. Part 46. The difference from the seventh embodiment is only that the sound source synthesizing unit 72 and the template storage unit 73 in the seventh embodiment are changed to a sound source synthesizing unit 82 and a template storage unit 83 in the present embodiment, respectively.

  Although the probability value is determined for each template in the seventh embodiment, the template is clustered for each performer and the output probability is determined for each cluster as in the template storage unit 83 shown in FIG. 21C. May be. In this case, the sound source synthesis unit 82 selects one or more clusters corresponding to the performers in accordance with the output probabilities stored in the template storage unit 83, and selects one of the one or more environmental sound segment templates corresponding to the selected clusters. Randomly select one or more environmental sound segment templates. When selecting a plurality of environmental phoneme template in a cluster, the volume for each template is set so that the sum of the volume of the sound signal output by the template is the volume assigned to the cluster. decide.

  Hereinafter, the environmental sound synthesizer 9 according to the ninth embodiment will be described. The environmental sound synthesizer 9 of this embodiment outputs the sound synthesized by the environmental sound synthesizer of Example 7 or 8 to the head mounted display.

  Here, the output probability of each template or each cluster stored in the template storage unit 73 (83) is set in advance according to the preference of the user wearing the head mounted display. Thereby, a favorite environmental sound can be presented for each individual. According to the probability value predetermined for each wearer of the head mounted display, the environment phoneme template is selected from the template storage unit 73 (83) according to the predetermined probability and synthesized. Sounds can be presented separately. When the user uses this system in an acoustically independent place, not limited to the head-mounted display, the probability that the environmental phoneme template is predetermined from the template storage unit 73 (83) with a different probability value for each place. It can be selected according to the combination.

  Hereinafter, the environmental sound synthesizer 10 according to the tenth embodiment will be described. In the seventh, eighth, and ninth embodiments described above, different environmental sound element templates are associated with each performer. However, in the environmental sound synthesizing apparatus 10 according to the present embodiment, an environmental sound element template common to all performers is defined. For example, a so-called mix (a pattern of cheering or cheering sounds) may be used as a probability value or a randomly selected environmental sound segment template.

  The various processes described above are not only executed in time series according to the description, but may also be executed in parallel or individually as required by the processing capability of the apparatus that executes the processes. Needless to say, other modifications are possible without departing from the spirit of the present invention.

  Further, when the above-described configuration is realized by a computer, processing contents of functions that each device should have are described by a program. The processing functions are realized on the computer by executing the program on the computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. As the computer-readable recording medium, for example, any recording medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory may be used.

  The program is distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing the process, the computer reads a program stored in its own recording medium and executes a process according to the read program. As another execution form of the program, the computer may directly read the program from a portable recording medium and execute processing according to the program, and the program is transferred from the server computer to the computer. Each time, the processing according to the received program may be executed sequentially. Also, the program is not transferred from the server computer to the computer, and the above-described processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and result acquisition. It is good.

  Note that the program in this embodiment includes information that is used for processing by an electronic computer and that conforms to the program (data that is not a direct command to the computer but has a property that defines the processing of the computer). In this embodiment, the present apparatus is configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware.

Claims (15)

An environmental sound synthesizer that generates an environmental sound by acquiring an environmental volume parameter related to the volume of an acoustic signal of a transmission source from an environmental sound analyzer,
A data receiver for receiving the environmental volume parameter from the environmental sound analyzer;
A template storage unit that stores an environmental sound template for one frame (hereinafter referred to as a template) and information corresponding to the volume of the environmental sound of the template in association with each other;
A template having the same volume as the environmental volume parameter is selected from the template storage unit, and a sound source synthesis unit that synthesizes the selected template to generate environmental sound;
An environmental sound synthesizer characterized by comprising: An environmental sound synthesizer that generates an environmental sound by acquiring an environmental volume parameter related to the volume of an acoustic signal of a transmission source from an environmental sound analyzer,
A data receiver for receiving the environmental volume parameter from the environmental sound analyzer;
A template storage unit for storing a template of environmental sound for one beat by a person (hereinafter referred to as an environmental sound segment template);
A template volume storage unit that stores information corresponding to the volume of the environmental phoneme template stored in the template storage unit;
A number estimation unit that outputs a value obtained by dividing the information corresponding to the volume of the environmental volume parameter by the information corresponding to the volume of the environmental sound segment template as a number of persons,
The environmental phoneme template is selected from the template storage unit, and the selected environmental phoneme template is arranged and synthesized at predetermined time intervals so as to decrease as the number of people increases, thereby generating an environmental sound. A sound source synthesizer
An environmental sound synthesizer characterized by comprising: The environmental sound synthesizer according to claim 2,
The template storage unit stores a plurality of types of environmental sound element templates and output probabilities of each environmental sound element template in association with each other,
The sound source synthesis unit
One or more environmental sound segment templates are selected from the template storage unit in accordance with the output probability and synthesized. An environmental sound transmission system including an environmental sound analyzer and an environmental sound synthesizer,
The environmental sound analyzer is
A sound volume calculation unit that obtains an acoustic signal and calculates a value corresponding to the volume of the acoustic signal;
A parameter conversion unit that obtains a value corresponding to the volume of the acoustic signal, quantizes the value corresponding to the volume of the acoustic signal, and outputs the index as an environmental volume parameter;
A data transmission unit for transmitting the environmental volume parameter to the environmental sound synthesizer,
The environmental sound synthesizer is
A data receiver for receiving the environmental volume parameter from the environmental sound analyzer;
A template storage unit that stores an environmental sound template for one frame (hereinafter referred to as a template) and information corresponding to the volume of the environmental sound of the template in association with each other;
A template having the same volume as the environmental volume parameter is selected from the template storage unit, and a sound source synthesis unit that synthesizes the selected template to generate environmental sound;
An environmental sound transmission system comprising: An environmental sound transmission system including an environmental sound analyzer and an environmental sound synthesizer,
The environmental sound analyzer is
A sound volume calculation unit that obtains an acoustic signal and calculates a value corresponding to the volume of the acoustic signal;
A parameter conversion unit that obtains a value corresponding to the volume of the acoustic signal, quantizes the value corresponding to the volume of the acoustic signal, and outputs the index as an environmental volume parameter;
A data transmission unit for transmitting the environmental volume parameter to the environmental sound synthesizer,
The environmental sound synthesizer is
A data receiver for receiving the environmental volume parameter from the environmental sound analyzer;
A template storage unit for storing a template of environmental sound for one beat by a person (hereinafter referred to as an environmental sound segment template);
A template volume storage unit that stores information corresponding to the volume of the environmental phoneme template stored in the template storage unit;
A number estimation unit that outputs a value obtained by dividing the information corresponding to the volume of the environmental volume parameter by the information corresponding to the volume of the environmental sound segment template as a number of persons,
The environmental phoneme template is selected from the template storage unit, and the selected environmental phoneme template is arranged and synthesized at predetermined time intervals so as to decrease as the number of people increases, thereby generating an environmental sound. A sound source synthesizer
An environmental sound transmission system comprising: The environmental sound transmission system according to claim 4 or 5,
The parameter converter of the environmental sound analyzer is
Calculating an average energy E _j (j is an integer of 1 or more representing a frame index) as a value corresponding to the volume of the acoustic signal;
From the average energy E _j

In columns F _j calculates represented, said column F _j twice, obtains the value G _j divided by 2, assign a symbol to each of the values G _j by converting the value G _j to the code, The environmental sound transmission system, wherein a symbol assigned to the value G _j is output as a parameter P _j of a j-th frame. The environmental sound transmission system according to claim 5,
The environmental sound analyzer is
It is determined whether or not the acoustic signal is a clapping sound. If the determination result is not a clapping sound, environmental sound volume parameter = 0 and period information indicating no period are output, and the determination result is a clapping sound. In the case, a clap section detection unit that outputs a flag indicating a clap sound;
Obtaining a flag indicating the applause sound, detecting the period of the acoustic signal using an autocorrelation function, and outputting the peak interval of the autocorrelation function as period information when the period is detected, A periodicity determination unit that outputs period information indicating no period when no period is detected;
The data transmission unit transmits the period information together with the environmental sound volume parameter to the environmental sound synthesizer,
The data receiving unit receives the period information together with the environmental sound volume parameter from the environmental sound analyzer,
The sound source synthesizer determines that the acoustic signal is a clapping sound when the environmental volume parameter is not 0 and the period information indicates no period, and the environmental volume parameter is not 0 and the period information is a period When the presence is indicated, it is determined that the sound signal is a hand clapping sound, and the environment is set such that the time interval when the sound signal is determined to be the clapping sound is longer than that of the clapping sound. An environmental sound transmission system characterized by arranging and synthesizing a phoneme template. An environmental sound synthesis method for generating an environmental sound by acquiring an environmental volume parameter related to a volume of an acoustic signal of a transmission source,
A data receiving step for receiving the environmental volume parameter;
Referring to a template storage unit that stores an environmental sound template for one frame (hereinafter referred to as a template) and information corresponding to the volume of the environmental sound of the template in association with each other, the same volume level as the environmental volume parameter A sound source synthesizing step of selecting a template and generating the environmental sound by synthesizing the selected template;
An environmental sound synthesis method comprising: An environmental sound synthesis method for generating an environmental sound by acquiring an environmental volume parameter related to a volume of an acoustic signal of a transmission source,
A data receiving step for receiving the environmental volume parameter;
Referring to a template volume storage unit that stores information corresponding to the volume of an environmental sound template (hereinafter referred to as an environmental sound segment template) for one beat by one person, information corresponding to the volume of the environmental volume parameter is obtained. The number of people estimation step of outputting the value divided by the information corresponding to the volume of the environmental phoneme template as the number of people,
With reference to a template storage unit that stores the environmental phoneme template, the environmental phoneme template is selected, and the selected environmental phoneme template is reduced at time intervals determined so as to decrease as the number of people increases. A sound source synthesis step for generating an environmental sound,
An environmental sound synthesis method comprising: An environmental sound transmission method executed by an environmental sound analyzer and an environmental sound synthesizer,
The environmental sound analyzer is
Obtaining a sound signal and calculating a value corresponding to the sound signal volume;
A parameter conversion step of obtaining a value corresponding to the volume of the acoustic signal, quantizing the value corresponding to the volume of the acoustic signal, and outputting the index as an environmental volume parameter;
Performing a data transmission step of transmitting the environmental volume parameter to the environmental sound synthesizer;
The environmental sound synthesizer is
A data receiving step for receiving the environmental volume parameter from the environmental sound analyzer;
Referring to a template storage unit that stores an environmental sound template for one frame (hereinafter referred to as a template) and information corresponding to the volume of the environmental sound of the template in association with each other, the same volume level as the environmental volume parameter A sound source synthesizing step of selecting a template and generating the environmental sound by synthesizing the selected template;
The environmental sound transmission method characterized by performing. An environmental sound transmission method executed by an environmental sound analyzer and an environmental sound synthesizer,
The environmental sound analyzer is
Obtaining a sound signal and calculating a value corresponding to the sound signal volume;
A parameter conversion step of obtaining a value corresponding to the volume of the acoustic signal, quantizing the value corresponding to the volume of the acoustic signal, and outputting the index as an environmental volume parameter;
Performing a data transmission step of transmitting the environmental volume parameter to the environmental sound synthesizer;
The environmental sound synthesizer is
A data receiving step for receiving the environmental volume parameter from the environmental sound analyzer;
A template volume storage unit that stores information corresponding to the volume of an environmental sound template (hereinafter referred to as an environmental sound segment template) for one beat by one person is referred to, and the information corresponding to the volume of the environmental volume parameter is The number of people estimation step of outputting the value divided by the information corresponding to the volume of the environmental sound segment template as the number of people,
With reference to a template storage unit that stores the environmental phoneme template, the environmental phoneme template is selected, and the selected environmental phoneme template is reduced at time intervals determined so as to decrease as the number of people increases. A sound source synthesis step for generating an environmental sound,
The environmental sound transmission method characterized by performing. The environmental sound transmission method according to claim 10 or 11,
In the parameter conversion step executed by the environmental sound analyzer,
Calculating an average energy E _j (j is an integer of 1 or more representing a frame index) as a value corresponding to the volume of the acoustic signal;
From the average energy E _j

In columns F _j calculates represented, said column F _j twice, obtains the value G _j divided by 2, assign a symbol to each of the values G _j by converting the value G _j to the code, The environmental sound transmission method, wherein a symbol assigned to the value G _j is output as a parameter P _j of a j-th frame. The environmental sound transmission method according to claim 11,
The environmental sound analyzer is
It is determined whether or not the acoustic signal is a clapping sound. If the determination result is not a clapping sound, environmental sound volume parameter = 0 and period information indicating no period are output, and the determination result is a clapping sound. In the case, a clap section detection step for outputting a flag indicating a clap sound;
Obtaining a flag indicating the applause sound, detecting the period of the acoustic signal using an autocorrelation function, and outputting the peak interval of the autocorrelation function as period information when the period is detected, A periodicity determining step of outputting periodic information indicating no period when no period is detected; and
In the data transmission step, the period information together with the environmental volume parameter is transmitted to the environmental sound synthesizer,
In the data receiving step, the periodic information together with the environmental sound volume parameter is received from the environmental sound analyzer,
In the sound source synthesis step, when the environmental volume parameter is not 0 and the period information indicates no period, it is determined that the acoustic signal is a clapping sound, and the environmental volume parameter is not 0 and the period information is a period. When the presence is indicated, it is determined that the sound signal is a hand clapping sound, and the environment is set such that the time interval when the sound signal is determined to be the clapping sound is longer than that of the clapping sound. An environmental sound transmission method comprising arranging and synthesizing a phoneme template.   A program for causing a computer to function as the environmental sound synthesizer according to any one of claims 1 to 3.   A program for causing a computer to function as the environmental sound transmission system according to any one of claims 4 to 7.