JP2023004632A - Object sound processing system - Google Patents

Abstract

To faithfully recreate and audition an auditioning sound, with results of predictive calculations regarding a sound environment such as sound insulation and resonance added to an object sound.SOLUTION: An object sound processing system which comprises a sound recording unit, a portable terminal, and an object sound processor: transmits an object sound that is recorded to the portable terminal; transmits the object sound from the portable terminal to the object sound processor; processes the object sound that is transmitted by the portable terminal with the use of a correction value for processing to generate a processed object sound; generates an auditioning sound for recreating a sound that is actually heard from the processed object sound; generates a processed auditioning sound that is the auditioning sound processed on the basis of output conditions of an output unit of the portable terminal for outputting the generated auditioning sound; transmits the processed auditioning sound to the portable terminal; has the output unit output the processed auditioning sound that is transmitted and auditions the processed auditioning sound that is output.SELECTED DRAWING: Figure 13

Description

The present invention relates to a target sound processing system.

The way sound resonates and the degree of sound insulation are usually indicated by numerical values, and it is difficult for ordinary people who are unfamiliar with such numerical values to have a concrete image of how sounds are heard. Therefore, for example, the way sound reverberates and the sound insulation performance are calculated from the design specifications of a building, and audition sounds are generated by adding prediction calculation results to target sounds obtained by picking up noise and the like. For example, in Patent Document 1, for environmental noise (target sound), each propagation path into the sound receiving room, for example, a boundary wall direct transmission path, a detour propagation path from an opening, a side wall solid propagation path, etc. It is disclosed that the attenuation amount for each path is predicted, and the impulse response waveform obtained from the predicted and calculated attenuation amount is convoluted with the sound source waveform of the environmental noise to generate the evaluation sound (test sound) (claim 1, etc.) ).

JP-A-2003-156388 Japanese Patent No. 4307622 Japanese Patent No. 4234257

However, in the technique described in Patent Document 1, the audition sound is generated after the collected target sound is brought back to the place where the processing device is located. could not be processed, and the audition sound could not be heard on the spot.

In order to solve the above problems, the target sound processing system according to the present invention includes:
A target sound processing system including a sound collecting device that collects target sound from a predetermined location, a mobile terminal, and a target sound processing device,
A first operator collects the target sound using the sound collection device, transmits the collected target sound to the mobile terminal,
the first operator operates the mobile terminal to transmit the target sound from the mobile terminal to the target sound processing device;
A second operator operates the target sound processing device to process the target sound transmitted from the mobile terminal using a first correction value for processing based on the sound pickup conditions of the sound pickup device, Generate the processed target sound,
When the second worker operates the target sound processing device and listens to the target sound transmitted from the mobile terminal at the predetermined place under a predetermined environment, the target sound can actually be heard. generating an audition sound that reproduces the sound from the processed target sound;
The second operator operates the target sound processing device to process the audition sound based on the output conditions of the output unit of the portable terminal for outputting the generated audition sound. to generate
the second operator operates the target sound processing device to transmit the processed audition sound to the mobile terminal;
The first operator operates the mobile terminal to output the transmitted processed audition sound from the output unit,
A third worker listens to the output processed audition sound.

In order to solve the above problems, the target sound processing system according to the present invention includes:
A target sound processing system including a mobile terminal and a target sound processing device,
A first operator operates the mobile terminal to transmit a target sound picked up by a sound pickup device built in the mobile terminal from the mobile terminal to the target sound processing device,
A second operator operates the target sound processing device to process the target sound transmitted from the mobile terminal using a first correction value for processing based on the sound pickup conditions of the sound pickup device, Generate the processed target sound,
A sound actually heard when the second worker operates the target sound processing device and listens to the target sound transmitted from the mobile terminal at a predetermined place under a predetermined environment. from the processed target sound,
The second operator operates the target sound processing device to process the audition sound based on the output conditions of the output unit of the portable terminal for outputting the generated audition sound. to generate
the second operator operates the target sound processing device to transmit the processed audition sound to the mobile terminal;
The first operator operates the portable terminal to output the transmitted processed audition sound from the output unit.

According to the present invention, it is possible to faithfully reproduce and listen to the audition sound in the place where the target sound is collected, taking into account the results of prediction calculations regarding the sound environment such as sound insulation and reverberation of the target sound.

1 is a diagram for explaining an overview of a target sound processing system according to a first embodiment of the present invention; FIG. FIG. 4 is a sequence diagram for explaining the outline of the operation of the target sound processing system according to the first embodiment of the present invention; 1 is a block diagram for explaining the configuration of a target sound processing system according to a first embodiment of the present invention; FIG. FIG. 4 is a diagram showing an example of a microphone correction value table possessed by the target sound processing device of the target sound processing system according to the first embodiment of the present invention; FIG. 4 is a diagram showing an example of a speaker correction value table possessed by the target sound processing device of the target sound processing system according to the first embodiment of the present invention; 2 is a diagram for explaining the hardware configuration of the target sound processing device of the target sound processing system according to the first embodiment of the present invention; FIG. 4 is a flow chart for explaining the processing procedure of the target sound processing device of the target sound processing system according to the first embodiment of the present invention; 4 is a flow chart for explaining the processing procedure of the mobile terminal of the target sound processing system according to the first embodiment of the present invention; FIG. 11 is a sequence diagram for explaining an overview of the operation of the target sound processing system according to the second embodiment of the present invention; FIG. 10 is a block diagram for explaining the configuration of a target sound processing system according to a second embodiment of the present invention; FIG. 9 is a flow chart for explaining the processing procedure of the target sound processing device of the target sound processing system according to the second embodiment of the present invention; 10 is a flow chart for explaining the processing procedure of the mobile terminal of the target sound processing system according to the second embodiment of the present invention; FIG. 11 is a block diagram for explaining the configuration of a target sound processing device according to a third embodiment of the present invention; FIG. 11 is a block diagram for explaining the configuration of a target sound adding device according to a fourth embodiment of the present invention; FIG. 14 is a diagram showing an example of a trial sound database possessed by the target sound adding device according to the fourth embodiment of the present invention; FIG. 11 is a diagram for explaining the hardware configuration of a target sound adding device according to a fourth embodiment of the present invention; FIG. 14 is a flow chart for explaining a processing procedure of the target sound adding device according to the fourth embodiment of the present invention; FIG. FIG. 16 is a flow chart for explaining the processing procedure of the sound collecting device of the target sound processing system according to the fifth embodiment of the present invention; FIG. FIG. 16 is a flow chart for explaining the processing procedure of the mobile terminal of the target sound processing system according to the fifth embodiment of the present invention; FIG. FIG. 14 is a flow chart for explaining the processing procedure of the target sound processing device of the target sound processing system according to the fifth embodiment of the present invention; FIG. 5 is a graph showing frequency characteristics of collected sound data; 4 is a graph showing the sound pickup level and linearity of a microphone; 4 is a graph showing frequency characteristics of reproduced sound through headphones. 4 is a graph showing the reproducible level and linearity of headphones; It is a figure which shows the outline|summary of the experimental conditions of this invention. It is a graph which shows the sound pressure level difference between rooms. It is a graph which shows the sound-pressure waveform by the side of a meeting room (sound source room). 4 is a graph showing octave band levels on the conference room (sound source room) side. It is a graph which shows the sound-pressure waveform by the side of an office (sound-receiving room). 4 is a graph showing octave band levels in an office (sound receiving room).

EMBODIMENT OF THE INVENTION Below, the form for implementing this invention is demonstrated in detail with reference to drawings. However, the configuration, numerical values, process flow, functional elements, etc. described in the following embodiments are merely examples, and modifications and changes are free, and the technical scope of the present invention is limited to the following descriptions. It is not intended to

[First embodiment]
A target sound processing system 100 as a first embodiment of the present invention will be described with reference to FIGS. 1A to 5B. The target sound processing system 100 is used, for example, to generate an evaluation sound for evaluating how a target sound picked up at a predetermined location is heard through performance determined by building specifications or the like. FIG. 1A is a diagram for explaining the outline of the target sound processing system according to this embodiment.

A target sound processing system 100 includes a target sound processing device 110 and a mobile terminal 120 . In addition, a sound pickup unit 130 (microphone) and an output unit 140 (speaker) are wired to the mobile terminal 120 from the outside of the mobile terminal 120 using a cable. Note that the sound pickup unit 130 and the output unit 140 may be wirelessly connected to the mobile terminal 120 using a wireless communication standard, and the sound pickup unit 130 and the output unit 140 are built in the mobile terminal 120. You can use whatever you have.

For example, a worker or user who owns the mobile terminal 120 uses the sound pickup unit 130 (microphone) connected to the mobile terminal 120 to pick up the target sound at a predetermined location. Here, the target sound includes, for example, indoor sound and outdoor sound, but is not limited to these. Further, the predetermined place is, for example, a planned construction site for a detached house or collective housing, a planned construction site for commercial facilities, office buildings, roads, railway facilities, airports, power plants, factories, etc., an existing building, etc. This is a place where persons concerned with the place, prospective buyers, etc. want to know the environment related to the sound of the predetermined place.

First, the operator of the target sound 131 at the predetermined location collects the target sound at the predetermined location using the sound pickup unit 130 and saves the collected target sound 131 in the portable terminal 120 . Then, the sound collecting operator (or the owner of mobile terminal 120 , etc.) transmits the target sound data saved in mobile terminal 120 to target sound processing apparatus 110 . The portable terminal 120 and the target sound processing device 110 are connected by wireless connection. Also, the target sound processing device 110 may be a cloud server or the like installed on the cloud.

Based on the received target sound data, the target sound processing device 110 processes the target sound 131 picked up at a predetermined location to generate an evaluation sound (processed audition sound 141). In addition, when transmitting the target sound data to the target sound processing device 110, the mobile terminal 120 also includes data about the characteristics of the sound pickup unit 130 (microphone) and the output unit 140 (speaker) connected to the mobile terminal 120. Although it is preferable to transmit the data in response to a request from the target sound processing device 110, the data may be transmitted in response to the request.

This is because part of the frequency components of the collected target sound 131 is cut due to the sound collection characteristics of the sound collection unit 130, or the output audition sound is different from the actual audible sound due to the output characteristics of the output unit 140. This is because sounds having different frequency components are output. Therefore, in the target sound processing system 100, the target sound 131 is processed to generate an audition sound (processed audition sound 141) in consideration of the characteristics of the microphone and speaker.

For example, a built-in microphone and speaker built into the mobile terminal 120 are compared to an external microphone and speaker for the purpose of reducing the price of the mobile terminal 120 and for the problem of space in the housing of the mobile terminal 120. , are smaller, may have certain performance limitations, or have certain features removed. Even with external microphones and speakers, depending on the purpose of use and price, they are limited to specific functions, have limited performance, or have specific functions enhanced. There are times when Therefore, there are microphones and speakers with various functions and performances.

As described above, if a microphone dedicated to picking up the target sound or a speaker dedicated to outputting the audition sound is used as the microphone or speaker, there is no need to adjust the variation for each microphone or speaker. However, if a dedicated microphone and speaker must be used, each time the target sound is to be collected, the dedicated microphone must be transported to a predetermined location, and listening to the audition sound In this case, it is necessary to go to the place where the dedicated speaker is installed, which makes it difficult to respond flexibly and flexibly.

Therefore, in the target sound processing system 100, in each stage of processing the collected target sound, in order to eliminate the error depending on the characteristics of each device, the absolute sound (processed target sound , audition sounds, and processed audition sounds), and by processing these absolute sounds, sounds that are the same as real sounds are reproduced so that listeners can experience them.

Therefore, in the target sound processing system 100, together with the target sound data of the collected target sound, the characteristics of the sound pickup unit 130 (microphone) and the characteristics of the output unit 140 (speaker) are transmitted to the target sound processing device 110. . Alternatively, the characteristics of the sound pickup unit 130 and the output unit 140 may be transmitted to the target sound processing device 110 separately from the target sound. You may The target sound processing device 110 processes the received target sound data using a correction value according to the characteristics of the sound pickup unit 130 that picked up the sound, and generates a processed target sound. Next, the target sound processing device 110 generates, from the generated processed target sound, a trial sound that reproduces the sound actually heard when listening to the target sound at a predetermined place under a predetermined environment.

Here, the predetermined environment is, for example, a building such as an apartment complex or a detached house scheduled to be constructed at a predetermined location where the target sound is collected, and includes indoors of these buildings and outdoors such as a veranda. Furthermore, the predetermined environment includes the position and area of the walls of the building, sound insulation performance (sound transmission loss), the position and area of the windows attached to the building, sound insulation performance (sound transmission loss), the area and number of air supply ports, Various factors such as sound insulation performance (standardized sound transmission loss), indoor surface area, sound absorption performance (sound absorption force), etc. that realize the living environment of the building may be included.

Then, the target sound processing device 110 reproduces, for example, a predetermined environment (such as a building) in a virtual space, and uses the data of the collected target sound to predict the acoustic effect in the predetermined environment and listen to the sound. produce sound. The target sound processing device 110 processes the generated audition sound using a correction value according to the characteristics of the output unit 140 to generate a processed audition sound. In this way, by processing the audition sound using the correction value based on the characteristics of the output unit 140, it is possible to reliably reproduce the sound actually heard in the output unit 140 without using a dedicated speaker. becomes. Note that the audition sound may be generated again based on the audition result of the processed audition sound. By regenerating the audition sound in this way, it is possible to reproduce the audition sound under various environments. Sound can be simulated.

An outline of the operation of the target sound processing system will be described with reference to FIG. 1B. In step S101, the sound pickup unit 130 picks up a target sound. In step S<b>103 , the collected target sound is transmitted from the sound collection unit 130 to the mobile terminal 120 . The target sound to be collected is, for example, analog data.

Then, in step S<b>105 , the portable terminal 120 transmits target sound data obtained by digitally converting the received target sound to the target sound processing device 110 . In step S107, the target sound processing device 110 processes the received target sound data according to predetermined conditions to generate a processed audition sound. In step S109, the target sound processing device 110 transmits the generated processed audition sound to the mobile terminal 120 (output unit 140). In step S111, the output unit 140 outputs the received processed audition sound. Note that the sound pickup unit 130 and the output unit 140 may be built in the mobile terminal 120 . Also, the target sound may be digitally converted in the target sound processing device 110 .

The configuration of the target sound processing system 100 will be described with reference to FIG. A target sound processing system 100 includes a target sound processing device 110 and a mobile terminal 120 . The target sound processing device 110 includes a first receiving section 211 , a sound collection condition acquiring section 212 , a processed target sound generating section 213 , a preview sound generating section 214 , a processed preview sound generating section 215 and a second transmitting section 216 .

The first receiving unit 211 acquires the target sound picked up by the sound pickup unit 130 at a predetermined location. The acquired data related to the target sound is, for example, analog data, and the target sound processing device 110 digitally converts the received analog data of the target sound and stores it as target sound data (digital data). Note that if the sound pickup unit 130 has an AD converter, the sound pickup unit 130 may perform digital conversion.

The sound collection condition acquiring unit 212 is various conditions under which the target sound is collected. These include, but are not limited to, features of embedded software, and environmental characteristics such as temperature, humidity, wind direction, and air volume at a given location.

The processed target sound generation unit 213 acquires the first processing correction for processing the target sound based on the acquired sound collection conditions. The processed target sound generation unit 213 acquires the first correction value for processing from, for example, an internal storage or an external storage, but the method for acquiring the first correction value for processing is not limited to this.

Then, the processed target sound generation unit 213 generates a processed target sound by processing the target sound (target sound data) using the acquired first correction value for processing. The processed target sound generation unit 213 processes the target sound data by, for example, canceling a specific frequency component, and generates a processed target sound.

The audition sound generating unit 214 converts the generated processed target sound into a audition sound that reproduces the sound actually heard when the target sound is heard under a predetermined environment at a predetermined location where the target sound is collected. produced by processing. Here, the predetermined environment is, for example, a building such as an apartment complex or a detached house scheduled to be constructed at a predetermined location where the target sound is collected, and includes indoors of these buildings and outdoors such as a veranda. The predetermined environment includes the position and area of the walls of the building, sound insulation performance (sound transmission loss), the position and area of the windows attached to the building, sound insulation performance (sound transmission loss), the area and number of air supply ports, and sound insulation performance. Various factors such as (normalized sound transmission loss), indoor surface area, sound absorption performance (sound absorption), reflection of sound from surrounding buildings, and the like may be included to realize the living environment of the building.

The generated audition sounds are, for example, (1) indoor noise caused by external noise, (2) inter-room sound insulation performance (noise propagating from adjacent rooms), (3) noise propagating from inside and outside the building to the site boundary, (4) indoor quietness performance due to air conditioning equipment, (5) floor impact sound blocking performance (floor impact sound), and (6) indoor reverberation time (sound reverberation).

Specifically, (1) is the sound of how the sound is heard in the room when there is a noise source such as a railway outside. (2) is the sound of how the sound is heard in the adjacent room when there is a noise source such as the sound of a TV or a meeting in a certain room. (3) is a propagating sound that indicates how noise sources such as facility machinery and work sounds within the building site (inside or outside the building) are heard to the boundary of the site or the neighborhood. (4) is how the quietness of the room changes when the air conditioner or total heat exchanger is the noise source of the indoor air conditioning equipment, or how the sound of the air conditioning equipment is heard in the room. It is a sound about (5) is the sound of how jumping, running, etc. sounds from a room on the upper floor are heard in a room on the lower floor. (6) is the sound of how conversations and sounds from audio equipment are heard in a room where a meeting or lecture is held in the room.

The processed audition sound generation unit 215 acquires a second processing correction value for processing the audition sound based on the output condition of the output unit 140 (speaker) for outputting the generated audition sound. The audition sound is processed using the second correction value for processing to generate the processed audition sound.

Since the reproducibility of the audition sound output from the output unit 140 depends on the characteristics of the output unit 140, even if the same audition sound data is reproduced, it is output from a plurality of output units 140 with different characteristics. For listeners, there may be differences in how they are heard. When such a situation occurs, additional work may be required after the actual construction of the building or the like. Therefore, the generated audition sound is processed according to the output characteristics of the output unit 140 in order to reproduce the sound that can actually be heard in advance. A correction value for processing (second correction value for processing) is used for processing the audition sound.

The second correction value for processing is determined by outputting a standard experimental sound for each of the output units 140 (speakers) and confirming the output characteristics such as the frequency characteristics of each output unit 140. be. Then, the processed audition sound generation unit 215 processes the audition sound using the second processing correction value determined as described above, and outputs the generated audition sound according to the characteristics of the output unit 140. Generate a processed audition sound.

The second transmission unit 216 transmits the processed preview sound generated by the processed preview sound generation unit 215 to the mobile terminal 120 . The second transmission section 216 may directly transmit the generated processed audition sound to the output section 140 .

Next, the mobile terminal 120 has an acquisition section 221 , a first transmission section 222 , a second reception section 223 and an output control section 224 . Furthermore, a sound pickup unit 130 and an output unit 140 are connected to the mobile terminal 120 . Note that the sound pickup unit 130 and the output unit 140 may be built in the mobile terminal 120 .

The acquisition unit 221 acquires a target sound picked up by the sound pickup unit 130 (microphone) at a predetermined location. Here, the target sound includes at least one of indoor sound and outdoor sound. The data of the acquired target sound is analog data. can be converted to data. Also, if the sound pickup unit 130 does not have an AD converter, the AD converter of the mobile terminal 120 may be used to convert the sound into digital data. Furthermore, if neither the sound pickup unit 130 nor the mobile terminal 120 has an AD converter, the AD converter of the target sound processing device 110 converts the analog data of the picked-up target sound into digital data, as described above. may

The first transmission unit 222 transmits the acquired target sound data to the target sound processing device 110 . The data of the target sound to be transmitted to the target sound processing device 110 may be analog data or digital data.

The second receiving unit 223 receives the processed audition sound 141 transmitted from the target sound processing device 110 . Data of the processed audition sound 141 received is digital data.

The output control section 224 controls the received processed audition sound 141 and outputs it from the output section 140 . The output control unit 224 converts the received digital data of the processed audition sound 141 into analog data, sends the analog data to the output unit 140, and controls the output unit 140 to reproduce the analog data of the processed audition sound 141. do.

Next, an example of the microphone correction value table 301 and the speaker correction value table 302 of the target sound processing device 110 of the target sound processing system 100 will be described with reference to FIGS. 3A and 3B. A microphone correction value table 301 stores a characteristic 312 and a correction value 313 in association with a microphone ID (Identifier) 311 . The microphone ID 311 is an identifier for identifying a microphone capable of picking up the target sound. Characteristics 312 indicate characteristics of the microphone and include frequency characteristics and sound pickup levels. Correction value 313 includes a frequency correction value and a level correction value. Then, the processed target sound generation unit 213 of the target sound processing device 110 refers to the microphone correction value table 301, extracts a correction value according to the characteristics of the microphone (sound pickup unit 130), and converts the received target sound into process.

The speaker correction value table 302 stores characteristics 322 and correction values 323 in association with speaker IDs 321 . The speaker ID 321 is an identifier for identifying a speaker capable of outputting the processed trial sound transmitted from the target sound processing device 110 . A characteristic 321 indicates the characteristics of the speaker, including frequency characteristics and possible output levels. Correction value 323 includes a frequency correction value and a level correction value. Then, the processed audition sound generation unit 215 of the target sound processing device 110 refers to the speaker correction value table 302, extracts a correction value according to the characteristics of the speaker (output unit 140), and processes the generated audition sound. do.

The hardware configuration of the target sound processing device 110 of the target sound processing system 100 will be described with reference to FIG. A CPU (Central Processing Unit) 410 is a processor for arithmetic control, and implements each functional configuration of the target sound processing device 110 in FIG. 2 by executing a program. The CPU 410 may have multiple processors and execute different programs, modules, tasks, threads, etc. in parallel. ROM (Read Only Memory) 420 stores fixed data such as initial data and programs and other programs. Network interface 430 also communicates with other devices and the like via a network. Note that the CPU 410 is not limited to one, and may be a plurality of CPUs or may include a GPU (Graphics Processing Unit) for image processing. Moreover, the network interface 430 preferably has a CPU independent of the CPU 410 and writes or reads transmission/reception data in a RAM (Random Access Memory) 440 area. It is also desirable to provide a DMAC (Direct Memory Access Controller) for transferring data between RAM 440 and storage 450 (not shown). Further, CPU 410 recognizes that data has been received or transferred to RAM 440 and processes the data. Also, the CPU 410 prepares the processing result in the RAM 440, and entrusts subsequent transmission or transfer to the network interface 430 or DMAC.

RAM 440 is a random access memory used by CPU 410 as a work area for temporary storage. The RAM 440 has a storage area for storing data necessary for implementing the present embodiment. The target sound data 441 is data of a target sound picked up using the sound pickup unit 130 at a predetermined location, and is digitally converted data.

The microphone correction value 442 is used to calibrate the microphone sensitivity (the difference between the actual sound and the collected sound) that depends on the sound pickup unit 130 (microphone) used when picking up the target sound. The speaker correction value 443 is set in order to cancel the acoustic characteristics (difference between the generated preview sound and the reproduced preview sound) dependent on the output unit 140 (speaker) that reproduces the generated processed preview sound. Used.

The processed target sound data 444 is data of the target sound obtained by processing the collected target sound using the first correction value for processing. The audition sound data 445 is audition sound data obtained by processing the processed target sound and reproducing the sound actually heard when the target sound is auditioned in a predetermined place and under a predetermined environment. The processed audition sound data 446 is the audition sound processed using the second processing correction value based on the output condition of the output unit 140 for outputting the generated audition sound.

The transmitted/received data 447 is data transmitted/received via the network interface 430 . RAM 440 also has an application execution area 448 for executing various application modules.

The storage 450 stores a database, various parameters, or the following data or programs necessary for realizing this embodiment. Storage 450 stores microphone correction value table 301 and speaker correction value table 302 . The microphone correction value table 301 is a table for managing the relationship between the microphone ID 311 and the correction value 313 shown in FIG. 3A. This is a table that manages the relationship between

The storage 450 further stores a first reception module 451 , a sound collection condition acquisition module 452 , a processed target sound generation module 453 , an audition sound generation module 454 , a processed audition sound generation module 455 and a second transmission module 456 . The first receiving module 451 is a module that receives the collected target sound from the mobile terminal 120 . The sound collection condition acquisition module 452 is a module that acquires the sound collection condition of the received target sound. The processed target sound generation module 453 acquires the first correction value for processing based on the acquired sound collection conditions, and processes the target sound using the acquired first correction value for processing to generate the processed target sound. is a module that generates The audition sound generation module 454 is a module that processes the processed target sound to generate audition sound, which is the sound that can actually be heard when the target sound is heard at a predetermined place under a predetermined environment. The processed audition sound generation module 455 is a module for processing the audition sound using the second correction value for processing according to the output condition of the output unit 140 for outputting the generated audition sound to generate the processed audition sound. is. The second transmission module 456 is a module that transmits the generated processed audition sound to the mobile terminal 120 . These modules 451 to 456 are read by the CPU 410 into the application execution area 448 of the RAM 440 and executed. The control program 457 is a program for controlling the target sound processing device 110 as a whole.

The input/output interface 460 interfaces input/output data with input/output devices. A display unit 461 and an operation unit 462 are connected to the input/output interface 460 . A storage medium 464 may also be connected to the input/output interface 460 . Furthermore, a speaker 463 as an audio output unit, a microphone (not shown) as an audio input unit, or a GPS position determination unit may be connected. Note that the RAM 440 and the storage 450 shown in FIG. 4 do not show programs or data relating to general-purpose functions of the target sound processing device 110 or other realizable functions.

Next, the processing procedure of the target sound processing device 110 will be described with reference to the flowchart shown in FIG. 5A. This flowchart is executed by the CPU 410 in FIG. 4 using the RAM 440, and implements each functional configuration of the target sound processing device 110 in FIG.

In step S<b>501 , the target sound processing device 110 receives from the mobile terminal 120 the target sound picked up at a predetermined location. In step S503, the target sound processing device 110 acquires the sound collection condition of the acquired target sound. In step S505, the target sound processing device 110 acquires a first processing correction value for processing the target sound based on the acquired sound collection conditions. In step S507, the target sound processing device 110 processes the target sound using the acquired first correction value for processing to generate a processed target sound.

In step S509, the target sound processing device 110 processes the generated processed target sound to generate a trial sound, which is a sound that can actually be heard when listening to the target sound at a predetermined location under a predetermined environment. In step S511, the target sound processing device 110 acquires a second processing correction value for processing the audition sound based on the output condition of the output unit 140 that outputs the generated audition sound. In step S513, the target sound processing device 110 processes the generated audition sound using the acquired correction value for second processing to generate a processed audition sound. The target sound processing device 110 transmits the generated processed audition sound to the mobile terminal 120 .

Next, a processing procedure of the mobile terminal 120 will be described with reference to the flowchart shown in FIG. 5B. This flowchart is executed by a CPU (not shown) using a RAM, and implements each functional configuration of the mobile terminal 120 in FIG.

In step S<b>531 , the mobile terminal 120 acquires the target sound picked up by the sound pickup unit 130 from the sound pickup unit 130 . Here, the mobile terminal 120 may digitally convert the acquired target sound. In step S<b>533 , the mobile terminal 120 transmits the acquired target sound data to the target sound processing device 110 . In step S<b>535 , the portable terminal 120 receives the processed audition sound from the target sound processing device 110 and outputs the received processed audition sound from the output unit 140 .

According to this embodiment, since the audition sound is generated based on the target sound processed according to the characteristics of the sound pickup unit, the audition sound can be generated without depending on the sound pickup device (without using a dedicated sound pickup device). can be generated. Furthermore, since the generated audition sound is processed according to the characteristics of the output section, the audition sound can be listened to independently of the output device (without using a dedicated output device). Moreover, since there is no need to use a dedicated device, it is possible to quickly and accurately generate and listen to the audition sound on the spot for the target sound at an arbitrary location.

[Second embodiment]
Next, a target sound processing system 600 according to a second embodiment of the present invention will be explained using FIGS. 6A to 7B. FIG. 6A is a sequence diagram for explaining the processing procedure of the target sound processing system 600 according to this embodiment. The target sound processing system 600 according to the present embodiment differs from the first embodiment in that the target sound processing device 610 generates a new audition sound based on the audition result of the audition sound. Since other configurations and operations are the same as those of the first embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof will be omitted.

Referring to FIG. 6A, generation of a new processed trial sound based on the trial result of the processed trial sound will be described. In step S<b>601 , the mobile terminal 620 transmits the reproduced processed audition sound, for example, the result of the user's audition, to the target sound processing device 610 . Then, in step S603, the target sound processing device 610 changes the conditions for generating the audition sound, such as the area of the window and the sound insulation performance (sound transmission loss), based on the audition result (determination result). Generate sound again. In step S605, the target sound processing device 610 transmits the generated processed audition sound to the mobile terminal 620 (output unit 140). In step S607, the output unit 140 reproduces the regenerated processed audition sound. As described above, in the target sound processing system 100, the processed trial sound may be regenerated according to the audition result of the processed trial sound. It is possible to audition the audition sound in the environment.

Next, referring to FIG. 6B, target sound processing system 600 includes target sound processing device 610 and mobile terminal 620 . The target sound processing device 610 has a result reception unit 611 . The mobile terminal 620 also has a result input reception unit 621 .

The result input reception unit 621 receives an input of the result of audition of the processed audition sound output from the output unit 140 by the person who listened to the processed audition sound. Here, the audition result of the processed audition sound is, for example, an evaluation of the output processed audition sound, an instruction to change the predetermined environment, or the like.

Then, the result receiving unit 611 receives the audition result of the processed audition sound from the portable terminal 620 . The audition sound generation unit 214 of the target sound processing device 610 generates a audition sound in a new environment different from the audition sound previously generated from the collected target sound based on the received audition result. Here, a new environment different from the previously generated audition sound refers to an environment where, for example, the window area is increased or decreased, the sound insulation performance is changed, or the sound insulation performance of the wall is changed. is not limited.

The audition sound generation unit 214 changes the conditions for generating the audition sound based on the received audition result (determination result), and generates the audition sound according to the audition result (determination result). The audition sound generation unit 214 generates audition sounds under all settable generation conditions, for example, as audition sound generation conditions.

The extracting unit 612 extracts a trial sound that satisfies the user's request based on the user's determination result from among the trial sounds generated under all the settable generation conditions. Note that the extraction unit 612 may extract all audition sounds generated under all settable generation conditions.

The assigning unit 613 assigns a score to the sample listening sound extracted by the extracting unit 612, taking into consideration the cost and construction period required for constructing the predetermined environment. The imparting unit 613 may impart a high score to, for example, a trial sound that can construct a predetermined environment at low cost and in a short construction period. Note that the scoring method is not limited to the method shown here.

Second transmitting section 216 then transmits the newly generated processed audition sound to portable terminal 620 . The output unit 140 outputs the received processed audition sound, and the result input reception unit 621 again receives the audition result from the person who auditioned the processed audition sound, and transmits the received audition result to the target sound processing device 610. do. In the target sound processing system 600, by repeating the procedure as described above, it is possible to try trial sounds under various environments.

Next, the processing procedure of target sound processing device 610 and portable terminal 620 will be described with reference to FIGS. 7A and 7B. First, referring to FIG. 7A, in step S701, target sound processing device 610 determines whether or not there is a request to regenerate audition sound. If there is a regeneration request (YES in step S701), the target sound processing device 610 returns to step S509 and regenerates the audition sound that satisfies the target level (noise level, inter-room sound insulation performance (Dr-50), etc.). Repeat procedure. For example, the audition sounds are generated under all generation conditions that can be set at that time, and then the audition sounds that satisfy the user's request are extracted from the generated audition sounds to regenerate the audition sounds. you can go

Next, referring to FIG. 7B, in step S731, portable terminal 620 determines whether or not the audition result received by result input reception unit 621 is the result of requesting reproduction of the processed audition sound (test-listen sound). do. If there is no regeneration request (NO in step S731), the mobile terminal 620 terminates the process. If there is a regeneration request (YES in step S731), the mobile terminal 620 proceeds to the next step. In step S<b>733 , the mobile terminal 620 sends a retransmission request for the audition sound to the target sound processing device 610 .

In step S<b>735 , the mobile terminal 620 receives the processed audition sound regenerated from the target sound processing device 610 and outputs it from the output unit 140 . In step S737, portable terminal 620 determines whether or not the audition result of the regenerated processed audition sound is the result of requesting regeneration. If there is a regeneration request (YES in step S737), the mobile terminal 620 returns to step S733. If there is no regeneration request (NO in step S737), the mobile terminal 620 ends the process.

According to this embodiment, since the input of the audition result of the audition sound is accepted, the audition sound can be auditioned under various environments.

[Third Embodiment]
Next, a target sound processing device according to a third embodiment of the present invention will be described with reference to FIGS. 8 to 11. FIG. FIG. 8 is a block diagram for explaining the configuration of the target sound processing device 800 according to this embodiment. Compared to the target sound processing systems of the first and second embodiments, the target sound processing device 800 according to the present embodiment collects, processes, and outputs the target sound. different in

The target sound processing device 800 includes a sound collection unit 801, a first characteristic acquisition unit 802, a processed target sound generation unit 803, an audition sound generation unit 804, a second characteristic acquisition unit 805, a processed audition sound generation unit 806, and output control. It has a unit 807 , an output unit 808 and a storage unit 809 .

The sound pickup unit 801 picks up the target sound 131 at a predetermined location. A sound pickup unit 801 is a device such as a microphone, and may be either an external type or a built-in type.

A first characteristic acquisition unit 802 acquires a first characteristic of the sound pickup unit 801 . The first characteristic is, for example, the frequency characteristic of the sound picked up by the sound pickup unit 801, the sound pickup level of the sound pickup unit 801, and the like. A first characteristic acquisition unit 802 acquires a first characteristic from the microphone correction value table 301 stored in the storage unit 809 .

The processed target sound generation unit 803 acquires a first processing correction value for processing the collected target sound based on the acquired first characteristic, and uses the acquired first processing correction value to The target sound is processed to generate a processed target sound. That is, the processed target sound generation unit 803 acquires from the microphone correction value table 301 the first processing correction value stored in association with the acquired first characteristic. Then, using the acquired first correction value for processing, the target sound 131 is processed to generate a processed target sound.

Here, the reason for processing the target sound 131 picked up using the first correction value for processing is that there are various types of sound pickup devices such as microphones, and each microphone has various characteristics. This is to eliminate variations that depend on the characteristics of the equipment (equipment dependence). For example, some microphones are configured to cut sounds in the high range (high frequency range). Another microphone is configured to cut sounds in the low range (low frequency range).

In this way, each microphone has various characteristics, for example, depending on its usage and price. Features (machine dependent) will be included. Therefore, the processed target sound generation unit 803 removes the characteristics of the sound (sound data) using the first correction value for processing in order to eliminate the characteristics of this sound (sound data), and removes the characteristics of the sound (sound data). (microphone) to eliminate differences in equipment characteristics.

The audition sound generation unit 804 generates audition sound that reproduces the sound actually heard when the collected target sound 131 is heard under a predetermined environment at the place where the target sound 131 is collected. Here, the predetermined environment is, for example, a building such as an apartment complex or a detached house scheduled to be constructed at a predetermined location where the target sound 131 is collected, and includes indoors of these buildings and outdoors such as a veranda. The environment includes the location and area of the walls of the building, sound insulation performance (sound transmission loss), the location and area of windows attached to the building, sound insulation performance (sound transmission loss), the area and number of air supply ports, sound insulation performance ( Various factors such as normalized sound transmission loss), indoor surface area, sound absorption performance (sound absorption), etc. that realize the living environment of the building may be included.

The generated audition sounds are, for example, (1) indoor noise caused by external noise, (2) inter-room sound insulation performance (noise propagating from adjacent rooms), (3) noise propagating from inside and outside the building to the site boundary, (4) indoor quietness performance due to air conditioning equipment, (5) floor impact sound blocking performance (floor impact sound), and (6) indoor reverberation time (sound reverberation).

A second characteristic acquisition section 805 acquires the second characteristic of the output section 808 for outputting the generated audition sound. The second characteristic is, for example, the frequency characteristic of the sound output from the output unit 808, the possible output level of the output unit 808, and the like. A second characteristic acquisition unit 805 acquires the second characteristic from the speaker correction value table 302 stored in the storage unit 809 .

The processed audition sound generation unit 806 obtains a second processing correction value for processing the generated audition sound based on the obtained second characteristics, and uses the obtained second processing correction value to generate a audition sound. A sound is processed to generate a processed audition sound 141 . That is, the processed audition sound generation unit 806 acquires from the speaker correction value table 302 the correction value for second processing that is stored in association with the acquired second characteristic. Then, using the obtained correction value for second processing, the preview sound is processed to generate the processed preview sound 141 .

As with the microphone (sound pickup unit 801) described above, there are various output devices such as speakers that process the generated audition sound using the second correction value for processing. , and each speaker has various characteristics, so that variations depending on the characteristics of the equipment (equipment dependence) can be eliminated. For example, a speaker may have excellent high frequency reproduction but poor low frequency reproduction, or, conversely, have poor high frequency reproduction but poor low frequency reproduction. Sometimes it's better.

In this way, each speaker has various characteristics according to its usage, price, etc., and the sound output from each speaker is output as a sound according to its characteristics. Become. Therefore, in order to eliminate the device-dependent characteristics of the sound to be output, the processed audition sound generation unit 806 uses the second correction value for processing to remove the device-dependent characteristics, and the output unit 808 (speaker ) is canceled to reproduce the sound that is actually heard.

The output control unit 807 controls the generated processed audition sound and outputs it from the output unit 808 . The output control unit 807 , for example, converts the processed audition sound from digital data to analog data and sends the converted analog data to the output unit 808 .

The output unit 808 outputs the processed audition sound. An output unit 808 is a device such as a speaker or headphones for outputting the processed audition sound. Note that the output unit 808 may be built in the target sound processing device 800 or externally attached to the target sound processing device 800 .

Storage unit 809 stores microphone correction value table 301 and speaker correction value table 302 . The microphone correction value table 301 is a table for managing the relationship between the microphone ID 311 and the correction value 313, and the speaker correction value table 302 is for managing the relationship between the speaker ID 321 and the correction value 323 and the like. Then, the processed target sound generation unit 803 acquires the first processing correction value from the microphone correction value table 301, and the processed audition sound generation unit 806 acquires the second processing correction value from the speaker correction value table 302. do.

As described above, in the target sound processing apparatus 800, the correction values for the first processing and the correction values for the second processing are stored in advance in the storage unit 809 as the microphone correction value table 301 and the speaker correction value table 302, I am trying to read it accordingly.

According to this embodiment, the target sound processing device has a table storing correction values for processing, so it is possible to quickly and reliably generate a processed audition sound. Further, even if the sound collection location and the installation location of the target sound processing device are different, it is possible to easily generate the processed audition sound and listen to it.

[Fourth embodiment]
Next, a target sound processing device 900 according to a fourth embodiment of the present invention will be described with reference to FIGS. 9 to 12. FIG. FIG. 9 is a block diagram for explaining the configuration of the target sound processing device 900 according to this embodiment. The target sound processing device 900 according to the present embodiment differs from the target sound processing systems and target sound processing devices of the first to third embodiments in that a pre-generated database is used.

The target sound processing device 900 has a storage unit 901 , a reception unit 902 , a search unit 903 , an acquisition unit 904 and an output control unit 905 .

The storage unit 901 stores the target sound (target sound data) picked up by the sound pickup unit 130 and the sound pickup conditions of the picked target sound at a predetermined location. The storage unit 901 further processes the acquired target sound using the first correction value for processing the target sound acquired based on the first characteristic of the sound pickup unit 130 to process the processed target sound. (processed target sound data) and audition sounds (auditory sound data) that reproduce sounds actually heard when the target sounds are heard at a predetermined location under a predetermined environment are stored.

The storage unit 901 also uses the second correction value for processing the audition sound acquired based on the second characteristic of the output unit 140 for outputting the audition sound to process the audition sound. Stores the finished audition sound (processed audition sound data).

The storage unit 901 associates the target sound data, the sound collection conditions, the processed target sound data, the audition sound data, and the processed audition sound data with each other, and stores them as the audition sound database 911 . In the target sound processing device 900 , each time the target sound is picked up to generate the processed audition sound, the data is stored in the storage unit 901 and stocked in the audition sound database 911 . In this way, when the target sound is picked up, various data generated are stored in the database. Therefore, as the database stock increases, it becomes possible to listen to the desired processed audition sound more quickly. Become.

The reception unit 902 receives the characteristics of the target sound for which the user wishes to listen to the processed audition sound. Here, the characteristics of the target sound are, for example, places where there is a factory nearby, places where highways and main roads run nearby, places near the coast, places in mountains, places near parks, and height [m], time zone (day and night), weather, temperature [°C], atmospheric pressure [atm], humidity [%], wind speed [m/s], wind direction, etc., but not limited to these. Alternatively, the frequency characteristic or waveform (change in sound pressure on the time axis) of the target sound may be used.

The search unit 903 searches the storage unit 901 for a target sound corresponding to the received feature. That is, the collected target sound is stored as target sound data to which the above-described features are added as metadata. Therefore, the search unit 903 searches for target sound data corresponding to the received feature, relying on this metadata. Note that the search unit 903 searches for target sound data that completely matches the received features. The search may be performed in order from the one with the highest matching rate.

The acquisition unit 904 acquires the processed audition sound (processed audition sound data) associated with the searched target sound (target sound data). In this case, one target sound is associated with a plurality of processed preview sounds. This is because there are a plurality of output units 140 of various types, and there are a plurality of processed audition sounds corresponding to each of these output units 140 . Therefore, the acquisition unit 904 acquires the processed audition sound that matches the characteristics of the output unit 140 that outputs the searched target sound.

The output control unit 905 controls the acquired processed audition sound and outputs it from the output unit 140 . The processed preview sound output from the output unit 140 is a preview sound that matches the characteristics of the output unit 140 .

Next, the structure of the audition sound database 911 will be described with reference to FIG. The audition sound database 911 stores target sound data 1002 , sound pickup conditions 1003 , processed target sound data 1004 , audition sound data 1005 , output conditions 1006 and processed audition sound data 1007 in association with target sound IDs 1001 .

The target sound ID 1001 is an identifier for identifying the collected target sound. The target sound data 1002 is data of the target sound picked up, and includes analog data of the target sound picked up by the sound pickup unit 130 and digital data converted from the analog data. Note that the target sound data 1002 may be analog data only, or may be digitally converted to obtain digital data as necessary.

The sound pickup condition 1003 is various conditions when the target sound is picked up. The sound pickup conditions 1003 include microphone characteristics, sound pickup environment, and the like. The microphone characteristics are the frequency characteristics of the sound pickup unit 130 (microphone), the sound pickup level, and the like, and the sound pickup environment is weather, temperature, atmospheric pressure, and the like.

The processed target sound data 1004 is data obtained by processing the collected sound data according to the characteristics of the sound pickup unit 130 (microphone). The audition sound data 1005 is data of audition sound that reproduces the sound actually heard when the target sound is listened to at a predetermined place under a predetermined environment. The output condition 1006 is a condition related to the output such as the frequency characteristic of the output unit 140 (speaker) and the output possible level. The processed audition sound data 1007 is audition sound data that has been processed in accordance with the output characteristics of the output unit 140 (speaker).

Then, the search unit 903 searches for a target sound that matches the characteristics received by the reception unit 902 from the audition sound database 911 stored in the storage unit 901 , and the acquisition unit 904 obtains the processed sound that matches the characteristics of the output unit 140 . Get preview sound data.

The hardware configuration of the target sound processing device 900 will be described with reference to FIG. A RAM 1140 is a random access memory used by the CPU 410 as a work area for temporary storage. The RAM 1140 has a storage area for storing data necessary for implementing the present embodiment. The target sound feature data 1141 is data relating to the feature of the target sound for which the user wishes to listen to the processed trial sound. The processed audition sound data 1142 is data relating to the processed audition sound stored in association with the target sound obtained by searching the audition sound database 911 based on the characteristics of the target sound to be auditioned for the processed audition sound. . The transmitted/received data 1143 is data transmitted/received via the network interface 430 . The RAM 1140 also has an application execution area 1144 for executing various application modules.

The storage 1150 stores a database, various parameters, or the following data or programs necessary for realizing this embodiment. Storage 1150 stores audition sound database 911 . The audition sound database 911 is a database that stores the target sound ID 1001 and the processed audition sound data 1007 shown in FIG. 10 in association with each other.

Storage 1150 further stores reception module 1151 , search module 1152 , acquisition module 1153 and output control module 1154 . The reception module 1151 is a module that receives the characteristics of the target sound for which the user wishes to listen to the processed audition sound. The search module 1152 searches the audition sound database 911 stored in the storage unit 901 for a target sound corresponding to the received feature. The acquisition module 1153 is a module that acquires from the audition sound database 911 the processed audition sound associated with the searched target sound. The output control module 1154 is a module that controls the obtained processed audition sound and outputs it from the output unit 140 . These modules 1151 to 1154 are read by the CPU 410 into the application execution area 1144 of the RAM 440 and executed. The control program 1155 is a program for controlling the target sound processing device 900 as a whole.

Next, the processing procedure of the target sound processing device 900 will be described with reference to the flowchart shown in FIG. This flowchart is executed by the CPU 410 in FIG. 11 using the RAM 1140 to implement each functional configuration of the target sound processing device 900 in FIG.

In step S1201, the reception unit 902 of the target sound processing apparatus 900 receives the characteristics of the target sound to be auditioned for the processed audition sound. In step S1203, the search unit 903 searches the audition sound database 911 for a target sound corresponding to the received feature. In step S<b>1205 , the acquisition unit 904 acquires the processed audition sound associated with the searched target sound from the audition sound database 911 . In step S<b>1207 , the output control unit 905 controls the obtained processed audition sound and outputs it from the output unit 140 .

In the above description, an example was used in which the target sound, the sound collection conditions, the processed target sound, the audition sound, and the processed audition sound are associated with each other and stored in the database. are not limited to these.

For example, if the target sound is stored in a database, the target sound can be used if the desired target sound is among the target sounds that have been collected in the past, without having to bother to pick up the target sound. can do. In this way, by using the target sound that has been collected in the past, it is possible to reduce the time required for collecting the sound.

Further, for example, if the target sound, the sound collection condition, and the processed target sound generated from the target sound are stored in a database in association with each other, if the desired target sound exists in the database, the desired target sound Processing up to the generation of the processed target sound generated from the sound becomes unnecessary. That is, by using the data of the processed target sound registered in the database in advance, it is possible to reduce the time until finally obtaining the processed audition sound.

Furthermore, if the audition sound is stored in the database together with the target sound, the sound pickup conditions, and the processed target sound in association with the database, if the desired target sound exists in the database, the processing up to the generation of the audition sound is unnecessary. . Therefore, as described above, it is possible to greatly reduce the time required to finally obtain the processed audition sound.

According to the present embodiment, when the target sound is picked up, various data generated are stocked in the database. Therefore, as the amount of stock in the database increases, the desired processed audition sound can be listened to more quickly. becomes possible.

[Fifth embodiment]
Next, a target sound processing system according to a fifth embodiment of the present invention will be described with reference to FIGS. 13 to 15. FIG. A target sound processing system according to this embodiment includes a sound collecting device, a mobile terminal, and a target sound processing device. The mobile terminal and the target sound processing device are connected via a network. Also, the sound collecting device and the mobile terminal are connected by wire or wirelessly. 13 to 15 are flowcharts for explaining the processing procedures of the sound collecting device, mobile terminal, and target sound processing device included in the target sound processing system according to this embodiment. In the following description, an example in which the sound collecting device and the mobile terminal are configured separately will be used, but the sound collecting device may be built in the mobile terminal.

First, with reference to FIG. 13, the processing procedure of the sound collecting device will be described. In step S1301, a first operator operates a sound collecting device such as a microphone to collect target sound at a predetermined location. In step S1303, the first operator operates the sound collecting device to transmit the collected target sound to the portable terminal.

Next, referring to FIG. 14, a processing procedure of the mobile terminal will be described. In step S1401, the first operator operates a portable terminal such as a tablet terminal or a smartphone to convert the received target sound into digital data. In step S1403, the first operator operates the mobile terminal to transmit the target sound (target sound data) to the target sound processing device. In step S1405, the first operator operates the mobile terminal to output the processed audition sound generated by the target sound processing device, which will be described later, from the output unit. In step S1407, the first operator operates the mobile terminal to transmit the listening result of the output processed audition sound to the target sound processing apparatus. In step S1409, the first operator operates the mobile terminal to output the new processed audition sound received from the target sound processing device from the output unit.

A processing procedure of the target sound processing apparatus will be described with reference to FIG. In step S1501, the second operator operates the target sound processing device to acquire the correction value for first processing based on the sound pickup conditions of the sound pickup device. In step S1503, the second operator operates the target sound processing device to process the collected target sound using the acquired correction value for first processing to generate a processed target sound. In step S1505, the second operator operates the target sound processing device to generate the audition sound that reproduces the sound actually heard when listening to the target sound in a predetermined environment under a predetermined environment. Generate from sound.

In step S1507, the second operator operates the target sound processing device to process the generated audition sound based on the output conditions of the output unit of the portable terminal for outputting the generated audition sound. Get the correction value for processing. In step S1509, the second operator operates the target sound processing device to process the generated audition sound using the obtained second processing correction value to generate a processed audition sound. Note that the output unit may be built in the mobile terminal or may be externally attached to the mobile terminal. In step S1511, the second operator operates the target sound processing device to transmit the generated processed audition sound to the portable terminal.

In step S1513, the second operator operates the target sound processing device to generate a new processed audition sound based on the audition result of the generated processed audition sound received from the portable terminal. The new processed audition sound is a audition sound generated by changing environmental conditions from the previously generated processed audition sound. In step S1515, the second operator operates the target sound processing device to transmit the generated new processed audition sound to the portable terminal. At least one of the first worker and the second worker may listen to and evaluate the output processed audition sound. For example, when the second operator listens to the processed audition sound, the second operator himself/herself evaluates the processed audition sound generated by the second operator. Alternatively, the output processed audition sound may be auditioned and evaluated by a third worker who is different from the first and second workers.

According to this embodiment, even if the sound collection location and the installation location of the target sound processing device are different, it is possible to easily generate the processed audition sound and listen to it.

[Example]
Next, embodiments of the present invention will be described with reference to FIGS. 16 to 25. FIG. In addition, the scope of the present invention is not limited to the following examples.

In the target sound processing systems 100 and 600 and the target sound processing devices 800 and 900, audit sounds generated are six items ((a) to (f)) shown in Table 1. That is, (a) indoor noise caused by external noise, (b) inter-room sound insulation performance (noise propagated from the next room), (c) noise propagated from inside and outside the building to the site boundary, (d) indoor noise caused by air conditioning equipment There are six items: noise, (e) floor impact sound insulation performance (floor impact sound), and (f) room reverberation time (sound reverberation).

For specific examples of each of the six items, for example, (a) traffic noise (road traffic noise, railway noise, etc.), (b) airborne sound such as speech in conference rooms and TV sound in hotels, and (c) outdoor equipment (d) indoor air-conditioning equipment; (e) floor impact sounds (heavy floor impact sounds/lightweight floor impact sounds); For each calculation, for example, techniques described in Patent Documents 1 to 3 are used.

The target frequencies for each of the six items are (a) 50Hz to 5,000Hz band, (b) 100Hz to 5,000Hz band, (c) and (d) 50Hz to 5,000Hz band, and (e) heavy floor impact noise. : 50 Hz to 630 Hz band, light floor impact sound: 50 Hz to 5,000 Hz band, (f) 100 Hz to 5,000 band.

As for the generation of the audition sound, in (a) to (d), a volume reduction filter is generated, and the sound source data (collected target sound data) is filtered to generate the audition sound.

In (e), the floor impact sound level is obtained from the impact force of the standard impact source (tire, ball, tapping) according to JIS standards, and the standard impact source collected for each condition such as slab thickness, floor finish structure, finished ceiling, etc. A sound source data close to the conditions calculated from the floor impact sound is extracted, and a filter is generated in which the level difference between the floor impact sound level and the calculated value is used as a reduction volume to generate the audition sound. Note that the heavy floor impact sound is evaluated in the 50 Hz to 630 Hz band, so frequencies outside the target are filtered and not reproduced.

In (f), an audition sound is generated by convoluting an impulse response predicted by an acoustic simulation or the like or an actual measurement value of the impulse response to a dry source sound such as reading sound collected in an anechoic room.

Next, the microphone (sound pickup unit 130 or sound pickup device) or headphone (output unit 140 or speaker) used has its own acoustic characteristics. Therefore, in order to faithfully reproduce the generated audition sound, it is necessary to correct these acoustic characteristics. do. The correction value for the acoustic characteristics of the equipment used is obtained by the following method.

≪How to correct the acoustic characteristics of the microphone≫
<Microphone frequency characteristics>
A method of correcting the acoustic characteristics of the microphone (sound pickup unit 130) will be described using a tablet terminal as the mobile terminal 120 as an example. First, it is experimentally confirmed that the sound of the evaluation target frequency can be picked up by the microphone. In an anechoic room, pink noise is generated from a speaker (sound source), and a precision sound level meter is installed at a position 1 m away to collect the sound. FIG. 16 shows the ⅓ octave band level of collected sound data.

The microphone externally attached to the tablet terminal and the precision sound level meter generally match in the target frequency range of 50 Hz to 5,000 Hz. On the other hand, with the microphone built into the tablet terminal, a level difference can be seen at low frequencies below the 80 Hz band. It is preferable to use an external microphone when picking up sounds that cause problems in the low frequency range, such as heavy floor impact sounds and equipment sounds.

<Microphone pick-up level and linearity>
When listening to the sample sound, the sound pressure level to be collected is assumed to be 30 dB to 80 dB, taking into account the level of noise that requires consideration of the user's hearing impairment and noise countermeasures when using the system. Moreover, the frequency characteristic of the microphone is linearly changed in accordance with the sound pressure level of the sound to be picked up. Therefore, the linearity between the sound pickup level of the microphone used and the frequency characteristics is experimentally confirmed.

The volume of pink noise was set to 30 dB to 80 dB, and the sound was collected using a built-in microphone of the tablet terminal and a precision sound level meter. A 1/3 octave band analysis of the collected sound is performed, and correspondence between the built-in microphone of the tablet terminal and the precision sound level meter is examined. FIG. 17 shows the results for the 1,000 Hz band as a representative example.

When the value of the precision sound level meter is taken as the true value, when using the built-in microphone of the tablet terminal, the change is approximately linear from 30 dB to 80 dB. Since the sound pressure level changes linearly within the assumed range of system use, correction can be performed with a fixed correction value for each frequency band.

After confirming that the target microphone can be used with the target sound processing system 100, the 1/3 octave band level difference between the precision sound level meter and the target microphone is corrected as a correction value (first correction value).

≪How to correct the acoustic characteristics of headphones≫
<Frequency characteristics of headphones>
Headphones are often tuned according to usage and preferences, and in order to faithfully reproduce the generated audition sound, the frequency characteristics of each individual headphone must be cancelled. Therefore, in an anechoic room, headphones are attached to a dummy head and pink noise (sound source) is reproduced via a tablet terminal. FIG. 18 shows 1/3 octave band levels of pink noise and headphone reproduction sound. For pink noise with a flat frequency characteristic, the reproduced sound of the headphones used differs for each frequency, and the characteristic is that the sound in the 400 Hz to 1,000 Hz band is particularly emphasized.

<Reproducible level and linearity of headphones>
The level of pink noise is changed and reproduced with headphones to examine the reproducible level and linearity of the headphones. FIG. 19 shows 1/3 octave band levels in a 1,000 Hz band as a representative example.

In the range of 20 dB to 80 dB, it can be reproduced with headphones, and it changes linearly according to the level change of 5 dB pitch of pink noise. Similar results were obtained in other frequency bands. Since it can reproduce up to 20 dB, for example, when considering sound insulation between rooms, the effect of spatial sound insulation performance up to Dr-55 can be expressed as an audition sound for a sound source generated at 75 dB in a sound source room. can. Here, Dr is a class of sound pressure level difference between rooms, and the larger the Dr value, the higher the sound insulation performance between rooms and the less airborne sound is transmitted.

After confirming that the target headphone can be used with the target sound processing system 100, the 1/3 octave band level difference between the pink noise (sound source) and the headphone playback sound is adjusted so that the generated audition sound can be reproduced faithfully. As a correction value (correction value for second processing), acoustic characteristics unique to headphones are cancelled.

≪Example of verification of system accuracy in an actual building≫
<Overview of Verification>
Using the room of an office, the accuracy of prediction calculation, audition sound, and processed audition sound generation by the target sound processing devices 110 and 610 and the target sound processing devices 800 and 900 regarding spatial sound insulation performance was verified. An overview of the measurement room is shown in FIG.

The parting wall between the conference room and office is a dry double wall (sound insulation performance: TL _D -40). The corridor doors between the meeting room and the office are ordinary steel parent-child doors without airtight. The conference room was used as the sound source room, and the target sound (pink noise or male reading sound) was reproduced from the speaker. The reproduced target sound was collected by the target sound processing device 110 (using the built-in microphone of the tablet terminal), and the sound source data of the collected target sound was obtained. In order to verify the accuracy of sound collection, sound was also collected using a precision sound level meter (NA-28 manufactured by RION). A dummy head was installed in the sound receiving room to collect the transmitted sound from the conference room. In addition, the inter-room sound pressure level difference in JIS A1418:2000 "Method for measuring air sound insulation performance of buildings" was also measured.

<Prediction calculation accuracy>
In order to confirm the prediction calculation accuracy by the target sound processing system 100, the predicted value of the spatial sound pressure level difference and the actually measured value were compared. FIG. 21 shows the results of the octave band level comparison. The predicted values generally correspond to the measured values in the 125 Hz to 4,000 Hz band, and the room-to-room sound pressure level difference can be predicted with high accuracy.

<Sound pickup accuracy>
Since the accuracy of sound pickup affects the accuracy of audition sound generation, the sound data collected by the target sound processing system 100 (tablet built-in microphone) and the sound data collected by the precision sound level meter were compared. The sound pressure waveform of the precision sound level meter and the sound pressure waveform (processed target sound) picked up by the target sound processing system 100 (tablet built-in microphone) are shown in FIG. 22, and the octave band levels of each sound pressure waveform are shown in FIG. .

The shape and amplitude of the sound pressure waveform picked up by the target sound processing system 100 (tablet built-in microphone) are the same waveform and amplitude as the sound pressure waveform picked up by the precision sound level meter for both the pink noise and the male reading sound. At the octave band level, the maximum error is about 1 dB, and the sound can be picked up with the same accuracy as a normal sound level meter.

<Accuracy of audition sound>
Correction processing for canceling acoustic characteristics unique to headphones is performed on the sound pressure waveform of the audition sound obtained by adding the prediction calculation result to the collected sound data of the target sound processing system 100, 600 and the target sound processing device 800, 900, Generated a processed audition sound.

FIG. 24 shows the sound pressure waveform of the audition sound, the sound pressure waveform of the processed audition sound (headphone playback sound), and the sound pressure waveform (measured values) collected using a dummy head in the office in the sound receiving room. Octave band levels are shown in FIG. Although the background noise in the sound receiving room is shown in FIG. 25, the male reading is excluded from the evaluation because it is affected by the background noise in the sound receiving room above 1,000 Hz.

The processed audition sound (headphone playback sound) has substantially the same shape and amplitude as the audition sound and the actually measured sound pressure waveform, and the octave band level is also about the same.

The audition sound generated by the target sound processing device of the system can be reproduced correctly with headphones, and the processed audition sound can reproduce the actual sound.

Although the present invention has been described with reference to the embodiments, the present invention is not limited to the above-described embodiments and can be modified as appropriate. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. Also, any system or apparatus that combines separate features included in each embodiment is included in the technical scope of the present invention.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied when an information processing program that implements the functions of the embodiments is supplied to a system or apparatus and executed by a built-in processor. Therefore, in order to realize the functions of the present invention on a computer, the program installed in the computer, the medium storing the program, the WWW (World Wide Web) server from which the program is downloaded, and the processor that executes the program are all included in the present invention. It is included in the technical scope of the invention. In particular, non-transitory computer readable media storing programs that cause a computer to perform at least the processing steps included in the above-described embodiments fall within the scope of the present invention.

Claims (6)

A target sound processing system including a sound collecting device that collects target sound from a predetermined location, a mobile terminal, and a target sound processing device,
A first operator collects the target sound using the sound collection device, transmits the collected target sound to the mobile terminal,
the first operator operates the mobile terminal to transmit the target sound from the mobile terminal to the target sound processing device;
A second operator operates the target sound processing device to process the target sound transmitted from the mobile terminal using a first correction value for processing based on the sound pickup conditions of the sound pickup device, Generate the processed target sound,
When the second worker operates the target sound processing device and listens to the target sound transmitted from the mobile terminal at the predetermined place under a predetermined environment, the target sound can actually be heard. generating an audition sound that reproduces the sound from the processed target sound;
The second operator operates the target sound processing device to process the audition sound based on the output conditions of the output unit of the portable terminal for outputting the generated audition sound. to generate
the second operator operates the target sound processing device to transmit the processed audition sound to the mobile terminal;
The first operator operates the mobile terminal to output the transmitted processed audition sound from the output unit,
A target sound processing system in which a third operator listens to the output processed audition sound. 2. The target sound processing system according to claim 1, wherein said third worker is at least one of said first worker and said second worker. A target sound processing system including a mobile terminal and a target sound processing device,
A first operator operates the mobile terminal to transmit a target sound picked up by a sound pickup device built in the mobile terminal from the mobile terminal to the target sound processing device,
A second operator operates the target sound processing device to process the target sound transmitted from the mobile terminal using a first correction value for processing based on the sound pickup conditions of the sound pickup device, Generate the processed target sound,
A sound actually heard when the second worker operates the target sound processing device and listens to the target sound transmitted from the mobile terminal at a predetermined place under a predetermined environment. from the processed target sound,
The second operator operates the target sound processing device to process the audition sound based on the output conditions of the output unit of the portable terminal for outputting the generated audition sound. to generate
the second operator operates the target sound processing device to transmit the processed audition sound to the mobile terminal;
The target sound processing system, wherein the first operator operates the mobile terminal to output the transmitted processed audition sound from the output unit. the first operator transmits a trial result obtained by listening to the processed trial sound to the target sound processing device;
The second worker operates the target sound processing device based on the audition result transmitted from the first worker to generate a new audition sound and a new processed audition sound, 4. The target sound processing system according to any one of claims 1 to 3, which is transmitted to a mobile terminal. The processed audition sound is at least one of indoor noise caused by external noise, inter-room sound insulation performance, noise propagating from inside and outside the building to the site boundary, indoor noise caused by air conditioning equipment, floor impact sound insulation performance, and indoor reverberation time. The target sound processing system according to any one of claims 1 to 4, comprising: The target sound processing system according to any one of claims 1 to 5, wherein the target sound includes at least one of indoor sound and outdoor sound.

Images