WO2017130537A1

WO2017130537A1 - Information processing device, information processing method, and program

Info

Publication number: WO2017130537A1
Application number: PCT/JP2016/084459
Authority: WO
Inventors: 大晴加藤; 徹知念; 優樹山本
Original assignee: ソニー株式会社
Priority date: 2016-01-29
Filing date: 2016-11-21
Publication date: 2017-08-03
Also published as: JP6876926B2; JPWO2017130537A1

Abstract

[Problem] To provide an information processing device, an information processing method, and a program, whereby characteristics of audio at a plurality of sites can be displayed in a readily understood manner. [Solution] An information processing device comprising an output control unit that, for each of a plurality of sites, associates a display corresponding to information indicating characteristics of audio recorded within an area including said sites to information relating to said sites and displays same on a display screen. The information indicating the characteristics of the recorded audio includes information indicating the magnitude of the recorded audio.

Description

Information processing apparatus, information processing method, and program

The present disclosure relates to an information processing apparatus, an information processing method, and a program.

In recent years, for example, with the spread of IC recorders and smartphones, it has become easier to record long-time voices. In addition, a technique for recording a recorded voice in a database for each genre has been proposed (see, for example, Patent Document 1 below).

Also, a technique for displaying information related to recorded audio has been proposed. For example, the position information providing apparatus described in Patent Document 2 below acquires surrounding sound data in real time, and displays the position of the sound data on a map screen.

JP 2010-198502 A JP 2012-73088 A

However, with the technique described in Patent Document 2, only information about the sound around the current position can be displayed. For this reason, with the technique described in Patent Document 2, for example, the user cannot grasp the sound characteristics at a specific point away from the current position.

Therefore, the present disclosure proposes a new and improved information processing apparatus, information processing method, and program capable of displaying the features of audio at a plurality of points in an easy-to-understand manner.

According to the present disclosure, for each of a plurality of points, an output control unit that displays on the display screen a display corresponding to information indicating the characteristics of the sound recorded in the area including the point, in association with the information about the point. , And the information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.

According to the present disclosure, there is provided an information processing apparatus including an output control unit that displays information indicating the volume of sound at each recording time on a display screen in order of the recording time with respect to the sound recorded at a predetermined point. Is done.

In addition, according to the present disclosure, for each of a plurality of points, the processor displays the display corresponding to the information indicating the characteristics of the sound recorded in the area including the point on the display screen in association with the information regarding the point. And the information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.

Further, according to the present disclosure, for each of a plurality of points, the computer displays a display corresponding to the information indicating the characteristics of the sound recorded in the area including the point with the information regarding the point on the display screen. There is provided a program for functioning as an output control unit to be displayed, wherein the information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.

As described above, according to the present disclosure, it is possible to display the features of voice at a plurality of points in an easy-to-understand manner. Note that the effects described here are not necessarily limited, and may be any of the effects described in the present disclosure.

It is explanatory drawing which showed the structural example of the information processing system by embodiment of this indication. It is the functional block diagram which showed the structural example of the recording terminal 40 by the embodiment. It is the functional block diagram which showed the structural example of the recording storage server 20 by the same embodiment. It is the functional block diagram which showed the structural example of the recording analysis server 30 by the same embodiment. It is the functional block diagram which showed the structural example of the recording presentation server 10 by the same embodiment. It is explanatory drawing which showed the example of a display which displays the characteristic information of the sound of several real estate by the list form by list format. It is explanatory drawing which showed the example of a display which displays the characteristic information of the sound of several real estate by the same embodiment on a map screen. It is explanatory drawing which showed another display example which displays the characteristic information of the sound of several real estate by the same embodiment on a map screen. It is explanatory drawing which showed the example of a display which displays the detailed information of one real estate by the same embodiment. It is explanatory drawing which showed the example of a display which displays the characteristic information of the sound of one real estate by the same embodiment in time series. It is explanatory drawing which showed another display example which displays the characteristic information of the sound of one real estate by the same embodiment in time series. It is explanatory drawing which showed the example of a display which displays the magnitude | size for every kind of sound in a certain recording timing by the embodiment. FIG. 6 is a sequence diagram showing an operation example during recording according to the embodiment. FIG. 6 is a sequence diagram showing a part of an operation example during display according to the embodiment. FIG. 6 is a sequence diagram showing a part of an operation example during display according to the embodiment. It is explanatory drawing which showed the structural example of the information processing system by the application example of the embodiment. It is explanatory drawing which showed the example of a display which displays the characteristic information of the sound of several points by the application example on a map screen. It is explanatory drawing which showed the example of a display by which the feature information of the sound of the position which cannot acquire recording data by the example of an application is displayed on a map screen by interpolating the feature information of the sound of a nearby point. It is explanatory drawing which showed the example of a display which displays the traffic volume estimated based on the recording data of each of several points by the example of application on a map screen. It is explanatory drawing which showed the example of a display which displays the precipitation estimated based on each recording data of the some point by the application example on a map screen. It is explanatory drawing which showed the example of a display which displays on the map screen the number of passersby estimated based on the recording data of each of several points by the application example. It is explanatory drawing which showed the example of a display which displays the inhabiting condition of the animal estimated based on the recording data of each of several points by the application example on a map screen. It is explanatory drawing which showed the hardware structural example of the recording presentation server 10 by the embodiment.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

In the present specification and drawings, a plurality of constituent elements having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numeral. For example, a plurality of configurations having substantially the same functional configuration are distinguished as the recording terminal 40a and the recording terminal 40b as necessary. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given. For example, when there is no need to distinguish between the recording terminal 40a and the recording terminal 40b, they are simply referred to as the recording terminal 40.

Further, the “DETAILED DESCRIPTION OF THE INVENTION” will be described according to the following item order.
1. 1. Configuration of information processing system 2. Detailed Description of Embodiments Application example 4. 4. Hardware configuration Modified example

<< 1. Configuration of information processing system >>
<1-1. Basic configuration>
First, the basic configuration of the information processing system according to the present embodiment will be described with reference to FIG. As shown in FIG. 1, the information processing system according to the present embodiment includes a recording presentation server 10, a recording storage server 20, a recording analysis server 30, a recording terminal 40, a communication network 42, and a user terminal 50.

{1-1-1. Recording terminal 40}
The recording terminal 40 is a device for recording external sound. The recording terminal 40 can be installed in each of the plurality of real estates 2 as shown in FIG. For example, the recording terminal 40 can be installed outdoors (for example, a veranda) and indoors of each of the plurality of real estates 2. More specifically, only one recording terminal 40 may be installed indoors in the real estate 2, or one recording terminal 40 may be installed outdoors and indoors for each room included in the real estate 2. Real estate is an example of a spot in the present disclosure.

Here, the configuration of the recording terminal 40 will be described with reference to FIG. FIG. 2 is a functional block diagram showing a configuration example of the recording terminal 40. As illustrated in FIG. 2, the recording terminal 40 includes a control unit 400, a communication unit 420, a microphone 422, a GPS (Global Positioning System) reception unit 424, a date / time information acquisition unit 426, and a storage unit 428.

(1-1-1-1. Control unit 400)
The control unit 400 generally performs the operation of the recording terminal 40 using hardware such as a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory) built in the recording terminal 40. Control. As shown in FIG. 2, the control unit 400 includes a recording unit 402, a recording storage unit 404, and a transmission control unit 406.

(1-1-1-2. Recording unit 402)
The recording unit 402 controls recording with respect to the microphone 422. For example, in a predetermined case such as when a recording start operation is performed on the recording terminal 40, the recording unit 402 causes the microphone 422 to start collecting sound. Further, in a predetermined case such as when a recording end operation is performed on the recording terminal 40, the microphone 422 ends the sound collection.

(1-1-1-3. Recording storage unit 404)
The recording storage unit 404 stores the audio collected by the microphone 422 and the metadata at the time of recording in the storage unit 428 in accordance with the control of the recording unit 402. Here, the metadata includes, for example, a recording date and time, a recording time, and position information at the time of recording. As will be described later, the position information is acquired by the GPS receiver 424. The recording date and time is acquired by the date and time information acquisition unit 426 at the time of recording. Note that the metadata is not limited to those collected mechanically. For example, the user inputs information such as information on the measurer, information on the equipment used, direction of measurement, weather, wind direction, or the presence or absence of specific noise (railway noise, aircraft noise, construction noise, etc.) as part of the metadata. May be.

(1-1-1-4. Transmission Control Unit 406)
The transmission control unit 406 controls transmission of recording data and metadata stored in the storage unit 428. For example, in a predetermined case such as when an operation of uploading recording data is performed, the transmission control unit 406 transmits the recording data and metadata stored in the storage unit 428 via the communication network 42 to the recording storage server. 20 to the communication unit 120.

(1-1-1-5. Communication unit 420)
The communication unit 420 communicates with other devices by wireless communication or wired communication. For example, the communication unit 420 transmits recording data and metadata to the recording storage server 20 under the control of the transmission control unit 406. Although FIG. 1 shows an example in which the recording terminal 40 is connected to the communication network 42 by wireless communication, the present invention is not limited to this example. The recording terminal 40 may be connected to the communication network 42 by wired communication using, for example, a LAN (Local Area Network) cable.

(1-1-1-6. Microphone 422)
The microphone 422 has a function of collecting sound by converting external sound into an electric signal.

(1-1-1-7. GPS receiver 424)
The GPS receiving unit 424 receives a positioning signal from a positioning satellite such as GPS, and measures the current position. Note that the GPS receiver 424 can receive positioning signals from one type of satellite, and can also receive positioning signals from a plurality of types of satellites, and perform positioning by combining the received signals. is there. The position information can also be input by the user.

(1-1-1-8. Date and time information acquisition unit 426)
The date / time information acquisition unit 426 acquires current date / time information. For example, the date / time information acquisition unit 426 acquires the date / time counted by the hardware clock as the current date / time information. Alternatively, the date / time information acquisition unit 426 can acquire current date / time information from a predetermined clock server (not shown). The date / time information can be input by the user.

(1-1-1-9. Storage Unit 428)
The storage unit 428 stores various data and various applications. For example, the storage unit 428 stores recording data and metadata.

{1-1-2. Recording storage server 20}
The recording storage server 20 is a device for storing the voices recorded by the plurality of recording terminals 40 for each recording terminal 40. Here, the configuration of the recording storage server 20 will be described with reference to FIG. FIG. 3 is a functional block diagram illustrating a configuration example of the recording storage server 20. As illustrated in FIG. 3, the recording storage server 20 includes a control unit 200, a communication unit 220, and a storage unit 222.

(1-1-2-1. Control unit 200)
The control unit 200 generally controls the operation of the recording / storage server 20 using hardware such as a CPU and a RAM built in the recording / storage server 20. As illustrated in FIG. 3, the control unit 200 includes a recording storage unit 202 and a transmission control unit 204.

(1-1-2-2. Recording storage unit 202)
The recording storage unit 202 stores the recording data and metadata received from each of the plurality of recording terminals 40 in association with the real estate in which the recording terminal 40 is installed in the storage unit 222. For example, the recording storage unit 202 distinguishes and stores the recording data outside the real estate and the recording data inside the real estate in the storage unit 222.

(1-1-2-3. Transmission Control Unit 204)
The transmission control unit 204 causes the recording analysis server 30 to transmit the recording data and metadata stored in the storage unit 222 to the communication unit 220 at a predetermined timing.

(1-1-2-4. Communication unit 220)
The communication unit 220 transmits and receives information to and from other devices via the communication network 42, for example. For example, the communication unit 220 transmits recording data and metadata for each real estate to the recording analysis server 30 according to the control of the transmission control unit 204.

(1-1-2-5. Storage Unit 222)
The storage unit 222 stores various data and various applications. For example, the storage unit 222 stores recording data and metadata in association with real estate.

{1-1-3. Recording analysis server 30}
(1-1-3-1. Sound feature information)
The recording analysis server 30 is a device for specifying information indicating characteristics of the sound recorded by each of the plurality of recording terminals 40 (hereinafter sometimes referred to as sound feature information). Here, the sound feature information includes, for example, sound volume, soundproof performance, or sound type. Here, for example, an equivalent noise level (defined in JIS Z8731 3.5) can be used as a loudness. However, the present invention is not limited to this example. For example, the noise level, the single noise exposure level, the time rate noise level, the long-term average equivalent noise level, the evaluation noise level, or the long-term average evaluation noise level are used as the loudness. May be. In the following, an example in which an equivalent noise level is used as the loudness will be mainly described.

The equivalent noise level is a quantity that represents the noise level of fluctuating noise as an energy average value for a certain time range T, and its unit is decibel (dB). More specifically, the equivalent noise level is calculated by the following equation (1) using the A characteristic sound pressure (defined in JIS Z8731 3.1). This equivalent noise level is a value that represents the loudness of a sound considering the frequency of human hearing.

The time T can be determined as follows. Although details will be described later, when the equivalent noise level of the recorded voice is displayed in time series by the recording presentation server 10, a relatively small predetermined value (for example, 10 seconds) is determined as the time T. Can be. Further, when only the representative value of the equivalent noise level of the recorded voice is displayed by the recording presentation server 10, the length of the recording time can be determined as the time T.

Also, the recording analysis server 30 can distinguish the equivalent noise level by a single or a plurality of sound sources by applying sound source separation to the recorded data. The recording analysis server 30 is not limited to the example using the A characteristic correction, and may use the C characteristic correction or the Z characteristic correction.

Here, the configuration of the recording analysis server 30 will be described with reference to FIG. FIG. 4 is a functional block diagram illustrating a configuration example of the recording analysis server 30. As illustrated in FIG. 4, the recording analysis server 30 includes a control unit 300, a communication unit 320, and a storage unit 322.

(1-1-3-2. Control unit 300)
The control unit 300 generally controls the operation of the recording analysis server 30 using hardware such as a CPU and a RAM built in the recording analysis server 30. As illustrated in FIG. 4, the control unit 300 includes a feature information specifying unit 302, a feature information storage unit 304, and a transmission control unit 306.

(1-1-3-3. Feature Information Identification Unit 302)
The feature information specifying unit 302 specifies sound feature information in the real estate based on the recording data and metadata of each of the plurality of real estates received from the recording storage server 20. For example, the feature information specifying unit 302 specifies sound feature information related to the entire recording data and sound feature information for each recording time of the recording data.

For example, the feature information specifying unit 302 first specifies a feature quantity such as power, spectrum envelope shape, zero crossing rate, pitch, correlation coefficient, mel frequency cepstrum coefficient, or sound source direction from the waveform of the recording data. Then, the feature information specifying unit 302 specifies sound feature information by applying a classifier such as a classification tree, a probability model, a logistic regression, a support vector machine, or a neural network to the specified feature quantity. To do.

(1-1-3-4. Feature information storage unit 304)
The feature information storage unit 304 stores, in the storage unit 322, the sound feature information of the property specified by the feature information specification unit 302 for each property.

(1-1-3-5. Transmission Control Unit 306)
The transmission control unit 306 causes the sound presentation server 10 to transmit the sound feature information for each real estate stored in the storage unit 322 to the recording presentation server 10 at a predetermined timing.

(1-1-3-6. Communication unit 320)
The communication unit 320 transmits and receives information to and from other devices via the communication network 42, for example. For example, the communication unit 320 transmits sound feature information for each real estate to the recording presentation server 10 according to the control of the transmission control unit 306.

(1-1-3-7. Storage Unit 322)
The storage unit 322 stores various data and various applications. For example, the storage unit 322 stores the real estate and the specified sound feature information in association with each other.

{1-1-4. Recording presentation server 10}
The recording presentation server 10 is an example of an information processing apparatus according to the present disclosure. The recording presentation server 10 is a device for presenting the sound feature information for each real estate specified by the recording analysis server 30 to the user terminal 50.

{1-1-5. User terminal 50}
The user terminal 50 is an information processing terminal used by the user. The user terminal 50 has a display that displays a display screen, an output unit that outputs sound, and a communication function for performing communication via the communication network 42. For example, the user terminal 50 receives display control information, audio data, and the like from the recording presentation server 10. Further, the user terminal 50 displays a display screen according to the received display control information or outputs received audio data.

The user terminal 50 may be, for example, a PC (Personal Computer), a tablet terminal, a mobile phone such as a smartphone, or a game machine. Alternatively, the user terminal 50 may be a wearable device such as a head mounted display, eyewear, or smart watch.

{1-1-6. Communication network 42}
The communication network 42 is a wired or wireless transmission path for information transmitted from a device connected to the communication network 42. For example, the communication network 42 may include a public line network such as a telephone line network, the Internet, a satellite communication network, various LANs including Ethernet (registered trademark), a WAN (Wide Area Network), and the like. The communication network 42 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).

Note that the configuration of the information processing system according to the present embodiment is not limited to the configuration described above. For example, the recording storage server 20, the recording analysis server 30, and the recording presentation server 10 may be configured as an integrated device instead of being configured as independent devices.

<1-2. Organizing issues>
The configuration of the information processing system according to this embodiment has been described above. Conventionally, as a method for grasping the contents of recorded data, trial recording of the recorded data has been performed. However, trial listening is inefficient because it takes as much time as the recording time.

Also, as another method for grasping the content of the recording data, a method of referring only to the metadata acquired together with the recording data can be considered. However, since the metadata includes only information such as recording time, recording time, and position information, for example, the user cannot fully grasp the contents of the recorded data.

Therefore, the recording presentation server 10 according to the present embodiment has been created by focusing on the above circumstances. For each of the plurality of real estates, the recording presentation server 10 can cause the user terminal 50 to display the sound feature information of the sound recorded in the real estate in association with the information related to the real estate. Thereby, the feature of the voice for each real estate can be easily and efficiently confirmed.

<< 2. Detailed Description of Embodiment >>
<2-1. Configuration>
Next, the configuration of the recording presentation server 10 according to the present embodiment will be described in detail. FIG. 5 is a functional block diagram showing the configuration of the recording presentation server 10 according to the present embodiment. As illustrated in FIG. 5, the recording presentation server 10 includes a control unit 100, a communication unit 120, and a storage unit 122.

{2-1-1. Control unit 100}
The control unit 100 generally controls the operation of the recording / presentation server 10 using hardware such as a CPU 150 and a RAM 154 described later, which are built in the recording / presentation server 10. Further, as illustrated in FIG. 5, the control unit 100 includes an output control unit 102 and an input reception unit 104.

{2-1-2. Output control unit 102}
For each of the plurality of real estates, the output control unit 102 displays according to the recording data and metadata of the real estate received from the recording storage server 20 and the sound feature information of the real estate received from the recording analysis server 30 A screen is displayed on the user terminal 50. For example, the output control unit 102 first generates display control information for displaying the display screen, and causes the communication unit 120 to transmit the generated display control information to the user terminal 50.

(2-1-2-1. List display)
For example, the output control unit 102 can display, in a list format, a combination of sound feature information of sound recorded in each real estate and information related to the real estate regarding each of the plurality of real estates. For example, the output control unit 102 displays a combination of sound feature information of audio recorded in the real estate and information on the real estate for each of the plurality of real estates in one direction in an order corresponding to the sound feature information. Display on the screen. Here, the information regarding the real estate includes, for example, real estate identification information or real estate location information.

FIG. 6 is an explanatory view showing a display example (list screen 60) in a list format. As shown in FIG. 6, the list screen 60 is a display screen that displays a list of information 620 of the property regarding each of the plurality of properties. Here, the real estate information 620 includes a plurality of items such as an image 600, a real estate name 602, an address 604, a floor number 606, an outdoor noise 608, an indoor noise 610, and a soundproof performance 612, for example.

In the image 600, for example, an image of the appearance of the corresponding real estate is displayed. In the real estate name 602, the name (identification information) of the corresponding real estate is displayed. The address 604 displays the address of the corresponding real estate. The floor number 606 displays the floor number of the corresponding real estate (or building). Further, the outdoor noise 608 displays the equivalent outdoor noise level of the corresponding real estate specified by the recording analysis server 30. The indoor noise 610 displays the indoor equivalent noise level of the real estate specified by the recording analysis server 30. The soundproof performance 612 displays a value indicating the soundproof performance of the corresponding real estate. Here, the soundproof performance is calculated as, for example, the difference between the outdoor equivalent noise level of the corresponding real estate and the indoor equivalent noise level. For example, when a predetermined sound is output from outside the corresponding property, the soundproofing performance is calculated as the difference between the measurement result of the equivalent noise level of the sound outdoors and the measurement result of the equivalent noise level of the sound indoors. Can be calculated.

For example, the list screen 60 rearranges and displays the information 620 of each property in ascending or descending order based on the user's selection regarding items such as outdoor noise 608, indoor noise 610, and soundproof performance 612. It is possible. In the list screen 60, the user can specify the range of values of one or more items, or specify metadata such as recording time, for example, to narrow down and display the real estate information 620. is there. The list screen 60 can also display the property information 620 separately for each group of properties whose sound feature information is similar, for example, the value of the outdoor noise 608 is within the same range.

In addition, when any real estate is selected on the list screen 60, the output control unit 102 can display a detailed screen regarding the selected real estate, as will be described later.

The list screen 60 displays a list of information on real estate and equivalent noise levels for each real estate. For this reason, the user can easily and efficiently refer to the magnitude of noise related to a plurality of real estates. For example, the user can efficiently search for a quieter property from a plurality of properties.

-Modification As a modification, when one building has a plurality of rooms, the list screen 60 can also display an equivalent noise level for each room regarding the building. For example, the list screen 60 may display, for each room included in each building, information such as the name of the room, outdoor noise in the room, and room noise in the room.

(2-1-2-2. Map display)
In addition, the output control unit 102 displays a map screen on the user terminal 50 and displays, for each real estate, a display corresponding to the sound feature information of the voice recorded in the real estate, corresponding to the position information of the real estate. It is possible to display the position. For example, the output control unit 102 displays, for each real estate, an icon corresponding to the sound feature information of the sound recorded in the real estate on the map screen in a display mode corresponding to the volume of the sound recorded in the real estate. Let

FIG. 7 is an explanatory diagram showing a display example of the map screen (map screen 70). As shown in FIG. 7, on the map screen 70, a real estate icon 700 and a noise level icon 702 are displayed in association with each of a plurality of real estate. The map screen 70 includes, for example, a calendar UI 710, a clock UI 712, and an enlargement rate change UI 714. Here, the real estate icon 700 is a predetermined icon displayed at a display position corresponding to the position information of the corresponding real estate. FIG. 7 shows an example in which the real estate icon 700 is the same for all real estates. However, the present invention is not limited to this example, and the shape and display color of the real estate icon 700 are different for each real estate or each type of real estate. May be displayed differently.

When any of the real estate icons 700 is selected by the user, the output control unit 102 can display a detailed screen related to the real estate corresponding to the selected real estate icon 700, as will be described later. .

Also, the noise level icon 702 is an icon for indicating an equivalent noise level (for example, an outdoor equivalent noise level) of the corresponding real estate. FIG. 7 shows an example in which the size of the noise level icon 702 is displayed larger as the equivalent noise level is larger. However, the output control unit 102 is not limited to this example, and the output control unit 102, for example, the shape of the noise level icon 702, the display color of the noise level icon 702 (color type, color density, It is also possible to change the decoration of the noise level icon 702, the character or image included in the noise level icon 702, or the like. Alternatively, the output control unit 102 may change a plurality of types of display formats related to the noise level icon 702 according to a plurality of types of equivalent noise levels related to the corresponding real estate. For example, the output control unit 102 changes the size of the noise level icon 702 according to the size of the equivalent noise level outdoors of the corresponding real estate, and according to the size of the equivalent noise level inside the corresponding real estate. The display color of the noise level icon 702 may be changed.

When the noise level icon 702 is selected by the user, as will be described later, the output control unit 102 may display the recording data of the corresponding real estate in time series, or the corresponding real estate. The sound of the recorded data may be output to the user terminal 50.

Further, the calendar UI 710 and the clock UI 712 are UIs for selecting a recording date or a recording time, respectively. For example, when the date is selected in the calendar UI 710 and the time is selected in the clock UI 712, the output control unit 102, for each of the plurality of real estates, is equivalent to the sound recorded on the selected date and time. The noise level can be displayed on the map screen 70.

According to the map screen 70, the location information (real estate icon 700) of the real estate and the equivalent noise level icon 702 are displayed in association with each of the plurality of real estate. For this reason, the user can refer to the equivalent noise level of each of the plurality of real estates on the same screen, and can refer efficiently. In addition, the size of the equivalent noise level for each property can be displayed in an easy-to-understand manner.

-Modification 1
As a modification, a selection window (not shown) is displayed on the map screen 70, and the type of sound characteristics (for example, an outdoor equivalent noise level, an indoor equivalent noise level, and a soundproofing) to be displayed. Performance etc.) may be selectable in the selection window. In this case, the value of the feature of the type selected in the selection window is displayed with the noise level icon 702. Alternatively, the type of sound to be displayed (for example, train sound, car sound, animal sound, etc.) may be selectable in the selection window.

As another modification, when one building has a plurality of rooms (objects), the noise level icon 702 (corresponding to the corresponding building) displays an average value of equivalent noise levels of the plurality of rooms. Alternatively, only the equivalent noise level of any of the plurality of rooms may be displayed. Alternatively, in this case, in the selection window displayed on the map screen 70, one of a plurality of rooms can be selected, and the noise level icon 702 (corresponding to the corresponding building) is selected. The equivalent noise level of the room may be displayed.

As another modification, the map screen 70 can automatically count up the recording time, for example, and the output control unit 102 can perform an equivalent for each of the plurality of real estates according to the counting up of the recording time. The change in the noise level may be displayed as an animation.

-Modification 2
FIG. 8 is an explanatory view showing another display example (map screen 70b) of the map screen. As shown in FIG. 8, on the map screen 70b, a real estate icon 700 and a noise level display 704 for each type are displayed for each real estate. As shown in FIG. 8, in the noise level display 704 for each type, for example, the outdoor equivalent noise level and the indoor equivalent noise level of the corresponding real estate are displayed as bar graphs, respectively. According to this display example, it is possible to display a list of a plurality of types of noise levels for each of a plurality of real estates on the map screen 70.

(2-1-2-3. Detailed screen)
For example, when any real estate is selected on the list screen or the map screen, the output control unit 102 can cause the user terminal 50 to display a detailed screen related to the selected real estate. Here, the detailed screen is a screen for displaying various types of information including sound feature information regarding the corresponding real estate.

FIG. 9 is an explanatory diagram showing a display example (detail screen 72) of the detail screen. As shown in FIG. 9, on the detailed screen 72, the real estate name 720, the address 722, the floor number 724, the outdoor noise 726, the time series display icon 728, the indoor noise 730, the soundproof performance 732, and the image relating to the selected real estate. 734 is displayed. Here, the real estate name 720, address 722, floor number 724, outdoor noise 726, indoor noise 730, soundproofing performance 732, and the contents of the image 734 are the real estate name 602, address 604, floor number 606, outdoor shown in FIG. The noise 608, the indoor noise 610, the soundproof performance 612, and the image 600 may be the same.

Further, the time series display icon 728 is a UI for displaying a time series display screen regarding the recording data of the corresponding real estate. Here, the time series display screen is a screen for displaying the equivalent noise level at each recording time in time series with respect to the recording data of the corresponding real estate.

(2-1-2-4. Time series display screen)
Further, for example, in a predetermined case such as when the time series display icon 728 is selected on the detailed screen, the output control unit 102 can display a time series display screen of sound feature information of the corresponding real estate. is there.

FIG. 10 is an explanatory diagram showing a display example (time series display screen 74) of the time series display screen of the sound feature information. As shown in FIG. 10, on the time series display screen 74, for example, an equivalent noise level coordinate system 740, an equivalent noise level time series graph 742 of real estate, an equivalent noise level graph 744 of other sounds, and a sound type selection UI 748 And a target time selection bar 750 is displayed. Here, in the equivalent noise level coordinate system 740, for example, the horizontal axis is the recording time, and the vertical axis is the equivalent noise level. Further, the equivalent noise level time series graph 742 of the real estate is a graph showing the transition of the equivalent noise level of the corresponding real estate at each recording time. Further, any point on the time series graph 742 of the equivalent noise level of the real estate can be selected, and when any point is selected by the user, the output control unit 102 is selected as will be described later. With the time corresponding to the point as the start time, it is possible to output the sound of the recorded data to the user terminal 50 and display the recorded data reproduction screen on the user terminal 50. As a modified example, a graph showing a time-series transition of the reliability of the equivalent noise level of the corresponding real estate may be further displayed in the equivalent noise level coordinate system 740.

Also, the equivalent noise level graph 744 of other sounds is a graph showing the equivalent noise levels of other types of sounds that serve as a guide, such as the equivalent noise level of a residential area and the equivalent noise level of a downtown area. The sound type selection UI 748 is a UI (for example, a check box) for the user to select one or more sound types from a plurality of sound types. When the user selects one of the sound types in the sound type selection UI 748, the output control unit 102 has a ratio of the magnitude of the equivalent noise level of the selected type of sound to the equivalent noise level of the corresponding real estate ( A time series graph in units of percent) is displayed on the time series display screen 74. For example, in FIG. 10, “train sound” is selected in the sound type selection UI 748, and the ratio of the magnitude of the equivalent noise level of “train sound” (to the equivalent noise level of the corresponding real estate) An example in which a time series graph 746 is displayed is shown.

Also, the target time selection bar 750 is a bar for designating a value range of recording time (horizontal axis) displayed in the equivalent noise level coordinate system 740. Instead of or in addition to the target time selection bar 750, for example, one of a plurality of predetermined periods such as 1 hour, night, 24 hours, and 1 week can be selected and selected. May be set as a range of values on the horizontal axis of the equivalent noise level coordinate system 740.

The time series display screen 74 allows the user to confirm at a glance the time series transition of the equivalent noise level of the corresponding real estate. For example, it is possible to easily confirm a time zone in which noise is loud or small in a day while comparing it with an equivalent noise level of other types of sounds as a guide.

-Modification Although FIG. 10 shows an example of displaying a time-series transition of one type of equivalent noise level related to the corresponding real estate, it is not limited to such an example. For example, as shown in FIG. 11, the time series display screen is a surface graph (stacked graph) that displays a list of time series transitions of the equivalent noise level for each type of sound included in the equivalent noise level of the corresponding property. ) May be displayed.

In the time-series display screen 74b shown in FIG. 11, an area 760a indicating the time-series transition of the equivalent noise level of the “train sound” included in the equivalent noise level of the corresponding real estate, the equivalent of the “car sound” An area 760b indicating the time-series transition of the noise level, an area 760c indicating the time-series transition of the equivalent noise level of the “passer's sound”, and a time series of the total equivalent noise level of other types of sounds The example of the area graph which piled up area | region 760d which shows general transition is shown.

(2-1-2-5. Recording data playback screen)
Further, for example, when any point on the time series graph 742 shown in FIG. 10 or FIG. 11 is selected, the output control unit 102 uses the selected time as the start time and plays the sound of the recorded data. It is possible to cause the user terminal 50 to start output and to display a recorded data reproduction screen on the user terminal 50.

FIG. 12 is an explanatory diagram showing a display example (recorded data playback screen 76) of the recorded data playback screen. As shown in FIG. 12, on the recorded data reproduction screen 76, for example, the ratio of the magnitude of each equivalent noise level of a plurality of types of sound to the equivalent noise level of the corresponding real estate is displayed as a bar graph 770, respectively. . For example, for each of a plurality of types of sounds, the output control unit 102 reproduces the sound so that the length of the bar graph 770 changes according to the ratio of the equivalent noise level of the sound at each reproduction time. The length of the bar graph 770 may be sequentially updated (animated). As a modification, on the recorded data reproduction screen 76, it is possible to hide the bar graph 770 corresponding to the sound selected by the user from among a plurality of types of sounds.

According to the recorded data reproduction screen 76, the user can check the ratio of the noise for each type of sound to the noise level related to the real estate at each trial listening timing while listening to the recorded data. .

{2-1-3. Input acceptance unit 104}
The input receiving unit 104 receives user input contents. For example, the input reception unit 104 receives selection of any real estate (for example, as a display target on the detail screen) from among a plurality of real estates displayed on the list screen or the map screen. Further, the input reception unit 104, for example, in the time series graph 742 of the real estate equivalent noise level shown in FIG. 10 and FIG. Accept selection.

{2-1-4. Communication unit 120}
The communication unit 120 transmits and receives information to and from other devices that can communicate with the recording presentation server 10. For example, the communication unit 120 transmits display control information for displaying various screens to the user terminal 50 according to the control of the output control unit 102.

{2-1-5. Storage unit 122}
The storage unit 122 stores various data and various software. For example, the storage unit 122 stores information (such as the name and image of the real estate) regarding each of the plurality of real estates.

<2-2. Operation>
The configuration according to this embodiment has been described above. Next, an example of the operation according to the present embodiment will be described in “2-2-1. Recording operation” and “2-2-2. Display operation”. Basically, “operation during recording” is first executed, and thereafter “operation during display” is executed.

{2-2-1. Operation during recording}
First, the operation during recording according to the present embodiment will be described with reference to FIG. Although only one recording terminal 40 is shown in FIG. 13, basically, a plurality of recording terminals 40 are installed, and each of the plurality of recording terminals 40 is shown in FIG. It is assumed that the same operation as the sequence diagram is performed.

As shown in FIG. 13, first, the recording terminal 40 installed in each of the plurality of real estates performs recording until a predetermined recording period ends (S101 to S103). When the predetermined recording period ends, each of the plurality of recording terminals 40 transmits the recording data and the metadata acquired at the time of recording to the recording storage server 20 via the communication network 42 (S105). However, the present invention is not limited to this example. For example, the recording terminal 40 is manually carried to the position of another device (not shown) that can be connected to the communication network 42, and the recording terminal 40 is connected to the other device. Also good. In this case, the other device transmits recording data and metadata to the recording storage server 20 via the communication network 42.

Thereafter, the recording storage unit 202 of the recording storage server 20 stores the recording data and metadata received in S105 in the storage unit 222 in association with the corresponding real estate (S107). And the communication part 220 transmits the said sound recording data and metadata to the sound recording analysis server 30 according to control of the transmission control part 204 (S109).

Thereafter, the feature information specifying unit 302 of the recording analysis server 30 specifies the sound feature information of the recorded data based on the recorded data and metadata received in S109 (S111). Then, the feature information storage unit 304 stores the specified sound feature information in the storage unit 322 in association with the corresponding real estate (S113).

{2-2-2. Operation during display}
Next, the display operation according to the present embodiment will be described with reference to FIGS.

As shown in FIG. 14, first, the user terminal 50 accesses the recording presentation server 10 based on, for example, user input (S121).

Thereafter, the recording presentation server 10 requests the recording analysis server 30 to provide sound feature information of each of the plurality of real estates. Then, the recording analysis server 30 transmits the sound feature information of each of the plurality of real estates to the recording presentation server 10 (S123).

Also, the recording presentation server 10 requests the recording storage server 20 to provide recording data and metadata for each of the plurality of real estates. Then, the recording storage server 20 transmits recording data and metadata to the recording presentation server 10 for each of the plurality of real estates (S125).

Thereafter, the output control unit 102 of the recording presentation server 10 generates display control information for displaying the sound feature information received in S123 in association with the information related to the real estate for each of the plurality of real estates (S127). ). And the communication part 120 transmits the produced | generated display control information to the user terminal 50 according to control of the output control part 102 (S129).

Thereafter, based on the display control information received in S129, the user terminal 50 displays a display screen (for example, a list screen or a map screen) in which information about the real estate is associated with sound feature information for each of the plurality of real estates. (S131).

Thereafter, the user terminal 50 stands by until any real estate is selected by the user on the display screen being displayed (S133). When any real estate is selected (S133: Yes), the user terminal 50 notifies the recording presentation server 10 of the identification information of the selected real estate (S135).

Thereafter, the output control unit 102 of the recording presentation server 10 generates display control information for displaying a detailed screen related to the real estate notified in S135 (S137). And the communication part 120 transmits the produced | generated display control information to the user terminal 50 according to control of the output control part 102 (S139).

Here, the operation after S139 will be described with reference to FIG. As shown in FIG. 15, after S139, the user terminal 50 displays a detailed screen related to the real estate selected in S133 based on the display control information received in S139 (S141).

Thereafter, the user terminal 50 stands by until the user selects the time-series display of the sound feature information on the detailed screen being displayed (S143). When the time-series display is selected (S143: Yes), the user terminal 50 notifies the recording presentation server 10 that the selection has been made (S145).

Thereafter, the output control unit 102 of the recording presentation server 10 generates display control information for displaying the sound feature information of the corresponding real estate in time series (S147). And the communication part 120 transmits the produced | generated display control information to the user terminal 50 according to control of the output control part 102 (S149).

Thereafter, the user terminal 50 displays a time-series display screen of sound feature information of the corresponding real estate based on the display control information received in S149 (S151).

After that, the user terminal 50 stands by until playback of the recorded data is selected on the displayed time series display screen. For example, the user terminal 50 waits until any point on the displayed time series graph is selected (S153). If playback of the recorded data is selected (S153: Yes), the user terminal 50 notifies the recording presentation server 10 that the selection has been made (S155).

Thereafter, based on the notification in S155, the output control unit 102 of the recording presentation server 10 causes the recording data of the corresponding real estate to be transmitted to the user terminal 50 to the communication unit 120, for example, in a streaming format (S157).

Thereafter, the user terminal 50 outputs the sound of the recording data received in S157 (S159).

-Modification The operation according to the present embodiment is not limited to the above-described operation example. For example, “the operation at the time of recording” and “the operation at the time of display” are not limited to the example of being executed continuously, and may be executed in parallel. Further, after S135, instead of performing the above-described processes of S137 to S145, the processes after S147 may be performed. In S133, S143, and S153, the user can also input the end of display, and when the input is performed, the above-described “operation during display” can be ended.

<2-3. Effect>
As described above, the recording and presentation server 10 according to the present embodiment associates the display corresponding to the sound feature information of the sound recorded in the real estate with respect to each of the plurality of real estates on the display screen. Display. For this reason, the characteristic of the sound in each of a plurality of real estate can be displayed clearly. For example, it is possible for the user to efficiently refer to the sound characteristics of each of the plurality of real estates and immediately grasp it. In addition, the user can investigate the sound characteristics of each real estate without actually going to the site.

For example, the recording presentation server 10 displays, for each of the plurality of real estates, the equivalent noise level of the sound recorded in the real estate and the information related to the real estate in association with each other and displayed on a map screen. For this reason, since the magnitude of noise relating to each of the plurality of real estates can be referred to on the same screen, it can be confirmed efficiently and easily. In addition, it becomes easy to investigate real estate with a specific equivalent noise level and a value of a specific equivalent noise level.

Moreover, the recording presentation server 10 displays the equivalent noise level at each recording time on the user terminal 50 in time series, for example, using a line graph for the real estate selected by the user, for example. For this reason, the user can confirm the time-series transition of the equivalent noise level of the corresponding real estate at a glance. Further, it becomes easy to investigate the time when the equivalent noise level is unique and the value of the equivalent noise level at the time.

Further, for example, regarding the real estate selected by the user, the recording presentation server 10 causes the user terminal 50 to display the equivalent noise level at the time of outputting the voice while outputting the voice recorded by the real estate to the user terminal 50. For this reason, the user can grasp | ascertain the content of the recording data of the said real estate fully and efficiently.

<< 3. Application example >>
The present embodiment has been described above. In the above-described embodiment, the example of recording sound for each real estate has been described. Next, an application example of this embodiment will be described. As will be described later, according to this application example, the sound feature information at an arbitrary point can be displayed on the user terminal 50 by recording the sound at the arbitrary point without being limited to the real estate.

<3-1. Configuration of information processing system>
FIG. 16 is an explanatory diagram showing a configuration example of an information processing system according to this application example. As shown in FIG. 16, the recording terminal 40 according to this application example can be attached to a stationary object installed in the area, such as a utility pole 4, a post box 6, or a roadside tree 8. Note that the recording terminal 40 may be attached to a signboard, a guardrail, a traffic light, a security camera, a building, or the like, without being limited to such an example.

Note that the recording terminal 40 is not limited to the example of being attached to a stationary object, and can be carried by the user, for example. For example, the recording terminal 40 may be a mobile phone such as a smartphone, a portable device such as an IC recorder, or a wearable device. In this case, the user can record the voice on the moving route of the user by moving while carrying the recording terminal 40.

Alternatively, the recording terminal 40 may be attached to the outside of a vehicle (a car, a motorcycle, a bicycle, etc.). In this case, when the vehicle moves, it is possible to record the voice on the moving route of the vehicle. Note that in the case of these modifications, the recording analysis server 30 appropriately extracts sound feature information at an arbitrary point by excluding sound accompanying movement of a person or vehicle from the sound recorded by the recording terminal 40. can do.

The configurations of the recording terminal 40, the recording storage server 20, the recording analysis server 30, and the user terminal 50 according to this application example are substantially the same as those in the above-described embodiment.

<3-2. Configuration>
Next, the configuration of the recording presentation server 10 according to this application example will be described. In addition, the component of the recording presentation server 10 by this application example is the same as that of embodiment mentioned above. Hereinafter, only functions different from the above-described embodiment will be described.

{3-2-1. Output control unit 102}
The output control unit 102 according to this application example displays, on the display screen, the sound feature information of the sound recorded at each point where the plurality of recording terminals 40 are located in association with the position information of the point.

(3-2-1-1. Display for each location)
For example, the output control unit 102 causes the user terminal 50 to display a map screen, and displays, for each of a plurality of points, a display corresponding to the sound feature information of the sound recorded at the point as the position information of the point. It is possible to display at the corresponding display position.

FIG. 17 is an explanatory view showing a display example of the map screen (map screen 80) according to this application example. As illustrated in FIG. 17, the output control unit 102 causes the equivalent noise level icon 800 to be displayed at a display position corresponding to the position information of each point on the map screen 80 for each of the plurality of points. Then, the output control unit 102 displays the equivalent noise level icon 800 with different display modes (for example, the size of the equivalent noise level icon 800) according to the equivalent noise level of the voice recorded at the point. Other display contents on the map screen 80 are substantially the same as those of the map screen 70 shown in FIG.

(3-2-1-2. Interpolation display)
By the way, for example, there is a limit to the number of recording terminals 40 that can be installed, or there is a position or time at which recording data cannot be acquired due to insufficient charge remaining in one or more recording terminals 40. Can occur. Therefore, the output control unit 102, regarding the position where the recording data cannot be acquired, the sound feature information of the sound recorded at a plurality of neighboring points, the position where the recording data cannot be acquired and the plurality of the neighboring data It is possible to interpolate according to the positional relationship with the point. And the output control part 102 can display the display corresponding to the interpolated sound feature information in a corresponding display position, for example on a map screen.

FIG. 18 shows a display example (map screen 82) in which the equivalent noise level at a position where recording data cannot be obtained is obtained by interpolating the equivalent noise level of a nearby point and displayed on the map screen. It is explanatory drawing. As shown in FIG. 18, the output control unit 102 displays the display at different display positions on the map screen 82 with different color types, color shades, and the like depending on the magnitude of the equivalent noise level.

In addition, each time the enlargement rate of the map screen 82 is changed, for example, when the enlargement rate change UI 714 is operated by the user, the output control unit 102 performs a plurality of neighboring points with respect to the position where the recording data cannot be obtained. It is possible to obtain the equivalent noise level at the corresponding position by sequentially interpolating the equivalent noise levels at the plurality of neighboring points according to the positional relationship between the two and the enlargement rate after the change. Then, the output control unit 102 can sequentially display the display corresponding to the interpolated equivalent noise level at the corresponding display position.

According to this map screen 82, it is possible to know the approximate equivalent noise level even at a position where recording data cannot be obtained. In addition, the distribution of equivalent noise levels in the entire area can be displayed in an easy-to-understand manner. For example, the user can grasp at a glance a quiet area and a noisy area.

(3-2-1-3. Traffic display)
Further, the output control unit 102 determines the traffic volume and the vehicle speed at the point or the vicinity of the point estimated based on the voice recorded at the point with respect to the point where each of the plurality of recording terminals 40 is located. It can be displayed on the display screen. The recording analysis server 30 analyzes the traveling sound of the vehicle based on the recorded voice for each of the plurality of points, and, for example, the traffic volume or the vehicle at the point based on the analyzed traveling sound level. Can be estimated.

FIG. 19 is an explanatory diagram showing a display example (map screen 84) for displaying the traffic volume at the point or in the vicinity of the point for each of a plurality of points on the map screen. As shown in FIG. 19, the output control unit 102 displays a car icon 840 for each of a plurality of points on the map screen 84 and displays the car icon 840 larger as the traffic volume at the point increases. However, the output control unit 102 is not limited to such an example, and the output control unit 102 determines, for example, the shape of the car icon 840 and the display color of the car icon 840 (color type, color intensity) according to the amount of traffic at the point. , Or transparency), decoration of the car icon 840, or characters or images included in the car icon 840 may be changed.

When the date is selected in the calendar UI 710 and the time is selected in the clock UI 712, the output control unit 102 displays the traffic volume at the selected date and time on the map screen 84 for each of a plurality of points. Update the display so that

According to these display examples, the traffic volume in the area and the traffic volume for each road included in the area can be referred to on the same screen, and can be referred to efficiently. For example, the user can guess the traffic congestion situation on the road displayed on the map screen 84.

(3-2-1-4. Weather information display)
Moreover, the output control part 102 can display the information regarding the weather in the said spot estimated based on the audio | voice recorded at the said spot about each of several spots on a display screen. Here, the information regarding the weather is, for example, rainfall, wind speed, or the frequency of lightning. The recording analysis server 30 analyzes, for each of the plurality of points, the sound of rain, the sound of the wind, or the sound of thunder based on the recorded sound, and, for example, the amount of rain at the point based on the analysis result. It is possible to estimate the wind speed or the frequency of lightning.

FIG. 20 is an explanatory view showing a display example (map screen 86) for displaying the rainfall at each of a plurality of points on the map screen. As shown in FIG. 20, the output control unit 102 displays a rain icon 860 for each of a plurality of points on the map screen 86, and displays the rain icon 860 larger as the amount of rain at the point increases. However, the output control unit 102 is not limited to such an example, and the output control unit 102, for example, the shape of the rain icon 860, the display color of the rain icon 860 (color type, color intensity, transparency, etc.) ), The decoration of the rain icon 860, or the character or image included in the rain icon 860 may be changed.

(3-2-1-5. Display of information on passers-by)
Moreover, the output control part 102 can display the information regarding the passerby at the said point estimated based on the audio | voice recorded at the said point about each of several points on a display screen. Note that the recording analysis server 30 analyzes the voices and footsteps of passersby for each of the plurality of points based on the recorded voice, and based on the analysis result, for example, sex or age ( For example, it is possible to estimate the number of passersby (such as children and the elderly) and the number of passersby by time of day. Alternatively, the recording analysis server 30 can estimate the ratio of the language used by passers-by based on the analysis result.

FIG. 21 is an explanatory diagram showing a display example (map screen 88) for displaying the number of passersby for each gender at each point on the map screen for each of a plurality of points. As illustrated in FIG. 21, the output control unit 102 causes the map screen 88 to display a point display icon 880 and a passerby number display 882 for each of a plurality of points. As shown in FIG. 8, for example, in the passer-by-passenger number display 882, the number of male passers-by and the number of female passers-by are displayed as bar graphs.

This map screen 88 is useful for regional surveys for marketing. For example, the user can infer the population distribution in the area and the distribution of passers by time.

(3-2-1-6. Display of animal habitat)
Moreover, the output control part 102 can display the inhabiting condition of the animal in the said point estimated based on the audio | voice recorded at the said point about each of several points on a display screen. The recording analysis server 30 analyzes the cry for each type of animal based on the recorded voice for each of the plurality of points, and, for example, for each type of animal at the point based on the analysis result. It is possible to estimate the number.

FIG. 22 is an explanatory diagram showing a display example (map screen 90) for displaying a crow inhabiting state at the point or in the vicinity of the point for each of a plurality of points on the map screen. As shown in FIG. 22, the output control unit 102 displays a crow icon 900 for each of a plurality of points on the map screen 90, and displays the crow icon 900 larger as the estimated number of crows at the point increases. Let However, the output control unit 102 is not limited to such an example, and the output control unit 102, for example, the shape of the crow icon 900, the display color of the crow icon 900 (color type, color density, Or, transparency, etc.), decoration of the crow icon 900, or characters or images included in the crow icon 900 may be changed.

<3-3. Effect>
As described above, the recording presentation server 10 according to this application example displays, for each of a plurality of points, the sound feature information of the sound recorded at the point in association with the position information of the point on the display screen. For this reason, the characteristic of the sound of each of a plurality of points can be displayed in an easy-to-understand manner. For example, the user can efficiently refer to the characteristics of each sound at a plurality of points and can immediately grasp it.

Also, the recording presentation server 10 interpolates the sound feature information of the voice recorded at a plurality of neighboring points in accordance with the positional relationship with the plurality of neighboring points for the positions where the recording data cannot be obtained. Then, the interpolated sound feature information can be displayed at the corresponding display position. Thereby, it is possible to know an approximate equivalent noise level even at a position where recording data cannot be obtained. In addition, the distribution of equivalent noise levels in the entire area can be displayed in an easy-to-understand manner.

<3-4. Modification>
In the above description, the application example has been described with a focus on an example in which the application is used for area surveys. However, the application example is not limited thereto. For example, according to this application example, by analyzing sounds such as screams, gunshots, runaways, riots, and dark trades based on the recorded voice, it can also be used for crime detection and statistics. Is possible. In addition, the present invention can be used for applications such as speed violation detection by estimating the moving speed of a car or a motorcycle based on the recorded voice.

Furthermore, it can be used for applications such as land price forecasting, stock price forecasting, economic forecasting, city and store reputation collection, etc. by using voices recorded at each of multiple points and known data mining technology. is there.

<< 4. Hardware configuration >>
Next, the hardware configuration of the recording presentation server 10 according to the present embodiment will be described with reference to FIG. As illustrated in FIG. 23, the recording presentation server 10 includes a CPU 150, a ROM 152, a RAM 154, a bus 156, an interface 158, a storage device 160, and a communication device 162.

The CPU 150 functions as an arithmetic processing unit and a control unit, and controls the overall operation within the recording presentation server 10 according to various programs. Further, the CPU 150 realizes the function of the control unit 100 in the recording presentation server 10. The CPU 150 is configured by a processor such as a microprocessor.

The ROM 152 stores programs used by the CPU 150 and control data such as calculation parameters.

The RAM 154 temporarily stores a program executed by the CPU 150, for example.

The bus 156 includes a CPU bus and the like. The bus 156 connects the CPU 150, the ROM 152, and the RAM 154 to each other.

The interface 158 connects the storage device 160 and the communication device 162 to the bus 156.

The storage device 160 is a data storage device that functions as the storage unit 122. The storage device 160 includes, for example, a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, or a deletion device that deletes data recorded on the storage medium.

The communication device 162 is a communication interface configured with, for example, a communication device for connecting to the communication network 42 or the like. Further, the communication device 162 may be a wireless LAN compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wire communication device that performs wired communication. This communication device 162 functions as the communication unit 120.

<< 5. Modification >>
The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present disclosure belongs can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present disclosure.

For example, all the components included in the control unit 100 described above may be mounted on the user terminal 50 instead of the recording presentation server 10. In this case, the information processing apparatus according to the present disclosure can be the user terminal 50. In this modified example, the user terminal 50 receives recording data, metadata, and sound feature information regarding each of a plurality of points from the recording storage server 20 and the recording analysis server 30, thereby substantially the same as in the above-described embodiment. In addition, it is possible to display sound feature information on each of the plurality of points on the display screen.

Further, according to the above-described embodiment, it is also possible to provide a computer program for causing hardware such as the CPU 150, the ROM 152, and the RAM 154 to perform the same functions as the components of the recording presentation server 10 according to the above-described embodiment. . A recording medium on which the computer program is recorded is also provided.

In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
For each of a plurality of points, an output control unit that displays on the display screen a display corresponding to information indicating the characteristics of the sound recorded in the area including the point, in association with the information about the point,
With
The information processing apparatus, wherein the information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.
(2)
The information processing apparatus according to (1), wherein the information indicating the magnitude of the recorded voice includes a noise level of the recorded voice.
(3)
The information regarding the point includes identification information of the property located at the point or position information of the property,
The information processing apparatus according to (2), wherein the information indicating the magnitude of the recorded voice includes a noise level of voice recorded outdoors or indoors in the real estate.
(4)
The information regarding the point includes identification information of the property located at the point or position information of the property,
The information processing apparatus according to any one of (1) to (3), wherein the information indicating the magnitude of the recorded voice includes a value indicating a soundproof performance of the real estate.
(5)
The output control unit displays, in a list format, a combination of information indicating the characteristics of the sound recorded in an area including the point and information regarding the point with respect to each of the plurality of points. The information processing apparatus according to any one of (4) to (4).
(6)
The output control unit, for each of the plurality of points, a combination of information indicating the characteristics of the sound recorded in the area including the point and information regarding the point, and the size of the recorded sound The information processing apparatus according to (5), wherein the information processing apparatus is arranged in one direction in an order corresponding to information to be displayed and is displayed on the display screen.
(7)
The display screen is a map screen,
The information about the point includes position information of the point,
The output control unit displays, for each of the plurality of points, a display corresponding to information indicating the characteristics of the sound recorded in an area including the point, and a display corresponding to the position information of the point on the map screen. The information processing apparatus according to any one of (1) to (4), wherein the information processing apparatus is displayed at a position.
(8)
The output control unit displays, for each of the plurality of points, a display corresponding to the information indicating the characteristics of the sound recorded in the region including the point, in a display mode according to the information indicating the size of the sound. The information processing apparatus according to (7), which is displayed on the map screen.
(9)
The plurality of points includes a first point and a second point located around the first point,
The output control unit further indicates a volume of sound recorded in an area including the first point with respect to a display position between the first point and the second point on the map screen. The information and the information indicating the volume of the sound recorded in the area including the second point are interpolated according to the positional relationship between the first point, the second point, and the display position. The information processing apparatus according to (8), wherein a display corresponding to the interpolated information is displayed at the display position.
(10)
The output control unit includes information indicating a volume of sound recorded in a region including the first point and information indicating a volume of sound recorded in a region including the second point. The information processing apparatus according to (9), further interpolating according to an enlargement ratio of the map screen and displaying a display corresponding to the interpolated information at the display position.
(11)
The information indicating the characteristics of the recorded voice includes the information indicating the volume of each type of sound included in the recorded voice, according to any one of (1) to (10). Information processing device.
(12)
The information processing apparatus further includes a reception unit that receives a selection of any of the plurality of points,
The output control unit further displays, on the display screen in order of recording time, information indicating the volume of the sound at each recording time with respect to the sound recorded in the area including the selected point. The information processing apparatus according to any one of (11).
(13)
The reception unit further receives a selection of a sound type,
The said output control part displays the information which shows the magnitude | size of the sound for every recording time on the said display screen in order of recording time regarding the selected kind of sound among the said recorded audio | voices as described in said (12). Information processing device.
(14)
The reception unit further receives a selection of a period,
The output control unit causes the display screen to display, on the display screen, information indicating the volume of sound at each recording time with respect to the sound of the selected period of the recorded sound. The information processing apparatus according to 13).
(15)
The output control unit further displays, on the display screen, a display corresponding to the traffic volume in the region including the point, estimated based on the sound recorded in the region including the point, for each of the plurality of points. The information processing apparatus according to any one of (1) to (14), which is displayed.
(16)
The output control unit further displays, on the display screen, a display corresponding to information on the weather at the point estimated based on the sound recorded in the region including the point for each of the plurality of points. The information processing apparatus according to any one of (1) to (15).
(17)
The information on the weather according to (16), wherein the information on the weather includes information on rainfall, wind speed, or lightning.
(18)
An output control unit that displays information indicating the volume of sound at each recording time on the display screen in order of the recording time with respect to the sound recorded at a predetermined point,
An information processing apparatus comprising:
(19)
For each of the plurality of points, the processor displays the display corresponding to the information indicating the characteristics of the sound recorded in the area including the point in association with the information about the point on the display screen;
Including
The information processing method, wherein the information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.
(20)
Computer
For each of a plurality of points, an output control unit that displays on the display screen a display corresponding to information indicating the characteristics of the sound recorded in the area including the point, in association with the information about the point,
Is a program for functioning as
The information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.

DESCRIPTION OF SYMBOLS 10 Recording presentation server 20 Recording storage server 30 Recording analysis server 40 Recording terminal 42 Communication network 50 User terminal 100,200,300,400 Control part 102 Output control part 104 Input reception part 120,220,320,420 Communication part 122,222 322, 428

Storage unit

202, 404

Recording storage unit

204, 306, 406 Transmission control unit 302 Feature information identification unit 304 Feature information storage unit 402 Recording unit 422 Microphone 424 GPS reception unit 426 Date / time information acquisition unit

Claims

For each of a plurality of points, an output control unit that displays on the display screen a display corresponding to information indicating the characteristics of the sound recorded in the area including the point, in association with the information about the point,
With
The information processing apparatus, wherein the information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.
The information processing apparatus according to claim 1, wherein the information indicating the size of the recorded voice includes a noise level of the recorded voice.
The information regarding the point includes identification information of the property located at the point or position information of the property,
The information processing apparatus according to claim 2, wherein the information indicating the magnitude of the recorded voice includes a noise level of voice recorded outdoors or indoors in the real estate.
The information regarding the point includes identification information of the property located at the point or position information of the property,
The information processing apparatus according to claim 1, wherein the information indicating the magnitude of the recorded voice includes a value indicating a soundproof performance of the real estate.
The said output control part displays the combination of the information which shows the characteristic of the audio | voice recorded within the area | region containing the said point regarding each of these several points, and the information regarding the said point in a list format. The information processing apparatus described in 1.
The output control unit, for each of the plurality of points, a combination of information indicating the characteristics of the sound recorded in the area including the point and information regarding the point, and the size of the recorded sound The information processing apparatus according to claim 5, wherein the information processing apparatus is arranged in one direction in an order corresponding to information to be displayed and displayed on the display screen.
The display screen is a map screen,
The information about the point includes position information of the point,
The output control unit displays, for each of the plurality of points, a display corresponding to information indicating the characteristics of the sound recorded in an area including the point, and a display corresponding to the position information of the point on the map screen. The information processing apparatus according to claim 1, wherein the information processing apparatus is displayed at a position.
The output control unit displays, for each of the plurality of points, a display corresponding to the information indicating the characteristics of the sound recorded in the region including the point, in a display mode according to the information indicating the size of the sound. The information processing apparatus according to claim 7, which is displayed on the map screen.
The plurality of points includes a first point and a second point located around the first point,
The output control unit further indicates a volume of sound recorded in an area including the first point with respect to a display position between the first point and the second point on the map screen. The information and the information indicating the volume of the sound recorded in the area including the second point are interpolated according to the positional relationship between the first point, the second point, and the display position. The information processing apparatus according to claim 8, wherein a display corresponding to the interpolated information is displayed at the display position.
The output control unit includes information indicating a volume of sound recorded in a region including the first point and information indicating a volume of sound recorded in a region including the second point. The information processing apparatus according to claim 9, further interpolating according to an enlargement ratio of the map screen and displaying a display corresponding to the interpolated information at the display position.
The information processing apparatus according to claim 1, wherein the information indicating the characteristics of the recorded voice includes information indicating a volume of each type of sound included in the recorded voice.
The information processing apparatus further includes a reception unit that receives a selection of any of the plurality of points,
The said output control part further displays the information which shows the magnitude | size of the sound for every recording time on the said display screen in order of recording time regarding the audio | voice recorded within the area | region containing the selected point. Information processing device.
The reception unit further receives a selection of a sound type,
The output control unit according to claim 12, wherein the output control unit causes the display screen to display information indicating a volume of sound at each recording time in the order of recording time with respect to the selected type of sound among the recorded sounds. Information processing device.
The reception unit further receives a selection of a period,
The output control unit according to claim 12, wherein the output control unit causes the display screen to display information indicating a sound volume for each recording time in the order of recording time for the sound of the selected period of the recorded sound. Information processing device.
The output control unit further displays, on the display screen, a display corresponding to the traffic volume in the region including the point, estimated based on the sound recorded in the region including the point, for each of the plurality of points. The information processing apparatus according to claim 1, which is displayed.
The output control unit further displays, on the display screen, a display corresponding to information on the weather at the point estimated based on the sound recorded in the region including the point for each of the plurality of points. The information processing apparatus according to claim 1.
The information processing apparatus according to claim 16, wherein the information on the weather includes information on rainfall, wind speed, or lightning.
An output control unit that displays information indicating the volume of sound at each recording time on the display screen in order of the recording time with respect to the sound recorded at a predetermined point,
An information processing apparatus comprising:
For each of the plurality of points, the processor displays the display corresponding to the information indicating the characteristics of the sound recorded in the area including the point in association with the information about the point on the display screen;
Including
The information processing method, wherein the information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.
Computer
For each of a plurality of points, an output control unit that displays on the display screen a display corresponding to information indicating the characteristics of the sound recorded in the area including the point, in association with the information about the point,
Is a program for functioning as
The information indicating the characteristics of the recorded voice includes information indicating the magnitude of the recorded voice.