WO2018101341A1 - Information processing device, external sound reproduction method, program, and data structure - Google Patents

Information processing device, external sound reproduction method, program, and data structure Download PDF

Info

Publication number
WO2018101341A1
WO2018101341A1 PCT/JP2017/042843 JP2017042843W WO2018101341A1 WO 2018101341 A1 WO2018101341 A1 WO 2018101341A1 JP 2017042843 W JP2017042843 W JP 2017042843W WO 2018101341 A1 WO2018101341 A1 WO 2018101341A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
mode
external sound
playback
information processing
Prior art date
Application number
PCT/JP2017/042843
Other languages
French (fr)
Japanese (ja)
Inventor
洋人 河内
昭光 藤吉
洋一 奥山
Original Assignee
パイオニア株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パイオニア株式会社 filed Critical パイオニア株式会社
Priority to JP2018554201A priority Critical patent/JP6799615B2/en
Publication of WO2018101341A1 publication Critical patent/WO2018101341A1/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones

Definitions

  • the present invention relates to an information processing apparatus, an external sound reproducing method, a program, and a data structure.
  • Patent Document 1 the type of sound to be notified in the vehicle is stored in the storage unit of the in-vehicle device, and the type of sound collected from the outside of the vehicle is stored in the storage unit.
  • a technique for controlling whether or not to notify the collected sound in the vehicle based on whether or not they match is disclosed.
  • sounds generated outside a moving body such as a vehicle.
  • sounds that are preferably notified promptly to the person in the car for example, sounds that affect the driving operation, and sounds that are preferably conveyed naturally to the person in the car without feeling uncomfortable, for example, Some sounds don't exist.
  • a technology that makes it possible to convey the sound to a person in the vehicle by a method suitable for each sound generated outside the moving body, for example, driving assistance by conveying it to the driver One example is to provide technology that can be communicated to the driver to contribute to the vehicle.
  • the invention described in claim 1 A first reproduction mode in which the external sound gradually fades in at the start of reproduction of the external sound generated outside the moving body, and a second reproduction mode in which the external sound fades in faster than the first reproduction mode.
  • a mode selection unit for selecting one of the playback modes;
  • a speaker control unit that reproduces the external sound collected by the sound collection device from the indoor speaker of the moving body at a fade-in speed of the reproduction mode selected by the mode selection unit; Is an information processing apparatus.
  • the invention according to claim 9 is: Computer A first reproduction mode in which the external sound gradually fades in at the start of reproduction of the external sound generated outside the moving body, and a second reproduction mode in which the external sound fades in faster than the first reproduction mode. Selecting one of the playback modes; Reproducing the external sound collected by the sound collecting device from the indoor speaker of the moving body at the fade-in speed of the selected reproduction mode; Is an external sound reproducing method.
  • the invention according to claim 10 is: Computer A first reproduction mode in which the external sound gradually fades in at the start of reproduction of the external sound generated outside the moving body, and a second reproduction mode in which the external sound fades in faster than the first reproduction mode.
  • the invention according to claim 11 A data structure of map data, Position information on the map data; Reproduction mode information indicating a reproduction mode when reproducing the external sound collected by the sound collection device by the indoor speaker of the moving body, set for each position information; Is a data structure.
  • each block in the block diagram represents a functional unit configuration, not a hardware unit configuration.
  • FIG. 1 is a block diagram conceptually showing the functional configuration of the information processing apparatus 10 in the first embodiment.
  • the information processing device 10 is an external device that can be attached to the inside or the outside of a moving body.
  • the information processing apparatus 10 may be an apparatus incorporated in a moving body such as an ECU (Electronic Control Unit).
  • the information processing apparatus 10 may be a portable terminal (for example, a smartphone or a tablet terminal) in which an application that realizes each function described below is installed.
  • the information processing apparatus 10 includes a mode selection unit 12 and a speaker control unit 14.
  • a moving body is not limited to a vehicle.
  • the mode selection unit 12 selects one of a plurality of playback modes related to the external sound of the vehicle.
  • the plurality of playback modes have different fade-in speeds at the start of playback of the external sound of the vehicle, and include at least a first playback mode and a second playback mode.
  • the fade-in speed means, for example, the time (speed) until a certain specified gain value is reached.
  • the prescribed gain value can be defined based on, for example, an average audible range of a person.
  • the first reproduction mode is a reproduction mode in which the external sound fades in at the first speed when the reproduction of the external sound of the vehicle is started.
  • the second playback mode is a playback mode in which the external sound is faded in at a second speed higher than the first speed described above.
  • the mode selection unit 12 can select at least one of the first reproduction mode and the second reproduction mode.
  • FIG. 2 is a diagram illustrating the difference between the fade-in speed in the first playback mode and the fade-in speed in the second playback mode.
  • the vertical axis in FIG. 2 indicates the gain value of the sound reproduced from the speaker.
  • the horizontal axis of FIG. 2 represents the time axis.
  • the gain value gradually increases in the first reproduction mode.
  • control is performed so that the sound outside the vehicle is gradually heard from the indoor speaker, so that the uncomfortable feeling given to the vehicle occupant by the sound outside the vehicle can be reduced.
  • the time until the same gain value as in the first playback mode is reached is faster than in the first playback mode. That is, in the second playback mode, control is performed so that the outside sound can be heard suddenly from the indoor speaker, so that the vehicle occupant can pay attention to the outside sound.
  • the speaker control unit 14 reproduces the vehicle exterior sound collected by the sound collection device (not shown) from the vehicle interior speaker (not shown) at the fade-in speed of the reproduction mode selected by the mode selection unit 12.
  • the sound collecting device is a device including a microphone or a microphone array that generates and outputs an electrical signal corresponding to the collected sound.
  • the sound collection device is provided on the outer periphery of the vehicle and can collect sound (external sound) generated outside the vehicle.
  • the installation position and number of sound collectors are not particularly limited.
  • the sound collection device can transmit the collected sound to the information processing device 10 by wireless connection or wired connection.
  • the sound collecting device may be configured integrally with the information processing device 10 as one device.
  • the indoor speaker is a speaker device built in the vehicle or a commercially available external speaker.
  • the indoor speaker may be, for example, a speaker that can communicate with the information processing apparatus 10 in a wired manner, or may be a speaker that can wirelessly communicate with the information processing apparatus 10.
  • the mode selection unit 12 selects at least two playback modes having different fade-in speeds. Further, in the present embodiment, the vehicle exterior sound is output from the vehicle interior speaker at a fade-in speed corresponding to the playback mode selected by the mode selection unit 12.
  • the sound can be transmitted to the person in the vehicle by a method suitable for each sound generated outside the vehicle.
  • environmental sounds such as the sound of waves that can be collected while driving on a seaside road are output from the indoor speakers in the first playback mode that gradually fades in. And can enhance the effect of raising and relaxing the mood.
  • the sound outside the vehicle is output from the indoor speaker at a faster fade-in speed than in the first playback mode, thereby giving a sense of incongruity to the person in the car and calling attention. Can be increased.
  • Each functional component of the information processing apparatus 10 may be realized by hardware (for example, a hard-wired electronic circuit) that realizes each functional component, or a combination of hardware and software (for example: It may be realized by a combination of an electronic circuit and a program for controlling it).
  • hardware for example, a hard-wired electronic circuit
  • software for example: It may be realized by a combination of an electronic circuit and a program for controlling it.
  • FIG. 3 is a diagram illustrating a hardware configuration of the information processing apparatus 10.
  • the information processing apparatus 10 includes a bus 102, a processor 104, a memory 106, a storage device 108, an input / output interface 110, and a network interface 112.
  • the bus 102 is a data transmission path through which the processor 104, the memory 106, the storage device 108, the input / output interface 110, and the network interface 112 transmit / receive data to / from each other.
  • the method of connecting the processors 104 and the like is not limited to bus connection.
  • the processor 104 is an arithmetic processing device realized using a microprocessor or the like.
  • the memory 106 is a memory realized using a RAM (Random Access Memory) or the like.
  • the storage device 108 is a storage device realized using a ROM (Read Only Memory), a flash memory, or the like.
  • the input / output interface 110 is an interface for connecting the information processing apparatus 10 to an external apparatus.
  • a GPS (Global Positioning System) module 1101 for acquiring information indicating the current position of the vehicle is connected to the input / output interface 110.
  • the information processing apparatus 10 can also acquire the position information of the surrounding base station via the network interface 112 and estimate the current position of the vehicle using the position information of the surrounding base station.
  • the information processing apparatus 10 can also calculate the estimated position of the host vehicle using Bayesian estimation such as a Kalman filter or a particle filter. In such a case, the GPS module 1101 may not be connected to the input / output interface 110.
  • the input / output interface 110 is connected to a speaker device 1102 that outputs sound into the vehicle.
  • the speaker device 1102 may be connected via the network interface 112 if the device is a device that enables short-range wireless communication such as Bluetooth (registered trademark), for example.
  • the switch 1103 may be connected to the input / output interface 110.
  • the switch 1103 is provided for accepting an operation for selecting a reproduction mode by a vehicle occupant.
  • the switch 1103 may be a physical switch having a physical switching mechanism, or may be a software switch realized by a touch panel.
  • the network interface 112 is an interface for connecting the information processing apparatus 10 to a communication network.
  • the information processing apparatus 10 may have a plurality of network interfaces 112.
  • the information processing apparatus 10 includes a network interface 112 for connecting to a CAN communication network and a network interface 112 that supports a short-range wireless communication standard (for example, Bluetooth (registered trademark)).
  • a short-range wireless communication standard for example, Bluetooth (registered trademark)
  • the information processing apparatus 10 can communicate with the sound collection device 20 provided on the outer peripheral portion of the vehicle by short-range wireless, and can acquire the data of the outside sound collected by the sound collection device 20.
  • the information processing apparatus 10 indicates the operation of the vehicle (for example, the moving speed of the vehicle, the steering angle of the steering, etc.) that can be used for the position estimation algorithm for the own vehicle using the Kalman filter or the like via the CAN communication network. Information can also be obtained.
  • the vehicle for example, the moving speed of the vehicle, the steering angle of the steering, etc.
  • the storage device 108 stores a program module for realizing each functional component of the information processing apparatus 10.
  • the processor 104 reads out the program module to the memory 106 and executes it, thereby realizing the function of each functional component of the information processing apparatus 10.
  • FIG. 4 is a flowchart illustrating a first operation example of the information processing apparatus 10 according to the first embodiment.
  • the mode selection unit 12 acquires the position information of the host vehicle, and selects either the first playback mode or the second playback mode based on the position information of the host vehicle.
  • the mode selection part 12 acquires the positional information on the own vehicle (S102).
  • the mode selection unit 12 can acquire GPS information obtained from the GPS module 1101 as position information of the host vehicle.
  • the mode selection unit 12 communicates with a surrounding radio base station via a 3G line or an LTE (Long Termination Evolution) line to obtain position information of the radio base station, and uses the position information of the radio base station. Then, the position information of the own vehicle may be estimated.
  • the mode selection unit 12 may calculate the estimated position of the host vehicle based on the position estimation algorithm for the host vehicle using a Kalman filter or the like.
  • the mode selection unit 12 selects an external sound reproduction mode based on the position information of the host vehicle acquired in S102 (S104).
  • the mode selection unit 12 indicates whether or not the position information of the host vehicle acquired in the process of S102 indicates a position corresponding to the first specific area, or indicates a position corresponding to the second specific area. Whether or not, and the playback mode is selected according to the determination result.
  • a 1st specific area is an area where the importance of the atmosphere which the external sound of a vehicle gives is higher than other areas.
  • Specific examples of the first specific area include, for example, a sightseeing spot, the sea, or the periphery of a forest.
  • the second specific area is an area where the degree of attention required of the driver of the vehicle is higher than other areas. Specific examples of the second specific area include the vicinity of a point where accidents frequently occur, the vicinity of a point with poor visibility, and the vicinity of a school facility or a park.
  • the mode selection unit 12 selects the first reproduction mode in which the external sound gradually fades in when the position information of the host vehicle acquired in the process of S102 indicates the position corresponding to the first specific area. Further, when the position information of the host vehicle acquired in the process of S102 indicates a position corresponding to the second specific area, the mode selection unit 12 causes the external sound to fade in faster than in the first playback mode. Select the playback mode.
  • the mode selection unit 12 can determine the playback mode to be selected with reference to a table as shown in FIG. 5, for example.
  • FIG. 5 is a diagram illustrating an example of a table that stores a correspondence relationship between position information and a reproduction mode.
  • the table shown in FIG. 5 stores information for identifying the playback mode in association with area information including one or more pieces of position information.
  • the mode selection unit 12 identifies a row (record) that stores area information of an area including the position indicated by the position information of the host vehicle acquired in S102, and “playback mode” of the identified record.
  • the reproduction mode identification information stored in the column is read out.
  • the mode selection unit 12 can determine the playback mode indicated by the read playback mode identification information as the playback mode to be selected.
  • the mode selection unit 12 has acquired the position information “(x 1 , y 2 )” in the process of S102.
  • the mode selection unit 12 can specify the “first playback mode” as the playback mode to be selected with reference to the table of FIG.
  • FIG. 5 is merely an example, and the format of the table is not limited to the example of FIG.
  • the mode selection unit 12 refers to the table based on the position information of the host vehicle acquired in S102, and acquires the identification information of the first specific area or the identification information of the second specific area.
  • the mode selection part 12 discriminate
  • the mode selection unit 12 selects the first reproduction mode when acquiring the identification information of the first specific area, and selects the second reproduction mode when acquiring the identification information of the second specific area. Select.
  • the mode selection unit 12 is configured to select an arbitrary reproduction mode when the position information of the host vehicle acquired in the process of S102 indicates a position that does not correspond to either the first specific area or the second specific area. May be. For example, either the first playback mode or the second playback mode is set as a default playback mode in the mode selection unit 12 in advance, and the mode selection unit 12 determines the position of the host vehicle acquired in the process of S102. When the information indicates a position that does not correspond to either the first specific area or the second specific area, a preset default playback mode may be selected.
  • the speaker control unit 14 outputs the outside sound collected by the sound collection device 20 from the indoor speaker at the fade-in speed of the reproduction mode selected in S104 (S106).
  • the speaker control unit 14 may control the timing of starting the reproduction of the external sound collected by the sound collecting device 20 based on the position information of the vehicle (S108). Specifically, the speaker control unit 14 collects sound when the position information of the vehicle indicates the vicinity of a sightseeing spot, the starting point of a road extending along the seaside or forest, the vicinity of a point where accidents frequently occur, or a point where visibility is poor. You may be comprised so that the reproduction
  • the outside sound collected by the sound collecting device 20 is reproduced from the indoor speaker.
  • the outside sound collected by the sound collecting device 20 is reproduced from the indoor speaker.
  • FIG. 6 is a flowchart illustrating a second operation example of the information processing apparatus 10 according to the first embodiment.
  • the mode selection unit 12 includes a switch 1103 that accepts an external sound reproduction mode selection operation, and the first reproduction mode or the second reproduction mode is selected based on the selection operation accepted by the switch 1103. Select one of the playback modes.
  • the mode selection unit 12 accepts a playback mode selection operation via the switch 1103 (S202). Then, the mode selection unit 12 selects a playback mode corresponding to the selection operation received via the switch 1103 (S204). For example, when the switch 1103 includes a switching mechanism such as a so-called push button switch or a slide switch, the mode selection unit 12 identifies the playback mode based on a change in the electrical signal from the switch 1103 due to the switching operation of the switching mechanism. can do. For example, when the switch 1103 is realized by a touch panel, the mode selection unit 12 acquires information indicating a playback mode according to a screen element (software button or the like) selected on the touch panel, and based on the information. A playback mode can be selected.
  • a switching mechanism such as a so-called push button switch or a slide switch
  • the speaker control unit 14 causes the vehicle exterior sound collected by the sound collecting device 20 to be output from the indoor speaker at the fade-in speed in the playback mode selected in S204 (S206). At this time, similarly to the first operation example, the speaker control unit 14 may control the timing for starting the reproduction of the outside sound collected by the sound collecting device 20 based on the position information of the vehicle (S208). . In this case, the information processing apparatus 10 acquires vehicle position information in the background, for example.
  • FIG. 7 is a block diagram conceptually showing the functional configuration of the information processing apparatus 10 in the second embodiment.
  • the information processing apparatus 10 according to the present embodiment further includes a buffer unit 16 and a sound analysis unit 18 in addition to the configuration of the first embodiment.
  • the buffer unit 16 buffers external sound collected by the sound collector 20.
  • the buffer unit 16 can be realized by the memory 106, for example.
  • the sound analysis unit 18 analyzes the sound outside the vehicle buffered in the buffer unit 16.
  • the sound analysis unit 18 can specify at least a generation source (sound source) of the outside sound based on, for example, a result of analyzing a frequency component of the buffered outside sound.
  • the sound analysis unit 18 can use a known sound source separation algorithm and sound source identification algorithm as a method of specifying a sound source.
  • the speaker control unit 14 of the present embodiment determines whether or not a specific sound source is detected based on the analysis result of the sound analysis unit 18.
  • Specific examples of sound generated from a specific sound source are not particularly limited, but include natural environmental sounds such as the sound of waves and chirping of birds, crowd noise around the tourist spot (crowd noise), people talking, and surroundings.
  • the speaker control unit 14 according to the present embodiment starts the reproduction of the sound outside the vehicle according to the timing at which a specific sound source is detected from the analysis result of the sound analysis unit 18.
  • the mode selection unit 12 of the present embodiment selects either the first reproduction mode or the second reproduction mode based on the analysis result of the sound analysis unit 18. Specifically, the mode selection unit 12 of the present embodiment first acquires the analysis result of the type of the sound source of the vehicle outside sound from the sound analysis unit 18. And the mode selection part 12 of this embodiment selects the 1st reproduction
  • the information processing apparatus 10 includes a hardware configuration as illustrated in FIG. 3 as in the first embodiment.
  • the storage device 108 according to the present embodiment further stores program modules that realize the functions of the buffer unit 16 and the sound analysis unit 18, and the processor 104 executes these program modules, whereby the buffer unit 16 and the sound analysis are performed.
  • the function of the unit 18 is realized.
  • the processor 104 executes a program module that realizes the function of the buffer unit 16 and buffers sound data acquired from the sound collecting device 20 in, for example, the memory 106.
  • the processor 104 executes a program module that implements the function of the sound analysis unit 18, reads sound data buffered in the memory 106 and the like, and uses the analysis algorithm to output various analysis results from the sound data. obtain.
  • FIG. 8 is a flowchart illustrating an operation example of the information processing apparatus 10 according to the second embodiment.
  • the buffer unit 16 acquires external sound data collected by the sound collection device 20 (S302). Further, the buffer unit 16 buffers the external sound data acquired in S302 in a buffer area such as the memory 106 (S304).
  • the sound analysis unit 18 analyzes the external sound data buffered in the buffer area (S306).
  • the sound analysis unit 18 can extract data of sound generated from each sound source based on the difference in sound detection time in each channel using, for example, a microphone array. Then, the sound analysis unit 18 compares the sound feature amount obtained by analyzing the extracted sound data with a feature value for each sound source (for example, FIG. 9) prepared in advance in the storage device 108 or the like. Thus, the sound source of each sound can be specified.
  • FIG. 9 is a diagram showing an example of a table for storing information for sound source collation.
  • the table illustrated in FIG. 9 stores sound feature amounts in association with identification information of sounds belonging to each sound source category.
  • the sound analysis unit 18 can specify a row (record) storing a sound feature amount most similar to the sound feature amount obtained by analyzing the extracted sound, using a table as shown in FIG. . Then, the sound analysis unit 18 can acquire information for identifying the category of the sound source stored in the “sound source category” column of the specified row (record).
  • the mode selection unit 12 and the speaker control unit 14 determine whether or not a specific sound source is detected using the analysis result of the sound analysis unit 18 (S308, S310).
  • the mode selection unit 12 selects an external sound reproduction mode based on the analysis result of the sound analysis unit 18. Further, the speaker control unit 14 controls the reproduction timing of the external sound based on the analysis result of the sound analysis unit 18.
  • the mode selection unit 12 and the speaker control unit 14 determine whether a specific environmental sound is detected based on the analysis result of the sound analysis unit 18 (S308).
  • the specific environmental sound is, for example, a natural environmental sound such as a sound of a wave or a chirping of a small bird, a crowd noise around a tourist spot (crowd noise), and the like.
  • the specific environmental sound in the present invention includes sounds that are desired to be heard naturally without giving a sense of incongruity to the passengers of the vehicle in order to obtain an uplifting effect and a relaxing effect.
  • the mode selection unit 12 selects the first reproduction mode in which the external sound is gradually faded in (S312). Then, the speaker control unit 14 reproduces the external sound acquired by the sound collection device 20 from the indoor speaker at the fade-in speed in the first reproduction mode (S316).
  • the mode selection unit 12 determines whether the sound of a person existing around or It is determined whether or not the sound of a vehicle existing around is detected (S310).
  • the mode selection unit 12 When an analysis result of the sound analysis unit 18 detects a human voice or a vehicle sound (S310: YES), the mode selection unit 12 performs the second reproduction to fade in the external sound faster than the first reproduction mode. A mode is selected (S314). Then, the speaker control unit 14 reproduces the external sound acquired by the sound collection device 20 from the indoor speaker at the fade-in speed in the second reproduction mode (S316).
  • the mode selection unit 12 may select a reproduction mode using map data in which reproduction mode setting information is embedded for each position information or each area information instead of the table shown in FIG. .
  • the map data has a data structure in which information on a reproduction mode to be selected when reproducing outside sound from an indoor speaker is embedded for each position information or predetermined area information.
  • the mode selection unit 12 selects the position information of the own vehicle acquired in S102 by using the analysis result obtained by analyzing which position on the map data corresponds to the position information of the own vehicle. Specify the playback mode to be used.
  • the analysis may be performed by an analysis unit (not shown) in the information processing apparatus 10 or may be performed by an external server device (not shown).
  • the playback mode and the playback timing of the external sound are controlled based on the analysis result of the external sound collected by the sound collecting device 20.
  • the external sound to be transmitted to the person in the vehicle can be reproduced from the indoor speaker in the reproduction mode (fade-in speed) suitable for the type of the external sound.
  • the driver can contribute to driving support by listening to the reproduced external sound.

Abstract

An information processing device (10) is provided with a mode selection unit (12) and a speaker control unit (14). The mode selection unit (12) selects one of a first reproduction mode in which an external sound generated on the outside of a mobile entity is faded in at a first speed when reproduction of the external sound begins and a second reproduction mode in which the external sound is faded in at a second speed faster than the first speed. The speaker control unit (14) causes the external sound collected by a sound collection device to be reproduced from an interior speaker of the mobile entity at a fade-in speed of the reproduction mode selected by the mode selection unit (12).

Description

情報処理装置、外部音再生方法、プログラム及びデータ構造Information processing apparatus, external sound reproduction method, program, and data structure
　本発明は、情報処理装置、外部音再生方法、プログラム及びデータ構造に関する。 The present invention relates to an information processing apparatus, an external sound reproducing method, a program, and a data structure.
　下記特許文献１には、車内に報知すべき音の種類を車載装置の記憶部に記憶しておき、車両の外部から収集された音の種類が当該記憶部に記憶されている音の種類と一致するか否かに基づいて、収集された音を車内に報知するか否かを制御する技術が開示されている。 In the following Patent Document 1, the type of sound to be notified in the vehicle is stored in the storage unit of the in-vehicle device, and the type of sound collected from the outside of the vehicle is stored in the storage unit. A technique for controlling whether or not to notify the collected sound in the vehicle based on whether or not they match is disclosed.
特開２０１５－３２１５５号公報JP2015-32155A
　車両等の移動体の外部において発生する音は様々である。例えば、車内の人物に速やかに通知することが好ましい音、例えば、運転操作に影響を与えるような音もあれば、車内の人物に違和感なく自然に伝えることが好ましい音、例えば、運転操作に関わらないような音もある。 There are various sounds generated outside a moving body such as a vehicle. For example, there are sounds that are preferably notified promptly to the person in the car, for example, sounds that affect the driving operation, and sounds that are preferably conveyed naturally to the person in the car without feeling uncomfortable, for example, Some sounds don't exist.
　本発明が解決しようとする課題としては、移動体の外部で発生する音それぞれに適した方法でその音を車内の人物に伝えることを可能とする技術、例えば、運転者に伝えることで運転支援に貢献するために運転者に伝えることを可能とする技術を提供することが一例として挙げられる。 As a problem to be solved by the present invention, a technology that makes it possible to convey the sound to a person in the vehicle by a method suitable for each sound generated outside the moving body, for example, driving assistance by conveying it to the driver One example is to provide technology that can be communicated to the driver to contribute to the vehicle.
　請求項１に記載の発明は、
　移動体の外部で発生した外部音の再生開始時に前記外部音を徐々にフェードインさせる第１の再生モードと、前記第１の再生モードよりも速く前記外部音をフェードインさせる第２の再生モードのうちのいずれかの再生モードを選択するモード選択部と、
　集音装置により収集された外部音を、前記モード選択部が選択した前記再生モードのフェードイン速度で前記移動体の室内スピーカーから再生させるスピーカー制御部と、
　を備える情報処理装置である。 The invention described in claim 1
A first reproduction mode in which the external sound gradually fades in at the start of reproduction of the external sound generated outside the moving body, and a second reproduction mode in which the external sound fades in faster than the first reproduction mode. A mode selection unit for selecting one of the playback modes;
A speaker control unit that reproduces the external sound collected by the sound collection device from the indoor speaker of the moving body at a fade-in speed of the reproduction mode selected by the mode selection unit;
Is an information processing apparatus.
　請求項９に記載の発明は、
　コンピュータが、
　移動体の外部で発生した外部音の再生開始時に前記外部音を徐々にフェードインさせる第１の再生モードと、前記第１の再生モードよりも速く前記外部音をフェードインさせる第２の再生モードのうちのいずれかの再生モードを選択する工程と、
　集音装置により収集された外部音を、選択した前記再生モードのフェードイン速度で前記移動体の室内スピーカーから再生させる工程と、
　を含む外部音再生方法である。 The invention according to claim 9 is:
Computer
A first reproduction mode in which the external sound gradually fades in at the start of reproduction of the external sound generated outside the moving body, and a second reproduction mode in which the external sound fades in faster than the first reproduction mode. Selecting one of the playback modes;
Reproducing the external sound collected by the sound collecting device from the indoor speaker of the moving body at the fade-in speed of the selected reproduction mode;
Is an external sound reproducing method.
　請求項１０に記載の発明は、
　コンピュータを、
　移動体の外部で発生した外部音の再生開始時に前記外部音を徐々にフェードインさせる第１の再生モードと、前記第１の再生モードよりも速く前記外部音をフェードインさせる第２の再生モードのうちのいずれかの再生モードを選択する手段、及び、
　集音装置により収集された外部音を、選択した前記再生モードのフェードイン速度で前記移動体の室内スピーカーから再生させる手段、
　として機能させるためのプログラムである。 The invention according to claim 10 is:
Computer
A first reproduction mode in which the external sound gradually fades in at the start of reproduction of the external sound generated outside the moving body, and a second reproduction mode in which the external sound fades in faster than the first reproduction mode. A means for selecting one of the playback modes, and
Means for reproducing the external sound collected by the sound collecting device from the indoor speaker of the moving body at the fade-in speed of the selected reproduction mode;
It is a program to make it function as.
　請求項１１に記載の発明は、
　地図データのデータ構造であって、
　前記地図データ上の位置情報と、
　前記位置情報毎に設定され、集音装置により集音された外部音を移動体の室内スピーカーにより再生する際の再生モードを示す再生モード情報と、
　を有するデータ構造である。 The invention according to claim 11
A data structure of map data,
Position information on the map data;
Reproduction mode information indicating a reproduction mode when reproducing the external sound collected by the sound collection device by the indoor speaker of the moving body, set for each position information;
Is a data structure.
　上述した目的、およびその他の目的、特徴および利点は、以下に述べる好適な実施の形態、およびそれに付随する以下の図面によってさらに明らかになる。 The above-described object and other objects, features, and advantages will be further clarified by a preferred embodiment described below and the following drawings attached thereto.
第１実施形態における情報処理装置の機能構成を概念的に示すブロック図である。It is a block diagram which shows notionally the functional structure of the information processing apparatus in 1st Embodiment. 第１の再生モードのフェードイン速度と第２の再生モードのフェードイン速度の違いを例示する図である。It is a figure which illustrates the difference between the fade-in speed of the 1st reproduction mode, and the fade-in speed of the 2nd reproduction mode. 情報処理装置のハードウエア構成を例示する図である。It is a figure which illustrates the hardware constitutions of information processing apparatus. 第１実施形態における情報処理装置の第１の動作例を示すフローチャートである。It is a flowchart which shows the 1st operation example of the information processing apparatus in 1st Embodiment. 位置情報と再生モードとの対応関係を記憶するテーブルの一例を示す図である。It is a figure which shows an example of the table which memorize | stores the correspondence of a positional information and reproduction | regeneration mode. 第１実施形態における情報処理装置の第２の動作例を示すフローチャートである。It is a flowchart which shows the 2nd operation example of the information processing apparatus in 1st Embodiment. 第２実施形態における情報処理装置の機能構成を概念的に示すブロック図である。It is a block diagram which shows notionally the function structure of the information processing apparatus in 2nd Embodiment. 第２実施形態における情報処理装置の動作例を示すフローチャートである。It is a flowchart which shows the operation example of the information processing apparatus in 2nd Embodiment. 音源照合用の情報を格納するテーブルの一例を示す図である。It is a figure which shows an example of the table which stores the information for sound source collation.
　以下、本発明の実施の形態について、図面を用いて説明する。尚、すべての図面において、同様な構成要素には同様の符号を付し、適宜説明を省略する。また、特に説明する場合を除き、ブロック図における各ブロックは、ハードウエア単位の構成ではなく、機能単位の構成を表している。 Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are given to the same components, and the description will be omitted as appropriate. Further, unless otherwise specified, each block in the block diagram represents a functional unit configuration, not a hardware unit configuration.
　［第１実施形態］
　〔機能構成〕
　図１は、第１実施形態における情報処理装置１０の機能構成を概念的に示すブロック図である。情報処理装置１０は、移動体の室内または室外に取り付け可能な外付け型の装置である。また、情報処理装置１０は、例えばＥＣＵ（Electronic Control Unit）といった、移動体に組み込まれる装置であってもよい。また、情報処理装置１０は、後述する各機能を実現するアプリケーションがインストールされた携帯型端末（例：スマートフォンやタブレット端末）であってもよい。図１に示されるように、情報処理装置１０は、モード選択部１２とスピーカー制御部１４と、を備える。なお、以下の説明では、移動体が車両である場合を例示するが、移動体は車両に限定されない。 [First Embodiment]
[Function configuration]
FIG. 1 is a block diagram conceptually showing the functional configuration of the information processing apparatus 10 in the first embodiment. The information processing device 10 is an external device that can be attached to the inside or the outside of a moving body. Further, the information processing apparatus 10 may be an apparatus incorporated in a moving body such as an ECU (Electronic Control Unit). Further, the information processing apparatus 10 may be a portable terminal (for example, a smartphone or a tablet terminal) in which an application that realizes each function described below is installed. As illustrated in FIG. 1, the information processing apparatus 10 includes a mode selection unit 12 and a speaker control unit 14. In addition, although the case where a moving body is a vehicle is illustrated in the following description, a moving body is not limited to a vehicle.
　モード選択部１２は、車両の外部音に関する複数の再生モードのうちの１つを選択する。複数の再生モードは、車両の外部音の再生開始時のフェードイン速度がそれぞれ互いに異なっており、第１の再生モードと第２の再生モードを少なくとも含む。ここで、フェードイン速度とは、例えば、ある規定のゲイン値に到達するまでの時間（速さ）を意味する。規定のゲイン値は、例えば人物の平均的な可聴域などに基づいて定義できる。第１の再生モードは、車両の外部音の再生開始時に当該外部音を第１の速度でフェードインさせる再生モードである。また、第２の再生モードは、上述の第１の速度よりも速い第２の速度で外部音をフェードインさせる再生モードである。モード選択部１２は、第１の再生モードと第２の再生モードのいずれかを少なくとも選択することができる。 The mode selection unit 12 selects one of a plurality of playback modes related to the external sound of the vehicle. The plurality of playback modes have different fade-in speeds at the start of playback of the external sound of the vehicle, and include at least a first playback mode and a second playback mode. Here, the fade-in speed means, for example, the time (speed) until a certain specified gain value is reached. The prescribed gain value can be defined based on, for example, an average audible range of a person. The first reproduction mode is a reproduction mode in which the external sound fades in at the first speed when the reproduction of the external sound of the vehicle is started. The second playback mode is a playback mode in which the external sound is faded in at a second speed higher than the first speed described above. The mode selection unit 12 can select at least one of the first reproduction mode and the second reproduction mode.
　図２は、第１の再生モードのフェードイン速度と第２の再生モードのフェードイン速度の違いを例示する図である。図２の縦軸はスピーカーから再生される音のゲイン値を示している。また、図２の横軸は時間軸を示している。図２に示されるように、第１の再生モードでは徐々にゲイン値が上昇していく。つまり、第１の再生モードでは、車外音が室内スピーカーから徐々に聞こえてくるように制御されるため、車外音が車両の乗員に与える違和感を低減させることができる。これに対し、第２の再生モードでは、第１の再生モードと同じゲイン値となるまでの時間が第１の再生モードよりも速い。つまり、第２の再生モードでは、室内スピーカーからいきなり車外音が聞こえてくるように制御されるため、車外音に対して車両の乗員の注意を向けることができる。 FIG. 2 is a diagram illustrating the difference between the fade-in speed in the first playback mode and the fade-in speed in the second playback mode. The vertical axis in FIG. 2 indicates the gain value of the sound reproduced from the speaker. Further, the horizontal axis of FIG. 2 represents the time axis. As shown in FIG. 2, the gain value gradually increases in the first reproduction mode. In other words, in the first playback mode, control is performed so that the sound outside the vehicle is gradually heard from the indoor speaker, so that the uncomfortable feeling given to the vehicle occupant by the sound outside the vehicle can be reduced. In contrast, in the second playback mode, the time until the same gain value as in the first playback mode is reached is faster than in the first playback mode. That is, in the second playback mode, control is performed so that the outside sound can be heard suddenly from the indoor speaker, so that the vehicle occupant can pay attention to the outside sound.
　スピーカー制御部１４は、集音装置（図示せず）により収集された車外音を、モード選択部１２が選択した再生モードのフェードイン速度で車両の室内スピーカー（図示せず）から再生させる。 The speaker control unit 14 reproduces the vehicle exterior sound collected by the sound collection device (not shown) from the vehicle interior speaker (not shown) at the fade-in speed of the reproduction mode selected by the mode selection unit 12.
　集音装置は、収集した音に応じた電気信号を生成して出力するマイクロフォンやマイクロフォンアレイなどを備える装置である。集音装置は、車両の外周部に設けられ、当該車両の外部で発生する音（外部音）を収集することができる。集音装置の設置位置や数は特に限定されない。集音装置は、無線接続または有線接続によって、情報処理装置１０に収集した音を送信することができる。また、集音装置は、１つの装置として情報処理装置１０と一体的に構成されていてもよい。 The sound collecting device is a device including a microphone or a microphone array that generates and outputs an electrical signal corresponding to the collected sound. The sound collection device is provided on the outer periphery of the vehicle and can collect sound (external sound) generated outside the vehicle. The installation position and number of sound collectors are not particularly limited. The sound collection device can transmit the collected sound to the information processing device 10 by wireless connection or wired connection. In addition, the sound collecting device may be configured integrally with the information processing device 10 as one device.
　室内スピーカーは、車両に組み込まれているスピーカー装置または市販の外付けスピーカーである。室内スピーカーは、例えば、情報処理装置１０と有線で通信可能なタイプのスピーカーであってもよいし、情報処理装置１０とワイヤレス通信可能なタイプのスピーカーであってもよい。 The indoor speaker is a speaker device built in the vehicle or a commercially available external speaker. The indoor speaker may be, for example, a speaker that can communicate with the information processing apparatus 10 in a wired manner, or may be a speaker that can wirelessly communicate with the information processing apparatus 10.
　以上、本実施形態では、モード選択部１２によってフェードイン速度の異なる少なくとも２つの再生モードが選択される。また、本実施形態では、車外音が、モード選択部１２によって選択された再生モードに応じたフェードイン速度で車両の室内スピーカーから出力される。 As described above, in the present embodiment, the mode selection unit 12 selects at least two playback modes having different fade-in speeds. Further, in the present embodiment, the vehicle exterior sound is output from the vehicle interior speaker at a fade-in speed corresponding to the playback mode selected by the mode selection unit 12.
　これにより、本実施形態によれば、車両の外部で発生する音それぞれに適した方法でその音を車内の人物に伝えることが可能となる。例えば、海辺の道路を走行中に集音可能な波の音といった環境音を、徐々にフェードインさせる第１の再生モードで室内スピーカーから出力することにより、車内の人物に違和感なくその音を認知させ、気分を高揚させたりリラックスさせたりする効果を高めることができる。また例えば、通学路や事故多発地点の周辺などでは、車外音を第１の再生モードよりも速いフェードイン速度で室内スピーカーから出力することにより、車内の人物に違和感を与えて注意を促す効果を高めることができる。 Thus, according to the present embodiment, the sound can be transmitted to the person in the vehicle by a method suitable for each sound generated outside the vehicle. For example, environmental sounds such as the sound of waves that can be collected while driving on a seaside road are output from the indoor speakers in the first playback mode that gradually fades in. And can enhance the effect of raising and relaxing the mood. Also, for example, in the vicinity of commuting roads and areas where accidents occur frequently, the sound outside the vehicle is output from the indoor speaker at a faster fade-in speed than in the first playback mode, thereby giving a sense of incongruity to the person in the car and calling attention. Can be increased.
　以下、第１実施形態の情報処理装置１０について、更に詳細に説明する。 Hereinafter, the information processing apparatus 10 according to the first embodiment will be described in more detail.
　〔ハードウエア構成〕
　情報処理装置１０の各機能構成部は、各機能構成部を実現するハードウエア（例：ハードワイヤードされた電子回路など）で実現されてもよいし、ハードウエアとソフトウエアとの組み合わせ（例：電子回路とそれを制御するプログラムの組み合わせなど）で実現されてもよい。以下、図３を用いて、情報処理装置１０がハードウエアとソフトウエアとの組み合わせで実現される場合について、さらに説明する。図３は、情報処理装置１０のハードウエア構成を例示する図である。 [Hardware configuration]
Each functional component of the information processing apparatus 10 may be realized by hardware (for example, a hard-wired electronic circuit) that realizes each functional component, or a combination of hardware and software (for example: It may be realized by a combination of an electronic circuit and a program for controlling it). Hereinafter, the case where the information processing apparatus 10 is realized by a combination of hardware and software will be further described with reference to FIG. FIG. 3 is a diagram illustrating a hardware configuration of the information processing apparatus 10.
　情報処理装置１０は、バス１０２、プロセッサ１０４、メモリ１０６、ストレージデバイス１０８、入出力インタフェース１１０、及びネットワークインタフェース１１２を有する。バス１０２は、プロセッサ１０４、メモリ１０６、ストレージデバイス１０８、入出力インタフェース１１０、及びネットワークインタフェース１１２が、相互にデータを送受信するためのデータ伝送路である。ただし、プロセッサ１０４などを互いに接続する方法は、バス接続に限定されない。プロセッサ１０４は、マイクロプロセッサなどを用いて実現される演算処理装置である。メモリ１０６は、ＲＡＭ（Random Access Memory）などを用いて実現されるメモリである。ストレージデバイス１０８は、ＲＯＭ（Read Only Memory）やフラッシュメモリなどを用いて実現されるストレージデバイスである。 The information processing apparatus 10 includes a bus 102, a processor 104, a memory 106, a storage device 108, an input / output interface 110, and a network interface 112. The bus 102 is a data transmission path through which the processor 104, the memory 106, the storage device 108, the input / output interface 110, and the network interface 112 transmit / receive data to / from each other. However, the method of connecting the processors 104 and the like is not limited to bus connection. The processor 104 is an arithmetic processing device realized using a microprocessor or the like. The memory 106 is a memory realized using a RAM (Random Access Memory) or the like. The storage device 108 is a storage device realized using a ROM (Read Only Memory), a flash memory, or the like.
　入出力インタフェース１１０は、情報処理装置１０を外部装置と接続するためのインタフェースである。例えば、入出力インタフェース１１０には、車両の現在位置を示す情報を取得するためのＧＰＳ（Global Positioning System）モジュール１１０１が接続される。なお、情報処理装置１０は、ネットワークインタフェース１１２を介して周辺基地局の位置情報を取得し、当該周辺基地局の位置情報を用いて車両の現在位置を推定することもできる。また、情報処理装置１０は、例えばカルマンフィルタやパーティクルフィルタといったベイズ推定を利用して自車両の推定位置を算出することもできる。このような場合、入出力インタフェース１１０にはＧＰＳモジュール１１０１が接続されていなくてもよい。また、入出力インタフェース１１０には、車内に音を出力するスピーカー装置１１０２が接続される。なお、スピーカー装置１１０２は、例えばｂｌｕｅｔｏｏｔｈ（登録商標）などの近距離無線通信を可能とする装置である場合には、ネットワークインタフェース１１２を介して接続されていてもよい。また、入出力インタフェース１１０には、スイッチ１１０３が接続されていてもよい。スイッチ１１０３は、車両の乗員による再生モードの選択操作を受け付けるために設けられる。スイッチ１１０３は、物理的な切り替え機構を備える物理スイッチであってもよいし、タッチパネルで実現されるソフトウエアスイッチであってもよい。 The input / output interface 110 is an interface for connecting the information processing apparatus 10 to an external apparatus. For example, a GPS (Global Positioning System) module 1101 for acquiring information indicating the current position of the vehicle is connected to the input / output interface 110. Note that the information processing apparatus 10 can also acquire the position information of the surrounding base station via the network interface 112 and estimate the current position of the vehicle using the position information of the surrounding base station. The information processing apparatus 10 can also calculate the estimated position of the host vehicle using Bayesian estimation such as a Kalman filter or a particle filter. In such a case, the GPS module 1101 may not be connected to the input / output interface 110. The input / output interface 110 is connected to a speaker device 1102 that outputs sound into the vehicle. Note that the speaker device 1102 may be connected via the network interface 112 if the device is a device that enables short-range wireless communication such as Bluetooth (registered trademark), for example. Further, the switch 1103 may be connected to the input / output interface 110. The switch 1103 is provided for accepting an operation for selecting a reproduction mode by a vehicle occupant. The switch 1103 may be a physical switch having a physical switching mechanism, or may be a software switch realized by a touch panel.
　ネットワークインタフェース１１２は、情報処理装置１０を通信網に接続するためのインタフェースである。情報処理装置１０は、ネットワークインタフェース１１２を複数有していてもよい。例えば、情報処理装置１０は、ＣＡＮ通信網に接続するためのネットワークインタフェース１１２と、近距離無線通信規格（例：Ｂｌｕｅｔｏｏｔｈ（登録商標））をサポートするネットワークインタフェース１１２とを有する。例えば、情報処理装置１０は、近距離無線によって、車両の外周部に設けられた集音装置２０と通信し、集音装置２０により収集された車外音のデータを取得することができる。また、情報処理装置１０は、ＣＡＮ通信網を介して、カルマンフィルタなどを利用した自車用の位置推定アルゴリズムに使用できる、車両の動作（例えば、車両の移動速度、ステアリングの操舵角度など）を示す情報を取得することもできる。 The network interface 112 is an interface for connecting the information processing apparatus 10 to a communication network. The information processing apparatus 10 may have a plurality of network interfaces 112. For example, the information processing apparatus 10 includes a network interface 112 for connecting to a CAN communication network and a network interface 112 that supports a short-range wireless communication standard (for example, Bluetooth (registered trademark)). For example, the information processing apparatus 10 can communicate with the sound collection device 20 provided on the outer peripheral portion of the vehicle by short-range wireless, and can acquire the data of the outside sound collected by the sound collection device 20. In addition, the information processing apparatus 10 indicates the operation of the vehicle (for example, the moving speed of the vehicle, the steering angle of the steering, etc.) that can be used for the position estimation algorithm for the own vehicle using the Kalman filter or the like via the CAN communication network. Information can also be obtained.
　ストレージデバイス１０８は、情報処理装置１０の各機能構成部を実現するためのプログラムモジュールを記憶している。プロセッサ１０４は、このプログラムモジュールをメモリ１０６に読み出して実行することで、情報処理装置１０の各機能構成部の機能を実現する。 The storage device 108 stores a program module for realizing each functional component of the information processing apparatus 10. The processor 104 reads out the program module to the memory 106 and executes it, thereby realizing the function of each functional component of the information processing apparatus 10.
　〔動作例〕
　以下、図を用いて第１実施形態における情報処理装置１０の具体的な動作例をいくつか説明する。 [Operation example]
Hereinafter, some specific operation examples of the information processing apparatus 10 according to the first embodiment will be described with reference to the drawings.
　＜第１の動作例＞
　図４は、第１実施形態における情報処理装置１０の第１の動作例を示すフローチャートである。第１の動作例では、モード選択部１２が、自車両の位置情報を取得し、その自車両の位置情報に基づいて、第１の再生モードまたは第２の再生モードのいずれかを選択する。 <First operation example>
FIG. 4 is a flowchart illustrating a first operation example of the information processing apparatus 10 according to the first embodiment. In the first operation example, the mode selection unit 12 acquires the position information of the host vehicle, and selects either the first playback mode or the second playback mode based on the position information of the host vehicle.
　モード選択部１２は、自車両の位置情報を取得する（Ｓ１０２）。入出力インタフェース１１０にＧＰＳモジュール１１０１が接続されている場合、モード選択部１２は、ＧＰＳモジュール１１０１から得られるＧＰＳ情報を、自車両の位置情報として取得することができる。また、モード選択部１２は、３Ｇ回線やＬＴＥ（Long Term Evolution）回線を介して周辺の無線基地局と通信して当該無線基地局の位置情報を取得し、無線基地局の位置情報を利用して自車両の位置情報を推定してもよい。また、モード選択部１２は、カルマンフィルタなどを利用した自車用の位置推定アルゴリズムに基づいて、自車両の推定位置を算出してもよい。 * The mode selection part 12 acquires the positional information on the own vehicle (S102). When the GPS module 1101 is connected to the input / output interface 110, the mode selection unit 12 can acquire GPS information obtained from the GPS module 1101 as position information of the host vehicle. In addition, the mode selection unit 12 communicates with a surrounding radio base station via a 3G line or an LTE (Long Termination Evolution) line to obtain position information of the radio base station, and uses the position information of the radio base station. Then, the position information of the own vehicle may be estimated. The mode selection unit 12 may calculate the estimated position of the host vehicle based on the position estimation algorithm for the host vehicle using a Kalman filter or the like.
　モード選択部１２は、Ｓ１０２の処理で取得した自車両の位置情報に基づいて、車外音の再生モードを選択する（Ｓ１０４）。 The mode selection unit 12 selects an external sound reproduction mode based on the position information of the host vehicle acquired in S102 (S104).
　具体的には、モード選択部１２は、Ｓ１０２の処理で取得した自車両の位置情報が、第１特定エリアに対応する位置を示すか否か、或いは、第２特定エリアに対応する位置を示すか否かを判定し、その判定結果に応じて再生モードを選択する。第１特定エリアとは、車両の外部音が与える雰囲気の重要度がその他のエリアよりも高いエリアである。第１特定エリアの具体例としては、例えば、観光地、海、または森林の周辺などが挙げられる。また、第２特定エリアとは、車両の操縦者に要求される注意の度合がその他のエリアよりも高いエリアである。第２特定エリアの具体例としては、事故多発地点の周辺、見通しの悪い地点の周辺、学校施設や公園の周辺などが挙げられる。 Specifically, the mode selection unit 12 indicates whether or not the position information of the host vehicle acquired in the process of S102 indicates a position corresponding to the first specific area, or indicates a position corresponding to the second specific area. Whether or not, and the playback mode is selected according to the determination result. A 1st specific area is an area where the importance of the atmosphere which the external sound of a vehicle gives is higher than other areas. Specific examples of the first specific area include, for example, a sightseeing spot, the sea, or the periphery of a forest. The second specific area is an area where the degree of attention required of the driver of the vehicle is higher than other areas. Specific examples of the second specific area include the vicinity of a point where accidents frequently occur, the vicinity of a point with poor visibility, and the vicinity of a school facility or a park.
　モード選択部１２は、Ｓ１０２の処理で取得した自車両の位置情報が第１特定エリアに対応する位置を示す場合には、外部音を徐々にフェードインさせる第１の再生モードを選択する。また、モード選択部１２は、Ｓ１０２の処理で取得した自車両の位置情報が第２特定エリアに対応する位置を示す場合には、第１の再生モードよりも速く外部音をフェードインさせる第２の再生モードを選択する。 The mode selection unit 12 selects the first reproduction mode in which the external sound gradually fades in when the position information of the host vehicle acquired in the process of S102 indicates the position corresponding to the first specific area. Further, when the position information of the host vehicle acquired in the process of S102 indicates a position corresponding to the second specific area, the mode selection unit 12 causes the external sound to fade in faster than in the first playback mode. Select the playback mode.
　ここで、モード選択部１２は、例えば図５に示すようなテーブルを参照して、選択すべき再生モードを判定することができる。図５は、位置情報と再生モードとの対応関係を記憶するテーブルの一例を示す図である。図５に示されるテーブルは、１つ以上の位置情報を含むエリア情報に紐付けて、再生モードを識別する情報が格納している。詳細には、モード選択部１２は、Ｓ１０２で取得した自車両の位置情報が示す位置を含むエリアのエリア情報を格納している行（レコード）を特定し、当該特定したレコードの「再生モード」の列に格納されている再生モードの識別情報を読み出す。そして、モード選択部１２は、読み出した再生モードの識別情報が示す再生モードを、選択すべき再生モードとして決定することができる。例えば、モード選択部１２がＳ１０２の処理で「（ｘ１，ｙ２）」の位置情報を取得したと仮定する。この場合、モード選択部１２は、図５のテーブルを参照して、「第１の再生モード」を選択すべき再生モードとして特定することができる。 Here, the mode selection unit 12 can determine the playback mode to be selected with reference to a table as shown in FIG. 5, for example. FIG. 5 is a diagram illustrating an example of a table that stores a correspondence relationship between position information and a reproduction mode. The table shown in FIG. 5 stores information for identifying the playback mode in association with area information including one or more pieces of position information. Specifically, the mode selection unit 12 identifies a row (record) that stores area information of an area including the position indicated by the position information of the host vehicle acquired in S102, and “playback mode” of the identified record. The reproduction mode identification information stored in the column is read out. Then, the mode selection unit 12 can determine the playback mode indicated by the read playback mode identification information as the playback mode to be selected. For example, it is assumed that the mode selection unit 12 has acquired the position information “(x 1 , y 2 )” in the process of S102. In this case, the mode selection unit 12 can specify the “first playback mode” as the playback mode to be selected with reference to the table of FIG.
　なお、図５はあくまで一例であり、テーブルの形式は図５の例に限定されない。例えば、図５に示されるテーブルの代わりに、エリア情報に紐付けてそのエリアが第１特定エリアまたは第２特定エリアのいずれであるかを識別する情報を格納するテーブルを用いることができる。この場合、モード選択部１２は、Ｓ１０２で取得した自車両の位置情報を基にテーブルを参照し、第１特定エリアの識別情報或いは第２特定エリアの識別情報を取得することになる。そして、モード選択部１２は、取得した情報から自車両の現在地が第１特定エリアに属するか或いは第２特定エリアに属するかを判別し、その判別結果に応じて第１の再生モードを選択するか第２の再生モードを選択するかを決定することができる。具体的には、モード選択部１２は、第１特定エリアの識別情報を取得した場合には第１の再生モードを選択し、第２特定エリアの識別情報を取得した場合には第２再生モードを選択する。 Note that FIG. 5 is merely an example, and the format of the table is not limited to the example of FIG. For example, instead of the table shown in FIG. 5, it is possible to use a table that stores information that is associated with the area information and identifies whether the area is the first specific area or the second specific area. In this case, the mode selection unit 12 refers to the table based on the position information of the host vehicle acquired in S102, and acquires the identification information of the first specific area or the identification information of the second specific area. And the mode selection part 12 discriminate | determines whether the present location of the own vehicle belongs to the 1st specific area or the 2nd specific area from the acquired information, and selects a 1st reproduction | regeneration mode according to the discrimination | determination result. Or to select the second playback mode. Specifically, the mode selection unit 12 selects the first reproduction mode when acquiring the identification information of the first specific area, and selects the second reproduction mode when acquiring the identification information of the second specific area. Select.
　なお、モード選択部１２は、Ｓ１０２の処理で取得した自車両の位置情報が第１特定エリアおよび第２特定エリアのいずれにも対応しない位置を示す場合、任意の再生モードを選択するように構成されていてもよい。例えば、モード選択部１２に、第１の再生モードまたは第２の再生モードのいずれかをデフォルトの再生モードとして予め設定しておき、モード選択部１２は、Ｓ１０２の処理で取得した自車両の位置情報が第１特定エリアおよび第２特定エリアのいずれにも対応しない位置を示す場合には、予め設定されたデフォルトの再生モードを選択するように構成されていてもよい。 The mode selection unit 12 is configured to select an arbitrary reproduction mode when the position information of the host vehicle acquired in the process of S102 indicates a position that does not correspond to either the first specific area or the second specific area. May be. For example, either the first playback mode or the second playback mode is set as a default playback mode in the mode selection unit 12 in advance, and the mode selection unit 12 determines the position of the host vehicle acquired in the process of S102. When the information indicates a position that does not correspond to either the first specific area or the second specific area, a preset default playback mode may be selected.
　図４に戻り、スピーカー制御部１４は、Ｓ１０４で選択された再生モードのフェードイン速度で、集音装置２０により収集された車外音を室内スピーカーから出力させる（Ｓ１０６）。 Returning to FIG. 4, the speaker control unit 14 outputs the outside sound collected by the sound collection device 20 from the indoor speaker at the fade-in speed of the reproduction mode selected in S104 (S106).
　このとき、スピーカー制御部１４は、車両の位置情報に基づいて、集音装置２０が収集する車外音の再生を開始するタイミングを制御してもよい（Ｓ１０８）。具体的には、スピーカー制御部１４は、車両の位置情報が観光地の周辺、海辺や森林部に沿って伸びる道路の始点、事故多発地点や見通しが悪い地点の周辺を示す場合に、集音装置２０が収集する車外音の再生を開始するように構成されていてもよい。より具体的には、スピーカー制御部１４は、Ｓ１０２の処理で取得した車両の位置情報と、メモリ１０６やストレージデバイス１０８などに予め記憶された、車外音を再生すべき所定エリアを示す情報とを比較し、当該車両の位置情報が示す位置と所定エリアとを基に算出可能な距離が基準値以下である場合に、集音装置２０が収集する車外音を室内スピーカーから再生する。これにより、車外音が必要とされる場所では車外音を室内スピーカーから再生し、その他の場所では車外音を遮断することが可能となる。 At this time, the speaker control unit 14 may control the timing of starting the reproduction of the external sound collected by the sound collecting device 20 based on the position information of the vehicle (S108). Specifically, the speaker control unit 14 collects sound when the position information of the vehicle indicates the vicinity of a sightseeing spot, the starting point of a road extending along the seaside or forest, the vicinity of a point where accidents frequently occur, or a point where visibility is poor. You may be comprised so that the reproduction | regeneration of the external sound which the apparatus 20 collects may be started. More specifically, the speaker control unit 14 includes the vehicle position information acquired in the process of S102 and information indicating a predetermined area in which sound outside the vehicle is to be reproduced, which is stored in advance in the memory 106, the storage device 108, or the like. In comparison, when the distance that can be calculated based on the position indicated by the position information of the vehicle and the predetermined area is equal to or less than the reference value, the outside sound collected by the sound collecting device 20 is reproduced from the indoor speaker. As a result, it is possible to reproduce the sound outside the vehicle from the indoor speaker in a place where the sound outside the vehicle is required, and to block the sound outside the vehicle in other places.
　＜第２の動作例＞
　図６は、第１実施形態における情報処理装置１０の第２の動作例を示すフローチャートである。第２の動作例では、モード選択部１２が、外部音の再生モードの選択操作を受け付けるスイッチ１１０３を有し、当該スイッチ１１０３で受け付けた選択操作に基づいて、第１の再生モードまたは第２の再生モードのいずれかを選択する。 <Second operation example>
FIG. 6 is a flowchart illustrating a second operation example of the information processing apparatus 10 according to the first embodiment. In the second operation example, the mode selection unit 12 includes a switch 1103 that accepts an external sound reproduction mode selection operation, and the first reproduction mode or the second reproduction mode is selected based on the selection operation accepted by the switch 1103. Select one of the playback modes.
　モード選択部１２は、スイッチ１１０３を介して、再生モードの選択操作を受け付ける（Ｓ２０２）。そして、モード選択部１２は、スイッチ１１０３を介して受け付けた選択操作に応じた再生モードを選択する（Ｓ２０４）。例えば、スイッチ１１０３が所謂押しボタンスイッチやスライドスイッチのような切り替え機構を備える場合、モード選択部１２は、当該切り替え機構の切り替え操作によるスイッチ１１０３からの電気信号の変化に基づいて、再生モードを識別することができる。また例えば、スイッチ１１０３がタッチパネルにより実現される場合、モード選択部１２は、タッチパネル上で選択された画面要素（ソフトウエアボタンなど）に応じて再生モードを示す情報を取得し、当該情報を基に再生モードを選択することができる。 The mode selection unit 12 accepts a playback mode selection operation via the switch 1103 (S202). Then, the mode selection unit 12 selects a playback mode corresponding to the selection operation received via the switch 1103 (S204). For example, when the switch 1103 includes a switching mechanism such as a so-called push button switch or a slide switch, the mode selection unit 12 identifies the playback mode based on a change in the electrical signal from the switch 1103 due to the switching operation of the switching mechanism. can do. For example, when the switch 1103 is realized by a touch panel, the mode selection unit 12 acquires information indicating a playback mode according to a screen element (software button or the like) selected on the touch panel, and based on the information. A playback mode can be selected.
　スピーカー制御部１４は、第１の動作例と同様に、Ｓ２０４で選択された再生モードのフェードイン速度で、集音装置２０により収集された車外音を室内スピーカーから出力させる（Ｓ２０６）。このとき、スピーカー制御部１４は、第１の動作例と同様に、車両の位置情報に基づいて、集音装置２０が収集する車外音の再生を開始するタイミングを制御してもよい（Ｓ２０８）。この場合、情報処理装置１０は、例えばバックグラウンドで車両の位置情報を取得している。 As in the first operation example, the speaker control unit 14 causes the vehicle exterior sound collected by the sound collecting device 20 to be output from the indoor speaker at the fade-in speed in the playback mode selected in S204 (S206). At this time, similarly to the first operation example, the speaker control unit 14 may control the timing for starting the reproduction of the outside sound collected by the sound collecting device 20 based on the position information of the vehicle (S208). . In this case, the information processing apparatus 10 acquires vehicle position information in the background, for example.
　［第２実施形態］
　本実施形態は、以下の点を除き、第１実施形態と同様の構成を有する。 [Second Embodiment]
This embodiment has the same configuration as that of the first embodiment except for the following points.
　〔機能構成〕
　図７は、第２実施形態における情報処理装置１０の機能構成を概念的に示すブロック図である。図７に示されるように、本実施形態の情報処理装置１０は、第１実施形態の構成に加え、バッファ部１６および音解析部１８を更に備える。 [Function configuration]
FIG. 7 is a block diagram conceptually showing the functional configuration of the information processing apparatus 10 in the second embodiment. As illustrated in FIG. 7, the information processing apparatus 10 according to the present embodiment further includes a buffer unit 16 and a sound analysis unit 18 in addition to the configuration of the first embodiment.
　バッファ部１６は、集音装置２０により収集された車外音をバッファリングする。バッファ部１６は、例えば、メモリ１０６により実現することができる。 The buffer unit 16 buffers external sound collected by the sound collector 20. The buffer unit 16 can be realized by the memory 106, for example.
　音解析部１８は、バッファ部１６にバッファリングされた車外音を解析する。音解析部１８は、例えばバッファリングされた車外音の周波数成分を解析した結果に基づいて、当該車外音の発生源（音源）を少なくとも特定することができる。音解析部１８は、音源を特定する手法として、既知の音源分離アルゴリズムおよび音源同定アルゴリズムを利用することができる。 The sound analysis unit 18 analyzes the sound outside the vehicle buffered in the buffer unit 16. The sound analysis unit 18 can specify at least a generation source (sound source) of the outside sound based on, for example, a result of analyzing a frequency component of the buffered outside sound. The sound analysis unit 18 can use a known sound source separation algorithm and sound source identification algorithm as a method of specifying a sound source.
　本実施形態のスピーカー制御部１４は、音解析部１８の解析結果に基づいて、特定の音源が検出されたか否かを判定する。特定の音源から発生される音の具体例としては、特に限定されないが、波の音や小鳥のさえずりといった自然の環境音や、観光地周辺の群集騒音（群衆の喧騒）、人物の話し声、周囲に存在する車両のエンジン音、自転車のチェーン音などである。また、本実施形態のスピーカー制御部１４は、音解析部１８の解析結果から特定の音源が検出されたタイミングに応じて、車外音の再生を開始する。 The speaker control unit 14 of the present embodiment determines whether or not a specific sound source is detected based on the analysis result of the sound analysis unit 18. Specific examples of sound generated from a specific sound source are not particularly limited, but include natural environmental sounds such as the sound of waves and chirping of birds, crowd noise around the tourist spot (crowd noise), people talking, and surroundings. The engine sound of a vehicle and the chain sound of a bicycle. In addition, the speaker control unit 14 according to the present embodiment starts the reproduction of the sound outside the vehicle according to the timing at which a specific sound source is detected from the analysis result of the sound analysis unit 18.
　また、本実施形態のモード選択部１２は、音解析部１８の解析結果を基に、第１の再生モードおよび第２の再生モードのいずれかを選択する。具体的には、本実施形態のモード選択部１２は、まず、車外音の音源の種別の解析結果を音解析部１８から取得する。そして、本実施形態のモード選択部１２は、解析結果が示す車外音の音源の種別が所定の環境音である場合に、車外音を徐々にフェードインさせる第１の再生モードを選択する。また、本実施形態のモード選択部１２は、解析結果が示す車外音の音源の種別が人物または車両である場合に、第１の再生モードよりも速く車外音をフェードインさせる第２の再生モードを選択する。 Further, the mode selection unit 12 of the present embodiment selects either the first reproduction mode or the second reproduction mode based on the analysis result of the sound analysis unit 18. Specifically, the mode selection unit 12 of the present embodiment first acquires the analysis result of the type of the sound source of the vehicle outside sound from the sound analysis unit 18. And the mode selection part 12 of this embodiment selects the 1st reproduction | regeneration mode which fades in a vehicle exterior sound gradually, when the classification of the sound source of the vehicle exterior sound which an analysis result shows is a predetermined environmental sound. In addition, the mode selection unit 12 according to the present embodiment causes the vehicle exterior sound to fade in faster than the first playback mode when the vehicle sound source type indicated by the analysis result is a person or a vehicle. Select.
　〔ハードウエア構成〕
　本実施形態の情報処理装置１０は、第１実施形態と同様に、図３に示されるようなハードウエア構成を備える。本実施形態のストレージデバイス１０８は、バッファ部１６および音解析部１８の機能を実現するプログラムモジュールを更に記憶しており、プロセッサ１０４がこれらのプログラムモジュールを実行することにより、バッファ部１６および音解析部１８の機能が実現される。具体的には、プロセッサ１０４は、バッファ部１６の機能を実現するプログラムモジュールを実行して、集音装置２０から取得した音のデータを、例えばメモリ１０６にバッファリングする。また、プロセッサ１０４は、音解析部１８の機能を実現するプログラムモジュールを実行して、メモリ１０６などにバッファリングされた音のデータを読み出し、解析アルゴリズムを用いて音のデータから様々な解析結果を得る。 [Hardware configuration]
The information processing apparatus 10 according to the present embodiment includes a hardware configuration as illustrated in FIG. 3 as in the first embodiment. The storage device 108 according to the present embodiment further stores program modules that realize the functions of the buffer unit 16 and the sound analysis unit 18, and the processor 104 executes these program modules, whereby the buffer unit 16 and the sound analysis are performed. The function of the unit 18 is realized. Specifically, the processor 104 executes a program module that realizes the function of the buffer unit 16 and buffers sound data acquired from the sound collecting device 20 in, for example, the memory 106. In addition, the processor 104 executes a program module that implements the function of the sound analysis unit 18, reads sound data buffered in the memory 106 and the like, and uses the analysis algorithm to output various analysis results from the sound data. obtain.
　〔動作例〕
　以下、図８を用いて第２実施形態における情報処理装置１０の具体的な動作例を説明する。図８は、第２実施形態における情報処理装置１０の動作例を示すフローチャートである。 [Operation example]
Hereinafter, a specific operation example of the information processing apparatus 10 according to the second embodiment will be described with reference to FIG. FIG. 8 is a flowchart illustrating an operation example of the information processing apparatus 10 according to the second embodiment.
　バッファ部１６は、集音装置２０が収集した外部音のデータを取得する（Ｓ３０２）。また、バッファ部１６は、メモリ１０６などのバッファ領域に、Ｓ３０２で取得した外部音のデータをバッファリングする（Ｓ３０４）。 The buffer unit 16 acquires external sound data collected by the sound collection device 20 (S302). Further, the buffer unit 16 buffers the external sound data acquired in S302 in a buffer area such as the memory 106 (S304).
　音解析部１８は、バッファ領域にバッファリングされた外部音のデータを解析する（Ｓ３０６）。音解析部１８は、例えばマイクロフォンアレイなどを利用し、各々のチャンネルにおける音の検出時間の差に基づいて、それぞれの音源から発生した音のデータを抽出することができる。そして、音解析部１８は、それぞれ抽出した音のデータを解析することによって得られる音特徴量を、ストレージデバイス１０８などに予め用意された照合用の音源別特徴量（例：図９）と比較して、各音の音源を特定することができる。 The sound analysis unit 18 analyzes the external sound data buffered in the buffer area (S306). The sound analysis unit 18 can extract data of sound generated from each sound source based on the difference in sound detection time in each channel using, for example, a microphone array. Then, the sound analysis unit 18 compares the sound feature amount obtained by analyzing the extracted sound data with a feature value for each sound source (for example, FIG. 9) prepared in advance in the storage device 108 or the like. Thus, the sound source of each sound can be specified.
　図９は、音源照合用の情報を格納するテーブルの一例を示す図である。図９に例示されるテーブルは、各音源カテゴリに属する音の識別情報に紐付けて音特徴量を格納している。音解析部１８は、図９に示すようなテーブルを用いて、抽出した音を解析することにより得られる音特徴量と最も類似する音特徴量を格納する行（レコード）を特定することができる。そして、音解析部１８は、特定した行（レコード）の「音源カテゴリ」の列に格納されている、音源のカテゴリを識別する情報を取得することができる。 FIG. 9 is a diagram showing an example of a table for storing information for sound source collation. The table illustrated in FIG. 9 stores sound feature amounts in association with identification information of sounds belonging to each sound source category. The sound analysis unit 18 can specify a row (record) storing a sound feature amount most similar to the sound feature amount obtained by analyzing the extracted sound, using a table as shown in FIG. . Then, the sound analysis unit 18 can acquire information for identifying the category of the sound source stored in the “sound source category” column of the specified row (record).
　図８に戻り、モード選択部１２およびスピーカー制御部１４は、音解析部１８の解析結果を用いて、特定の音源が検出されたか否かを判定する（Ｓ３０８、Ｓ３１０）。モード選択部１２は、音解析部１８の解析結果に基づいて、外部音の再生モードを選択する。また、スピーカー制御部１４は、音解析部１８の解析結果に基づいて、外部音の再生タイミングを制御する。 8, the mode selection unit 12 and the speaker control unit 14 determine whether or not a specific sound source is detected using the analysis result of the sound analysis unit 18 (S308, S310). The mode selection unit 12 selects an external sound reproduction mode based on the analysis result of the sound analysis unit 18. Further, the speaker control unit 14 controls the reproduction timing of the external sound based on the analysis result of the sound analysis unit 18.
　具体的には、モード選択部１２およびスピーカー制御部１４は、音解析部１８の解析結果を基に、特定環境音を検出したか否かを判定する（Ｓ３０８）。ここで、特定環境音とは、例えば、波の音や小鳥のさえずりといった自然の環境音や、観光地周辺の群集騒音（群衆の喧騒）などである。但し、これらはあくまで例示であり、本発明における特定環境音は、気分の高揚効果やリラックス効果を得るために、車両の乗客に違和感を与えることなく自然に聞かせることが望ましい音を含む。 Specifically, the mode selection unit 12 and the speaker control unit 14 determine whether a specific environmental sound is detected based on the analysis result of the sound analysis unit 18 (S308). Here, the specific environmental sound is, for example, a natural environmental sound such as a sound of a wave or a chirping of a small bird, a crowd noise around a tourist spot (crowd noise), and the like. However, these are merely examples, and the specific environmental sound in the present invention includes sounds that are desired to be heard naturally without giving a sense of incongruity to the passengers of the vehicle in order to obtain an uplifting effect and a relaxing effect.
　音解析部１８の解析結果、特定環境音が検出された場合（Ｓ３０８：ＹＥＳ）、モード選択部１２は、外部音を徐々にフェードインさせる第１の再生モードを選択する（Ｓ３１２）。そして、スピーカー制御部１４は、第１の再生モードのフェードイン速度で、集音装置２０が取得した外部音を室内スピーカーから再生させる（Ｓ３１６）。 When the specific environmental sound is detected as a result of the analysis by the sound analysis unit 18 (S308: YES), the mode selection unit 12 selects the first reproduction mode in which the external sound is gradually faded in (S312). Then, the speaker control unit 14 reproduces the external sound acquired by the sound collection device 20 from the indoor speaker at the fade-in speed in the first reproduction mode (S316).
　一方、音解析部１８の解析結果、特定環境音が検出されなかった場合（Ｓ３０８：ＮＯ）、モード選択部１２は、音解析部１８の解析結果を基に、周囲に存在する人物の音声または周囲に存在する車両の音を検出したか否かを判定する（Ｓ３１０）。 On the other hand, when the specific environmental sound is not detected as a result of the analysis by the sound analysis unit 18 (S308: NO), the mode selection unit 12 determines whether the sound of a person existing around or It is determined whether or not the sound of a vehicle existing around is detected (S310).
　音解析部１８の解析結果、人物の音声または車両の音が検出された場合（Ｓ３１０：ＹＥＳ）、モード選択部１２は、第１の再生モードよりも速く外部音をフェードインさせる第２の再生モードを選択する（Ｓ３１４）。そして、スピーカー制御部１４は、第２の再生モードのフェードイン速度で、集音装置２０が取得した外部音を室内スピーカーから再生させる（Ｓ３１６）。 When an analysis result of the sound analysis unit 18 detects a human voice or a vehicle sound (S310: YES), the mode selection unit 12 performs the second reproduction to fade in the external sound faster than the first reproduction mode. A mode is selected (S314). Then, the speaker control unit 14 reproduces the external sound acquired by the sound collection device 20 from the indoor speaker at the fade-in speed in the second reproduction mode (S316).
　一方、音解析部１８の解析結果、人物の音声または車両の音が検出されなかった場合（Ｓ３１０：ＮＯ）、外部音を出力すべき条件を満たしていない状態であるため、モード選択部１２およびスピーカー制御部１４は上述の処理を実行しない。 On the other hand, if no sound of the person or vehicle is detected as a result of the analysis by the sound analysis unit 18 (S310: NO), the condition for outputting the external sound is not satisfied. The speaker control unit 14 does not execute the above processing.
　また、モード選択部１２は、図５に示されるテーブルの代わりに、位置情報毎、またはエリア情報毎に再生モードの設定情報が埋め込まれている地図データを用いて再生モードを選択してもよい。具体的には、上記地図データは、位置情報、または所定のエリア情報毎に、室内スピーカーから車外音を再生させる際に選択されるべき再生モードの情報が埋め込まれているデータ構造となっている。例えば、モード選択部１２は、Ｓ１０２で取得した自車両の位置情報が、地図データ上のどの位置に自車両の位置情報が該当するかを解析した解析結果を用いることで、その位置で選択されるべき再生モードを特定する。尚、本解析は情報処理装置１０内の、図示しない解析部で行ってもよく、また、図示しない外部のサーバ装置で行ってもよい。 Further, the mode selection unit 12 may select a reproduction mode using map data in which reproduction mode setting information is embedded for each position information or each area information instead of the table shown in FIG. . Specifically, the map data has a data structure in which information on a reproduction mode to be selected when reproducing outside sound from an indoor speaker is embedded for each position information or predetermined area information. . For example, the mode selection unit 12 selects the position information of the own vehicle acquired in S102 by using the analysis result obtained by analyzing which position on the map data corresponds to the position information of the own vehicle. Specify the playback mode to be used. The analysis may be performed by an analysis unit (not shown) in the information processing apparatus 10 or may be performed by an external server device (not shown).
　以上、本実施形態では、集音装置２０が収集した外部音の解析結果に基づいて、再生モードと外部音の再生タイミングが制御される。これにより、車両内の人物に伝えるべき外部音を、その外部音の種類に適した再生モード（フェードイン速度）で室内スピーカーから再生させることができる。更に、運転者が再生された外部音を聞くことで、運転支援に貢献することが可能となる。 As described above, in the present embodiment, the playback mode and the playback timing of the external sound are controlled based on the analysis result of the external sound collected by the sound collecting device 20. Thereby, the external sound to be transmitted to the person in the vehicle can be reproduced from the indoor speaker in the reproduction mode (fade-in speed) suitable for the type of the external sound. Furthermore, the driver can contribute to driving support by listening to the reproduced external sound.
　以上、図面を参照して実施形態及び実施例について述べたが、これらは本発明の例示であり、上記以外の様々な構成を採用することもできる。 As mentioned above, although embodiment and the Example were described with reference to drawings, these are the illustrations of this invention, Various structures other than the above are also employable.
　この出願は、２０１６年１１月２９日に出願された日本出願特願２０１６－２３１０３９号を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2016-231039 filed on Nov. 29, 2016, the entire disclosure of which is incorporated herein.

Claims (11)

  1. 　移動体の外部で発生した外部音の再生開始時に前記外部音を第１の速度でフェードインさせる第１の再生モードと、前記第１の速度よりも速い第２の速度で前記外部音をフェードインさせる第２の再生モードのうちのいずれかの再生モードを選択するモード選択部と、
    　集音装置により収集された外部音を、前記モード選択部が選択した前記再生モードのフェードイン速度で前記移動体の室内スピーカーから再生させるスピーカー制御部と、
    　を備える情報処理装置。     A first playback mode in which the external sound fades in at a first speed when starting playback of the external sound generated outside the moving body; and the external sound is faded at a second speed higher than the first speed. A mode selection unit that selects any one of the second playback modes to be turned on;
    A speaker control unit that reproduces the external sound collected by the sound collection device from the indoor speaker of the moving body at a fade-in speed of the reproduction mode selected by the mode selection unit;
    An information processing apparatus comprising:
  2. 　前記モード選択部は、前記移動体の位置情報を取得し、当該取得した位置情報に基づいて前記第１の再生モードまたは前記第２の再生モードのいずれかを選択する、
    　請求項１に記載の情報処理装置。     The mode selection unit acquires position information of the moving body, and selects either the first reproduction mode or the second reproduction mode based on the acquired position information.
    The information processing apparatus according to claim 1.
  3. 　前記モード選択部は、
    　　前記移動体の位置情報が第１特定エリア及び第２特定エリアのいずれかに対応する位置であるかを判定し、
    　　前記移動体の位置情報が前記第１特定エリアに対応する位置を示す場合、前記第１の再生モードを選択し、前記移動体の位置情報が前記第２特定エリアに対応する位置を示す場合、前記第２の再生モードを選択する、
    　請求項２に記載の情報処理装置。     The mode selection unit
    Determining whether the position information of the mobile body corresponds to either the first specific area or the second specific area;
    When the position information of the mobile object indicates a position corresponding to the first specific area, the first reproduction mode is selected, and when the position information of the mobile object indicates a position corresponding to the second specific area, Selecting the second playback mode;
    The information processing apparatus according to claim 2.
  4. 　前記第１特定エリアは、観光地、海、又は森林の周辺エリアであり、
    　前記第２特定エリアは、交通事故多発地点、見通しの悪い地点、人通りの多い地点、又は、学校施設や公園の周辺エリアである、
    　請求項３に記載の情報処理装置。     The first specific area is a tourist area, a sea, or a surrounding area of a forest,
    The second specific area is a traffic accident-prone point, a point with poor visibility, a point with a lot of traffic, or an area around a school facility or park,
    The information processing apparatus according to claim 3.
  5. 　前記モード選択部は、
    　　前記外部音の再生モードの選択操作を受け付けるスイッチを有し、
    　　前記スイッチで受け付けた選択操作に基づいて、前記第１の再生モードまたは前記第２の再生モードのいずれかを選択する、
    　請求項１に記載の情報処理装置。     The mode selection unit
    A switch for receiving an operation for selecting the reproduction mode of the external sound;
    Selecting either the first playback mode or the second playback mode based on the selection operation received by the switch;
    The information processing apparatus according to claim 1.
  6. 前記スピーカー制御部は、前記移動体の位置情報に基づいて、前記外部音の再生を開始するタイミングを制御する、
    　請求項１～５のいずれか１項に記載の情報処理装置。     The speaker control unit controls the timing to start the reproduction of the external sound based on the position information of the moving body.
    The information processing apparatus according to any one of claims 1 to 5.
  7. 　前記集音装置により収集された前記外部音をバッファリングするバッファと、
    　前記バッファにバッファリングされた前記外部音を解析する音解析部と、
    　を更に備え、
    　前記スピーカー制御部は、
    　　前記音解析部の解析結果に基づいて、特定の音源が検出されたか否かを判定し、
    　　前記特定の音源が検出されたタイミングに応じて、前記外部音の再生を開始する、
    　請求項１～５のいずれか１項に記載の情報処理装置。     A buffer for buffering the external sound collected by the sound collector;
    A sound analysis unit that analyzes the external sound buffered in the buffer;
    Further comprising
    The speaker control unit
    Based on the analysis result of the sound analysis unit, determine whether a specific sound source is detected,
    In response to the timing at which the specific sound source is detected, playback of the external sound is started.
    The information processing apparatus according to any one of claims 1 to 5.
  8. 　前記音解析部は、前記音源の種別を識別し、
    　前記モード選択部は、
    　　前記音解析部により識別された前記音源の種別が特定環境音である場合に、前記第１の再生モードを選択し、
    　　前記音解析部により識別された前記音源の種別が人または移動体である場合に、前記第２の再生モードを選択する、
    　請求項７に記載の情報処理装置。     The sound analysis unit identifies the type of the sound source,
    The mode selection unit
    When the type of the sound source identified by the sound analysis unit is a specific environmental sound, the first reproduction mode is selected,
    When the type of the sound source identified by the sound analysis unit is a person or a moving body, the second reproduction mode is selected.
    The information processing apparatus according to claim 7.
  9. 　コンピュータが、
    　移動体の外部で発生した外部音の再生開始時に前記外部音を第１の速度でフェードインさせる第１の再生モードと、前記第１の速度よりも速い第２の速度で前記外部音をフェードインさせる第２の再生モードのうちのいずれかの再生モードを選択する工程と、
    　集音装置により収集された外部音を、選択した前記再生モードのフェードイン速度で前記移動体の室内スピーカーから再生させる工程と、
    　を含む外部音再生方法。     Computer
    A first playback mode in which the external sound fades in at a first speed when starting playback of the external sound generated outside the moving body; and the external sound is faded at a second speed higher than the first speed. Selecting any one of the second playback modes to be turned on;
    Reproducing the external sound collected by the sound collecting device from the indoor speaker of the moving body at the fade-in speed of the selected reproduction mode;
    External sound playback method including.
  10. 　コンピュータを、
    　移動体の外部で発生した外部音の再生開始時に前記外部音を第１の速度でフェードインさせる第１の再生モードと、前記第１の速度よりも速い第２の速度で前記外部音をフェードインさせる第２の再生モードのうちのいずれかの再生モードを選択する手段、及び、
    　集音装置により収集された外部音を、選択した前記再生モードのフェードイン速度で前記移動体の室内スピーカーから再生させる手段、
    　として機能させるためのプログラム。     Computer
    A first playback mode in which the external sound fades in at a first speed when starting playback of the external sound generated outside the moving body; and the external sound is faded at a second speed higher than the first speed. Means for selecting any one of the second playback modes to be turned on; and
    Means for reproducing the external sound collected by the sound collecting device from the indoor speaker of the moving body at the fade-in speed of the selected reproduction mode;
    Program to function as.
  11. 　地図データのデータ構造であって、
    　前記地図データ上の位置情報と、
    　前記位置情報毎に設定され、集音装置により集音された外部音を移動体の室内スピーカーにより再生する際の再生モードを示す再生モード情報と、
    　を有するデータ構造。     A data structure of map data,
    Position information on the map data;
    Reproduction mode information indicating a reproduction mode when reproducing the external sound collected by the sound collection device by the indoor speaker of the moving body, set for each position information;
    A data structure with
PCT/JP2017/042843 2016-11-29 2017-11-29 Information processing device, external sound reproduction method, program, and data structure WO2018101341A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018554201A JP6799615B2 (en) 2016-11-29 2017-11-29 Information processing device, external sound reproduction method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016231039 2016-11-29
JP2016-231039 2016-11-29

Publications (1)

Publication Number Publication Date
WO2018101341A1 true WO2018101341A1 (en) 2018-06-07

Family

ID=62242440

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/042843 WO2018101341A1 (en) 2016-11-29 2017-11-29 Information processing device, external sound reproduction method, program, and data structure

Country Status (2)

Country Link
JP (1) JP6799615B2 (en)
WO (1) WO2018101341A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05305847A (en) * 1992-04-30 1993-11-19 Suzuki Motor Corp Sound volume control system for vehicle
WO2007032389A1 (en) * 2005-09-14 2007-03-22 Pioneer Corporation Sound volume control device, sound volume control method, sound volume control program, and computer-readable recording medium
JP2009051333A (en) * 2007-08-27 2009-03-12 Nissan Motor Co Ltd Acoustic sense monitoring device for vehicle
JP2011201406A (en) * 2010-03-25 2011-10-13 Denso It Laboratory Inc Outer-vehicle sound providing device, outer-vehicle sound providing method, and program

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3868390B2 (en) * 2003-04-03 2007-01-17 アルパイン株式会社 Source switching device
JP4285371B2 (en) * 2003-11-14 2009-06-24 株式会社デンソー Sound field control system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05305847A (en) * 1992-04-30 1993-11-19 Suzuki Motor Corp Sound volume control system for vehicle
WO2007032389A1 (en) * 2005-09-14 2007-03-22 Pioneer Corporation Sound volume control device, sound volume control method, sound volume control program, and computer-readable recording medium
JP2009051333A (en) * 2007-08-27 2009-03-12 Nissan Motor Co Ltd Acoustic sense monitoring device for vehicle
JP2011201406A (en) * 2010-03-25 2011-10-13 Denso It Laboratory Inc Outer-vehicle sound providing device, outer-vehicle sound providing method, and program

Also Published As

Publication number Publication date
JPWO2018101341A1 (en) 2019-10-24
JP6799615B2 (en) 2020-12-16

Similar Documents

Publication Publication Date Title
US10214145B2 (en) Vehicle control device and vehicle control method thereof
EP3280162A1 (en) A system for and a method of generating sound
CN109147815B (en) System and method for selective volume adjustment in a vehicle
US20150365743A1 (en) Method and apparatus for including sound from an external environment into a vehicle audio system
JP5395716B2 (en) Outside sound providing device, outside sound providing method and program
US11485231B2 (en) Systems and methods for providing nature sounds
JP4622991B2 (en) Volume control device for car audio system
KR102526081B1 (en) Vehicle and method for controlling thereof
US20210380055A1 (en) Vehicular independent sound field forming device and vehicular independent sound field forming method
WO2020120754A1 (en) Audio processing device, audio processing method and computer program thereof
JP7040513B2 (en) Information processing equipment, information processing method and recording medium
US20210345043A1 (en) Systems and methods for external environment sensing and rendering
JP2010089617A (en) Onboard audio device
WO2018079527A1 (en) Control device, output method and program
KR101487474B1 (en) Simulation sound generation apparatus of vehicle and simulation sound generation method of vehicle using the same
CN110830885B (en) System and method for vehicle audio source input channels
JP6799615B2 (en) Information processing device, external sound reproduction method, and program
KR20210096879A (en) Vehicle and method for controlling thereof
JP2022518135A (en) Acoustic augmented reality system for in-car headphones
CN113939858A (en) Automatic driving assistance device, automatic driving assistance system, and automatic driving assistance method
CN110139205B (en) Method and device for auxiliary information presentation
JP2004348895A (en) Onboard reproducing device and its control method, and control program and recording medium
WO2018139650A1 (en) Audio control device, audio control method, and program
JP4867624B2 (en) Audio output control device and vehicle navigation device
JP2018176949A (en) Vehicle approaching sound control device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17877119

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018554201

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17877119

Country of ref document: EP

Kind code of ref document: A1