JP2008236448A - Sound signal processing device, hands-free calling device, sound signal processing method, and control program - Google Patents

Sound signal processing device, hands-free calling device, sound signal processing method, and control program Download PDF

Info

Publication number
JP2008236448A
JP2008236448A JP2007073939A JP2007073939A JP2008236448A JP 2008236448 A JP2008236448 A JP 2008236448A JP 2007073939 A JP2007073939 A JP 2007073939A JP 2007073939 A JP2007073939 A JP 2007073939A JP 2008236448 A JP2008236448 A JP 2008236448A
Authority
JP
Japan
Prior art keywords
noise
signal processing
audio signal
unit
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2007073939A
Other languages
Japanese (ja)
Inventor
Seiichi Suzuki
誠一 鈴木
Hiroshige Kogori
弘滋 古郡
Takashi Takayama
隆 高山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faurecia Clarion Electronics Co Ltd
Original Assignee
Clarion Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Clarion Co Ltd filed Critical Clarion Co Ltd
Priority to JP2007073939A priority Critical patent/JP2008236448A/en
Publication of JP2008236448A publication Critical patent/JP2008236448A/en
Pending legal-status Critical Current

Links

Images

Abstract

<P>PROBLEM TO BE SOLVED: To properly perform sound signal processing according to the kind of noise, combination of noise components, and quantity of noise. <P>SOLUTION: The sound signal processing device includes a sound signal input part 12 in which a sound signal is input; a signal processing part 15 for performing signal processing on the sound signal; and a state signal input part 16, in which a state signal indicating a state of a vehicle 100 is input, and the device further includes a control part 18 which determines present or absence of the noise contained in the sound signal, based on the state signal for each kind of the noise, refers to a parameter setting table with which a parameter used at the signal processing is associated for each kind of the noise so as to set a parameter corresponding to the kind or the combination of the noise included in the sound signal to be a parameter value that corresponds to the quantity of the noise and controls the signal processing part 15 to perform the sinal processing, based on the parameter value. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

本発明は、車両内で収音された音声信号等に含まれるノイズを除去するための音声信号処理装置、ハンズフリー通話装置、音声信号処理方法および制御プログラムに関する。   The present invention relates to an audio signal processing device, a hands-free call device, an audio signal processing method, and a control program for removing noise contained in an audio signal or the like collected in a vehicle.

従来から、車載用のオーディオ装置の中には、車両の走行状態や、車両内の騒音レベルに基づいて、最適な音量ゲインを設定することにより乗員に対して最適な音量でオーディオ出力等を行う音量調整装置を備えるものが知られている(例えば、特許文献1参照)。
また、自動車等の車両内において、ユーザが携帯電話機を把持せずとも、携帯電話機を使用していわゆるハンズフリー通話を可能とするハンズフリー通話装置が知られている(例えば、特許文献2参照)。ハンズフリー通話装置を据置型のマイクロフォンや拡声装置を用いて構成する場合、通話時の音質は、走行時に生じる車両の走行音、エアコンの運転等に伴う空調音等のノイズによる影響を受けやすい。このため、この種のハンズフリー通話装置の中には、通話音質を向上するために、マイクロフォンにより取得された音声信号に対してノイズを除去すべく音声信号処理を行うようにしたものがある。
特開平10−173458号公報 特開平10−276261号公報
Conventionally, some in-vehicle audio devices perform audio output at an optimum volume for the occupant by setting an optimum volume gain based on the running state of the vehicle and the noise level in the vehicle. One having a volume control device is known (for example, see Patent Document 1).
There is also known a hands-free call device that enables a so-called hands-free call using a mobile phone without the user holding the mobile phone in a vehicle such as an automobile (see, for example, Patent Document 2). . When a hands-free call device is configured using a stationary microphone or a loudspeaker, the sound quality during a call is easily affected by noise such as the running sound of a vehicle generated during traveling and the air-conditioning sound associated with the operation of an air conditioner. For this reason, some hands-free call devices of this type perform voice signal processing to remove noise from a voice signal acquired by a microphone in order to improve call sound quality.
JP-A-10-173458 JP 10-276261 A

ところで、音声信号に含まれるノイズを除去するには、ノイズの量に加えて、ノイズの種類に応じた適切なパラメータ値を用いて音声信号処理を行う必要がある。しかしながら、上記従来の音量調整装置のように、車両内の騒音レベルをマイクロフォンを用いて判別し、判別された騒音レベルに基づいて音声信号処理を行う構成とすると、騒音レベルは判別することができるものの、ノイズの種類を特定することはできず、ノイズの種類に応じた適切なパラメータ値を設定することが困難であった。
すなわち、車両の走行音に起因するノイズと、空調音に起因するノイズとでは、ノイズの特性が異なり、単にノイズ量に基づいて音声信号処理を行ったのでは、所望の音質に調整することが困難であった。
本発明の課題は、ノイズの種類又はノイズ成分の組み合わせとノイズの量に応じて適切に音声信号処理を施すことのできる音声信号処理装置、ハンズフリー通話装置、音声信号処理方法および制御プログラムを提供することにある。
By the way, in order to remove noise contained in the audio signal, it is necessary to perform audio signal processing using an appropriate parameter value corresponding to the type of noise in addition to the amount of noise. However, the noise level can be determined if the configuration is such that the noise level in the vehicle is determined using a microphone and the audio signal processing is performed based on the determined noise level, as in the conventional volume control device. However, the noise type cannot be specified, and it is difficult to set an appropriate parameter value according to the noise type.
That is, the noise characteristics of the noise caused by the running sound of the vehicle and the noise caused by the air-conditioning sound are different, and if the audio signal processing is simply performed based on the noise amount, it can be adjusted to a desired sound quality. It was difficult.
An object of the present invention is to provide an audio signal processing device, a hands-free call device, an audio signal processing method, and a control program capable of appropriately performing audio signal processing according to the type of noise or a combination of noise components and the amount of noise. There is to do.

上記課題を解決するため、本発明の音声信号処理装置は、車両内で収音された音声に基づく音声信号が入力される音声信号入力部と、設定されたパラメータ値に基づいて、前記音声信号に含まれるノイズを除去すべく前記音声信号に対して信号処理を施す信号処理部と、外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、前記状態信号に基づき、前記音声信号に含まれるノイズの有無をノイズの種類毎に判別するノイズ判別部と、各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させるように制御する制御部と、を備えることを特徴とする。
上記構成によれば、車両内で収音された音声に基づく音声信号が音声信号入力部を介して入力される。信号処理部では、この音声信号に対して、設定されたパラメータ値に基づいて、前記音声信号に含まれるノイズを除去すべく信号処理を施す。ノイズ判別部は、状態信号入力部を介して入力された車両の状態を示す状態信号に基づき、前記音声信号に含まれるノイズの有無をノイズの種類毎に判別する。制御部は、記憶部に記憶されたパラメータ設定テーブルを参照して、ノイズの種類又はノイズ成分の組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させるように制御する。従って、車両内で収音された音声信号に含まれるノイズの種類が車両の走行/停止等に伴って変動した場合であっても、ノイズの種類又はノイズ成分の組み合わせとノイズの量に応じて適切に音声信号処理を施すことができる。
In order to solve the above problems, an audio signal processing device according to the present invention includes an audio signal input unit that receives an audio signal based on audio collected in a vehicle, and the audio signal based on a set parameter value. Based on the state signal, a signal processing unit that performs signal processing on the audio signal to remove noise included in the sound signal, a state signal input unit that receives a state signal that indicates the state of the vehicle from the outside, A noise determination unit that determines the presence or absence of noise included in an audio signal for each type of noise, a storage unit that stores a parameter setting table that associates parameters used in the signal processing for each type of noise, and According to the type of noise or the combination of noise components determined by the noise determination unit, referring to the parameter setting table, according to the type or combination of noise By setting the parameter to the parameter value corresponding to the amount of noise, based on the parameter values, characterized in that it comprises a control unit for controlling such that subjected to the signal processing in the signal processing unit.
According to the above configuration, the audio signal based on the sound collected in the vehicle is input via the audio signal input unit. The signal processing unit performs signal processing on the audio signal based on the set parameter value so as to remove noise included in the audio signal. The noise discriminating unit discriminates the presence or absence of noise included in the audio signal for each type of noise based on the state signal indicating the state of the vehicle input via the state signal input unit. The control unit refers to the parameter setting table stored in the storage unit, sets a parameter according to the type of noise or a combination of noise components to a parameter value according to the amount of noise, and based on the parameter value, The signal processing unit is controlled to perform the signal processing. Therefore, even if the type of noise included in the audio signal collected in the vehicle fluctuates as the vehicle travels / stops, etc., depending on the type of noise or the combination of noise components and the amount of noise Audio signal processing can be performed appropriately.

上記構成の音声信号処理装置において、前記状態信号入力部には、前記状態信号として、少なくとも前記車両の走行状態を示す状態信号と、前記車両内に設置された空気調和装置の空気調和運転状態を示す状態信号との入力を受け、前記ノイズの種類には、前記車両の走行に起因するノイズと、前記空気調和装置の空気調和運転に起因するノイズとを含むことが好ましい。
上記構成によれば、状態信号入力部は、車両の走行状態を示す状態信号と、車両内に設置された空気調和装置の空気調和運転状態を示す状態信号との入力を受け、ノイズの種類として、車両の走行に起因するノイズと、空気調和装置の空気調和運転に起因するノイズとに応じて、それぞれノイズの種類とノイズの量に応じて適切に音声信号処理を施すことができる。また、例えば、空調運転時に車両が走行状態から停止状態となった場合に、音声信号に含まれるノイズから空気調和装置に起因するノイズだけになった場合でも、ノイズの種類の変化(ノイズ成分の組み合わせの変化)に応じて、適切に音声信号処理を施すことができる。
In the audio signal processing device having the above-described configuration, the state signal input unit includes at least a state signal indicating a traveling state of the vehicle and an air-conditioning operation state of the air-conditioning apparatus installed in the vehicle as the state signal. Preferably, the type of noise includes noise caused by running of the vehicle and noise caused by air conditioning operation of the air conditioner.
According to the above configuration, the state signal input unit receives an input of a state signal indicating the running state of the vehicle and a state signal indicating the air-conditioning operation state of the air conditioner installed in the vehicle. According to the noise caused by the running of the vehicle and the noise caused by the air-conditioning operation of the air conditioner, the audio signal processing can be appropriately performed according to the type of noise and the amount of noise. In addition, for example, when the vehicle is stopped from the running state during the air-conditioning operation, even if only the noise caused by the air conditioner is changed from the noise included in the audio signal, the change in the noise type (the noise component) Audio signal processing can be appropriately performed according to the change in the combination.

また、上記構成の音声信号処理装置において、前記状態信号入力部には、前記状態信号として、窓の開閉量を示す信号の入力を受け、前記ノイズの種類には、風切り音に起因するノイズを含むことが好ましい。
当該構成によれば、窓の開閉量により変化する風切り音に起因するノイズについても、適切に音声信号処理を施すことができる。
In the audio signal processing device having the above configuration, the state signal input unit receives a signal indicating a window opening / closing amount as the state signal, and the noise type includes noise caused by wind noise. It is preferable to include.
According to this configuration, it is possible to appropriately perform audio signal processing on noise caused by wind noise that varies depending on the opening / closing amount of the window.

また、上記構成の音声信号処理装置において、前記状態信号入力部には、前記状態信号として、ワイパー速度を示す信号の入力を受け、前記ノイズの種類には、ワイパーの動作に起因するノイズ又は雨音に起因するノイズを含むことが好ましい。
当該構成によれば、ワイパー速度により変化するワイパーの動作に起因するノイズについても適切に音声信号処理を施すことができる。また、周囲の雨音の有無や雨音の大きさ等をワイパー速度により推定して、雨音の大きさに応じて、適切に音声信号処理を施すことができる。
In the audio signal processing apparatus having the above configuration, the state signal input unit receives a signal indicating a wiper speed as the state signal, and the noise type includes noise or rain caused by the operation of the wiper. It is preferable to include noise caused by sound.
According to this configuration, it is possible to appropriately perform audio signal processing on noise caused by the operation of the wiper that changes depending on the wiper speed. In addition, the presence or absence of the surrounding rain sound, the magnitude of the rain sound, and the like can be estimated from the wiper speed, and the sound signal processing can be appropriately performed according to the magnitude of the rain sound.

また、上記構成の音声信号処理装置において、前記制御部は、前記音声信号に含まれるノイズの種類又はノイズ成分の組み合わせが変化した場合、変化後のノイズの種類又はノイズ成分の組み合わせに応じたパラメータを変化後のノイズ量に応じて新たなパラメータ値に設定するまでの間は、変化前に設定されたパラメータ値に基づいて、前記信号処理部に前記信号処理を施させることが好ましい。
この構成によれば、制御部は、信号処理の際に用いるパラメータ値をノイズの種類やノイズの変化の種類に応じて切り換える際に、新たなパラメータ値を設定するまでの間は、変化前に設定されたパラメータ値に基づいて、信号処理部に信号処理を施させるので、ノイズの種類の変化やノイズ成分の組み合わせの変化に応じてリアルタイムにパラメータ値を変更する場合に比較して、異音が発生する等の不具合が生じるのを防ぐことができる。
Further, in the audio signal processing device having the above configuration, when the type of noise or the combination of noise components included in the audio signal changes, the control unit determines a parameter according to the type of noise or the combination of noise components after the change. It is preferable that the signal processing unit perform the signal processing based on the parameter value set before the change until the parameter value is set to a new parameter value according to the noise amount after the change.
According to this configuration, when the parameter value used for signal processing is switched according to the type of noise or the type of change in noise, the control unit does not change until a new parameter value is set. Since the signal processing unit performs signal processing based on the set parameter value, compared with the case where the parameter value is changed in real time according to the change in the type of noise or the change in the combination of noise components, It is possible to prevent the occurrence of problems such as

また、本発明の音声信号処理装置は、音源装置から車両内に拡声するための音響信号が入力される音響信号入力部と、設定されたパラメータ値に基づいて、前記音響信号に対して音質を調整すべく信号処理を施す信号処理部と、外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、前記状態信号に基づき、車両内のノイズの有無をノイズの種類毎に判別するノイズ判別部と、各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させるように制御する制御部と、を備えることを特徴とする。
この構成によれば、例えば、車載オーディオ装置等の様に、CD再生装置やラジオチューナ等の音源装置から入力される音響信号(音声信号)を車両内に設置された拡声装置を介して拡声する際に、車両内に拡声する音響信号の音質を車両内のノイズの種類又はノイズ成分の組み合わせとノイズの量に応じて適切に音響信号処理を施して、音質を調整することができる。
Further, the audio signal processing device of the present invention has an audio signal input unit to which an audio signal for amplifying the sound from the sound source device into the vehicle is input, and a sound quality for the audio signal based on a set parameter value. A signal processing unit that performs signal processing to adjust, a state signal input unit that receives a state signal indicating the state of the vehicle from the outside, and the presence or absence of noise in the vehicle based on the state signal for each type of noise A noise discriminating unit that discriminates, a storage unit that stores a parameter setting table in which a parameter used in the signal processing is associated with each noise type, and a noise type or a noise component discriminated by the noise discriminating unit Depending on the combination, referring to the parameter setting table, the parameter corresponding to the noise type or combination is set to a parameter value corresponding to the amount of noise. Based on the parameter values, characterized in that it comprises a control unit for controlling such that subjected to the signal processing in the signal processing unit.
According to this configuration, for example, a sound signal (audio signal) input from a sound source device such as a CD playback device or a radio tuner is amplified via a loudspeaker installed in the vehicle, such as an in-vehicle audio device. In this case, the sound quality of the sound signal that is amplified in the vehicle can be adjusted by appropriately performing sound signal processing according to the type of noise in the vehicle or the combination of noise components and the amount of noise.

また、本発明のハンズフリー通話装置は、音声を収音して音声信号に変換する収音部と、携帯電話端末と所定の通信プロトコルに従って、前記音声信号を送信するとともに前記携帯電話端末から音声信号を受信する通信部と、前記通信部において受信した音声信号を出力する出力部とを備え、前記携帯電話端末をハンズフリーで通話可能とするハンズフリー通話装置において、設定されたパラメータ値に基づいて、前記音声信号に対して音質を調整すべく信号処理を施す信号処理部と、外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、前記状態信号に基づき、前記車両内のノイズの有無をノイズの種類毎に判別するノイズ判別部と、各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させるように制御する制御部と、を備えることを特徴とする。   The hands-free call device according to the present invention also includes a sound collection unit that collects voice and converts it into a voice signal, and transmits the voice signal according to a predetermined communication protocol with the mobile phone terminal and transmits voice from the mobile phone terminal. In a hands-free call device that includes a communication unit that receives a signal and an output unit that outputs an audio signal received in the communication unit, and enables the mobile phone terminal to perform a hands-free call, based on a set parameter value A signal processing unit that performs signal processing on the audio signal to adjust sound quality, a state signal input unit that receives a state signal indicating the state of the vehicle from the outside, and the vehicle based on the state signal. A parameter setting in which a noise discrimination unit for discriminating the presence or absence of noise in each noise type and a parameter used in the signal processing for each noise type are associated with each other. A storage unit that stores a table and a parameter corresponding to the noise type or combination by referring to the parameter setting table according to a noise type or a combination of noise components determined by the noise determination unit. And a control unit that controls the signal processing unit to perform the signal processing based on the parameter value.

また、本発明の音声信号処理方法は、車両内で収音された音声に基づく音声信号が入力される音声信号入力部と、設定されたパラメータ値に基づいて、前記音声信号に対して信号処理を施す信号処理部と、外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、を備えた音声信号処理装置を用いて前記音声信号に含まれるノイズを除去すべく前記音声信号に対して信号処理を施す音声信号処理方法であって、前記状態信号に基づき、前記音声信号に含まれるノイズの有無をノイズの種類毎に判別する過程と、前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定する過程と、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させる過程と、を備えることを特徴とする。   Also, the audio signal processing method of the present invention includes an audio signal input unit to which an audio signal based on audio collected in a vehicle is input, and signal processing for the audio signal based on a set parameter value. A signal processing unit for performing the processing, a state signal input unit for inputting a state signal indicating the state of the vehicle from the outside, and a parameter setting table in which parameters used for the signal processing are associated with each noise type An audio signal processing method for performing signal processing on the audio signal to remove noise included in the audio signal using an audio signal processing device including a storage unit, and based on the status signal, According to the process of determining the presence or absence of noise included in the audio signal for each type of noise, and the combination of noise type or noise component determined by the noise determination unit. A process for setting a parameter corresponding to the noise type or combination to a parameter value corresponding to the amount of noise with reference to a data setting table, and performing the signal processing on the signal processing unit based on the parameter value. And the process of making it comprise.

また、本発明の制御プログラムは、車両内で収音された音声に基づく音声信号が入力される音声信号入力部と、設定されたパラメータ値に基づいて、前記音声信号に含まれるノイズを除去すべく前記音声信号に対して信号処理を施す信号処理部と、外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、を備えた音声信号処理装置をコンピュータを用いて制御するための制御プログラムであって、前記状態信号に基づき、前記音声信号に含まれるノイズの有無をノイズの種類毎に判別させ、前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定させ、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させること、を特徴とする。   Further, the control program of the present invention removes noise included in the audio signal based on the audio signal input unit to which an audio signal based on the audio collected in the vehicle is input and the set parameter value. Therefore, a signal processing unit that performs signal processing on the audio signal, a state signal input unit that receives a state signal indicating the state of the vehicle from the outside, and a parameter that is used for the signal processing for each type of noise And a storage unit for storing a parameter setting table in association with each other, and a control program for controlling the audio signal processing device using a computer, based on the state signal, the noise of the audio signal Presence / absence is determined for each type of noise, and the parameter setting table is selected according to the type of noise or the combination of noise components determined by the noise determination unit. The parameter according to the noise type or combination is set to a parameter value according to the amount of noise, and the signal processing unit is configured to perform the signal processing based on the parameter value. To do.

本発明によれば、車両内のノイズが車両の走行/停止等に伴って変動した場合であっても、ノイズの種類又はノイズ成分の組み合わせとノイズの量に応じて適切に音声信号処理を施すことができる。   According to the present invention, even when the noise in the vehicle fluctuates with the running / stop of the vehicle, etc., the audio signal processing is appropriately performed according to the type of noise or the combination of noise components and the amount of noise. be able to.

以下、図面を参照して本発明の実施の形態について説明する。
図1に示すように、本実施の形態に係る音声信号処理装置、ハンズフリー通話装置は、自動車等の車両100に搭載される車載機器10として構成され、当該車両100を運転する運転者や同乗者が所有する携帯電話機20(携帯電話端末)20と所定の通信プロトコルに従って通信を行い、これらの携帯電話機20に対してハンズフリー通話を可能にする装置である。
Embodiments of the present invention will be described below with reference to the drawings.
As shown in FIG. 1, the audio signal processing device and the hands-free call device according to the present embodiment are configured as an in-vehicle device 10 mounted on a vehicle 100 such as an automobile, and a driver or a rider who drives the vehicle 100. This is a device that communicates with a mobile phone 20 (mobile phone terminal) 20 owned by a person according to a predetermined communication protocol, and enables hands-free communication with these mobile phones 20.

車載機器10と携帯電話機20との間は、例えば、近距離無線通信の一つであるBluetooth(登録商標、以下同じ)を用いて、無線通信により音声信号の送受信を行うことができる。なお、近距離無線通信として無線LANを用いる構成としても良く、また、無線通信に限らず、有線通信であっても良いが本実施の形態では無線通信を行うものとして以下説明する。   Audio signals can be transmitted and received between the in-vehicle device 10 and the mobile phone 20 by wireless communication using, for example, Bluetooth (registered trademark, the same applies hereinafter), which is one of short-range wireless communication. Note that a configuration using a wireless LAN as short-range wireless communication may be used, and not limited to wireless communication, but may be wired communication. In the present embodiment, the following description will be made assuming that wireless communication is performed.

図2は、上記車載機器10の機能的構成を、携帯電話機20と共に示すブロック図である。携帯電話機20は、図示しない移動通信網を介して携帯端末キャリアを受信或いは送信して、他の携帯端末や固定電話と通話通信するものであり、内蔵拡声装置や内蔵マイク、電話通信のための通信部、音声通信やデータ通信のための通信端子といった一般的な携帯電話機20が有する構成を備えると共に、車載機器10と上述した所定のプロトコルに従って近距離無線通信するための近距離無線通信用の通信モジュール(例えば、Bluetoothモジュール)(図示略)を備えている。   FIG. 2 is a block diagram showing a functional configuration of the in-vehicle device 10 together with the mobile phone 20. The mobile phone 20 receives or transmits a mobile terminal carrier via a mobile communication network (not shown), and communicates with other mobile terminals and landline telephones. The mobile phone 20 has a configuration such as a communication unit, a communication terminal for voice communication and data communication, and is used for short-range wireless communication for short-range wireless communication with the in-vehicle device 10 according to the predetermined protocol described above. A communication module (for example, a Bluetooth module) (not shown) is provided.

一方、車載機器10は、収音装置(収音部)30、音源装置40、拡声装置50と接続され、図2に示すように、携帯電話機20との間で音声信号の送受を行う近距離無線通信部11と、収音装置30において収音された音声信号の入力を受ける音声信号入力部12と、音源装置40から音響信号の入力を受ける音響信号入力部13と、携帯電話機20から受信した音声信号又は音源装置40から入力された音響信号(音声信号)を拡声装置50に出力する音声信号出力部14と、これらの音声信号(音響信号を含む)に対して音質を調整すべく信号処理を施す信号処理部15と、車両100の各種状態を示す状態信号の入力を受ける状態信号入力部16と、ノイズの種類又はノイズ成分の組み合わせ毎に信号処理部15において用いられるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部17と、制御部18とを備えている。   On the other hand, the in-vehicle device 10 is connected to a sound collection device (sound collection unit) 30, a sound source device 40, and a loudspeaker device 50, and transmits and receives audio signals to and from the mobile phone 20, as shown in FIG. Radio communication unit 11, audio signal input unit 12 that receives an input of an audio signal collected by sound collection device 30, acoustic signal input unit 13 that receives an input of an acoustic signal from sound source device 40, and reception from mobile phone 20 The audio signal output unit 14 that outputs the audio signal or the audio signal (audio signal) input from the sound source device 40 to the loudspeaker 50 and a signal for adjusting the sound quality of these audio signals (including the audio signal) The signal processing unit 15 that performs processing, the state signal input unit 16 that receives input of state signals indicating various states of the vehicle 100, and the signal processing unit 15 for each type of noise or combination of noise components. A storage unit 17 for storing the parameter setting table correlating parameters, and a control unit 18.

近距離無線通信部11は、制御部18の制御の下、車両100内の携帯電話機20と所定の通信プロトコルに従って近距離無線通信を行うものであり、携帯電話機20に着信があった場合に送信される着信トリガ信号を受信して、制御部18に出力し、携帯電話機20から送信された受話音声(音声信号)を受信して、信号処理部15に出力するとともに、収音装置30、音声信号入力部12、信号処理部15を介して送話音声(音声信号)の入力を受け、この送話音声を携帯電話機20に送信するものである。例えば、所定の通信プロトコルとして上述したBluetoothプロトコルに従う場合、Bluetoothモジュールを用いて構成することができる。   The near field communication unit 11 performs near field communication with the mobile phone 20 in the vehicle 100 in accordance with a predetermined communication protocol under the control of the control unit 18 and is transmitted when the mobile phone 20 receives an incoming call. The incoming call trigger signal is received and output to the control unit 18, the received voice (audio signal) transmitted from the mobile phone 20 is received and output to the signal processing unit 15, and the sound collection device 30, the voice A voice signal (voice signal) is input via the signal input unit 12 and the signal processing unit 15, and the voice signal is transmitted to the mobile phone 20. For example, when following the above-described Bluetooth protocol as a predetermined communication protocol, it can be configured using a Bluetooth module.

なお、当該車載機器10と携帯電話機20とを有線にて接続可能とする場合には、車載機器10に通信ケーブルが接続される通信I/F(インターフェース)を設け、当該通信I/Fを介して携帯電話機20と受話音声、送話音声及び各種制御コマンドを送受する構成とすれば良い。   When the in-vehicle device 10 and the mobile phone 20 can be connected by wire, a communication I / F (interface) to which a communication cable is connected is provided in the in-vehicle device 10, and the communication I / F is connected via the communication I / F. The mobile phone 20 may be configured to transmit and receive received voice, transmitted voice, and various control commands.

収音装置30は、車両100内に配置される据置型のマイクロフォンであり、無指向性の小型マイクを用いて構成される。収音装置30では、話者(運転者や搭乗者等)が発話した音声をアナログの音声信号に変換して、上記音声信号入力部12に音声信号を出力する。   The sound collection device 30 is a stationary microphone disposed in the vehicle 100, and is configured using a small omnidirectional microphone. The sound collection device 30 converts the voice uttered by a speaker (driver, passenger, etc.) into an analog voice signal and outputs the voice signal to the voice signal input unit 12.

音声信号入力部12は、図示しない制御線を介して制御部18と接続され、制御部18の制御下で動作する。音声信号入力部12は、図示しないゲイン調整回路等を備え、制御部18により設定されるマイクゲイン値に従って、収音装置30から出力される音声信号の増幅等を行うものである。音声信号入力部12において増幅等が行われた音声信号は信号処理部15に出力される。   The audio signal input unit 12 is connected to the control unit 18 via a control line (not shown) and operates under the control of the control unit 18. The audio signal input unit 12 includes a gain adjustment circuit (not shown) and the like, and amplifies an audio signal output from the sound collection device 30 in accordance with a microphone gain value set by the control unit 18. The audio signal that has been amplified by the audio signal input unit 12 is output to the signal processing unit 15.

音源装置40は、例えば、CDDA(Compact Disc Digital Audio:音楽CD)を再生するCD再生装置、DVD(Digital Versatile Disk)を再生するDVD再生装置、ラジオ放送を受信するラジオ受信装置等を用いて構成することができる。音源装置40は、図示しない制御線を介して、制御部18との間で各種制御信号の送受を行い、制御部18の制御の下、所定の音響信号を音響信号入力部13に出力する。
音響信号入力部13は、図示しない制御線を介して、制御部18と接続され、制御部18の制御の下、音源装置40において再生された音響信号の入力を受ける。この音響信号入力部13に入力された音響信号は信号処理部15に出力される。
The sound source device 40 is configured using, for example, a CD playback device that plays a CDDA (Compact Disc Digital Audio: music CD), a DVD playback device that plays a DVD (Digital Versatile Disk), a radio reception device that receives a radio broadcast, and the like. can do. The sound source device 40 transmits and receives various control signals to and from the control unit 18 via a control line (not shown), and outputs a predetermined acoustic signal to the acoustic signal input unit 13 under the control of the control unit 18.
The acoustic signal input unit 13 is connected to the control unit 18 via a control line (not shown), and receives an input of an acoustic signal reproduced in the sound source device 40 under the control of the control unit 18. The acoustic signal input to the acoustic signal input unit 13 is output to the signal processing unit 15.

音声信号出力部14は、図示しない制御線を介して、制御部18と接続され、制御部18の制御の下、信号処理部15を介して近距離無線通信部11又は音源装置40から出力される音声信号(音響信号を含む)を、車両100内に設置される一又は複数の拡声装置50に対して出力するものである。
拡声装置50は、音声信号を音波に変換するスピーカであり、音声信号出力部14は信号処理部15から出力されるデジタル信号としての音声信号をアナログ信号に変換するD/Aコンバータ(図示略)や、アナログ信号に変換された音声信号を増幅するアンプ(図示略)等を備えている。
The audio signal output unit 14 is connected to the control unit 18 through a control line (not shown), and is output from the short-range wireless communication unit 11 or the sound source device 40 through the signal processing unit 15 under the control of the control unit 18. Audio signals (including acoustic signals) are output to one or a plurality of loudspeakers 50 installed in the vehicle 100.
The loudspeaker 50 is a speaker that converts an audio signal into a sound wave, and the audio signal output unit 14 is a D / A converter (not shown) that converts an audio signal as a digital signal output from the signal processing unit 15 into an analog signal. And an amplifier (not shown) for amplifying an audio signal converted into an analog signal.

信号処理部15は、制御部18の制御の下、収音装置30から音声信号入力部12を介して入力される音声信号または、携帯電話機20または音源装置40から、近距離無線通信部11又は音響信号入力部13を介して入力される音声信号(音響信号を含む)に対して、音質を所定の状態に調整するための信号処理を施すものである。
具体的には、信号処理部15はいわゆるエコーキャンセラ装置やノイズリダクション装置を備え、音声信号出力部14において拡声再生された音声が収音装置30により収音されたり、車両100の走行音(エンジンノイズ、ロードノイズ等)、空気調和装置の空調音、風切り音、雨天時等に生じるワイパーの動作音、あるいは雨音などが収音されたりすることにより音声信号に含まれるエコー成分やノイズ成分を除去あるいは低減するための信号処理を音声信号に対して施す。音声信号に対して信号処理を施す際に、信号処理部15は制御部18により設定されるパラメータ値に基づいて信号処理を施す。
Under the control of the control unit 18, the signal processing unit 15 receives an audio signal input from the sound collection device 30 via the audio signal input unit 12, or the short-range wireless communication unit 11 or the mobile phone 20 or the sound source device 40. Signal processing for adjusting the sound quality to a predetermined state is performed on an audio signal (including an acoustic signal) input via the acoustic signal input unit 13.
Specifically, the signal processing unit 15 includes a so-called echo canceller device or noise reduction device, and the sound reproduced and reproduced by the sound signal output unit 14 is collected by the sound collecting device 30 or the running sound (engine) of the vehicle 100 is collected. Noise, road noise, etc.), air-conditioning sound of air conditioner, wind noise, wiper operation sound generated in rainy weather, etc. Signal processing for removal or reduction is performed on the audio signal. When performing signal processing on the audio signal, the signal processing unit 15 performs signal processing based on the parameter value set by the control unit 18.

状態信号入力部16は、制御部18においてノイズの有無をノイズの種類毎に判別するために用いる車両100の各種状態を示す状態信号の入力を受けるものである。
車両100の各種状態を示す状態信号として、例えば、車両100の走行状態を示す走行状態信号、車両100内に設置された空気調和装置の空気調和運転状態を示す空調運転状態信号、ワイパー速度等を示すワイパー状態信号、窓の開閉量を示す窓開閉状態信号等がある。これらの車両100の各種状態を示す状態信号は、車両100の各種制御を行う制御装置等から入力を受ける構成とすることができる。
The state signal input unit 16 receives input of state signals indicating various states of the vehicle 100 used for the control unit 18 to determine the presence or absence of noise for each type of noise.
Examples of the state signal indicating various states of the vehicle 100 include a traveling state signal indicating the traveling state of the vehicle 100, an air conditioning operation state signal indicating the air conditioning operation state of the air conditioner installed in the vehicle 100, a wiper speed, and the like. A wiper state signal indicating the window opening / closing state signal indicating a window opening / closing amount. The state signals indicating the various states of the vehicle 100 can be configured to receive input from a control device or the like that performs various controls of the vehicle 100.

具体的には、走行状態信号として車速パルス、エンジンの回転数を示す信号、加速度を示す信号等を車両100の各種制御を行う制御装置から入力を受ける構成とすることができる。また、車載機器10がカーナビゲーション装置である場合、あるいはカーナビゲーション装置が車載機器10とは別に車両100に設置されている場合、カーナビゲーション装置から走行している道路が一般道路か高速道路かの別を示す信号等の入力を受ける構成とすることができる。これらの走行状態信号の入力に基づいて、制御部18では、車両100が走行中であるか停車中であるかを判別することができ、車両100の走行に起因するノイズ(ロードノイズ、エンジンノイズ等)の有無や、車両100の走行速度や走行している道路の種別等によって変化するノイズ量を判別(演算)することができる。   Specifically, a vehicle speed pulse, a signal indicating the number of revolutions of the engine, a signal indicating acceleration, and the like can be received from the control device that performs various controls of the vehicle 100 as the driving state signal. When the in-vehicle device 10 is a car navigation device, or when the car navigation device is installed in the vehicle 100 separately from the in-vehicle device 10, whether the road running from the car navigation device is a general road or a highway. It can be configured to receive an input of a signal indicating another. Based on the input of these running state signals, the control unit 18 can determine whether the vehicle 100 is running or stopped, and noise (road noise, engine noise) caused by the running of the vehicle 100. Etc.), the amount of noise that varies depending on the traveling speed of the vehicle 100, the type of road on which the vehicle is traveling, and the like can be determined (calculated).

また、空調運転状態信号として、例えば、車両100に設置された空気調和装置を制御する制御装置から、空調運転の有無や空調時の風量の設定情報等の入力を受ける構成とすることができる。これらの空調運転状態信号の入力に基づいて、制御部18では、空気調和装置が空調運転を行っているか否かに基づいて、空気調和装置の空調運転に起因するノイズの有無や、風量等によって変化するノイズ量を判別(演算)することができる。   Further, as the air conditioning operation state signal, for example, it is possible to receive input from the control device that controls the air conditioner installed in the vehicle 100, such as the presence / absence of the air conditioning operation and the setting information of the air volume during air conditioning. Based on the input of these air conditioning operation state signals, the control unit 18 determines whether there is noise caused by the air conditioning operation of the air conditioner, the amount of air flow, etc., based on whether the air conditioner is performing the air conditioning operation. The amount of noise that changes can be determined (calculated).

また、ワイパー速度等を示すワイパー状態信号は、ワイパーの動作を制御する制御装置から入力を受ける構成とすることができる。ワイパー状態信号の入力に基づいて、制御部18は、ワイパーの動作に起因するノイズの有無や、ワイパー速度によって変化するノイズ量を判別(演算)することができる。また、ワイパーが動作している間は雨天のときである可能性が高く、ワイパー速度が速いほど、雨が強く雨音が激しい場合が多い。そこで、制御部18では、ワイパー状態信号の入力に基づいて、雨音に起因するノイズの有無および、雨の強度によって変化するノイズ量を判別(演算)することができるように構成されている。   Further, the wiper state signal indicating the wiper speed or the like can be configured to receive an input from a control device that controls the operation of the wiper. Based on the input of the wiper state signal, the control unit 18 can determine (calculate) the presence or absence of noise due to the operation of the wiper and the amount of noise that varies depending on the wiper speed. Further, there is a high possibility that it is raining while the wiper is in operation, and the faster the wiper speed, the stronger the rain and the stronger the rain sound. Therefore, the control unit 18 is configured to be able to determine (calculate) the presence / absence of noise caused by rain sound and the amount of noise that changes depending on the intensity of rain based on the input of the wiper state signal.

また、窓の開閉量を示す窓開閉状態信号は、窓の開閉を制御するパワーウインド装置等から窓の開閉量等を示す信号の入力を受ける構成とすることができる。車両100の走行に伴って風切り音が発生するが、窓の開閉の有無や窓の開き具合によって、車両100の内部における風切り音の大きさは異なる。また、窓が開いている場合、車両100内の音響空間が変化する。そこで、制御部18は、窓開閉状態信号の入力を受けて、車両100内の風切り音に起因するノイズ量を判別(演算)したり、音響空間に対する影響を演算したりすることができる。   The window opening / closing state signal indicating the opening / closing amount of the window may be configured to receive a signal indicating the opening / closing amount of the window from a power window device that controls the opening / closing of the window. Wind noise is generated as the vehicle 100 travels, but the magnitude of wind noise in the vehicle 100 varies depending on whether the window is opened or closed and how the window is opened. When the window is open, the acoustic space in the vehicle 100 changes. Therefore, the control unit 18 can receive (input) the window open / closed state signal, determine (calculate) the amount of noise caused by wind noise in the vehicle 100, and calculate the influence on the acoustic space.

記憶部17は、制御部18によって実行される制御プログラムや各種データを記憶するものであり、ROMやRAM等のメモリ素子を備え、制御部18によりアクセス可能に構成されたものである。また、記憶部17は、上記パラメータ値を設定するために、予め各ノイズの種類毎に前記信号処理の際に用いるパラメータ情報(パラメータ)を対応付けたパラメータ設定テーブルを格納するパラメータ設定テーブル格納領域17aを有する(図3参照)。   The storage unit 17 stores a control program executed by the control unit 18 and various data. The storage unit 17 includes a memory element such as a ROM or a RAM and is configured to be accessible by the control unit 18. The storage unit 17 is a parameter setting table storage area for storing a parameter setting table in which parameter information (parameters) used in the signal processing is associated with each noise type in advance in order to set the parameter value. 17a (see FIG. 3).

パラメータ設定テーブルは、制御部18が信号処理部15に対して音声信号に信号処理を施させる際に用いるパラメータ値を設定するために参照されるもので、ノイズの各種類毎に上記パラメータ情報が対応付けられている他、音声信号に含まれるノイズが複数のノイズ成分を含む場合に参照するためのパラメータ情報として、ノイズ成分の組み合わせ毎に対応付けたパラメータ情報を有している。   The parameter setting table is referred to for setting parameter values used when the control unit 18 causes the signal processing unit 15 to perform signal processing on the audio signal. The parameter information is stored for each type of noise. In addition to the correspondence, parameter information associated with each combination of noise components is included as parameter information for reference when the noise included in the audio signal includes a plurality of noise components.

図示例においては、例えば、パラメータ設定テーブルにおいてノイズの種類毎にパラメータ情報を対応付けた例として、車両100の走行に起因するノイズ(走行音)Aに対してパラメータ情報PAが対応付けられており、空気調和装置の空調運転に起因するノイズ(空調音)Bに対してパラメータ情報PBが対応付けられており、ノイズCに対してパラメータ情報PCが対応付けられている。また、パラメータ設定テーブルでは、ノイズ成分の組み合わせとして、ノイズAとノイズBがノイズとして音声信号に含まれる場合に参照されるパラメータ情報として、パラメータ情報PA+Bが対応付けられている。また、ノイズAとノイズCがノイズとして音声信号に含まれる場合に参照されるパラメータ情報として、パラメータ情報PA+Cが対応付けられている。 In the illustrated example, for example, as an example that associates parameter information for each type of noise in the parameter setting table, noise caused by the traveling of the vehicle 100 (running noise) and parameter information P A is associated to the A The parameter information P B is associated with the noise (air-conditioning sound) B resulting from the air-conditioning operation of the air conditioner, and the parameter information P C is associated with the noise C. In the parameter setting table, parameter information P A + B is associated as parameter information that is referred to when noise A and noise B are included as noise in the audio signal as a combination of noise components. Also, parameter information P A + C is associated as parameter information that is referred to when noise A and noise C are included in the audio signal as noise.

パラメータ情報は、例えば、信号処理部15において音声信号からノイズ成分等を除去するために用いる適応フィルタのフィルタ係数あるいはマイクゲイン値などの各パラメータ値に関する情報を含む。これらのパラメータ値は、ノイズ(エコーを含む)の種類や音声信号に含まれるノイズ成分の種類の組み合わせに応じて、通話品質が最適となるようなパラメータ情報が予め対応付けられていることが好ましい。また、通信接続される携帯電話機20の機種毎に、車載機器10が設置される車両100の車種において、通話品質が最適となるようなパラメータ情報が対応付けられているとより好ましい。   The parameter information includes, for example, information on each parameter value such as a filter coefficient or a microphone gain value of an adaptive filter used for removing a noise component or the like from the audio signal in the signal processing unit 15. These parameter values are preferably associated in advance with parameter information that optimizes the call quality according to the combination of the type of noise (including echo) and the type of noise component included in the audio signal. . In addition, it is more preferable that parameter information that optimizes the call quality is associated with the model of the vehicle 100 in which the in-vehicle device 10 is installed for each model of the mobile phone 20 that is connected for communication.

制御部18は、CPU等を用いて構成され、記憶部17に記憶された各種制御プログラム等に従って、携帯電話機20をハンズフリーで通話可能となるように上記各部を制御するものである。制御部18は、近距離無線通信部11を介して携帯電話機20から着信トリガ信号を受け取ると、携帯電話機20をハンズフリー通話状態とすべく、各種制御コマンドを近距離無線通信部11を介して携帯電話機20に送信し、当該携帯電話機20に対して、内蔵拡声装置からの音声出力及び内蔵マイクからの音声入力を禁止させると共に、受話音声を内蔵の近距離無線通信部11を介して送信させて、当該携帯電話機20の動作モードをハンズフリー通話モードに移行させる。   The control unit 18 is configured using a CPU or the like, and controls each of the above units so that the mobile phone 20 can make a hands-free call according to various control programs stored in the storage unit 17. When receiving the incoming trigger signal from the mobile phone 20 via the short-range wireless communication unit 11, the control unit 18 sends various control commands via the short-range wireless communication unit 11 to place the mobile phone 20 in a hands-free call state. Transmitting to the mobile phone 20, prohibiting voice output from the built-in loudspeaker and voice input from the built-in microphone to the mobile phone 20 and transmitting the received voice via the built-in short-range wireless communication unit 11. Thus, the operation mode of the mobile phone 20 is shifted to the hands-free call mode.

また、制御部18は、携帯電話機20の動作モードをハンズフリー通話モードから単独使用可能な通常動作モードに移行させる際には、近距離無線通信部11を介して当該携帯電話機20に対して各種制御コマンドを送信し、内蔵拡声装置の音声出力及び内蔵マイクからの音声入力を許可する。   Further, when the control unit 18 shifts the operation mode of the mobile phone 20 from the hands-free call mode to the normal operation mode that can be used independently, the control unit 18 performs various operations on the mobile phone 20 via the short-range wireless communication unit 11. A control command is transmitted, and the voice output of the built-in loudspeaker and the voice input from the built-in microphone are permitted.

また、制御部18は、携帯電話機20の動作モードを上述の様にハンズフリー通話モードに移行させた場合、信号処理部15により、携帯電話機20に対して近距離無線通信部11を介して送信する音声信号に対して信号処理を施す際に用いるパラメータ値を次のようにして設定する。   Further, when the operation mode of the mobile phone 20 is shifted to the hands-free call mode as described above, the control unit 18 transmits the signal to the mobile phone 20 via the short-range wireless communication unit 11 by the signal processing unit 15. The parameter value used when performing signal processing on the audio signal to be set is set as follows.

以下、音声信号送信時におけるパラメータ値の設定および信号処理に係る動作について図4を参照して説明する。車載機器10と携帯電話機20との間で無線通信接続が確立され、ハンズフリー通話が開始されると、制御部18は、まず、音声信号入力部12を介して収音装置30により収音された車両100内の音声に基づく音声信号の入力の有無を判別する(ステップS1)。ここで、音声信号入力部12を介して収音装置30から音声信号が入力されていると判別されると(ステップS1:Y)、制御部18は、次に、状態信号入力部16を介して入力される車両100の各種状態を示す状態信号に基づいて、携帯電話機20に対して送信すべき音声信号にノイズが含まれているか否かを判別する(ステップS2)。ステップS2において、音声信号にノイズが含まれていると判別されると(ステップS2:Y)、制御部18は、状態信号入力部16を介して入力される各種状態信号に基づいて、ノイズの種類を判別する(ステップS3)。ここで、音声信号に含まれるノイズが複数のノイズ成分を含む場合は、ノイズに含まれる各ノイズ成分の種類を判別する。   Hereinafter, operations related to setting of parameter values and signal processing at the time of audio signal transmission will be described with reference to FIG. When a wireless communication connection is established between the in-vehicle device 10 and the mobile phone 20 and a hands-free call is started, the control unit 18 first collects sound by the sound collection device 30 via the audio signal input unit 12. It is determined whether or not an audio signal based on the audio in the vehicle 100 is input (step S1). Here, if it is determined that an audio signal is input from the sound collection device 30 via the audio signal input unit 12 (step S1: Y), the control unit 18 then passes through the status signal input unit 16. Whether or not noise is included in the audio signal to be transmitted to the mobile phone 20 is determined based on the state signals indicating the various states of the vehicle 100 input in step S2. When it is determined in step S2 that the audio signal includes noise (step S2: Y), the control unit 18 determines whether noise has been generated based on various state signals input via the state signal input unit 16. The type is determined (step S3). Here, when the noise included in the audio signal includes a plurality of noise components, the type of each noise component included in the noise is determined.

次に、制御部18は、ノイズの種類又はノイズ成分の組み合わせに変化があったか否かを判別する(ステップS4)。ここで、音声信号が初めて入力された場合は、ノイズ種類の変化があった(ステップS4:Y)ものとして次のステップに進む。
ステップS4において、ノイズの種類又はノイズ成分の組み合わせに変化があったと判別された場合(ステップS4:Y)、次に、制御部18は、パラメータ設定テーブルを参照して、ノイズの種類又はノイズ成分の組み合わせに応じたパラメータ情報を読み出して信号処理部15において用いるパラメータ値をノイズ量に基づいて設定する(ステップS5)。但し、ノイズ量は、制御部18において、状態信号に基づいて演算により求めることができる。
Next, the control unit 18 determines whether or not there is a change in the type of noise or the combination of noise components (step S4). Here, when an audio signal is input for the first time, it is assumed that there has been a change in noise type (step S4: Y), and the process proceeds to the next step.
If it is determined in step S4 that there has been a change in the type of noise or the combination of noise components (step S4: Y), the control unit 18 then refers to the parameter setting table and refers to the type of noise or noise component. The parameter information corresponding to the combination is read and the parameter value used in the signal processing unit 15 is set based on the amount of noise (step S5). However, the amount of noise can be obtained by calculation based on the state signal in the control unit 18.

パラメータ値の設定が終了すると(ステップS6:Y)、制御部18は、設定されたパラメータ値に基づいて、信号処理部15により音声信号に対して信号処理が施されるように制御する(ステップS7)。そして、音声信号の入力が終了(ステップS8:Y)するまでの間、上記処理を繰り返し行う。この際、ステップS4において、音声信号に含まれるノイズの種類又はノイズ成分の組み合わせが変化したと判別された場合(ステップS4:Y)には、変化後のノイズの種類又はノイズ成分の組み合わせに応じたパラメータを変化後のノイズ量に応じて新たなパラメータ値に設定するまでの間は、変化前に設定されたパラメータ値に基づいて、信号処理部15に音声信号に対して信号処理を行わせる。また、ステップS4において、ノイズの種類又はノイズ成分の組み合わせに変化がないと判別された場合(ステップS4:N)、既に設定されているパラメータ値に基づいて、信号処理部15に音声信号に対して信号処理を行わせる。
但し、信号処理部15により信号処理が施された音声信号は、近距離無線通信部11を介して所定の通信プロトコルに従って携帯電話機20に対して送信される。
When the parameter value setting is completed (step S6: Y), the control unit 18 controls the signal processing unit 15 to perform signal processing on the audio signal based on the set parameter value (step S6). S7). The above process is repeated until the input of the audio signal is completed (step S8: Y). At this time, if it is determined in step S4 that the type of noise or the combination of noise components included in the audio signal has changed (step S4: Y), depending on the type of noise or the combination of noise components after the change. Until the parameter is set to a new parameter value according to the noise amount after the change, the signal processing unit 15 is caused to perform signal processing on the audio signal based on the parameter value set before the change. . If it is determined in step S4 that there is no change in the type of noise or the combination of the noise components (step S4: N), the signal processing unit 15 applies an audio signal to the audio signal based on the already set parameter value. Signal processing.
However, the audio signal subjected to the signal processing by the signal processing unit 15 is transmitted to the mobile phone 20 through the short-range wireless communication unit 11 according to a predetermined communication protocol.

また、携帯電話機20から近距離無線通信部11を介して入力された音声信号に対して信号処理を施す際には、上記と同様に、状態信号入力部16を介して入力される車両100の各種状態を示す状態信号に基づいて、制御部18は、車両100内のノイズの有無をノイズの種類毎に判別し、記憶部17に記憶されたパラメータ設定テーブルを参照して、車両100内のノイズの種類又はノイズ成分の組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、信号処理部15に信号処理を施させ、信号処理後の音声信号を音声信号出力部14を介して拡声装置50から車両100内に拡声させるように制御する。   When performing signal processing on the audio signal input from the mobile phone 20 via the short-range wireless communication unit 11, the vehicle 100 input via the status signal input unit 16 is the same as described above. Based on the state signals indicating various states, the control unit 18 determines the presence / absence of noise in the vehicle 100 for each type of noise, and refers to the parameter setting table stored in the storage unit 17 to determine whether there is noise in the vehicle 100. A parameter corresponding to the type of noise or a combination of noise components is set to a parameter value corresponding to the amount of noise, and based on the parameter value, the signal processing unit 15 performs signal processing, and the audio signal after signal processing is processed. Control is performed so that the sound is amplified from the loudspeaker 50 into the vehicle 100 via the audio signal output unit 14.

同様に、音源装置40から音響信号入力部13を介して入力された音響信号についても、拡声装置50から車両100内に拡声させる際に、状態信号入力部16を介して入力される車両100の各種状態を示す状態信号に基づいて、制御部18は、車両100内のノイズの有無をノイズの種類毎に判別し、記憶部17に記憶されたパラメータ設定テーブルを参照して、車両100内のノイズの種類又はノイズ成分の組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、信号処理部15に信号処理を施させ、信号処理後の音響信号を音声信号出力部14を介して拡声装置50から車両100内に拡声させるように制御する。   Similarly, the sound signal input from the sound source device 40 via the sound signal input unit 13 is also input to the vehicle 100 input via the state signal input unit 16 when the sound signal is amplified from the sound expansion device 50 into the vehicle 100. Based on the state signals indicating various states, the control unit 18 determines the presence / absence of noise in the vehicle 100 for each type of noise, and refers to the parameter setting table stored in the storage unit 17 to determine whether there is noise in the vehicle 100. A parameter corresponding to the type of noise or a combination of noise components is set to a parameter value corresponding to the amount of noise, and based on the parameter value, the signal processing unit 15 performs signal processing, and the acoustic signal after signal processing is Control is performed so that the sound is amplified from the loudspeaker 50 into the vehicle 100 via the audio signal output unit 14.

以上説明した本実施の形態によれば、車両100内で収音装置30により収音された音声に基づく音声信号が音声信号入力部12を介して音声信号処理装置としての車載機器10に入力される。信号処理部15では、この音声信号に対して、制御部18により、設定されたパラメータ値に基づいて、音声信号に含まれるノイズを除去すべく信号処理を施す。この際、制御部18は、パラメータ値の設定に際して、状態信号入力部16を介して入力された車両100の状態を示す各種状態信号に基づき、音声信号に含まれるノイズの有無をノイズの種類毎に判別する。また、制御部18は、記憶部17に記憶されたパラメータ設定テーブルを参照して、ノイズの種類又はノイズ成分の組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、信号処理部15に信号処理を施させるように制御する。従って、車両100内で収音された音声信号に含まれるノイズの種類が車両100の走行/停止等に伴って変動した場合であっても、ノイズの種類又はノイズ成分の組み合わせとノイズの量に応じて適切に音声信号処理を施すことができる。すなわち、車両100の走行音に起因するノイズと、空調音に起因するノイズとでは、ノイズの特性が異なるため、本実施の形態では、それぞれノイズの特性に応じたパラメータを用いて、ノイズ量に応じたパラメータ値を設定することにより、所望の音質に調整することができる。   According to the present embodiment described above, an audio signal based on the sound collected by the sound collection device 30 in the vehicle 100 is input to the in-vehicle device 10 as the audio signal processing device via the audio signal input unit 12. The In the signal processing unit 15, the control unit 18 performs signal processing to remove noise included in the audio signal based on the set parameter value by the control unit 18. At this time, when setting the parameter value, the control unit 18 determines the presence or absence of noise included in the audio signal based on various state signals indicating the state of the vehicle 100 input via the state signal input unit 16 for each type of noise. To determine. Further, the control unit 18 refers to the parameter setting table stored in the storage unit 17, sets a parameter according to the noise type or the combination of noise components to a parameter value according to the noise amount, and sets the parameter value Based on the above, control is performed so that the signal processing unit 15 performs signal processing. Therefore, even if the type of noise included in the audio signal collected in the vehicle 100 varies as the vehicle 100 travels / stops, the noise type or combination of noise components and the amount of noise Accordingly, the audio signal processing can be appropriately performed. That is, since noise characteristics are different between noise caused by running sound of vehicle 100 and noise caused by air-conditioning sound, in the present embodiment, the noise amount is set using parameters corresponding to the noise characteristics. By setting a corresponding parameter value, it is possible to adjust to a desired sound quality.

また、本実施の形態では、状態信号入力部16に、走行状態信号、空調運転状態信号、ワイパー状態信号、窓開閉状態信号等の車両100の各種状態を示す状態信号の入力を受ける構成としており、これらの状態信号に基づいて、制御部18は、ノイズの有無、ノイズの種類あるいは複数のノイズ成分が含まれる場合にはその組み合わせなどを判別することができ、ノイズ量を演算して求めることができる。したがって、車両100の走行に起因するノイズと、空気調和装置の空気調和運転に起因するノイズ、風切り音に起因するノイズ、ワイパーの動作に起因するノイズ又は雨音に起因するノイズなどを判別して、それぞれのノイズ量に応じて適切なパラメータ値を設定することができる。   In the present embodiment, the state signal input unit 16 is configured to receive input of state signals indicating various states of the vehicle 100 such as a traveling state signal, an air conditioning operation state signal, a wiper state signal, and a window opening / closing state signal. Based on these state signals, the control unit 18 can determine the presence / absence of noise, the type of noise, or a combination of a plurality of noise components, and the like, and calculate and obtain the amount of noise. Can do. Therefore, it is possible to discriminate between noise caused by running of the vehicle 100, noise caused by air conditioning operation of the air conditioner, noise caused by wind noise, noise caused by wiper operation, noise caused by rain sound, and the like. Therefore, an appropriate parameter value can be set according to each noise amount.

また、制御部18は、信号処理の際に信号処理部15において用いるパラメータ値をノイズの種類やノイズの変化の種類に応じて切り換える際に、新たなパラメータ値を設定するまでの間は、変化前に設定されたパラメータ値に基づいて、信号処理部15に信号処理を施させるので、ノイズの種類の変化やノイズ成分の組み合わせの変化に応じてリアルタイムにパラメータ値を変更する場合に比較して、異音が発生する等の不具合が生じるのを防ぐことができる。すなわち、ノイズの種類の変化やノイズ成分の組み合わせの変化に応じて、直ちに、パラメータ値の設定を変更すると、通話品質が安定するまで一定時間を要する。また、ノイズ量を計算する際に収束時間を要し、異音が発生する場合がある。しかしながら、本実施の形態では、上述のように、パラメータ値を新たに設定する際に、新たなパラメータ値が設定(演算)されるまでの間は、ノイズ種類等が変化する前に設定されたパラメータ値を用いる構成としているので、上記異音の発生等の不具合が生じるのを防止することができる。   The control unit 18 changes the parameter value used in the signal processing unit 15 during signal processing according to the type of noise or the type of change in noise until a new parameter value is set. Since the signal processing unit 15 performs signal processing based on the previously set parameter value, compared with the case where the parameter value is changed in real time according to the change in the type of noise or the change in the combination of noise components. It is possible to prevent the occurrence of problems such as abnormal noise. That is, if the parameter value setting is changed immediately in response to a change in the type of noise or a change in the combination of noise components, a certain time is required until the call quality is stabilized. In addition, when calculating the amount of noise, a convergence time is required, and abnormal noise may occur. However, in the present embodiment, as described above, when a new parameter value is set, until the new parameter value is set (calculated), it is set before the noise type or the like changes. Since the parameter value is used, it is possible to prevent problems such as the occurrence of abnormal noise.

更に、音声信号に含まれるノイズを周波数特性と分析して、ノイズ成分を判定し、ノイズ成分を除去するように信号処理を施す場合と比較して、状態信号入力部16を介して入力される状態信号に基づいて、予め、音声信号に含まれ得るノイズ成分の周波数特性やノイズ量等を判定することができるので、信号処理時に要する演算を簡易にすることができ、迅速にノイズを除去することができる。   Furthermore, the noise contained in the audio signal is analyzed with the frequency characteristic, the noise component is determined, and compared with the case where signal processing is performed so as to remove the noise component, the noise signal is input via the state signal input unit 16. Based on the status signal, it is possible to determine in advance the frequency characteristics of noise components that can be included in the audio signal, the amount of noise, etc., so that calculations required during signal processing can be simplified and noise can be quickly removed. be able to.

以上、説明した実施の形態は本発明の一態様であり、本発明の趣旨を逸脱しない範囲において適宜変更可能であるのは勿論である。例えば、上記実施の形態の車載機器10では収音装置30や拡声装置50が接続される構成としたが、車載機器10が備えていてもよいのは勿論である。また、車載機器10が近距離無線通信部11、音声信号入力部12、音響信号入力部13、音声信号出力部14を備える構成としたが、音声信号処理装置としては、これらを外部構成としてもよいのは勿論である。   The embodiment described above is one aspect of the present invention, and it is needless to say that the embodiment can be appropriately changed without departing from the gist of the present invention. For example, although the sound collecting device 30 and the loudspeaker 50 are connected in the in-vehicle device 10 of the above embodiment, the in-vehicle device 10 may be provided. Moreover, although the in-vehicle device 10 is configured to include the short-range wireless communication unit 11, the audio signal input unit 12, the acoustic signal input unit 13, and the audio signal output unit 14, the audio signal processing device may be configured as an external configuration. Of course it is good.

本発明の実施の形態に係る車載機器(音声信号処理装置、ハンズフリー通話装置)の使用の態様を示す図である。It is a figure which shows the aspect of use of the vehicle equipment (audio | voice signal processing apparatus, hands-free call apparatus) which concerns on embodiment of this invention. 車載機器の機能的構成を示すブロック図である。It is a block diagram which shows the functional structure of vehicle equipment. パラメータ設定テーブルの構成を示す図である。It is a figure which shows the structure of a parameter setting table. 車載機器の動作を示すフローチャートである。It is a flowchart which shows operation | movement of vehicle equipment.

符号の説明Explanation of symbols

10 車載機器
11 近距離無線通信部
12 音声信号入力部
13 音響信号入力部
14 音声信号出力部
15 信号処理部
16 状態信号入力部
17 記憶部
17a パラメータ設定テーブル格納領域
18 制御部
20 携帯電話機(携帯電話端末)
30 収音装置
40 音源装置
50 拡声装置
100 車両
DESCRIPTION OF SYMBOLS 10 In-vehicle apparatus 11 Near field communication part 12 Audio | voice signal input part 13 Acoustic signal input part 14 Audio | voice signal output part 15 Signal processing part 16 State signal input part 17 Memory | storage part 17a Parameter setting table storage area 18 Control part 20 Cellular phone (portable) Phone terminal)
DESCRIPTION OF SYMBOLS 30 Sound collecting device 40 Sound source device 50 Loudspeaker 100 Vehicle

Claims (9)

車両内で収音された音声に基づく音声信号が入力される音声信号入力部と、
設定されたパラメータ値に基づいて、前記音声信号に含まれるノイズを除去すべく前記音声信号に対して信号処理を施す信号処理部と、
外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、
前記状態信号に基づき、前記音声信号に含まれるノイズの有無をノイズの種類毎に判別するノイズ判別部と、
各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、
前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させるように制御する制御部と、
を備えることを特徴とする音声信号処理装置。
An audio signal input unit to which an audio signal based on audio collected in the vehicle is input;
A signal processing unit that performs signal processing on the audio signal to remove noise included in the audio signal based on the set parameter value;
A state signal input unit to which a state signal indicating the state of the vehicle is input from the outside;
Based on the state signal, a noise determination unit that determines the presence or absence of noise included in the audio signal for each type of noise;
A storage unit for storing a parameter setting table in which parameters used in the signal processing are associated with each noise type;
Refer to the parameter setting table according to the type of noise or the combination of noise components determined by the noise determination unit, and set the parameter according to the type or combination of noise to a parameter value according to the amount of noise. A control unit that controls the signal processing unit to perform the signal processing based on the parameter value;
An audio signal processing device comprising:
請求項1記載の音声信号処理装置において、
前記状態信号入力部には、前記状態信号として、少なくとも前記車両の走行状態を示す状態信号と、前記車両内に設置された空気調和装置の空気調和運転状態を示す状態信号との入力を受け、
前記ノイズの種類には、前記車両の走行に起因するノイズと、前記空気調和装置の空気調和運転に起因するノイズとを含むこと、
を特徴とする音声信号処理装置。
The audio signal processing device according to claim 1,
The state signal input unit receives, as the state signal, at least a state signal indicating a traveling state of the vehicle and a state signal indicating an air conditioning operation state of an air conditioner installed in the vehicle,
The types of noise include noise caused by running of the vehicle and noise caused by air conditioning operation of the air conditioner,
An audio signal processing device.
請求項1又は2記載の音声信号処理装置において、
前記状態信号入力部には、前記状態信号として、窓の開閉量を示す信号の入力を受け、
前記ノイズの種類には、風切り音に起因するノイズを含むこと、
を特徴とする音声信号処理装置。
The audio signal processing device according to claim 1 or 2,
The state signal input unit receives a signal indicating the opening / closing amount of the window as the state signal,
The noise type includes noise caused by wind noise,
An audio signal processing device.
請求項1〜3のいずれか一項に記載の音声信号処理装置において、
前記状態信号入力部には、前記状態信号として、ワイパー速度を示す信号の入力を受け、
前記ノイズの種類には、ワイパーの動作に起因するノイズ又は雨音に起因するノイズを含むこと、
を特徴とする音声信号処理装置。
In the audio signal processing device according to any one of claims 1 to 3,
The state signal input unit receives a signal indicating a wiper speed as the state signal,
The type of noise includes noise caused by wiper operation or noise caused by rain sound,
An audio signal processing device.
請求項1〜4のいずれか一項に記載の音声信号処理装置において、
前記制御部は、前記音声信号に含まれるノイズの種類又はノイズ成分の組み合わせが変化した場合、変化後のノイズの種類又はノイズ成分の組み合わせに応じたパラメータを変化後のノイズ量に応じて新たなパラメータ値に設定するまでの間は、変化前に設定されたパラメータ値に基づいて、前記信号処理部に前記信号処理を施させること、
を特徴とする音声信号処理装置。
In the audio signal processing device according to any one of claims 1 to 4,
When the noise type or the combination of noise components included in the audio signal is changed, the control unit sets a new parameter according to the changed noise type or the noise component combination according to the changed noise amount. Until the parameter value is set, based on the parameter value set before the change, the signal processing unit is subjected to the signal processing,
An audio signal processing device.
音源装置から車両内に拡声するための音響信号が入力される音響信号入力部と、
設定されたパラメータ値に基づいて、前記音響信号に対して音質を調整すべく信号処理を施す信号処理部と、
外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、
前記状態信号に基づき、車両内のノイズの有無をノイズの種類毎に判別するノイズ判別部と、
各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、
前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させるように制御する制御部と、
を備えることを特徴とする音声信号処理装置。
An acoustic signal input unit for inputting an acoustic signal for sounding into the vehicle from the sound source device;
A signal processing unit for performing signal processing to adjust the sound quality of the acoustic signal based on the set parameter value;
A state signal input unit to which a state signal indicating the state of the vehicle is input from the outside;
Based on the state signal, a noise determination unit that determines the presence or absence of noise in the vehicle for each type of noise,
A storage unit for storing a parameter setting table in which parameters used in the signal processing are associated with each noise type;
Refer to the parameter setting table according to the type of noise or the combination of noise components determined by the noise determination unit, and set the parameter according to the type or combination of noise to a parameter value according to the amount of noise. A control unit that controls the signal processing unit to perform the signal processing based on the parameter value;
An audio signal processing device comprising:
音声を収音して音声信号に変換する収音部と、携帯電話端末と所定の通信プロトコルに従って、前記音声信号を送信するとともに前記携帯電話端末から音声信号を受信する通信部と、前記通信部において受信した音声信号を出力する出力部とを備え、前記携帯電話端末をハンズフリーで通話可能とするハンズフリー通話装置において、
設定されたパラメータ値に基づいて、前記音声信号に対して音質を調整すべく信号処理を施す信号処理部と、
外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、
前記状態信号に基づき、前記車両内のノイズの有無をノイズの種類毎に判別するノイズ判別部と、
各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、
前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定して、当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させるように制御する制御部と、
を備えることを特徴とするハンズフリー通話装置。
A sound collection unit that collects sound and converts it into an audio signal; a communication unit that transmits the audio signal and receives the audio signal from the mobile phone terminal according to a predetermined communication protocol with the mobile phone terminal; and the communication unit In the hands-free call device that includes the output unit that outputs the audio signal received in the above, and enables the hands-free call on the mobile phone terminal,
A signal processing unit that performs signal processing to adjust sound quality based on the set parameter value;
A state signal input unit to which a state signal indicating the state of the vehicle is input from the outside;
Based on the state signal, a noise determination unit that determines the presence or absence of noise in the vehicle for each type of noise;
A storage unit for storing a parameter setting table in which parameters used in the signal processing are associated with each noise type;
Refer to the parameter setting table according to the type of noise or the combination of noise components determined by the noise determination unit, and set the parameter according to the type or combination of noise to a parameter value according to the amount of noise. A control unit that controls the signal processing unit to perform the signal processing based on the parameter value;
A hands-free communication device comprising:
車両内で収音された音声に基づく音声信号が入力される音声信号入力部と、設定されたパラメータ値に基づいて、前記音声信号に対して信号処理を施す信号処理部と、外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、を備えた音声信号処理装置を用いて前記音声信号に含まれるノイズを除去すべく前記音声信号に対して信号処理を施す音声信号処理方法であって、
前記状態信号に基づき、前記音声信号に含まれるノイズの有無をノイズの種類毎に判別する過程と、
前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定する過程と、
当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させる過程と、
を備えることを特徴とする音声信号処理方法。
An audio signal input unit that receives an audio signal based on audio collected in the vehicle, a signal processing unit that performs signal processing on the audio signal based on a set parameter value, and the vehicle from the outside Audio signal processing comprising: a state signal input unit to which a state signal indicating the state of the signal is input; and a storage unit that stores a parameter setting table in which parameters used in the signal processing are associated with each noise type An audio signal processing method for performing signal processing on the audio signal to remove noise included in the audio signal using an apparatus,
Based on the status signal, a process of determining the presence or absence of noise included in the audio signal for each type of noise;
According to the type of noise or the combination of noise components determined by the noise determination unit, the parameter setting table is referred to and a parameter corresponding to the type or combination of noise is set to a parameter value corresponding to the amount of noise. Process,
A process of causing the signal processing unit to perform the signal processing based on the parameter value;
An audio signal processing method comprising:
車両内で収音された音声に基づく音声信号が入力される音声信号入力部と、設定されたパラメータ値に基づいて、前記音声信号に含まれるノイズを除去すべく前記音声信号に対して信号処理を施す信号処理部と、外部から前記車両の状態を示す状態信号が入力される状態信号入力部と、各ノイズの種類毎に前記信号処理の際に用いるパラメータを対応付けたパラメータ設定テーブルを記憶する記憶部と、を備えた音声信号処理装置をコンピュータを用いて制御するための制御プログラムであって、
前記状態信号に基づき、前記音声信号に含まれるノイズの有無をノイズの種類毎に判別させ、
前記ノイズ判別部により判別されたノイズの種類又はノイズ成分の組み合わせに応じて、前記パラメータ設定テーブルを参照して、前記ノイズの種類又は組み合わせに応じたパラメータをノイズ量に応じたパラメータ値に設定させ、
当該パラメータ値に基づいて、前記信号処理部に前記信号処理を施させること、
を特徴とする制御プログラム。
An audio signal input unit to which an audio signal based on the audio collected in the vehicle is input, and signal processing on the audio signal to remove noise included in the audio signal based on a set parameter value A signal processing unit for performing the processing, a state signal input unit for inputting a state signal indicating the state of the vehicle from the outside, and a parameter setting table in which parameters used for the signal processing are associated with each noise type A control program for controlling an audio signal processing device including a storage unit using a computer,
Based on the state signal, the presence or absence of noise included in the audio signal is determined for each type of noise,
According to the type of noise or the combination of noise components determined by the noise determination unit, the parameter setting table is referred to and a parameter corresponding to the noise type or combination is set to a parameter value corresponding to the amount of noise. ,
Causing the signal processing unit to perform the signal processing based on the parameter value;
A control program characterized by
JP2007073939A 2007-03-22 2007-03-22 Sound signal processing device, hands-free calling device, sound signal processing method, and control program Pending JP2008236448A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2007073939A JP2008236448A (en) 2007-03-22 2007-03-22 Sound signal processing device, hands-free calling device, sound signal processing method, and control program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2007073939A JP2008236448A (en) 2007-03-22 2007-03-22 Sound signal processing device, hands-free calling device, sound signal processing method, and control program

Publications (1)

Publication Number Publication Date
JP2008236448A true JP2008236448A (en) 2008-10-02

Family

ID=39908670

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2007073939A Pending JP2008236448A (en) 2007-03-22 2007-03-22 Sound signal processing device, hands-free calling device, sound signal processing method, and control program

Country Status (1)

Country Link
JP (1) JP2008236448A (en)

Cited By (153)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010074734A (en) * 2008-09-22 2010-04-02 Denso Corp Onboard hands-free device
US8639516B2 (en) 2010-06-04 2014-01-28 Apple Inc. User-specific noise suppression for voice quality improvements
US8892446B2 (en) 2010-01-18 2014-11-18 Apple Inc. Service orchestration for intelligent automated assistant
US9190062B2 (en) 2010-02-25 2015-11-17 Apple Inc. User profiling for voice input processing
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US9300784B2 (en) 2013-06-13 2016-03-29 Apple Inc. System and method for emergency calls initiated by voice command
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9535906B2 (en) 2008-07-31 2017-01-03 Apple Inc. Mobile device having human language translation capability with positional feedback
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
US9620104B2 (en) 2013-06-07 2017-04-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US9626955B2 (en) 2008-04-05 2017-04-18 Apple Inc. Intelligent text-to-speech conversion
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9633674B2 (en) 2013-06-07 2017-04-25 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
US9646614B2 (en) 2000-03-16 2017-05-09 Apple Inc. Fast, language-independent method for user authentication by voice
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US9697822B1 (en) 2013-03-15 2017-07-04 Apple Inc. System and method for updating an adaptive speech recognition model
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9798393B2 (en) 2011-08-29 2017-10-24 Apple Inc. Text correction processing
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9922642B2 (en) 2013-03-15 2018-03-20 Apple Inc. Training an at least partial voice command system
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9953088B2 (en) 2012-05-14 2018-04-24 Apple Inc. Crowd sourcing information to fulfill user requests
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
US9966065B2 (en) 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US9966068B2 (en) 2013-06-08 2018-05-08 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US9971774B2 (en) 2012-09-19 2018-05-15 Apple Inc. Voice-based media searching
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US10079014B2 (en) 2012-06-08 2018-09-18 Apple Inc. Name recognition system
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10089072B2 (en) 2016-06-11 2018-10-02 Apple Inc. Intelligent device arbitration and control
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
US10185542B2 (en) 2013-06-09 2019-01-22 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10199051B2 (en) 2013-02-07 2019-02-05 Apple Inc. Voice trigger for a digital assistant
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10269345B2 (en) 2016-06-11 2019-04-23 Apple Inc. Intelligent task discovery
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10283110B2 (en) 2009-07-02 2019-05-07 Apple Inc. Methods and apparatuses for automatic speech recognition
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US10297253B2 (en) 2016-06-11 2019-05-21 Apple Inc. Application integration with a digital assistant
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10318871B2 (en) 2005-09-08 2019-06-11 Apple Inc. Method and apparatus for building an intelligent automated assistant
US10332518B2 (en) 2017-05-09 2019-06-25 Apple Inc. User interface for correcting recognition errors
US10354011B2 (en) 2016-06-09 2019-07-16 Apple Inc. Intelligent automated assistant in a home environment
US10356243B2 (en) 2015-06-05 2019-07-16 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10403283B1 (en) 2018-06-01 2019-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10482874B2 (en) 2017-05-15 2019-11-19 Apple Inc. Hierarchical belief states for digital assistants
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10521466B2 (en) 2016-06-11 2019-12-31 Apple Inc. Data driven natural language event detection and classification
WO2020017518A1 (en) * 2018-07-20 2020-01-23 株式会社ソニー・インタラクティブエンタテインメント Audio signal processing device
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US10568032B2 (en) 2007-04-03 2020-02-18 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US10607141B2 (en) 2010-01-25 2020-03-31 Newvaluexchange Ltd. Apparatuses, methods and systems for a digital conversation management platform
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10643611B2 (en) 2008-10-02 2020-05-05 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US10684703B2 (en) 2018-06-01 2020-06-16 Apple Inc. Attention aware virtual assistant dismissal
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10706373B2 (en) 2011-06-03 2020-07-07 Apple Inc. Performing actions associated with task items that represent tasks to perform
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733993B2 (en) 2016-06-10 2020-08-04 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10755703B2 (en) 2017-05-11 2020-08-25 Apple Inc. Offline personal assistant
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
US10789945B2 (en) 2017-05-12 2020-09-29 Apple Inc. Low-latency intelligent automated assistant
US10791216B2 (en) 2013-08-06 2020-09-29 Apple Inc. Auto-activating smart responses based on activities from remote devices
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US10791176B2 (en) 2017-05-12 2020-09-29 Apple Inc. Synchronization and task delegation of a digital assistant
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10810274B2 (en) 2017-05-15 2020-10-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11023513B2 (en) 2007-12-20 2021-06-01 Apple Inc. Method and apparatus for searching using an active ontology
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US11217255B2 (en) 2017-05-16 2022-01-04 Apple Inc. Far-field extension for digital assistant services
US11231904B2 (en) 2015-03-06 2022-01-25 Apple Inc. Reducing response latency of intelligent automated assistants
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
US11314370B2 (en) 2013-12-06 2022-04-26 Apple Inc. Method for extracting salient dialog usage from live data
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
US11495218B2 (en) 2018-06-01 2022-11-08 Apple Inc. Virtual assistant operation in multi-device environments
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
JP7362766B2 (en) 2019-11-19 2023-10-17 株式会社ソニー・インタラクティブエンタテインメント operation device

Cited By (226)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9646614B2 (en) 2000-03-16 2017-05-09 Apple Inc. Fast, language-independent method for user authentication by voice
US10318871B2 (en) 2005-09-08 2019-06-11 Apple Inc. Method and apparatus for building an intelligent automated assistant
US9117447B2 (en) 2006-09-08 2015-08-25 Apple Inc. Using event alert text as input to an automated assistant
US8930191B2 (en) 2006-09-08 2015-01-06 Apple Inc. Paraphrasing of user requests and results by automated digital assistant
US8942986B2 (en) 2006-09-08 2015-01-27 Apple Inc. Determining user intent based on ontologies of domains
US10568032B2 (en) 2007-04-03 2020-02-18 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US11023513B2 (en) 2007-12-20 2021-06-01 Apple Inc. Method and apparatus for searching using an active ontology
US10381016B2 (en) 2008-01-03 2019-08-13 Apple Inc. Methods and apparatus for altering audio output signals
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US9865248B2 (en) 2008-04-05 2018-01-09 Apple Inc. Intelligent text-to-speech conversion
US9626955B2 (en) 2008-04-05 2017-04-18 Apple Inc. Intelligent text-to-speech conversion
US9535906B2 (en) 2008-07-31 2017-01-03 Apple Inc. Mobile device having human language translation capability with positional feedback
US10108612B2 (en) 2008-07-31 2018-10-23 Apple Inc. Mobile device having human language translation capability with positional feedback
JP2010074734A (en) * 2008-09-22 2010-04-02 Denso Corp Onboard hands-free device
US10643611B2 (en) 2008-10-02 2020-05-05 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US11348582B2 (en) 2008-10-02 2022-05-31 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
US11080012B2 (en) 2009-06-05 2021-08-03 Apple Inc. Interface for a virtual digital assistant
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10475446B2 (en) 2009-06-05 2019-11-12 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10795541B2 (en) 2009-06-05 2020-10-06 Apple Inc. Intelligent organization of tasks items
US10283110B2 (en) 2009-07-02 2019-05-07 Apple Inc. Methods and apparatuses for automatic speech recognition
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US8903716B2 (en) 2010-01-18 2014-12-02 Apple Inc. Personalized vocabulary for digital assistant
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US8892446B2 (en) 2010-01-18 2014-11-18 Apple Inc. Service orchestration for intelligent automated assistant
US9548050B2 (en) 2010-01-18 2017-01-17 Apple Inc. Intelligent automated assistant
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10706841B2 (en) 2010-01-18 2020-07-07 Apple Inc. Task flow identification based on user intent
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US11423886B2 (en) 2010-01-18 2022-08-23 Apple Inc. Task flow identification based on user intent
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US11410053B2 (en) 2010-01-25 2022-08-09 Newvaluexchange Ltd. Apparatuses, methods and systems for a digital conversation management platform
US10984326B2 (en) 2010-01-25 2021-04-20 Newvaluexchange Ltd. Apparatuses, methods and systems for a digital conversation management platform
US10984327B2 (en) 2010-01-25 2021-04-20 New Valuexchange Ltd. Apparatuses, methods and systems for a digital conversation management platform
US10607140B2 (en) 2010-01-25 2020-03-31 Newvaluexchange Ltd. Apparatuses, methods and systems for a digital conversation management platform
US10607141B2 (en) 2010-01-25 2020-03-31 Newvaluexchange Ltd. Apparatuses, methods and systems for a digital conversation management platform
US9190062B2 (en) 2010-02-25 2015-11-17 Apple Inc. User profiling for voice input processing
US10049675B2 (en) 2010-02-25 2018-08-14 Apple Inc. User profiling for voice input processing
US10692504B2 (en) 2010-02-25 2020-06-23 Apple Inc. User profiling for voice input processing
US9633660B2 (en) 2010-02-25 2017-04-25 Apple Inc. User profiling for voice input processing
US10446167B2 (en) 2010-06-04 2019-10-15 Apple Inc. User-specific noise suppression for voice quality improvements
US8639516B2 (en) 2010-06-04 2014-01-28 Apple Inc. User-specific noise suppression for voice quality improvements
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
US10102359B2 (en) 2011-03-21 2018-10-16 Apple Inc. Device access using voice authentication
US10417405B2 (en) 2011-03-21 2019-09-17 Apple Inc. Device access using voice authentication
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US11350253B2 (en) 2011-06-03 2022-05-31 Apple Inc. Active transport based notifications
US10706373B2 (en) 2011-06-03 2020-07-07 Apple Inc. Performing actions associated with task items that represent tasks to perform
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US11120372B2 (en) 2011-06-03 2021-09-14 Apple Inc. Performing actions associated with task items that represent tasks to perform
US9798393B2 (en) 2011-08-29 2017-10-24 Apple Inc. Text correction processing
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US11069336B2 (en) 2012-03-02 2021-07-20 Apple Inc. Systems and methods for name pronunciation
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9953088B2 (en) 2012-05-14 2018-04-24 Apple Inc. Crowd sourcing information to fulfill user requests
US10079014B2 (en) 2012-06-08 2018-09-18 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9971774B2 (en) 2012-09-19 2018-05-15 Apple Inc. Voice-based media searching
US10199051B2 (en) 2013-02-07 2019-02-05 Apple Inc. Voice trigger for a digital assistant
US10978090B2 (en) 2013-02-07 2021-04-13 Apple Inc. Voice trigger for a digital assistant
US11388291B2 (en) 2013-03-14 2022-07-12 Apple Inc. System and method for processing voicemail
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US9922642B2 (en) 2013-03-15 2018-03-20 Apple Inc. Training an at least partial voice command system
US9697822B1 (en) 2013-03-15 2017-07-04 Apple Inc. System and method for updating an adaptive speech recognition model
US9620104B2 (en) 2013-06-07 2017-04-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
US9966060B2 (en) 2013-06-07 2018-05-08 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9633674B2 (en) 2013-06-07 2017-04-25 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
US9966068B2 (en) 2013-06-08 2018-05-08 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10657961B2 (en) 2013-06-08 2020-05-19 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10769385B2 (en) 2013-06-09 2020-09-08 Apple Inc. System and method for inferring user intent from speech inputs
US11048473B2 (en) 2013-06-09 2021-06-29 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10185542B2 (en) 2013-06-09 2019-01-22 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
US9300784B2 (en) 2013-06-13 2016-03-29 Apple Inc. System and method for emergency calls initiated by voice command
US10791216B2 (en) 2013-08-06 2020-09-29 Apple Inc. Auto-activating smart responses based on activities from remote devices
US11314370B2 (en) 2013-12-06 2022-04-26 Apple Inc. Method for extracting salient dialog usage from live data
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US10169329B2 (en) 2014-05-30 2019-01-01 Apple Inc. Exemplar-based natural language processing
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9966065B2 (en) 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US10657966B2 (en) 2014-05-30 2020-05-19 Apple Inc. Better resolution when referencing to concepts
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US11257504B2 (en) 2014-05-30 2022-02-22 Apple Inc. Intelligent assistant for home automation
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US11133008B2 (en) 2014-05-30 2021-09-28 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10699717B2 (en) 2014-05-30 2020-06-30 Apple Inc. Intelligent assistant for home automation
US10497365B2 (en) 2014-05-30 2019-12-03 Apple Inc. Multi-command single utterance input method
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10714095B2 (en) 2014-05-30 2020-07-14 Apple Inc. Intelligent assistant for home automation
US10083690B2 (en) 2014-05-30 2018-09-25 Apple Inc. Better resolution when referencing to concepts
US10417344B2 (en) 2014-05-30 2019-09-17 Apple Inc. Exemplar-based natural language processing
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US9668024B2 (en) 2014-06-30 2017-05-30 Apple Inc. Intelligent automated assistant for TV user interactions
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10904611B2 (en) 2014-06-30 2021-01-26 Apple Inc. Intelligent automated assistant for TV user interactions
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US10431204B2 (en) 2014-09-11 2019-10-01 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US10438595B2 (en) 2014-09-30 2019-10-08 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9986419B2 (en) 2014-09-30 2018-05-29 Apple Inc. Social reminders
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10453443B2 (en) 2014-09-30 2019-10-22 Apple Inc. Providing an indication of the suitability of speech recognition
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US10390213B2 (en) 2014-09-30 2019-08-20 Apple Inc. Social reminders
US11556230B2 (en) 2014-12-02 2023-01-17 Apple Inc. Data detection
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US11231904B2 (en) 2015-03-06 2022-01-25 Apple Inc. Reducing response latency of intelligent automated assistants
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US10311871B2 (en) 2015-03-08 2019-06-04 Apple Inc. Competing devices responding to voice triggers
US11087759B2 (en) 2015-03-08 2021-08-10 Apple Inc. Virtual assistant activation
US10529332B2 (en) 2015-03-08 2020-01-07 Apple Inc. Virtual assistant activation
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US11127397B2 (en) 2015-05-27 2021-09-21 Apple Inc. Device voice control
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10356243B2 (en) 2015-06-05 2019-07-16 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US11500672B2 (en) 2015-09-08 2022-11-15 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US11526368B2 (en) 2015-11-06 2022-12-13 Apple Inc. Intelligent automated assistant in a messaging environment
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10354652B2 (en) 2015-12-02 2019-07-16 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US11069347B2 (en) 2016-06-08 2021-07-20 Apple Inc. Intelligent automated assistant for media exploration
US10354011B2 (en) 2016-06-09 2019-07-16 Apple Inc. Intelligent automated assistant in a home environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US11037565B2 (en) 2016-06-10 2021-06-15 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10733993B2 (en) 2016-06-10 2020-08-04 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US11152002B2 (en) 2016-06-11 2021-10-19 Apple Inc. Application integration with a digital assistant
US10297253B2 (en) 2016-06-11 2019-05-21 Apple Inc. Application integration with a digital assistant
US10089072B2 (en) 2016-06-11 2018-10-02 Apple Inc. Intelligent device arbitration and control
US10269345B2 (en) 2016-06-11 2019-04-23 Apple Inc. Intelligent task discovery
US10580409B2 (en) 2016-06-11 2020-03-03 Apple Inc. Application integration with a digital assistant
US10521466B2 (en) 2016-06-11 2019-12-31 Apple Inc. Data driven natural language event detection and classification
US10942702B2 (en) 2016-06-11 2021-03-09 Apple Inc. Intelligent device arbitration and control
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10553215B2 (en) 2016-09-23 2020-02-04 Apple Inc. Intelligent automated assistant
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10332518B2 (en) 2017-05-09 2019-06-25 Apple Inc. User interface for correcting recognition errors
US10847142B2 (en) 2017-05-11 2020-11-24 Apple Inc. Maintaining privacy of personal information
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US10755703B2 (en) 2017-05-11 2020-08-25 Apple Inc. Offline personal assistant
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10789945B2 (en) 2017-05-12 2020-09-29 Apple Inc. Low-latency intelligent automated assistant
US10791176B2 (en) 2017-05-12 2020-09-29 Apple Inc. Synchronization and task delegation of a digital assistant
US11405466B2 (en) 2017-05-12 2022-08-02 Apple Inc. Synchronization and task delegation of a digital assistant
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models
US10810274B2 (en) 2017-05-15 2020-10-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US10482874B2 (en) 2017-05-15 2019-11-19 Apple Inc. Hierarchical belief states for digital assistants
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US11217255B2 (en) 2017-05-16 2022-01-04 Apple Inc. Far-field extension for digital assistant services
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US11009970B2 (en) 2018-06-01 2021-05-18 Apple Inc. Attention aware virtual assistant dismissal
US10403283B1 (en) 2018-06-01 2019-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
US10984798B2 (en) 2018-06-01 2021-04-20 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11495218B2 (en) 2018-06-01 2022-11-08 Apple Inc. Virtual assistant operation in multi-device environments
US10684703B2 (en) 2018-06-01 2020-06-16 Apple Inc. Attention aware virtual assistant dismissal
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US10504518B1 (en) 2018-06-03 2019-12-10 Apple Inc. Accelerated task performance
US10944859B2 (en) 2018-06-03 2021-03-09 Apple Inc. Accelerated task performance
WO2020017518A1 (en) * 2018-07-20 2020-01-23 株式会社ソニー・インタラクティブエンタテインメント Audio signal processing device
JPWO2020017518A1 (en) * 2018-07-20 2021-08-05 株式会社ソニー・インタラクティブエンタテインメント Audio signal processor
US11749293B2 (en) 2018-07-20 2023-09-05 Sony Interactive Entertainment Inc. Audio signal processing device
JP7362766B2 (en) 2019-11-19 2023-10-17 株式会社ソニー・インタラクティブエンタテインメント operation device
JP7362765B2 (en) 2019-11-19 2023-10-17 株式会社ソニー・インタラクティブエンタテインメント operation device

Similar Documents

Publication Publication Date Title
JP2008236448A (en) Sound signal processing device, hands-free calling device, sound signal processing method, and control program
CN109147815B (en) System and method for selective volume adjustment in a vehicle
US8019454B2 (en) Audio processing system
US9264527B2 (en) Hands-free telephone conversation apparatus
CN106231497B (en) Vehicle-mounted loudspeaker playing volume adjusting device and method and vehicle
CN109273006B (en) Voice control method of vehicle-mounted system, vehicle and storage medium
US20150365771A1 (en) Vehicle communiation with a hearing aid device
CN1821911A (en) Vehicle-state based parameter adjustment system
JP2012025270A (en) Apparatus for controlling sound volume for vehicle, and program for the same
JP5292345B2 (en) Sound reproduction device having automatic sound quality adjustment function and hands-free telephone device incorporating the same
US8280450B2 (en) Hands-free phone-call device and tone quality control device
JP2012203122A (en) Voice selection device, and media device and hands-free talking device using the same
JP2013531273A (en) Method for adjusting a speech recognition system comprising a speaker and a microphone, and a speech recognition system
JP4381291B2 (en) Car audio system
JP2007043356A (en) Device and method for automatic sound volume control
JP2010141468A (en) Onboard acoustic apparatus
JP2010263401A (en) Handsfree speech communication device, and voice correcting method of the device
CN101192812A (en) Onboard audio volume control device and method
JP2006033700A (en) In-car hands-free speaking device
JP2008252722A (en) Handsfree device, control method therefor, and control program
JP7084899B2 (en) In-vehicle device
KR20170053252A (en) Apparatus and method for improving the sound quality during driving.
KR20040006850A (en) Circuit for processing voice of audio system having handsfree function and method thereof
WO2018047294A1 (en) Vehicle audio recording control apparatus and vehicle audio recording control system
JP2008034928A (en) Sound input/output device and program