JP2016137203A - Control device for coping with feeling of passenger for vehicle - Google Patents
Control device for coping with feeling of passenger for vehicle Download PDFInfo
- Publication number
- JP2016137203A JP2016137203A JP2015015338A JP2015015338A JP2016137203A JP 2016137203 A JP2016137203 A JP 2016137203A JP 2015015338 A JP2015015338 A JP 2015015338A JP 2015015338 A JP2015015338 A JP 2015015338A JP 2016137203 A JP2016137203 A JP 2016137203A
- Authority
- JP
- Japan
- Prior art keywords
- occupant
- emotion
- passengers
- occupants
- feeling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010485 coping Effects 0.000 title abstract 3
- 230000006872 improvement Effects 0.000 claims abstract description 21
- 230000007704 transition Effects 0.000 claims abstract description 5
- 230000008451 emotion Effects 0.000 claims description 202
- 230000001953 sensory effect Effects 0.000 claims description 20
- 230000006397 emotional response Effects 0.000 claims description 7
- 230000006698 induction Effects 0.000 claims description 6
- 230000001939 inductive effect Effects 0.000 claims 1
- 238000001514 detection method Methods 0.000 abstract description 9
- 230000035807 sensation Effects 0.000 abstract description 9
- 230000002996 emotional effect Effects 0.000 description 35
- 238000000034 method Methods 0.000 description 31
- 230000008569 process Effects 0.000 description 29
- 230000000694 effects Effects 0.000 description 23
- 230000008859 change Effects 0.000 description 20
- 230000000875 corresponding effect Effects 0.000 description 18
- 230000006866 deterioration Effects 0.000 description 16
- 230000009471 action Effects 0.000 description 13
- 238000005286 illumination Methods 0.000 description 12
- 230000006399 behavior Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 239000012141 concentrate Substances 0.000 description 6
- 239000005357 flat glass Substances 0.000 description 6
- 230000017531 blood circulation Effects 0.000 description 5
- 230000008921 facial expression Effects 0.000 description 5
- 230000006996 mental state Effects 0.000 description 5
- 230000007423 decrease Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000014509 gene expression Effects 0.000 description 4
- 210000001747 pupil Anatomy 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 206010041349 Somnolence Diseases 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000002542 deteriorative effect Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 201000003152 motion sickness Diseases 0.000 description 3
- 238000002834 transmittance Methods 0.000 description 3
- 206010010774 Constipation Diseases 0.000 description 2
- 241000052343 Dares Species 0.000 description 2
- 230000002411 adverse Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000003066 decision tree Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 210000000887 face Anatomy 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000029058 respiratory gaseous exchange Effects 0.000 description 2
- 230000036387 respiratory rate Effects 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 230000001914 calming effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 230000015654 memory Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000452 restraining effect Effects 0.000 description 1
- 230000004936 stimulating effect Effects 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Landscapes
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
本発明は、車両用乗員感情対応制御装置に関し、特に運転者と同乗者の感情を両立可能な車両用乗員感情対応制御装置に関する。 The present invention relates to a vehicle occupant emotion response control device, and more particularly to a vehicle occupant emotion response control device capable of achieving both driver and passenger emotions.
従来より、乗員の望む形態で車載装置の動作を車両が自律的に制御する車両用もてなしシステムが知られている。
特許文献1の車両用もてなしシステムは、乗員の生体情報を取得する生体情報取得手段と、乗員の生体情報に基づいて乗員の体調・精神状態を特定する体調・精神状態特定手段と、特定された体調・精神状態に基づいてもてなし動作部によるもてなし動作の内容を定めるもてなし意思決定部と、対応するもてなし動作部の動作制御を行うもてなし実行制御部とを備えている。これにより、もてなし対象者である乗員が個々のシーンで欲する種類のもてなし内容を車両が自律的に実行している。
Conventionally, a hospitality system for a vehicle in which the vehicle autonomously controls the operation of the in-vehicle device in a form desired by an occupant is known.
The vehicle hospitality system disclosed in Patent Literature 1 is identified with biometric information acquisition means for acquiring biometric information of the occupant, and physical condition / mental state specifying means for specifying the physical condition / mental state of the occupant based on the biometric information of the occupant. A hospitality determination unit that determines the content of the hospitality operation by the hospitality operation unit based on the physical condition / mental state, and a hospitality execution control unit that controls the operation of the corresponding hospitality operation unit. As a result, the vehicle autonomously executes the type of hospitality content desired by the occupant who is the subject of hospitality in each scene.
特許文献2のユーザの心理状態判断装置は、スマートフォン等の移動端末を保持したユーザを対象にしたものであるが、ユーザ動作に基づくセンサデータから特徴データを抽出するデータ処理部と、特徴データを推論モデルに適用して心理状態を判断する心理状態判断部と、心理状態に適合した措置を実行する措置実行部とを備えている。心理状態判断部は、特徴データを指導学習アルゴリズム(決定木等)の1つを用いた推論モデルに適用して心理状態を判断している。 The psychological state determination device for a user in Patent Literature 2 is intended for a user who holds a mobile terminal such as a smartphone. A data processing unit that extracts feature data from sensor data based on user actions, and a feature data It includes a psychological state determination unit that applies the inference model to determine a psychological state, and a measure execution unit that executes a measure that is adapted to the psychological state. The psychological state determination unit determines the psychological state by applying the feature data to an inference model using one of the teaching learning algorithms (such as a decision tree).
複数の乗員が一緒にドライブする際、乗車前の状況や休憩中の状況或いはその時の体調等が乗員毎に異なるため、同乗している乗員の感情も異なっていることが少なくない。
このような場合、運転者は、走行中、各々の同乗者への気配りを余儀なくされることから、同乗者の感情を独自に推測し、自己の感情(要求)に反した運転を行うことがある。
例えば、運転者は山岳路を軽快に走行したい状況でも、同乗者は景色を楽しみたいと運転者が独自に推測したとき、運転者は敢えて低速する場合、或いは運転者は先行車両を追い越したい状況でも、同乗者は高速を怖がっていると運転者が独自に推測したとき、運転者は敢えて追従走行する場合等である。このような場合には、運転者は、車両を運転することによる楽しみや喜び或いは同乗者との一体感等、所謂運転に伴う走行中のわくわく感を十分に得ることができない。しかも、運転者は独自に推測しているため、実際に同乗者は運転者が推測したように感じていない虞もある。
When a plurality of occupants drive together, the situation before boarding, the situation during a break, or the physical condition at that time are different for each occupant.
In such a case, the driver is forced to pay attention to each passenger while traveling, so the driver's feelings can be estimated independently and driving contrary to his own feelings (requests) can be performed. is there.
For example, even if the driver wants to drive lightly on a mountain road, when the driver originally guesses that he wants to enjoy the scenery, the driver dares to slow down, or the driver wants to overtake the preceding vehicle However, when the driver independently estimates that the passenger is afraid of high speed, the driver dares to follow. In such a case, the driver cannot sufficiently obtain the excitement during driving accompanying so-called driving, such as pleasure and pleasure by driving the vehicle or a sense of unity with the passenger. In addition, since the driver makes an assumption, the passenger may not actually feel as if the driver has made an assumption.
特許文献1の車両用もてなしシステムでは、もてなし対象者が運転者或いは序列順位が最も上位に位置する乗員に予め一義的に設定されているため、もてなし対象者である乗員は個々の運転状況(シーン)に応じて感情の改善が図られている。
しかし、もてなし対象者以外の乗員の感情変化は一切考慮されていない。
即ち、もてなし対象者が運転者の場合、同乗者の感情が悪化する虞があり、もてなし対象者が特定の同乗者の場合、運転者の感情が悪化する虞がある。
しかも、もてなし対象者ではない乗員は感情が悪化しているにも拘らず積極的に乗車状況が改善されないため、感情が悪化した乗員によって他の乗員の感情が悪影響を受けることから、結果的に、全ての乗員が走行中のわくわく感を満喫できないことも考えられる。
In the vehicle hospitality system of Patent Literature 1, the hospitality target person is uniquely set in advance to the driver or the occupant with the highest ranking, so that the occupant who is the hospitality target person has an individual driving situation (scene ) To improve emotions.
However, changes in the emotions of passengers other than the hospitality target are not considered at all.
That is, when the hospitality target person is a driver, the passenger's feelings may deteriorate, and when the hospitality target person is a specific passenger, the driver's feelings may deteriorate.
In addition, since the passengers who are not subject to hospitality do not actively improve their riding conditions despite their worsening emotions, the emotions of other passengers are adversely affected by the passengers whose emotions deteriorated. It is also possible that not all passengers can enjoy the excitement while driving.
本発明の目的は、多人数走行中の同乗者の感情改善を図りつつ、運転者も良好な運転感覚を得ることができる車両用乗員感情対応制御装置等を提供することである。 An object of the present invention is to provide a vehicle occupant emotion response control device and the like that can improve the feelings of passengers traveling with a large number of passengers and also allow the driver to obtain a good driving feeling.
請求項1の車両用乗員感情対応制御装置は、運転者と同乗者からなる複数の乗員の複数種類の生体情報を夫々検出する生体情報検出手段と、前記生体情報検出手段によって検出された生体情報に基づき前記複数の乗員の感情を夫々推定する感情推定手段と、前記複数の乗員の感情を改善可能な感情改善手段と、前記感情改善手段を制御する制御手段とを備えた車両用乗員感情対応制御装置において、前記感情推定手段が前記複数の乗員の感情変化の推移を乗員毎に記憶するマップ手段を備え、前記感情改善手段が前記運転者の運転動作を誘導する運転動作誘導部を有し、前記制御手段は、前記マップ手段に基づき前記同乗者の感情が不快方向へ移行することを抑制するように前記運転動作誘導部を制御することを特徴としている。 The vehicle occupant emotion control device according to claim 1 is a biometric information detecting means for detecting a plurality of types of biometric information of a plurality of occupants comprising a driver and a passenger, and biometric information detected by the biometric information detecting means. Vehicle occupant emotion correspondence comprising: an emotion estimation means for estimating the emotions of each of the plurality of passengers based on the above; an emotion improvement means capable of improving the emotions of the plurality of passengers; and a control means for controlling the emotion improvement means In the control device, the emotion estimation unit includes a map unit that stores, for each occupant, changes in the emotions of the plurality of occupants, and the emotion improvement unit includes a driving operation guidance unit that guides the driving operation of the driver. The control means controls the driving operation guiding section so as to suppress the passenger's emotion from shifting in an uncomfortable direction based on the map means.
この車両用乗員感情対応制御装置では、感情推定手段が前記複数の乗員の感情変化の推移を乗員毎に記憶するマップ手段を備えているため、複数の乗員毎の感情変化の推移を容易且つ正確に追跡することができ、高精度の感情推定を行うことができる。
感情改善手段が運転者の運転動作を誘導する運転動作誘導部を有し、制御手段は、前記マップ手段に基づき前記同乗者の感情が不快方向へ移行することを抑制するように前記運転動作誘導部を制御するため、運転者を違和感なく所定の運転動作に誘導でき、同乗者の感情を悪化させることなく、運転者の感情悪化を防止することができる。
In this vehicle occupant emotion correspondence control apparatus, since the emotion estimation means includes a map means for storing the change in emotion of each of the plurality of passengers for each passenger, the change in emotion change for each of the plurality of passengers can be easily and accurately performed. It is possible to track emotions accurately and to estimate emotions with high accuracy.
The emotion improving means has a driving action guiding section for guiding the driving action of the driver, and the control means guides the driving action so as to suppress the passenger's feeling from moving in an uncomfortable direction based on the map means. Since the vehicle is controlled, the driver can be guided to a predetermined driving motion without feeling uncomfortable, and the driver's emotional deterioration can be prevented without deteriorating the passenger's emotion.
請求項2の発明は、請求項1の発明において、前記感情改善手段が前記複数の乗員に作用する複数の感覚誘導部を有し、前記複数の感覚誘導部は、前記複数の乗員が共通に知覚可能な誘導媒体を出力可能な複数の共通感覚誘導部と前記複数の乗員が個々に知覚可能な誘導媒体を出力可能な複数の個別感覚誘導部とを備えていることを特徴としている。
この構成によれば、全乗員又は個別の乗員の区別に拘らず感情が改善されるべき乗員の感情を早期に改善することができる。
According to a second aspect of the present invention, in the first aspect of the present invention, the emotion improving means has a plurality of sensory guidance sections that act on the plurality of occupants, and the plurality of sensory guidance sections are shared by the plurality of occupants. It is characterized by comprising a plurality of common sensory guidance units capable of outputting perceptible guidance media and a plurality of individual sensory guidance units capable of outputting guidance media perceptible to the plurality of passengers individually.
According to this configuration, it is possible to quickly improve the feeling of the occupant whose feeling should be improved regardless of the distinction between all occupants or individual occupants.
請求項3の発明は、請求項1又は2の発明において、前記制御手段は、前記乗員のうち他の乗員に優先して感情が改善されるべき優先乗員を決定する優先乗員決定手段を有し、前記優先乗員決定手段は生理的要求が発生した乗員を優先して優先乗員に決定することを特徴としている。
この構成によれば、運転者に負担を掛けることなく、車両側が自律的に感情が改善されるべき優先乗員を決定することができ、緊急性を要する乗員の感情を優先して改善することができる。
The invention according to claim 3 is the invention according to claim 1 or 2, wherein the control means includes priority occupant determination means for deciding a priority occupant whose emotion should be improved in preference to other occupants. The priority occupant determining means is characterized in that a priority occupant is determined with priority given to a occupant having a physiological request.
According to this configuration, the vehicle side can autonomously determine the priority occupant whose emotion should be improved without imposing a burden on the driver, and the urgent occupant's emotion can be prioritized and improved. it can.
本発明の車両用乗員感情対応制御装置によれば、多人数走行中の同乗者の感情改善を図りつつ、運転者も良好な運転感覚を得ることができる。 According to the vehicle occupant emotion control device for a vehicle of the present invention, the driver can also obtain a good driving feeling while improving the feelings of passengers traveling with a large number of people.
以下、本発明の実施形態を図面に基づいて詳細に説明する。
以下の説明は、本発明を車両Vに適用したものを例示したものであり、本発明、その適用物、或いは、その用途を制限するものではない。
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
The following description exemplifies a case where the present invention is applied to the vehicle V, and does not limit the present invention, its application, or its use.
以下、本発明の実施例1について図1〜図11に基づいて説明する。
乗員感情対応制御装置1は、車両Vに乗車することによって、運転者と同乗者が共にわくわく感を感じるように車両Vから自律的に乗員感情に働きかける乗員支援装置である。
図1,図2に示すように、この乗員感情対応制御装置1は、運転者である乗員P1と助手席に着座した乗員P2と左右後部座席に夫々着座した乗員P3,P4の複数種類の生体情報を夫々検出する生体情報検出手段2と、これら生体情報検出手段2によって検出された生体情報に基づき乗員P1〜P4の感情を夫々推定する感情推定手段11と、乗員P1〜P4の精神的な感情を改善可能な感情改善手段3と、これら感情改善手段3を制御する制御手段12等を備えている。
Embodiment 1 of the present invention will be described below with reference to FIGS.
The occupant emotion control device 1 is an occupant support device that autonomously works on occupant emotions from the vehicle V so that both the driver and the passenger feel excited by getting on the vehicle V.
As shown in FIGS. 1 and 2, this occupant emotion control device 1 is composed of a plurality of types of living bodies, that is, an occupant P1 as a driver, an occupant P2 seated in a passenger seat, and occupants P3 and P4 seated in left and right rear seats, respectively. Biological information detection means 2 for detecting information, emotion estimation means 11 for estimating the feelings of the occupants P1 to P4 based on the biological information detected by the biological information detection means 2, and the mentality of the occupants P1 to P4, respectively. Emotion improvement means 3 capable of improving emotions, and control means 12 for controlling these emotion improvement means 3 are provided.
まず、生体情報検出手段2について説明する。
図1,図2に示すように、生体情報検出手段2は、主に、車両Vの前方を含む周辺風景を撮像する車外カメラ21と、乗員P1,P2を夫々撮像する1対の前席用カメラ22a,22bと、乗員P3,P4を夫々撮像する1対の後席用カメラ22c,22dと、乗員P1〜P4が夫々携帯しているスマートフォンからなるユーザ端末23と、運転支援装置24等を備えている。
First, the biological information detection unit 2 will be described.
As shown in FIGS. 1 and 2, the biological information detecting means 2 is mainly used for a vehicle exterior camera 21 that captures the surrounding scenery including the front of the vehicle V, and a pair of front seats that respectively capture the passengers P1 and P2. A camera 22a, 22b, a pair of rear-seat cameras 22c, 22d for imaging the passengers P3, P4, a user terminal 23 composed of a smartphone carried by each of the passengers P1-P4, a driving support device 24, etc. I have.
車外カメラ21及びカメラ22a〜22dで撮像された画像は、静止画及び動画を記憶可能な記録部15に夫々蓄積されている。
前席用カメラ22a,22bは、例えばインスツルメントパネルの上部に夫々装着され、乗員P1,P2の顔を含む上半身を夫々撮像する。撮像された上半身の画像は、顔部分の画像を切り出して表情の特定、目のアイリス(虹彩)を拡大検出して瞳孔寸法と視線方向の特定、画像の重心位置と乗員P1,P2の上半身の形状に基づいて姿勢の特定に用いられる。同様に、後席用カメラ22c,22dは、例えば左右のシートバックモニタ39の近傍位置に夫々装着され、乗員P3,P4の顔を含む上半身を夫々撮像する。撮像された上半身の画像は、顔部分の画像を切り出して表情の特定、目のアイリスを拡大検出して瞳孔寸法と視線方向の特定、画像の重心位置と乗員P3,P4の上半身の形状に基づいて姿勢の特定に用いられる。
Images captured by the outside camera 21 and the cameras 22a to 22d are stored in the recording unit 15 that can store still images and moving images, respectively.
The front seat cameras 22a and 22b are mounted, for example, on the upper part of the instrument panel, respectively, and respectively image the upper body including the faces of the passengers P1 and P2. The captured upper body image is a facial image cut out to specify facial expressions, eye iris (iris) is enlarged to detect pupil dimensions and line-of-sight direction, the center of gravity position of the image and the upper body of passengers P1 and P2 Used to specify the posture based on the shape. Similarly, the rear seat cameras 22c and 22d are mounted, for example, in the vicinity of the left and right seat back monitors 39, respectively, and image the upper body including the faces of the passengers P3 and P4. The captured upper body image is based on the face image cut out to specify facial expression, the iris of the eye is enlarged and the pupil size and line-of-sight direction specified, the center of gravity position of the image and the shape of the upper body of the occupants P3 and P4 Used to identify the posture.
ユーザ端末23は、各種情報を外部サーバ25を介して又は直接的に車両Vと通信可能に構成されている。このユーザ端末23は、乗員P1〜P4の心拍数を取得する心拍センサと、呼吸数を取得する呼吸センサと、血流速度を取得する血流速度センサと、皮膚電気抵抗値を取得する皮膚電気抵抗センサを備えている(何れも図示略)。
ユーザ端末23は、GNSS(Global Navigation Satellite System)機能と商品購入の決済機能等を備え、乗員P1〜P4の歩行距離、歩行時間、所定位置における滞在時間、商品の取引履歴等に関する行動履歴を取得可能である。
また、このユーザ端末23は、乗員P1〜P4のキーボード入力情報と筆記入力情報を検出可能に構成されている。キーボード入力情報は、キーボードへのタイプ速度、削除されたテキスト長、特殊記号の使用頻度、打ち間違い率等であり、筆記入力情報は、ペン入力時の筆記入力速度、平均筆圧、筆記入力規則性、入力キーワード等である。
しかも、予めドライブアプリが導入されたユーザ端末23は、スケジューラに入力されたスケジュール情報によって、ドライブの日程、出発時刻、所要(走行)時間、同乗者情報(家族、客等の種別)を検出可能に構成されている。ユーザ端末23は、インスツルメントパネル内のアンテナ(図示略)とbluetooth(登録商標)による通信によってスケジュール情報を車両Vに伝達する。
The user terminal 23 is configured to be able to communicate various information via the external server 25 or directly with the vehicle V. The user terminal 23 includes a heart rate sensor that acquires the heart rate of the passengers P1 to P4, a respiration sensor that acquires a respiration rate, a blood flow rate sensor that acquires a blood flow rate, and an electrical skin that acquires a skin electrical resistance value. A resistance sensor is provided (both not shown).
The user terminal 23 has a GNSS (Global Navigation Satellite System) function and a product purchase settlement function, etc., and obtains an action history related to the walking distance, walking time, staying time at a predetermined position, merchandise transaction history, etc. of the passengers P1 to P4. Is possible.
Moreover, this user terminal 23 is comprised so that detection of the keyboard input information and writing input information of passenger | crew P1-P4 is possible. Keyboard input information includes keyboard typing speed, deleted text length, use frequency of special symbols, typing error rate, etc. Written input information includes writing input speed, average writing pressure, and writing input rules for pen input. And input keywords.
Moreover, the user terminal 23 in which the drive application has been introduced in advance can detect the driving schedule, departure time, required (running) time, and passenger information (type of family, customer, etc.) based on the schedule information input to the scheduler. It is configured. The user terminal 23 transmits schedule information to the vehicle V by communication using an antenna (not shown) in the instrument panel and bluetooth (registered trademark).
運転支援装置24は、車両Vの走行状態を判定し、所定の運転操作状態に関する運転評価情報をメータパネル4に表示するスマートドライブサポートシステムである。
この運転支援装置24は、乗員P1の運転状態を所定の判定基準によって、適度な加速度変化のあるしなやかな運転状態と、急激な加速度変化のあるゆれる運転状態と、ゆっくりな加速度変化のあるやさしい運転状態とに分類し、この判定結果をメータパネル4に表示している。乗員P1は、この情報に基づいて学習することにより、運転操作の技術を向上することができる。尚、運転支援装置24の具体的な構成は、本出願人が既に出願しているため、詳細な説明を省略する(特開2012−106714号公報参照)。
The driving support device 24 is a smart drive support system that determines the driving state of the vehicle V and displays driving evaluation information related to a predetermined driving operation state on the meter panel 4.
The driving support device 24 uses the predetermined determination criteria for the driving state of the occupant P1, a supple driving state with a moderate acceleration change, a swaying driving state with a sudden acceleration change, and a gentle driving with a slow acceleration change. The determination result is displayed on the meter panel 4. The occupant P1 can improve the driving skill by learning based on this information. In addition, since the present applicant has already applied for the specific structure of the driving assistance device 24, detailed description is abbreviate | omitted (refer Unexamined-Japanese-Patent No. 2012-106714).
次に、感情改善手段3について説明する。
感情改善手段3は、乗員P1〜P4の五感に作用する感覚を介して乗員P1〜P4の感情を改善可能に構成されている。
図1,図2に示すように、感情改善手段3は、乗員P1〜P4に作用する複数の車載装置としての感覚誘導部31〜39を有し、感覚誘導部31〜39は、乗員P1〜P4が共通に知覚可能な誘導媒体を出力可能な複数の共通感覚誘導部3aと、乗員P1〜P4が個別に知覚可能な誘導媒体を出力可能な複数の個別感覚誘導部3bとを備えている。
Next, the emotion improving means 3 will be described.
The emotion improving means 3 is configured to be able to improve the feelings of the passengers P1 to P4 through the senses acting on the five senses of the passengers P1 to P4.
As shown in FIGS. 1 and 2, the emotion improving means 3 includes sensory guidance units 31 to 39 as a plurality of in-vehicle devices that act on passengers P1 to P4, and the sensory guidance units 31 to 39 are passengers P1 to P1. P4 includes a plurality of common sensory guidance units 3a capable of outputting a guidance medium that can be perceived in common by P4, and a plurality of individual sensory guidance units 3b capable of outputting guidance media that can be individually perceived by passengers P1 to P4. .
共通感覚誘導部3aは、乗員P1〜P4に夫々対応した送風口を有する空調装置31と、車体側に設けられたオーディオシステムの一部を構成するスピーカ32と、左右1対のヘッドライト34と、窓枠可変装置35と、可変ステアリング装置36等を備えている。
共通感覚誘導部3aは、乗員P1の運転動作を誘導する運転動作誘導部3cを有している。運転動作誘導部3cは、ヘッドライト34、窓枠可変装置35、可変ステアリング装置36、ディスプレイモニタ37(以下、モニタ37と略す)を有するナビゲーションシステムとが相当している。
尚、乗員P1の運転動作を誘導する運転動作誘導部3cは、乗員P1にとっては個別感覚誘導部3bに相当するものの、乗員P2〜P4にとっては共通感覚誘導部3aに相当するため、本実施例では主に共通感覚誘導部3aに分類している。。
The common sensation guiding unit 3a includes an air conditioner 31 having an air outlet corresponding to each of the passengers P1 to P4, a speaker 32 constituting a part of an audio system provided on the vehicle body side, and a pair of left and right headlights 34. A window frame variable device 35, a variable steering device 36, and the like are provided.
The common sense induction unit 3a includes a driving operation induction unit 3c that guides the driving operation of the occupant P1. The driving operation guidance unit 3c corresponds to a navigation system having a headlight 34, a window frame variable device 35, a variable steering device 36, and a display monitor 37 (hereinafter abbreviated as a monitor 37).
The driving operation guiding unit 3c for guiding the driving operation of the occupant P1 corresponds to the individual sensation guiding unit 3b for the occupant P1, but corresponds to the common sensation guiding unit 3a for the occupants P2 to P4. In FIG. 4, the common sensory guidance unit 3a is mainly classified. .
LEDヘッドライトを用いているヘッドライト34は、乗員P1に生じる緊張状態を緩和するため、車道外に設置された反射板からの反射光の発生を抑制する運転支援装置の一部を構成している。このヘッドライト34は、乗員P1が緊張状態であり且つ車両Vの前方の周辺状況が乗員P1を緊張させる状況(例えば路肩等に設置された反射板からの反射光の発生)のとき、ロービームLEDの照射範囲を下方向へ自律的に移動させるように構成されている。尚、ヘッドライト34に係る運転支援装置の具体的な構成は、本出願人が既に出願しているため、詳細な説明を省略する(特願2014−247801号参照)。 The headlight 34 using the LED headlight constitutes a part of a driving support device that suppresses the generation of reflected light from the reflector installed outside the roadway in order to relieve the tension state generated in the occupant P1. Yes. The headlight 34 is a low-beam LED when the occupant P1 is in a tensioned state and the surrounding situation in front of the vehicle V causes the occupant P1 to be tensed (for example, generation of reflected light from a reflector installed on a road shoulder). Is configured to autonomously move the irradiation range downward. The specific configuration of the driving support device related to the headlight 34 has already been filed by the present applicant, and thus detailed description thereof is omitted (see Japanese Patent Application No. 2014-247801).
窓枠可変装置35は、フロントウインドガラスを介した視界の増減によって、乗員P1の知覚速度を人為的に増加又は減少させることができ、乗員P1に高い運転技量の運転操作を経験させることができる運転支援装置である。この窓枠可変装置35は、フロントウインドガラスの両端部分の透過率が多段階に変更可能に形成され、両端部分の透過率を低下(視界減少)させることにより乗員P1の知覚速度を減少させ、両端部分の透過率を増加(視界拡大)させることにより乗員P1の知覚速度を増加させるように構成されている。
尚、窓枠可変装置35に係る運転支援装置の具体的な構成は、本出願人が既に出願しているため、詳細な説明を省略する(特願2014−120871号参照)。
The window frame varying device 35 can artificially increase or decrease the perceived speed of the occupant P1 by increasing or decreasing the field of view through the front window glass, and can cause the occupant P1 to experience a driving operation with a high driving skill. It is a driving assistance device. The window frame variable device 35 is formed so that the transmittance of both end portions of the front window glass can be changed in multiple stages, and the perceived speed of the occupant P1 is decreased by reducing the transmittance of both end portions (reducing the field of view). It is configured to increase the perceived speed of the occupant P1 by increasing the transmittance at both ends (expanding the field of view).
In addition, since the present applicant has already applied for the specific structure of the driving assistance apparatus which concerns on the window frame variable apparatus 35, detailed description is abbreviate | omitted (refer Japanese Patent Application No. 2014-120871).
可変ステアリング装置36は、車両Vが乗員P1の精神状態を自動判定又は乗員P1が自己選択して、ステアリングホイール5の操作感覚を切替える運転支援装置である。
この可変ステアリング装置36は、乗員P1がわくわく感、軽快感、重厚感、リニア感を夫々知覚可能な操舵力特性を設定し、選択された操舵フィーリングに応じてステアリングホイール5の操作感覚を変更するように構成されている。
尚、可変ステアリング装置36に係る運転支援装置の具体的な構成は、本出願人が既に出願しているため、詳細な説明を省略する(特願2014−099234号参照)。
The variable steering device 36 is a driving support device that automatically determines the mental state of the occupant P1 by the vehicle V or that the occupant P1 self-selects and switches the operation feeling of the steering wheel 5.
The variable steering device 36 sets steering force characteristics that allow the occupant P1 to perceive excitement, lightness, profoundness, and linearity, and changes the operation feeling of the steering wheel 5 according to the selected steering feeling. Is configured to do.
In addition, since the present applicant has already applied for the specific configuration of the driving support device related to the variable steering device 36, detailed description thereof is omitted (see Japanese Patent Application No. 2014-099234).
ナビゲーションシステムは、インスツルメントパネルの中段部に配設され、車両Vの位置検出器、地図データ入力器、音声出力用スピーカー、モニタ37等を備えている。
モニタ37は、カラー液晶表示器によって構成され、CDプレイヤ、HDDプレイヤ、テレビ、ナビゲーション等の動画を表示可能に構成されている。このモニタ37は、操作スイッチ群が表示されたタッチパネルと併用され、CDプレイヤ操作位置、HDDプレイヤ操作位置、テレビ操作位置、空調操作位置、ナビゲーション操作位置を接触操作することにより、各装置を起動させることができる。
The navigation system is disposed in the middle part of the instrument panel, and includes a position detector for the vehicle V, a map data input device, a sound output speaker, a monitor 37, and the like.
The monitor 37 is configured by a color liquid crystal display, and is configured to be able to display moving images such as a CD player, an HDD player, a television, and navigation. This monitor 37 is used in combination with a touch panel on which a group of operation switches is displayed, and activates each device by touching the CD player operation position, the HDD player operation position, the television operation position, the air conditioning operation position, and the navigation operation position. be able to.
個別感覚誘導部3bは、4つの照明装置33と、各座席のヘッドレストに夫々配設された4つの個別スピーカ38と、左右前部座席の後部に夫々配設された左右1対のシートバックモニタ39等を備えている。
4つの照明装置33は、各座席側方のピラーに夫々設けられ、乗員P1〜P4に夫々対応するように配設されている。これら照明装置33は、照明光の周波数及び光量が調整可能に構成されている。照明光は、波長の長い赤系、中波長の緑系、波長の短い青系に多段階に切替えることができ、光量を多段階に切替えることができる。
The individual sensory guidance unit 3b includes four lighting devices 33, four individual speakers 38 disposed on the headrest of each seat, and a pair of left and right seat back monitors disposed on the rear of the left and right front seats, respectively. 39 etc.
The four lighting devices 33 are respectively provided in the pillars on the side of each seat, and are arranged so as to correspond to the passengers P1 to P4, respectively. These illuminating devices 33 are configured such that the frequency and amount of illumination light can be adjusted. The illumination light can be switched in multiple stages to a long wavelength red system, a medium wavelength green system, and a short wavelength blue system, and the amount of light can be switched in multiple stages.
個別スピーカ38は、出力される音声信号の位相特性を調整可能に夫々構成されている。
個別スピーカ38は、スピーカ32から出力される音声信号位相特性に対して互いに180度異なるように音声信号位相特性を設定することにより、個別スピーカ38に対応する乗員が認識するスピーカ32の音声(音量)を擬似的に消音することができ、また、ロードノイズの位相特性に対して同位相又は逆位相になるように音声信号位相特性を設定することにより、個別スピーカ38に対応する乗員が認識するロードノイズを擬似的に強調(増幅)又は消音することができる。
The individual speakers 38 are each configured to be capable of adjusting the phase characteristics of the output audio signal.
The individual speaker 38 sets the audio signal phase characteristics so that the audio signal phase characteristics output from the speakers 32 differ from each other by 180 degrees, so that the sound (volume) of the speakers 32 recognized by the occupant corresponding to the individual speakers 38 is obtained. ) Can be artificially silenced, and the audio signal phase characteristics are set so as to be the same phase or opposite phase with respect to the phase characteristics of the road noise, so that the occupant corresponding to the individual speaker 38 recognizes. Road noise can be artificially enhanced (amplified) or silenced.
シートバックモニタ39は、カラー液晶表示器によって構成され、CDプレイヤ、HDDプレイヤ、テレビ等の動画を表示可能に構成されている。このシートバックモニタ39は、操作スイッチ群が表示されたタッチパネルと併用され、CDプレイヤ操作位置、HDDプレイヤ操作位置、テレビ操作位置を接触操作することにより、各装置を起動させることができる。また、シートバックモニタ39及びモニタ37は、記録部15に蓄積された車外カメラ21によって撮像された車両Vの周辺画像や所定の交通事象のアニメーションを再生可能に構成されている。 The seat back monitor 39 is configured by a color liquid crystal display, and is configured to be able to display a moving image from a CD player, an HDD player, a television, or the like. The seat back monitor 39 is used in combination with a touch panel on which a group of operation switches is displayed, and can activate each device by touching the CD player operation position, the HDD player operation position, and the television operation position. In addition, the seatback monitor 39 and the monitor 37 are configured to be able to reproduce a surrounding image of the vehicle V and an animation of a predetermined traffic event captured by the outside camera 21 stored in the recording unit 15.
感情推定手段11及び制御手段12の説明の前に、わくわく感について説明する。
人の全感情(精神状態)は、快・不快の横軸と、活性・不活性の縦軸との2軸の平面(ラッセルの感情円環モデル)で表現することができる。
しかし、多人数走行中の車両Vでは、限られた車室内に、役割が異なる運転者、助手席同乗者、後席同乗者が存在しており、更に、同じ後席同乗者であっても、立場が異なる同乗者が存在する状況が発生することも少なくない。
本発明者が検討した結果、多人数走行中の車両Vでは、感情の同一性(x軸)と、期待感(y軸)と、達成感(z軸)の3軸で表現されるわくわく感が車両Vの車室内における感情判定に適していることを知見した(図4参照)。
Before describing the emotion estimation means 11 and the control means 12, an exciting feeling will be described.
The whole emotion (mental state) of a person can be expressed by a two-axis plane (Russell's emotional ring model), which is a horizontal axis of pleasure / discomfort and a vertical axis of active / inactive.
However, in the vehicle V in which a large number of people are traveling, there are a driver, a passenger seat passenger, and a rear seat passenger who have different roles in a limited vehicle interior, and even if the same rear seat passenger is present. In many cases, passengers with different positions may exist.
As a result of the study by the present inventor, in the vehicle V running with a large number of people, the excitement expressed by three axes of emotional identity (x axis), feeling of expectation (y axis), and feeling of achievement (z axis). Has been found to be suitable for emotion determination in the interior of the vehicle V (see FIG. 4).
感情の同一性は快の共感性、期待感は快の存在性、達成感は快の獲得性で定義することができる。これらの同一性、期待感、達成感は、人の感情を一般化したラッセルの感情円環モデルでは直接的に表現し難いため、重み付けした快度の値をX、重み付けした活性度の値をYとしたとき、快度X,活性度Yと同一性、期待感、達成感との各々の関係式を経験則によって次式のように求めている。
同一性=F(X,Y)
期待感=G(X,Y)
達成感=H(X,Y) …(1)
尚、Fは、X,Yで表すことができる同一性の3次元関係式、Gは、X,Yで表すことができる期待感の3次元関係式、Hは、X,Yで表すことができる達成感の3次元関係式である。
Emotion identity can be defined as pleasure sympathy, expectation as pleasure existence, and achievement as pleasure acquisition. These identity, expectation, and achievement are difficult to express directly in the Russell's emotional ring model that generalizes human emotions. Therefore, the weighted pleasure value is X, and the weighted activity value is When Y is assumed, the relational expressions of the pleasure X, the activity Y, the identity, the expectation, and the sense of accomplishment are obtained by the following equation based on empirical rules.
Identity = F (X, Y)
Expectation = G (X, Y)
Feeling of achievement = H (X, Y) (1)
Note that F is a three-dimensional relational expression of identity that can be represented by X and Y, G is a three-dimensional relational expression of expectation that can be represented by X and Y, and H is represented by X and Y. It is a three-dimensional relational expression of achievement feeling that can be achieved.
次に、感情推定手段11及び制御手段12について説明する。
感情推定手段11及び制御手段12は、車両V内のECU(Electric Control Unit)10によって構成され、CPU(Central Processing Unit)や、ROM、及びRAM等のメモリを有している。
Next, the emotion estimation unit 11 and the control unit 12 will be described.
The emotion estimation means 11 and the control means 12 are constituted by an ECU (Electric Control Unit) 10 in the vehicle V, and have memories such as a CPU (Central Processing Unit), ROM, and RAM.
感情推定手段11は、生体情報検出手段2によって検出された生体情報に基づき、予め定められた学習処理を用いて推定区間における乗員P1〜P4の感情を夫々推定可能に構成されている。ここで、学習処理には、例えば、SVM(Support Vector Machines)、決定木、k近傍法等から選択したアルゴリズムを用いている。 The emotion estimation means 11 is configured to be able to estimate the feelings of the passengers P1 to P4 in the estimation section based on the biological information detected by the biological information detection means 2, using a predetermined learning process. Here, for the learning process, for example, an algorithm selected from SVM (Support Vector Machines), a decision tree, a k-nearest neighbor method, or the like is used.
感情推定手段11は、カメラ22a〜22dで撮像した画像に基づき快度、不快度を検出している。快が高い順に表情の序列を決めたマスタ画像が予め準備され、その序列に従って快度Xが付与されているため、カメラ22a〜22dで撮像した画像とマスタ画像を比較することで乗員P1〜P4の快度Xを判定している。
図3(a)に示すように、乗員P1〜P4の表情以外に、視線方向変化数や姿勢変化数及び瞳孔径は快度Xと相関関係を有しているため、これら視線方向変化数や姿勢変化数及び瞳孔径によって乗員P1〜P4の快度Xを補正して高精度の快度Xを設定している。
The emotion estimation means 11 detects the degree of pleasure and the degree of discomfort based on images captured by the cameras 22a to 22d. Master images in which the order of facial expressions is determined in descending order are prepared in advance, and the degree of pleasure X is assigned in accordance with the order. Therefore, the images captured by the cameras 22a to 22d are compared with the master images, thereby occupants P1 to P4. The degree of pleasure X is determined.
As shown in FIG. 3A, in addition to the facial expressions of the passengers P1 to P4, the number of gaze direction changes, the number of posture changes, and the pupil diameter are correlated with the degree of pleasure X. The accuracy X of the occupants P1 to P4 is corrected by the number of posture changes and the pupil diameter to set a high accuracy X.
ユーザ端末23は、キーボード入力情報と筆記入力情報を検出しているため、これらキーボード入力情報と筆記入力情報を用いて乗員P1〜P4の快度X,活性度Yを補正することができる。具体的には、キーボード入力情報では、通常の打ち間違い率と現在の打ち間違い率との比較で活性度Yを推定でき、筆記入力情報では、メッセージ機能において車外との遣り取りにおけるキーワード、例えば「びみょ−」(不快ワード)や「かなりいい」(快ワード)等、によって快度Xを推定できる。
また、運転支援装置24は、運転状態をしなやかな運転状態とゆれる運転状態とやさしい運転状態に分類しているため、分類された運転状態に基づき乗員P1の快度Xを補正することができる。尚、室内マイクを設けることで、乗員P1〜P4の発言するワードを検出して、この検出されたワードを用いて乗員P1〜P4の興味対象を抽出すると共に乗員P1〜P4の快度Xを補正しても良い。
Since the user terminal 23 detects the keyboard input information and the writing input information, the user terminal 23 can correct the pleasure X and the activity Y of the passengers P1 to P4 using the keyboard input information and the writing input information. Specifically, in the keyboard input information, the activity level Y can be estimated by comparing the normal typing error rate with the current typing error rate, and in the written input information, a keyword such as “Bimyo” is used in the message function. The degree of pleasure X can be estimated by “-” (unpleasant word), “pretty good” (quick word), or the like.
In addition, since the driving support device 24 classifies the driving state into a supple driving state, a swaying driving state, and a gentle driving state, it can correct the comfort level X of the occupant P1 based on the classified driving state. By providing an indoor microphone, the words spoken by the passengers P1 to P4 are detected, and the interests of the passengers P1 to P4 are extracted using the detected words, and the pleasure X of the passengers P1 to P4 is obtained. It may be corrected.
感情推定手段11は、ユーザ端末23によって検出された心拍数に基づき活性度、不活性度を検出している。心拍数が高い程、活性度が高く、心拍数が低い程、不活性度が低いため、心拍数を介して乗員P1〜P4の活性度Yを判定している。
図3(b)に示すように、乗員P1〜P4の心拍数以外にも、呼吸数や血流速度及び皮膚電気抵抗値は活性度Yと相関関係を有しているため、これら呼吸数や血流速度及び皮膚電気抵抗値によって乗員P1〜P4の活性度Yを補正して高精度の活性度Yを設定している。
また、キーボード入力頻度も活性度Yと相関関係を有しており、活性度Yを間接的に推定できる。
The emotion estimation unit 11 detects the degree of activity and inactivity based on the heart rate detected by the user terminal 23. The higher the heart rate, the higher the activity level, and the lower the heart rate, the lower the inactivity level. Therefore, the activity level Y of the passengers P1 to P4 is determined through the heart rate.
As shown in FIG. 3 (b), in addition to the heart rate of the passengers P1 to P4, the respiratory rate, the blood flow velocity, and the skin electrical resistance value are correlated with the activity Y. The activity Y of the occupants P1 to P4 is corrected by the blood flow velocity and the skin electrical resistance value to set a highly accurate activity Y.
The keyboard input frequency also has a correlation with the activity Y, and the activity Y can be estimated indirectly.
ユーザ端末23に代えて乗員P1〜P4が着座する各々の座席に心臓や肺をエコー測定可能なエコー測定ユニットを配設し、心拍数、呼吸数、血流速度を検出することによって乗員P1〜P4の活性度Yの判定や補正を行っても良い。また、ステアリングホイール5の乗員P1の把持位置に皮膚電気抵抗センサを配設し、皮膚電気抵抗値を検出することによって乗員P1の活性度Yを補正することができる。 In place of the user terminal 23, an echo measurement unit capable of performing echo measurement of the heart and lungs is provided in each seat where the passengers P1 to P4 are seated, and the heart rate, the respiratory rate, and the blood flow velocity are detected, thereby detecting the passengers P1 to P1. The determination and correction of the activity Y of P4 may be performed. In addition, a skin electrical resistance sensor is disposed at the gripping position of the occupant P1 of the steering wheel 5, and the activity Y of the occupant P1 can be corrected by detecting the skin electrical resistance value.
感情推定手段11は、ユーザ端末23から入力された乗員P1〜P4の休憩中の行動履歴(歩行距離・滞在時間・商品購入等)によって休憩前の快度Xと活性度Yを補正し、乗員P1〜P4の行動履歴を反映するようにマップ11aを最新状態に更新している。
このマップ11aの更新は、乗員P1〜P4の再乗車時にユーザ端末23との一回的な通信により行っても良い。
The emotion estimation means 11 corrects the pleasure X and the activity Y before the break based on the behavior history (walking distance, staying time, product purchase, etc.) of the occupants P1 to P4 input from the user terminal 23 during the break. The map 11a is updated to the latest state so as to reflect the action history of P1 to P4.
The map 11a may be updated by a single communication with the user terminal 23 when the passengers P1 to P4 re-ride.
感情推定手段11は、乗員P1〜P4の感情変化の推移を乗員毎に記憶するマップ11aを有している。図4に示すように、マップ11aは、感情の同一性(x軸)と、期待感(y軸)と、達成感(z軸)との3軸で表現される乗員P1〜P4の感情を2軸の平面で表現したものである。尚、本実施例では、同一性と期待感と達成感が何れも高い、所謂わくわく感が高い領域を領域W、わくわく感が低い領域を領域Vとしている。 The emotion estimation means 11 has a map 11a for storing the transition of emotional changes of the passengers P1 to P4 for each passenger. As shown in FIG. 4, the map 11a shows the feelings of the passengers P1 to P4 expressed by three axes of emotion identity (x axis), expectation (y axis), and sense of accomplishment (z axis). This is expressed in a biaxial plane. In this embodiment, a region where the identity, expectation, and achievement are all high, a region where the so-called excitement is high, is a region W, and a region where the excitement is low is the region V.
感情推定手段11は、取得された乗員P1〜P4の快度Xと活性度Yを式(1)に代入して乗員P1〜P4の感情座標p1〜p4を演算した後、感情座標p1〜p4をマップ11aにプロットしてマップ11aを順次更新している。
この感情推定手段11には、ユーザ端末23との通信によって、走行スケジュール(走行距離、走行時間等)、乗員P1〜P4の種別(子供、もてなす必要がある客、生理的要求が発生した乗員等)が入力されているため、各感情座標p1〜p4に各種付加情報が紐付けされる。
The emotion estimation unit 11 calculates the emotion coordinates p1 to p4 of the occupants P1 to P4 by substituting the acquired pleasure X and activity Y of the occupants P1 to P4 into the equation (1), and then the emotion coordinates p1 to p4. Are plotted on the map 11a, and the map 11a is sequentially updated.
The emotion estimation means 11 includes a travel schedule (travel distance, travel time, etc.), types of passengers P1 to P4 (children, guests who need hospitality, passengers who have physiological demands, etc.) through communication with the user terminal 23. ) Is input, various additional information is linked to the emotion coordinates p1 to p4.
次に、制御手段12について説明する。
制御手段12は、他の乗員に対して優先的に対応する優先乗員の有無に基づき、通常モードと第1全体制御を備えた優先モードとを実行可能に形成されている。
また、この制御手段12は、通常モードにおいて、乗員P1〜P4の感情を一定方向に誘導する第2,第3全体制御と、乗員P1〜P4のうち特定乗員の感情を一定方向に誘導する第1〜第3個別制御を実行可能に構成されている。
図2に示すように、制御手段12は、優先乗員決定部13と、乗員感情比較部14と、記憶部15と、実行部16を備えている。
Next, the control means 12 will be described.
The control means 12 is configured to be able to execute the normal mode and the priority mode having the first overall control based on the presence or absence of a priority occupant that preferentially corresponds to other occupants.
Further, in the normal mode, the control means 12 performs second and third overall control for guiding the feelings of the occupants P1 to P4 in a certain direction, and the first control for guiding the feeling of the specific occupant among the occupants P1 to P4 in a certain direction. 1st-3rd individual control is comprised so that execution is possible.
As shown in FIG. 2, the control means 12 includes a priority occupant determination unit 13, an occupant emotion comparison unit 14, a storage unit 15, and an execution unit 16.
まず、優先乗員決定部13について説明する。
優先乗員決定部13は、乗員P1〜P4のうち他の乗員に優先して感情が改善されるべき優先乗員を決定している。この優先乗員決定部13は、マップ11aの付加情報に基づき生理的要求のある乗員を第1優先乗員として決定する。体調不良(車酔い、便意発生等)が原因で感情が悪化した乗員が第1優先乗員に相当する。
それ故、体調面から感情が悪化した第1優先乗員は、心拍数等の実際の生体測定値と表情等の動きを所定の判定基準と比較して乗員の体調を直接的に判定しても良い。
また、優先乗員決定部13は、マップ11aの付加情報に基づき乗員P1が他の乗員に優先してもてなす必要のある乗員を第2優先乗員として決定する。久しぶりに訪ねて来た親戚や友人、取引先の顧客等が第2優先乗員に相当する。
First, the priority occupant determination unit 13 will be described.
The priority occupant determination unit 13 determines a priority occupant whose emotion should be improved in preference to other occupants among the occupants P1 to P4. The priority occupant determination unit 13 determines an occupant having a physiological request as a first priority occupant based on the additional information of the map 11a. A passenger whose emotions have deteriorated due to poor physical condition (car sickness, constipation, etc.) corresponds to the first priority passenger.
Therefore, the first priority occupant whose emotions have deteriorated from the physical condition may directly determine the physical condition of the occupant by comparing the actual biological measurement values such as the heart rate and the movement of the facial expression with a predetermined criterion. good.
Further, the priority occupant determination unit 13 determines, as the second priority occupant, an occupant that the occupant P1 needs to give priority over other occupants based on the additional information of the map 11a. Relatives, friends, business customers, etc. who have visited after a long time correspond to second priority passengers.
次に、乗員感情比較部14について説明する。
乗員感情比較部14は、推定された乗員P1〜P4の感情が互いに近い状態か否かについて比較している。マップ11a上の乗員P1の感情座標p1から一定距離の同心円の領域A内に、乗員P2〜P4の感情座標p2〜p4が存在するか否かを夫々判定している。
領域A内に、乗員P2〜P4の感情座標p2〜p4が存在すれば、乗員P2〜P4は乗員P1と略同一又は近い感情(類似感情)を有し、領域A外の乗員は乗員P1と異なる感情(非類似感情)を有している。
Next, the occupant emotion comparison unit 14 will be described.
The occupant emotion comparison unit 14 compares whether or not the estimated emotions of the occupants P1 to P4 are close to each other. It is determined whether or not the emotion coordinates p2 to p4 of the occupants P2 to P4 exist within the concentric region A of a constant distance from the emotion coordinates p1 of the occupant P1 on the map 11a.
If the emotion coordinates p2 to p4 of the occupants P2 to P4 exist in the region A, the occupants P2 to P4 have emotions (similar emotions) that are substantially the same as or close to the occupant P1, and the occupants outside the region A are occupants P1. Have different emotions (dissimilar emotions).
次に、実行部16について説明する。
実行部16は、基本的に感情が悪化した乗員の感情をマップ11aに基づきフィードバックを行いながら改善するように感情改善手段3を制御している。
この実行部16は、推定された乗員P1〜P4の感情が互いに離隔しているとき、乗員P1〜P4の感情を接近させると共に、複数の乗員の感情が悪化したとき、複数の乗員の感情を同一方向に誘導するように感情改善手段3を制御している。
更に、実行部16は、予め設定された制限条件(具体的には、走行予定時間が短い、及び乗員の感情が悪化且つ夜間)が成立したとき、複数の乗員の感情を同一方向に誘導する感情改善手段3の制御を制限している。
Next, the execution unit 16 will be described.
The execution unit 16 controls the emotion improving means 3 so as to improve the emotion of the occupant whose emotion has basically deteriorated while performing feedback based on the map 11a.
When the estimated emotions of the occupants P1 to P4 are separated from each other, the execution unit 16 makes the emotions of the occupants P1 to P4 approach each other, and when the emotions of the plurality of occupants deteriorate, The emotion improving means 3 is controlled so as to be guided in the same direction.
Furthermore, the execution unit 16 guides the feelings of a plurality of passengers in the same direction when a preset restriction condition (specifically, the scheduled traveling time is short and the passengers' feelings are worse and at night) is satisfied. The control of the emotion improving means 3 is limited.
実行部16は、主に共通感覚誘導部と個別感覚誘導部を用いる第1〜第3全体制御と、主に個別感覚誘導部を用いる第1〜第3個別制御を実行可能に構成されている。
第1全体制御は、第1又は第2優先乗員が同乗しているとき、他の乗員に優先して第1又は第2優先乗員の感情を快方向に向かって改善するようにマップ11aに基づいて感情改善手段3を制御するものである。第1全体制御では、第1又は第2優先乗員に対応した個別感覚誘導部3bに加えて、運転動作誘導部3cを含む共通感覚誘導部3aが制御される。
The execution unit 16 is configured to be capable of executing first to third overall control mainly using the common sense induction unit and the individual sense induction unit, and first to third individual control mainly using the individual sense induction unit. .
The first overall control is based on the map 11a so as to improve the feeling of the first or second priority occupant in a pleasant direction in preference to other occupants when the first or second priority occupant is on board. Thus, the emotion improving means 3 is controlled. In the first overall control, in addition to the individual sense guidance unit 3b corresponding to the first or second priority occupant, the common sense guidance unit 3a including the driving operation guidance unit 3c is controlled.
第2全体制御は、乗員P1〜P4が類似感情状態(領域A内に感情座標p2〜p4が存在)で且つ乗員P1〜P4が感情が良好ではないとき、類似感情状態を維持した状態で乗員P1〜P4の感情が快状態を含む領域W方向に移行するようにマップ11aに基づいて感情改善手段3を制御するものである。第2全体制御では、運転動作誘導部3cを含む共通感覚誘導部3aと個別感覚誘導部3bとが用いられる。
また、第3全体制御は、乗員P1の感情から離隔した乗員が存在し且つ複数の乗員の感情が悪化(負の座標を有する感情座標p1〜p4が複数存在)したとき、乗員P1〜P4の感情を接近させるようにマップ11aに基づいて感情改善手段3を制御するものである。第3全体制御では、運転動作誘導部3cを除く共通感覚誘導部3aが主として用いられ、個別感覚誘導部3bは補助的に用いられる。そして、接近させた乗員P1〜P4の感情は、類似感情状態を維持した状態で領域Wをはじめとする所望の領域へ移行するように誘導される。
In the second overall control, when the occupants P1 to P4 are in a similar emotion state (the emotion coordinates p2 to p4 are present in the area A) and the occupants P1 to P4 are not in good emotion, the occupant is in a state in which the similar emotion state is maintained. The emotion improving means 3 is controlled based on the map 11a so that the emotions P1 to P4 shift in the direction of the region W including the pleasant state. In the second overall control, a common sense guidance unit 3a including a driving motion guidance unit 3c and an individual sense guidance unit 3b are used.
Further, in the third overall control, when there is an occupant separated from the emotion of the occupant P1 and the emotions of a plurality of occupants deteriorate (a plurality of emotion coordinates p1 to p4 having negative coordinates), the occupants P1 to P4 The emotion improving means 3 is controlled based on the map 11a so as to make the emotion approach. In the third overall control, the common sensory guidance part 3a excluding the driving action guidance part 3c is mainly used, and the individual sensory guidance part 3b is used as an auxiliary. Then, the emotions of the occupants P1 to P4 that are approached are guided to move to a desired region including the region W while maintaining a similar emotion state.
第1個別制御は、乗員P3又は乗員P4が感情悪化状態で且つ夜間走行のとき、乗員P3又はP4を放置或いは活性化を抑えた状態で乗員P1,P2の感情を快方向に向かって改善するようにマップ11aに基づいて感情改善手段3を制御するものである。第1個別制御では、運転動作誘導部3cと個別感覚誘導部3bが用いられている。
第2個別制御は、乗員P1の感情から離隔した乗員が存在し且つ乗員P1の感情が良好なとき、感情の悪化している乗員の感情を領域W内へ移行するようにマップ11aに基づいて感情改善手段3を制御するものである。第2個別制御では、個別感覚誘導部3bのみが用いられている。
第3個別制御は、乗員P1の感情から離隔した乗員が存在し且つ乗員P1に感情の急変が生じていないとき、乗員P1〜P4の感情を接近させつつ快方向に向かって改善するようにマップ11aに基づいて感情改善手段3を制御するものである。第3個別制御では、運転動作誘導部3cと個別感覚誘導部3bが主として用いられている。
In the first individual control, when the occupant P3 or the occupant P4 is in an emotionally deteriorated state and travels at night, the occupant P3 or P4 is left in the state or the feeling of the occupants P1 and P2 is improved in a pleasant direction with the activation suppressed. Thus, the emotion improvement means 3 is controlled based on the map 11a. In the first individual control, the driving operation guiding unit 3c and the individual sense guiding unit 3b are used.
The second individual control is based on the map 11a so that when there is an occupant that is separated from the emotion of the occupant P1 and the emotion of the occupant P1 is good, the emotion of the occupant whose emotion is deteriorated is transferred into the region W. It controls the emotion improvement means 3. In the second individual control, only the individual sensory guidance unit 3b is used.
The third individual control is such that when there is an occupant separated from the emotion of the occupant P1 and there is no sudden change of the emotion in the occupant P1, the map is improved so that the emotions of the occupants P1 to P4 are approached while improving in a pleasant direction. The emotion improvement means 3 is controlled based on 11a. In the third individual control, the driving operation guiding unit 3c and the individual sense guiding unit 3b are mainly used.
次に、図5〜図7のフローチャート及び図8〜図11に基づいて、乗員感情対応制御装置1の制御処理について説明する。尚、Si(i=1,2…)は、各処理のためのステップを示す。
まず、図5に示すように乗員感情対応制御装置1では、生体情報検出手段2からの出力を入力し(S1)、S2へ移行する。
Next, the control processing of the occupant emotion response control apparatus 1 will be described based on the flowcharts of FIGS. 5 to 7 and FIGS. 8 to 11. Si (i = 1, 2,...) Indicates a step for each process.
First, as shown in FIG. 5, in the occupant emotion correspondence control apparatus 1, the output from the biological information detection means 2 is input (S1), and the process proceeds to S2.
S2では、乗員P1〜P4が車両Vから降車して別行動を行ったか否か、例えば、高速道路のサービスエリア等で休憩したか否かを判定している。
S2の判定の結果、乗員P1〜P4が休憩した場合、休憩中の乗員P1〜P4の各々の行動履歴によって休憩前の快度Xと活性度Yの補正値を設定し(S3)、S4に移行する。
感情推定手段11は、休憩中の行動履歴に基づき乗員P1〜P4の感情変化の推移原因を推定している。例えば、降車中、乗員が所定の店舗まで移動し、目的地に関わる商品購入の取引があった場合等、走行目的の一部が達成されたため、購入後、快度(期待感)が減少することがあり、また、降車中、トイレが混雑して出発時間までに済ませられなかった場合等、乗員の体調が悪化して感情が急激に不活性状態に移行することがあるためである。乗員P1は、走行中、乗員P2〜P4への気配りを行っているため、高速道路のサービスエリア等で休憩する降車時までの乗員P2〜P4の感情を概ね把握している。
しかし、乗員P1は、休憩中の乗員P2〜P4の行動や言動を見ていないため、休憩中の感情変化が分からないため、乗員P2〜P4が乗車して再出発した後、暫くの間乗員P2〜P4の様子を伺って乗員P2〜P4の感情把握を再度行うことになる。
本制御により、乗員P1については、車両V側が、再乗車後の最新の乗員P2〜P4の感情が反映されたマップ11aに基づき、乗員P1が無意識のうちに乗員P1に対して所定の運転動作を行うように誘導せしめるため、乗員P2〜P4への気配り負荷が軽減される。また、乗員P2〜P4については、休憩中の事象、(例えば、トイレが混雑して行けなかった、屋台で昼食を取った結果眠くなった等)を乗員P1に敢えて伝えることなく、各自の要求に応じた処理(例えば、ナビゲーションシステムが立ち寄り地点として最短距離のサービスエリアを設定する、アクティブノイズキャンセラ機能により静粛性を確保しながら車両挙動を安定させる等)により要求が満たされるため、感情が改善される。
S2の判定の結果、乗員P1〜P4が降車を伴う休憩していない場合、S4に移行する。
In S2, it is determined whether or not the occupants P1 to P4 get off the vehicle V and perform different actions, for example, whether or not they have taken a rest in a highway service area or the like.
As a result of the determination in S2, when the occupants P1 to P4 take a break, correction values for the pleasantness X and the activity Y before the break are set according to the behavior history of each of the occupants P1 to P4 during the break (S3), and S4 Transition.
The emotion estimation means 11 estimates the cause of transition of emotional changes of the passengers P1 to P4 based on the behavior history during the break. For example, if a passenger moves to a predetermined store while getting off and there is a transaction for purchasing a product related to the destination, a part of the driving purpose has been achieved, so the degree of pleasure (expectation) decreases after purchase. In some cases, when the passenger gets off, the toilet is crowded and the departure time has not been completed, and the occupant's physical condition deteriorates, and the emotion can suddenly shift to an inactive state. Since the occupant P1 is paying attention to the occupants P2 to P4 during traveling, the occupant P1 generally understands the feelings of the occupants P2 to P4 until the passenger gets off to take a break in the service area of the highway.
However, since the passenger P1 does not see the behaviors and behaviors of the passengers P2 to P4 during the break, and does not know the emotional changes during the break, the passenger P1 rides for a while after the passengers P2 to P4 get on and restart. The state of P2-P4 is asked and the feelings of passengers P2-P4 are grasped again.
With this control, for the occupant P1, the vehicle V side performs a predetermined driving operation with respect to the occupant P1 unconsciously based on the map 11a reflecting the latest feelings of the occupants P2 to P4 after the re-boarding. Therefore, the attention load on the passengers P2 to P4 is reduced. In addition, for passengers P2 to P4, each passenger's request can be made without telling passenger P1 the event during the break (for example, the toilet could not be crowded, or the patient became sleepy as a result of having lunch at the stall). The feelings are improved because the requirements are fulfilled by processing according to (for example, the navigation system sets the service area of the shortest distance as a stopover point, stabilizes the vehicle behavior while ensuring quietness by the active noise canceller function, etc.) The
As a result of the determination in S2, when the passengers P1 to P4 are not taking a break with getting off, the process proceeds to S4.
S4では、乗員P1〜P4の感情を予め定められた学習処理を用いて推定している。
各種生体情報と行動履歴に基づく補正値等によって乗員P1〜P4の快度Xと活性度Yを夫々演算し、これらの快度Xと活性度Yを式(1)に代入することにより乗員P1〜P4の感情座標p1〜p4を夫々算出する。
走行スケジュールや乗員P1〜P4の種別等の付加情報が各々の感情座標p1〜p4に夫々対応付けされ、S5に移行する。
In S4, the feelings of the passengers P1 to P4 are estimated using a predetermined learning process.
The passengers P1 to P4 are calculated by calculating the pleasantness X and the activity Y of the passengers P1 to P4 based on various biological information and a correction value based on the action history, and substituting these pleasures X and the activity Y into the equation (1). The emotion coordinates p1 to p4 of .about.P4 are calculated.
Additional information such as the travel schedule and the types of the passengers P1 to P4 is associated with the emotion coordinates p1 to p4, respectively, and the process proceeds to S5.
S5では、感情座標p1〜p4に基づき前回のマップ11a(図4参照)を更新して、S6に移行する。S6では、乗員P1〜P4の感情座標p1〜p4及び感情座標p1〜p4に付随した付加情報に基づいて優先乗員を決定する。
このS6では、感情座標p1〜p4により、乗員P1〜P4について、例えば、車酔いや便意等の生理的要求を判定し、生理的要求が発生した乗員が存在する場合、その乗員を第1優先乗員に決定する。また、乗員P1〜P4の種別により、例えば、久しぶりに訪ねて来た親戚や仕事上の顧客等のように他の乗員(特に乗員P1)がもてなす必要のある乗員が存在する場合、その乗員を第2優先乗員に決定する。
In S5, the previous map 11a (see FIG. 4) is updated based on the emotion coordinates p1 to p4, and the process proceeds to S6. In S6, the priority occupant is determined based on the emotion coordinates p1 to p4 and the additional information attached to the emotion coordinates p1 to p4 of the occupants P1 to P4.
In S6, for example, a physiological request such as car sickness or constipation is determined for the occupants P1 to P4 based on the emotion coordinates p1 to p4. If there is an occupant who has generated a physiological request, the occupant is given first priority. Decide on the crew. Also, depending on the type of the passengers P1 to P4, for example, when there is an occupant that another occupant (especially the occupant P1) needs to entertain, such as a relative who has visited after a long time or a customer on the job, the occupant Decide to be the second priority occupant.
次に、S7へ移行して、第1優先乗員又は第2優先乗員が存在するか否かを判定する。
S7の判定の結果、第1優先乗員又は第2優先乗員が存在する場合、優先モードを実行する(S8)。S7の判定の結果、第1優先乗員又は第2優先乗員が存在しない場合、通常モードを実行する(S9)。これらの処理は、イグニッションがONされた時点から走行予定が完了してイグニッションがOFFされるまで一定時間毎に実行される。
Next, it transfers to S7 and it is determined whether a 1st priority crew member or a 2nd priority crew member exists.
As a result of the determination in S7, when the first priority occupant or the second priority occupant exists, the priority mode is executed (S8). If the result of determination in S7 is that there is no first priority occupant or second priority occupant, the normal mode is executed (S9). These processes are executed at regular intervals from the time when the ignition is turned on until the travel schedule is completed and the ignition is turned off.
次に、図6のフローチャートに基づき、優先モードの処理について説明する。
優先モードでは、第1優先乗員と第2優先乗員が両方存在するとき、第2優先乗員よりも第1優先乗員を優先して対応し、第1優先乗員の感情(体調)が改善した後、第2優先乗員の感情改善を実行する。
Next, the priority mode process will be described with reference to the flowchart of FIG.
In the priority mode, when both the first priority occupant and the second priority occupant are present, the first priority occupant is given priority over the second priority occupant, and the feeling (physical condition) of the first priority occupant is improved. The emotion improvement of the second priority occupant is executed.
S11では、第1優先乗員の発生有無を判定する。
S11の判定の結果、第1優先乗員が発生した場合、S12へ移行して、第1全体制御を実行する。例えば、乗員P3が車酔いによって感情悪化したと推定されたとき、マップ11aに基づき乗員P3の感情が改善するように乗員P3に作用する刺激を低減する。
In S11, it is determined whether or not the first priority occupant is generated.
When the first priority occupant is generated as a result of the determination in S11, the process proceeds to S12 and the first overall control is executed. For example, when the occupant P3 is estimated to have an emotional deterioration due to car sickness, the stimulus acting on the occupant P3 is reduced based on the map 11a so that the emotion of the occupant P3 is improved.
具体的には、個別感覚誘導部3bとして、乗員P3に対応した照明装置33が、照明光の波長を短く(青系)すると共に振幅を小さく(暗く)し、乗員P3に対応した個別スピーカ38が、スピーカ32の音及びロードノイズを擬似的に消音し、乗員P3に対応したシートバックモニタ39が、穏やかな風景等を映し出す。また、共通感覚誘導部3aとして、空調装置31が、マップ11aに基づき車内温度を乗員P3に適した温度に調節し、スピーカ32が、乗員P3の落ち着く曲を選曲して音量を低減する。 Specifically, the lighting device 33 corresponding to the occupant P3 as the individual sensation guiding unit 3b shortens the wavelength of the illumination light (blue system) and decreases the amplitude (darkens), and the individual speaker 38 corresponding to the occupant P3. However, the sound of the speaker 32 and the road noise are muffled in a pseudo manner, and the seat back monitor 39 corresponding to the occupant P3 projects a calm scenery or the like. Further, as the common sensation guiding unit 3a, the air conditioner 31 adjusts the in-vehicle temperature to a temperature suitable for the occupant P3 based on the map 11a, and the speaker 32 selects a calming song for the occupant P3 to reduce the volume.
更に、運転動作誘導部3cとして、窓枠可変装置35が、フロントウインドガラスの視界を広げて乗員P1の知覚速度を高めることにより車両Vの実車速を抑え、可変ステアリング装置36が、操舵抵抗を高めて車両Vの揺れを抑制し、モニタ37が、早い時点で休憩の提案や最も近いサービスエリアの提案を行う。
以上により、乗員P3に作用する刺激が低減され、乗員P3の感情改善を図ることができ、乗員P1の気配り負荷が低減される。
しかも、乗員P1が高速で素早く操舵したいと感じている場合、乗員P1の感覚(知覚速度、知覚操舵感覚)としては、乗員P1の要望通りの運転が実現できていると感じられるため、乗員P1の感情と他の乗員、特に感情が悪化した乗員P3の感情とを両立している。
Further, as the driving operation guiding portion 3c, the window frame varying device 35 suppresses the actual vehicle speed of the vehicle V by widening the field of view of the front window glass and increasing the perceived speed of the occupant P1, and the variable steering device 36 reduces the steering resistance. The vibration of the vehicle V is suppressed to increase, and the monitor 37 proposes a break and the nearest service area at an early point.
As described above, the stimulus acting on the occupant P3 is reduced, the emotion of the occupant P3 can be improved, and the attention load on the occupant P1 is reduced.
In addition, when the occupant P1 feels that he / she wants to steer quickly at high speed, the occupant P1 feels that the driving (perceived speed, perceived steering sensation) can be realized as desired by the occupant P1, and thus the occupant P1. And other passengers, in particular, the feelings of the passenger P3 whose emotions have deteriorated.
S11の判定の結果、第1優先乗員が発生していない場合、S13へ移行する。
S13では、マップ11aに基づき第2優先乗員の感情が悪化しているか否かについて判定している。尚、以下、感情悪化とは、今回の感情座標が、前回の感情座標よりも同一性、期待感、達成感のうち何れかの値が負の方向に移行した状態である。
S13の判定の結果、第2優先乗員の感情が悪化している場合、S12へ移行して、第1全体制御を実行する。基本的に、第2優先乗員の感情座標が前回の感情座標よりも同一性、期待感、達成感が何れも正方向に移行するように個別感覚誘導部3bと共通感覚誘導部3aと運転動作誘導部3cを作動させる。尚、第2優先乗員が体調面から感情が悪化した場合、第1優先乗員と同様の第1全体制御が実行される。
例えば、乗員P3が第2優先乗員に相当する親戚の子供であり、乗員P1の車速域が乗員P3の親による通常の車速域よりも高い場合等が想定される。
この場合、乗員P3は恐怖を感じているものの、遠慮しているため、乗員P1に対して車速を減速して欲しいことを言い出すことができず、次第に感情が悪化する。このような乗員P3(第2優先乗員)の感情悪化を検出した時、可変窓枠装置35による窓枠遮蔽動作によって乗員P1が無意識のうちに車速を低下させた結果、乗員P3の感情が改善方向に誘導された場合、窓枠遮蔽動作を継続する。
乗員P1については、自分の運転について矯正(例えば、「もっとゆっくり走って!」等の要求)されて不愉快な思いをすることなく、良い感情を維持した状態で乗員P3を安心させることができる。
S13の判定の結果、第2優先乗員の感情が悪化していない場合、S9へ移行して、通常モードを実行する。
As a result of the determination in S11, if the first priority occupant has not occurred, the process proceeds to S13.
In S13, it is determined whether or not the feeling of the second priority occupant has deteriorated based on the map 11a. In the following, the emotional deterioration is a state in which the value of the current emotion coordinate is shifted in a negative direction from the previous emotional coordinate in terms of identity, expectation, and achievement.
As a result of the determination in S13, if the emotion of the second priority occupant has deteriorated, the process proceeds to S12 to execute the first overall control. Basically, the individual sensation guidance unit 3b, the common sensation guidance unit 3a, and the driving operation are performed so that the emotion coordinates of the second priority occupant move in the positive direction from the previous emotion coordinates. The guide part 3c is operated. In addition, when the second priority occupant has an emotional deterioration due to physical condition, the same first overall control as the first priority occupant is executed.
For example, it is assumed that the occupant P3 is a relative child corresponding to the second priority occupant and the vehicle speed range of the occupant P1 is higher than the normal vehicle speed range of the occupant P3 parent.
In this case, although the passenger P3 feels fear, he / she refrains from saying that he / she wants the passenger P1 to decelerate the vehicle speed, and his feelings gradually worsen. When such an emotional deterioration of the occupant P3 (second priority occupant) is detected, the occupant P1 unconsciously reduces the vehicle speed by the window frame shielding operation by the variable window frame device 35. As a result, the emotion of the occupant P3 is improved. When guided in the direction, the window frame shielding operation is continued.
As for the passenger P1, the passenger P3 can be relieved while maintaining good feelings without having to feel unpleasant because his / her driving is corrected (for example, “run more slowly!”).
As a result of the determination in S13, if the emotion of the second priority occupant has not deteriorated, the process proceeds to S9 and the normal mode is executed.
次に、図7のフローチャートに基づき、通常モードの処理について説明する。
通常モードでは、基本的に、乗員P1〜P4を類似感情状態にすると共に乗員P1〜P4がわくわく感を体感できるように、第2,第3全体制御と第1〜第3個別制御とを実行する。
Next, processing in the normal mode will be described based on the flowchart of FIG.
In the normal mode, basically, the second and third overall controls and the first to third individual controls are executed so that the passengers P1 to P4 are in a similar emotional state and the passengers P1 to P4 can feel the excitement. To do.
S21では、今回の走行予定時間が長時間か否かを判定する。
S21の判定の結果、走行予定時間が長時間、例えば、1時間以上の場合、S22へ移行する。S21の判定の結果、走行予定時間が短時間の場合、乗員P1〜P4の感情を改善方向へ誘導するための十分な時間が確保できないため、S1へリターンする。
走行予定時間が短時間の場合、各制御を実行しても、乗員P1〜P4の感情を改善或いは感情の同一性を確保するまでに至らず、特に、走行予定時間が短時間の場合に運転動作誘導部3cが作動すると乗員P1に違和感のみを与える。それ故、上記不具合を防止するため、感情改善制御を制限している。
ここで、走行予定時間が長時間か否かは、例えば、ナビゲーションシステムに設定された目的地までの到達時間を参照することができる。尚、近所のショッピングモールや最寄りの駅に送迎に行くような短時間走行の場合、乗員P1にとって既知の目的地であり、目的地設定を行わないため、ナビゲーションシステムに目的地が設定されないときは、本制御の実行を省略することができる。また、ユーザ端末23のスケジューラを参照して乗車時間の長短を判定しても良い。
S22では、感情座標p2〜p4が領域A内か否かを判定する。
S22の判定の結果、感情座標p2〜p4が領域A内の場合、乗員P1〜P4の感情が類似感情状態であるため、S23へ移行する。
In S21, it is determined whether or not the current scheduled travel time is a long time.
As a result of the determination in S21, if the estimated traveling time is a long time, for example, 1 hour or more, the process proceeds to S22. As a result of the determination in S21, if the scheduled traveling time is short, sufficient time for guiding the feelings of the passengers P1 to P4 in the improvement direction cannot be secured, and the process returns to S1.
When the scheduled travel time is short, even if each control is executed, it does not lead to improving the feelings of the passengers P1 to P4 or ensuring the identity of the passengers, especially when the planned travel time is short. When the operation guiding portion 3c is activated, only a sense of incongruity is given to the passenger P1. Therefore, emotion improvement control is limited to prevent the above-mentioned problems.
Here, whether or not the scheduled traveling time is long can be referred to, for example, the arrival time to the destination set in the navigation system. If you are traveling for a short time, such as picking up at a nearby shopping mall or the nearest station, this is a known destination for the occupant P1, and the destination is not set. The execution of this control can be omitted. Further, the length of the boarding time may be determined with reference to the scheduler of the user terminal 23.
In S22, it is determined whether or not the emotion coordinates p2 to p4 are within the region A.
If the emotion coordinates p2 to p4 are within the region A as a result of the determination in S22, the occupants P1 to P4 are in a similar emotion state, and the process proceeds to S23.
S23では、乗員P1に直前の感情変化があったか否かを判定する。
運転している乗員P1の感情は、交通状況を含めた周囲環境からの影響を乗員P2〜P4よりも早く且つ大きく受けるため、乗員P2〜P4に比べて感情変化速度が速い。
乗員P1の直前の感情変化は、感情座標p1の変化率を検出し、感情座標p1の変化率が正方向(又は負方向)に所定値以上の場合に直前の感情変化ありと判定している。
S23の判定の結果、乗員P1に直前の感情変化があった場合、図8に示すように、乗員P2〜P4が乗員P1の感情に共感できる状態であるため、S24へ移行する。
尚、S23の判定の結果、乗員P1に直前の感情変化がなかった場合、S25へ移行する。
In S23, it is determined whether or not the passenger P1 has a previous emotional change.
The emotion of the occupant P1 who is driving is affected more quickly and greatly than the occupants P2 to P4 by the influence from the surrounding environment including the traffic situation, so the emotion change speed is faster than that of the occupants P2 to P4.
For the emotional change immediately before the occupant P1, the change rate of the emotion coordinate p1 is detected, and when the change rate of the emotion coordinate p1 is greater than or equal to a predetermined value in the positive direction (or negative direction), it is determined that there is an immediately previous emotion change. .
As a result of the determination in S23, if there is a previous emotional change in the occupant P1, as shown in FIG.
If the result of determination in S23 is that there is no previous emotional change in the occupant P1, the process proceeds to S25.
S24では、車外カメラ21によって撮像し一時的に記録された車両Vの周辺状況をモニタ37及びシートバックモニタ39に再生して、S25へ移行する。
乗員P1が、例えば、前方の綺麗な風景によって感動した場合、乗員P1に「あの景色見て、あの景色」と乗員P2〜P4に指差して視線を誘導させる負担を強いることなく、同じ対象物によって乗員P2〜P4の感動を発生させることができるため、乗員P1は乗員P2〜P4との共感を得ることにより感情の同一性を向上することができ、運転に集中することができる。
また、乗員P1が、急な割り込み車両等によって怒りを感じた場合であっても、乗員P1は乗員P2〜P4との共感を得ることにより運転に集中することができる。
急な割り込みを受けた時、乗員P1は単独運転であれば悪態を発して怒りを解消することができるが、同乗者の乗員P2〜P4が存在する場合は悪態をつけず、怒りを解消できないため、運転に悪影響を及ぼすことが考えられる。本制御では、乗員P2〜P4から声(例えば「あの車確かに乱暴だね」、「危ないな」等)を掛けられることにより、乗員P1が乗員P2〜P4に状況を理解して貰えたことを認識することで怒りを和らげられるため、運転に集中することができる。
また、乗員P2〜P4については、乗員P1の感情変化の速度及び指向方向に連動することができ、車内の雰囲気が盛り上がり、乗員P1を含めて乗員間の連帯感が生まれて目的地での行動が改善される等車全体として状況改善を図ることができる。
尚、再生した事象(例えば、割り込み車両の場合であれば交通事象に相当する)に関連するアニメーションを予め記憶している場合、撮像した画像に続けて再生しても良く、再生事象の種類に応じてアニメーションの再生可否を予め設定することができる。
また、実際の割り込み車両の映像の代わりに、割り込み車両を悪役風にデフォルメしたアニメーションを再生しても良い。
In S24, the surrounding situation of the vehicle V imaged and temporarily recorded by the outside camera 21 is reproduced on the monitor 37 and the seat back monitor 39, and the process proceeds to S25.
For example, when the occupant P1 is impressed by the beautiful scenery ahead, the same object is imposed without forcing the occupant P1 to “look at that scenery, that scenery” and point to the occupants P2 to P4 to guide the line of sight. Therefore, the passengers P1 to P4 can generate the emotion of the passengers P1, so that the passenger P1 can improve the identity of the emotion by obtaining sympathy with the passengers P2 to P4, and can concentrate on driving.
Further, even when the occupant P1 feels anger due to a sudden interruption vehicle or the like, the occupant P1 can concentrate on driving by obtaining sympathy with the occupants P2 to P4.
When an abrupt interruption occurs, the occupant P1 is able to resolve the anger if he / she is driving alone, but the anger cannot be resolved if the occupants P2 to P4 of the passenger are present. Therefore, it can be considered that driving will be adversely affected. In this control, the passenger P1 understands the situation to the passengers P2 to P4 because the passengers P2 to P4 can speak (for example, “That car is really violent”, “dangerous”, etc.) By recognizing, you can ease your anger, so you can concentrate on driving.
In addition, the passengers P2 to P4 can be linked to the speed and direction of the emotional change of the passenger P1, the atmosphere inside the vehicle is excited, and a sense of solidarity among the passengers including the passenger P1 is born and the behavior at the destination is reached. The situation can be improved as a whole vehicle.
If an animation related to a reproduced event (for example, a traffic event in the case of an interrupted vehicle) is stored in advance, it may be reproduced after the captured image. Accordingly, whether or not the animation can be reproduced can be set in advance.
Further, instead of the actual video of the interrupting vehicle, an animation in which the interrupting vehicle is deformed in a villain style may be reproduced.
S25では、感情座標p1が領域W内か否か判定する。
S25の判定の結果、感情座標p1が領域W内の場合、領域A内の乗員P1〜P4がわくわく感を体感しているため、感情改善の対応を行うことなく、S1へリターンする。
S25の判定の結果、感情座標p1が領域W外の場合、類似感情状態であるものの、乗員P1〜P4がわくわく感を体感できていないため、第2全体制御を実行して(S26)、S1へリターンする。
In S25, it is determined whether or not the emotion coordinate p1 is within the region W.
As a result of the determination in S25, when the emotion coordinates p1 are in the region W, the passengers P1 to P4 in the region A have a feeling of excitement, and therefore, the process returns to S1 without taking action for improving emotions.
As a result of the determination in S25, when the emotion coordinates p1 are outside the region W, the passengers P1 to P4 are not feeling the excitement although they are in a similar emotion state, so the second overall control is executed (S26), S1 Return to
S26では、第2全体制御を実行する。
具体的には、全ての照明装置33が、照明光の波長を長く(赤系)し、振幅を大きく(明るく)し、全ての個別スピーカ38が、ロードノイズを擬似的に消音し、モニタ37やシートバックモニタ39が、乗員P1〜P4が共通して興味のある目的地情報等を映し出す。また、空調装置31が、マップ11aに基づき車内温度を調節し、スピーカ32が、乗員P1〜P4が共通して好む或いは感情を高揚させる曲を選曲し音量を増加する。
更に、窓枠可変装置35が、フロントウインドガラスの視界を狭めて乗員P1の知覚速度を低くすることにより車両Vの実車速を増加し、可変ステアリング装置36が、操舵抵抗を低減して車両Vの走行感を発生させる。
以上により、乗員P1〜P4の同一性、期待感、達成感を夫々向上でき、乗員P1〜P4の感情を類似感情状態を維持したまま改善している。
例えば、観光地への日帰りドライブでは、出発直後は全乗員がわくわくしているものの、高速道路にのって暫くすると室内の雰囲気が中だるみする状況が生じることがある。
第2全体制御によって、中だるみした乗員P1〜P4の感情を類似感情状態を維持したまま改善方向に指向させることができる。
In S26, the second overall control is executed.
Specifically, all the illumination devices 33 lengthen the wavelength of the illumination light (red system) and increase the amplitude (brighter), and all the individual speakers 38 mute the road noise in a pseudo manner, and monitor 37 And the seat back monitor 39 displays destination information and the like that the passengers P1 to P4 have in common. In addition, the air conditioner 31 adjusts the vehicle interior temperature based on the map 11a, and the speaker 32 selects a song that the passengers P1 to P4 like in common or enhances emotions and increases the volume.
Further, the window frame variable device 35 increases the actual vehicle speed of the vehicle V by narrowing the field of view of the front window glass and lowering the perceived speed of the occupant P1, and the variable steering device 36 reduces the steering resistance to reduce the vehicle V. The feeling of running is generated.
As described above, the identity, expectation, and achievement of the occupants P1 to P4 can be improved, and the emotions of the occupants P1 to P4 are improved while maintaining the similar emotional state.
For example, in a day trip to a sightseeing spot, although all crew members are excited immediately after departure, a situation may occur in which the indoor atmosphere becomes sluggish after a while on the expressway.
By the second overall control, the feelings of the occupants P1 to P4 who are sluggish can be directed in the improvement direction while maintaining the similar emotional state.
S22の判定の結果、感情座標p2〜p4の何れかが領域A外の場合、乗員P2〜P4のうち何れかの乗員の感情が乗員P1の感情から離隔しているため、S27へ移行する。
S27では、乗員P3又はP4が感情悪化状態か否か判定している。
S27の判定の結果、乗員P3又はP4が感情悪化状態の場合、S28へ移行し、現在夜間か否か判定している。
S28の判定の結果、夜間走行中の場合、S29へ移行し、夜間走行中ではない場合、S30へ移行する。
As a result of the determination in S22, if any of the emotion coordinates p2 to p4 is outside the region A, since the occupant's emotion is separated from the occupant P1's emotion among the occupants P2 to P4, the process proceeds to S27.
In S27, it is determined whether or not the occupant P3 or P4 is in an emotional deterioration state.
As a result of the determination in S27, when the occupant P3 or P4 is in an emotional deterioration state, the process proceeds to S28, and it is determined whether or not it is currently nighttime.
As a result of the determination in S28, if the vehicle is traveling at night, the process proceeds to S29. If the vehicle is not traveling at night, the process proceeds to S30.
S29では、第1個別制御を実行する。
図9に示すように、例えば、乗員P3,P4が共に感情悪化状態(感情座標p3,p4の同一性、期待感、達成感のうち何れかの値が負)の場合、乗員P3,P4は眠たい或いは疲労していると推測されるため、前席乗員P1,P2と感情悪化状態の後席乗員P3,P4を分離して対応している。
具体的には、乗員P3,P4に対応した照明装置33が、照明光の波長を短くすると共に振幅を小さくし、乗員P1,P2に対応した照明装置33が、照明光の波長を長くすると共に振幅を大きくし、乗員P3,P4に対応した個別スピーカ38が、スピーカ32の音及びロードノイズを擬似的に消音し、乗員P1,P2に対応した個別スピーカ38が、スピーカ32の音を擬似的に増幅し、乗員P3,P4に対応したシートバックモニタ39の再生を停止する。また、スピーカ32が、音量を低減する。更に、窓枠可変装置35が、フロントウインドガラスの視界を広げて乗員P1の知覚速度を高めることにより車両Vの実車速を抑え、可変ステアリング装置36が、操舵抵抗を高めて車両Vの揺れを抑制する。
以上により、乗員P1〜P4の感情の非類似感情状態を維持することにより、乗員P3,P4は睡眠や休息を取りつつ、乗員P1,P2は感情改善が図られて高い運転意識を確保することができる。尚、乗員P3,P4については、乗員P3,P4に対する感情改善制御を停止し、放置しても良く、また、夜間に加えて単調道路でも分離対応しても良い。
事例としては、観光地への日帰りドライブの帰途において、夜になり、後席乗員P3,P4が眠たくなっている場合である。この場合、乗員P3,P4に対して無理に刺激を与えることなく、眠らせることができる。乗員P1については、眠っているP3,P4に対してやさしい運転をするための気遣い負荷を軽減することができる。
In S29, the first individual control is executed.
As shown in FIG. 9, for example, when the occupants P3 and P4 are both in an emotional deterioration state (any one of the emotion coordinates p3 and p4 has the same value, expectation, or feeling of achievement), the occupants P3 and P4 Since it is estimated that the patient is sleepy or tired, the front seat occupants P1 and P2 and the rear seat occupants P3 and P4 in an aggravated state are separated.
Specifically, the illumination device 33 corresponding to the passengers P3 and P4 shortens the wavelength of the illumination light and reduces the amplitude, and the illumination device 33 corresponding to the passengers P1 and P2 increases the wavelength of the illumination light. The individual speakers 38 corresponding to the passengers P3 and P4 increase the amplitude and mute the sound and road noise of the speakers 32, and the individual speakers 38 corresponding to the passengers P1 and P2 simulate the sounds of the speakers 32. The reproduction of the seat back monitor 39 corresponding to the passengers P3 and P4 is stopped. Further, the speaker 32 reduces the volume. Furthermore, the window frame variable device 35 suppresses the actual vehicle speed of the vehicle V by widening the field of view of the front window glass and increasing the perceived speed of the occupant P1, and the variable steering device 36 increases the steering resistance and shakes the vehicle V. Suppress.
As described above, by maintaining the dissimilar emotional state of the occupants P1 to P4, the occupants P3 and P4 can sleep and rest, while the occupants P1 and P2 can improve their emotions and ensure high driving awareness. Can do. For the passengers P3 and P4, the emotion improvement control for the passengers P3 and P4 may be stopped and left alone, or may be separated on a monotonous road in addition to the night.
As an example, on the way home for a day trip to a sightseeing spot, it is night and the rear seat passengers P3 and P4 are sleepy. In this case, it is possible to sleep without forcibly stimulating the passengers P3 and P4. About the passenger | crew P1, the caring load for carrying out a gentle driving | operation with respect to sleeping P3, P4 can be reduced.
S27の判定の結果、乗員P3又はP4が感情悪化状態ではない場合、S30へ移行し、感情座標p1が領域W内か否か判定する。
S30の判定の結果、感情座標p1が領域W内の場合、乗員P1はわくわく感を体感できる良好な状態であるものの、乗員P2〜P4の何れかはわくわく感を体感できないため、第2個別制御を実行して(S31)、S1へリターンする。
As a result of the determination in S27, when the occupant P3 or P4 is not in an emotionally deteriorated state, the process proceeds to S30, and it is determined whether or not the emotion coordinate p1 is within the region W.
As a result of the determination in S30, when the emotion coordinate p1 is within the region W, the occupant P1 is in a good state where he can feel the excitement, but any of the occupants P2 to P4 cannot feel the excitement, so the second individual control Is executed (S31), and the process returns to S1.
S31では、第2個別制御を実行する。
図10に示すように、例えば、感情座標p1が領域W内且つ感情座標p2〜p4が領域W外の場合、マップ11aに基づき感情座標p2〜p4が領域W内へ移行するように個別感覚誘導部3bを制御する。これにより、乗員P1の良好な感情を維持したまま乗員P2〜P4のうち感情が悪化している乗員の感情が改善されると共に乗員P1〜P4の感情を類似感情状態に誘導している。
事例としては、観光地への日帰りドライブの帰途において、乗員P1は、乗員P2〜P4を観光地に送り届けたことに達成感を感じ、トラブルなく帰宅してこのドライブを成功裏に終えることに期待感を持っているが、乗員P2〜P4は観光地訪問後は目的がなく、乗員によっては観光地が期待外れで喪失感が生じている場合である。このような場合、帰途の高速道路の各サービスエリアの名物料理を各モニタに表示したり、往路において全乗員P1〜P4の感情値が上昇したとき(感情座標p1〜p4が領域W内へ移行したとき)の車外映像を再生することにより、わくわく感を再現させて乗員P2〜P4を活性化することができる。
In S31, the second individual control is executed.
As shown in FIG. 10, for example, when the emotion coordinates p1 is within the region W and the emotion coordinates p2 to p4 are outside the region W, the individual sense guidance is performed so that the emotion coordinates p2 to p4 are moved into the region W based on the map 11a. The unit 3b is controlled. As a result, the feelings of the occupants whose emotions are worsening among the occupants P2 to P4 are improved while maintaining the good feelings of the occupant P1, and the feelings of the occupants P1 to P4 are induced to a similar emotional state.
As an example, on the way to a day trip to a sightseeing spot, the crew P1 felt a sense of accomplishment in delivering the crew P2 to P4 to the sightseeing spot and expected to return home without any trouble and finish this drive successfully. The passengers P2 to P4 have no purpose after visiting the sightseeing spot, and some passengers have a feeling of loss due to disappointment of the sightseeing spot depending on the passenger. In such a case, when the special dishes of each service area on the return expressway are displayed on each monitor, or when the emotion values of all the occupants P1 to P4 rise in the outward trip (emotion coordinates p1 to p4 move into the area W) ), The passengers P2 to P4 can be activated by reproducing the feeling of excitement.
S30の判定の結果、感情座標p1が領域W外の場合、乗員P1がわくわく感を体感しておらず非類似感情状態であるため、S32へ移行する。
S32では、乗員P1の感情が直前に悪化し且つ乗員P2〜P4のうち何れかの乗員が感情悪化しているか否かを判定する。
S32の判定の結果、乗員P1の感情が直前に悪化し且つ乗員P2〜P4のうち何れかの乗員が感情悪化している場合、第3全体制御を実行して(S33)、S1へリターンする。
As a result of the determination in S30, if the emotion coordinate p1 is outside the region W, the passenger P1 is not feeling the excitement and is in a dissimilar emotion state, so the process proceeds to S32.
In S32, it is determined whether or not the feeling of the passenger P1 has deteriorated immediately before and any of the passengers P2 to P4 has deteriorated.
As a result of the determination in S32, when the feeling of the occupant P1 has deteriorated immediately before and any of the occupants P2 to P4 has deteriorated, the third overall control is executed (S33), and the process returns to S1. .
S33では、第3全体制御を実行する。
図11に示すように、例えば、乗員P1〜P4の感情が何れも感情悪化側領域に分散的に存在し且つ乗員P1に直前の感情変化があった場合、乗員P1の感情を安定させるために乗員P1〜P4が共通して知覚できる車内環境に制御している。
In S33, the third overall control is executed.
As shown in FIG. 11, for example, when all the emotions of the passengers P1 to P4 are distributed in the emotion worsening side region and the passenger P1 has a previous emotional change, in order to stabilize the emotion of the passenger P1 It is controlled to an in-vehicle environment that can be perceived in common by the passengers P1 to P4.
具体的には、照明装置33が、照明光の波長を短くすると共に振幅を小さくし、個別スピーカ38が、ロードノイズを擬似的に増幅する。また、空調装置31が、マップ11aに基づき車内温度を低下する。
以上により、乗員P1〜P4が共通して知覚できる誘導媒体(照度、音、温度)で車内環境を悪化させて乗員P1〜P4の感情を同一感情領域に意図的に誘導するため、乗員P2〜P4の意識を特定の事象に指向させることができ、乗員P1は乗員P2〜P4と共感しながら運転に集中することができる。尚、領域Vに感情座標が位置する乗員が存在する場合、乗員P1〜P4が共通して知覚できる誘導媒体によって車内環境を改善させて乗員P1〜P4の感情を同一感情領域に意図的に誘導し、継続して乗員P1〜P4の感情を領域Wまで誘導することも可能である。
事例としては、観光地への日帰りドライブの帰途において、乗員P3,P4が些細なことで言い争いを始め、乗員P2の仲裁も効かず、乗員P1が運転に集中できなくなる場合である。このような場合、空調装置31の吹出口からブロアファン全開で冷風が吹出し、乗員P1〜P4の聴覚には言い争いの声が一瞬聞こえない程度のロードノイズが発生する。乗員P3,P4は、共通不快体験により知覚が強く刺激されて我に返り、何れかが「何か寒いね」等の仲直りのきっかけを発声し、言い争いを終結できる。また、怒った動物をデフォルメしたキャラクタのアニメーションをシートバックモニタ39に表示して、自らを客観視させることにより、類似効果を期待できる。本制御により、乗員P1は、言い争いを止めて欲しい旨の発声を我慢するという負担なく、再び運転に集中することができる。
また、逆に、共通快体験(例えば、昼食前に美味しそうな料理の映像を見せる等)によって同様の効果を得ることができるが、共通不快体験の方が知覚刺激が強い。
Specifically, the illumination device 33 shortens the wavelength of the illumination light and decreases the amplitude, and the individual speaker 38 artificially amplifies road noise. Further, the air conditioner 31 reduces the in-vehicle temperature based on the map 11a.
As described above, in order to intentionally induce the feelings of the passengers P1 to P4 to the same emotional area by deteriorating the in-vehicle environment with the guidance medium (illuminance, sound, temperature) that can be perceived in common by the passengers P1 to P4, The consciousness of P4 can be directed to a specific event, and the occupant P1 can concentrate on driving while sympathizing with the occupants P2 to P4. When there is an occupant whose emotion coordinates are located in the region V, the in-vehicle environment is improved by a guidance medium that the occupants P1 to P4 can perceive in common, and the emotions of the occupants P1 to P4 are intentionally guided to the same emotion region. In addition, it is possible to continuously induce the feelings of the passengers P1 to P4 to the area W.
As an example, on the way back to a sightseeing spot, the occupants P3 and P4 start to argue because they are trivial, the arbitration of the occupant P2 does not work, and the occupant P1 cannot concentrate on driving. In such a case, cold air blows out from the air outlet of the air conditioner 31 when the blower fan is fully opened, and road noise is generated to such an extent that a voice of a dispute cannot be heard for a moment in the hearing of the passengers P1 to P4. The passengers P3 and P4 are strongly stimulated by the common unpleasant experience and returned to me, and one of them speaks out for reconciliation such as “something is cold” and can end the dispute. Further, a similar effect can be expected by displaying an animation of a character deformed of an angry animal on the seatback monitor 39 and objectively viewing itself. With this control, the occupant P1 can concentrate on driving again without the burden of enduring utterances to stop the dispute.
On the other hand, the same effect can be obtained by a common pleasant experience (for example, showing an image of a delicious dish before lunch), but the common unpleasant experience has a stronger perceptual stimulus.
S32の判定の結果、乗員P1の感情が直前に悪化し且つ乗員P2〜P4のうち何れかの乗員が感情悪化していない場合、少なくとも乗員P1の感情は良好ではないため、第3個別制御を実行して(S34)、S1へリターンする。
S34では、第3個別制御を実行する。
例えば、乗員P4以外の乗員P1〜P3の感情が何れも感情悪化領域に分散的に存在する場合、マップ11aに基づき乗員P1〜P3の感情を改善する。
具体的には、乗員P1〜P3に対応した照明装置33が、照明光の波長を長くし、振幅を大きくし、乗員P1〜P3に対応した個別スピーカ38が、ロードノイズを擬似的に消音する。また、窓枠可変装置35が、フロントウインドガラスの視界を狭めて乗員P1の知覚速度を低くすることにより車両Vの実車速を増加し、可変ステアリング装置36が、操舵抵抗を低減して車両Vの走行感を発生させる。
以上により、乗員P1〜P3の同一性、期待感、達成感を夫々向上でき、乗員P1〜P3の感情を改善している。
具体事例1としては、観光地に向かう高速道路は車が多く、特に走行車線では前方が詰まり、乗員P1が好む車速域よりも低い車速でしか巡航できず、車間距離も確保できないため、乗員P1はストレスを感じている場合である。追い越し車線にレーンチェンジすることもできるが、追い越し車線は乗員P1が好む車速域よりも車速が高く且つ煽られることがあるので、レーンチェンジを躊躇している。乗員P1は、車両Vの高い動力性能をもてなし対象の乗員P4に自慢したい欲求があるが、乗員P4がスピード感に恐怖を持っている可能性もあるため、低車速を維持した方が良いと考えて欲求を自制している。乗員P1は、走行安全性と自己の欲求と乗員の感情とを常時考える負荷に晒されており、前方が大型車両に塞がれたとき等、感情が一時的に悪化することがある。
具体事例2としては、山岳観光道路において、乗員P1は、ワインディング路で車両Vの走行性能を楽しみたいという欲求と、乗員P2〜P4が絶景鑑賞できるように低速走行するという義務感がある場合である。このような場合、乗員P1は、乗員P2〜P4の感情を推察しながら、どのような速度で走行するかを常時考える負荷に晒されている。後続車両が増加したとき等、増速すべきか追い抜いてもらうかで感情が一時的に悪化することがある。
何れの場合においても、他の乗員P2〜P4が感情悪化領域に存在する場合、乗員P1と同様に低車速にストレスを感じていると判断し、前述した如く乗員P1に車速を増加する決断を促すように制御する。乗員P1は、乗員P2〜P4の感情を考える負荷から開放され、他の乗員P2〜P4の感情も改善方向に移行することができる。尚、他の乗員P2〜P4の感情が良い領域に存在する場合、現走行速度に安心感を持っていると判断し、現車速を維持するため、フロントウインドガラスの視界を広げて乗員P1の知覚速度を高くして乗員P1のストレスを解消する。
As a result of the determination in S32, when the feeling of the occupant P1 has deteriorated immediately before and any of the occupants P2 to P4 has not deteriorated, at least the feeling of the occupant P1 is not good, so the third individual control is performed. Execute (S34) and return to S1.
In S34, the third individual control is executed.
For example, when all of the emotions of the passengers P1 to P3 other than the passenger P4 are present in the emotion deterioration region, the emotions of the passengers P1 to P3 are improved based on the map 11a.
Specifically, the lighting device 33 corresponding to the passengers P1 to P3 increases the wavelength of the illumination light and increases the amplitude, and the individual speaker 38 corresponding to the passengers P1 to P3 mutes the road noise in a pseudo manner. . Further, the window frame variable device 35 increases the actual vehicle speed of the vehicle V by narrowing the field of view of the front window glass and lowering the perceived speed of the occupant P1, and the variable steering device 36 reduces the steering resistance to reduce the vehicle V. The feeling of running is generated.
As described above, the identity, expectation, and achievement of the passengers P1 to P3 can be improved, and the feelings of the passengers P1 to P3 are improved.
As a specific example 1, since there are many cars on the highway heading to the sightseeing spot, especially in the traveling lane, the front is clogged, and it can only cruise at a vehicle speed lower than the vehicle speed range preferred by the occupant P1, and the inter-vehicle distance cannot be secured. Is when you feel stress. Although it is possible to change the lane to the overtaking lane, the overtaking lane has a higher vehicle speed than the vehicle speed range preferred by the occupant P1 and may be beaten. The occupant P1 has a desire to brag about the high power performance of the vehicle V, but the occupant P4 may be afraid of speed, so it is better to maintain a low vehicle speed. Thinking and restraining desire. The occupant P1 is exposed to a load that constantly considers driving safety, self-desires, and occupant's emotions, and emotions may temporarily worsen when the front is blocked by a large vehicle.
As a specific example 2, on the mountain sightseeing road, the occupant P1 has a desire to enjoy the running performance of the vehicle V on the winding road and a duty to travel at a low speed so that the occupants P2 to P4 can appreciate the spectacular view. is there. In such a case, the occupant P1 is exposed to a load that constantly considers what speed to travel while inferring the feelings of the occupants P2 to P4. When the number of succeeding vehicles increases, the emotion may be temporarily deteriorated depending on whether the speed should be increased or overtaken.
In any case, when other occupants P2 to P4 are present in the emotional deterioration area, it is determined that the occupant P1 is stressed at the low vehicle speed as in the case of the occupant P1, and the decision is made to increase the vehicle speed to the occupant P1 as described above. Control to prompt. The occupant P1 is released from the load that considers the emotions of the occupants P2 to P4, and the emotions of the other occupants P2 to P4 can also shift in the improvement direction. If the feelings of other occupants P2 to P4 are present in a good area, it is determined that the current traveling speed has a sense of security, and in order to maintain the current vehicle speed, the field of view of the occupant P1 is widened. The stress of the passenger P1 is eliminated by increasing the perception speed.
次に、上記乗員感情対応制御装置1の作用、効果について説明する。
本乗員感情対応制御装置1によれば、感情推定手段11が乗員P1〜P4の感情変化の推移を乗員毎に記憶するマップ11aを備えているため、乗員P1〜P4毎の感情変化の推移を容易且つ正確に追跡することができ、高精度の感情推定を行うことができる。
感情改善手段3が乗員P1の運転動作を誘導する運転動作誘導部3cを有し、制御手段12は、マップ11aに基づき乗員P2〜P4の感情が不快方向へ移行することを抑制するように運転動作誘導部3cを制御するため、乗員P1を違和感なく所定の運転動作に誘導でき、乗員P2〜P4の感情を悪化させることなく、乗員P1の感情悪化を防止することができる。
Next, the operation and effect of the occupant emotion response control apparatus 1 will be described.
According to this occupant emotion correspondence control apparatus 1, since the emotion estimation means 11 includes the map 11a for storing the change in the emotional changes of the occupants P1 to P4 for each occupant, the change in the emotional changes for each of the occupants P1 to P4 is detected. It is possible to track easily and accurately, and to perform emotion estimation with high accuracy.
The emotion improving means 3 has a driving action guiding section 3c for guiding the driving action of the occupant P1, and the control means 12 drives so as to suppress the feeling of the occupants P2 to P4 from moving in an uncomfortable direction based on the map 11a. Since the operation guiding unit 3c is controlled, the occupant P1 can be guided to a predetermined driving operation without feeling uncomfortable, and the emotional deterioration of the occupant P1 can be prevented without deteriorating the feelings of the occupants P2 to P4.
感情改善手段3が乗員P1〜P4に作用する感覚誘導部31〜39を有し、感覚誘導部31〜39は、乗員P1〜P4が共通に知覚可能な誘導媒体を出力可能な共通感覚誘導部3aと乗員P1〜P4が個々に知覚可能な誘導媒体を出力可能な個別感覚誘導部3bとを備えているため、全乗員P1〜P4又は個別の乗員の区別に拘らず感情が改善されるべき乗員の感情を早期に改善することができる。 The emotion improving means 3 has sensory guidance units 31 to 39 that act on the passengers P1 to P4, and the sensory guidance units 31 to 39 can output a guidance medium that the passengers P1 to P4 can perceive in common. 3a and the occupant P1 to P4 are provided with the individual sensory guidance part 3b that can output a perceptible guidance medium, so that the feeling should be improved regardless of the distinction between all occupants P1 to P4 or individual occupants Crew feelings can be improved early.
制御手段12は、乗員P1〜P4のうち他の乗員に優先して感情が改善されるべき第1,第2優先乗員を決定する優先乗員決定部13を有し、優先乗員決定部13は生理的要求が発生した乗員を優先して第1優先乗員に決定するため、乗員P1に負担を掛けることなく、車両V側が自律的に感情が改善されるべき第1優先乗員を決定することができ、緊急性を要する乗員の感情を優先して改善することができる。 The control means 12 includes a priority occupant determination unit 13 that determines first and second priority occupants whose emotions should be improved over other occupants among the occupants P1 to P4. Since the occupant who has generated a demand is given priority as the first priority occupant, the vehicle V can autonomously determine the first priority occupant whose emotion should be improved without placing a burden on the occupant P1. Priority can be given to the feelings of occupants who need urgency.
次に、前記実施形態を部分的に変更した変形例について説明する。
1〕前記実施形態においては、同乗者が3人の例を説明したが、同乗者は1人でも良く、また、車両の許容人数に応じて3人以上であっても良い。
Next, a modified example in which the embodiment is partially changed will be described.
1) In the above-described embodiment, an example in which there are three passengers has been described. However, there may be one passenger or three or more passengers depending on the allowable number of vehicles.
2〕前記実施形態においては、優先モード及び通常モードにおいて、複数種類の感情改善手段を制御する例を説明したが、少なくとも乗員の感情を快方向に誘導できれば良く、可能であれば特定の装置のみを作動させても良い。また、乗員の種類、状況に応じて有効な装置を選択的にさせることも可能であり、乗員の好みに合わせて作動させる装置を変更させても良い。 2) In the above embodiment, an example of controlling a plurality of types of emotion improvement means in the priority mode and the normal mode has been described. However, it is sufficient that at least the passenger's emotion can be guided in a pleasant direction, and if possible, only a specific device is used. May be activated. It is also possible to selectively select an effective device according to the type and situation of the occupant, and the device to be operated may be changed according to the passenger's preference.
3〕前記実施形態においては、感情悪化を前回の感情座標と比較して同一性、期待感、達成感の何れか1の値が負の方向に移行したときに判定する例を説明したが、同一性、期待感、達成感の何れか1の値が所定量以上負の方向に移行したときに感情悪化を判定しても良い。また、乗員によって、感情悪化の判定方法を要素(同一性、期待感、達成感)によって変更しても良い。具体的には、運転者の感情悪化判定は、達成感が負の方向に移行したとき、或いは同一性又は期待感が所定量以上負の方向に移行したときに感情悪化を判定し、同乗者の感情悪化判定は、同一性又は期待感が負の方向に移行したとき、或いは達成感が所定量以上負の方向に移行したときに感情悪化を判定することも可能である。 3] In the above embodiment, an example has been described in which an emotional deterioration is compared with the previous emotional coordinate, and when any one of identity, expectation, and achievement shifts in a negative direction. Emotion deterioration may be determined when any one of identity, expectation, and achievement shifts in a negative direction by a predetermined amount or more. Further, the determination method of emotion deterioration may be changed depending on factors (identity, expectation, feeling of achievement) depending on the occupant. Specifically, the driver's emotional deterioration determination is performed when the feeling of achievement shifts in the negative direction, or when the identity or expectation shifts in the negative direction by a predetermined amount or more. It is also possible to determine the emotional deterioration when the identity or expectation shifts in the negative direction, or when the sense of achievement shifts in the negative direction by a predetermined amount or more.
4〕その他、当業者であれば、本発明の趣旨を逸脱することなく、前記実施形態に種々の変更を付加した形態で実施可能であり、本発明はそのような変更形態も包含するものである。 4) In addition, those skilled in the art can implement the present invention with various modifications added without departing from the spirit of the present invention, and the present invention includes such modifications. is there.
1 乗員感情対応制御装置
2 生体情報検出手段
3 感情改善手段
3a 共通感覚誘導部
3b 個別感覚誘導部
3c 運転動作誘導部
11 感情推定手段
11a マップ
12 制御手段
13 優先乗員決定部
23 ユーザ端末
V 車両
P1〜P4 乗員
DESCRIPTION OF SYMBOLS 1 Passenger emotion corresponding | compatible control apparatus 2 Biological information detection means 3 Emotion improvement means 3a Common sense guidance part 3b Individual sense guidance part 3c Driving | operation action guidance part 11 Emotion estimation means 11a Map 12 Control means 13 Priority occupant determination part 23 User terminal V Vehicle P1 ~ P4 Crew
Claims (3)
前記感情推定手段が前記複数の乗員の感情変化の推移を乗員毎に記憶するマップ手段を備え、
前記感情改善手段が前記運転者の運転動作を誘導する運転動作誘導部を有し、
前記制御手段は、前記マップ手段に基づき前記同乗者の感情が不快方向へ移行することを抑制するように前記運転動作誘導部を制御することを特徴とする車両用乗員感情対応制御装置。 Biological information detecting means for detecting a plurality of types of biological information of a plurality of occupants comprising a driver and a passenger, and an emotion for estimating emotions of the plurality of occupants based on the biological information detected by the biological information detecting means, respectively. In a vehicle occupant emotion correspondence control device comprising: an estimation unit; an emotion improvement unit capable of improving emotions of the plurality of occupants; and a control unit that controls the emotion improvement unit.
The emotion estimation means comprises map means for storing the transition of emotion changes of the plurality of passengers for each passenger,
The emotion improving means has a driving operation induction unit for inducing the driving operation of the driver,
The vehicle occupant emotion correspondence control device, wherein the control unit controls the driving operation guiding unit so as to suppress the passenger's emotion from shifting in an uncomfortable direction based on the map unit.
前記複数の感覚誘導部は、前記複数の乗員が共通に知覚可能な誘導媒体を出力可能な複数の共通感覚誘導部と前記複数の乗員が個々に知覚可能な誘導媒体を出力可能な複数の個別感覚誘導部とを備えていることを特徴とする請求項1に記載の車両用乗員感情対応制御装置。 The emotion improving means has a plurality of sensory guidance sections that act on the plurality of occupants,
The plurality of sensory guidance units include a plurality of common sensory guidance units capable of outputting a guidance medium that can be commonly perceived by the plurality of occupants and a plurality of individual sensors capable of outputting a guidance medium that can be perceived by the plurality of occupants individually. The vehicle occupant emotion response control device according to claim 1, further comprising a sensory guidance unit.
前記優先乗員決定手段は生理的要求が発生した乗員を優先して優先乗員に決定することを特徴とする請求項1又は2に記載の車両用乗員感情対応制御装置。 The control means includes priority occupant determination means for determining a priority occupant whose emotions should be improved over other occupants among the occupants,
3. The vehicle occupant emotion control device according to claim 1, wherein the priority occupant determination unit preferentially determines a occupant having a physiological request as a priority occupant.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015015338A JP6213489B2 (en) | 2015-01-29 | 2015-01-29 | Vehicle occupant emotion response control device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015015338A JP6213489B2 (en) | 2015-01-29 | 2015-01-29 | Vehicle occupant emotion response control device |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2016137203A true JP2016137203A (en) | 2016-08-04 |
JP6213489B2 JP6213489B2 (en) | 2017-10-18 |
Family
ID=56559589
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2015015338A Active JP6213489B2 (en) | 2015-01-29 | 2015-01-29 | Vehicle occupant emotion response control device |
Country Status (1)
Country | Link |
---|---|
JP (1) | JP6213489B2 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018086135A (en) * | 2016-11-29 | 2018-06-07 | マツダ株式会社 | Operation support system |
JP2018102705A (en) * | 2016-12-27 | 2018-07-05 | 本田技研工業株式会社 | Feeling improvement device and feeling improvement method |
WO2019021653A1 (en) * | 2017-07-28 | 2019-01-31 | ソニー株式会社 | Information processing device, information processing method, and program |
JP2020047022A (en) * | 2018-09-20 | 2020-03-26 | トヨタ自動車株式会社 | Occupant support device |
US11225257B2 (en) * | 2017-09-26 | 2022-01-18 | Nissan Motor Co., Ltd. | Driving assistance method and driving assistance device |
JP2022016947A (en) * | 2020-07-13 | 2022-01-25 | トヨタ紡織株式会社 | Movement space providing system |
US11332147B2 (en) * | 2018-09-12 | 2022-05-17 | Toyota Jidosha Kabushiki Kaisha | Driving evaluation apparatus, driving evaluation system, and driving evaluation method |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006036012A (en) * | 2004-07-27 | 2006-02-09 | Matsushita Electric Ind Co Ltd | Carsickness prevention device |
JP2006034576A (en) * | 2004-07-27 | 2006-02-09 | Matsushita Electric Ind Co Ltd | Motion sickness countermeasure device and motion sickness countermeasure method |
JP2006044420A (en) * | 2004-08-03 | 2006-02-16 | Denso Corp | Vehicular equipment control device |
JP2006082691A (en) * | 2004-09-16 | 2006-03-30 | Hitachi Software Eng Co Ltd | In-vehicle appliance control system to work with particular personal information |
JP2006102362A (en) * | 2004-10-08 | 2006-04-20 | Matsushita Electric Ind Co Ltd | Physiological condition improving device |
WO2007026447A1 (en) * | 2005-08-30 | 2007-03-08 | Mitsubishi Denki Kabushiki Kaisha | In-vehicle device, portable terminal, and guidance information providing system using them |
JP2007145225A (en) * | 2005-11-29 | 2007-06-14 | Denso Corp | User hospitality system for vehicle |
JP2007290539A (en) * | 2006-04-25 | 2007-11-08 | Denso Corp | Driving support apparatus for vehicle |
JP2009023613A (en) * | 2007-07-23 | 2009-02-05 | Denso Corp | User entertainment system for automobile |
JP2009106626A (en) * | 2007-10-31 | 2009-05-21 | Equos Research Co Ltd | System and method for supporting partner |
JP2009126485A (en) * | 2007-11-28 | 2009-06-11 | Toyota Motor Corp | Vehicle control system adapted to handicapped person |
JP2009208727A (en) * | 2008-03-06 | 2009-09-17 | Denso Corp | User hospitality system for vehicle |
JP2009245222A (en) * | 2008-03-31 | 2009-10-22 | Denso It Laboratory Inc | Action history management system |
JP2010143362A (en) * | 2008-12-18 | 2010-07-01 | Konica Minolta Holdings Inc | Driver support system |
EP2743141A1 (en) * | 2012-12-12 | 2014-06-18 | Volvo Car Corporation | Control arrangement for vehicle |
-
2015
- 2015-01-29 JP JP2015015338A patent/JP6213489B2/en active Active
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006036012A (en) * | 2004-07-27 | 2006-02-09 | Matsushita Electric Ind Co Ltd | Carsickness prevention device |
JP2006034576A (en) * | 2004-07-27 | 2006-02-09 | Matsushita Electric Ind Co Ltd | Motion sickness countermeasure device and motion sickness countermeasure method |
JP2006044420A (en) * | 2004-08-03 | 2006-02-16 | Denso Corp | Vehicular equipment control device |
JP2006082691A (en) * | 2004-09-16 | 2006-03-30 | Hitachi Software Eng Co Ltd | In-vehicle appliance control system to work with particular personal information |
JP2006102362A (en) * | 2004-10-08 | 2006-04-20 | Matsushita Electric Ind Co Ltd | Physiological condition improving device |
WO2007026447A1 (en) * | 2005-08-30 | 2007-03-08 | Mitsubishi Denki Kabushiki Kaisha | In-vehicle device, portable terminal, and guidance information providing system using them |
JP2007145225A (en) * | 2005-11-29 | 2007-06-14 | Denso Corp | User hospitality system for vehicle |
JP2007290539A (en) * | 2006-04-25 | 2007-11-08 | Denso Corp | Driving support apparatus for vehicle |
JP2009023613A (en) * | 2007-07-23 | 2009-02-05 | Denso Corp | User entertainment system for automobile |
JP2009106626A (en) * | 2007-10-31 | 2009-05-21 | Equos Research Co Ltd | System and method for supporting partner |
JP2009126485A (en) * | 2007-11-28 | 2009-06-11 | Toyota Motor Corp | Vehicle control system adapted to handicapped person |
JP2009208727A (en) * | 2008-03-06 | 2009-09-17 | Denso Corp | User hospitality system for vehicle |
JP2009245222A (en) * | 2008-03-31 | 2009-10-22 | Denso It Laboratory Inc | Action history management system |
JP2010143362A (en) * | 2008-12-18 | 2010-07-01 | Konica Minolta Holdings Inc | Driver support system |
EP2743141A1 (en) * | 2012-12-12 | 2014-06-18 | Volvo Car Corporation | Control arrangement for vehicle |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018086135A (en) * | 2016-11-29 | 2018-06-07 | マツダ株式会社 | Operation support system |
JP2018102705A (en) * | 2016-12-27 | 2018-07-05 | 本田技研工業株式会社 | Feeling improvement device and feeling improvement method |
EP3549430A4 (en) * | 2016-12-27 | 2019-12-11 | Honda Motor Co., Ltd. | Emotion improvement device and emotion improvement method |
WO2019021653A1 (en) * | 2017-07-28 | 2019-01-31 | ソニー株式会社 | Information processing device, information processing method, and program |
JPWO2019021653A1 (en) * | 2017-07-28 | 2020-05-28 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
US11225257B2 (en) * | 2017-09-26 | 2022-01-18 | Nissan Motor Co., Ltd. | Driving assistance method and driving assistance device |
US11332147B2 (en) * | 2018-09-12 | 2022-05-17 | Toyota Jidosha Kabushiki Kaisha | Driving evaluation apparatus, driving evaluation system, and driving evaluation method |
JP2020047022A (en) * | 2018-09-20 | 2020-03-26 | トヨタ自動車株式会社 | Occupant support device |
US11243544B2 (en) | 2018-09-20 | 2022-02-08 | Toyota Jidosha Kabushiki Kaisha | Occupant assist apparatus |
JP7070275B2 (en) | 2018-09-20 | 2022-05-18 | トヨタ自動車株式会社 | Crew support device |
JP2022016947A (en) * | 2020-07-13 | 2022-01-25 | トヨタ紡織株式会社 | Movement space providing system |
JP7521286B2 (en) | 2020-07-13 | 2024-07-24 | トヨタ紡織株式会社 | Mobility space provision system |
Also Published As
Publication number | Publication date |
---|---|
JP6213489B2 (en) | 2017-10-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6083441B2 (en) | Vehicle occupant emotion response control device | |
JP6115577B2 (en) | Vehicle occupant emotion response control device | |
JP6213489B2 (en) | Vehicle occupant emotion response control device | |
JP6656079B2 (en) | Control method of information presentation device and information presentation device | |
JP2016137200A (en) | Control device for coping with feeling of passenger for vehicle | |
US20170352267A1 (en) | Systems for providing proactive infotainment at autonomous-driving vehicles | |
JP7329755B2 (en) | Support method and support system and support device using the same | |
JP5045302B2 (en) | Automotive information provision device | |
JP6213488B2 (en) | Vehicle occupant emotion response control device | |
JP2014167438A (en) | Information notification device | |
CN113491519A (en) | Digital assistant based on emotion-cognitive load | |
US20180025283A1 (en) | Information processing apparatus, information processing method, and program | |
JP6575933B2 (en) | Vehicle driving support system | |
JP2016137202A (en) | Control device for coping with feeling of passenger for vehicle | |
JP2019131096A (en) | Vehicle control supporting system and vehicle control supporting device | |
JP2024041746A (en) | Information processing device | |
JP4253918B2 (en) | Agent device | |
US20200082818A1 (en) | Voice interaction device, control method for voice interaction device, and non-transitory recording medium storing program | |
JP2020169956A (en) | Vehicle destination proposal system | |
JP2013024753A (en) | Drive support system | |
JP7117221B2 (en) | Sleep suggestion method and sleep suggestion device | |
WO2022124164A1 (en) | Attention object sharing device, and attention object sharing method | |
JP7148296B2 (en) | In-vehicle robot | |
JP2020124392A (en) | Information processing device and information processing system | |
JP6579493B2 (en) | Vehicle driving support system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20170118 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20170221 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20170421 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20170822 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20170904 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6213489 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |