JP2007099249A - User hospitality system for automobile - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a user hospitality system for an automobile capable of detecting the state of a user and autonomously controlling action of on-vehicle devices in the form that the user desires (seemed to be desired) from the detection result. <P>SOLUTION: The user hospitality system 100 for the automobile detects the predetermined living body state of the user (for example, driver) getting on the automobile as a time variation of the living body state parameter, i.e., a numerical value parameter reflecting the living body state, presumes the mental state or the physical state of the user based on the time variation of the detected living body state parameter and varies the action content of a hospitality action part according to the presumed mental state or physical state. Namely, the mental state or the physical condition of the user is spontaneously grasped at an automobile side and the hospitality action fitted to the mental state or the physical condition is performed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention is intended to assist the user in using the car or to entertain (or serve) the user at least one of approaching, riding, driving, getting off and leaving the car of the user. This relates to a hospitality system for automobile users.

JP 2003-312391 A

  Patent Document 1 discloses an automatic adjustment device for an in-vehicle device using a mobile phone. This device communicates between a mobile phone carried by an automobile passenger and a wireless device mounted on the automobile side, and installs an in-vehicle device such as an air conditioner, a car stereo, an optical axis of a headlight, an electric seat, or an electric mirror. The operation adjustment is performed under conditions registered in advance for each mobile phone holder. Patent Document 1 also discloses a technique for grasping the number and positions of passengers in a vehicle by using a GPS (Global Positioning System) mounted on a mobile phone and adjusting the volume balance and frequency characteristics of an audio device. .

  However, the above-described device only adjusts the in-vehicle device after the passenger (user) gets into the automobile, and does not disclose the idea of adjusting the in-vehicle device before the user gets in. In this document, the vehicle-side communication device for the mobile phone is a short-range wireless communication device (Bluetooth: the communicable distance defined in the standard is at most 10 m), and in FIG. It is also clear from the fact that it is depicted as communicating only with a mobile phone. In addition, since the adjustment contents of the in-vehicle device are defined uniformly regardless of the user's state, there is a drawback that the user can read the hand and use it several times and gradually lose joy.

  An object of the present invention is to detect the state of a user, and from the detection result, the operation of the in-vehicle device can be autonomously controlled in the form that the user wants most (or seems to be desired). It is to provide an automobile user hospitality system that is filled with the desire to entertain the car positively as a master or customer.

Means and actions / effects for solving the problems

In order to solve the above problems, the automobile user hospitality system of the present invention is:
A hospitality action to assist the user in using the car or to entertain the user at least one of approaching the user, riding, driving or staying in the car, getting off and leaving the car. A hospitality action part,
A biological state detection unit that detects a predetermined biological state of the user as a temporal change of a biological state parameter that is a numerical parameter reflecting the biological state;
A mental / physical state estimating means for estimating a user's mental state or physical state based on a temporal change of the detected biological state parameter;
And a hospitality control unit that changes the operation content of the hospitality operation unit in accordance with the content of the estimated mental / physical state.

  According to the automobile user hospitality system of the present invention described above, a predetermined biological state of a user (for example, a driver) boarding the automobile is detected as a temporal change of a biological state parameter that is a numerical parameter reflecting the biological state. Then, the mental state or physical state of the user is estimated based on the temporal change of the detected biological state parameter, and the operation of the hospitality operation unit is performed according to the estimated mental state or physical state. The contents were changed. That is, the user's mental state or physical condition is spontaneously grasped by the vehicle side, and the hospitality operation adapted to the mental state or physical condition is performed, so that the service effect on the user when using the vehicle can be remarkably enhanced. In addition, since the car will spontaneously walk up to the user's spirit or body, the user's sympathy will be improved, and the internal connection between the car and the user will be nurtured. , You can improve your position as a virtual partner who understands and acts on your own.

  The biological state change detection unit can detect a temporal change waveform of the biological state parameter. In this case, the mental / physical state estimation means can estimate the physical state of the user based on the amplitude information of the waveform. For example, when the physical state of the user decreases due to illness or fatigue, the fluctuation of the biological state reflecting the physical state is also reduced. In other words, the amplitude of the temporal change waveform of the biological condition parameter tends to decrease, and it is possible to accurately detect abnormalities in the physical condition such as the above-mentioned diseases and fatigue. On the other hand, the mental / physical state estimating means may estimate the user's mental state based on the frequency information of the waveform. The stability or instability of the mental state is often reflected in the fluctuation rate of the biological state, and the fluctuation rate is reflected in the frequency of the biological state parameter waveform. Therefore, the mental state of the user is determined based on the frequency information. It can be estimated accurately.

  The mental / physical state estimating means may specify the mental state or physical state of the user as one of a plurality of predetermined mental state levels or mental state levels. In addition, a hospitality operation information storage unit that stores hospitality operation information that defines the operation content of the hospitality operation unit in association with a plurality of mental state levels or mental state levels can be provided. The hospitality control unit can be configured to read out the hospitality operation information corresponding to the estimated mental state level or the mental state level from the hospitality operation information storage unit, and to control the operation of the hospitality operation unit based on this. According to this configuration, the algorithm of hospitality control can be greatly simplified by performing stepwise level setting on the user's physical state or mental state that originally changed in an analog manner and continuously.

  The biological state change detection unit can detect the temporal change state of the user's body temperature as the temporal change information of the biological state parameter. The body temperature reflects the user's physical condition (physical condition) and mental state, especially the physical condition (for example, when the physical condition is poor, the temperature fluctuation range (waveform amplitude) becomes gentle) and infrared measurement (for example, facial thermography) Etc.) can be used to estimate the user's condition not only during driving (or while in the car) but also in various aspects such as approaching, getting in, and getting off / leaving the car. Yes, it can also contribute to the diversification of scenes that should be provided with appropriate hospitality operations.

  In addition, the biological state change detection unit may acquire a temporal change state of at least one of the facial expression and the line-of-sight direction of the user as the temporal change state of the biological state parameter. These two parameters also reflect the user's physical condition (physical condition) and mental condition (especially mental condition), and can be measured remotely by taking images, so it is limited to driving (or staying in the car). In addition, there are advantages that can be used for estimating the user's condition in various aspects such as approaching, getting in, and getting off / leaving from the automobile, and can contribute to diversification of scenes that should be provided with appropriate hospitality operations.

  The hospitality operation unit may perform a hospitality operation while the user is driving the automobile. The biological state change detection unit may detect a temporal change of the biological state parameter during the user's operation. Thereby, according to the mental state or physical state of the driver (user), the hospitality operation during the driving is optimized, and a comfortable and safer driving of the automobile can be realized.

  The biological state change detection unit acquires a temporal change state of a first-type biological state parameter including one or more of blood pressure, heart rate, body temperature, skin resistance, and sweating as a temporal change state of the biological state parameter. It can be. The first-type biological condition parameter indicates a so-called internal physical state change of the driver, and the temporal change (waveform) includes the driver's mental state (or psychological state), physical state, particularly mental state. Since the state is remarkably reflected, by analyzing this, the hospitality operation for the driver can be optimized more effectively. Further, these first-type biological condition parameters can be directly measured by, for example, a sensor attached to a grip position by the driver of the steering wheel, and have an advantage that the temporal change can be grasped sharply. For example, if you perceive danger and cool, or interrupt and overtake (that is, if you are mentally excited), you may notice sweating or a heartbeat. Significant changes appear in the waveform (especially amplitude) of the first-type biological condition parameters such as blood pressure, heart rate, body temperature, skin resistance (or sweating). It is also known that the first-type biological state parameter shows a similar waveform when attention is distracted and the attention is distracted. In this case, the mental / physical state estimating means can estimate that the mental state of the user is abnormal when the waveform frequency of the first-type biological state parameter is greater than a certain level.

  On the other hand, the biological state change detection unit detects a temporal change state of the second-type biological state parameter consisting of at least one of the user's driving posture, line-of-sight direction, and facial expression as the temporal change state of the biological state parameter. Can be. The second-type biological condition parameter indicates a so-called external physical condition change of the driver, and its movement amplitude tends to be reduced to reflect a state such as poor physical condition, illness, or fatigue. . Therefore, the mental / physical state estimating means can estimate that the user's physical condition is abnormal when the waveform amplitude of the second-type biological state parameter becomes smaller than a certain level.

  On the other hand, the waveform of the second-type biological state parameter can be effectively used for grasping the driver's mental state. For example, when the driver falls into an excited state, the driver's posture frequently changes, while the change in the line-of-sight direction decreases, resulting in a so-called “eye position” state. In addition, when mentally unstable, the facial expression changes significantly. In this case, the mental / physical state estimating means determines whether or not the waveform frequency of the second-type biological state parameter is greater than a certain level or smaller than a certain level (whether the waveform frequency depends on the type of parameter). Different), it can be presumed that the user's spirit is abnormal.

  There is also a biological condition parameter that can grasp a mental state or a physical state based on time change information different from the frequency and amplitude. For example, the biological state change detection unit can detect a temporal change in the pupil size of the user as a temporal change in the biological state parameter. The mental / physical state estimating means can estimate that the user's physical condition is abnormal when the detected pupil size is more than a predetermined level. This is because the focusing and light amount adjustment of the eyes become unstable due to fatigue and often fall into a state of so-called blurred eyes or flickering. On the other hand, when the driver is abnormally excited due to anger or the like, the driver often opens his eyes. In this case, the mental / physical state estimating means can estimate that the user's mental state is abnormal when the detected pupil size is expanded beyond a predetermined level.

  In addition, a plurality of biological state change detection units can be provided, and the mental / physical state estimation means can determine the user's mentality based on a combination of temporal change states of the biological state parameters detected by the plurality of biological state change detection units. The physical state or the physical state can be estimated. By combining a plurality of biological condition parameters, it is possible to further diversify (or subdivide) types of mental states or physical states that can be estimated (that is, identified), and to improve estimation accuracy. In this case, a plurality of estimated states that are a mental state or a physical state of the user and a plurality of biological state change detection units for estimating that the respective estimated states are established respectively. A determination table is provided in which a combination of temporal change states of biological condition parameters to be detected is stored in association with each other, and the mental / physical state estimation unit is configured to detect temporal change states of a plurality of detected biological condition parameters. Are compared with the combinations on the determination table, and the estimated state corresponding to the combination that has been matched is identified as the estimated state currently established. Thereby, even when many biological condition parameters are taken into account, it is possible to efficiently carry out the process of specifying the estimated state.

  The estimated state may include at least three of “diffused concentration”, “bad physical condition”, and “excited state”. When the user (driver) is estimated to be “distraction concentration” by the mental / physical state estimation means, the hospitality control unit can make the hospitality operation unit perform an operation to wake up the user. . Thereby, the user can be concentrated on driving. In addition, when the user is estimated to be “bad” by the mental / physical state estimation means, the hospitality control unit operates the corresponding hospitality operation unit so that the disturbance stimulus given to the user by the hospitality operation is alleviated. Control can be performed. By reducing the disturbance stimulus, it is possible to suppress the increase in physical fatigue resulting from the psychological burden, and to reduce the driver's pain. In addition, when the user is estimated to be in an “excited state” by the mental / physical state estimating means, the hospitality control unit shall cause the hospitality operation unit to perform an operation for relieving the user's mental tension. Can do. As a result, the hot mental state of the driver can be cooled, and it can be corrected to a calm and mild driving orientation.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a conceptual block diagram of an automobile user hospitality system (hereinafter also simply referred to as “system”) 100 according to an embodiment of the present invention. The system 100 includes a hospitality execution control unit 3 including a first computer to which various hospitality operation units 502 to 517, 534, 541, 548, 549, 550, 551, 552, and 1001B are connected, and various sensors and The vehicle-side mounting unit 100 including the hospitality decision making unit 2 including a second computer to which the camera groups 518 to 528 are connected is configured as a main part thereof. Each of the first computer and the second computer includes a CPU, a ROM, and a RAM, and implements various functions described below by executing control software stored in the ROM using the RAM as a work memory.

  In the system 100, a series of operations related to the user's use of the car until the user approaches the car, gets into the car, drives the car or stays in the car, and then gets off the vehicle. The scene is divided into a plurality of predetermined scenes. Then, for each of the plurality of divided scenes, the hospitality operation units 502 to 517, 534, 541, 548, 549, 550, 551, 552, and 1001B assist the user in using the car, or enjoy the user. The hospitality operation for the purpose is performed. In the present embodiment, a horn 502 and a buzzer 503 are connected as a sound wave generator to the outside of the vehicle. As lighting devices (lamps), a head lamp 504 (beam can be switched between high and low), a fog lamp 505, a hazard lamp 506, a tail lamp 507, a cornering lamp 508, a backup lamp 509, a stop lamp 510, indoor lighting 511 and an underfloor lamp 512 are connected. Further, as other hospitality operation units, an air conditioner 514, a car audio system (car stereo) 515, an electric seat 516, an angle adjustment drive unit 517 such as a side mirror and a rearview mirror, a car navigation system 534, and an door opening / closing assist. Mechanism (hereinafter referred to as a door assist mechanism) 541, an aroma generating unit 548 that releases fragrance into the vehicle, an ammonia generating unit 549 for awareness and awakening for drowsiness (or severe physical condition) (as shown in FIG. 50) The seat vibrator 550 (shown in FIG. 58) is attached to the center of the steering wheel 340 so as to spout ammonia in the form of aiming near the driver's face). Embedded in the seat bottom or backrest) Data 551 (as shown in FIG. 50, is attached to the shaft of the handle 340), the noise canceller 1001B for reducing cabin noise is connected.

  FIG. 16 shows a configuration example of the indoor lighting 511, and a plurality of lighting sections each having a unique lighting color (in this embodiment, a red lighting 511r, an amber lighting 511u, a yellow lighting 511y, a white lighting) 511w and blue illumination 511b). In response to the control command signal input from the hospitality decision making unit 2 through the hospitality execution control unit 3, these lights are selected, and lighting control is performed in various lighting patterns according to the control command signal. . FIG. 19 shows a configuration example of the lighting control data determined according to the personality type of the user. The lighting control data is stored in the ROM of the hospitality decision making unit 2 and is read and used as needed by the control software. For example, for the active personality (SKC1 (see FIG. 18)), the red light 511r is selected and flashed (only the first, then continuously lighted), and for the gentle personality (SKC2), For example, the amber system illumination 511u is selected and fade-in lighting is performed, but this is only an example.

  In addition to the incandescent light bulb and the fluorescent lamp, the lighting device using a light emitting diode can be adopted as the lighting device. In particular, various illumination lights can be easily obtained by combining light emitting diodes of the three primary colors of red (R), green (G), and blue (B). FIG. 39 shows an example of the circuit configuration, and each of the red (R), green (G), and blue (B) light emitting diodes 3401 is connected to a power source (Vs) and is switched by a transistor 3402. Driven. This switching is PWM controlled by a duty ratio determined by the period of a triangular wave (which may be a sawtooth wave) input to the comparator 3403 and the voltage level of the command signal. The input waveform of the command signal to the light emitting diodes 3401 of each color can be changed independently, and an illumination color of any color tone can be obtained according to the mixing ratio of the three light emission colors, and the color tone and illumination intensity pattern can be changed. It is also possible to change over time according to the input waveform of the command signal. Note that the light emission intensity of each color light emitting diode 3401 can be adjusted at the drive current level on the premise of continuous lighting, in addition to the PWM control method as described above, and this is combined with PWM control. A scheme is also possible.

  FIG. 17 shows a configuration example of the car audio system 515. The hospitality music performance control information such as music identification information and volume control information is input from the hospitality decision making section 2 through the hospitality execution control section 3. It has an interface unit 515a. The interface unit 515a is connected to a digital audio control unit 515e and music source databases 515b and 515c (the former is an MPEG3 database and the latter is a MIDI database) storing a large number of music source data. The music source data selected based on the music identification information is sent to the audio control unit via the interface unit 515a, where it is decoded into digital music waveform data, converted into analog by the analog conversion unit 515f, and then pre-amplifier 515g and power amplifier. After 515h, it is output from the speaker 515j at the volume specified by the hospitality music performance control information.

  FIG. 40 shows an outline of the door assist mechanism 541. A swing-type door (hereinafter also simply referred to as “door”) 1101 for getting on and off is attached to the automobile 1100 via a door turning shaft 1103 at one edge of the entrance 1102. The door 1101 can be opened from a closed position where the door 1102 is closed manually to an arbitrary angle position. The manual door opening operation is power-assisted by a motor (actuator) 1010. In the present embodiment, the rotation output of the motor 1010 is directly torqued to the turning shaft 1103 as a rotational driving force of the door opening / closing assist while torque is increased via the reduction gear mechanism RG with respect to the door turning shaft 1103 that rotates together with the door 1101. I try to communicate.

  FIG. 41 is an example of a circuit diagram of the door assist mechanism 541. The door assist mechanism 541 has an obstacle detection unit that detects an obstacle outside the vehicle that interferes with the door during the opening operation of the door, and the actuator control unit, when no obstacle is detected, When the door is opened, the actuator enters a normal assist mode in which a positive assist force in the door opening direction is generated by the actuator. When the obstacle detection means detects an obstacle, the door closes the entrance / exit when the door is opened. The door by the actuator is in a collision suppression mode in which the door can be opened at least halfway in the door turning section that reaches the collision position where it collides with the obstacle while the collision between the obstacle and the door is suppressed. It is configured to control the assist.

  The actuator is a motor 1010 that can rotate in both forward and reverse directions, and is configured by a DC motor in this embodiment (of course, other types of motors such as an induction motor, a brushless motor, and a stepping motor may be used). The actuator control means rotates the motor in the forward direction in the positive assist mode, and rotates the motor 1010 in the reverse direction in the reverse assist mode. In this embodiment, the actuator control means is a bidirectional linear control type using a push-pull transistor circuit. The motor driver 1007 constitutes an actuator control means.

  Specifically, the motor driver 1007 includes a forward drive transistor 1073 connected to a positive power supply (voltage Vcc) and a reverse drive transistor 1074 connected to a negative power supply (voltage −Vcc). The drive instruction voltage VD is voltage-adjusted by a resistor 1071 and input to the base terminals of both transistors 1073 and 1074. A resistor 1072 is a feedback resistor for amplification, and a part of the collector-emitter current of both transistors 1073 and 1074 is converted into a voltage and returned to the base of each transistor. Thus, when VD is positive, the forward driving transistor 1073 causes the motor 10 to pass a current proportional to VD, respectively, when the VD is negative. Therefore, when VD is positive, the motor 1010 rotates in the positive assist mode, and when VD is negative, the motor 1010 rotates in the reverse direction. The assist force is determined by the motor current corresponding to VD. The driving transistors 1073 and 1074 are provided with overcurrent protection transistors 1073t and 1074t, respectively. Reference numerals 1073R and 1074R denote overcurrent detection resistors, and reference numerals 1073D and 1074D denote flyback diodes.

  The door assist mechanism 541 is provided with an operation force detecting means 1002 for detecting the operation force of the door 1101, and as shown in FIG. 43 as a state (A) and a state (B), the actuator control means performs a positive assist mode. The operation of the actuator 1010 is controlled so that the positive assisting force increases as the door operating force detected by the operating force detection means 2 decreases. That is, when a person with weak power tries to open the door 1101, the positive assist force by the motor 1010 acts strongly and the door 1101 can be opened easily. On the other hand, when a strong person tries to open the door strongly, the positive assist force works relatively weakly. For example, if the control is performed so that the sum of the door opening torque generated by the external operating force and the door opening torque generated by the positive assist force is substantially constant, the door 1101 can be opened with a substantially constant standard torque regardless of who is operated. it can.

  In the circuit of FIG. 41, the above functions are realized as follows. The operating force detection means 1002 is a torque sensor 1002 provided on the door turning shaft 1103 as shown in FIG. The output voltage of the sensor 1002 increases. Since the output voltage of the torque sensor 1002 is positive when the door is opened and negative when the door is closed, the direction of torque can be detected by the sign of the voltage. In the present embodiment, the output voltage of the torque sensor 1002 is amplified by the non-inverting amplifier 1003 and is output as the torque detection voltage Vst via the voltage follower 1004.

  The torque detection voltage Vst is input to the differential amplifier circuit 1005. The differential amplifier circuit 1005 compares the torque detection voltage Vst with the reference voltage Vref1, amplifies the difference ΔV (= Vref1−Vst) with a constant gain, and outputs it as a drive instruction voltage VD for the motor 1010. When the opening operation of the door 1101 is started, since the torque detection voltage Vst is initially small, ΔV is large, the output current of the motor 1010 is also large, and a large positive assist force is activated. Since the torque due to the positive assist force is superimposed on the door turning shaft 1103 together with the torque due to the external operation force, the torque detection voltage Vst increases by the contribution due to the positive assist force. Then, ΔV decreases and ΔV decreases. That is, when the torque by the positive assist force is returned to the door turning shaft 1103, the total torque of the external operation force and the positive assist force is reflected in the torque detection voltage Vst, and the door assist by the motor 1010 is made so as to approach Vref1. The drive is feedback controlled. As a result, in the case of a weak person, the assist motor current (that is, the assist torque AT) is kept large as much as the contribution by the external operation force is reduced. Conversely, in the case of a strong person, the assist motor current is It will be kept small.

  As is well known, the door 1101 can be opened and closed by either the vehicle exterior operation knob 1104E or the vehicle interior operation knob 1104, and when the lock button 1104 is tilted, a known door lock mechanism 1320 shown in FIG. The door opening / closing operation by the knobs 1104E and 1104 becomes impossible. When the door lock mechanism 1320 is in the locked state, a door lock signal DRS is output and used for stop control of the motor 1010. In the present embodiment, the switch 21 that has received the door lock signal DRS disconnects the reference voltage Vref1 from the differential amplifier circuit 1005, shorts the inverting input terminal and the non-inverting input terminal of the differential amplifier circuit 1005, and performs differential operation. The input ΔV and thus the drive instruction voltage VD to the motor 1010 is forcibly set to zero, and the motor 1010 is stopped driving.

  In the circuit of FIG. 41, a comparator 1020 is provided that outputs an assist control signal SK1 when the sign of the torque detection voltage Vst becomes negative. A logical sum of the door lock signal DRS and the assist prohibition signal SK1 is input to the control terminal of the switch 1021 via the gate 1304, and the motor 1010 of the assist system SYS1 is controlled to stop even when the assist control signal SK1 is detected. It has come to be.

  Further, obstacle detection means for detecting an obstacle outside the vehicle that interferes with the door 1101 when the door 1101 is opened is provided. As the obstacle detection means, one that detects an obstacle that faces the side surface of the door 1101 can be adopted. If it does in this way, the obstacle which exists in the direction which the door 1101 opens can be detected correctly. As such an obstacle detection means, for example, a well-known proximity switch, a reflection optical sensor (including an infrared sensor), or an obstacle sensor 1050 such as an ultrasonic sensor can be employed.

  The detection output of the obstacle sensor 1050 is compared with a threshold value by the comparator 1051, and a signal indicating the presence / absence of detection of the obstacle is output in a binary manner. When the door 1101 is opened from the inside and this is detected by the obstacle sensor 1050, the angular position of the door 1101 when the obstacle is detected becomes the limit angle position, and the detection signal SI ′ signifies that there is an obstacle. Is output, and the door assist control means that receives this performs control to prevent the subsequent door opening operation. In this embodiment, when the door 1101 reaches the limit angle position, an obstacle door turning lock mechanism 1300 for preventing the door from turning thereafter is provided as part of the door assist control means. .

  FIG. 42 shows a configuration example of the lock portion of the lock mechanism 1300. The main part of the lock part is a door side engaging part (male spline in this embodiment) 1312 provided on the turning shaft 1103 of the door 1101 and a vehicle body side fixed to the door side engaging part 1312. A vehicle body side engaging portion (a female spline in the present embodiment) 1313 that is detachably engaged at an arbitrary angle phase corresponding to the turning angle of 1103 and locks the turning of the turning shaft 1103 at the angle phase of the engaged state. And have. The vehicle body side engaging portion 1313 is provided so as to be able to approach and separate from the door side engaging portion 1312 in the axial direction of the turning shaft 1103. When approaching, the vehicle body side engaging portion 1313 is locked with the vehicle body side engaging portion 1313 and unlocked when separated. It becomes. In this embodiment, this approach / separation mechanism is constituted by a known solenoid mechanism (may be a cylinder mechanism or the like). The vehicle body side engaging portion 1313 is attached to the tip of a drive shaft 1314 having a spring receiving portion 1314B, and this drive shaft 1314 is driven by a solenoid 1301 that is driven to advance and retract in the axial direction by a solenoid 1301 housed in the case 1300C. When energized, the drive shaft 1314 pops out, and the vehicle body side engaging portion 1313 engages with the door side engaging portion 1312. On the other hand, when the solenoid is de-energized, the bias spring 1310 that engages with the spring receiving portion 1314B is elastically restored, and the drive shaft 1314 is retracted to disengage the vehicle body side engaging portion 1313 and the door side engaging portion 1312. Is done.

  As shown in FIG. 41, when the obstacle detection signal SI ′ is output, the drive switch (transistor: reference 1302 is a flyback diode for protection) 1303 is turned on, the solenoid 1301 is energized, and FIG. The vehicle body side engaging portion 1313 and the door side engaging portion 1312 engage with each other. At this time, the door 1101 is approaching to an obstacle at an indeterminate position outside the vehicle, and the vehicle body side engaging portion 1313 and the door side engaging portion 1312 are connected to the spline at the angle phase when the obstacle is detected. If it is, it will be locked at that angle. That is, the limit angle position is variably determined according to the door angle position when the obstacle detection unit detects the obstacle (that is, according to the position of the obstacle). Thereby, regardless of the relative distance of the obstacle with respect to the automobile, if the door approaches by the opening operation, the door opening operation is prevented so as not to hit the obstacle. At this time, since the opening operation of the door 1101 is hindered even if a positive assist force is generated by the motor 1010, it is clear that the door assist by the actuator is controlled so that the collision suppression mode is set.

  When the door operation signal EDS indicates a state in which the door is operated from the outside of the vehicle, the door assist suppression control mechanism (here, the door for obstacles) is used regardless of the detection output of the obstacle sensor 1050. The operation of the turning lock mechanism 1300) is restricted. Specifically, the detection signal SI ′ of the obstacle sensor 1050 binarized by the comparator 1051 and the binary external door operation signal EDS (when the door is operated from the outside, the opposite sign to the detection signal SI) This function is realized by using the logical product output SI of the gate 1051a as the drive signal of the drive switch 1303 described above.

  Instead of using the swing type door having the assist mechanism as described above, it is also possible to adopt a known electric automatic opening / closing mechanism or an electric slide type door provided with an assist mechanism.

    FIG. 44 is a functional block diagram illustrating a configuration example of the noise canceller 1001B. The main part of the noise canceller 1001B includes an active noise control mechanism main body 2010 that forms noise suppression means, and a necessary sound enhancement part (means) 2050. The active noise control mechanism 2010 is a noise that synthesizes an in-vehicle noise detection microphone (noise detection microphone) 2011 that detects noise entering the vehicle, and a noise control waveform that is opposite in phase to the noise waveform detected by the in-vehicle noise detection microphone 2011. And a control waveform synthesis unit (control sound generation unit) 2015. The noise control waveform is output from the noise control speaker 2018. There are also provided an error detection microphone 2012 for detecting an unerased noise component included in the vehicle interior sound after the noise control sound wave is superimposed, and an adaptive filter 2014 for adjusting a filter coefficient in a direction in which the level of the unerased noise is reduced. ing.

  Vehicle interior noise having a sound source in the vehicle itself includes engine sound, road surface sound, wind noise, etc. A plurality of vehicle interior noise detection microphones 2011 are distributed and arranged at positions suitable for detection of individual vehicle interior noise. ing. The vehicle interior noise detection microphones 2011 are at different positions as viewed from the passenger J, and there is a considerable phase difference between the noise waveform at the position picked up by the microphone 2011 and the noise waveform actually heard by the passenger J. . Therefore, in order to match this phase difference, the detection waveform of the vehicle interior noise detection microphone 2011 is appropriately supplied to the control sound generation unit 2015 via the phase adjustment unit 2013.

  Next, the necessary sound enhancement unit 2050 includes an enhanced sound detection microphone 2051 and a necessary sound extraction filter 2053, and the extracted waveform of the necessary sound is given to the control sound generation unit 2015. Also here, the phase adjustment unit 2052 is provided as appropriate due to the same situation as the vehicle interior noise detection microphone 2011. The emphasis sound detection microphone 2051 includes an in-vehicle microphone 2051 for capturing necessary sounds outside the vehicle and an in-vehicle microphone 2051 for capturing necessary sounds in the vehicle. Both can be configured with known directional microphones, and are mounted on the outside of the vehicle so that the angle range with strong directivity for sound detection faces the outside direction of the vehicle and the angle range with low directivity faces the inside direction of the vehicle. In the present embodiment, the entire microphone 2051 is attached so as to go out of the vehicle, but the inside area of the vehicle is set so that the angle area with low directivity is located inside the vehicle and only the angle area with strong directivity goes out of the car. It can also be installed across the outside of the vehicle. On the other hand, the in-vehicle microphone 2051 has a low directivity because the sound detection directivity angle range faces the front of the passenger so that the passenger's conversation sound can be selectively detected corresponding to each seat. It is attached so that the angle range faces in the opposite direction. Each of these emphasized sound detection microphones 2051 is connected to a necessary sound extraction filter 2053 that preferentially passes a necessary sound component in its input waveform (detected waveform). The audio input of the car audio system 515 in FIG. 1 is used as the in-vehicle necessary sound source 2019. The speaker output sound of this audio device (the speaker may be used as the noise control speaker 2018 or may be provided separately) is controlled so as not to be canceled even if the noise control waveform is superimposed.

  FIG. 45 shows an example of a hardware block diagram corresponding to the functional block diagram of FIG. A first DSP (Digital Signal Processor) 2100 constitutes a noise control waveform synthesis unit (control sound generation unit) 2015 and an adaptive filter 2014 (and further a phase adjustment unit 2013), and an in-vehicle noise detection microphone 2011 is a microphone amplifier. 2101 and an A / D converter 2102, and a noise control speaker 2018 are connected via a D / A converter 2103 and an amplifier 2104, respectively. On the other hand, the second DSP 2200 constitutes an extraction unit for the noise component to be suppressed, and the error detection microphone 2012 is not subject to suppression through the microphone amplifier 2101 and the A / D converter 2102 and is not subject to suppression such as audio input. An audio signal source, that is, a necessary sound source 2019 is connected via an A / D converter 2102.

  The necessary sound enhancement unit 2050 includes a third DSP 2300 that functions as a necessary sound extraction filter 2053, and a necessary sound detection microphone (emphasis sound detection microphone) 2051 is connected via a microphone amplifier 2101 and an A / D converter 2102. Yes. The third DSP 2300 functions as a digital adaptive filter. The filter coefficient setting process will be described below.

  Recognize caution and danger of emergency vehicles (ambulances, fire trucks, police cars, etc.) sirens, railroad crossing alarms, subsequent vehicle horns, whistle, human screams (children crying, women screaming, etc.) It is determined as a necessary vehicle exterior sound (emphasized sound), these sample sounds are recorded on a disk or the like, and are made into a library as reference enhanced sound data that can be read and reproduced. As for the conversation sound, a plurality of individual model sounds are similarly stored in a library as reference emphasized sound data. In addition, when the boarding candidate is fixedly fixed, if the model voice is prepared as reference enhancement sound data by the utterance of the model voice itself, the boarding candidate will get on Can enhance the accuracy of conversation sound.

  Then, an appropriate initial value is given to the filter coefficient, and the enhancement sound detection level by the enhancement sound detection microphone 2051 is set to the initial value. Next, each reference emphasis sound is read and output, and is detected by the emphasis sound detection microphone 2051. Then, the passing waveform of the adaptive filter is read, and the level of the waveform that has passed as the reference enhancement sound is measured. The above process is repeated until the detection level reaches the target value. In this way, the filter coefficient is subjected to learning processing so that the reference emphasis sound is successively replaced for both the vehicle exterior sound and the vehicle interior sound (conversation sound), and the detection level of the passing waveform is optimized. The necessary sound is extracted from the input waveform from the emphasized sound detection microphone 2051 by the necessary sound extraction filter 2053 having the filter coefficient adjusted as described above, and the extracted enhanced sound waveform is transferred to the second DSP 2200. The second DSP 2200 calculates a difference between the input waveform from the necessary sound source (audio output here) 2019 and the extracted enhanced sound waveform from the third DSP 2300 from the detection waveform of the in-vehicle noise detection microphone 2011.

  The filter coefficients of the digital adaptive filter incorporated in the first DSP 2100 are initialized prior to use of the system. First, various noises to be suppressed are determined, and these sample sounds are recorded on a disk or the like, and are made into a library as reproducible reference noise. Then, an appropriate initial value is given to the filter coefficient, and the noise level left by the error detection microphone 2012 is set to the initial value. Next, the reference noise is sequentially read out and output, and detected by the vehicle interior noise detection microphone 2011. The detection waveform of the vehicle interior noise detection microphone 2011 that has passed through the adaptive filter is read, and this is subjected to fast Fourier transform to decompose the noise detection waveform into sinusoidal elementary waves having different wavelengths. Then, an inverted elementary wave obtained by inverting the phase of each sine wave elementary wave is generated and synthesized again to obtain a noise control waveform having a phase opposite to that of the noise detection waveform. This is output from the noise control speaker 2018.

  If the coefficient of the adaptive filter is appropriately determined, only the noise component should be efficiently extracted from the waveform of the vehicle interior noise detection microphone 2011. Therefore, the noise control waveform synthesized based on the noise is used to generate the interior of the vehicle. Noise can be offset without excess or deficiency. However, if the setting of the filter coefficient is not appropriate, the waveform component that is not canceled out remains as a noise component. This is detected by the error detection microphone 2012. The level of the unerased noise component is compared with the target value, and if it is not lower than the target value, the filter coefficient is updated, and the same processing is repeated until it becomes lower than the target value. In this manner, the reference noise is replaced one after another, and the filter coefficient is subjected to learning processing so that the unerased noise component is minimized. During actual use, the noise component that remains unerased is constantly monitored, the filter coefficient is updated in real time so that it is always minimized, and the same processing as described above is performed to leave the necessary sound wave component. Only the noise level in the vehicle can be effectively reduced.

  Next, the user terminal device 1 is configured as a mobile phone as shown in FIG. 14 in the present embodiment (hereinafter also referred to as “mobile phone 1”). The mobile phone 1 includes a monitor 308 formed of a liquid crystal display, an input unit 305 including a keyboard, a transmitter 304, a receiver 303, and the like. A pulse sensor (heart rate sensor) 342 is also provided on the side surface.

  FIG. 15 is a block diagram showing an example of the electrical configuration of the mobile phone 1. The main part of the circuit includes an input / output unit 1311 and a control unit 310 including a CPU 312, a ROM 314, a RAM 313, and the like connected thereto. An input unit 305 and an on-hook / off-hook switch 306 are connected to the input / output unit 1311. The receiver 303 is connected to the input / output unit 1311 via the amplifier 315 and the D / A converter 316, and the transmitter 304 is connected to the input / output unit 1311 via the amplifier 317 and the A / D converter 318. Furthermore, a well-known GPS 554 for acquiring position information of the mobile phone 1 is connected to the input / output unit 1311.

  In this embodiment, in order to grasp the distance and azimuth relationship between the user side terminal device 1 and the vehicle, the user side terminal device 1 is provided with the GPS 554 in addition to the GPS 533 (FIG. 1) on the vehicle side, A method is adopted in which the terminal device 1 can independently acquire the position information, and the terminal position information is transmitted to the vehicle side via the wireless communication network. As a result, the vehicle side can acquire both the accurate vehicle position by the GPS 533 connected to itself and the accurate terminal position by the GPS 554 received from the user side terminal device 1, and the user side terminal device 1 and the vehicle The distance and azimuth relationship can be grasped very accurately. Moreover, the distance change and the approach direction change between the user-side terminal device 1 and the automobile can be grasped in real time.

  Returning to FIG. 15, a communication device 323 is connected to the input / output unit 1311 of the mobile phone 1. The communication device 323 includes a connection interface 331 for connecting to the control unit 310, a modulator 332, a transmitter 333, a frequency synthesizer 334, a receiver 335, a demodulator 336, a duplexer 337, and the like connected thereto. ing. The data signal from the control unit 310 is modulated by the modulator 332 and further transmitted from the antenna 339 via the duplexer 337 by the transmitter 333. On the other hand, the received radio wave is received by the receiver 335 via the antenna 339 and the duplexer 337, demodulated by the demodulator 336, and then input to the I / O port 1311 of the control unit 310. When making a call, for example, an audio signal input from the transmitter 304 is amplified by the amplifier 317, further digitally converted by the A / D converter 318, and input to the control unit 310. The signal is processed by the control unit 310 as necessary, and then output from the receiver 303 via the D / A converter 316 and the amplifier 315.

On the other hand, the connection interface 331 is connected to a control radio wave transmitter 338 that transmits a control radio wave. The control radio wave is transmitted from the antenna 339 via the duplexer 337. When the mobile phone 1 moves to another communication zone, the network-side radio network controller performs a known handover process based on the reception status of the control radio wave.

  Next, the mobile phone 1 is provided with the following functions for outputting ringtones and playing music. That is, ringtone data and music data (MPEG3 data or MIDI data: also used as a ringtone) downloaded by wireless reception are stored in the sound data flash ROM 316. In the case of MIDI data, musical tone data in which tone color, pitch, tone length, tempo, etc. are described according to the MIDI code is sent to the musical tone synthesis unit 307. The tone synthesizer 307 reads the waveform data of the specified tone color from the waveform ROM 358 functioning as a sound source while buffering the tone data, converts the frequency so that the pitch specified by the MIDI code is obtained, and specifies the tone data. This is sequentially output as digital waveform data according to the set tempo. The output digital waveform data is output from the speaker 311 via the analog conversion circuit 359 and the amplifier 350. Note that sound data composed of compressed waveform data such as MPEG3 is output from the speaker 311 via the analog conversion circuit 359 and the amplifier 350 after being decoded. In this embodiment, the timing information of the voice output by the musical tone synthesis unit 357 is input to the sequencer 352, and the vibrator unit 354 and the LED unit 355 are driven synchronously with music via the PWM unit 353, so that the sound output from the mobile phone 1 is performed. The device has been devised to further enhance the hospitality effect by combining vibration and LED light emission.

Next, the hospitality decision making unit 2 is connected to the following sensor / camera group. Some of these function as scene estimation information acquisition means and also function as user biometric characteristic information acquisition means.
External camera 518: Takes a picture of a user approaching the car. Acquire user gestures and facial expressions as still images or videos. In order to magnify a user for photographing, an optical zoom method using a telephoto lens and a digital zoom method for digitally enlarging a photographed image can be used in combination.
Infrared sensor 519: Takes a thermography based on the infrared rays emitted from the face portion of the user approaching or riding the vehicle. By functioning as a body temperature measurement unit that is a biological state detection unit and measuring the temporal change waveform, it is possible to estimate the user's physical state or mental state.

Seat sensor 520: Detects whether the user is seated on the seat. It can be composed of a proximity switch or the like embedded in the automobile seat. In addition, a seating sensor can be configured by a camera that captures a user seated on a seat. With this method, when a load source other than a person such as luggage is placed on the seat, it can be distinguished from a case where a person is seated, for example, a hospitality operation is performed only when a person is seated. Selection control is also possible. In addition, if a camera is used, it is possible to detect the motion of a seated user, and the detection information can be further diversified. In order to detect the user's movement on the seat, there is a method using a pressure sensor attached to the seat.

  Further, in the present embodiment, as shown in FIG. 58, the posture of the seated user (driver) is based on the detection outputs of the seating sensors 520A, 520B, and 520C embedded in a plurality of distributed portions in the seat and backrest of the seat. The change is detected by the waveform. Both are configured by a pressure sensor that detects a seating pressure, and specifically, a reference sensor 520A is arranged at the center of the back of a user seated facing the front. The remaining sensor is composed of a left sensor 520B arranged to be deviated to the left of the seat and a right sensor 520C arranged to be deviated to the right of the sheet. The difference between the output of the reference sensor 520A and the output of the right sensor 520C and the output of the left sensor 520B is calculated by the differential amplifiers 603 and 604, respectively. Input to the amplifier 605. The posture signal output Vout (second-type biological state parameter) is substantially a reference value (here, zero V) when the user is sitting facing the front, and when the posture is biased to the right, the output of the right sensor 520C is output. Since the output of the left sensor 520C decreases and shifts to the negative side, when the posture is biased to the left, the opposite is true and shifts to the positive side. Note that the right sensor 520C and the left sensor 520B are output by the adders 601 and 602 as added values of the sensor output on the seat side and the sensor output on the back side, but the remaining sensor output and the back sensor output are output. (When doing so, the output on the backrest sensor side decreases when the driver turns forward, and the difference value increases, so this is detected as a larger posture collapse) be able to.

-Face camera 521: Photographs the facial expression of the user who is seated. As shown in FIG. 49, the upper body including the face of the user (driver) who is attached to the rearview mirror 331 and the like and is seated on the seat is photographed obliquely from the front glass 337 side. The facial expression image is cut out from the image, and various facial expressions shown in FIG. 59 can be specified by comparing various facial expressions of the user with a master image prepared in advance. Regardless of the physical condition or the physical condition, the order of the facial expression is determined in the order of good condition, and points are given according to the order (for example, in the case of mental state, stability is “1”, distraction and anxiety “2”, excitement / anger is set to “3”, etc.), facial expressions can be used as discrete numerical parameters (second-type biological state parameters), and their temporal changes can be measured as discrete waveforms. The mental state or the physical state can be estimated based on the waveform. Note that a change in the posture of the driver can also be detected from the image shape of the upper body including the face and the position of the center of gravity on the image. That is, the change waveform of the center of gravity position can be used as a change waveform of the posture (second type biological condition parameter), and it is possible to estimate the mental state or the physical state based on the waveform. In addition to the function as an acquisition source (biological condition detection unit) of user biometric characteristic information used for hospitality control, it is also used for user authentication by biometrics. It is also possible to specify the direction of the face and line of sight by detecting the direction of the iris of the eyes (for example, if you look at the direction of the clock at times, it is estimated that you are impatient with time) Etc.) Further, based on the temporal change waveform of the angle of the line-of-sight direction (detecting the shake angle to the left and right with respect to the reference direction as a reference direction when the head is facing directly in front as the waveform change) (second-type biological condition parameter), It is also used to estimate the physical or mental state of the driver.
Microphone 522: Detects user voice. This can also function as a biological state detection unit.

Pressure sensor 523: It is attached to the grasping position of the steering wheel or shift lever of the vehicle by the user, and detects the gripping force of the user, the repetition frequency of gripping and releasing, etc. (biological state detection unit).
Blood pressure sensor 524: As shown in FIG. 50, the blood pressure sensor 524 is attached to the user grasping position of the steering wheel of the automobile (biological condition detection unit). The blood pressure value detected by the blood pressure sensor 524 is recorded as a waveform of the temporal change (first type biological condition parameter), and is used to estimate the physical state or mental state of the driver based on the waveform.
Body temperature sensor 525: As shown in FIG. 50, the body temperature sensor 525 includes a temperature sensor attached to the user grasping position of the steering wheel of the automobile (biological condition detection unit). The body temperature value detected by the body temperature sensor 525 is recorded as a waveform of the temporal change (first type biological condition parameter), and is used to estimate the physical state or mental state of the driver based on the waveform.
Skin resistance sensor 545: a well-known sensor that measures the resistance value of the body surface due to perspiration or the like, and is attached to a user grasping position of a car handle as shown in FIG. The skin resistance value detected by the skin resistance sensor 545 is recorded as a waveform of the temporal change (first type biological condition parameter), and is used to estimate the physical state or mental state of the driver based on the waveform.

Retina camera 526: Takes a user's retina pattern and is used for user authentication by biometrics.
49. Iris camera 527: As shown in FIG. 49, the camera is attached to a rearview mirror 331 or the like, takes an image of the user's iris (iris), and is used for user authentication by biometrics. When an iris image is used, collation / authentication is performed using the personality of the pattern and color. In particular, the iris pattern is an acquired component and has a low genetic influence, so there is a significant difference even in identical twins, and there is an advantage that it can be reliably identified. An authentication method using an iris pattern has features that it can quickly recognize and collate and has a low misidentification rate. Further, the physical state or the mental state can be estimated based on the temporal change in the driver's pupil size (second type biological condition parameter) photographed by the iris camera.
Vein camera 528: The user's vein pattern is photographed and used for user authentication by biometrics.
-Door courtesy switch 537: Detects opening and closing of the door. It is used as a scene estimation information acquisition means for detecting the transition to the boarding scene and the getting-off scene.

  In addition, the output of the ignition switch 538 for detecting the start of the engine is branched and input to the hospitality determination unit 2. An illuminance sensor 539 for detecting the brightness level in the vehicle and a sound pressure sensor 540 for measuring the sound level in the vehicle are also connected to the hospitality decision making unit 2 in the same manner.

  The hospitality decision-making unit 2 may also be a touch panel (a touch panel superimposed on the monitor of the car navigation system 534: in this case, input information is transferred from the hospitality execution control unit 3 to the hospitality decision-making unit 2) And the like, and a storage device 535 configured by a hard disk drive or the like that functions as a hospitality operation information storage unit.

  On the other hand, the hospitality execution control unit 3 is also connected with a GPS 533 (also used in the car navigation system 534), a brake sensor 530, a vehicle speed sensor 531 and an acceleration sensor 532 for acquiring vehicle position information.

  The hospitality decision-making unit 2 acquires user biometric information including at least one of the personality, mental state, and physical condition of the user from the detection information of one or more of the sensor / camera groups 518 to 528, In response, it determines what hospitality operation is to be performed by which hospitality operation unit, and commands this to the hospitality execution control unit 3. In response to this, the hospitality execution control unit 3 causes the corresponding hospitality operation units 502 to 517, 534, 541, 548, 549, 550, 551, 552, and 1001B to execute the hospitality operation. That is, the hospitality decision making unit 2 and the hospitality execution control unit 3 cooperate with each other, and the hospitality operation units 502 to 517, 534, 541, 548, 549, 550, A function of changing the operation contents of 551, 552, and 1001B is realized. The hospitality execution control unit 3 is connected to a wireless communication device 4 that constitutes a vehicle side communication means (host side communication means). The wireless communication device 4 communicates with a user-side terminal device (mobile phone) 1 carried by a user of an automobile via a wireless communication network 1170 (FIG. 15).

  On the other hand, the car audio system 515 is provided with an operation unit 515d (FIG. 17) that is manually operated by the user, and by inputting music selection data from the operation unit 515d, desired music source data can be read and played. The volume / tone control signal from the operation unit 515d is input to the preamplifier 515g. This music selection data is transferred from the interface unit 515a to the hospitality decision making unit 2 via the hospitality execution control unit 3 of FIG. 1, and is stored as music selection result data in the storage device 535 connected thereto. Based on the stored contents, a user-personality determination process, which will be described later, is performed (that is, the operation unit 515d of the car audio system 515 can be said to constitute the function of the user biometric characteristic information acquisition unit).

  FIG. 18 shows an example of the database structure of the music source data, in which music source data (MPEG3 or MIDI) is stored in association with the song ID, song name, and genre code. In addition, each music source data includes the personality type estimated for the user who selected the music (“active”, “adult”, “optimistic”, “pessimistic”, “degenerate”, “ ”,“ Intellect ”,“ Romanticist ”, etc., as well as the age code (“ Infant ”,“ Children ”,“ Junior ”,“ Youth ”,“ Middle Age ”,“ Midpoint ”,“ Middle Age ”) , “Respect for the elderly”, “age unrelated”, etc.) and gender codes (“male”, “female” and “gender unrelated”) are stored in association with each other. The personality type code is one of user personality specifying information, and the age code and the sex code are sub-classes that are unrelated to the personality. Even if the personality of the user can be identified, if the music source that does not match the age group or gender is selected, the effect of “hospitality” to entertain the user is halved. Therefore, in order to further narrow down the suitability of the music source provided to the user, the sub-classification as described above is effective.

  On the other hand, each music source data also stores a song mode code in association with each other. The song mode code is data indicating the mental state and physical condition of the user who selected the song, and the relationship between the song and the song. In the present embodiment, the song mode code is “smooth”, “exhilarating”, “warm / healing”. And “Healing / α-wave system”. Since the personality type code, age code, gender code, genre code, and song mode code are data to be referred to when selecting the hospitality content specific to each user, these are collectively referred to as hospitality reference data. .

  In the ROM of the hospitality decision making unit 2 in FIG. 1, as shown in FIG. 2, a hospitality decision table 360 for storing hospitality contents for each scene is stored. In this embodiment, an approach scene SCN1, a boarding scene SCN2, a preparation scene SCN3, a driving / staying scene SCN4, an exit scene SCN5, and a leaving scene SCN6 are set in this order in this order. In addition, the following five hospitality genres (ST) are set for each scene, and one or more hospitality themes (OBJ) are set for each scene.

  As will be described later, the approach scene is specified by the user-side GPS 554 and the car-side GPS 533 to identify the relative distance between the car and the user located outside the car and its change, and the user determines the car in advance. This is done by detecting the approach within a given distance. The boarding scene and the getting-off scene are specified based on the door opening detection output of the door courtesy switch 537. However, since it is not possible to specify whether it is a boarding scene or a getting-off scene only by door opening information, FIG. Thus, the scene flag 350 is provided to cope with this. The scene flag 350 has an individual scene flag corresponding to each scene, and each time a scene whose arrival order is determined in time series arrives, the flag corresponding to the scene is set to “arrival (flag value 1)”. I will do it. By specifying the latest flag of which the value is “1” in the scene flag 350 (the last one in the “1” flag row), it is possible to specify which scene is currently advanced.

  The preparation scene and the scene driving / staying scene are both specified by whether or not the above-mentioned seating sensor detects the user, but until the ignition switch 538 is turned on after entering the automobile, or It is recognized as a preparation scene until the ignition switch 538 is not turned ON and the continuation of sitting beyond a certain level is confirmed. Further, the transition to the leaving scene is identified by the door courtesy switch 537 detecting the door closing after the getting-off scene.

  The hospitality operation in each theme is controlled by the operation control application of the corresponding hospitality operation unit, and these operation control applications are stored in the ROM of the hospitality execution control unit 3 in the form of a theme-specific application library 351 as shown in FIG. It is remembered. The theme determined on the hospitality decision making unit 2 side is notified to the hospitality execution control unit 3, and the operation control application of the corresponding theme is read and executed there. When executing a motion control application, the priority of adoption is determined in advance according to the degree to which the user is oriented to the hospitality for a plurality of hospitality operations managed under each hospitality theme. The theme (or scene) is selected from the plurality of prepared hospitality operations having the highest priority. Specifically, as illustrated in FIGS. 7 to 13 (detailed later), the operation priority of a plurality of hospitality operation units (hospitality functions) (the larger the number, the higher the priority is displayed) Are selected for each hospitality theme and stored in the ROM of the hospitality execution control unit 3.

  Hereinafter, the operation of the automobile user hospitality system (hereinafter also simply referred to as “system”) 100 will be described. 46 to 48 conceptually show an overall algorithm of a series of processes from hospitality decision making to hospitality operation execution in the system 100 (these three figures are shown by using the corresponding circle numbers as connectors. It should be read as a connection diagram). The hospitality main processing includes “objective estimation (δ1)”, “personality adaptation (δ2)”, “state adaptation (δ3)”, “production correspondence (δ4)”, “function selection (δ5)” and “drive (δ6)”. It consists of each step.

  First, in “objective estimation (δ1)”, the current scene is estimated by user position detection (β1) and user motion detection (β2). Specifically, the user position detection (β1) is performed by grasping and specifying the relative positional relationship (α1) between the user and the automobile. In the present embodiment, the user approach direction (α2) is also considered. On the other hand, the user motion detection (β2) is basically performed by sensors (scene estimation information acquisition means) that detect motions fixed for scene determination, such as door opening / closing operations and seating on a seat. The output is used (α6). Further, the duration (α7) of the specific operation is also taken into consideration, as in the case of detecting the transition from the preparation scene to the driving / staying scene based on the sitting duration.

  FIG. 3 is a flowchart showing the flow of the scene determination process. This process is repeatedly executed at regular intervals during use of the automobile. First, in S1, the scene flag 350 in FIG. 5 is read. S2, S5, S8, S12, S16, and S20 are processes for discriminating from the state of the scene flag 350 which scene is currently advanced. The scene flag 350 is set in order from the flag of the scene positioned earlier in time series, and the flag of the subsequent scene is not set once with the preceding scene interposed. .

  Steps S2 to S4 are identification processes for an approaching scene. First, in S2, it is confirmed that the flag SCN1 for the approaching scene is not “1” (that is, the approaching scene has not yet arrived). FIG. 1) and the position information specified by the GPS 554 on the user side (mobile phone 1: FIG. 5) respectively, it is determined whether or not the user has approached the vehicle within a certain distance (for example, 50 m or less). If it is approaching, it is determined that the approach scene has been entered, and S4SCN1 is set to “1”.

  S5 to S7 are boarding scene identification processing. In S5, it is confirmed that the flag SCN2 for the boarding scene is not "1", and in S6, it is determined whether the door is opened from the input information from the door courtesy switch 537. . If the door is open, it is determined that the boarding scene has been entered, and SCN2 is set to "1" in S7. Since it is confirmed that the current scene is SCN = 1, that is, an approaching scene, it is possible to easily determine that the “door open” in this situation is at the time of boarding.

  S8 to S11 are preparation scene specifying processes. In S8, it is confirmed that the flag SCN3 for the preparation scene is not “1”, and in S9, it is determined whether the user is seated from the input information from the seating sensor 520. If the user's seating is detected, it is determined that the preparation scene has been entered, and SCN3 is set to “1” in S10. At this stage, it is only detected that the seating has been completed, and it is only necessary to specify that the user is in a preparation stage to make a full transition to driving or staying in the vehicle. In S11, a seating timer used for determination of transition to the driving / staying scene is started.

  S12 to S15 are driving / staying scene specifying processing. In S12, it is confirmed that the flag SCN4 for the driving / staying scene is not “1”, and in S13, it is determined from the input information from the ignition switch 538 whether or not the user has started the engine. If the engine has been started, it is immediately determined that the operation / stay scene has been entered, jumping to S15 and setting SCN4 to "1". On the other hand, even if the engine has not been started, if the seating timer has elapsed for a certain time (t1), it is determined that the user has boarded to stay in the vehicle (for example, for purposes other than driving), and the process proceeds to S15 and SCN4 Is set to “1” (if t1 has not elapsed, S15 is skipped to continue the preparation scene.

  S16 to S18 are processing for specifying the getting-off scene. In S16, it is confirmed that the flag SCN5 for the getting-off scene is not “1”, and in S17, it is determined whether or not the user has stopped the engine from the input information from the ignition switch 538. If the engine is stopped, the process proceeds to S18, and it is determined from the input information of the door courtesy switch 537 whether the user has opened the door. If the door is open, it is determined that the exit scene has been entered, and SCN5 is set to "1" in S19.

  S20 to S23 are separation scene specifying processes. In S20, it is confirmed that the flag SCN6 for the separated scene is not “1”, and in S21, it is determined from the input information from the ignition switch 538 and the seating sensor 520 whether the user has closed the door while leaving the seat. If Yes, the process proceeds to S22, and SCN6 is set to "1". Further, in S23, the getting-off timer is activated. When SCN6 is 1 in S20 (that is, when a separated scene has already arrived), the process proceeds to S24 and subsequent steps. The time t2 required for the hospitality process in the getting-off scene is measured by the getting-off timer. If t2 has already elapsed in S24, the scene flag is reset for the next hospitality process in S25, and the seating timer in S26. And reset the getting-off timer.

Returning to FIG. 46, if the scene is determined at γ1, the hospitality content in the scene is determined. This determination is made with reference to the hospitality decision table 360 of FIG. As described above, a plurality of hospitality genres are set for each scene, and a hospitality theme is set for each genre. As described above, genres and hospitality themes are variously set from the viewpoints of desires and orientations desired by users. More specifically, in each scene, the user wants to satisfy the requirements of “safety”, “easy”, and “comfortable” when using the car, and the demand is disturbed by some factors. The cause is identified as a disturbance. And it can be said that the purpose of the final system is to measure the response so that each individual request is satisfied by performing some response processing, that is, hospitality operation. The hospitality genre and hospitality theme are determined according to the type. Among these, the genre is determined based on the “disturbance” that can be found in common for each scene.
(ST1) Expect and excite users;
(ST2) Relax the user and give them peace of mind;
(ST3) Eliminate user anxiety and tension;
(ST4) Reducing the physical burden on the user;
(ST5) Assist with suitability according to the physical condition of the user;
5 genres are set.

  In FIG. 2, one of the hospitality themes belonging to the expectation / excitement genre ST1 and the relaxation / relaxation genre ST2 is selected according to the personality and mental state of the user (that is, these genres). Are selected exclusively from each other). Hospitality themes of other genres are simultaneously selected in each scene, and hospitality operations belonging to those themes are performed in parallel in the corresponding scenes.

  On the other hand, different hospitality themes belonging to each genre are set depending on the scene. The theme of each scene by genre is as described in FIG. There are also themes set across multiple scenes. For example, the theme of the anxiety / tension relief genre ST3 “I want you to make your car comfortable” OBJ321 is defined as covering three scenes: boarding, preparation, and driving stay. Moreover, OBJ331 “I want to know the state of the destination” spans two scenes of preparation and driving stay.

  The hospitality decision-making table 360 is used in accordance with the flow shown in FIG. 4 (this corresponds to the main part extracted from the hospitality main process indicated by δ1 to δ6 in FIGS. 46 to 48). In S101, the scene flag is read, and in S102, what the current scene is is specified. In S103, the hospitality theme corresponding to the identified scene is read, and the hospitality function (hospitality operation unit) belonging to the theme is selected with reference to the function selection tables 371 and 372 illustrated in FIGS. In step S105, a hospitality application for specifically operating the extracted hospitality function is selected from the theme-specific application library 351 in FIG. 6 and activated.

  Returning to FIG. 46, as correction items at the time of scene specification, the user's dressing detection (α3: can be grasped from the photographed image of the user's figure by the camera 518 (FIG. 1) when approaching), property detection ( (α4: baggage, etc.), gesture detection (α5: detected as a sign of an action directly related to scene estimation), and the like can also be executed. These detections effectively contribute to hospitality theme determination for each scene.

  Next, it progresses to (delta) 2 and becomes the process which adapts the content of hospitality to a user's individuality. Specifically, this is done by appropriately weighting each individual hospitality process according to the personality determination process described later and the determined personality, that is, in order to adapt to the individual user's personality. The object is to customize a combination of hospitality operations as appropriate, or to change the level of hospitality operations. The personality determination process requires personality determination processing β4 or ε2. Process ε2 is for obtaining personality classification by user input, such as questionnaire processing, etc., and process β4 is for determining personality classification more analytically from the user's actions, actions, thought patterns, facial expressions, etc. It is. As for the latter, a specific example of determining personality classification from music selection statistics is shown in the later-described embodiment. However, as in α10, a habit directly connected to personality determination is extracted from the user's action, or α11 In this way, it is possible to make a personality determination from the human phase.

  Proceeding to FIG. 47, in δ3, the hospitality content is adapted to the mental / physical state of the user. Although a specific example will be described later in this respect as well, mental / physical condition information reflecting the mental state and physical condition of the user is acquired based on the detection information of the biological state detection unit, and the user's Monitor mental status or physical condition. As the biological state detection unit, an infrared sensor 519 (facial color: α20), a face camera 521 (expression: α12, posture: α14, line of sight: α15, pupil diameter: α16), a pulse sensor 524 (heartbeat: α17), and the like can be employed. In addition to these, sensors (502w, 530, 531, 532, 532a; erroneous operation rate: α13), blood pressure sensor (α18), breath sensor (alcohol: α21, for example, alcohol for expiration) Is detected), the seating sensor 520 (measures the weight distribution on the seat with the pressure sensor, detects the minute weight shift during driving, It is possible to make a judgment that the calmness is impaired, or to detect a biased weight and determine the degree of fatigue of the driver).

  Also here, the gist of the processing is to replace the output from the above-mentioned biological state detection unit with a numerical parameter indicating the mental state and physical condition (β5), and to change the mental state and physical condition of the user from the numerical parameter and its temporal change. Specify (γ3, γ4) and give appropriate weighting to each hospitality process, that is, customize the combination of multiple hospitality operations to suit the mental state and physical condition of the user, or entertain The purpose is to change the degree of operation. Even if the hospitality is the same in the same scene and theme, as described above, if the user's personality is different, it is better to perform a hospitality operation that matches that personality. It is of course desirable to adjust the type and degree of hospitality.

  In this case, taking the case of illumination light as an example, the lighting color directed by the user differs depending on the personality (for example, the active type is red, the gentle type is green or blue), and the physical condition is good or bad Therefore, the demands on the illumination intensity (for example, when the physical condition is poor, the light amount is reduced to suppress the stimulation by illumination) are often different. The former is hospitality control for adjusting the frequency or wavelength of the illumination light (the wavelength becomes shorter in the order of red, green, and blue), and the latter is hospitality control for adjusting the amplitude of the illumination light. In addition, mental state is a factor related to both of them, and in a somewhat cheerful mental state, it is possible to adopt red illumination light (frequency adjustment) to further boost the mood, and the color of the illumination light It is possible to increase brightness without changing (amplitude adjustment). In an excessively excited state, processing such as adopting blue illumination light (frequency adjustment) to reduce feelings or reducing brightness without changing the color of the illumination light (amplitude adjustment) can be considered. In the case of music, it is more complicated because it contains various frequency components, but in order to enhance the arousal effect, to emphasize the high-frequency sound wave of about several hundreds to 10 kHz, or conversely to sink feelings The control pattern by frequency / amplitude, such as adopting so-called α wave music that combines the center frequency of sound wave fluctuations with the frequency (7-13 Hz: Schumann resonance) of the brain wave (α wave) when relaxing Can be grasped as well.

  With regard to the brightness and sound wave level in the vehicle, the suitability level can be set numerically for each hospitality theme in consideration of the personality, mental state and physical condition. FIGS. 7, 8, 9 and 10 show examples in which the function selection table 371 for each theme is accompanied by a control suitability value setting table 371a for the required illumination level and sound wave level. Then, the process proceeds to δ4 in FIG. For example, information (disturbance stimulus) on how much stimulus the user currently feels is obtained from the output of the illuminance sensor 539 (visual stimulus: α23), sound pressure sensor (auditory stimulus: α24), etc. in FIG. Environmental estimation: β6), the disturbance stimulus is converted into a numerical value that can be compared with the suitability value obtained from the personality (personality), mental state, and physical condition, and the disturbance is numerically estimated (γ6) . As the disturbance stimulus to be specified, a tactile stimulus (α25: for example, a pressure sensor 523 attached to the handle), an olfactory stimulus (α26: by an olfactory sensor), or the like can be used in combination. Regarding disturbance estimation, indirect stimulation from the space surrounding the user, specifically, height (α27), distance (α28), depth (α29), and the physique of the passenger or passenger (α30), etc. It is also possible to do.

  Next, at δ5, function selection processing is performed. Here, in order to reduce the difference between the disturbance stimulus and the aptitude value, the hospitality functions (hospitality operation units) with the highest priority shown in the function selection tables 371 and 372 are adopted in order, and each hospitality operation unit is selected at δ6. This is the driving process. At this time, information relating to whether or not the content and level of the hospitality function actually selected is liked by the user is estimated from, for example, the output of the above-described biological state detection unit, or input information (like / It may be a direct input related to disagreement intentions, or may be inferred from an operation input that avoids disliked music or lighting) and is fed back to provide hospitality operation control It is also possible to give a kind of learning effect (ε5, ε6 and γ7).

  In addition, as a function selection determination element of a different system from this, the function state of the hospitality operation unit is determined (α31) and maintained as car deterioration information (β8), and the function state contributes to either normal or abnormal It is also possible to determine whether or not (γ8), positively adopt the function that contributes to normality, and perform processing to avoid the function that contributes to abnormality.

  In addition, it is important to increase the hospitality effect by determining the concept of hospitality operation according to the type of vehicle and the content that matches the image of the vehicle. For high-end cars, a smart hospitality production that is generally calm and can emphasize luxury is effective, and conversely, it can be said that a bright and lively production is appropriate for sports and leisure vehicles.

Hereinafter, representative examples of hospitality in individual scenes will be described.
FIG. 28 shows the flow of the hospitality operation process in the approaching scene SCN1. The theme is “encouragement to ride a car” in FIG. 2 and belongs to the expectation / stimulation genre ST1 according to the personality classification of the user (OBJ111; for example, the personality classification is “active SKC1” (FIG. 18) ) And those belonging to the Relax / Peace genre ST2 (OBJ211; for example, when the personality classification is “soft SKC2” (FIG. 18)). Also, the user's physical condition or mental condition is estimated by the method described later, and the result is reflected in the hospitality process. In this embodiment, as described in detail later, “physical condition (mild / severe)”, “distraction concentration”, and “excitement (anger) state” are estimated as physical condition or mental condition. The hospitality operation as shown in FIG. 67 is performed according to each state.

  In S21 of FIG. 28, the approach direction of the user (that is, the terminal device 1) to the automobile is specified. On the automobile side, the direction of the automobile can be specified together with the position of the automobile from the position information by the GPS 533 and the history of changes in the traveling direction of the automobile leading to parking. Therefore, by referring to the position information of the user (from the GPS 554) sent from the mobile phone 1, whether the user is approaching the vehicle from, for example, the front side, the rear side, or the side, and the vehicle It is recognition of how far the user is approaching.

  Proceed to S22, and if the approach direction is from the front, proceed to S23 and select the front lamp group. As shown in FIG. 23, a headlamp 504, a fog lamp 505, and a cornering lamp 508 are used as the front lamp group in this embodiment. If the approach direction is from the rear, the process proceeds from S24 to S25, and the rear lamp group is selected. As shown in FIG. 24, as the rear lamp group, a tail lamp 507, a backup lamp 509, and a stop lamp 510 are used in this embodiment. In other cases, it is determined that the vehicle is approaching from the side, and the process proceeds to S26 to select a side lamp group. As shown in FIG. 25, a hazard lamp 506, a tail lamp 507, and an underfloor lamp 512 are used as side lamp groups in the present embodiment.

  In S27, the distance between the car and the user is specified by the above method. If the distance between the car and the user can be specified, if the distance exceeds a first upper limit (for example, set to 20 m or more), the process proceeds to S29, and the long distance illumination mode is set. Moreover, if it exceeds the 2nd upper limit (for example, set to 5 m or more and less than 20 m), it will progress to S31 and will be in the middle distance illumination mode. In other cases (that is, in the case of the second upper limit value or less), the process proceeds to S32 and the short distance illumination mode is set. When the user is farther from the car (that is, in order of short-distance illumination mode → medium-distance illumination mode → long-distance illumination mode), the total light quantity from each lamp (illumination) increases (when the beam angle is involved) , The amount of light that the user can see when standing in front of the illumination: For example, if the lamp is turned upward to make it a high beam, the amount of light that is visible will increase even if the intensity of the light source does not change from the low beam) The light emission operation of each individual lamp is controlled. This enhances the effect of illuminating the approach to the car and guiding the user to the car safely.

  FIG. 23 shows an operation example when the approaching direction of the user U is the front side. In the long-distance illumination mode, the headlamp 504 is turned on with a high beam, and in the intermediate-distance illumination mode, the amount of light is reduced as a low beam. That is, a method is employed in which the amount of visible light of the same lamp is changed by adjusting at least one of the light source intensity (adjustable by the drive voltage or the like) and the beam angle. On the other hand, in the short distance illumination mode, the fog lamp 505 or the cornering lamp 508 having a smaller light quantity is switched. When the user U approaches from the front, the fog lamp 505 is turned on. When the user U moves toward the side of the vehicle, the corresponding side of the cornering lamp 508 is turned on.

  FIG. 24 shows an operation example when the approaching direction of the user U is the rear side. In the long distance illumination mode, all of the backup lamp 509, the tail lamp 507 and the stop lamp 510 are turned on, and in the middle distance illumination mode, only the tail lamp 507 and the stop lamp 510 are turned on to reduce the amount of light. That is, a method is adopted in which the total amount of light is changed by changing the number of lamps to be lit among a plurality of lamps. In the short-distance illumination mode, only one of the backup lamp 509, the tail lamp 507, and the stop lamp 510 is switched on. When the user U approaches from the rear center, only the tail lamp 507 (or only the stop lamp 510) is turned on. When the user U moves toward the side of the vehicle, the one on the corresponding side of the backup lamp 509 is used. Light up.

  FIG. 25 shows an operation example when the approaching direction of the user U is the side. In the long-distance illumination mode, all of the hazard lamps 506 and the plurality of underfloor lamps 512 are turned on. In the middle-distance illumination mode, only the hazard lamps 506 are extinguished to reduce the amount of light. In the short-distance illumination mode, only the lamps close to the user U among the plurality of underfloor lamps 512 are switched on. When the user U approaches from the center on the vehicle side, only the center underfloor lamp 512 is turned on, and when the user U moves in the vehicle length direction, the corresponding underfloor lamp 512 is switched on. As the user U approaches, the illumination angle of the underfloor lamp 512 may be changed to change the illumination area so as to guide the user U toward the automobile. In either case, in the short distance illumination mode, the room illumination 511 is also turned on to treat the user who tries to get into the car more politely.

  There is also a method of performing illumination with an illumination lighting pattern in which an image of a destination facing in the future is imagined. For example, if the destination is the sea, it is effective to light up with an illumination pattern reminiscent of a wave that gradually increases and then decreases the illuminance of blue illumination light.

  In this case, the illumination driving form described above has variations as shown in FIG. 67 according to the physical condition and mental state of the user. If it is “slightly poor physical condition”, for example, light that is not necessary among illumination lights used for illumination is reduced to improve visibility when the user approaches the automobile. Also, if it is “severe physical condition”, white or warm-colored darker lighting is adopted to reduce the psychological burden. On the other hand, if it is estimated that “concentration distraction” is performed, the lighting operation is performed in order to wake the user (for example, it is more effective to use stimulating wavelengths of primary colors such as red and blue). is there). On the other hand, when it is estimated that the state is “excited (angry)”, the use of blue illumination light is effective in sinking an excessively high mental state.

  In addition, as a hospitality operation unit that can be controlled by a wireless command from the user terminal 1, for example, if peripheral equipment having a building-side illumination 1161 as shown in FIG. The operation of lighting up the vehicle by 1161 may be added to the hospitality operation. As shown in FIG. 27, in the long-distance lighting mode, the parking position becomes easier to understand by illuminating your car in the parking lot at night, and the effect of raising the feeling of the user before boarding by lighting up is also effective. Arise. On the other hand, in the middle-range or short-distance lighting mode, the area around the car is widely illuminated, so the effect of guidance or assistance is enhanced, and foreign objects etc. on the user's route (foot) to get into the car Can be easily discovered.

The personality classification is determined by the following method, for example.
The user of the car registers in advance in a user registration unit 600 (for example, a ROM of the hospitality decision making unit 2 (preferably configured with a flash ROM so that it can be rewritten) as shown in FIG. 36. In the user registration unit 600, each user name (or user ID) and its personality type (see FIG. 18) are registered in association with each other. As will be described later, while the user continues to use the vehicle, it is acquired and accumulated as operation history information in a specific operation unit, and is estimated based on the accumulated operation history information. If the operation history information is insufficiently accumulated, such as immediately after, or if you want to estimate the personality type without collecting the operation history information, The information necessary to identify the rank classification information or the sex rating type information is input by the user himself may be determined character type on the basis of the input result.

  In FIG. 37, the personality type is displayed on the monitor 536 of FIG. 1 (the monitor of the car navigation system 534 may be substituted), and the user selects the personality type that suits him and inputs this from the input unit 529. . Here, the input unit is a touch panel overlaid on the monitor 536, and a selection input is made by touching the selection button 529B formed on the display. On the other hand, in FIG. 38, instead of directly inputting the personality type, a questionnaire is input for determining the personality type. Questionnaire questions are displayed on the monitor 536, and the user answers by selecting an answer from the answer options (in this case, the options are configured with the selection button 529B, and the corresponding position on the touch panel 529 superimposed thereon is touched) Select input). By answering all the questions, one is uniquely determined from a personality type group determined in advance according to the combination of the answers.

  The user registration input including the user name is also made from the input unit 529 and stored in the user registration unit 600 together with the determined personality type. These series of inputs can also be performed from the mobile phone 1, and in this case, the input information is transferred to the automobile side by radio. In addition, when the user purchases a vehicle, there is a method in which the dealer side uses the input unit 529 or a dedicated input tool to perform user registration input in advance.

  Prior to using the car, user authentication is required. This is because, in particular, when a plurality of users are registered, the personality types are set to be different depending on the users, and the contents of hospitality are also different. The simplest authentication method is a method in which a user ID and a personal identification number are transmitted from the mobile phone 1 to the vehicle side, and the hospitality decision-making unit 2 receives this and verifies the registered user ID and personal identification number. is there. In addition, biometrics authentication methods such as collation of facial photographs using a camera provided in the mobile phone 1, voice authentication, authentication using fingerprints, and the like can be employed. On the other hand, when the user approaches the car, only simple authentication using the user ID and the personal identification number is performed. After unlocking, the user gets into the car, and then the face camera 521, microphone 522, retina camera 526, iris described above. Biometrics authentication by the camera 527 or the vein camera 528 may be performed.

  When the user is authenticated and specified as described above, the personality type (user biometric information) corresponding to the user is acquired by the hospitality decision making unit 2, and the selection and operation pattern of the corresponding hospitality operation unit are selected. As described above, for example, if the specified personality type is “active SKC1”, the theme OBJ111 belonging to the expected / encouraged genre ST1 is selected, and if the specified personality type is “gentle SKC2”, relaxation / comfort is achieved. The theme OBJ211 belonging to the genre ST2 is selected. The process flow is exactly the same for other scenes.

  FIG. 7 shows a function selection table 371 corresponding to the expectation / exciting theme OBJ111, and the function priorities of exterior lighting, interior lighting, window shielding (power window), and car audio are high. In any case, in order to perform flashing, the setting value of the external lighting level for illumination by the outside lighting in the control aptitude value setting table 371a, the setting value of the inside lighting, the sound output level from the car audio system 515 and the mobile phone 1 ( Here, the musical sound levels (music output) are all set high. The illumination outputs 504 to 512 and the drive output level of the car audio system 515 in FIG. 1 are treated as hospitality so that the illuminance detection level of the illuminance sensor 539 in FIG. 1 and the sound pressure detection level of the sound pressure sensor 540 approach the above set values. It is controlled by the control unit 3. Further, the audio output level of the mobile phone 1 is also set to a corresponding value by a radio command. In addition, even when the estimated mental state corresponds to distraction, it may be effective in increasing the degree of mental concentration in driving by expectation / pumping effects.

  On the other hand, FIG. 8 shows a function selection table 371 corresponding to the theme OBJ211 of the relaxation / comfort system. The function priority setting is the same as the expectation / pumping system, but the control aptitude value setting table 371a The setting value of the general lighting level, the setting value of the in-vehicle lighting, and the musical sound level are set lower than the expectation / exciting theme OBJ111, and a milder effect including lighting color and music selection is performed. In addition, when the estimated mental state or physical state corresponds to a poor physical condition or an excited state, the same mild effect is effective.

  The specific process is as follows. That is, when the user approaches to get into the car, the lighting device (FIGS. 23 to 25: reference numerals 504, 505, 507, and 509) differs depending on the acquired personality type (user biometric information). , 510, 511, 512: These operate as lighting devices that illuminate the exterior of the automobile (the interior light 511 also indirectly illuminates the exterior of the automobile with light leaking from the window)) It can be. When the expectation / exciting theme OBJ111 is selected, the amount of light emitted from the lighting apparatus involved in hospitality is increased or the number of blinks is increased, the headlamp 504 is turned into a high beam, the amount of light emitted from the red tail lamp 507 is increased, etc. , To produce a flashing up the user's approach to the car. On the other hand, when the relaxation / comfort system theme OBJ211 is selected, the amount of light emitted from the lighting device involved in hospitality is slightly reduced, flashing of flashing lighting is avoided, and the amount of light is gradually increased gradually. Alternatively, the lighting is performed in the order of the side lamp 512 illuminating the foot, the interior lamp 511, and the head lamp 504 (to cause the car to rise slowly, and so on). If it is not adopted, changes in the overall lighting color can be obtained compared to the lighting form for the “active” personality type, including headlamps and tail lamps, and lighting devices such as incandescent bulbs and halogen lamps. Instead of this, it is also possible to use a light emitting diode.

  Next, when the user approaches the vehicle, in addition to the lighting device as described above, a speaker (sound output unit) 311 provided in the mobile phone 1 (user side terminal device) should be used as a hospitality operation unit. You can also. In this case, the communication device 4 on the automobile side detects the approach of the mobile phone 1, that is, the user, and the speaker 311 with different output contents according to the personality type corresponding to the user (that is, the acquired user biometric information). The voice for hospitality is output. In the present embodiment, the voice data for hospitality is music source data, but it may be data of sound effects or human voices (so-called incoming voices or incoming voices). As shown in FIG. 1, the voice data for hospitality may be stored in a storage device 535 on the automobile side, and necessary data may be distributed to the mobile phone 1 via the communication device 4. Either may be stored in the sound data flash ROM 316 on the telephone 1 side. Here, the latter case will be described as an example.

  First, when a user is authenticated and specified, the personality type corresponding to the user is specified, and an ID list of hospitality voice data stored in the sound data flash ROM 316 is acquired from the mobile phone 1 by radio. Next, music source data corresponding to the specified personality type is selected from the list. Here, a plurality of music source data having different song mode codes are selected in order to perform a process that increases as the user approaches (here, a case where MIDI data is used is taken as an example).

  Here, as in the hospitality process with illumination described above, different effects are performed according to the distance (the process flow is the same as in FIG. 28). Corresponding to the user's mental state elevation, an order corresponding to the music mode code is set, and the music selection is performed so as to increase the spirit of elevation as the distance gets closer. Specifically, the closer to the car, the higher the mental state elevation, and the song mode code when approaching the user is "Healing / α wave system" or "Warm / Healing system" (for long distance) → The order is determined in the order of “exhilarating system” (for medium distance) → “lifting system” (for short distance). However, depending on your preference, it is of course possible to reverse the above order so that you get excited at first and calm down as you get closer to the car.

  First, as shown in FIG. 31, in the long-distance hospitality mode, the music source data ID (song ID) having the song mode code of “Healing / α wave system” or “Warm / Healing system” is transmitted to the mobile phone 1. (S201). The mobile phone 1 selects music source data corresponding to the ID and starts playing (S202). Next, in the medium distance hospitality mode shown in FIG. 32, the music source data ID (music ID) having the music mode code “exhilarating” is transmitted to the mobile phone 1 (S210). Then, the mobile phone 1 selects the music source data corresponding to the ID and starts playing, and as described above, the vibrator unit 354 and the LED unit 315 are driven synchronously with the music, thereby enhancing the hospitality by sound output. (S211). Further, the lighting device on the automobile side may be blinked in conjunction with music (S212).

  When the user finally approaches the point of getting into the car, the short-distance hospitality mode shown in FIG. 33 is entered, and the climax of the climax is performed. In other words, in S220 to S222, the processing is almost the same as that in the medium-distance hospitality mode, but the music source data is selected from the “rising system”. On the other hand, the music source data having the same ID is selected on the automobile side, and the performance in the car audio system 515 is started. In this case, if the power window is activated to open the window and output in synchronization with the performance of the mobile phone 1, the excitement effect can be further enhanced (S223). At this time, on the automobile side, if the pitch code of the main melody part of the MIDI data is changed so as to be lower (or higher) by the frequency of forming the harmony pitch with respect to the main melody part of the mobile phone 1 side, The output of the mobile phone 1 and the output of the car audio system 515 can be added, and the output timing of the main melody portion of the MIDI data is delayed (or advanced) by a fixed number of beats relative to the main melody portion on the mobile phone 1 side. If the output is changed as described above, it is possible to achieve a slewing effect between the output of the mobile phone 1 and the output of the car audio system 515.

  In step S224, the heart rate sensor 342 of the mobile phone 1 reads the user's heart rate, and changes the tempo code of the MIDI data so that the tempo increases in proportion to the heart rate. Thereby, the music to be output is uptempoed according to the heartbeat of the user, and the excitement effect is further enhanced. It should be noted that in the relaxation / relaxation theme OBJ21, it is possible not to perform the last flashy uplifting process for short distances.

  Also, in relation to the estimated mental state or physical state, if the physical condition is poor, the music is played mainly in the low temperature range avoiding the stimulating high range, or the volume is low if the physical condition is relatively heavy. And set the tempo to relax. Even in an excited state, it is effective to set the music tempo to a relaxed system. On the other hand, in the case of distracting concentration, it is effective to increase the volume in reverse, or to play music that is effective for mood awakening, such as percussion banging, screaming singing, or piano dissonance.

  As shown in FIG. 2, in the approach scene SCN1, in the anxiety / tension relief genre ST3, “I want to know the position of the car (OBJ311)” and “Confirmation of forgotten / closed doors (OBJ312)”, in the physical burden reduction genre ST4 Each theme of “I want to load cargo smoothly (OBJ311)” is defined. The hospitality processing of these themes is executed in parallel with the hospitality processing of the themes OBJ111 to OBJ211 for enhancing the feeling. FIG. 11 shows the contents of the function selection table 372 corresponding to the theme “I want to know the position of a car (OBJ311)”. Car interior lighting) is selected as the hospitality operating part. Specifically, for example, the position information of the car-side GPS 533 is notified to the mobile phone 1 side, and the map is displayed on the monitor 308 (FIG. 14) together with the position information of the mobile phone-side GPS 554, and the relative position between the user and the car. To be able to grasp. Further, when the user approaches the vehicle at a predetermined distance or less, the position of the vehicle is directly notified to the user by blowing the horn 502 and lighting the vehicle exterior light (or vehicle interior light).

On the other hand, in the “confirmed thing / door lock confirmation (OBJ312)”, a message for prompting caution confirmation before departure (voice data can be stored in the ROM of the hospitality execution control unit 3 and the audio output hardware of the car audio system Can be used for output processing). Examples of messages that prompt attention confirmations include the following: “Is my license and wallet OK?”
・ (If the destination set in the car navigation system is an airport) “Did you have a passport?”
・ Did you lock the entrance door?
・ "Is the back window open?"
・ Did you turn off the air conditioner in the room?
・ Did you tighten the gas mains?

  Next, the user's mental state or physical state is measured by measuring temporal changes in the facial expression of the user approaching the car (which can be taken with the camera 518 for external use) and body temperature (which can be measured with the infrared sensor 519). It can be estimated from the waveform. As described above, if the estimated mental state is normal, the hospitality operation of the expectation / healing genre ST1 is performed, and if the estimated mental state is unstable or angry (or excited) (or the physical state is in physical condition). If it is defective), it can be a hospitality operation of the relaxation / relaxation genre ST2.

  FIG. 56 shows an example of a flowchart of facial expression change analysis processing. The change counter N is reset in SS151, and if the sampling timing comes in SS152, the process proceeds to SS153 to capture a face image. The face image is repeated until a front image capable of specifying a facial expression is obtained (SS154 → SS153). When the front image is obtained, the facial expression type is specified by sequentially comparing with the master image (in the storage device 535) (SS155). If the specified facial expression type is “stable”, “1” is set to the facial expression parameter I (SS156 → SS157). If the specified facial expression type is “anxiety / discomfort”, “2” is set to the facial expression parameter I (SS158 → SS159). If the specified facial expression type is “excitement / anger”, “3” is set to facial expression parameter I (SS160 → SS161).

  In SS162, the previously acquired facial expression parameter value I 'is read and the change value ΔN is calculated. In SS163, the value is added to the change counter N. The above processing is repeated until a predetermined sampling period expires (SS164 → SS152). When the sampling period expires, the process proceeds to SS165, where the average value I (which is converted into an integer) of the facial expression parameter I is calculated, and the mental state corresponding to the facial expression value can be determined. Further, the larger the value of the change counter N, the greater the change in facial expression. For example, by setting a threshold value for the value of N, the expression change is changed from the value of N to “change small (−)”, “increase”, It can be determined as “slight increase” and “rapid increase”.

  On the other hand, FIG. 54 shows an example of a flow chart of the body temperature waveform analysis process. In the sampling routine, the body temperature value detected by the infrared sensor 519 is sampled every time the sampling timing set at a constant time interval comes. And record the waveform. In the waveform analysis routine, a body temperature value sampled in the latest fixed period is acquired as a waveform at SS53, a known fast Fourier transform process is performed on the waveform at SS54, and a frequency spectrum is obtained. The center frequency (or peak frequency) f is calculated. Further, in SS56, as shown in FIG. 53, the waveform is divided into a fixed number of sections σ1, σ2,... Then, for each section, with the average body temperature value as the waveform center line, the integral amplitudes A1, A2,... Value). In SS59, the integral amplitude A in each section is averaged and determined as a representative value of the waveform amplitude.

  Note that the information sampling program for waveform acquisition, including the following processing, manages the schedule so that when a scene can be identified, only the biological state detection unit related to the scene is activated at regular time intervals. Is done. Further, although not shown in the drawing, the repetition of sampling does not continue indefinitely. The repetition is aborted.

  In SS60, it is checked whether or not the frequency f is larger than the upper limit reference value fu0. In SS62, it is checked whether the frequency f is smaller than the lower limit reference value fL0 (> fu0). If it is smaller, it is determined that the body temperature change being monitored is “slow”. If fu0 ≧ f ≧ fL0, the process proceeds to SS64, and the body temperature change being monitored is determined to be “standard”. Next, proceeding to SS65, the integrated amplitude A (average value) is compared with the reference value A0. If A> A0, it is determined that the average body temperature level being monitored is in the “variation” state. If A ≦ A0, it is determined that the average body temperature level being monitored is in the “maintenance (stable)” state.

  The determination (estimation) of the specific mental / physical state of the user is performed using the determination result relating to the temporal change of the biological condition parameter obtained in this way. Specifically, in the storage device 535, as shown in FIG. 51, a plurality of estimated states that are mental states or physical states to be determined by the user and individual estimated states are established. Is stored in association with a combination of temporal change states of biological state parameters that should be detected by each of the plurality of biological state change detection units.

  In this embodiment, “diffused concentration”, “bad physical condition”, and “excited state” are defined as the estimated states. Specifically, “physical condition” is divided into a plurality of levels, here, “mild physical condition” and “severe physical condition”, and four basic estimated states are defined. It should be noted that “concentration distraction” and “excited state” can be divided into a plurality of levels in order to estimate a more detailed mental / physical state. In the present embodiment, in addition to the above-mentioned basic estimated state, the biological state parameter of the combined state of the physical state system and the mental state system (“concentration distraction” or “excited state”) is also used. Combinations of temporally changing states are uniquely determined to improve the estimation accuracy of these composite states.

  As biological condition parameters, including those used in subsequent scenes, “blood pressure”, “body temperature”, “skin resistance”, “expression”, “posture”, “line of sight”, “pupil (dimension)” and “ Each parameter of “steering” is covered. Even for the same parameter, the sensor or camera to be used is appropriately selected according to the scene, which is advantageous for obtaining the target biological condition parameter.

  As described above, in this approach scene, the user's facial expression by the external camera 518 and the user's body temperature by the infrared sensor 519 can be adopted as the biological condition parameters. According to the determination table 601, the change in facial expression increases rapidly when concentration is distracted, and the change in facial expression also tends to increase in the case of poor physical condition or excitement. Each can be identified as being in a state different from the normal state, but it is difficult to identify individual mental / physical conditions in detail. On the other hand, when looking at the body temperature, there is no significant change when the concentration is dissipated (that is, almost the same as normal), but it shows a gradual change when the physical condition is poor, and very much when the person is excited. Exhibits rapid changes. Therefore, by combining these two, it becomes possible to distinguish “distraction concentration”, “bad physical condition” and “excited state” from each other.

  The processing in this case is shown in FIG. Basically, a plurality of (in this case, facial expression and body temperature) biological condition parameters are collated with master information on the determination table, and an estimated state corresponding to a matching combination is currently established. The process is specified as a state. That is, in SS501 to SS508, a determination result (for example, “sudden decrease”) associated with the temporal change of each biological condition parameter by the analysis processing shown in the flowcharts of FIGS. Or “increase”). In SS509, in order to determine that each estimated state is established, master information indicating what change tendency each biological condition parameter in the determination table 601 should indicate, and the above determination result And the collation counter of the estimated state in which the master information matches the determination result is incremented. In this case, for example, for all biological condition parameters, only the estimated state in which the master information matches the determination result may be used. However, when there are many biological condition parameters to be referred to, the master information and the determination result Rarely match for all the biological condition parameters, and the user's physical condition or mental condition cannot be estimated flexibly. Therefore, it is effective to consider the score of the collation counter as the “matching degree” and determine the highest score, that is, the highest matching score as the estimated state (SS510).

  The addition to the collation counter may be performed only when the master information and the determination result completely match. However, even if the master information and the determination result do not completely match, a result that is close within a predetermined range is obtained. In this case, the score may be added to the verification counter while limiting to a lower score than in the case of perfect match. For example, when the master information is “rapid increase”, if the determination result is also “rapid increase”, 3 points are added, 2 points are added for “increased”, and 1 point is added for “slight increase”. It can be illustrated.

  Next, the hospitality process in the boarding scene SCN2 can be basically implemented as an extension of the process in the approach scene SCN1 (FIG. 2, OBJ121, OBJ221). That is, when the user gets into the car and the seating sensor 520 detects the user, the hospitality execution control unit 3 wirelessly transmits a performance stop command to the mobile phone 1. This completes the hospitality operation on the mobile phone 1. On the other hand, as for the theme of hospitality in the anxiety / tension relief genre ST3, “I want you to make the interior comfortable” (OBJ321: for example, keeping the interior at a suitable temperature by operating the air conditioner in advance, etc.) "Securing and trouble avoidance" (OBJ322). This can be achieved not only by the foot illumination by the underfloor lamp 512 of FIG. 1 but also by the obstacle suppression mode function of the obstacle and the door by the door assist mechanism 541 of FIG.

  Further, regarding the hospitality theme “I want to get into comfortably” (OBJ 421) of the physical burden reduction genre ST4, the door opening / closing operation can be reduced by the basic operation of the door assist mechanism 541. Details of the operation of the door assist mechanism 541 have been described, and will not be repeated here. When it is estimated that the physical condition is poor, the burden on the user can be further reduced by controlling the assist force by the door assist mechanism 541 to be higher than normal. In the configuration of FIG. 41, the total torque of the external operating force and the positive assist force is reflected in the torque detection voltage Vst, and the door assist drive by the motor 1010 is feedback-controlled so that this approximates Vref1, which is accompanied by poor physical condition. As the user's door opening force decreases, the assist force automatically increases. Also, a method of increasing the assist force by changing this so that Vref1 increases when it is estimated that the state of poor physical condition is possible is also possible. In this case, when a part of the voltage dividing resistor that determines Vref1 is made variable and it is estimated that the physical condition is poor, it is possible to increase Vref1 by changing the voltage dividing resistance value.

  In addition, in the theme “I want to load my baggage easily” (OBJ422), for example, when the user has a large baggage or the user is estimated to be unwell with the vehicle camera 518, the user can open the door. Instead of assisting, it automatically opens the door to a certain position and eliminates the need to operate the door itself, helping to load baggage. It is also effective to assist loading by informing the position of the trunk room or automatically opening the cover.

  Next, the preparation scene SCN3 and the driving / staying scene SCN4 are entered. In each theme (OBJ131, OBJ141 and OBJ231, OBJ241) of the expectation / excitement genre ST1 and the relaxation / relaxation genre ST2, the operation of the interior lighting 511 executed from the approaching scene SCN1 and the boarding scene SCN2, and the car audio system in the car The process of continuing the performance of 515 is mainly performed (however, the lighting color / pattern and the music selection (or volume) adapted to the scene are changed). In preparation scene SCN3, in order to calm down, lighting with reduced light intensity and exhilarating system ST3 or mild / healing SF selection in FIG. Therefore, an operation such as increasing the amount of illumination light and switching to the music selection of energizing / energizing AG can be exemplified. However, as described above, when an abnormality in the mental state or the physical state is estimated, the lighting drive pattern and music selection considering this are given priority as in the approaching scene.

  FIG. 9 shows a setting example of the function selection table 371 related to themes OBJ141 and OBJ142 of the expectation / excitement genre ST1, and includes vehicle exterior lighting (5 only at night, 0 during the day (non-operation)), interior lighting, and power window. A closing operation, a noise canceller, a car audio system, and a video output device such as a DVD player are selected as the hospitality operation unit. Regarding the reduction of the noise level in the vehicle, the operation of the noise canceller 1001B shown in FIGS. 44 and 45 contributes greatly to the deadline of the window due to the closing operation of the power window. As described above, the noise canceller 1001B leaves the specified necessary sound such as the car audio system 515, in-car conversation, or the necessary outside sound (emphasis sound) to be recognized as caution or danger by setting the adaptive filter. Because other noise components are canceled out, the music can be heard in a quieter environment, and the necessary outside sound is not missed. In addition, as shown in FIG. 67, in the case of poor physical condition, the specified necessary sound (warning sound / important sound) is left, and equalizing mainly for the low frequency range is performed on the audio output, thereby providing an effect. it can.

  In the control suitability value setting table 371a, the interior lighting level and the musical sound level are set relatively high. When targeting young people who originally prefer a noisy environment, noise in the car, such as wind noise, may contribute to the creation of the car's atmosphere, and there are more or less limitations with regard to picking up the necessary outside sound with an adaptive filter. Therefore, as the musical tone level in the vehicle is set higher, the reduction level of the noise level (the higher the numerical value indicates quieter) is somewhat suppressed. Note that the control of the musical sound level to the set value can be performed by adjusting the output volume of the car audio system 515 so that the detection level of the sound pressure sensor 540 in FIG. 1 approaches the target value. On the other hand, the control of the noise level to the set value can be performed by setting the target value level of the unerased noise component detected by the error detection microphone 2012 in FIG. 44 to a finite value indicating the desired noise level instead of zero. .

  FIG. 10 shows a setting example of the function selection table 371 related to the themes OBJ241 and OBJ242 of the relaxation / relaxation genre ST2. The selection content of the hospitality operation unit is the same as that of the expectation / excitement genre ST1, but the illumination level and the musical sound level are set lower than the expectation / excitement genre ST1, and conversely, the degree of noise level reduction is increased. As described above, it is also effective as an effect for cool-down in poor physical condition or in an excited state.

  If the music performance in the approaching scene SCN1 and the boarding scene SCN2 is based on MIDI, it is not easy to use MIDI to enjoy music in earnest. Therefore, the performance using the MPEG3 music database 515c (FIG. 17) is used. Switch. In this case, the hospitality decision making unit 2 (FIG. 1) selects music source data corresponding to the personality type of the user.

  However, if the user does not like the song automatically selected by the hospitality decision-making unit 2, the user can switch the performance to a favorite song at any time by an input from the operation unit 515d. When the user selects the music by himself / herself, as shown in FIG. 20, the specific information (user name or user ID) of the user, the ID of the selected music source data, and the aforementioned hospitality reference data RD (personality type code) , Age code, gender code, genre code, and music mode code) are stored in the music selection record storage unit 403 (formed in the storage device 535 in FIG. 1) in association with each other. In this embodiment, the date and time of music selection, the user's sex and age are also stored.

  As shown in FIG. 21, in the music selection record storage unit 403, statistical information 404 of the music selection record is created for each user. In this statistical information 404, the music selection data is counted for each personality type code (SKC), and which personality type of music is selected most frequently is specified as a numerical parameter. As the simplest process, it is possible to specify the personality type having the highest frequency of music selection as the personality of the user. For example, if the number of music selections accumulated in the statistical information 404 reaches a certain level, for example, the personality type initially set by user input is replaced with the personality type derived from the statistical information 404 as described above. That's fine.

  By the way, the classification of personality of users is actually more complicated, and the taste of music is not so simple that it can be uniformly pushed into the same personality type. Also, it may easily fluctuate in the short term depending on the living environment in which the user is located (whether it is fulfilling or stress is accumulated). In this case, it is not strange that the taste of music fluctuates and the personality type derived from the statistics may change. In this case, as shown in FIG. 21, instead of taking the statistics of the music selection performance retroactively, if the statistical information 404 of the music selection performance is created only for the most recent fixed period (for example, 1 month to 6 months). In addition, short-term fluctuations in personality types can be reflected in the statistical results, and the hospitality content by music can be changed flexibly according to the user's condition.

  In addition, even the same user does not always select music of the same personality type, and may be selected across music of other personality types. In this case, if the music is selected only from the personality type having the highest frequency of music selection, a situation that is not always desirable for the user to change their mood may occur. Therefore, the music selection probability expected value to be assigned to each personality type is assigned according to the music selection frequency indicated by the statistical information 404, and a method of randomly selecting music from each personality type in a weighted form according to the expected value is adopted. You can also. In this way, music sources that are more or less interested (ie, selected music) are preferentially selected from those with a high frequency of music selection across multiple personality types, sometimes other than your personality type You will be able to receive hospitality with the music of this, which will make you feel better. Specifically, a random number table composed of a certain number of random values is stored, and the number of random values assigned to each personality type is distributed in proportion to the music selection frequency. Next, it is possible to specify a personality type to be selected by generating a random number using a known random number generation algorithm and collating which personality type the obtained random number value is a random value assigned to. Become.

  In the statistical information 404, the frequency of music selection by music genre (JC), age (AC) and gender (SC) is also counted, and the frequency of music selection is high in the same manner as in the case of the personality type. The music source data belonging to the genre, age group or gender can be configured to be preferentially selected. If it does in this way, it will become possible to perform the hospitality music selection which matched by user's preference. A plurality of personality types can be assigned to one music source data.

  FIG. 30 is a flowchart showing an example of the process. When the music selection frequency statistics for each personality type are obtained as shown in FIG. 21, the random number values on the random number table are distributed in proportion to the individual music selection frequency for each personality type as shown in the lower part of FIG. . Next, in S108 of the flowchart, one arbitrary random number value is generated, and a personality type code corresponding to the acquired random number value is selected on the random number table. Next, in S109, the one corresponding to the personality code is selected from the lighting control data group of FIG. In S110, the music source data corresponding to the genre, age group, and gender with the highest frequency of music selection in FIG. 21 are extracted from the music source data corresponding to the acquired personality type code (of course, the personality is also used here). As in the case of determining the type, the genre, age group, and gender related to the music selection may be selected by proportional distribution of random numbers according to the frequency for each genre, age group, and gender). When there are a plurality of extracted music source data, one music source data ID among them may be selected by random numbers as in S111, or a list of music source data may be displayed on the monitor 536 ( As shown in FIG. 1, the user may manually select the operation unit 515 d (FIG. 17). Thus, the lighting control of the lighting device in the automobile that is being driven (or the user is staying) is performed according to the selected lighting control data, and the music performance by the selected music source data is transmitted to the car audio system. It is done.

  Hereinafter, other hospitality themes assigned to the preparation scene SCN3 and the driving / staying scene SCN4 will be described. The theme “I want to know the state of my destination / way” is a theme that is set across both scenes. For example, on the preparation scene SCN3 side (OBJ331), as shown in the function selection table 372 of FIG. The vehicle-side GPS 533 and the car navigation system 534 are selected as the hospitality operation unit, and when the destination is set, the on-site and road conditions are acquired via the wireless communication network, and the hospitality operation is performed on the monitor of the car navigation system 534. Is called.

  In the driving / staying scene, the user's personality type can be estimated by using information other than the music selection performance of the music source. For example, driving performance data for each user can be accumulated, and the personality type of the user can be specified based on the analysis result of the driving performance data. Specific examples thereof will be described below. As shown in FIG. 22, an operation that is easily performed when the user feels stress during driving is determined in advance as a stress reflection operation, the corresponding stress reflection operation is detected by a corresponding detection unit, and the detection result is reflected in the stress. Store / accumulate in the operation statistics storage unit 405 (FIG. 1: in the storage unit 535). Based on the accumulation result, the personality type of the user is estimated. The embodiment described below focuses on how to suppress the influence of personality factors that are undesirable in driving a car.

  In this embodiment, the stress reflection operation is a horn operation (i.e., irritates a horn), the number of times of braking (too much space between the cars, etc., and the brakes are stepped on), and the number of lane changes (pass the previous car) The lane is frequently changed: winker operation + steering wheel operation angle after the winker operation is detected (if the steering wheel operation angle is below a certain level, the lane change is considered)), and the horn switch 502a, The brake sensor 530, the blinker switch 502W, and the acceleration sensor 532 function as a stress reflection operation detection unit. As each operation occurs, the corresponding counter in the stress reflecting operation statistics storage unit 405 counts up and the number of times is recorded. It can be said that these operations reflect the orientation toward “dangerous driving”.

Further, the traveling vehicle speed is detected by the vehicle speed sensor 531, the acceleration is detected by the acceleration sensor 532, and the average speed V _N and the average acceleration _AN are calculated and stored in the stress reflecting operation statistics storage unit 405. Average acceleration A _N is the average value only during a period in which a certain level or higher acceleration increasing direction is detected is taken, less low speeds during periods of acceleration variations are not incorporated into the average value calculation. By doing so, the value of the average acceleration A _N is a value that reflects whether prefer or profusely in Dari depresses the accelerator, or sudden acceleration due to overtake the like. Further, the travel distance is calculated from the output integrated value of the vehicle speed sensor 531 and stored in the stress reflection operation statistics storage unit 405.

  Furthermore, the stress reflection operation statistics are created separately for the general road section and the highway section (the identification is possible by referring to the travel information from the car navigation system 534). In other words, when driving on an expressway, if it is flowing smoothly, users who drive normally should not make a lot of horns, brakes, or lane changes. This is because the number of reflection operations detected should be added with higher weight than the general road section. Further, since the average speed and the average acceleration are inevitably higher than those of the general road section, this influence can be mitigated by taking statistics by distinguishing the general road section and the highway section as described above.

An example of the personality determination algorithm using the stress reflection operation statistics is shown below, but is not limited thereto. First, the horn number Nh, brake number N _B, the lane change frequency N _LC, of the general way section (indicated by subscript "O") and fast way section (indicated by subscript "E") Multiply each value by the weighting factors α and β (where α <β: either coefficient may be fixed at 1 and the other coefficient may be displayed as a relative value) The value divided by L is calculated as the number of conversions (indicated by the subscript “Q”). On the other hand, the average speed and the average acceleration are similarly calculated as the converted average speed and the converted average acceleration by adding the values in the general road section and the values in the highway section by multiplying by the weighting factor. A value obtained by adding all of them is obtained as a personality estimation parameter ΣCh, and personality estimation is performed according to the value of the ΣCh.

  In the present embodiment, the range of the value of ΣCh is divided into a plurality of sections by predetermined different boundary values A1, A2, A3, and A4, and a personality type is assigned to each of the sections. Then, the reduction coefficients δ1, δ2, and δ3 (all greater than 0 and less than 1) are determined in association with the section to which the calculated ΣCh value belongs. An example of the flow of a specific personality analysis process using this is shown in FIG. As described above, the user is authenticated in S101, and the music selection record data 403 in FIG. 20 is acquired in S202. In step S103, the music selection statistics information 404 shown in FIG. 21 is created. Next, in S104, the information (running performance data) accumulated in the stress reflecting operation statistics storage unit 405 of FIG. 22 is read, and in S105, the value of ΣCh is calculated by the above method, and the corresponding personality type is determined. Specify the reduction factor δ. In S106, the personality type having the highest frequency is specified from the statistical information 404 of the track selection results, and the apparent frequency is reduced by multiplying this by the reduction coefficient δ. As a result, for example, when a result that increases ΣCh is obtained for an “active” user, the direction toward dangerous driving that increases ΣCh is enhanced due to its “active” personality. This means that the frequency of music selection that boosts this can be suppressed by multiplying by the reduction factor δ, leading to safe driving. In addition, when a result that ΣCh is low is obtained for the “adult” user, the music selection frequency corresponding to “adult” is suppressed by multiplying by the reduction factor δ, and the active music selection frequency is relatively Therefore, it is possible to increase the safety by giving a moderate stimulus to the user and sharpening the driving.

  Next, during driving, it becomes more necessary to consider mental state and physical condition separately from personality. In the state where the user (driver) is seated in the driver's seat, more biological state detection units (sensors and cameras) for acquiring biological state parameters can be employed. Specifically, FIG. Infrared sensor 519, seating sensor 520, face camera 521, microphone 522, pressure sensor 523, blood pressure sensor 524, body temperature sensor 525, iris camera 527, and skin resistance sensor 545 can be used. These biological state detection units can capture the biological reaction of the user during driving from various angles, and the hospitality decision-making unit 2 is the same as detailed in the embodiment in the approach scene. The mental state and physical condition of the user are estimated from the temporal change information of the detected biological condition parameter, and a hospitality operation is performed in a form adapted to this.

  As described above, the facial expression information is obtained from a still image of the face photographed by the face camera 521. As shown in FIG. 34, the whole (or part: for example, eyes and mouth) image is converted into various psychological states. Compared to the master image in physical condition or physical condition, whether the user is angry, calm, in a good mood (for example, fun and excited), in a bad mood (for example, disappointed or sad) Or whether they are exposed to anxiety or tension. Also, instead of using a user-specific master image, the facial contours, eyes (or iris), mouth and nose positions and shapes are extracted as facial feature values common to all users, and the feature values are extracted. Can be compared with standard feature values measured and stored in advance in various psychological states or physical conditions. In addition, it can also be used for specification of a user's personality type by classifying and collating face types according to personality from the above facial feature quantities.

  The movement of the body includes a moving image of the user (for example, moving in small steps, frowning, etc.) taken by the face camera 521, a detection state of the pressure sensor 523 (for example, frequently releasing the hand from the handle). ) Or the like, for example, it can be determined whether the driving user is frustrated or not.

  The body temperature can be detected and specified by a body temperature detection unit such as a body temperature sensor 525 attached to the handle or a thermography of a face acquired by the infrared sensor 519. With the same algorithm as shown in FIG. 54, it is possible to determine whether the body temperature changes rapidly and the average body temperature level changes / maintenance. In addition, by registering the user's normal heat in advance and measuring the temperature shift from that normal temperature (especially on the high temperature side) with the body temperature detection unit, it is possible to detect more subtle changes in body temperature and thus the emotional movement caused by it. Is possible.

  FIG. 55 shows an example of a flowchart of the skin resistance change waveform analysis process. In the sampling routine, the skin resistance value detected by the skin resistance sensor 545 every time a sampling timing determined at a constant time interval arrives. Is sampled and the waveform is recorded. Then, in the waveform analysis routine, the skin resistance value sampled in the last certain period at SS103 is acquired as a waveform, and the waveform is subjected to a well-known fast Fourier transform process at SS104 to obtain a frequency spectrum, and at SS105, The center frequency (or peak frequency) f of the spectrum is calculated. 53, the waveform is divided into a certain number of sections σ1, σ2,..., And the average skin resistance value for each section is calculated in SS107. Then, integral amplitudes A1, A2,... Are calculated for each section using the average skin resistance value as the waveform center line. In SS109, the integral amplitude A of each section is plotted against time t, and the gradient α is obtained by least squares regression.

  In SS110, it is checked whether or not the frequency f is higher than the upper limit reference value fu0. If it is larger, it is determined that the skin resistance change being monitored is “sudden”. Further, in SS112, it is checked whether or not the frequency f is smaller than the lower limit reference value fL0 (> fu0), and if it is smaller, it is determined that the skin resistance change being monitored is “slow”. If fu0 ≧ f ≧ fL0, the process proceeds to SS114, and the skin resistance change being monitored is determined to be “standard”. Next, proceeding to SS115, the absolute value of the gradient α is compared with the reference value α0. If | α | ≦ α0, it is determined that the average skin resistance level being monitored is in a “constant” state. In the case of | α |> α0, if the sign of α is positive, it is determined that the average skin resistance level being monitored is in an “increasing” state, and if it is negative, it is determined that it is in a “decreasing” state.

  As shown in FIG. 51, when the change in the detected skin resistance value is abrupt and the direction of the change is “increase”, it can be estimated that the mental state is “diffused concentration”. With regard to poor physical condition, mild ones are not so much reflected in the temporal change in skin resistance, but as the poor physical condition progresses, the change in skin resistance value gradually increases, so it is effective in estimating "severe poor physical condition" It is. When the skin resistance value decreases rapidly, it is possible to estimate the “excited (angry) state” with considerably high accuracy.

Next, FIG. 57 shows an example of a flowchart of the attitude signal waveform analysis process. In the sampling routine, the attitude signal described with reference to FIG. 58 each time a sampling timing determined at a constant time interval arrives. The value (Vout) is sampled and the waveform is recorded (SS201, SS202). Then, in the waveform analysis routine, the attitude signal value sampled in the latest fixed period in SS203 is acquired as a waveform, and in SS204, a known fast Fourier transform process is performed on the waveform to obtain a frequency spectrum. The center frequency (or peak frequency) f of the spectrum is calculated. Further, in SS 206, as shown in FIG. 53, the waveform is divided into a predetermined number of sections σ1, σ2,... Then, integral amplitudes A1, A2,... Are calculated for each section using the average posture signal value as the waveform center line. In SS209, the integral amplitude A in each section is averaged and determined as a representative value of the waveform amplitude. Further, the SS210, calculates the variance sigma ² of the integrated amplitudes A.

In SS211, it is checked whether or not the frequency f is larger than the upper limit reference value fu0. If it is larger, it is determined that the posture change speed being monitored is “increase”. Further, in SS213, it is checked whether or not the frequency f is smaller than the lower limit reference value fL0 (> fu0). If it is smaller, it is determined that the posture change speed being monitored is “decrease”. If fu0 ≧ f ≧ fL0, the process proceeds to SS215, and it is determined that the posture changing speed being monitored is “normal”. Next, proceeding to SS216, the average value An of the integrated amplitude A is compared with a predetermined threshold value, and the posture movement amount is determined as one of “small change”, “slight increase”, and “rapid increase” ( The larger the average value An, the more the posture movement amount tends to increase). Further, it is determined that the SS217, when the value of the variance sigma ² of A is greater than or equal to the threshold value, attitude change is in the increasing or decreasing trend.

  The change in posture shows a significantly different tendency depending on the difference in the basic estimated state (“bad physical condition”, “diffused concentration” and “excited state”). It is. If it is normal, the user who is driving can maintain the tension necessary for driving while maintaining a proper posture. On the other hand, when the physical condition is poor, a gesture that occasionally changes the posture in an attempt to relieve the hotness becomes conspicuous, and the amount of posture movement tends to slightly increase. However, when the physical condition further progresses (or when extreme sleepiness is attacked), the posture becomes unstable and wobbles, and the posture movement tends to increase or decrease. At this time, the posture movement is unstable with no control of the body, so the speed of the posture movement is greatly reduced. Also, when the concentration is scattered, the posture movement increases and decreases slowly, but the posture control speed does not decrease so much because the body control is good. On the other hand, when the person is in an excited state, the posture movement increases rapidly and the movement speed increases because the patient becomes restless or frustrated.

FIG. 60 shows an example of a flow chart of the line-of-sight angle waveform analysis process. In the sampling routine, a face image is photographed at SS 252 every time a sampling timing determined at regular time intervals arrives, and the image is included in the image. Then, the pupil position and the face center position are specified, and in SS253, the blurring from the front direction of the pupil with respect to the face center position is calculated, and the line-of-sight angle θ can be obtained. In the waveform analysis routine, the line-of-sight angle value sampled in the most recent fixed period in SS254 is acquired as a waveform, and in SS255, a known fast Fourier transform process is performed on the waveform to obtain a frequency spectrum. In SS256, the frequency spectrum is obtained. The center frequency (or peak frequency) f of the spectrum is calculated. Further, in SS257, as shown in FIG. 53, the waveform is divided into a predetermined number of sections σ1, σ2,... In SS259, the integral amplitudes A1, A2,... Are calculated for each section using the average line-of-sight angle value as the waveform center line. In SS260, the integral amplitude A in each section is averaged and determined as a representative value An of the waveform amplitude. Further, the SS261, calculates the variance sigma ² of the integrated amplitudes A.

  In SS262, it is checked whether or not the frequency f is larger than the upper limit reference value fu0. If it is larger, it is determined that the changing speed of the line-of-sight angle θ being monitored is “increase”. In SS264, it is checked whether the frequency f is smaller than the lower limit reference value fL0 (> fu0). If it is smaller, it is determined that the changing speed of the line-of-sight angle θ being monitored is “decrease”. If fu0 ≧ f ≧ fL0, the process proceeds to SS266, and it is determined that the changing speed of the line-of-sight angle θ being monitored is “normal”. Next, proceeding to SS267, the average value An of the integrated amplitude A is compared with a predetermined threshold value, and the change amount of the line-of-sight angle θ is set to one of “small change”, “slight increase”, and “rapid increase”. Determination (the larger the average value An is, the more the amount of change in the viewing angle θ tends to increase). In SS268, when the value of the variance Σ2 of A is equal to or greater than the threshold value, the change in the line-of-sight angle θ tends to increase or decrease, that is, the “modulation” state (so-called “glanced state”). judge.

  First, the line-of-sight angle θ is a decisive factor in estimating the distraction of concentration because the amount of movement increases rapidly when the concentration is distracted, and the modulation is abrupt. In addition, when a poor physical condition occurs, the amount of line-of-sight movement decreases according to the degree of the poor condition, which is also effective for estimating a poor physical condition. In addition, the amount of gaze movement decreases even in the excited state, but when the physical condition is poor, it becomes difficult to follow the line of sight when the visual field changes, and the movement speed also decreases, while in the excited state the visual field changes, etc. The speed of the gaze movement that occurs from time to time, such as being sensitive to and scolding it, is so great that they can be distinguished from each other.

FIG. 61 shows an example of a flowchart of pupil diameter change analysis processing. In the sampling routine, every time a sampling timing determined at a constant time interval arrives, the SS 302 performs the user's operation with the iris camera 527 (FIG. 1). The iris is photographed, and in SS 303, the pupil diameter d is determined on the image. In the analysis routine, the pupil diameter d sampled in the latest fixed period in SS304 is acquired as a waveform. Further, in SS305, as shown in FIG. 53, the waveform is divided into a predetermined number of sections σ1, σ2,..., And the average pupil diameter dn for each section is calculated in SS306. Then, in SS307, the integrated amplitudes A1, A2,... Are calculated for each section using the average pupil diameter value as the waveform center line, and in SS308, the average value An of the integrated amplitude calculated for each section is calculated. Further, the SS309, calculates the variance sigma ² of the integrated amplitudes A.

In SS310, it is checked whether or not the pupil diameter average value dn is larger than the reference value d0. If it is larger, the process proceeds to SS311 to determine “pupil open”. Further, the process proceeds to SS312 unless increased, determine whether variance sigma ² of the integrated amplitudes A of the pupil diameter change waveform is larger than the reference value sigma ^{2 0,} it determines "pupil diameter variation" greater. If it is not larger, it is determined as “normal”.

  As shown in FIG. 51, the pupil diameter d changes significantly according to the mental state of the user, and in particular, whether or not the user is in an excited state based on whether or not there is a specific pupil open state. It can be estimated with high accuracy. Further, when the pupil diameter varies, it can be estimated that the concentration is distracting.

  In the present invention, the steering operation state of the driver is also used as a biological state parameter for estimating the driver's mental or physical state. However, steering sampling and evaluation should be limited to straight running. Steering operation is not monitored or evaluated during periods when the steering angle is predicted to increase inevitably, such as when turning left or right or when changing lanes. It is desirable that the steering may be determined to be unstable even though it is normal. For example, if there is a blinker lighting operation, the blinker lighting period and a certain period before and after the steering operation is expected (for example, about 5 seconds before lighting and about 10 seconds after lighting) are evaluated. It should be excluded.

FIG. 62 shows an example of a flowchart of the steering angle waveform analysis process. In the sampling routine, every time a sampling timing determined at a fixed time interval arrives, the current value is output from the steering angle sensor 547 at SS352. The steering angle φ is read (for example, φ = 0 ° in a straight traveling neutral state, and defined as a touch angle to either the left or right (for example, the right angle is positive and the left angle is negative). In the accuracy analysis routine, a steering angle value sampled in a recent fixed period is acquired as a waveform in SS353, and a known fast Fourier transform process is performed on the waveform in SS354 to obtain a frequency spectrum. In SS355, the spectrum of the spectrum is obtained. The center frequency (or peak frequency) f is calculated, and in SS356, as shown in FIG. The waveform is divided into a fixed number of sections σ1, σ2, etc., and an average steering angle value for each section is calculated in SS357, and in SS358, the integral amplitude A1, the average steering angle value is set as the waveform center line for each section. A2 calculates the ‥. Then, the SS359, calculates the variance sigma ² of the integrated amplitudes a.

In SS360, it is checked whether or not the frequency f is larger than the upper limit reference value fu0. If it is larger, the process proceeds to SS361 and it is determined that the changing speed of the steering angle φ being monitored is “increase”. In SS362, it is checked whether or not the frequency f is lower than the lower limit reference value fL0 (> fu0). If it is smaller, it is determined that the changing speed of the steering angle φ being monitored is “decrease”. If fu0 ≧ f ≧ fL0, the process proceeds to SS364, where it is determined that the changing speed of the steering angle φ being monitored is “normal”. Then, the process proceeds to SS365, it determines examined whether variance sigma ² of the integrated amplitudes A of change waveform of the steering angle φ is larger than the reference value sigma ^{2 0,} larger if the steering error is the "increase" (SS366). If it is not larger, it is determined as “normal” (SS367).

  Further, the steering error can be detected not only by the above-described detection by the steering angle but also from the monitoring image by the traveling monitor camera 546 in FIG. The traveling monitor camera 546 can be attached to, for example, the center of the front of the automobile (for example, the center of the front grill), and captures the field of view in the traveling direction as shown in FIG. Once the camera mounting position on the vehicle is determined, the vehicle width center position (vehicle side reference position) in the traveling direction in the field of view is also determined. For example, by identifying the shoulder line, center line, or lane separation line on the image The center position of the lane in which the vehicle is traveling can be specified on the image. And if the shift | offset | difference from said lane center position of said vehicle width center position is calculated | required, it can be monitored whether the motor vehicle which it drives can keep the center of a lane. FIG. 64 is a flowchart showing an example of the processing flow. In SS401, a frame of the driving monitor image is acquired. In SS402, as described above, a white line (or overtaking prohibited) indicating a shoulder line, a center line, or a lane separation line. The lane-side edge line (orange line) is extracted by well-known image processing and specified as the lane width position. In SS 403, the position that bisects the distance between the edge lines is calculated as the lane center position. On the other hand, in SS404, the vehicle width center position is plotted on the image frame, and the deviation amount η in the road width direction from the lane center position is calculated. This process is repeated for image frames captured at a predetermined time interval, and recorded as a time-change waveform of the shift amount η (SS405 → SS401).

  The steering accuracy analysis processing in this case can be performed according to the flow shown in FIG. 65, for example. That is, in SS451, the integral amplitude A with respect to the center line of the waveform for the latest fixed period is calculated, and in SS453, the average value ηn of the deviation amount η from the lane center position is calculated. In SS454, the integral amplitude A is compared with a predetermined reference value A0, and if it exceeds this reference value, the process proceeds to SS455 and it is determined that the steering error is “increase”. A large A means that the displacement amount η fluctuates greatly with respect to time, and indicates a kind of wobbling traveling tendency. On the other hand, if the center of the lane cannot be kept and the tendency to approach the end continues, even if the integral amplitude A is smaller than the reference value A0 in SS454, the deviation amount η itself is large and should be determined as abnormal. is there. Therefore, in this case, the process proceeds to SS456, and if the deviation amount average value ηn exceeds the reference value ηn0, the process proceeds to SS455 and it is determined that the steering error is “increased”. On the other hand, if the deviation average value ηn is smaller than the reference value ηn0, the process proceeds to SS457 and is determined to be “normal”.

  As for the steering speed (response to steering), the waveform is subjected to a well-known fast Fourier transform process to obtain a frequency spectrum, the center frequency (or peak frequency) f of the spectrum is calculated, and the tendency is determined from the f. Is possible. In this case, it is checked whether or not the frequency f is larger than the upper limit reference value fu0. If it is larger, it is determined that the steering speed is “increased”. In SS362, it is checked whether or not the frequency f is smaller than the lower limit reference value fL0 (> fu0), and if it is smaller, it is determined that the steering speed is “decrease”. If fu0 ≧ f ≧ fL0, it is determined that the steering speed is “normal”.

  As shown in FIG. 51, it can be estimated that the driver is in a state of distraction or an excitement by detecting an increase in steering error. On the other hand, even when a severe physical condition (including a drowsiness) occurs, normal steering is hindered, and this can be estimated from the increasing tendency of errors. On the other hand, poor physical condition and distraction of concentration tend to delay the response to steering, and this can be estimated from the decrease in steering speed. Also, in the excited state, it is irritating and the steering wheel tends to be turned, so this can be estimated from the increase in the steering speed.

  Now, also in the traveling scene, processing for specifying the estimated state is performed according to the flow of FIG. In this case, since the number of biological condition parameters to be referred to increases, the score of the matching counter is regarded as the “matching degree”, and the highest score, that is, the highest matching score is determined as the estimated state. The method is more effective. As described above, the addition to the verification counter is limited to a lower score than the case of perfect match if the master information and the judgment result do not completely match but a result close to the specified range is obtained. However, this can be implemented to be added to the verification counter.

  If the estimated state can be identified, a great many specific examples can be considered as the hospitality control corresponding to this. For example, in the theme “appropriate driving environment setting” OBJ 441 in FIG. 2, as shown in the function selection table 373 in FIG. 13, the car navigation system 534 (for video output), the car audio system 515, the air conditioner 514, the interior lighting 511, and the steering wheel adjustment The unit and the seat adjustment unit are selected as the hospitality operation part, and as described above, the music selection is changed according to the mental state and physical condition of the driver (user), the set temperature of the air conditioner, the lighting color or lighting in the car Adjust the strength. In addition, the handle adjustment unit and the seat adjustment unit automatically adjust the position of the handle, the front / rear position of the seat, the angle of the backrest, etc. by the motor operation.For example, when it is determined that the feeling of tension is weakened, Raise the back and raise the seat, or raise the handle so that you can concentrate on driving. When it is determined that the user is tired, it is effective to finely adjust the angle of the backrest in such a direction that the user's movement showing discomfort is calmed down.

In addition to the above, there are the following modes.
・ Excited state (when it is determined that the person is feeling too high, or when it is determined that they are feeling angry or stressed): Playing quiet and comfortable music to calm down. Further, the air-conditioning temperature is lowered, and a rhythm vibration that is slow (having a longer period than when the concentration is disseminated later) is generated and relaxed by the seat vibrator 550. Also, if it is assumed that overtaking from the following vehicle, interrupting, passing, horning, etc. are related to the driver's unpleasant mental state, “What, excuse me. Do n’t worry. "I love you as an adult," and so on. Also, when the speed exceeds (vehicle speed detection) or is about to exceed: “Let's go slowly… the night is long. You ’re safe driving.” Output a prompt message.
When the concentration power is diffused: Impulse strong vibration is generated in the handle vibrator 551 and the seat vibrator 550 to promote concentration. Further, a strong odor for care is generated from the ammonia generator 549.
・ Unwell (if fatigue or disease symptoms (such as fever) are observed): Promote safe driving such as speed control, stopping or resting. When the railroad crossing or red signal is approached, caution information is output as a voice. In the worst case, notifications of driving suspension etc. are given by voice output or monitor display. Moreover, the fragrance which encourages relaxation is generated from a direction generation part. As for sleepiness, the same hospitality as when the concentration is distracted is also effective.
・ When it is judged that you are depressed (facial expression, body temperature): Play music with good economy, or change the lighting to something red or other exciting ones to boost your mood.

  A more specific example will be described taking as an example the selection of music for hospitality performed during driving. The personality type code described above provides a music source having a personality type code that matches the personality of the specified user, such as the personality type code of the music source to be selected. Used in a matching form. On the other hand, for the song mode code, the song mode assigned to the music source is not necessarily used to match and match the mental state and physical condition of the specified user. For example, it is used to set a certain mental state as a target value and to bring the user's mental state closer to this, such as selecting a mild / healing or healing / α wave music source. If the user's mental state elevation can be parameterized, the music mode code is also set in order corresponding to this, and the music selection control is performed so that the song mode code corresponding to the mental state elevation parameter is selected. be able to. Specifically, when it is determined that the mental state of the user is higher the higher the value of the mental state elevation parameter, the “rising system”, “exhilaration system”, “warm / healing system”, “healing / healing system” If you select a song mode code that is located at the lower part of the rank, the higher the value of the mental state elevation parameter is, the calmer it is if you feel too high When the song is selected, and when it is depressed, the song mode code is selected so that the song is selected so as to raise the mood. In the former case, the effect of suppressing excessive speed due to mood excitement, etc. is obtained, and in the latter case, the user's arousal is promoted and the driver's attention is improved. Contributes to driving. On the other hand, when the physical condition level is deteriorated, it can be said that it is desirable not to perform extreme music selection that causes the user to get tired as much as possible regardless of the above mental state.

  For example, as shown in FIG. 34, when the user's mental state is divided into three levels of excitement (anger), concentration distraction (anxiety / tension), and stability, the music of FIG. A mode code is uniquely associated. In this embodiment, “anger / healing” (SF) corresponds to “anger”, “exhilaration” (ST) corresponds to “anxiety / tension”, and “healing / revitalization” (AG) corresponds to stability. Attached (first setting).

  When using the car navigation system 534, when heading to a destination farther than a certain distance, the driver's tiredness is added on the way home, so the song mode code corresponding to make the driving calmer than going It can be set to lower the level (second setting). In FIG. 34, regarding “return”, “healing / α wave system” (HL) for “anger”, “mild / healing system” (SF) for “anxiety / tension”, “exhilaration system” (ST) for stability. ) Are associated.

  FIG. 35 shows a flowchart of the process. In S501, it is determined whether to go or return, and in S502 and S503, the music mode code is set to a corresponding level. In S504, the detection state of the biological state detection unit is read, and the mental state is estimated in S505 and S506. In the case of “stable state”, the processing of S507 is performed, in the case of “tension / anxiety”, the processing of S508 is performed, and in the case of “anger”, the processing of S509 is performed. Music performance is performed with music selection corresponding to each mental state (the personality type is determined separately by the above-described method, and the music selection corresponding to the mental state is performed in the music source group corresponding to the personality type). Note that, along with music performances, room lighting and air conditioner adjustment are also controlled in a form corresponding to each mental state. For example, in the case of “going” in the “stable state”, in addition to the performance music (AG), the red lighting is used and the room temperature is set to be slightly higher. In order to relax, “return” is performed with a refreshing amber system in addition to the performance of refreshing (or stable) music, and the room temperature is set a little lower than the going.

  In the case of “going” and “tension / anxiety”, in order to relax, in addition to playing exhilarating (or stable) music, the lighting should be a calm amber system, and the room temperature should be set slightly lower than the going. In “Return”, in addition to the performance of healing music (SF), white lighting is used, and the room temperature is further lowered. And if it is “going” or “angry”, it is necessary to cool down as soon as possible. In addition to playing soothing music (SF), use white lighting and use air conditioning to further increase the room temperature. Lower. “Return” uses music as a healing system (HL) and switches to blue lighting, but to prevent fatigue, the temperature is higher than “going” and “angry” so that the temperature does not drop drastically. Set to.

  Returning to FIG. 2, the following hospitality operations are possible in the getting-off scene SCN5 and the leaving scene SCN6. For example, in the theme “I want you to increase your sense of arrival at your destination” (OBJ151, OBJ161, OBJ251, OBJ261) "Let's play and have fun!" In addition, in the theme “Check for lost items / getting off” (OBJ351), it is possible to output a message for forgetting items in the car and for preventing infants from leaving the car (this operation is performed using the mobile phone 1) It can be continued with SCN6). For “OBJ352” and “OBJ451” to get off easily (OBJ352) and to get off easily (OBJ451, OBJ551), the door assist mechanism 541 assists in opening and closing the door and the collision suppression mode between the obstacle and the door is the same as when getting on. Function can be activated. Even in a leaving scene, the operation of the outside camera 518 is used to monitor the traffic conditions around the vehicle, and when the oncoming vehicle or the following vehicle is approaching the user, the mobile phone 1 is used to call attention. It is possible to output a message.

The block diagram which shows an example of an electrical structure of the user service system for motor vehicles of this invention. The schematic diagram which shows an example of the hospitality decision-making table. The flowchart which shows the flow of a scene determination process. The flowchart which shows the flow of hospitality main processing. The schematic diagram which shows the content of a scene flag. The figure which shows the concept of a theme-specific application library. The figure which shows the 1st example of a function selection table. The figure which shows the 2nd example of a function selection table. The figure which shows the 3rd example of a function selection table. The figure which shows the 4th example of a function selection table. The figure which shows the 5th example of a function selection table. The figure which shows the 6th example of a function selection table. The figure which shows the 7th example of a function selection table. The external appearance perspective view which shows an example of the user side terminal device comprised as a mobile telephone. The block diagram which shows an example of the electrical constitution of a user side terminal device. The block diagram which shows an example of the electrical structure of vehicle interior lighting. The block diagram which shows an example of the electrical constitution of a car audio system. The conceptual diagram which shows the content of a music source database. The conceptual diagram which shows the structural example of the lighting control data of an illuminating device. The conceptual diagram which shows the content of the music selection performance memory | storage part. The conceptual diagram which shows the content of the statistical information of a music selection track record. The conceptual diagram which shows the content of the stress reflection operation statistics memory | storage part. The schematic diagram which shows the 1st example of hospitality operation | movement when a user approaches a motor vehicle. The schematic diagram which similarly shows a 2nd example. The schematic diagram which similarly shows a 3rd example. The schematic diagram which similarly shows a 4th example. The schematic diagram which similarly shows a 5th example. The flowchart which shows the flow of a process of the hospitality operation | movement when a user approaches a motor vehicle. The flowchart which shows the flow of a personality analysis process. The flowchart which shows an example of hospitality source determination processing. The flowchart which shows the flow of a process in the long distance hospitality mode by music. The flowchart which similarly shows the flow of a process in medium distance hospitality mode. The flowchart which similarly shows the flow of a process in short distance hospitality mode. The schematic diagram which shows the example of mental state / physical condition estimation using the detection information from a biological condition detection part, and the determination of a music mode code. The flowchart which shows an example of the hospitality process during driving | running | working. The conceptual diagram which shows the content of user registration information. The schematic diagram which shows the 1st example of the input method of character classification determination. The schematic diagram which shows the 2nd example of the input method of character classification determination. The circuit diagram which shows an example of the illuminating device using a light emitting diode. Explanatory drawing of the mechanical component part of a door assist mechanism. The circuit diagram of a door assist mechanism. The schematic diagram which shows the structural example of the door rotation lock mechanism for obstacles. FIG. 42 is an operation explanatory diagram of the door assist mechanism of FIG. 41 in a normal state. The conceptual block diagram which shows the structural example of a noise canceller. The block diagram which similarly shows an example of a hardware configuration. The flowchart which shows the whole flow of the hospitality process in the user service system for motor vehicles. The flowchart following FIG. The flowchart following FIG. The schematic diagram which illustrates the attachment position of the camera in a vehicle. The schematic diagram which shows the example of attachment of the various sensors and hospitality operation | movement part to a handle | steering-wheel. The schematic diagram which shows an example of the determination table. The flowchart which shows an example of blood-pressure change waveform acquisition and its analysis algorithm. The schematic diagram which illustrates and illustrates some waveform analysis methods. The flowchart which shows an example of body temperature waveform acquisition and its analysis algorithm. The flowchart which shows an example of skin resistance waveform acquisition and its analysis algorithm. The flowchart which shows an example of a facial expression change analysis algorithm. The flowchart which shows an example of attitude signal waveform acquisition and its analysis algorithm. FIG. 3 is a circuit diagram showing an example of hardware for generating a posture signal waveform. The image figure of various to-be-estimated states. The flowchart which shows an example of a gaze angle waveform acquisition and its analysis algorithm. . The flowchart which shows an example of a pupil diameter waveform acquisition and its analysis algorithm. . The flowchart which shows an example of steering angle waveform acquisition and its analysis algorithm. The image figure of a driving | running | working monitor image. The flowchart which shows an example of a driving | running | working monitor data acquisition process. The flowchart which shows an example of the steering precision analysis process using driving | running | working monitor data. The flowchart which shows an example of a state specific process. The figure which shows the relationship between a to-be-estimated state and hospitality operation | movement classification.

Explanation of symbols

1 Mobile phone (user terminal device)
2 Hospitality decision-making unit (hospitality control unit, mental / physical state estimation means)
3 Hospitality execution control unit (hospitality control unit)
4 Communication device (host side communication means)
100 Automotive User Hospitality System 311 Speaker (Audio Output Unit)
502-517,534 Hospitality operation unit 515 Car audio system 515b, 515c Music source database (hospitality operation information storage unit)
515d operation unit (music selection unit: user biometric information acquisition means)
535 storage device (hospitality operation information storage unit, song selection result storage unit)
504 to 512 Lighting device 511 Indoor lighting (lighting device)
521 Face camera (biological condition detector)
523 Pressure-sensitive sensor (biological state detection unit)
519 Infrared sensor (biological condition detector)
525 Body temperature sensor (biological condition detector)
524 Pulse sensor (biological condition detector)
1170 Wireless communication network

Claims (20)

Hospitality to assist the user or entertain the user by at least one of approaching the user, riding, driving or staying in the car, getting off and leaving the car A hospitality operating part that performs the operation;
A biological state detection unit that detects a predetermined biological state of the user as a temporal change of a biological state parameter that is a numerical parameter reflecting the biological state;
A mental / physical state estimating means for estimating the mental state or physical state of the user based on the detected temporal change of the biological condition parameter;
A hospitality control unit that changes the operation content of the hospitality operation unit according to the content of the estimated mental / physical state;
An automobile user hospitality system characterized by comprising: The biological state change detection unit detects a temporal change waveform of the biological state parameter,
The automobile user hospitality system according to claim 1, wherein the mental / physical state estimating means estimates the physical state of the user based on amplitude information of the waveform. The biological state change detection unit detects a temporal change waveform of the biological state parameter,
The automobile user hospitality system according to claim 1 or 2, wherein the mental / physical state estimating means estimates the mental state of the user based on frequency information of the waveform. The mental / physical state estimating means specifies the mental state or physical state of the user as one of a plurality of predetermined mental state levels or mental state levels,
A hospitality operation information storage unit that stores hospitality operation information that defines the operation content of the hospitality operation unit in association with the plurality of mental state levels or mental state levels is provided,
The hospitality control unit reads out the hospitality operation information corresponding to the estimated mental state level or the mental state level from the hospitality operation information storage unit, and controls operation of the hospitality operation unit based on the read out hospitality operation information. The automobile user hospitality system according to claim 3. The automobile according to any one of claims 1 to 4, wherein the biological state change detection unit detects a temporal change state of the body temperature of the user as temporal change information of the biological state parameter. User hospitality system. 6. The biological state change detection unit acquires a temporal change state of at least one of the facial expression and the line-of-sight direction of the user as the temporal change state of the biological state parameter. An automobile user hospitality system according to any one of the above. The hospitality operation unit is for the user to perform the hospitality operation while driving the automobile,
The automobile user hospitality system according to any one of claims 1 to 6, wherein the biological state change detection unit detects a temporal change of the biological state parameter during the driving of the user. The biological state change detection unit obtains a temporal change state of a first-type biological state parameter including one or more of blood pressure, heart rate, body temperature, skin resistance, and sweating as the temporal change state of the biological state parameter. 8. A user hospitality system for automobiles according to claim 7. 9. The automobile according to claim 8, wherein the mental / physical state estimating means estimates that the mental state of the user is abnormal when the waveform frequency of the first-type biological state parameter is greater than a certain level. User hospitality system. The biological state change detection unit detects a temporal change state of a second type biological state parameter including at least one of a posture, a line-of-sight direction, and a facial expression of the user during driving as the temporal change state of the biological state parameter The automobile user hospitality system according to any one of claims 7 to 9, wherein: 11. The vehicle according to claim 10, wherein the mental / physical condition estimating means estimates that the user's physical condition is abnormal when the waveform amplitude of the second-type biological condition parameter is reduced to a certain level or less. User hospitality system. The mental / physical state estimating means has an abnormality in the user's spirit when the waveform frequency of the second-type biological state parameter is greater than a certain level or smaller than a certain level. The automobile user hospitality system according to claim 10 or claim 11 to be estimated. The biological state change detection unit detects a temporal change in the pupil size of the user as a temporal change in the biological state parameter,
The mental / physical state estimating means estimates that the physical condition of the user is abnormal when the detected pupil size changes more than a predetermined level. 13. The user service system for automobiles according to any one of 12 above. 14. The automobile according to claim 13, wherein the mental / physical state estimating means estimates that the mental state of the user is abnormal when the detected pupil size is expanded beyond a predetermined level. User hospitality system. A plurality of the biological state change detection units are provided, and the mental / physical state estimation means is configured to determine the mentality of the user based on a combination of temporal change states of the biological state parameters detected by the plurality of biological state change detection units. The automobile user hospitality system according to any one of claims 1 to 14, wherein a human state or a physical state is estimated. The plurality of biological state change detection units for estimating that the user has a plurality of estimated states that are the mental state or physical state to be estimated and each of the estimated states is established. A determination table is provided in which the combination of temporal change states of the biological condition parameters to be detected is stored in association with each other,
The mental / physical state estimation means collates a combination of the detected temporal change states of the plurality of biological condition parameters with the combination on the determination table, and presents an estimated state corresponding to the combination that has been matched. The vehicle user hospitality system according to claim 15, which is specified as an established estimated state. The automobile user hospitality system according to claim 16, wherein the estimated state includes at least three of “diffused concentration”, “bad physical condition”, and “excited state”. 18. The automobile according to claim 17, wherein when the user is estimated to be "diffused by concentration" by the mental / physical state estimating means, the hospitality control unit causes the hospitality operation unit to perform an operation to wake up the user. User hospitality system. When the mental / physical state estimating means estimates that the user is “bad”, the hospitality control unit performs the corresponding hospitality operation so that the disturbance stimulus given to the user is mitigated by the hospitality operation. 18. The user service system for automobiles according to claim 17, wherein the operation control of the unit is performed. When the mental / physical state estimating means estimates that the user is in an “excited state”, the hospitality control unit causes the hospitality operation unit to perform an operation for alleviating the mental tension of the user. Item 18. The hospitality user system for automobiles according to Item 17.

Images