JP4535273B2 - Automotive user hospitality system - Google Patents

Description

  The present invention is intended to assist the user in using the car or to entertain (or serve) the user at least one of approaching, riding, driving, getting off and leaving the car of the user. This relates to a hospitality system for automobile users.

JP 2003-312391 A

  Patent Document 1 discloses an automatic adjustment device for an in-vehicle device using a mobile phone. This device communicates between a mobile phone carried by an automobile passenger and a wireless device mounted on the automobile side, and installs an in-vehicle device such as an air conditioner, a car stereo, an optical axis of a headlight, an electric seat or an electric mirror. The operation adjustment is performed under conditions registered in advance for each mobile phone holder. Patent Document 1 also discloses a technique for grasping the number and positions of passengers in a vehicle by using a GPS (Global Positioning System) mounted on a mobile phone and adjusting the volume balance and frequency characteristics of an audio device. .

  However, the above-described device only adjusts the in-vehicle device after the passenger (user) gets into the automobile, and does not disclose the idea of adjusting the in-vehicle device before the user gets in. In this document, the vehicle-side communication device for the mobile phone is a short-range wireless communication device (Bluetooth: the communicable distance defined in the standard is at most 10 m), and in FIG. It is also clear from the fact that it is depicted as communicating only with a mobile phone. In addition, since the adjustment contents of the in-vehicle device are defined uniformly regardless of the user's state, there is a drawback that the user can read the hand and use it several times and gradually lose joy.

  An object of the present invention is to detect the state of a user, and from the detection result, it is possible to autonomously control the operation of the in-vehicle device in the form that the user wants (or seems to be desired). It is to provide an automobile user hospitality system that is filled with the spirit of positively entertaining the car as a master or customer.

Means and actions / effects for solving the problems

In order to solve the above problems, the first configuration of the automobile user hospitality system of the present invention is as follows.
Multiple hospitality operations to assist the user in using the vehicle or to entertain the user, at least one of approaching the user, riding, driving, getting off and leaving the vehicle A plurality of hospitality themes that govern the plurality of hospitality operations according to the direction of hospitality desired by the user, and a plurality of hospitality operations are prepared in advance for each theme.
User status information acquisition means for acquiring user status information, hospitality theme determination means for selecting one or more of a plurality of hospitality themes based on the contents of the user status information, and each selected hospitality theme A hospitality operation selection means for collectively selecting a plurality of hospitality operations, and a hospitality decision making unit;
A hospitality execution control unit that performs control to cause the corresponding hospitality operation unit to execute the selected hospitality operation , and
A series of actions related to the use of the user's car until the user approaches the car, gets in the car, drives the car or stays in the car, and then gets off the vehicle in a plurality of predetermined scenes It is divided and a hospitality theme is defined for each of the divided scenes.
The user state information acquisition means includes a scene estimation information acquisition means for acquiring a user position or motion predetermined for each scene as scene estimation information, and a scene specification for specifying individual scenes based on the acquired scene estimation information Means,
The theme determination means selects the hospitality theme corresponding to the identified scene,
Current scene specifying information storage means for storing and holding current scene specifying information for specifying the current scene is provided. The scene specifying means grasps the current scene based on the stored contents of the current scene specifying information, and If the user position or action specific to the subsequent scene is detected by a predetermined scene estimation information acquisition unit, it is determined that the subsequent scene has been transferred, and the subsequent scene specifying information Is stored in the current scene specifying information storage means as current scene specifying information .
Moreover, in order to solve said subject, the 2nd structure of the user service system for motor vehicles of this invention is as follows.
Multiple hospitality operations to assist the user in using the vehicle or to entertain the user, at least one of approaching the user, riding, driving, getting off and leaving the vehicle A plurality of hospitality themes that govern the plurality of hospitality operations according to the direction of hospitality desired by the user, and a plurality of hospitality operations are prepared in advance for each theme.
User status information acquisition means for acquiring user status information, hospitality theme determination means for selecting one or more of a plurality of hospitality themes based on the contents of the user status information, and each selected hospitality theme A hospitality operation selection means for collectively selecting a plurality of hospitality operations, and a hospitality decision making unit;
A hospitality execution control unit that performs control to cause the corresponding hospitality operation unit to execute the selected hospitality operation, and
The hospitality decision-making unit includes user biometric information acquisition means for acquiring user biometric information including at least one of the user's personality, mental state, and physical condition, and individual execution of a plurality of hospitality operations prepared for each hospitality theme Hospitality content determination means for changing the content according to the content of the acquired user personality information or mental / physical condition information,
Two or more of the plurality of hospitality themes are reciprocal oriented themes determined in accordance with the user's mutually opposite hospitality orientations, and the hospitality theme determination means is user personality information acquired by the user biometric information acquisition means Or, according to the content of the mental / physical condition information, it is determined which of the reciprocal oriented themes is selected.

  According to the above-described configuration, there are a wide variety of functions that the user wants from the automobile, and many hospitality operations are prepared on the automobile side in order to meet the demand. In this case, the diversification of hospitality operations is a delight for the user, but the difficulty of making hospitality decision-making on the automobile side, which hospitality operation is provided according to the user's situation, is complicated. If there is some error in the hospitality decision-making process, such as failure to grasp the situation on the user side, certain hospitality operations may be performed at a timing that the user does not originally want, and there is a sufficient effect. In some cases, it may not be obtained, or in some cases, the hospitality operation that is executed by mistake may be harmful to the user.

  However, according to the configuration of the automobile user hospitality system of the present invention, when determining the hospitality operation, the individual hospitality operations are not directly selected, but a plurality of hospitality operations are controlled according to the direction of hospitality desired by the user. A plurality of hospitality themes are determined, and the hospitality operation is selected in units of the hospitality theme. In other words, depending on what kind of “hospitality” the user wants to receive from the car side, by selecting the corresponding hospitality theme, the hospitality operations associated with each other based on the hospitality theme can be selected at once. As a result, it is possible to simplify the hospitality decision-making process and to greatly reduce the trouble of erroneously performing the hospitality operation that does not match the user's intention.

  In the automobile user hospitality system of the present invention, the user approaches the automobile, gets into the automobile, drives or stays in the automobile, and then uses the automobile until the user gets off. Such a series of operations can be divided into a plurality of predetermined scenes, and a hospitality theme can be determined for each of the divided plurality of scenes. In this case, the user state information acquisition means specifies individual scenes based on the scene estimation information acquisition means for acquiring, as scene estimation information, a user position or motion determined in advance for each scene. And a theme determination unit that selects a hospitality theme corresponding to the specified scene.

  In the above configuration, the scene determined by the relative relationship between the user and the car is grasped as the state of the user. Specifically, a series of operations related to the use of the user's car until the user approaches the car, gets into the car, drives the car or stays in the car, and then gets off the vehicle in advance. The hospital theme is determined for each of the plurality of divided scenes. As a result, it is possible to appropriately provide the hospitality operation that the user desires most according to each scene, and it is possible to provide an accurate and detailed service. Also, different hospitality themes can be organized by associating them with a series of scenes. As a result, the user can receive a consistent service as a guest from the car side at any time, as if staying at a first-class hotel, and should be an “inhuman” subject. A virtual effect that the car functions as a “human” host is also added, and it is possible to provide an unprecedented novel enjoyment of car use.

  The determination of the scene is determined within the framework of “use of car by user”, and the basic flow of approaching, boarding, driving / staying, opening the door and getting off when reaching the destination does not change. . Therefore, it is important to smoothly cut the scene along this flow from the viewpoint of providing a natural and uncomfortable hospitality to the user. In this case, the following configuration may be employed. That is, a current scene specifying information storage means for storing and holding current scene specifying information for specifying the current scene is provided. The scene specifying means grasps the current scene based on the stored contents of the current scene specifying information, and on the premise of grasping the current scene, a predetermined scene estimation information obtaining means determines a user specific to the subsequent scene. When the position or the motion is detected, it is determined that the transition to the subsequent scene is made, and the specific information of the subsequent scene is stored in the current scene specific information storage unit as the current scene specific information. If the current scene can be grasped, it can be predicted from the user's behavior flow when using the car as described above, what kind of scene will come next, and the user position or action specific to the subsequent scene By detecting this, it is possible to accurately grasp the transition between scenes. In addition, the content of the following scene identification information ("door opening / closing" in the above example) is common to multiple scenes so that it is easy to understand when considering cases where door opening and closing occurs both when getting on and off. It may appear. However, by grasping the current scene, it is possible to prevent an erroneous grasp of the subsequent scene even in such a case, and to appropriately switch the hospitality operation.

  Next, the hospitality decision-making unit includes user biometric information acquisition means for acquiring user biometric information including at least one of the user's personality, mental state and physical condition, and a plurality of hospitality operations prepared for each hospitality theme. Each execution content can be configured to have a hospitality content determination unit that changes the content of the acquired user personality information or mental / physical condition information. According to this configuration, the operation content of the hospitality operation unit changes according to the content of the user biometric characteristic information, and consequently, the service effect to the user when using the car depends on the unique personality, mental state or physical condition of each user. It can be used with precision and precision.

  Employment priorities can be determined in advance for a plurality of hospitality operations assigned to each hospitality theme. In this case, it is possible to sequentially select a plurality of prepared hospitality operations in descending order of priority. Even if the hospitality is the same, there is often a difference in the level of hospitality to be given depending on the circumstances surrounding the user and the user's orientation (or satisfaction). Therefore, by performing a plurality of hospitality operations for each theme while selecting them according to a predetermined priority order, it is possible to flexibly cope with the above cases.

  In addition, it is natural that the contents that are desired for hospitality differ between users who are usually flashy and those who are quiet and quiet, and the same user can be adapted to the situation when the mood is good or bad It can be said that it is effective to provide hospitality with different directions. As described above, when the conditions relating to the hospitality orientation determination are caused by the personality and state of the users who are in conflict with each other, it is possible to cope with the problem by configuring as follows. That is, two or more of the plurality of hospitality themes are reciprocal oriented themes that are determined in accordance with the user's conflicting hospitality orientations, and the hospitality theme selection means is a user acquired by the user biometric information acquisition means. Depending on the contents of the personality information or the mental / physical condition information, it is determined which of the reciprocal genres is selected. Depending on the user's mood and personality, it can be said that this is an effective method for selecting an appropriate one from a plurality of hospitality actions. Easily select the appropriate hospitality action according to the user's personality and mental / physical condition. Can do.

  Next, the scene specifying means may specify an approach scene in which the user approaches the car and a driving / staying scene in which the user drives or stays in the car. The hospitality content determination means can be configured to determine the hospitality operation unit to be used and the content of the hospitality operation by the hospitality operation unit for each scene. When driving or staying in a car, it takes a long time as a scene related to the use of the car, and emphasizing the hospitality in the driving / staying scene is an important key for whether or not the user can use the car comfortably. Holding. On the other hand, the approaching scene occupies the next time specific gravity as the scene preceding the driving / staying scene, and by effectively utilizing this as an opportunity for hospitality, the approaching scene of the user facing the driving / staying scene It also contributes to improving the mental state and further enhancing the hospitality effect in the driving / staying scene.

  The scene estimation information acquisition means has an approach detection means for detecting the approach of the user to the car based on the relative distance between the car and the user located outside the car in order to specify the approach scene. Can be configured. In addition, in order to specify the driving / staying scene, it can be configured to have a seating detection means for detecting a user seated in a car seat. Both have the advantage that an approaching scene or a driving / staying scene can be specified accurately.

  Next, the hospitality control unit can be configured such that the operation content of the hospitality operation unit is changed according to the distance between the user and the vehicle detected by the approach detection means. According to this, since the operation content of the hospitality operation unit is controlled so as to change according to the distance between the user and the car, the service effect to the user by the hospitality operation unit should be demonstrated appropriately and finely according to the above distance. As a result, it is possible to enhance the atmosphere in which the automobile side actively treats the user as the master or the customer.

In this case, the hospitality control unit can change the operation content of the hospitality operation unit so that the closer the user is to the car, the higher the feeling of the user. As a result, hospitality increases as the user gets closer to the car, which can significantly contribute to raising the mood when getting into the car. Specifically, the following aspects can be illustrated.
・ Make the music output for hospitality uptempo as the distance gets closer. It is also possible to set the tempo to a multiple of the heart rate, increase the volume as the distance gets closer, or change to a song that makes the mood more exciting.
-Brighten the lighting for hospitality or change the color to red. It is also possible to synchronize the blinking (or change) cycle of the lighting with music.

  The hospitality control unit includes at least one of stopping the hospitality operation unit that is already in operation and starting operation of the non-operational hospitality operation unit (of course, including operation switching between a plurality of hospitality operation units, which is a combination of both) ), The operation content of the hospitality operation unit can be changed stepwise depending on the distance between the user and the automobile. According to this configuration, an appropriate threshold value is set for the distance between the user and the vehicle, and the control of switching between operation / non-operation is performed for each hospitality operation unit by simple determination of whether or not the vehicle approaches the threshold. The above-described effect of the present invention can be achieved by a relatively light control process.

  In the approaching scene, a lighting device that illuminates the space outside the vehicle mounted on the vehicle (head lamp, tail lamp, hazard lamp, etc .: the interior light can also illuminate the space outside the vehicle by leakage through the window glass). Can be determined as And it can be defined as the content of the hospitality operation that the lighting device is turned on to welcome the user. According to this, the lighting mounted on the car can be used as illumination for the presentation of the user and contributes to raising the mood. Also, at night or in the dark, there is an advantage that the position of the parked automobile can be easily grasped.

  In the above case, the hospitality control unit can control the lighting device so that the total amount of illumination light decreases as the distance between the user-side terminal device and the automobile decreases. When the distance to the car is long, increasing the total illumination light quantity makes it easier to understand whether there are any obstacles etc. between the car and it is necessary if the distance to the car decreases. In order to illuminate only the field of view, if the amount of light is reduced, waste can be eliminated, and glare when approaching the illumination light source can be reduced.

  The hospitality operation unit is not necessarily limited to equipment mounted on a car, and may be peripheral equipment of a parked car (for example, ancillary equipment of a designated parking lot) It is good also as a hospitality operation | movement part for the carrying goods which a user must carry at the time of utilization. For example, the following configuration can be exemplified as an example of the latter case. That is, a host-side communication unit that is provided in a parked vehicle or a peripheral facility of the vehicle and communicates with an external terminal device, and is carried by the user of the vehicle and communicates with the host-side communication unit via a wireless communication network. In addition to providing a user-side terminal device having terminal-side communication means, the hospitality operation unit in the approach scene can be a voice output unit provided in the user-side terminal device. In this case, the host-side communication means is a hospitality control unit, and it is possible to give a radio command to the user-side terminal device so that the audio output unit operates in an approach scene. In this aspect, when the user approaches the vehicle, a wireless command is sent to the user terminal device by the host communication means, and voice for hospitality (music, sound effects, greetings) is received from the user terminal device carried by the user. Etc.) are output. Thereby, the hospitality by the voice of the user approaching the automobile can be effectively executed by the user side terminal device carried by the user. Car audio system mounted on the car side by voice can be used as the voice output part, but if the window is closed, the hospitality voice will not reach the user enough, and the window will open and the sound will leak out of the car Doing so can be a nuisance to the neighborhood. However, if the user-side terminal device is used as a hospitality sound output unit as described above, the voice effect can be output at the user's hand, which greatly enhances the hospitality effect. There is nothing.

  In this case, outputting music and greetings from the voice output unit will help improve or improve the mental state of the user. There is also a method for outputting a message prompting the user. Thereby, even if it is the same approach scene, the other objective of preventing the unexpected situation when a user neglects attention confirmation can be achieved. For example, the message that prompts attention confirmation items may be a message that prompts confirmation of forgotten things, door locks, etc., but is not limited thereto.

  In a driving / staying scene, an air conditioner mounted on a car can be defined as a hospitality operation unit. In particular, in the case of providing a user biometric information acquisition unit that acquires user biometric information including at least one of the user's personality, mental state, and physical condition, the hospitality content determination unit includes the acquired user personality information or mental / It can be configured to change the set temperature of the air conditioner according to the contents of the physical condition information. As a result, a more human-friendly and friendly air conditioning adjustment control based on the user's feelings is realized. Similarly, in a driving / staying scene, a car audio system mounted on a car can be defined as a hospitality operation unit. In this case, the hospitality content determination means can change the music selection content of the music source output from the car audio system according to the content of the acquired user personality information or mental / physical condition information. Accordingly, the music source desired by the user is automatically selected and output according to the mood and personality, so that the user who is driving or staying in the vehicle can be pleased in a timely manner.

  Next, as a more detailed scene setting, the scene specifying means includes an approach scene in which the user approaches the automobile, a boarding scene in which the user gets into the automobile, and a driving / driving in which the user drives or stays in the automobile. The stay scene and the getting-off scene where the user gets off the car can be specified in this order in time series. The hospitality content determination means may determine the hospitality operation unit to be used and the content of the hospitality operation by the hospitality operation unit for each of these scenes. In this aspect, a boarding scene and a getting-off scene are newly added to the above-described configuration. Although each of these scenes is short in time, it involves actions that are physically and psychologically burdensome, such as opening and closing doors, loading and unloading, and considerations regarding obstacles and traffic hazards when opening and closing the doors. There is a feature, and in the form of assisting this, if you set the original hospitality operation in these scenes, you can more reliably follow up the user before and after the main driving / staying scene, As the content of hospitality received by users from automobiles is more consistent and continuous, the satisfaction that users feel is even greater. As a specific example, for example, in the boarding scene and the getting-off scene, the hospitality operation unit can be an automatic opening / closing device or an opening / closing assist mechanism for a door provided in the automobile, and the automatic opening / closing device or the opening / closing assistance mechanism can be used as a user's boarding operation. It is possible to determine the content of the hospitality operation to operate for assistance. In addition, when the opening / closing assist mechanism is provided, door opening suppression means for detecting an obstacle outside the vehicle, particularly when opening the door, and preventing the door from opening to prevent interference between the obstacle and the door. It can be provided.

  Even after the user gets off, it is possible to add another scene such as a separated scene in which the user leaves the car, and a corresponding hospitality operation can be performed.

  The user biometric information acquisition means can be configured to acquire user personality specifying information for specifying the personality of the user as the user biometric characteristic information. In this case, it is possible to provide a hospitality operation information storage unit that stores the hospitality operation information that defines the operation content of the hospitality operation unit in a form associated with the personality type of the user specified by the user personality specification information. The hospitality control unit can read out the hospitality operation information corresponding to the personality type specified by the acquired user personality identification information from the hospitality operation information storage unit, and can be configured to control the operation of the hospitality operation unit based on this. .

  According to the above configuration, the personality of the user is classified, and the content of the hospitality operation adapted to the user of the personality type is individually determined according to the type. On the other hand, on the automobile side, the personality of the user who is currently using the automobile is specified by the user personality specifying information acquired by the user biometric characteristic information acquisition means, and the hospitality operation corresponding to this is selected and executed. Accordingly, it is possible to perform a hospitality operation with content that matches the personality of the user, and even users with different personalities can be satisfied with their own unique hospitality content.

  The hospitality operation unit may be a car audio system installed in an automobile, for example. In this case, the hospitality operation information storage unit stores a plurality of music source data to be reproduced by the car audio system, and each music source data is classified in a form uniquely associated with the user personality type. It can be a music source database. Then, the hospitality control unit is configured to read out music source data corresponding to the personality type specified by the acquired user personality specifying information from the music source database, and to reproduce it in the car audio system. The music source to be played is classified in the music source database in association with a predetermined user personality type, and the music source corresponding to the acquired and determined user personality type is played on the car audio system. Thus, it is possible to accurately provide music that the user of that character likes, and to entertain the user while driving or staying in the car. In addition, it is possible to save a considerable part of the trouble of selecting music that suits the user from a huge database, and it does not bother the user.

  Naturally, the car audio system can also be provided with a music selection section operated by the user, and the music source data selected by the music selection section can be used for reproduction. Here, if the music source data is classified in association with the user personality type as described above, the personality type of the user is specified according to what kind of music the user intends to use. It becomes possible. Specifically, a music selection record storage unit is provided for storing the music selection results by the user together with the personality types associated with the individual music source data. It is assumed that the user personality specifying information is acquired based on the type information. The personality of the user can be accurately identified based on which personality type belongs most to the selected music source.

  Next, the hospitality operation unit may be a lighting device that illuminates the interior of the automobile or the exterior of the automobile. The hospitality control unit can be configured to change at least one of the color tone of the illumination light by the illumination device and the illumination form according to the content of the user biometric characteristic information. By changing the movement of lighting depending on the user's personality, mental condition, or physical condition, the user's mind can be visually softened, and the mood can be raised depending on the mental condition and physical condition. Or conversely, it is possible to heal a user who is too tall or tired.

  For example, the hospitality control unit may operate the lighting device with different contents according to the acquired user biometric information when the user approaches to get into a car. According to this aspect, the car appropriately changes the so-called “greeting” form of the approaching user according to the personality, mental state or physical condition of the user, and thereby enhances the feeling of the user who wants to drive from now on. Or you can calm down.

  Next, the automobile hospitality system of the present invention can be provided with a body state detection unit that detects the state of the user's body. Further, the user biological characteristic information acquisition means can acquire mental / physical condition information reflecting the mental state and physical condition of the user based on the detection information of the physical condition detection unit. The operation content of the hospitality operation unit can be changed according to the content of the acquired mental / physical condition information. If the mental state is elevated or depressed, it appears as some kind of biological reaction on the user's body. The same applies when there is physical condition or fatigue. Therefore, by capturing the biological reaction by the body state detection unit, estimating the mental state and physical condition of the user from the detection information, and performing a hospitality operation in a form suitable for this, the user's mood is raised in a good direction, Alternatively, the vehicle can be converted, and the use of the automobile can be made more comfortable. If the user is a driver, the vehicle can also contribute to safe driving.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a conceptual block diagram of an automobile user hospitality system (hereinafter also simply referred to as “system”) 100 according to an embodiment of the present invention. The system 100 includes a hospitality execution control unit 3 including a first computer to which various hospitality operation units 502 to 517, 534, 541, and 1001B are connected, and a first sensor to which various sensor / camera groups 518 to 528 are connected. An automobile-side mounting unit 100A including a hospitality decision-making unit 2 including two computers is configured as a main part thereof. Each of the first computer and the second computer includes a CPU, a ROM, and a RAM, and implements various functions described below by executing control software stored in the ROM using the RAM as a work memory.

  In the system 100, a series of operations related to the user's use of the car until the user approaches the car, gets into the car, drives the car or stays in the car, and then gets off the vehicle. It is divided into a plurality of predetermined scenes. Then, for each of a plurality of divided scenes, the hospitality operation units 502 to 517, 534, 541, and 1001B perform a hospitality operation for assisting the use of the automobile by the user or for entertaining the user. In the present embodiment, a horn 502 and a buzzer 503 are connected as a sound wave generator to the outside of the vehicle. Further, as a lighting device (lamps), a head lamp 504 (beam can be switched between high and low), a fog lamp 505, a hazard lamp 506, a tail lamp 507, a cornering lamp 508, a backup lamp 509, a stop lamp 510, indoor lighting 511 and an underfloor lamp 512 are connected. Further, as other hospitality operation units, an air conditioner 514, a car audio system (car stereo) 515, an electric seat 516, an angle adjusting drive unit 517 such as a side mirror and a rearview mirror, a car navigation system 534, an assist for opening and closing the door. A mechanism (hereinafter referred to as a door assist mechanism) 541 and a noise canceller 1001B for reducing vehicle interior noise are connected.

  FIG. 16 shows a configuration example of the indoor lighting 511, and a plurality of lighting sections each having a unique lighting color (in this embodiment, a red lighting 511r, an amber lighting 511u, a yellow lighting 511y, a white lighting) 511w and blue illumination 511b). In response to the control command signal input from the hospitality decision making unit 2 through the hospitality execution control unit 3, these lights are selected, and lighting control is performed in various lighting patterns according to the control command signal. . FIG. 19 shows a configuration example of the lighting control data determined according to the personality type of the user. The lighting control data is stored in the ROM of the hospitality decision making unit 2 and is read and used as needed by the control software. For example, for the active personality (SKC1 (see FIG. 18)), the red light 511r is selected and flashed (only the first, then continuously lighted), and for the gentle personality (SKC2), For example, the amber system lighting 511u is selected and fade-in lighting is performed, but this is only an example.

  In addition to the incandescent light bulb and the fluorescent lamp, the lighting device using a light emitting diode can be adopted as the lighting device. In particular, various illumination lights can be easily obtained by combining light emitting diodes of three primary colors of red (R), green (G), and blue (B). FIG. 39 shows an example of the circuit configuration, and each of the red (R), green (G), and blue (B) light emitting diodes 401 is connected to a power source (Vs) and is switched by a transistor 402. Driven. This switching is PWM controlled by a duty ratio determined by a period of a triangular wave (which may be a sawtooth wave) input to the comparator 403 and a voltage level of the command signal. The input waveform of the command signal to the light emitting diode 401 for each color can be changed independently, and an illumination color of any color tone can be obtained according to the mixing ratio of the three light emission colors, and the color tone and illumination intensity pattern can be changed. It is also possible to change over time according to the input waveform of the command signal. In addition to the method of PWM control as described above, the light emission intensity of each color light emitting diode 401 can be adjusted at the drive current level on the premise of continuous lighting, and this is combined with PWM control. A scheme is also possible.

  FIG. 17 shows a configuration example of the car audio system 515. The hospitality music performance control information such as music identification information and volume control information is input from the hospitality decision making section 2 through the hospitality execution control section 3. It has an interface unit 515a. The interface unit 515a is connected to a digital audio control unit 515e and music source databases 515b and 515c (the former is an MPEG3 database and the latter is a MIDI database) storing a large number of music source data. The music source data selected based on the music identification information is sent to the audio control unit via the interface unit 515a, where it is decoded into digital music waveform data, converted into analog by the analog conversion unit 515f, and then pre-amplifier 515g and power amplifier. After 515h, it is output from the speaker 515j at the volume specified by the hospitality music performance control information.

  FIG. 40 shows an outline of the door assist mechanism 541. A swing-type door (hereinafter also simply referred to as a “door”) 1101 for getting on and off is attached to the automobile 1100 via a door turning shaft 1103 at one edge of the entrance 1102. The door 1101 can be opened from a closed position where the door 1102 is closed by a manual operation to an arbitrary angle position. The manual door opening operation is power-assisted by a motor (actuator) 1010. In the present embodiment, the rotation output of the motor 10 is directly torqued to the turning shaft 103 as the rotational driving force of the door opening / closing assist while torque is increased via the reduction gear mechanism RG with respect to the door turning shaft 103 rotating together with the door 101. I try to communicate.

  FIG. 41 is an example of a circuit diagram of the door assist mechanism 541. The door assist mechanism 541 has an obstacle detection unit that detects an obstacle outside the vehicle that interferes with the door during the opening operation of the door, and the actuator control unit, when no obstacle is detected, When the door is opened, the actuator enters a normal assist mode in which a positive assist force in the door opening direction is generated by the actuator. When the obstacle detection means detects an obstacle, the door closes the entrance / exit when the door is opened. The door by the actuator is in a collision suppression mode in which the door can be opened at least halfway in the door turning section that reaches the collision position where it collides with the obstacle while the collision between the obstacle and the door is suppressed. It is configured to control the assist.

  The actuator is a motor 1010 that can rotate in both forward and reverse directions, and is configured by a DC motor in this embodiment (of course, other types of motors such as an induction motor, a brushless motor, and a stepping motor may be used). The actuator control means rotates the motor in the forward direction in the positive assist mode, and rotates the motor 1010 in the reverse direction in the reverse assist mode. In this embodiment, the actuator control means is a bidirectional linear control type using a push-pull transistor circuit. The motor driver 1007 constitutes an actuator control means.

Specifically, the motor driver 1007 includes a forward drive transistor 1073 connected to a positive power supply (voltage Vcc) and a reverse drive transistor 1074 connected to a negative power supply (voltage −Vcc). is configured as, each base terminals of the transistors 1073,1074, drive instruction voltage _{V D} is input is the voltage adjusted by the resistor 1071. A resistor 1072 is a feedback resistor for amplification, and a part of the collector-emitter current of both transistors 1073 and 1074 is converted into a voltage and returned to the base of each transistor. Thus, when V _D is positive, the forward driving transistor 1073 causes the motor 10 to pass a current proportional to V _D , respectively, when the V _D is negative. Therefore, when V _D is positive, the motor 1010 rotates in the positive assist mode, and when V _D is negative, the motor 1010 rotates in the reverse direction. The assist force becomes the determined by a motor current corresponding to V _D. The driving transistors 1073 and 1074 are provided with overcurrent protection transistors 1073t and 1074t, respectively. Reference numerals 1073R and 1074R denote overcurrent detection resistors, and reference numerals 1073D and 1074D denote flyback diodes.

  The door assist mechanism 541 is provided with an operation force detecting means 1002 for detecting the operation force of the door 1101, and as shown in FIG. 43 as a state (A) and a state (B), the actuator control means performs a positive assist mode. The operation of the actuator 10 is controlled so that the positive assist force increases as the door operation force detected by the operation force detection means 2 decreases. That is, when a person with weak power tries to open the door 101, the positive assist force by the motor 10 acts strongly and the door 101 can be opened easily. On the other hand, when a strong person tries to open the door strongly, the positive assist force works relatively weakly. For example, if the control is performed so that the sum of the door opening torque generated by the external operating force and the door opening torque generated by the positive assist force is substantially constant, the door 101 can be opened with a substantially constant standard torque regardless of who is operated. it can.

  In the circuit of FIG. 41, the above functions are realized as follows. The operating force detection means 1002 is a torque sensor 1002 provided on the door turning shaft 1103 as shown in FIG. 40, and the torsion torque generated in the door turning shaft 1103 appears more greatly as the door opening operating force acts more strongly. The output voltage of the sensor 1002 increases. Since the output voltage of the torque sensor 1002 is positive when the door is opened and negative when the door is closed, the direction of torque can be detected by the sign of the voltage. In the present embodiment, the output voltage of the torque sensor 1002 is amplified by the non-inverting amplifier 1003 and is output as the torque detection voltage Vst via the voltage follower 1004.

The torque detection voltage Vst is input to the differential amplifier circuit 1005. The differential amplifier circuit 1005, as compared to the reference voltage Vref1 torque detection voltage Vst, the difference ΔV a (= Vref1-Vst) is amplified by a predetermined gain, and outputs a drive instruction voltage _{V D} to the motor 1010. When the opening operation of the door 1101 is started, since the torque detection voltage Vst is initially small, ΔV increases, the output current of the motor 1010 also increases, and a large positive assist force works. Since the torque due to the positive assist force is superimposed on the door turning shaft 1103 together with the torque due to the external operation force, the torque detection voltage Vst is increased by the contribution due to the positive assist force. Then, ΔV decreases and ΔV decreases. That is, when the torque by the positive assist force is returned to the door turning shaft 1103, the total torque of the external operation force and the positive assist force is reflected in the torque detection voltage Vst, and the door assist by the motor 1010 is made so that this approximates Vref1. The drive is feedback controlled. As a result, in the case of a weak person, the assist motor current (that is, the assist torque AT) is kept large as much as the contribution by the external operation force is reduced. Conversely, in the case of a strong person, the assist motor current is It will be kept small.

As is well known, the door 1101 can be opened and closed by either the vehicle outer operation knob 1104E or the vehicle inner operation knob 1104. When the lock button 1104 is tilted, the door 1101 is moved by a known door lock mechanism 1320 shown in FIG. The door opening / closing operation by the knobs 1104E and 1104 becomes impossible. When the door lock mechanism 1320 is in the locked state, a door lock signal DRS is output and used for stop control of the motor 1010. In the present embodiment, the switch 21 that has received the door lock signal DRS disconnects the reference voltage Vref1 from the differential amplifier circuit 5, shorts the inverting input terminal and the non-inverting input terminal of the differential amplifier circuit 5, The input ΔV and thus the drive instruction voltage V _D to the motor 1010 is forcibly set to zero, and the motor 1010 is stopped driving.

  In the circuit of FIG. 41, a comparator 1020 is provided that outputs an assist control signal SK1 when the sign of the torque detection voltage Vst becomes negative. A logical sum of the door lock signal DRS and the assist prohibition signal SK1 is input to the control terminal of the switch 1021 through the gate 1021a, and the motor 1010 of the assist system SYS1 is controlled to stop even when the assist control signal SK1 is detected. It has come to be.

  Further, obstacle detection means for detecting an obstacle outside the vehicle that interferes with the door 1101 when the door 1101 is opened is provided. As the obstacle detection means, one that detects an obstacle that faces the side surface of the door 1101 can be adopted. If it does in this way, the obstacle which exists in the direction which the door 1101 opens can be detected correctly. As such an obstacle detection means, for example, a well-known proximity switch, a reflection optical sensor (including an infrared sensor), or an obstacle sensor 1050 such as an ultrasonic sensor can be employed.

  The detection output of the obstacle sensor 1050 is compared with a threshold value by the comparator 1051, and a signal indicating the presence / absence of detection of the obstacle is output in a binary manner. When the door 1101 is opened from the inside and is detected by the obstacle sensor 1050, the angular position of the door 1101 when the obstacle is detected becomes the limit angle position, and the detection signal SI ′ means that there is an obstacle. Is output, and the door assist control means that receives this performs control to prevent the subsequent door opening operation. In this embodiment, when the door 1101 reaches the limit angle position, the obstacle door turning lock mechanism 1300 for preventing the door from turning thereafter is provided as part of the door assist control means. .

  FIG. 42 shows a configuration example of the lock portion of the lock mechanism 1300. The main part of the lock part is a door side engaging part (male spline in this embodiment) 1312 provided on the turning shaft 1103 of the door 1101 and a vehicle body side fixed to the door side engaging part 1312. A vehicle body side engaging portion (female spline in this embodiment) 1313 that is detachably engaged at an arbitrary angle phase corresponding to the turning angle 1103 and locks the turning of the turning shaft 1103 at the angle phase of the engaged state. And have. The vehicle body side engaging portion 1313 is provided so as to be able to approach and separate from the door side engaging portion 1312 in the axial direction of the turning shaft 1103, and is locked with the vehicle body side engaging portion 1313 when approaching, and unlocked when separated. It becomes. In this embodiment, this approach / separation mechanism is configured by a known solenoid mechanism (cylinder mechanism or the like). The vehicle body side engaging portion 1313 is attached to the tip of a drive shaft 1314 having a spring receiving portion 1314, and this drive shaft 1031 is driven by a solenoid 1301 that is driven forward and backward in the axial direction by a solenoid 1301 accommodated in the case 1300C. When energized, the drive shaft 1031 pops out and the vehicle body side engaging portion 1313 engages with the door side engaging portion 1312. On the other hand, when the solenoid is de-energized, the bias spring 1310 that engages with the spring receiving portion 1314 is elastically restored, and the drive shaft 1031 is retracted to disengage the vehicle body side engaging portion 1313 and the door side engaging portion 1312. Is done.

  As shown in FIG. 41, when the obstacle detection signal SI ′ is output, the drive switch (transistor: reference 1302 is a flyback diode for protection) 1303 is turned on, the solenoid 1301 is energized, and FIG. The vehicle body side engaging portion 1313 and the door side engaging portion 1312 engage with each other. At this time, the door 1101 is approaching an obstacle at an indeterminate position outside the vehicle. If it is, it will be locked at that angle. That is, the limit angle position is variably determined according to the door angle position when the obstacle detection unit detects the obstacle (that is, according to the position of the obstacle). Thereby, regardless of the relative distance of the obstacle with respect to the automobile, if the door approaches by the opening operation, the door opening operation is prevented so as not to hit the obstacle. At this time, since the opening operation of the door 1101 is hindered even if a positive assist force is generated by the motor 1010, it is clear that the door assist by the actuator is controlled so that the collision suppression mode is set.

  When the door operation signal EDS indicates a state in which the door is operated from the outside of the vehicle, the door assist suppression control mechanism (here, the door for obstacles) is used regardless of the detection output of the obstacle sensor 1050. The operation of the turning lock mechanism 1300) is restricted. Specifically, the detection signal SI ′ of the obstacle sensor 1050 binarized by the comparator 1051 and the binary external door operation signal EDS (when the door is operated from the outside, the opposite sign to the detection signal SI) This function is realized by using the logical product output SI by the gate 1051a as the drive signal for the analog switch 1053.

  Instead of using the swing type door having the assist mechanism as described above, it is also possible to adopt a known electric automatic opening / closing mechanism or an electric slide type door having an assist mechanism.

    FIG. 44 is a functional block diagram illustrating a configuration example of the noise canceller 2001B. The main part of the noise canceller 2001B includes an active noise control mechanism main body 2010 that forms noise suppression means, and a necessary sound enhancement part (means) 2050. The active noise control mechanism 2010 is a noise that synthesizes an in-vehicle noise detection microphone (noise detection microphone) 2011 that detects noise invading into the vehicle, and a noise control waveform that is opposite in phase to the noise waveform detected by the in-vehicle noise detection microphone 2011. A control waveform synthesis unit (control sound generation unit) 2015. The noise control waveform is output from the noise control speaker 2018. There are also provided an error detection microphone 2012 for detecting an unerased noise component included in the vehicle interior sound after the noise control sound wave is superimposed, and an adaptive filter 2014 for adjusting a filter coefficient in a direction in which the level of the unerased noise is reduced. ing.

  Vehicle interior noise having a sound source in the vehicle itself includes engine sound, road surface sound, wind noise, etc. A plurality of vehicle interior noise detection microphones 2011 are distributed and arranged at positions suitable for detection of individual vehicle interior noise. ing. The vehicle interior noise detection microphones 2011 are at different positions as viewed from the passenger J, and there is a considerable phase difference between the noise waveform at the position picked up by the microphone 2011 and the noise waveform actually heard by the passenger J. . Therefore, in order to match this phase difference, the detection waveform of the vehicle interior noise detection microphone 2011 is appropriately supplied to the control sound generation unit 2015 via the phase adjustment unit 2013.

  Next, the necessary sound enhancement unit 2050 is configured to include an enhancement sound detection microphone 2051 and a necessary sound extraction filter 2053, and an extraction waveform of the necessary sound is given to the control sound generation unit 2015. Also here, the phase adjustment unit 2052 is provided as appropriate due to the same situation as the vehicle interior noise detection microphone 2011. The emphasis sound detection microphone 2051 includes an in-vehicle microphone 2051 (E) for capturing necessary sound outside the vehicle and an in-vehicle microphone 2051 (I) for capturing the necessary sound inside the vehicle. Both can be configured with known directional microphones, and are mounted on the outside of the vehicle so that the angle range with strong directivity for sound detection faces the outside direction of the vehicle and the angle range with low directivity faces the inside direction of the vehicle. In the present embodiment, the entire microphone 2051 is attached so as to go out of the vehicle, but the inside area of the vehicle is set so that the angle area with low directivity is located inside the vehicle and only the angle area with strong directivity goes out of the car. It can also be installed across the outside of the vehicle. On the other hand, the in-vehicle microphone 2051 (I) has a sound detection directivity angle range facing the front of the passenger so that the passenger's conversational sound can be selectively detected corresponding to each seat. It is attached so that the weak angle range is facing the opposite direction. Each of these emphasized sound detection microphones 2051 is connected to a necessary sound extraction filter 2053 that preferentially passes a necessary sound component of its input waveform (detected waveform). The audio input of the car audio system 515 in FIG. 1 is used as the in-vehicle necessary sound source 2019. The speaker output sound of this audio device (the speaker may be used as the noise control speaker 2018 or may be provided separately) is controlled so as not to be canceled even if the noise control waveform is superimposed.

  FIG. 45 shows an example of a hardware block diagram corresponding to the functional block diagram of FIG. A first DSP (Digital Signal Processor) 2100 constitutes a noise control waveform synthesis unit (control sound generation unit) 2015 and an adaptive filter 2014 (and further a phase adjustment unit 2013), and an in-vehicle noise detection microphone 2011 is a microphone amplifier. 2101 and an A / D converter 2102, and a noise control speaker 2018 are connected via a D / A converter 2103 and an amplifier 2104, respectively. On the other hand, the second DSP 2200 constitutes an extraction unit for a noise component to be suppressed, and the in-vehicle noise detection microphone 2011 is not subject to suppression through the microphone amplifier 2101 and the A / D converter 2102 or audio input. Audio signal sources, that is, a necessary sound source 2019 are connected to each other via an A / D converter 2102.

  The necessary sound enhancement unit 2050 includes a third DSP 2300 that functions as a necessary sound extraction filter 2053, and a necessary sound detection microphone (emphasis sound detection microphone) 2051 is connected via a microphone amplifier 2101 and an A / D converter 2102. Yes. The third DSP 2300 functions as a digital adaptive filter. The filter coefficient setting process will be described below.

  Recognize caution and danger of emergency vehicles (ambulances, fire trucks, police cars, etc.) sirens, railroad crossing alarms, subsequent vehicle horns, whistle, human screams (children crying, women screaming, etc.) It is determined as necessary outside vehicle sound (emphasized sound), these sample sounds are recorded on a disk or the like, and are made into a library as reference emphasized sound data that can be read and reproduced. As for the conversation sound, a plurality of individual model sounds are similarly stored in a library as reference emphasized sound data. In addition, if the boarding candidate is fixedly fixed, if the model voice is prepared as reference enhancement sound data by the utterance of the model voice itself, the boarding candidate will get on Can enhance the accuracy of conversation sound.

  Then, an appropriate initial value is given to the filter coefficient, and the enhancement sound detection level by the enhancement sound detection microphone 2051 is set to the initial value. Next, each reference emphasis sound is read and output, and is detected by the emphasis sound detection microphone 2051. Then, the passing waveform of the adaptive filter is read, and the level of the waveform that has passed as the reference enhancement sound is measured. The above processing is repeated until this detection level reaches the target value. In this way, the filter coefficient is subjected to learning processing so that the reference emphasis sound is successively replaced for both the vehicle exterior sound and the vehicle interior sound (conversation sound), and the detection level of the passing waveform is optimized. The necessary sound is extracted from the input waveform from the emphasized sound detection microphone 2051 by the necessary sound extraction filter 2053 having the filter coefficient adjusted as described above, and the extracted enhanced sound waveform is transferred to the second DSP 2200. The second DSP 2200 calculates a difference between the input waveform from the necessary sound source (audio output here) 2019 and the extracted enhanced sound waveform from the third DSP 2300 from the detection waveform of the in-vehicle noise detection microphone 2011.

  The filter coefficients of the digital adaptive filter incorporated in the first DSP 2100 are initialized prior to use of the system. First, various noises to be suppressed are determined, and those sample sounds are recorded on a disk or the like, and are made into a library as reproducible reference noise. Then, an appropriate initial value is given to the filter coefficient, and the noise level left by the error detection microphone 2012 is set to the initial value. Next, the reference noise is sequentially read out and output, and detected by the vehicle interior noise detection microphone 2011. The detection waveform of the vehicle interior noise detection microphone 2011 that has passed through the adaptive filter is read, and this is subjected to fast Fourier transform to decompose the noise detection waveform into sinusoidal elementary waves having different wavelengths. Then, an inverted elementary wave obtained by inverting the phase of each sine wave elementary wave is generated and synthesized again to obtain a noise control waveform having a phase opposite to that of the noise detection waveform. This is output from the noise control speaker 2018.

  If the coefficient of the adaptive filter is appropriately determined, only the noise component should be efficiently extracted from the waveform of the vehicle interior noise detection microphone 2011. Therefore, the noise control waveform synthesized based on the noise is used to generate the interior of the vehicle. Noise can be offset without excess or deficiency. However, if the setting of the filter coefficient is not appropriate, the waveform component that is not canceled out remains as a noise component. This is detected by the error detection microphone 2012. The level of the unerased noise component is compared with the target value. If the level is not lower than the target value, the filter coefficient is updated, and the same processing is repeated until it becomes lower than the target value. In this manner, the reference noise is replaced one after another, and the filter coefficient is subjected to learning processing so that the unerased noise component is minimized. During actual use, the noise component that remains unerased is constantly monitored, the filter coefficient is updated in real time so that it is always minimized, and the same processing as described above is performed to leave the necessary sound wave component. Only the noise level in the vehicle can be effectively reduced.

  Next, the user-side terminal device 1 is configured as a mobile phone as shown in FIG. 14 in the present embodiment (hereinafter also referred to as “mobile phone 1”). The mobile phone 1 includes a monitor 308 configured with a liquid crystal display, an input unit 305 including a keyboard, a transmitter 304, a receiver 303, and the like. A pulse sensor (heart rate sensor) 342 is also provided on the side surface.

  FIG. 15 is a block diagram showing an example of the electrical configuration of the mobile phone 1. The main part of the circuit includes an input / output unit 1311 and a control unit 310 including a CPU 312, a ROM 314, a RAM 313, and the like connected thereto. An input unit 305 and an on-hook / off-hook switch 306 are connected to the input / output unit 1311. The receiver 303 is connected to the input / output unit 1311 via the amplifier 315 and the D / A converter 316, and the transmitter 304 is connected to the input / output unit 1311 via the amplifier 317 and the A / D converter 318. Furthermore, a well-known GPS 554 for acquiring position information of the mobile phone 1 is connected to the input / output unit 1311.

  In this embodiment, in order to grasp the distance and azimuth relationship between the user side terminal device 1 and the vehicle, the user side terminal device 1 is provided with the GPS 554 in addition to the GPS 533 (FIG. 1) on the vehicle side, A method is adopted in which the terminal device 1 can independently acquire the position information, and the terminal position information is transmitted to the vehicle side via the wireless communication network. As a result, the vehicle side can acquire both the accurate vehicle position by the GPS 533 connected to itself and the accurate terminal position by the GPS 554 received from the user side terminal device 1, and the user side terminal device 1 and the vehicle The distance and azimuth relationship can be grasped very accurately. Moreover, the distance change and the approach direction change between the user-side terminal device 1 and the vehicle can be grasped in real time.

  Returning to FIG. 15, a communication device 323 is connected to the input / output unit 1311 of the mobile phone 1. The communication device 323 includes a connection interface 331 for connecting to the control unit 310, a modulator 332, a transmitter 333, a frequency synthesizer 334, a receiver 335, a demodulator 336, a duplexer 337, and the like connected thereto. ing. The data signal from the control unit 310 is modulated by the modulator 332 and further transmitted from the antenna 339 via the duplexer 337 by the transmitter 333. On the other hand, the received radio wave is received by the receiver 335 via the antenna 339 and the duplexer 337, demodulated by the demodulator 336, and then input to the I / O port 1311 of the control unit 310. When making a call, for example, an audio signal input from the transmitter 304 is amplified by the amplifier 317, further digitally converted by the A / D converter 318, and input to the control unit 310. The signal is processed by the control unit 310 as necessary, and then output from the receiver 303 via the D / A converter 316 and the amplifier 315.

  On the other hand, the connection interface 331 is connected to a control radio wave transmitter 338 that transmits a control radio wave. The control radio wave is transmitted from the antenna 339 via the duplexer 337. When the mobile phone 1 moves to another communication zone 102, the network-side radio network controller performs a known handover process based on the reception status of the control radio wave P.

  Next, the mobile phone 1 is provided with the following functions for outputting ringtones and playing music. That is, ringtone data and music data (MPEG3 data or MIDI data: also used as a ringtone) downloaded by wireless reception are stored in the sound data flash ROM 316. In the case of MIDI data, musical tone data in which tone color, pitch, tone length, tempo, etc. are described according to the MIDI code is sent to the musical tone synthesis unit 307. The tone synthesizer 307 reads the waveform data of the specified tone color from the waveform ROM 358 functioning as a sound source while buffering the tone data, converts the frequency so that the pitch specified by the MIDI code is obtained, and specifies the tone data. This is sequentially output as digital waveform data according to the set tempo. The output digital waveform data is output from the speaker 311 through the analog conversion circuit 309 and the amplifier 350. Note that sound data composed of compressed waveform data such as MPEG3 is output from the speaker 311 via the analog conversion circuit 309 and the amplifier 350 after being decoded. In the present embodiment, the timing information of the voice output by the tone synthesizer 307 is input to the sequencer 352, and the vibrator unit 354 and the LED unit 315 are driven synchronously with music via the PMW unit 353, and the sound output from the mobile phone 1 is performed. The device has been devised to further enhance the hospitality effect in combination with vibration and LED light emission.

Next, the hospitality decision making unit 2 is connected to the following sensor / camera group. Some of these function as scene estimation information acquisition means and also function as user biometric characteristic information acquisition means.
External camera 518: Takes a picture of a user approaching the car. Acquire user gestures and facial expressions as still images or videos. In order to magnify a user for photographing, an optical zoom method using a telephoto lens and a digital zoom method for digitally enlarging a photographed image can be used in combination.
Infrared sensor 519: Takes a thermography based on the radiant infrared radiation from the face portion of the user in the car. It functions as a body temperature measurement unit that is a body state detection unit.
Seating sensor 520: Detects whether the user is seated on the seat. It can be composed of a proximity switch or the like embedded in the automobile seat. In addition, a seating sensor can be configured by a camera that captures a user seated on a seat. With this method, when a load source other than a person such as luggage is placed on the seat, it can be distinguished from a case where a person is seated, for example, a hospitality operation is performed only when a person is seated. Selection control is also possible. In addition, if a camera is used, it is possible to detect the motion of a seated user, and the detection information can be further diversified. In order to detect the user's movement on the seat, there is a method using a pressure sensor mounted on the seat.
-Face camera 521: Photographs the facial expression of the user who is seated. In addition to the function as an acquisition source (body state detection unit) of user biometric information used for hospitality control, it is also used for user authentication by biometrics. It is also possible to specify the direction of the face and line of sight by detecting the direction of the iris of the eyes (for example, when looking at the direction of the clock at times, it is determined that "I am impatient with time") Etc.)
Microphone 522: Detects user voice. This can also function as a body state detection unit.

Pressure sensor 523: It is attached to the grasping position of the steering wheel and shift lever of the automobile by the user, and detects the gripping force of the user, the repetition frequency of gripping and releasing, etc. (body state detection unit).
Pulse sensor 524: It is composed of a reflective optical sensor or the like that reflects and detects a blood flow reflecting the pulse, and is attached to a user grasping position of a car handle (body state detection unit).
Body temperature sensor 525: It is composed of a temperature sensor attached to the user grasping position of the vehicle steering wheel (body state detection unit).
Retina camera 526: Takes a user's retina pattern and is used for user authentication by biometrics.
Iris camera 527: Takes an image of the user's iris (iris) and is used for user authentication by biometrics. When an iris image is used, collation / authentication is performed using the personality of the pattern and color. In particular, the iris pattern is an acquired component and has a low genetic influence, so there is a significant difference even in identical twins, and there is an advantage that it can be reliably identified. An authentication method using an iris pattern has features that it can quickly recognize and collate and has a low misidentification rate.
Vein camera 528: The user's vein pattern is photographed and used for user authentication by biometrics.
-Door courtesy switch 537: Detects opening and closing of the door. It is used as a scene estimation information acquisition means for detecting the transition to the boarding scene and the getting-off scene.

  In addition, the output of the ignition switch 538 for detecting the start of the engine is branched and input to the hospitality determination unit 2. An illuminance sensor 539 for detecting the brightness level in the vehicle and a sound pressure sensor 540 for measuring the sound level in the vehicle are also connected to the hospitality decision making unit 2 in the same manner.

  Further, the hospitality decision making unit 2 may be a touch panel (a touch panel superimposed on the monitor of the car navigation system 534 may be used: in this case, input information is transferred from the hospitality execution control unit 3 to the hospitality decision making unit 2 And the like, and a storage device 535 configured by a hard disk drive or the like that functions as a hospitality operation information storage unit.

  On the other hand, the hospitality execution control unit 3 is also connected with a GPS 533 (also used in the car navigation system 534), a brake sensor 530, a vehicle speed sensor 531 and an acceleration sensor 532 for acquiring vehicle position information.

  The hospitality decision-making unit 2 acquires user biometric information including at least one of the personality, mental state, and physical condition of the user from the detection information of one or more of the sensor / camera groups 518 to 528, In response, it determines what hospitality operation is to be performed by which hospitality operation unit, and commands this to the hospitality execution control unit 3. In response to this, the hospitality execution control unit 3 causes the corresponding hospitality operation units 502 to 517, 534, 541, and 1001B to execute the hospitality operation. That is, the hospitality decision making unit 2 and the hospitality execution control unit 3 cooperate with each other to change the operation contents of the hospitality operation units 502 to 517, 534, 541, and 1001B according to the contents of the acquired user biometric characteristic information. Realize the function to let you. The hospitality execution control unit 3 is connected to a wireless communication device 4 that constitutes a vehicle side communication means (host side communication means). The wireless communication device 4 communicates with a user-side terminal device (mobile phone) 1 carried by a user of an automobile via a wireless communication network 1170 (FIG. 15).

  On the other hand, the car audio system 515 is provided with an operation unit 515d that is manually operated by a user, and by inputting music selection data from the operation unit 515d, desired music source data can be read and played. The volume / tone control signal from the operation unit 515d is input to the preamplifier 515g. This music selection data is transferred from the interface unit 515a to the hospitality decision making unit 2 via the hospitality execution control unit 3 of FIG. 1, and is stored as music selection result data in the storage device 535 connected thereto. Based on the stored contents, a user-personality determination process, which will be described later, is performed (that is, the operation unit 515d of the car audio system 515 can be said to constitute the function of the user biometric characteristic information acquisition unit).

  FIG. 18 shows an example of the database structure of the music source data, in which music source data (MPEG3 or MIDI) is stored in association with the song ID, song name, and genre code. In addition, each music source data includes the personality type estimated for the user who selected the music (“active”, “adult”, “optimistic”, “pessimistic”, “degenerate”, “ ”,“ Intellect ”,“ Romanticist ”, etc., as well as the age code (“ Infant ”,“ Children ”,“ Junior ”,“ Youth ”,“ Middle Age ”,“ Midpoint ”,“ Middle Age ”) , “Respect for the elderly”, “age unrelated”, etc.) and gender codes (“male”, “female” and “gender unrelated”) are stored in association with each other. The personality type code is one of user personality specifying information, and the age code and the sex code are sub-classes that are unrelated to the personality. Even if the personality of the user can be identified, if the music source that does not match the age group or gender is selected, the effect of “hospitality” to entertain the user is halved. Therefore, in order to further narrow down the suitability of the music source provided to the user, the sub-classification as described above is effective.

  On the other hand, each music source data also stores a song mode code in association with each other. The song mode code is data indicating the mental state and physical condition of the user who selected the song, and the relationship between the song and the song. In the present embodiment, the song mode code is “smooth”, “exhilarating”, “warm / healing”. And “Healing / α-wave system”. Since the personality type code, age code, gender code, genre code, and song mode code are data that are referred to when selecting the hospitality content specific to each user, these are collectively referred to as hospitality reference data. .

  In the ROM of the hospitality decision making unit 2 in FIG. 1, as shown in FIG. 2, a hospitality decision table 360 for storing hospitality contents for each scene is stored. In this embodiment, an approach scene SCN1, a boarding scene SCN2, a preparation scene SCN3, a driving / staying scene SCN4, an exit scene SCN5, and a leaving scene SCN6 are set in this order in this order. Further, the following five hospitality genres (ST) are set for each scene, and one or more hospitality themes (OBJ) are set for each scene.

  As will be described later, the approach scene is specified by the user-side GPS 554 and the vehicle-side GPS 553 by specifying the relative distance between the vehicle and the user located outside the vehicle and its change, and the user determines the vehicle in advance. This is done by detecting the approach within a given distance. The boarding scene and the getting-off scene are specified based on the door opening detection output of the door courtesy switch 537. However, since it is not possible to specify whether it is a boarding scene or a getting-off scene only by door opening information, FIG. Thus, the scene flag 350 is provided to cope with this. The scene flag 350 has an individual scene flag corresponding to each scene, and each time a scene whose arrival order is determined in time series arrives, the flag corresponding to the scene is set to “arrival (flag value 1)”. I will do it. By specifying the latest flag of which the value is “1” in the scene flag 350 (the last one in the “1” flag row), it is possible to specify which scene is currently advanced.

  The preparation scene and the scene driving / staying scene are both specified by whether or not the above-mentioned seating sensor detects the user, but until the ignition switch 538 is turned on after entering the automobile, or It is recognized as a preparation scene until the ignition switch 538 is not turned ON and the continuation of sitting beyond a certain level is confirmed. Further, the transition to the leaving scene is identified by the door courtesy switch 537 detecting the door closing after the getting-off scene.

  The hospitality operation in each theme is controlled by the operation control application of the corresponding hospitality operation unit, and these operation control applications are stored in the ROM of the hospitality execution control unit 3 in the form of a theme-specific application library 351 as shown in FIG. It is remembered. The theme determined on the hospitality decision making unit 2 side is notified to the hospitality execution control unit 3, and the operation control application of the corresponding theme is read and executed there. When executing a motion control application, the priority of adoption is determined in advance according to the degree to which the user is oriented to the hospitality for multiple hospitality operations that are managed under each hospitality theme. The theme is selected from the plurality of prepared hospitality operations having the highest priority. Specifically, as illustrated in FIGS. 7 to 13 (detailed later), the operation priority of a plurality of hospitality operation units (hospitality functions) (the larger the number, the higher the priority is displayed) Are selected for each hospitality theme and stored in the ROM of the hospitality execution control unit 3.

  The operation of the automobile user hospitality system (hereinafter also simply referred to as “system”) 100 will be described below. 46 to 48 conceptually show an overall algorithm of a series of processes from hospitality decision making to hospitality operation execution in the system 100 (these three figures are shown by using corresponding round numbers as connectors, It should be read as a connection diagram). The hospitality main processing includes “objective estimation (δ1)”, “personality adaptation (δ2)”, “state adaptation (δ3)”, “production correspondence (δ4)”, “function selection (δ5)” and “drive (δ6)”. It consists of each step.

  First, in “objective estimation (δ1)”, the current scene is estimated by user position detection (β1) and user motion detection (β2). Specifically, the user position detection (β1) is performed by grasping and specifying the relative positional relationship (α1) between the user and the automobile. In the present embodiment, the user approach direction (α2) is also considered. On the other hand, the user motion detection (β2) is basically performed by sensors (scene estimation information acquisition means) that detect motions fixed for scene determination, such as door opening / closing operations and seating on a seat. The output is used (α6). Further, as in the case of detecting the transition from the preparation scene to the driving / staying scene based on the seating duration, the duration (α7) of the specific operation is also taken into consideration.

  FIG. 3 is a flowchart showing a flow of scene determination processing. This process is repeatedly executed at regular intervals during use of the automobile. First, in S1, the scene flag 350 in FIG. 5 is read. S2, S5, S8, S12, S16, and S19 are processes for discriminating from the state of the scene flag 350 which scene is currently advanced. The scene flag 350 is set in order from the flag of the scene positioned earlier in time series, and the flag of the subsequent scene is not set once with the preceding scene interposed. .

  Steps S2 to S4 are identification processes for an approaching scene. First, in S2, it is confirmed that the flag SCN1 for the approaching scene is not “1” (that is, the approaching scene has not yet arrived). From FIG. 1) and the position information specified by the GPS 554 on the user side (mobile phone 1: FIG. 5), it is determined whether or not the user has approached the vehicle within a certain distance (for example, 50 m or less). If it is approaching, it is determined that the approach scene has been entered, and S4SCN1 is set to “1”.

  S5 to S7 are boarding scene specifying processes. In S5, it is confirmed that the flag SCN2 for the boarding scene is not “1”, and in S6, it is determined whether the door is opened from the input information from the door courtesy switch 537. . If the door is open, it is determined that the boarding scene has been entered, and SCN2 is set to "1" in S7. Since it is confirmed that the current scene is SCN = 1, that is, an approaching scene, it is possible to easily determine that the “door open” in this situation is at the time of boarding.

  S8 to S11 are preparation scene specifying processes. In S8, it is confirmed that the flag SCN3 for the preparation scene is not “1”, and in S9, it is determined whether the user is seated from the input information from the seating sensor 520. If the user's seating is detected, it is determined that the preparation scene has been entered, and SCN3 is set to “1” in S10. At this stage, it is only detected that the seating has been completed, and it is only necessary to specify that the user is in a preparation stage to make a full transition to driving or staying in the vehicle. In S11, a seating timer used for determining the transition to the driving / staying scene is started.

  S12 to S15 are driving / staying scene specifying processing. In S12, it is confirmed that the flag SCN4 for the driving / staying scene is not “1”, and in S13, it is determined whether or not the user has started the engine from the input information from the ignition switch 538. If the engine has been started, it is immediately determined that the operation / stay scene has been entered, jumping to S15 and setting SCN4 to "1". On the other hand, even if the engine has not been started, if the seating timer has elapsed for a certain time (t1), it is determined that the user has boarded to stay in the vehicle (for example, for purposes other than driving), and the process proceeds to S15 and SCN4 Is set to “1” (if t1 has not elapsed, S15 is skipped in order to continue the preparation scene.

  S16 to S18 are processing for specifying the getting-off scene. In S16, it is confirmed that the flag SCN5 for the getting-off scene is not “1”, and in S17, it is determined whether the user has stopped the engine from the input information from the ignition switch 538. If the engine is stopped, the process proceeds to S18, and it is determined from the input information of the door courtesy switch 538 whether the user has opened the door. If the door is open, it is determined that the exit scene has been entered, and SCN5 is set to "1" in S19.

  S20 to S23 are separation scene specifying processes. In S20, it is confirmed that the flag SCN6 for the separated scene is not “1”, and in S21, it is determined from the input information from the ignition switch 538 and the seating sensor 520 whether the user has closed the door while leaving the seat. If Yes, the process proceeds to S22, and SCN6 is set to "1". Further, in S23, the getting-off timer is activated. When SCN6 is 1 at 20 (that is, when a separated scene has already arrived), the process proceeds to S24 and subsequent steps. The time t2 required for the hospitality process in the getting-off scene is measured by the getting-off timer. If t2 has already elapsed in S24, the scene flag is reset for the next hospitality process in S25, and the seating timer in S26. And reset the getting-off timer.

Returning to FIG. 46, if the scene is determined at γ1, the hospitality content in the scene is determined. This determination is made with reference to the hospitality decision table 360 of FIG. As described above, a plurality of hospitality genres are set for each scene, and a hospitality theme is set for each genre. As described above, various genres and themes are set from the viewpoints of desires and orientations sought by user hospitality. More specifically, in each scene, the user wants to satisfy the requirements of “safety”, “easy”, and “comfortable” when using the car, and the demand is disturbed by some factors. The cause is identified as a disturbance. And it can be said that the purpose of the final system is to measure the response so that each individual request is satisfied by performing some response processing, that is, hospitality operation. Depending on the type, hospitality genres and themes are defined. Among these, the genre is determined based on the “disturbance” that can be found in common for each scene.
(ST1) Expect and excite users;
(ST2) Relax the user and give them peace of mind;
(ST3) Eliminate user anxiety and tension;
(ST4) Reducing the physical burden on the user;
(ST5) Assist with suitability according to the physical condition of the user;
5 genres are set.

  In FIG. 2, one of the hospitality themes belonging to the expectation / excitement genre ST1 and the relaxation / relaxation genre ST2 is selected according to the personality and mental state of the user (that is, these genres). As a result, hospitality themes belonging to each genre are selected exclusively from each other). Hospitality themes of other genres are simultaneously selected in each scene, and hospitality operations belonging to those themes are performed in parallel in the corresponding scenes.

  On the other hand, different hospitality themes belonging to each genre are set depending on the scene. The hospitality theme by genre of each scene is as described in FIG. There is also a hospitality theme set across multiple scenes. For example, the theme of the anxiety / tension relief genre ST3 “I want you to make your car comfortable” OBJ322 covers three scenes: boarding, preparation, and driving stay. Moreover, OBJ331 “I want to know the state of the destination” spans two scenes of preparation and driving stay.

  The hospitality decision-making table 360 is used in accordance with the flow shown in FIG. 4 (this corresponds to the main part extracted from the hospitality main process indicated by δ1 to δ6 in FIGS. 46 to 48). In S101, the scene flag is read, and in S102, what the current scene is is specified. In S103, the hospitality theme corresponding to the identified scene is read, and the hospitality function (hospitality operation unit) belonging to the theme is selected with reference to the function selection tables 371 and 372 illustrated in FIGS. In step S105, the hospitality application for specifically operating the extracted hospitality function is selected from the theme-specific application library 351 in FIG. 6 and activated.

  Returning to FIG. 46, as correction items at the time of scene specification, the user's dressing detection (α3: can be grasped from the photographed image of the user's figure by the camera 518 (FIG. 1) when approaching), property detection ( (α4: baggage, etc.), gesture detection (α5: detected as a sign of an action directly related to scene estimation), and the like can also be executed. These detections effectively contribute to hospitality theme determination for each scene.

  Next, it progresses to (delta) 2 and becomes the process which adapts the content of hospitality to a user's individuality. Specifically, this is done by appropriately weighting each individual hospitality process according to the personality determination process described later and the determined personality, that is, in order to adapt to the individual user's personality. The object is to customize the combination of hospitality operations as appropriate, or to change the level of hospitality operations. The personality determination process requires personality determination processing β4 or ε2. Process ε2 is for obtaining personality classification by user input, such as questionnaire processing, etc., and process β4 is for determining personality classification more analytically from the user's actions, actions, thought patterns, facial expressions, etc. It is. As for the latter, a specific example of determining personality classification from music selection statistics is shown in the later-described embodiment. However, as in α10, a habit directly connected to personality determination is extracted from the user's action, or α11 In this way, it is possible to make a personality determination from the human phase.

  Proceeding to FIG. 47, in δ3, the hospitality content is adapted to the mental / physical state of the user. Also in this regard, although a specific example will be described later, mental / physical condition information reflecting the mental state and physical condition of the user is acquired based on the detection information of the physical condition detecting unit, and the user's Monitor mental status or physical condition. The body state detection unit can employ an infrared sensor 519 (facial color: α20), a face camera 521 (expression: α12, posture: α14, line of sight: α15, pupil diameter: α16), a pulse sensor 524 (heartbeat: α17), and the like. In addition to these, sensors (502w, 530, 531, 532, 532a; erroneous operation rate: α13), blood pressure sensor (α18), breath sensor (alcohol: α21, for example, alcohol for expiration) Is detected), the seating sensor 520 (measures the weight distribution on the seat with the pressure sensor, detects the minute weight shift during driving, It is possible to make a judgment that the calmness is impaired, or to detect a biased weight and determine the degree of fatigue of the driver).

  Here, the gist of the processing is to replace the output from the physical condition detection unit with a numerical parameter indicating the mental state and physical condition (β5), and specify the mental state and physical condition of the user from the numerical parameter (γ3 , Γ4) Appropriate weighting for each hospitality process, that is, to customize the combination of hospitality operations to suit the user's mental state and physical condition, or to change the level of hospitality operations The purpose is to do. Even if the hospitality is the same in the same scene and theme, as described above, if the user's personality is different, it is better to perform a hospitality operation that matches that personality. It is of course desirable to adjust the type and degree of hospitality.

  In this case, taking the case of illumination light as an example, the lighting color directed by the user differs depending on the personality (for example, the active type is red, the gentle type is green or blue), and the physical condition is good or bad. Therefore, the demands on the illumination intensity (for example, when the physical condition is poor, the light amount is reduced in order to suppress stimulation by illumination) are often different. The former is hospitality control for adjusting the frequency or wavelength of the illumination light (the wavelength becomes shorter in the order of red, green, and blue), and the latter is hospitality control for adjusting the amplitude of the illumination light. In addition, mental state is a factor related to both of them, and in a somewhat cheerful mental state, it is possible to employ red illumination light (frequency adjustment) to further boost the mood, and the color of the illumination light It is possible to increase brightness without changing (amplitude adjustment). In an excessively excited state, processing such as adopting blue illumination light (frequency adjustment) to reduce feelings or reducing brightness without changing the color of the illumination light (amplitude adjustment) can be considered. In the case of music, it is more complicated because it contains various frequency components, but in order to enhance the arousal effect, to emphasize high-frequency sound waves of about several hundreds to 10 kHz, or conversely to sink The control pattern by frequency / amplitude, such as adopting so-called α-wave music that combines the center frequency of sound wave fluctuations with the frequency (7-13 Hz: Schumann resonance) of the brain wave (α wave) when relaxing Can be grasped similarly.

  With regard to the brightness and sound wave level in the vehicle, the suitability level can be set numerically for each hospitality theme in consideration of the personality, mental state and physical condition. FIGS. 7, 8, 9 and 10 show examples in which the function selection table 371 for each theme is accompanied by a control suitability value setting table 371a for the required illumination level and sound wave level. Then, the process proceeds to δ4 in FIG. For example, information (disturbance stimulus) on how much stimulus the user currently feels is obtained from the output of the illuminance sensor 539 (visual stimulus: α23), sound pressure sensor (auditory stimulus: α24), etc. in FIG. Environmental estimation: β6), the disturbance stimulus is converted into a numerical value that can be compared with the suitability value obtained from the personality (personality), mental state, and physical condition, and the disturbance is numerically estimated (γ6) . As the disturbance stimulus to be specified, a tactile stimulus (α25: for example, a pressure sensor 523 attached to the handle), an olfactory stimulus (α26: by an olfactory sensor), or the like can be used in combination. Regarding disturbance estimation, indirect stimulation from the space surrounding the user, specifically, height (α27), distance (α28), depth (α29), and the physique of the passenger or passenger (α30), etc. It is also possible to do.

  Next, at δ5, a function selection process is performed. Here, in order to reduce the difference between the disturbance stimulus and the aptitude value, the hospitality functions (hospitality operation units) having higher priorities shown in the function selection tables 371 and 372 are adopted in order, and each hospitality operation unit is selected at δ6. This is the driving process. At this time, information relating to whether or not the content and level of the hospitality function that is actually selected is liked by the user is estimated from, for example, the output of the body state detection unit described above, or input information (like / It may be a direct input related to disagreement intentions, or may be inferred from an operation input that avoids disliked music or lighting) and is fed back to provide hospitality operation control It is also possible to give a kind of learning effect (ε5, ε6 and γ7).

  In addition, as a function selection determination element of a system different from this, the function state of the hospitality operation unit is determined (α31) and maintained as vehicle deterioration information (β8), and the function state contributes to either normal or abnormal It is possible to determine whether or not (γ8), positively adopt the function that contributes to normality, and perform processing to avoid the function that contributes to abnormality.

  In addition, it is important to increase the hospitality effect by determining the concept of hospitality operation according to the type of vehicle and the content that matches the image of the vehicle. For high-end cars, a smart hospitality production that is generally calm and can emphasize luxury is effective, and conversely, it can be said that a bright and lively production is appropriate for sports and leisure vehicles.

Hereinafter, representative examples of hospitality in individual scenes will be described.
FIG. 28 shows the flow of the hospitality operation process in the approaching scene SCN1. The theme is “encouragement to ride a car” in FIG. 2 and belongs to the expectation / stimulation genre ST1 according to the personality classification of the user (OBJ111; for example, the personality classification is “active SKC1” (FIG. 18). ) And those belonging to the Relax / Peace genre ST2 (OBJ211; for example, when the personality classification is “soft SKC2” (FIG. 18)).

  In S21 of FIG. 28, the approach direction of the user (that is, the terminal device 1) to the automobile is specified. On the automobile side, the direction of the automobile can be specified together with the position of the automobile from the position information by the GPS 533 and the history of changes in the traveling direction of the automobile leading to parking. Therefore, by referring to the position information of the user (from the GPS 554) sent from the mobile phone 1, whether the user is approaching the vehicle from, for example, the front side, the rear side, or the side, and the vehicle It is recognition of how far the user is approaching.

  Proceed to S22, and if the approach direction is from the front, proceed to S23 and select the front lamp group. As shown in FIG. 23, a headlamp 504, a fog lamp 505, and a cornering lamp 508 are used as the front lamp group in this embodiment. If the approach direction is from the rear, the process proceeds from S24 to S25, and the rear lamp group is selected. As shown in FIG. 24, as the rear lamp group, a tail lamp 507, a backup lamp 509, and a stop lamp 510 are used in this embodiment. In other cases, it is determined that the vehicle is approaching from the side, and the process proceeds to S26 to select a side lamp group. As shown in FIG. 25, a hazard lamp 506, a tail lamp 507, and an underfloor lamp 512 are used as side lamp groups in this embodiment.

  In S27, the distance between the car and the user is specified by the above method. If the distance between the car and the user can be specified, if the distance exceeds a first upper limit (for example, set to 20 m or more), the process proceeds to S29, and the long distance illumination mode is set. Moreover, if it exceeds the second upper limit value (for example, set to 5 m or more and less than 20 m), the process proceeds to S31 and the middle distance illumination mode is set. In other cases (that is, the second upper limit value or less), the process proceeds to S32, and the short distance illumination mode is set. When the user is farther from the car (that is, in order of short-distance illumination mode → medium-distance illumination mode → long-distance illumination mode), the total light quantity from each lamp (illumination) increases (when the beam angle is involved) , The amount of light that the user can see when standing in front of the illumination: For example, if the lamp is turned upward to make it a high beam, the amount of light that is visible will increase even if the intensity of the light source does not change from the low beam) The light emission operation of each individual lamp is controlled. This enhances the effect of lighting up the approach to the car and guiding the user to the car safely.

  FIG. 23 shows an operation example when the approaching direction of the user U is the front side. In the long-distance illumination mode, the headlamp 504 is turned on with a high beam, and in the intermediate-distance illumination mode, the amount of light is reduced as a low beam. That is, a method is employed in which the amount of visible light of the same lamp is changed by adjusting at least one of the light source intensity (adjustable by the drive voltage or the like) and the beam angle. On the other hand, in the short distance illumination mode, the fog lamp 505 or the cornering lamp 508 having a smaller light amount is switched. When the user U approaches from the front, the fog lamp 505 is turned on. When the user U moves toward the side of the vehicle, the corresponding side of the cornering lamp 508 is turned on.

  FIG. 24 shows an operation example when the approaching direction of the user U is the rear side. In the long distance illumination mode, all of the backup lamp 509, the tail lamp 507 and the stop lamp 510 are turned on, and in the middle distance illumination mode, only the tail lamp 507 and the stop lamp 510 are turned on to reduce the amount of light. That is, a method of changing the total light quantity by changing the number of lamps to be lit among a plurality of lamps is adopted. In the short-distance illumination mode, only the backup lamp 509, the tail lamp 507, or the stop lamp 510 is switched on. When the user U approaches from the rear center, only the tail lamp 507 (or only the stop lamp 510) is turned on. When the user U moves toward the side of the vehicle, the one on the corresponding side of the backup lamp 509 is used. Light up.

  FIG. 25 shows an operation example when the approaching direction of the user U is the side. In the long-distance illumination mode, all of the hazard lamps 506 and the plurality of underfloor lamps 512 are turned on. In the middle-distance illumination mode, only the hazard lamps 506 are extinguished to reduce the amount of light. In the short-distance illumination mode, only the lamps close to the user U among the plurality of underfloor lamps 512 are switched on. When the user U approaches from the center on the vehicle side, only the center underfloor lamp 512 is turned on, and when the user U moves in the vehicle length direction, the corresponding underfloor lamp 512 is switched on. As the user U approaches, the illumination angle of the underfloor lamp 512 may be changed to change the illumination area so as to guide the user U toward the automobile. In either case, in the short distance illumination mode, the room illumination 511 is also turned on to treat the user who tries to get into the car more politely.

  There is also a method of performing illumination with an illumination lighting pattern in the image of the destination facing from now. For example, if the destination is the sea, it is effective to light up with an illumination pattern reminiscent of a wave that gradually increases and then decreases the illuminance of blue illumination light.

  In addition, as a hospitality operation unit that can be controlled by a wireless command from the user terminal 1, for example, if peripheral equipment having a building-side illumination 1161 as shown in FIG. The operation of lighting up the vehicle by 1161 may be added to the hospitality operation. As shown in FIG. 27, in the long-distance lighting mode, the parking position becomes easier to understand by illuminating your car in the parking lot at night, and the effect of raising the feeling of the user before boarding by lighting up is also effective. Arise. On the other hand, in the middle-range or short-distance lighting mode, the area around the vehicle is widely illuminated, so the effect of guidance or assistance is enhanced, and foreign objects etc. on the user's route (foot) until getting into the vehicle Can be easily discovered.

The personality classification is determined by the following method, for example.
The user of the car registers in advance in a user registration unit 600 (for example, a ROM of the hospitality decision making unit 2 (preferably configured with a flash ROM so that it can be rewritten) as shown in FIG. 36. In the user registration unit 600, each user name (or user ID) and its personality type (see FIG. 18) are registered in association with each other. As will be described later, while the user continues to use the vehicle, it is acquired and accumulated as operation history information in a specific operation unit, and is estimated based on the accumulated operation history information. If the operation history information is insufficiently accumulated, such as immediately after, or if you want to estimate the personality type without collecting the operation history information, The information necessary to identify the rank classification information or the sex rating type information is input by the user himself may be determined character type on the basis of the input result.

  In FIG. 37, the personality type is displayed on the monitor 536 of FIG. 1 (the monitor of the car navigation system 534 may be substituted), and the user selects the personality type that suits him and inputs this from the input unit 529. . Here, the input unit is a touch panel overlaid on the monitor 536, and a selection input is made by touching the selection button 529B formed on the display. On the other hand, in FIG. 38, instead of directly inputting the personality type, a questionnaire is input for determining the personality type. Questionnaire questions are displayed on the monitor 536, and the user answers in the form of selecting an answer from the answer options (in this case, the options are configured with the selection button 529B, and the corresponding position on the touch panel 529 superimposed thereon is touched) Select input). By answering all the questions, one is uniquely determined from a personality type group determined in advance according to the combination of the answers.

  The user registration input including the user name is also made from the input unit 529 and stored in the user registration unit 600 together with the determined personality type. These series of inputs can also be performed from the mobile phone 1, and in this case, the input information is transferred to the automobile side by radio. In addition, when the user purchases a vehicle, there is a method in which the dealer side uses the input unit 529 or a dedicated input tool to perform user registration input in advance.

  Prior to using the car, user authentication is required. This is because, in particular, when a plurality of users are registered, different personality types are set depending on the users, and the contents of hospitality are also different. The simplest authentication method is a method in which a user ID and a personal identification number are transmitted from the mobile phone 1 to the vehicle side, and the hospitality decision-making unit 2 receives this and verifies the registered user ID and personal identification number. is there. In addition, biometrics authentication methods such as collation of facial photographs using a camera provided on the mobile phone 1, voice authentication, authentication using fingerprints, and the like can be employed. On the other hand, when the user approaches the car, only simple authentication using the user ID and the personal identification number is performed, and after unlocking, the user gets into the car and then the face camera 521, microphone 522, retina camera 526, iris described above. Biometrics authentication using the camera 527 or the vein camera 52 may be performed.

  When the user is authenticated and specified as described above, the personality type (user biometric information) corresponding to the user is acquired by the hospitality decision making unit 2, and the selection and operation pattern of the corresponding hospitality operation unit are selected. As described above, for example, if the specified personality type is “active SKC1”, the theme OBJ111 belonging to the expectation / promotion genre ST1 is selected, and if the specified personality type is “gentle SKC2”, relaxation / comfort is achieved. The theme OBJ211 belonging to the genre ST2 is selected. The process flow is exactly the same for other scenes.

  FIG. 7 shows a function selection table 371 corresponding to the expectation / exciting theme OBJ111, and the function priorities of exterior lighting, interior lighting, window shielding (power window), and car audio are high. In any case, in order to perform flashing, the setting value of the external lighting level for illumination by the outside lighting in the control aptitude value setting table 371a, the setting value of the inside lighting, the audio output level from the car audio system 515 and the mobile phone 1 ( Here, the musical sound levels relating to music output are all set high. The driving output levels of the lights 504 to 512 and the car audio system 515 of FIG. 1 are treated as hospitality so that the illuminance detection level of the illuminance sensor 539 of FIG. 1 and the sound pressure detection level of the sound pressure sensor 540 approach the above set values. It is controlled by the control unit 3. The audio output level of the mobile phone 1 is also set to a corresponding value by a radio command.

  On the other hand, FIG. 8 shows a function selection table 371 corresponding to the theme OBJ211 of the relaxation / comfort system. The function priority setting is the same as the expectation / pumping system, but the control aptitude value setting table 371a The setting value of the general lighting level, the setting value of the in-vehicle lighting, and the musical sound level are set lower than the expectation / exciting theme OBJ111, and a milder effect including lighting color and music selection is performed.

  The specific process is as follows. That is, when the user approaches to get into the car, the lighting device (FIGS. 23 to 25: reference numerals 504, 505, 507, and 509) differs depending on the acquired personality type (user biometric information). , 510, 511, and 512: all of which function as a lighting device that illuminates the appearance of the automobile (the interior light 511 also indirectly illuminates the appearance of the automobile with light leaking from the window)) It can be. When the expectation / exciting theme OBJ111 is selected, the amount of light emitted from the lighting apparatus involved in hospitality is increased or the number of blinks is increased, the headlamp 504 is turned into a high beam, the amount of light emitted from the red tail lamp 507 is increased, etc. , To produce a flashing up the user's approach to the car. On the other hand, when the relaxation / comfort system theme OBJ21 is selected, the lighting device involved in the hospitality is slightly reduced in lightness, and flashing of the lighting is avoided to gradually increase the amount of light gradually. Alternatively, the lighting is performed in the order of the side lamp 512 illuminating the foot, the interior lamp 511, and the head lamp 504 (to cause the car to rise slowly, and so on). If it is not adopted, changes in the overall lighting color can be obtained compared to the lighting style for “active” personality types, including headlamps and tail lamps, such as incandescent bulbs and halogen lamps. Instead of this, it is also possible to use a light emitting diode.

  Next, when the user approaches the vehicle, in addition to the lighting device as described above, a speaker (sound output unit) 311 provided in the mobile phone 1 (user side terminal device) should be used as a hospitality operation unit. You can also. In this case, the communication device 4 on the automobile side detects the approach of the mobile phone 1, that is, the user, and the speaker 311 with different output contents according to the personality type corresponding to the user (that is, the acquired user biometric information). The voice for hospitality is output. In the present embodiment, the voice data for hospitality is music source data, but it may be data of sound effects or human voices (so-called incoming voices or incoming voices). As shown in FIG. 1, the voice data for hospitality may be stored in a storage device 535 on the automobile side, and necessary data may be distributed to the mobile phone 1 via the communication device 4 or portable. Either may be stored in the sound data flash ROM 316 on the telephone 1 side. Here, the latter case will be described as an example.

  First, when a user is authenticated and specified, a personality type corresponding to the user is specified, and a list of hospitality voice data IDs stored in the sound data flash ROM 316 is acquired wirelessly from the mobile phone 1. Next, music source data corresponding to the specified personality type is selected from the list. Here, a plurality of music source data having different song mode codes are selected in order to perform a process that increases as the user approaches (here, a case where MIDI data is used is taken as an example).

  Here, as in the above-described hospitality process with illumination, different effects are performed according to the distance (the process flow is the same as in FIG. 28). Corresponding to the user's mental state elevation, an order corresponding to the music mode code is set, and the music selection is performed so as to increase the spirit of elevation as the distance gets closer. Specifically, the closer to the car, the higher the mental state elevation, and the song mode code when approaching the user is "Healing / α wave system" or "Warm / Healing system" (for long distance) → The order is determined in the order of “exhilarating system” (for medium distance) → “lifting system” (for short distance). However, depending on your preference, it is of course possible to reverse the above order so that you get excited at first and calm down as you get closer to the car.

  First, as shown in FIG. 31, in the long-distance hospitality mode, the music source data ID (song ID) having the song mode code of “Healing / α wave system” or “Warm / Healing system” is transmitted to the mobile phone 1. (S201). The mobile phone 1 selects music source data corresponding to the ID and starts playing (S202). Next, in the medium distance hospitality mode shown in FIG. 32, the music source data ID (music ID) having the music mode code “exhilarating” is transmitted to the mobile phone 1 (S210). Then, the mobile phone 1 selects music source data corresponding to the ID and starts playing, and as described above, the vibrator unit 354 and the LED unit 315 are synchronously driven with music to further enhance hospitality by sound output. (S211). Further, the lighting device on the automobile side may be blinked in conjunction with music (S212).

  When the user finally approaches the point of getting into the car, the short-distance hospitality mode shown in FIG. 33 is entered, and the climax of the climax is performed. That is, in S220 to S222, the processing is almost the same as that in the medium-distance hospitality mode, but the music source data is selected from the “rising system”. On the other hand, the music source data having the same ID is selected on the automobile side, and the performance in the car audio system 515 is started. In this case, if the power window is activated to open the window and output in synchronization with the performance of the mobile phone 1, the excitement effect can be further enhanced (S223). At this time, on the automobile side, if the pitch code of the main melody portion of the MIDI data is changed to be lower (or higher) by the frequency of forming the harmony pitch than the main melody portion of the mobile phone 1 side, and output, The output of the mobile phone 1 and the output of the car audio system 515 can be added, and the output timing of the main melody portion of the MIDI data is delayed (or advanced) by a fixed number of beats relative to the main melody portion on the mobile phone 1 side. If the output is changed as described above, it is possible to achieve a singing effect between the output of the mobile phone 1 and the output of the car audio system 515.

  In S224, the heart rate sensor 342 of the mobile phone 1 reads the user's heart rate, and the tempo code of the MIDI data is changed so that the tempo increases in proportion to the heart rate. Thereby, the music to be output is uptempoed in accordance with the heartbeat of the user, and the excitement effect is further enhanced. It should be noted that in the relaxation / relaxation theme OBJ21, it is possible not to perform the last flashy uplifting process for short distances.

  As shown in FIG. 2, in the approach scene SCN1, in the anxiety / tension elimination genre ST3, “I want to know the position of a car (OBJ311)” and “Confirmation of forgotten / closed doors (OBJ312)”, in the physical burden reduction genre ST4 Each theme of “I want to load cargo smoothly (OBJ311)” is defined. The hospitality processing of these themes is executed in parallel with the hospitality processing of the themes OBJ111 to OBJ211 for enhancing feelings. FIG. 11 shows the contents of the function selection table 372 corresponding to the theme “I want to know the position of a car (OBJ311)”. The car-side GPS 533, the mobile phone 1, the mobile phone-side GPS 554, the horn 502, and the exterior lighting (or Car interior lighting) is selected as the hospitality operating part. Specifically, for example, the position information of the car-side GPS 533 is notified to the mobile phone 1 side, and the map is displayed on the monitor 308 (FIG. 14) together with the position information of the mobile phone-side GPS 554, and the relative position between the user and the car. To be able to grasp. Further, when the user approaches the vehicle at a predetermined distance or less, the position of the vehicle is directly notified to the user by blowing the horn 502 and lighting the vehicle exterior light (or vehicle interior light).

On the other hand, in the “confirmed thing / door lock confirmation (OBJ312)”, a message for prompting caution confirmation before departure (voice data can be stored in the ROM of the hospitality execution control unit 3 and the audio output hardware of the car audio system Can be used for output processing). Examples of messages that prompt attention confirmations include the following: “Is my license and wallet OK?”
・ (If the destination set in the car navigation system is an airport) “Did you have a passport?”
・ Did you lock the entrance door?
・ "Is the back window open?"
・ Did you turn off the air conditioner in the room?
・ Did you tighten the gas mains?

  Next, the hospitality process in the boarding scene SCN2 can be basically implemented as an extension of the process in the approach scene SCN1 (FIG. 2, OBJ121, OBJ222). That is, if the user gets into the car and the seating sensor 520 detects the user, the hospitality execution control unit 3 wirelessly transmits a performance stop command to the mobile phone 1. This completes the hospitality operation on the mobile phone 1. On the other hand, as for the theme of hospitality of the anxiety / tension relief genre ST3, “I want you to make the interior comfortable” (OBJ311: For example, keep the interior at a suitable temperature by operating the air conditioner in advance etc.) “Securing and trouble avoidance” (OBJ322). This can be achieved not only by the foot illumination by the underfloor lamp 512 of FIG. 1 but also by the obstacle suppression mode function of the obstacle and the door by the door assist mechanism 541 of FIG. Further, regarding the hospitality theme “I want to get into comfortably” (OBJ 421) of the physical burden reduction genre ST4, the door opening / closing operation can be reduced by the basic operation of the door assist mechanism 541. Since details of the operation of the door assist mechanism 541 have been described, they will not be repeated here.

  Also, in the theme “I want to load my baggage easily” (OBJ422), for example, when the user holds large baggage with the camera 518 for outside the vehicle, the user does not assist the user in opening the door, but automatically to a certain position. The door is opened with, and the door operation itself is not necessary, so that the baggage can be loaded. It is also effective to assist loading by informing the position of the trunk room or automatically opening the cover.

  Next, the preparation scene SCN3 and the driving / staying scene SCN4 are executed from the approaching scene SCN1 and the boarding scene SCN2 in the themes (OBJ131, OBJ141, OBJ231, and OBJ241) of the expectation / rising genre ST1 and the relaxation / relaxation genre ST2. The operation of the car interior lighting 511 and the performance of the car audio system 515 in the car are continued, except for the change to the illumination color / pattern and music selection (or volume) adapted to the scene. In preparation scene SCN3, in order to calm down, lighting with reduced light intensity and exhilarating system ST3 or mild / healing SF selection in FIG. Therefore, an operation such as increasing the amount of illumination light and switching to the music selection of energizing / energizing AG can be exemplified.

  FIG. 9 shows a setting example of the function selection table 371 relating to themes OBJ131 and OBJ141 of the expectation / excitement genre ST1. A closing operation, a noise canceller, a car audio system, and a video output device such as a DVD player are selected as the hospitality operation unit. Regarding the reduction of the noise level in the vehicle, the operation of the noise canceller 1001B shown in FIGS. 44 and 45 contributes greatly to the deadline of the window due to the closing operation of the power window. As described above, the noise canceller 1001B leaves the specified necessary sound such as the car audio system 515, in-car conversation, or the necessary outside sound (emphasis sound) to be recognized as caution or danger by setting the adaptive filter. Because other noise components are canceled out, the music can be heard in a quieter environment, and the necessary outside sound is not missed.

  In the control suitability value setting table 371a, the interior lighting level and the musical sound level are set relatively high. When targeting young people who originally prefer a noisy environment, noise in the car, such as wind noise, may contribute to the creation of the car's atmosphere, and there are more or less limitations with regard to picking up the necessary outside sound with an adaptive filter. Therefore, as the musical tone level in the vehicle is set higher, the reduction level of the noise level (the higher the value, the quieter it is) is somewhat suppressed. Note that the control of the musical sound level to the set value can be performed by adjusting the output volume of the car audio system 515 so that the detection level of the sound pressure sensor 540 in FIG. 1 approaches the target value. On the other hand, the control of the noise level to the set value can be performed by setting the target value level of the unerased noise component detected by the error detection microphone 2012 in FIG. 44 to a finite value indicating the desired noise level instead of zero. .

  FIG. 10 shows a setting example of the function selection table 371 related to each theme OBJ231, OBJ241 of the relaxation / relaxation genre ST2. The selection content of the hospitality operation unit is the same as that of the expectation / excitement genre ST1, but the illumination level and the musical sound level are set lower than the expectation / excitement genre ST1, and conversely the degree of noise level reduction is increased.

  Note that if the music performance in the approaching scene SCN1 and the boarding scene SCN2 is based on MIDI, it is not easy to enjoy music in earnest. Therefore, the performance using the MPEG3 music database 515c (FIG. 17). Switch to. In this case, the hospitality decision making unit 2 (FIG. 1) selects music source data corresponding to the personality type of the user.

  However, if the user does not like the song automatically selected by the hospitality decision making unit 2, the user can switch the performance to a favorite song at any time by an input from the operation unit 515d. When the user selects a song by himself / herself, as shown in FIG. 20, the specific information (user name or user ID) of the user, the ID of the selected music source data, and the aforementioned hospitality reference data RD (personality type code) , Age code, gender code, genre code, and music mode code) are stored in the music selection record storage unit 403 (formed in the storage device 535 in FIG. 1) in a form associated with each other. In this embodiment, the date and time of music selection, the user's sex and age are also stored.

  As shown in FIG. 21, in the music selection record storage unit 403, statistical information 404 of the music selection record is created for each user. In this statistical information 404, the music selection data is counted for each personality type code (SKC), and which personality type of music is selected most frequently is specified as a numerical parameter. As the simplest process, it is possible to specify the personality type having the highest frequency of music selection as the personality of the user. For example, if the number of track selections accumulated in the statistical information 404 reaches a certain level, for example, the personality type initially set by user input is replaced with the personality type derived from the statistical information 404 as described above. That's fine.

  By the way, the classification of personality of users is actually more complicated, and the taste of music is not so simple that it can be uniformly pushed into the same personality type. Also, it may easily change in the short term depending on the living environment (whether it is fulfilled or stress is accumulated) where the user is located. In this case, it is not strange that the taste of music fluctuates and the personality type derived from the statistics may also change. In this case, as shown in FIG. 21, if the statistics of the music selection results are not collected retroactively but limited to the most recent period (for example, 1 to 6 months), the statistics information 404 of the music selection results is created. In addition, short-term fluctuations in personality types can be reflected in the statistical results, and the hospitality content by music can be changed flexibly according to the user's condition.

  Also, even the same user does not always select music of the same personality type, and may be selected across music of other personality types. In this case, if the music is selected only from the personality type having the highest frequency of music selection, there may be a situation that is not always desirable in order to change the mood of the user. Therefore, a method is adopted in which the music selection probability expectation value to be assigned to each personality type is assigned according to the music selection frequency indicated by the statistical information 404 and randomly selected from each personality type in a weighted form according to the expected value. You can also. In this way, the music source that the user is more or less interested (ie, selected music) is preferentially selected from those with a high frequency of selection across multiple personality types, and occasionally other than your personality type You will be able to receive hospitality with the music of this, which will make you feel better. Specifically, a random number table composed of a certain number of random values is stored, and the number of random values assigned to each personality type is distributed in proportion to the music selection frequency. Next, it is possible to specify a personality type to be selected by generating a random number using a well-known random number generation algorithm and checking which personality type the obtained random number value is a random value assigned to. Become.

  In the statistical information 404, the frequency of music selection by music genre (JC), age (AC), and gender (SC) is also counted. The music source data belonging to the genre, age group or gender can be configured to be preferentially selected. If it does in this way, it will become possible to perform the hospitality music selection which matched by a user preference. A plurality of personality types can be assigned to one music source data.

  FIG. 30 is a flowchart showing an example of the process. When the music selection frequency statistics for each personality type are obtained as shown in FIG. 21, as shown in the lower part of FIG. 30, the random number values on the random number table are allocated to each personality type in proportion to the individual music selection frequency. . Next, in S108 of the flowchart, one arbitrary random number value is generated, and a personality type code corresponding to the acquired random number value is selected on the random number table. Next, in S109, the one corresponding to the personality code is selected from the lighting control data group of FIG. In S110, the music source data corresponding to the genre, age group, and sex with the highest frequency of music selection in FIG. 21 are extracted from the music source data corresponding to the acquired personality type code (of course, the personality is also used here). As in the case of determining the type, the genre, age group, and gender related to the music selection may be selected by a random distribution according to the frequency of each genre, age group, and gender). If there are a plurality of extracted music source data, one music source data ID among them may be selected by random numbers as in S111, or a list of music source data may be displayed on the monitor 536 ( As shown in FIG. 1, the user may manually select the operation unit 515 d (FIG. 17). In this way, lighting control of the lighting device in the automobile while the user is driving (or the user is staying) is performed according to the selected lighting control data, and music performance based on the selected music source data is transmitted to the car audio system. It is done.

  Hereinafter, other hospitality themes assigned to the preparation scene SCN3 and the driving / staying scene SCN4 will be described. The theme “I want to know the state of my destination / way” is a theme that is set across both scenes. For example, on the preparation scene SCN3 side (OBJ331), as shown in the function selection table 372 of FIG. The vehicle-side GPS 553 and the car navigation system 534 are selected as the hospitality operation unit, and in accordance with the destination setting, the situation on the road or on the road is acquired via the wireless communication network and displayed on the monitor of the car navigation system 534. Is called.

  In the driving / staying scene, the personality type of the user can also be estimated using information other than the music selection performance of the music source. For example, operation performance data for each user can be accumulated, and the personality type of the user can be specified based on the analysis result of the operation performance data. Specific examples thereof will be described below. As shown in FIG. 22, an operation that is easily performed when the user feels stress during driving is determined in advance as a stress reflection operation, the corresponding stress reflection operation is detected by a corresponding detection unit, and the detection result is reflected in the stress. Store / accumulate in the operation statistics storage unit 405 (FIG. 1: in the storage unit 535). And based on the accumulation result, the personality type of the user is estimated. The embodiment described below focuses on how to suppress the influence of personality factors that are undesirable in driving a car.

  In this embodiment, the stress reflection operation is a horn operation (i.e., irritates a horn), the number of times of braking (too much space between the cars, etc., and the brakes are stepped on), the number of lane changes (let's overtake the previous car) The lane is frequently changed: winker operation + steering wheel operation angle after the winker operation is detected (if the steering wheel operation angle is below a certain level, it is regarded as a lane change) is selected, and the horn switch 502S, The brake sensor 530, the blinker switch 502W, and the angular velocity sensor 532 function as a stress reflection operation detection unit. As each operation occurs, the corresponding counter in the stress reflecting operation statistics storage unit 405 counts up and the number of times is recorded. It can be said that these operations reflect the orientation toward “dangerous driving”.

  Further, the traveling vehicle speed is detected by the vehicle speed sensor 531, the acceleration is detected by the acceleration sensor 532S, and the average speed VN and the average acceleration AN are calculated and stored in the stress reflecting operation statistics storage unit 405. The average acceleration AN is averaged only during a period in which acceleration of a certain level or more in the increasing direction is detected, and a low-speed traveling period with little acceleration fluctuation is not incorporated in the average value calculation. By doing so, the value of the average acceleration AN is a value reflecting whether or not it is preferable to step on the accelerator or take a sudden start with overtaking. Further, the travel distance is calculated from the output integrated value of the vehicle speed sensor 531 and stored in the stress reflection operation statistics storage unit 405.

  Furthermore, the stress reflection operation statistics are created separately for the general road section and the highway section (the identification is possible by referring to the travel information from the car navigation system 534). In other words, when driving on a highway, if it is flowing smoothly, users who normally drive should be less likely to blow horns, step on brakes, or change lanes. This is because the number of reflection operations detected should be added with higher weight than the general road section. Further, since the average speed and the average acceleration are inevitably higher than those of the general road section, the influence can be mitigated by taking statistics by distinguishing the general road section and the highway section as described above.

  An example of the personality determination algorithm using the stress reflection operation statistics is shown below, but is not limited thereto. First, with respect to the number of horns Nh, the number of brakes NB, and the number of lane changes NLC, each value in the general road section (indicated by the suffix “O”) and the expressway section (indicated by the suffix “E”). Are multiplied by weighting coefficients α and β (where α <β: either coefficient may be fixed to 1 and the other coefficient may be displayed as a relative value), The divided value is calculated as the number of conversions (indicated by the subscript “Q”). On the other hand, the average speed and the average acceleration are similarly calculated as the converted average speed and the converted average acceleration by adding the values in the general road section and the values in the highway section by multiplying by the weighting factor. A value obtained by adding all of them is obtained as a personality estimation parameter ΣCh, and personality estimation is performed according to the value of the ΣCh.

  In this embodiment, the range of the value of ΣCh is divided into a plurality of sections by predetermined different boundary values A, A2, A3, and A4, and a personality type is assigned to each of the sections. Then, the reduction coefficients δ1, δ2, and δ3 (all greater than 0 and less than 1) are defined in association with the section to which the calculated ΣCh value belongs. An example of the flow of a specific personality analysis process using this is shown in FIG. As described above, the user is authenticated in S101, and the music selection record data 403 in FIG. 20 is acquired in S202. In step S103, the music selection statistics information 404 shown in FIG. 21 is created. Next, in S104, the information (running performance data) accumulated in the stress reflecting operation statistics storage unit 405 of FIG. 22 is read, and in S105, the value of ΣCh is calculated by the above method, and the corresponding personality type is determined. Specify the reduction coefficient δ. In S106, the most frequently used personality type is identified from the music selection record statistical information 404, and the apparent frequency is reduced by multiplying this by the reduction coefficient δ. As a result, for example, when a result that increases ΣCh is obtained in an “active” user, the direction toward dangerous driving that increases ΣCh is increased because of the “active” personality. This means that the frequency of music selection that boosts this can be suppressed by multiplying by the reduction factor δ, leading to safe driving. In addition, when a result that ΣCh is low is obtained for “adult” users, the music selection frequency corresponding to “adult” is suppressed by multiplying by the reduction factor δ, and the active music selection frequency is relatively Therefore, it is possible to enhance the safety by giving a moderate stimulus to the user and sharpening the driving.

  Next, in order to entertain the user properly, it is necessary to consider mental state and physical condition as well as personality. In other words, if the mental state is elevated, or conversely, it appears as some biological reaction in the user's body. The same applies when there is physical condition or fatigue. In the present embodiment, the infrared sensor 519, the face camera 521, the microphone 522, the pressure sensor 523, the pulse sensor 524, and the body temperature sensor 525 of FIG. 1 are used as a body state detection unit that detects a user's biological state. Since the body state detection unit captures the user's biological reaction from various angles, the hospitality decision-making unit 2 estimates the user's mental state and physical condition from the detected information, and performs the hospitality operation in a form adapted to this. To.

  The body state detection unit includes at least a facial expression of the user (face camera 521), body movement (face camera 521, pressure sensor 523), body temperature (infrared sensor 519, body temperature sensor 525), and heart rate (pulse sensor 524). Any one (that is, some of these may be omitted depending on the required accuracy) is detected. The facial expression information is obtained from a still image of the face taken by the face camera 521, and as shown in FIG. Compared to the master image in, whether the user is angry, calm, in a good mood (for example, fun and excited), in a bad mood (for example, discouraged or sad), or anxious You can determine whether you are under tension. Also, instead of using a master image unique to the user, the facial contour, eyes (or iris), mouth and nose positions and shapes are extracted as facial feature values common to all users, and the feature values are extracted. Can be compared with standard feature values measured and stored in advance in various psychological states or physical conditions. In addition, it can also be used for specification of a user's personality type by classifying and collating face types according to personality from the above facial feature quantities.

  The movement of the body includes a moving image of the user (for example, moving in small steps, frowning, etc.) taken by the face camera 521, a detection state of the pressure sensor 523 (for example, frequently releasing the hand from the handle) ) Or the like, for example, it can be determined whether the driving user is frustrated or not.

  The body temperature can be detected and specified by a body temperature detection unit such as a body temperature sensor 525 attached to the handle or a thermography of a face acquired by the infrared sensor 519. When feelings are uplifted, nervous, excited or angry, etc., the body temperature appears high, and conversely, when calm, the body temperature appears low. Further, tension and excitement can be detected by increasing the heart rate detected by the pulse sensor 524.

  Apart from the mental state, body temperature also appears high depending on the physical condition such as when ill or tired. To determine whether the high body temperature is due to mental state or physical condition, body state information other than body temperature, such as facial expression (face camera 521) and body movement (face camera 521, pressure sensor 523). It is effective to combine with. In addition, the body temperature is constantly high in the case of poor physical condition, whereas the body temperature rise when it becomes tense, excited or emotional is temporary, so it is determined by analyzing the trend of body temperature change according to time Sometimes you can. In addition, by registering the user's normal heat in advance and measuring the temperature shift from that normal temperature (especially on the high temperature side) with the body temperature detection unit, it is possible to detect more subtle changes in body temperature and thus the emotional movement caused by it. Is possible.

  Regarding the hospitality control based on the detection information of the body state detection unit, a great many specific examples can be considered. For example, in the theme “appropriate driving environment setting” OBJ 441 in FIG. 2, as shown in the function selection table 373 in FIG. 13, the car navigation system 534 (for video output), the car audio system 515, the air conditioner 514, the interior lighting 511, and the steering wheel adjustment The unit and the seat adjustment unit are selected as the hospitality operation part, and as described above, the music selection is changed according to the mental state and physical condition of the driver (user), the set temperature of the air conditioner, the lighting color or lighting in the car Adjust the strength. In addition, the handle adjustment unit and the seat adjustment unit automatically adjust the position of the handle, the front / rear position of the seat, the angle of the backrest, etc. by the motor operation.For example, when it is determined that the feeling of tension is weakened, Raise the back and raise the seat, or raise the handle so that you can concentrate on driving. When it is determined that the user is tired, it is effective to finely adjust the angle of the backrest in such a direction that the user's movement showing discomfort is calmed down.

In addition to the above, there are the following modes (in parentheses indicate suitable body state information).
・ When it is judged that you are feeling too high, or when you feel that you are feeling angry or stressed (facial expression, body movement, body temperature): play quiet and comfortable music and calm down I will let you.
・ When the driver falls into an unpleasant mental state (facial expression, body movement) when overtaking, interrupting, passing, horning, etc., from the following vehicle: “What a shame. "I love you as an adult."
・ When the speed exceeds or is about to exceed due to tension or emotional enhancement (facial expression, body temperature): “Let's go slowly. You are safe driving. For example, a message prompting speed suppression is output as a voice.
・ If fatigue or illness (such as fever) is observed: Safe driving such as speed control, stopping / resting is encouraged. When the railroad crossing or red signal is approached, caution information is output as a voice. In the worst case, notifications of driving suspension etc. are given by voice output or monitor display.
・ If you are feeling depressed (facial expression, body temperature): Play good music or change the lighting to something red or other exciting ones to boost your mood.

  In this case, the mental / physical condition information can be defined as specifying the mental state or physical condition of the user as one of a plurality of predetermined physical conditions / mental levels. Further, the hospitality operation information storage unit can store the hospitality operation information that defines the operation content of the hospitality operation unit in association with a plurality of physical condition / mental levels. Thereby, the hospitality control unit reads out the hospitality operation information corresponding to the acquired physical condition / mental level from the hospitality operation information storage unit, and controls the operation of the hospitality operation unit based on this. The algorithm of hospitality control can be greatly simplified by performing stepwise level setting on the user's physical condition / mental state that originally changed in an analog manner. In the following, an explanation will be given by taking as an example the selection of hospitality music performed during driving.

  The personality type code described above provides a music source having a personality type code that matches the personality of the specified user, such as the personality type code of the music source to be selected. Used in a matching form. On the other hand, for the song mode code, the song mode assigned to the music source is not necessarily used to match and match the mental state and physical condition of the specified user. For example, it is used to set a certain mental state as a target value and to bring the user's mental state closer to this, such as selecting a mild / healing or healing / α wave music source. If the user's mental state elevation can be parameterized, the music mode code is also set in order corresponding to this, and the music selection control is performed so that the song mode code corresponding to the mental state elevation parameter is selected. be able to. Specifically, when it is determined that the mental state of the user is higher the higher the value of the mental state elevation parameter, the “rising system”, “exhilaration system”, “warm / healing system”, “healing / healing system” If you select a song mode code that is located at the lower part of the rank, the higher the value of the mental state elevation parameter is, the calmer it is if you feel too high When the song is selected, and when it is depressed, the song mode code is selected so that the song is selected so as to raise the mood. In the former case, the effect of suppressing excessive speed due to mood excitement, etc. is obtained, and in the latter case, the user's arousal is promoted and the driver's attention is improved. Contributes to driving. On the other hand, when the physical condition level is deteriorated, it can be said that it is desirable not to perform extreme music selection that causes the user to get tired as much as possible regardless of the above mental state.

Hereinafter, an example of specific processing will be described.
As shown in FIG. 34, the mental state of the user is divided into three levels of anger, anxiety / tension, and stability, and these mental states are classified into face camera images and detection levels of heart rate, body temperature, and handle gripping force. Levels are uniquely associated. For the mental state level, the one that occupies the most of the mental state levels indicated by each detection content is adopted, or the detection level is expressed in numerical steps (1, 2, 3), and the average value is rounded off. To decide. The music mode code of FIG. 18 is uniquely associated with each mental state level. In this embodiment, “anger / healing” (SF) corresponds to “anger”, “exhilaration” (ST) corresponds to “anxiety / tension”, and “healing / revitalization” (AG) corresponds to stability. Attached (first setting).

  When using the car navigation system 534, when heading to a destination farther than a certain distance, the driver's tiredness is added on the way home, so the song mode code corresponding to make the driving calmer than going It can be set to lower the level (second setting). In FIG. 34, regarding “return”, “healing / α wave system” (HL) for “anger”, “mild / healing system” (SF) for “anxiety / tension”, “exhilaration system” (ST) for stability. ) Are associated.

  FIG. 35 shows a flowchart of the process. In S501, it is determined whether to go or return, and in S502 and S503, the music mode code is set to a corresponding level. In S504, the detection state of the body state detection unit is read, and the mental state is determined in S505 and S506. In the case of “stable state”, the processing of S507 is performed, in the case of “tension / anxiety”, the processing of S508 is performed, and in the case of “anger”, the processing of S509 is performed. Music performance is performed with music selection corresponding to each mental state (the personality type is determined separately by the above-described method, and the music selection corresponding to the mental state is performed in the music source group corresponding to the personality type). Note that, along with music performances, room lighting and air conditioner adjustment are also controlled in a form corresponding to each mental state. For example, in the case of “going” in the “stable state”, in addition to the performance music (AG), the red lighting is used and the room temperature is set to be slightly higher. In order to relax, “return” is performed with a refreshing amber system in addition to the performance of refreshing (or stable) music, and the room temperature is set a little lower than the going.

  In the case of “going” and “tension / anxiety”, in order to relax, in addition to playing exhilarating (or stable) music, the lighting is a calm amber system, and the room temperature is set slightly lower than the going. In “Return”, in addition to the performance of healing music (SF), white lighting is used, and the room temperature is further lowered. And if it is “going” or “angry”, it is necessary to cool down as soon as possible. In addition to playing soothing music (SF), use white lighting and use air conditioning to further increase the room temperature. Lower. “Return” uses music as a healing system (HL) and switches to blue lighting, but to prevent fatigue, the temperature is higher than “going” and “angry” so that the temperature does not drop drastically. Set to.

  Returning to FIG. 2, the following hospitality operations are possible in the getting-off scene SCN5 and the leaving scene SCN6. For example, in the theme “I want you to increase your sense of arrival at your destination” (OBJ151, OBJ161, OBJ251, OBJ261), you can aim for the arrival of the user with music and lighting suitable for the destination. "Let's play and have fun!" In addition, in the theme “Check for lost items / getting off” (OBJ351), it is possible to output a message for forgetting items in the car and for preventing infants from leaving the car (this operation is performed using the mobile phone 1) It can be continued with SCN6). In “OBJ351” and “OBJ351, OBJ551” for getting off safely and avoiding trouble (OBJ351), as with getting on, the door assist mechanism 541 assists in opening and closing the door, and the collision suppression mode between the obstacle and the door. Function can be activated. Even in a leaving scene, the operation of the outside camera 518 is used to monitor the traffic conditions around the vehicle, and when the oncoming vehicle or the following vehicle is approaching the user, the mobile phone 1 is used to call attention. It is possible to output a message.

The block diagram which shows an example of an electrical structure of the user service system for motor vehicles of this invention. The schematic diagram which shows an example of the hospitality decision-making table. The flowchart which shows the flow of a scene determination process. The flowchart which shows the flow of hospitality main processing. The schematic diagram which shows the content of a scene flag. The figure which shows the concept of a theme-specific application library. The figure which shows the 1st example of a function selection table. The figure which shows the 2nd example of a function selection table. The figure which shows the 3rd example of a function selection table. The figure which shows the 4th example of a function selection table. The figure which shows the 5th example of a function selection table. The figure which shows the 6th example of a function selection table. The figure which shows the 7th example of a function selection table. The external appearance perspective view which shows an example of the user side terminal device comprised as a mobile telephone. The block diagram which shows an example of the electrical constitution of a user side terminal device. The block diagram which shows an example of the electrical structure of vehicle interior lighting. The block diagram which shows an example of the electrical constitution of a car audio system. The conceptual diagram which shows the content of a music source database. The conceptual diagram which shows the structural example of the lighting control data of an illuminating device. The conceptual diagram which shows the content of the music selection performance memory | storage part. The conceptual diagram which shows the content of the statistical information of a music selection track record. The conceptual diagram which shows the content of the stress reflection operation statistics memory | storage part. The schematic diagram which shows the 1st example of hospitality operation | movement when a user approaches a motor vehicle. The schematic diagram which similarly shows a 2nd example. The schematic diagram which similarly shows a 3rd example. The schematic diagram which similarly shows a 4th example. The schematic diagram which similarly shows a 5th example. The flowchart which shows the flow of a process of the hospitality operation | movement when a user approaches a motor vehicle. The flowchart which shows the flow of a personality analysis process. The flowchart which shows an example of hospitality source determination processing. The flowchart which shows the flow of a process in the long distance hospitality mode by music. The flowchart which similarly shows the flow of a process in medium distance hospitality mode. The flowchart which similarly shows the flow of a process in short distance hospitality mode. The schematic diagram which shows the example of mental state / physical condition estimation using the detection information from a body state detection part, and the determination of a music mode code. The flowchart which shows an example of the hospitality process during driving | running | working. The conceptual diagram which shows the content of user registration information. The schematic diagram which shows the 1st example of the input method of character classification determination. The schematic diagram which shows the 2nd example of the input method of character classification determination. The circuit diagram which shows an example of the illuminating device using a light emitting diode. Explanatory drawing of the mechanical component part of a door assist mechanism. The circuit diagram of a door assist mechanism. The schematic diagram which shows the structural example of the door rotation lock mechanism for obstacles. FIG. 42 is an operation explanatory diagram of the door assist mechanism of FIG. 41 in a normal state. The conceptual block diagram which shows the structural example of a noise canceller. The block diagram which similarly shows an example of a hardware configuration. The flowchart which shows the whole flow of the hospitality process in the user service system for motor vehicles. The flowchart following FIG. The flowchart following FIG.

Explanation of symbols

1 Mobile phone (user terminal device)
2 Hospitality decision-making part (scene identification means)
3 Hospitality execution control unit 4 Communication device (host side communication means)
311 Speaker (Audio output unit)
323 Terminal-less communication device 350 Scene flag (current scene specifying information storage means)
502-517, 534, 541, 1001B Hospitality operation unit 515 Car audio system 515b, 515c Music source database (hospitality operation information storage unit)
515d operation unit (music selection unit: user biometric information acquisition means)
520 Seating sensor (scene estimation information acquisition means)
535 storage device (hospitality operation information storage unit, song selection result storage unit)
537 Door courtesy switch (scene estimation information acquisition means)
538 Ignition switch (scene estimation information acquisition means)
504 to 512 Lighting device 511 Indoor lighting (lighting device)
532 GPS (approach detection means)
554 GPS (approach detection means)
521 Face camera (body state detection unit)
523 Pressure-sensitive sensor (body state detection unit)
519 Infrared sensor (body state detector)
525 Body temperature sensor (body condition detector)
524 Pulse sensor (body state detection unit)
1170 Wireless communication network

Claims (5)

Access to the user's car, ride operation, a plurality of performing getting off and away from the car, at least one of, for aiding the use of a motor vehicle by the user, or a hospitality operation to entertain the user comprising a hospitality operation portion, while a plurality of the hospitality operation, the user hospitality theme for generally in accordance with the directivity of hospitality wants the is defined more in advance a plurality of the hospitality operation is being prepared for each of the themes ,further,
And user status information acquiring means for acquiring user status information, based on the content of the user status information, the hospitality theme determination unit to select a 1 or more of the plurality of the hospitality themes, each hospitality theme selected A hospitality operation selection means for collectively selecting a plurality of the hospitality operations to be controlled, and a hospitality decision making unit;
A hospitality execution control unit that performs control to cause the corresponding hospitality operation unit to execute the selected hospitality operation , and
A series of operations related to the use of the vehicle by the user until the user approaches the vehicle, gets into the vehicle, drives the vehicle or stays in the vehicle, and then gets off the vehicle. Divided into a plurality of divided scenes, and the hospitality theme is defined for each of the divided plurality of scenes,
The user status information acquisition means includes scene estimation information acquisition means for acquiring, as scene estimation information, the position or motion of the user predetermined for each scene, and the individual scenes based on the acquired scene estimation information. And a scene specifying means for specifying
The theme determining means selects a hospitality theme corresponding to the identified scene,
Current scene specifying information storage means for storing and holding current scene specifying information for specifying the current scene is provided. The scene specifying means grasps the current scene based on the stored contents of the current scene specifying information, and On the premise of grasping the scene, when the user position or motion peculiar to the subsequent scene is detected by a predetermined scene estimation information acquisition unit, it is determined that the subsequent scene has been moved, and the subsequent scene An automobile user hospitality system characterized in that specific information is stored in the current scene specific information storage means as the current scene specific information . The hospitality decision-making unit includes user biometric information acquisition means for acquiring user biometric information including at least one of the user's personality, mental state, and physical condition, and a plurality of the hospitality operations prepared for each hospitality theme 2. The automobile user hospitality system according to claim 1, further comprising: a hospitality content determining unit that changes each execution content of the first character in accordance with the content of the acquired user personality information or mental / physical condition information. A two or more of the plurality of the hospitality theme, is a reciprocal oriented theme determined corresponding to opposite hospitality oriented to each other of the user, the hospitality theme determination means, the user biometric characteristic information obtaining means obtains wherein depending on the content of the user character information or spirit / physical condition information, automobile users hospitality system according to claim 2 for determining whether to select one of said reciprocal oriented themes.   A plurality of hospitality operations to assist the user in using the vehicle or to entertain the user in at least one of approaching the user, getting on, driving, getting off and leaving the vehicle A plurality of hospitality themes, and a plurality of the hospitality operations are prepared in advance for each theme. ,further,
  User status information acquisition means for acquiring user status information, hospitality theme determination means for selecting one or more of the hospitality themes based on the contents of the user status information, and each of the selected hospitality themes A hospitality operation selection means for collectively selecting a plurality of the hospitality operations to be controlled, and a hospitality decision making unit;
  A hospitality execution control unit that performs control to cause the corresponding hospitality operation unit to execute the selected hospitality operation, and
  The hospitality decision-making unit includes user biometric information acquisition means for acquiring user biometric information including at least one of the user's personality, mental state, and physical condition, and a plurality of the hospitality operations prepared for each hospitality theme Hospitality content determination means for changing the individual execution content of the user according to the acquired user personality information or the content of the mental / physical condition information,
  Two or more of the plurality of the hospitality themes are reciprocal oriented themes determined corresponding to the user's mutually opposite hospitality orientations, and the hospitality theme determination means is acquired by the user biometric characteristic information acquisition means An automobile user hospitality system that determines which of the reciprocity-oriented themes is selected according to the content of the user personality information or mental / physical condition information.   A series of operations related to the use of the vehicle by the user until the user approaches the vehicle, gets into the vehicle, drives the vehicle or stays in the vehicle, and then gets off the vehicle. Divided into a plurality of divided scenes, and the hospitality theme is defined for each of the divided plurality of scenes,
  The user status information acquisition means includes scene estimation information acquisition means for acquiring, as scene estimation information, the position or motion of the user predetermined for each scene, and the individual scenes based on the acquired scene estimation information. And a scene specifying means for specifying
  The automobile user hospitality system according to claim 4, wherein the theme determination unit selects a hospitality theme corresponding to the identified scene.

Images