JP4525926B2 - Automotive user hospitality system - Google Patents

Description

  The present invention is intended to assist the user in using the car or to entertain (or serve) the user at least one of approaching, riding, driving, getting off and leaving the car of the user. This relates to a hospitality system for automobile users.

JP 2003-312391 A

  Patent Document 1 discloses an automatic adjustment device for an in-vehicle device using a mobile phone. This device communicates between a mobile phone carried by an automobile passenger and a wireless device mounted on the automobile side, and installs an in-vehicle device such as an air conditioner, a car stereo, an optical axis of a headlight, an electric seat or an electric mirror. The operation adjustment is performed under conditions registered in advance for each mobile phone holder. Patent Document 1 also discloses a technique for grasping the number and positions of passengers in a vehicle by using a GPS (Global Positioning System) mounted on a mobile phone and adjusting the volume balance and frequency characteristics of an audio device. .

  However, since the above devices set the adjustment contents of the in-vehicle device uniformly regardless of the type of disturbance applied to the user, the user can read the inside of the hand after several uses and gradually lose joy. There is a drawback. Further, it is not in the form of effectively mitigating the adverse effects of the generated disturbances, and wasteful functional operations are likely to occur, so that it is far from the idea to entertain the user in a timely and generous manner.

  An object of the present invention is to detect a disturbance state applied to a user, and based on the detection result, the operation of the in-vehicle device can be controlled in a timely and autonomous manner in a form desired by the user, and the satisfaction of the user is always improved. An object of the present invention is to provide an automobile user hospitality system in which the automobile side can always actively treat the user as a master or a guest while maintaining the high level.

Means and actions / effects for solving the problems

In order to solve the above problems, the automobile user hospitality system of the present invention is:
A plurality of hospitality operation units for performing a hospitality operation to assist a user in using a car or to entertain a user;
The predetermined disturbance detection means, and disturbance information obtaining means for obtaining the disturbance information applied to the user, depending on the acquired disturbance information, also Tenashi operation contents Ru good in hospitality operation portion and the hospitality operation unit to be used A hospitality decision-making unit having a hospitality content determination means for determining
A hospitality execution control unit that controls the operation of the corresponding hospitality operation unit so as to perform the hospitality operation according to the determination content by the hospitality decision making unit, and the hospitality content determination means includes a plurality of hospitality operation units. Correspondence between the content to be preferentially used according to the content of the disturbance information received and the content of the disturbance information is determined in advance, and the hospitality operation unit corresponding to the content of the disturbance indicated by the acquired disturbance information is based on the correspondence relationship. It has the hospitality function selection means to select .

According to the present invention described above, the operation content of the hospitality operation unit changes according to disturbance information applied to the user, and as a result, the service effect to the user when using the car is precisely and precisely displayed according to the content of the disturbance to the user. can do. In addition, the adverse effects of the generated disturbance can be mitigated in a timely and efficient manner.

The hospitality content determination means has a predetermined correspondence relationship between a plurality of hospitality operation units that are used preferentially according to the content of disturbance information received by the user and the content of the disturbance information, and the acquired disturbance information The hospitality function selecting means for selecting the hospitality operation unit corresponding to the disturbance content indicated by the information on the basis of the correspondence relationship. According to this configuration, since an appropriate hospitality operation is selected according to the disturbance, it is more effective in reducing the adverse effects of the generated disturbance, and unnecessary function operations can be reduced.

A series of actions related to the user's use of the car until the user approaches the car, gets into the car, drives the car or stays in the car, and then gets off the vehicle is a plurality of predetermined operations. Can be divided into scenes. In this case, the plurality of hospitality operation units can perform a hospitality operation for assisting the use of the automobile by the user for each of a plurality of divided scenes or for entertaining the user. In addition, a scene estimation information acquisition unit that acquires, as scene estimation information, a user position or action that is predetermined for each scene, a scene specification unit that specifies individual scenes based on the acquired scene estimation information, User biometric characteristic information acquisition means for acquiring user biometric characteristic information including at least one of personality, mental state, and physical condition, and disturbance information applied to the user by predetermined disturbance detection means in each specified scene Disturbance information acquisition means can be provided. Hospitality determination section, in response to the scene and the user biometric characteristic information and disturbance information, it shall provide for the even Tenashi operation content Ru good in hospitality operation portion and the hospitality operation unit to be used.

  According to the above configuration, the scene determined by the relative relationship between the user and the car is grasped as the user state. Specifically, a series of operations related to the user's use of the car until the user approaches the car, gets into the car, drives the car or stays in the car, and then gets off the vehicle in advance. Divided into a plurality of predetermined scenes, a hospitality operation is performed to assist the user in using the car or to entertain the user for each of the divided scenes. The hospitality operation performed on the vehicle side changes for each scene (scene) related to the use of the car by the user, so it is possible to provide the most desired hospitality operation according to the individual scene, and it is accurate and precise. Service becomes possible. Also, different hospitality contents for users can be organized by associating them with a series of scenes.

  Then, disturbance information applied to the user in each identified scene is acquired, and the hospitality operation unit to be used and the hospitality operation content by the hospitality operation unit are determined according to the scene, user biometric information, and disturbance information. Therefore, the operation content of the hospitality operation unit changes according to the content of the user biometric information and the disturbance applied to the user, and consequently, the service effect to the user when using the car, the personality, mental state or physical condition for each user, Depending on the content of the disturbance, it can be accurately and precisely demonstrated.

The hospitality function selection means specifies a plurality of hospitality operation units that can be used in each scene, and among the plurality of hospitality operation units that can be used, one that is used preferentially according to the content of disturbance information received by the user And a function selection table storage means for storing a function selection table indicating a correspondence relationship between the disturbance information and the content of the disturbance information, and finds a hospitality operation unit corresponding to the disturbance contents indicated by the acquired disturbance information on the function selection table. Thus, it can be determined as a hospitality operation unit to be operated in the scene. Naturally, the hospitality operation unit used preferentially according to the content of the disturbance is limited to the hospitality operation unit having a function capable of reducing the adverse effects of the disturbance on the user.

According to the above configuration, the hospitality operation unit to be used for each scene is collected in the function selection table, and the hospitality operation unit to be used preferentially according to the situation of disturbance information is specified on the function selection table. The process of shifting from acquiring disturbance information to selecting an appropriate hospitality operation unit can be performed quickly and appropriately by referring to the function selection table. In this case, the function selection table can determine a plurality of hospitality operation units to be used preferentially in disturbance information of a predetermined type, and includes information related to the priority of use of the hospitality operation units. I can leave. By determining a plurality of hospitality operation units capable of dealing with specific disturbance information , the influence of the disturbance information can be reduced by the plurality of hospitality operation units, so that a hospitality situation that satisfies the user can be created more efficiently. In addition, it is easy to selectively use a plurality of hospitality operation units according to the level of disturbance information , and by giving higher priority to the hospitality operation unit that is most effective in reducing the influence of disturbance information , It is possible to appropriately adjust the hospitality operation content for any level of disturbance information .

  When the acquired user biometric information includes user personality specifying information for specifying the user's personality, each hospitality operation is associated with the personality type of the user specified by the user personality specifying information individually. A hospitality operation information storage unit that stores hospitality operation information that defines the operation content of each unit can be provided. In this case, the hospitality decision making unit reads the hospitality operation information corresponding to the personality type specified by the acquired user personality identification information from the hospitality operation information storage unit, and controls the operation of the hospitality operation unit based on this to the hospitality operation unit Can be commanded.

  According to the above configuration, the personality of the user is classified, and the content of the hospitality operation adapted to the user of the personality type is individually determined according to the type. On the other hand, on the vehicle side, the personality of the user who is currently using the vehicle is specified based on the acquired user personality specifying information, and the hospitality operation corresponding to this is selected and executed. Accordingly, it is possible to perform a hospitality operation with content that matches the personality of the user, and even users with different personalities can be satisfied with their own unique hospitality content.

  The hospitality operation unit may be a car audio system installed in an automobile, for example. In this case, the hospitality operation information storage unit stores a plurality of music source data to be reproduced by the car audio system, and each music source data is classified in a form uniquely associated with the user personality type. It can be a music source database. Then, the hospitality control unit is configured to read out music source data corresponding to the personality type specified by the acquired user personality specifying information from the music source database, and to reproduce it in the car audio system. The music source to be played is classified in the music source database in association with a predetermined user personality type, and the music source corresponding to the acquired and determined user personality type is played on the car audio system. Thus, it is possible to accurately provide music that the user of that character likes, and to entertain the user while driving or staying in the car. In addition, it is possible to save a considerable part of the trouble of selecting music that suits the user from a huge database, and it does not bother the user.

  Naturally, the car audio system can also be provided with a music selection section operated by the user, and the music source data selected by the music selection section can be used for reproduction. Here, if the music source data is classified in association with the user personality type as described above, the personality type of the user is specified according to what kind of music the user intends to use. It becomes possible. Specifically, a music selection record storage unit that stores the music selection results by the user together with the personality types associated with the individual music source data is provided, and the biological state detection unit is configured to store the personality types in the stored music selection results. It is assumed that the user personality specifying information is acquired based on the information. The personality of the user can be accurately identified based on which personality type belongs most to the selected music source.

  The user biological characteristic information acquisition means includes a biological state detection unit for detecting a predetermined biological state for estimating the user's mental state and physical condition, and based on the detected biological state, Mental / physical condition estimating means for estimating physical condition can be included. In this case, the hospitality determination unit can determine the control suitability value of the hospitality operation according to the content of the estimated mental / physical state. According to this configuration, the control suitability value of the hospitality motion unit selected according to the disturbance changes according to the estimated mental / physical state, and consequently, the service effect on the user when using the car is changed. Depending on the condition or physical condition, it can be accurately and precisely demonstrated. It should be noted that the user's physical condition and mental state change from moment to moment even after the start of the hospitality operation as long as the user is a human being. Therefore, the hospitality decision-making unit monitors the temporal transition of the mental / physical state of the user estimated by the mental / physical state estimation means, and corrects the control suitability value according to the temporal transition of the mental / physical state. If so, it is even more effective.

  In addition, when the hospitality decision making unit performs the determination process of the hospitality operation content corresponding to the above-described personality type, this determination process determines (or adjusts) the control suitability value of the hospitality operation according to the content of the mental / physical condition. ) It is desirable to carry out prior to processing. According to this method, the adjustment effect of the control aptitude value of the hospitality operation according to the mental / physical condition is buried by the determination of the hospitality operation corresponding to the personality type and the narrowing down of the hospitality operation content specialized for the user personality type Therefore, the adjustment of the hospitality operation control according to the mental / physical condition can be finely and accurately performed according to the personality of the user.

Further, when the determination process by the hospitality function selecting means of the hospitality operation unit corresponding to the disturbance content indicated by the disturbance information is performed, this process determines the control suitability value of the hospitality operation according to the content of the mental / physical condition. It is desirable to carry out after processing. In other words, the disturbance often changes suddenly depending on the situation outside the vehicle, and it is often difficult to predict in advance what kind of disturbance the user will encounter. Therefore, with regard to the hospitality operation unit that may be used in the current scene, the control suitability value is uniformly set to stand-by without being narrowed down by disturbance factors, and then the hospitality operation unit is responded to the generated disturbance. By selecting and operating, each hospitality operation unit can shift to a proper operation smoothly and promptly because a control suitability value is determined in advance when a corresponding disturbance occurs.

  Next, in the system of the present invention, a plurality of hospitality themes can be defined in accordance with the direction of hospitality desired by the user, and a plurality of hospitality operations can be prepared in advance for each theme. it can. The hospitality decision-making unit collectively includes hospitality theme determination means for selecting one or more of a plurality of hospitality themes based on user biometric information, and a plurality of hospitality operations managed by each of the selected hospitality themes. It can be configured to have hospitality operation selection means for selecting.

  There are a wide variety of functions that users demand from automobiles, and in order to meet these demands, many hospitality operations are prepared on the automobile side. In this case, the diversification of hospitality operations is a delight for the user, but the difficulty of making hospitality decision-making on the automobile side, which hospitality operation is provided according to the user's situation, is complicated. If there is some error in the hospitality decision-making process, such as failure to grasp the situation on the user side, certain hospitality operations may be performed at a timing that the user does not want, and there is a sufficient effect. In some cases, it may not be obtained, or in some cases, a mischievous hospitality operation may be harmful to the user.

  However, according to the above configuration, when determining the hospitality operation, instead of directly selecting individual hospitality operations, a plurality of hospitality themes that govern the hospitality operations according to the direction of hospitality desired by the user are determined, The hospitality operation is selected in units of the hospitality theme. In other words, depending on what kind of “hospitality” the user wants to receive from the car side, by selecting the corresponding hospitality theme, the hospitality operations associated with each other based on the hospitality theme can be selected at once. As a result, it is possible to simplify the hospitality decision-making process and to greatly reduce the trouble of erroneously performing the hospitality operation that does not match the user's intention.

  In this case, a hospitality theme can be defined for each of a plurality of scenes. The user status information acquisition means includes a scene estimation information acquisition means for acquiring a user position or action predetermined for each scene as scene estimation information, and a scene specification for specifying individual scenes based on the acquired scene estimation information The theme determination means may select a hospitality theme corresponding to the specified scene.

  In the above configuration, different hospitality themes can be organized by associating them with a series of scenes. As a result, the user can receive a consistent service as a guest from the car side at any time, as if staying at a first-class hotel, and should be an “inhuman” subject. A virtual effect that the car functions as a “human” host is also added, and it is possible to provide an unprecedented novel enjoyment of car use.

  Employment priorities can be determined in advance for a plurality of hospitality operations assigned to each hospitality theme. In this case, it is possible to sequentially select a plurality of prepared hospitality operations in descending order of priority. Even if the hospitality is the same, there is often a difference in the level of hospitality to be given depending on the circumstances surrounding the user and the user's orientation (or satisfaction). Therefore, by performing a plurality of hospitality operations for each theme while selecting them according to a predetermined priority order, it is possible to flexibly cope with the above cases.

  In addition, it is natural that the contents that are desired for hospitality differ between users who are usually flashy and those who are quiet and quiet, and the same user can be adapted to the situation when the mood is good or bad It can be said that it is effective to provide hospitality with different directions. As described above, when the conditions relating to the hospitality orientation determination are caused by the personality and state of the users who are in conflict with each other, it is possible to cope with the problem by configuring as follows. That is, two or more of the plurality of hospitality themes are reciprocal oriented themes that are determined in accordance with the user's conflicting hospitality orientations, and the hospitality theme selection means is a user acquired by the user biometric information acquisition means. Depending on the contents of the personality information or the mental / physical condition information, it is determined which of the reciprocal oriented themes is selected. Depending on the user's mood and personality, it can be said that this is an effective method for selecting an appropriate one from a plurality of hospitality actions. Easily select the appropriate hospitality action according to the user's personality and mental / physical condition. Can do.

In addition, the automobile user hospitality system of the present invention is provided with hospitality adjustment command means for commanding the hospitality execution control unit to adjust the control state of the hospitality operation based on response information from the user who enjoyed the hospitality operation. Can do. According to this configuration, since the control state of the hospitality operation control is adjusted for the hospitality execution control unit based on the response information from the user who enjoyed the hospitality operation, the satisfaction level of the user is confirmed based on the response information. It is possible to always keep the control state of the hospitality operation unit properly, and in the form that the user's satisfaction is always maintained at a high level, it is possible for the car side to always actively treat the user as the master or the customer. .

  The hospitality adjustment commanding means can use information related to the mental state or physical condition of the user, which is estimated by the mental / physical condition estimating means after the start of the hospitality operation, as response information from the user. This not only determines the hospitality operation content according to the mental state or physical condition of the user, but also optimizes the hospitality operation content based on the response information related to the mental state or physical condition after the start of the hospitality operation. Can be achieved.

  In this case, the hospitality adjustment commanding unit may adjust the control state of the hospitality operation in a direction in which at least one of the mental state or the physical state of the user estimated by the mental / physical state estimation unit is improved. Thereby, even if the user is in a situation where the mental state or the physical condition is deteriorated, the user can make positive improvements by the hospitality operation enjoyed from the automobile side. More specifically, the mental / physical condition estimating means can estimate the user's mental condition or physical condition so as to be distinguishable between a normal condition and an abnormal condition in which some abnormality has occurred. When the mental state or physical condition of the user estimated by the mental / physical condition estimating means is a normal state, the hospitality adjustment commanding means maintains the normal state. It is possible to adjust the control state of the hospitality operation in such a direction that the abnormal state is eliminated or alleviated. That is, the user's mental state or physical condition is spontaneously grasped by the vehicle side, and the hospitality operation adapted to the mental state or physical condition is performed, so that the service effect on the user when using the vehicle can be remarkably enhanced. In addition, since the car will spontaneously walk up to the user's spirit or physical condition, the user's sympathy will be improved, and the internal connection between the car and the user will be nurtured. , You can improve your position as a virtual partner who understands and acts on your own.

Hereinafter, further invention constituent elements that can be added to the present invention will be described.
The hospitality operation unit may be a lighting device that illuminates the interior of the automobile or the exterior of the automobile. The hospitality control unit can be configured to change at least one of the color tone of the illumination light by the illumination device and the illumination form according to the content of the user biological state information. You can visually soften the user's mind by changing the lighting operation mode according to the user's personality, mental state, or physical condition, and also raise the mood according to the mental state and physical condition. Or conversely, it is possible to heal a user who is too tall or tired.

  For example, the hospitality control unit may operate the lighting device with different contents according to the acquired user biological state information when the user approaches to get into a car. According to this aspect, the car appropriately changes the so-called “greeting” form of the approaching user according to the personality, mental state or physical condition of the user, and thereby enhances the feeling of the user who wants to drive from now on. Or you can calm down.

  The hospitality operation unit is not necessarily limited to equipment mounted on a car, and may be peripheral equipment of a parked car (for example, ancillary equipment of a designated parking lot) It is good also as a hospitality operation | movement part for the carrying goods which a user must carry at the time of utilization. For example, the following configuration can be exemplified as an example of the latter case. That is, a host-side communication means that communicates with an external terminal device is provided in a parked automobile or a peripheral facility of the automobile, and the terminal side that communicates with the host-side communication means carried by the automobile user via a wireless communication network A user-side terminal device having communication means is provided (this user-side terminal device corresponds to the above-mentioned carried item). The hospitality operation unit is a voice output unit provided in the user side terminal device, while the host side communication means is a hospitality control unit, and the user biometrics acquired when the user approaches to get into the car A wireless command is issued to the user terminal device so that the voice output unit operates with different output contents according to the information. In this aspect, when the user approaches the vehicle, a wireless command is sent to the user terminal device by the host communication means, and voice for hospitality (music, sound effects, greetings) is received from the user terminal device carried by the user. Etc.) are output. Thereby, the hospitality by the voice of the user approaching the automobile can be effectively executed by the user side terminal device carried by the user. Car audio system mounted on the car side by voice can be used as the voice output part, but if the window is closed, the hospitality voice will not reach the user enough, and the window will open and the sound will leak out of the car Doing so can be a nuisance to the neighborhood. However, if the user-side terminal device is used as a hospitality sound output unit as described above, the voice effect can be output at the user's hand, which greatly enhances the hospitality effect. There is nothing.

  Moreover, the hospitality system for automobiles of the present invention can be provided with user distance detecting means for detecting the distance between a user approaching to get into the automobile and the automobile. In this case, the hospitality control unit can be configured to change the operation content of the hospitality operation unit according to the distance between the user and the vehicle detected by the user distance detection means. According to this, since the operation content of the hospitality operation unit is controlled so as to change according to the distance between the user and the car, the service effect to the user by the hospitality operation unit should be demonstrated appropriately and finely according to the above distance. As a result, it is possible to enhance the atmosphere in which the automobile side actively treats the user as the master or the customer.

In this case, the hospitality control unit can change the operation content of the hospitality operation unit so that the closer the user is to the car, the higher the feeling of the user. As a result, hospitality increases as the user gets closer to the car, which can significantly contribute to raising the mood when getting into the car. Specifically, the following aspects can be illustrated.
・ Make the music output for hospitality uptempo as the distance gets closer. It is also possible to set the tempo to a multiple of the heart rate, increase the volume as the distance gets closer, or change to a song that makes the mood more exciting.
-Brighten the lighting for hospitality or change the color to red. It is also possible to synchronize the blinking (or change) cycle of the lighting with music.

  The hospitality control unit includes at least one of stopping the hospitality operation unit that is already in operation and starting operation of the non-operational hospitality operation unit (of course, including operation switching between a plurality of hospitality operation units, which is a combination of both) ), The operation content of the hospitality operation unit can be changed stepwise depending on the distance between the user and the automobile. According to this configuration, an appropriate threshold value is set for the distance between the user and the vehicle, and the control of switching between operation / non-operation is performed for each hospitality operation unit by simple determination of whether or not the vehicle approaches the threshold. The above-described effect of the present invention can be achieved by a relatively light control process.

  The hospitality operation unit can be configured by a lighting device. The lighting device naturally includes a device mounted on a vehicle, but may be provided in a facility around a parked vehicle (for example, a building or a utility pole). The lighting device is particularly effective in informing the user of the location of the automobile when getting in at night and guiding or guiding the user to the location.

  The hospitality control unit can turn on the lighting device so that the total amount of illumination light decreases as the distance between the user-side terminal device and the automobile decreases. When the distance to the car is long, increasing the total illumination light quantity makes it easier to understand whether there are any obstacles etc. between the car and it is necessary if the distance to the car decreases. In order to illuminate only the field of view, if the amount of light is reduced, waste can be eliminated, and glare when approaching the illumination light source can be reduced.

  Next, the biological state detection unit can detect a predetermined biological state of the user as a temporal change of the biological state parameter that is a numerical parameter reflecting the biological state, and the mental / physical state estimation means includes: The mental state or physical condition of the user can be estimated based on the temporal change of the detected biological condition parameter. The mental state or physical condition of the user can be estimated more rationally based on the temporal change of the biological condition parameter, and accordingly, the adaptation control of the hospitality operation to the user can be performed more accurately.

  The biological state detection unit can detect a temporal change waveform of the biological state parameter. In this case, the mental / physical condition estimating means can estimate the physical condition of the user based on the amplitude information of the waveform. For example, when the user's physical condition is lowered due to illness or fatigue, the fluctuation of the biological condition reflecting the physical condition is also reduced. That is, the amplitude of the temporal change waveform of the biological condition parameter tends to decrease, and it is possible to accurately detect abnormalities in the physical condition such as the disease and fatigue. On the other hand, the mental / physical condition estimating means may estimate the user's mental condition based on the frequency information of the waveform. The stability or instability of the mental state is often reflected in the fluctuation rate of the biological state, and the fluctuation rate is reflected in the frequency of the biological state parameter waveform. Therefore, the mental state of the user is appropriately adjusted based on the frequency information. It can be estimated accurately.

  The mental / physical state estimating means may specify the mental state or physical state of the user as one of a plurality of predetermined mental state levels or mental state levels. In addition, a hospitality operation information storage unit that stores hospitality operation information that defines the operation content of the hospitality operation unit in association with a plurality of mental state levels or mental state levels can be provided. The hospitality control unit can be configured to read the hospitality operation information corresponding to the estimated mental state level or the mental state level from the hospitality operation information storage unit, and to control the operation of the hospitality operation unit based on this. According to this configuration, the hospitality control algorithm can be greatly simplified by performing stepwise level setting on the user's physical condition or mental state that originally changed in an analog manner.

  The biological state detection unit can detect the temporal change state of the user's body temperature as the temporal change information of the biological state parameter. The body temperature reflects the user's physical condition (physical condition) and mental condition, especially the physical condition (for example, when the physical condition is poor, the temperature fluctuation range (waveform amplitude) becomes gentle) and infrared measurement (for example, facial thermography) Etc.) can be used to estimate the user's condition not only during driving (or while in the car) but also in various aspects such as approaching, getting in, and getting off / leaving the car. Yes, it can also contribute to the diversification of scenes that should provide an accurate hospitality operation.

  Further, the biological state detection unit may acquire a temporal change state of at least one of the facial expression and the line-of-sight direction of the user as the temporal change state of the biological state parameter. These two parameters also reflect the user's physical condition (physical condition) and mental condition (especially mental condition), and can be measured remotely by taking images, so they are limited to driving (or staying in the car). In addition, there are advantages that can be used for estimating the user's condition in various aspects such as approaching, getting in, and getting off / leaving from the automobile, and can contribute to diversification of scenes that should be provided with appropriate hospitality operations.

  The hospitality operation unit may perform a hospitality operation while the user is driving the automobile. And the biological condition detection part shall detect the temporal change of the biological condition parameter during a user's driving | operation. Thereby, according to the mental state or physical condition of the driver (user), the hospitality operation during the driving is optimized, and a comfortable and safer driving of the automobile can be realized.

  The biological state detection unit acquires a temporal change state of a first-type biological state parameter including one or more of blood pressure, heart rate, body temperature, skin resistance, and sweating as a temporal change state of the biological state parameter. can do. The first-type biological condition parameter indicates the internal physical state change of the driver, and the temporal change (waveform) includes the driver's mental state (or psychological state) and physical condition, particularly mental state. Since the state is remarkably reflected, by analyzing this, the hospitality operation for the driver can be optimized more effectively. Further, these first-type biological condition parameters can be directly measured by, for example, a sensor attached to a grip position by the driver of the steering wheel, and have an advantage that the temporal change can be grasped sharply. For example, if you perceive danger and cool, or interrupt and overtake (that is, if you are mentally excited), you may notice sweating or a heartbeat. Significant changes appear in the waveform (especially amplitude) of the first-type biological condition parameters such as blood pressure, heart rate, body temperature, skin resistance (or sweating). It is also known that the first-type biological state parameter shows a similar waveform when attention is distracted and the attention is distracted. In this case, the mental / physical condition estimating means can estimate that the user's mental condition is abnormal when the waveform frequency of the first-type biological condition parameter exceeds a certain level.

  On the other hand, the biological state detection unit detects a temporal change state of the second-type biological state parameter consisting of at least one of the user's driving posture, line-of-sight direction, and facial expression as the temporal change state of the biological state parameter. It can be. The second-type biological condition parameter indicates a so-called external physical condition change of the driver, and its movement amplitude tends to be reduced to reflect a condition such as poor physical condition, illness, or fatigue. . Therefore, the mental / physical condition estimating means can estimate that the user's physical condition is abnormal when the waveform amplitude of the second-type biological condition parameter becomes smaller than a certain level.

  On the other hand, the waveform of the second-type biological state parameter can be effectively used for grasping the driver's mental state. For example, when the driver falls into an excited state, the driver's posture frequently changes, while the change in the line-of-sight direction decreases, resulting in a so-called “eye position” state. In addition, when mentally unstable, the facial expression changes significantly. In this case, the mental / physical condition estimating means determines whether the waveform frequency of the second-type biological condition parameter is larger than a certain level or smaller than a certain level. Different), it can be presumed that the user's spirit is abnormal.

  There is also a biological condition parameter that can grasp a mental state or a physical condition based on time change information different from the frequency and amplitude. For example, the biological state detection unit can detect a temporal change in the pupil size of the user as a temporal change in the biological state parameter. The mental / physical condition estimating means can estimate that the user's physical condition is abnormal when the detected pupil size is more than a predetermined level. This is because the focusing and light amount adjustment of the eyes become unstable due to fatigue and often fall into a state of so-called blurred eyes or flickering. On the other hand, when the driver is abnormally excited due to anger or the like, the driver often opens his eyes. In this case, the mental / physical condition estimating means can estimate that the user's mental condition is abnormal when the detected pupil size is expanded beyond a predetermined level.

  In addition, a plurality of biological state detection units can be provided, and the mental / physical state estimation means can determine whether the user's mental state or the state based on a combination of temporal change states of the biological state parameters detected by the plurality of biological state detection units. The physical condition can be estimated. By combining a plurality of biological condition parameters, it is possible to further diversify (or subdivide) types of mental states or physical condition states that can be estimated (that is, identified), and to improve estimation accuracy. In this case, a plurality of specified states that are a mental state or a physical condition to be estimated by the user and a plurality of biological state detection units for estimating that each specified state is established respectively A determination table is provided in which a combination of temporal change states of biological condition parameters to be stored is stored in association with each other, and the mental / physical state estimation means determines a combination of temporal change states of a plurality of detected biological condition parameters. Then, it is possible to collate with the combination on the determination table and identify the identified state corresponding to the combination that has been collated and matched as the identified state that is currently established. Thereby, even when many biological condition parameters are considered, the specified process of specifying the specified state can be performed efficiently.

  The specified state may include at least three of “diffused concentration”, “bad physical condition”, and “excited state”. When the user (driver) is estimated to be “diffused by concentration” by the mental / physical state estimating means, the hospitality control unit can make the hospitality operation unit perform an operation to wake up the user. . Thereby, the user can be concentrated on driving. In addition, when the user is estimated to be “inferior physical condition” by the mental / physical condition estimating means, the hospitality control unit operates the corresponding hospitality operation unit so that the disturbance stimulus given to the user is alleviated by the hospitality operation. Control can be performed. By reducing the disturbance stimulus, it is possible to suppress the increase in physical fatigue resulting from the psychological burden, and to reduce the driver's pain. In addition, when the user is estimated to be in an “excited state” by the mental / physical state estimating means, the hospitality control unit shall cause the hospitality operation unit to perform an operation for relieving the user's mental tension. Can do. As a result, the hot mental state of the driver can be cooled, and it can be corrected to a calm and mild driving orientation.

  Next, the hospitality adjustment commanding means outputs a question output means for outputting a question for confirming the satisfaction degree of the user by the hospitality operation after the start of the hospitality operation, and an answer input for inputting the user's answer to the question as response information It is also possible to configure as an object having means and adjustment content determination means for determining the adjustment content for the control state of the hospitality operation based on the response content. Although this method lacks the autonomy of hospitality control, there is an advantage that the user's satisfaction (satisfaction level) for the hospitality operation can be surely grasped by the question form on the automobile side. For example, when there is a problem in the content estimation accuracy of the mental / physical condition, etc., supplementary use is effective in guiding the hospitality movement in the correct direction.

  Next, a hospitality scene determination method according to the present invention will be described. In other words, the scene is defined within the framework of “use of car by user”, and the basic flow of approaching, getting in, driving / staying, opening the door and getting off when reaching the destination does not change. . Therefore, it is important to smoothly cut the scene along this flow from the viewpoint of providing a natural and uncomfortable hospitality to the user. In this case, the following configuration may be employed. That is, a current scene specifying information storage means for storing and holding current scene specifying information for specifying the current scene is provided. The scene specifying means grasps the current scene based on the stored contents of the current scene specifying information, and on the premise of grasping the current scene, a predetermined scene estimation information obtaining means determines a user specific to the subsequent scene. When the position or the motion is detected, it is determined that the transition to the subsequent scene is made, and the specific information of the subsequent scene is stored in the current scene specific information storage unit as the current scene specific information. If the current scene can be grasped, it can be predicted from the user's behavior flow when using the car as described above, what kind of scene will come next, and the user position or action specific to the subsequent scene By detecting this, it is possible to accurately grasp the transition between scenes. In addition, the content of the subsequent scene specifying information ("opening / closing of the door" in the above example) is the same in a plurality of scenes so that it can be easily understood by considering the case where the opening / closing of the door occurs both when getting on and off the vehicle. There is a case. However, by grasping what the current scene is, even in such a case, it is possible to prevent the subsequent scene from being misunderstood, and the hospitality operation can be switched appropriately.

  In the automobile hospitality system of the present invention, it is possible to define a plurality of hospitality themes to be given to the user for each scene, and the hospitality operation unit to be used and the hospitality operation by the hospitality operation unit for each theme. Can be determined uniquely. In this case, the hospitality decision-making unit determines the hospitality operation unit to be used in each theme for some or all of the plurality of themes and the content of the hospitality operation by the hospitality operation unit, and the hospitality execution control unit Can control the operation of the hospitality operation unit corresponding to each theme. Even if it is the same scene, what the user wants to do as “hospitality” is not necessarily unique, so “hospitality” depends on the personality, mental state or physical condition of the user. "What you want to do" may be different. These “hospitality of hospitality” and “contents you want for hospitality” can be grasped individually as “theme of hospitality”, and by setting the content of hospitality for each theme, more multifaceted hospitality services Can be provided.

  In the case where a plurality of hospitality operations are prepared in advance for each scene, the priority order of adoption can be determined in advance for the plurality of hospitality operations according to the degree of orientation of the hospitality by the user. The hospitality content determination means may sequentially select a plurality of prepared hospitality operations in descending order of priority in each scene. Even in hospitality in the same scene, there are often differences in the circumstances surrounding the user and the degree of hospitality to be given depending on the user's orientation. Therefore, by preparing a plurality of hospitality operations for each scene and selecting them according to a predetermined priority order, it is possible to flexibly cope with the above cases.

  Prepare multiple hospitality themes for each scene according to the above-mentioned “hospitality for hospitality” and “contents desired for hospitality”, and each hospitality operation unique to each of these multiple themes will be included in the same scene. Can be executed in parallel. In this way, hospitality from various angles according to the theme to be set can be given to the user at the same time, and satisfaction with the user can be enhanced by multifaceted and deep hospitality in the same scene. . For example, in each of the above scenes, the theme of hospitality can be determined corresponding to a plurality of different hospitality purposes related to improvement or suppression of deterioration of the mental state or physical condition of the user. It is possible to select two or more items from the above and perform the hospitality operation of each selected theme in parallel. For example, as an example of a theme that achieves different purposes in the same scene, the theme of `` energizing the user's feeling '' and the theme of `` eliminating anxiety '' can be illustrated, but the former does The latter contributes to the improvement of the mental state of “feeling high”, and the latter contributes to the suppression of the deterioration of the mental state of “inhibition of increased anxiety”. By executing the hospitality operations of these themes in parallel, the two-sided hospitality effect of heightening and relieving anxiety can be achieved at the same time, and as a result, the user can improve their mental state more three-dimensionally. It becomes possible.

  In this case, the hospitality adjustment commanding means can preferentially adjust the control state of the hospitality operation as the hospitality operation that greatly contributes to the improvement of the mental state or physical condition of the user among the plurality of hospitality operations. A hospitality operation that is highly effective in improving the mental state or physical condition increases the priority of the operation, and the user can use the car more comfortably, and the satisfaction level of the hospitality is also increased. In addition, the hospitality adjustment command means has a plurality of hospitality operations whose contribution to the improvement of the mental state or physical condition of the user falls below a predetermined level, or the user's answer to the question avoids the hospitality operation. It is also possible to configure the content to be excluded from the control target. As a result, the hospitality operation not desired by the user is hesitated and only the hospitality operation desired by the user remains, so that the user can use the automobile more comfortably and the satisfaction level of the hospitality is increased.

  Next, the scene specifying means may specify an approach scene in which the user approaches the car and a driving / staying scene in which the user drives or stays in the car. The hospitality content determination means can be configured to determine the hospitality operation unit to be used and the content of the hospitality operation by the hospitality operation unit for each of these scenes. When driving or staying in a car, it takes a long time as a scene related to the use of the car, and emphasizing the hospitality in the driving / staying scene is an important key for whether or not the user can use the car comfortably. Holding. On the other hand, the approaching scene occupies the next time specific gravity as the scene preceding the driving / staying scene, and by effectively utilizing this as an opportunity for hospitality, the approaching scene of the user facing the driving / staying scene It also contributes to improving the mental state and further enhancing the hospitality effect in the driving / staying scene.

  The scene estimation information acquisition means has an approach detection means for detecting the approach of the user to the car based on the relative distance between the car and the user located outside the car in order to specify the approach scene. Can be configured. In addition, in order to specify the driving / staying scene, it can be configured to have a seating detection means for detecting a user seated in a car seat. Both have the advantage that an approaching scene or a driving / staying scene can be specified accurately.

  Next, the hospitality control unit can be configured such that the operation content of the hospitality operation unit is changed according to the distance between the user and the vehicle detected by the approach detection means. According to this, since the operation content of the hospitality operation unit is controlled so as to change according to the distance between the user and the car, the service effect to the user by the hospitality operation unit should be demonstrated appropriately and finely according to the above distance. As a result, it is possible to enhance the atmosphere in which the automobile side actively treats the user as the master or the customer.

In this case, the hospitality control unit can change the operation content of the hospitality operation unit so that the closer the user is to the car, the higher the feeling of the user. As a result, hospitality increases as the user gets closer to the car, which can significantly contribute to raising the mood when getting into the car. Specifically, the following aspects can be illustrated.
・ Make the music output for hospitality uptempo as the distance gets closer. It is also possible to set the tempo to a multiple of the heart rate, increase the volume as the distance gets closer, or change to a song that makes the mood more exciting.
-Brighten the lighting for hospitality or change the color to red. It is also possible to synchronize the blinking (or change) cycle of the lighting with music.

  The hospitality control unit includes at least one of stopping the hospitality operation unit that is already in operation and starting operation of the non-operational hospitality operation unit (of course, including operation switching between a plurality of hospitality operation units, which is a combination of both) ), The operation content of the hospitality operation unit can be changed stepwise depending on the distance between the user and the automobile. According to this configuration, an appropriate threshold value is set for the distance between the user and the vehicle, and the control of switching between operation / non-operation is performed for each hospitality operation unit by simple determination of whether or not the vehicle approaches the threshold. The above-described effect of the present invention can be achieved by a relatively light control process.

  In the approaching scene, a lighting device that illuminates the space outside the vehicle mounted on the vehicle (head lamp, tail lamp, hazard lamp, etc .: the interior light can also illuminate the space outside the vehicle by leakage through the window glass). Can be determined as And it can be defined as the content of the hospitality operation that the lighting device is turned on to welcome the user. According to this, the lighting mounted on the car can be used as illumination for the presentation of the user and contributes to raising the mood. Also, at night or in the dark, there is an advantage that the position of the parked automobile can be easily grasped.

  In the above case, the hospitality control unit can control the lighting device so that the total amount of illumination light decreases as the distance between the user-side terminal device and the automobile decreases. When the distance to the car is long, increasing the total illumination light quantity makes it easier to understand whether there are any obstacles etc. between the car and it is necessary if the distance to the car decreases. In order to illuminate only the field of view, if the amount of light is reduced, waste can be eliminated, and glare when approaching the illumination light source can be reduced.

  The hospitality operation unit is not necessarily limited to equipment mounted on a car, and may be peripheral equipment of a parked car (for example, ancillary equipment of a designated parking lot) It is good also as a hospitality operation | movement part for the carrying goods which a user must carry at the time of utilization. For example, the following configuration can be exemplified as an example of the latter case. That is, a host-side communication unit that is provided in a parked vehicle or a peripheral facility of the vehicle and communicates with an external terminal device, and is carried by the user of the vehicle and communicates with the host-side communication unit via a wireless communication network. In addition to providing a user-side terminal device having terminal-side communication means, the hospitality operation unit in the approach scene can be a voice output unit provided in the user-side terminal device. In this case, the host-side communication means is a hospitality control unit, and a wireless command can be given to the user-side terminal device so that the audio output unit operates in the approaching scene. In this aspect, when the user approaches the vehicle, a wireless command is sent to the user terminal device by the host communication means, and voice for hospitality (music, sound effects, greetings) is received from the user terminal device carried by the user. Etc.) are output. Thereby, the hospitality by the voice of the user approaching the automobile can be effectively executed by the user side terminal device carried by the user. Car audio system mounted on the car side by voice can be used as the voice output part, but if the window is closed, the hospitality voice will not reach the user enough, and the window will open and the sound will leak out of the car Doing so can be a nuisance to the neighborhood. However, if the user-side terminal device is used as a hospitality sound output unit as described above, the voice effect can be output at the user's hand, which greatly enhances the hospitality effect. There is nothing.

  In this case, outputting music and greetings from the voice output unit contributes to improving or improving the mental state of the user. There is also a method of outputting sound. Thereby, even if it is the same approach scene, the other objective of preventing the unexpected situation when a user neglects attention confirmation can be achieved. For example, the message that prompts attention confirmation items may be a message that prompts confirmation of forgotten things, door locks, etc., but is not limited thereto.

  In a driving / staying scene, an air conditioner mounted on a car can be defined as a hospitality operation unit. In particular, in the case of providing a biological state detection unit that acquires user biological state information including at least one of a mental state and a physical state, the hospitality content determination means includes the acquired mental / physical state information (or a user personality described later). It can be configured to change the set temperature of the air conditioner according to the content of the information. As a result, a more human-friendly and friendly air conditioning adjustment control based on the user's feelings is realized. Similarly, in a driving / staying scene, a car audio system mounted on a car can be defined as a hospitality operation unit. In this case, the hospitality content determination means changes the music selection content of the music source output from the car audio system according to the content of the acquired user personality information or mental / physical condition information (or user personality information described later). It can be. Accordingly, the music source desired by the user is automatically selected and output according to the mood and personality, so that the user who is driving or staying in the vehicle can be pleased in a timely manner.

  Next, as a more detailed scene setting, the scene specifying means includes an approach scene in which the user approaches the automobile, a boarding scene in which the user gets into the automobile, and a driving / driving in which the user drives or stays in the automobile. The stay scene and the getting-off scene where the user gets off the car can be specified in this order in time series. The hospitality content determination means may determine the hospitality operation unit to be used and the content of the hospitality operation by the hospitality operation unit for each of these scenes. In this aspect, a boarding scene and a getting-off scene are newly added to the above-described configuration. Although each of these scenes is short in time, it involves actions that are physically and psychologically burdensome, such as opening and closing doors, loading and unloading, and considerations regarding obstacles and traffic hazards when opening and closing the doors. There is a feature, and in the form of assisting this, if you set the original hospitality operation in these scenes, you can more reliably follow up the user before and after the main driving / staying scene, As the content of hospitality received by users from automobiles is more consistent and continuous, the satisfaction that users feel is even greater. As a specific example, for example, in the boarding scene and the getting-off scene, the hospitality operation unit can be an automatic opening / closing device or an opening / closing assist mechanism for a door provided in the automobile, and the automatic opening / closing device or the opening / closing assistance mechanism can be used as a user's boarding operation. It is possible to determine the content of the hospitality operation to operate for assistance. In addition, when the opening / closing assist mechanism is provided, door opening suppression means for detecting an obstacle outside the vehicle, particularly when opening the door, and preventing the door from opening to prevent interference between the obstacle and the door. It can be provided.

  Even after the user gets off, it is possible to add another scene such as a separated scene in which the user leaves the car, and a corresponding hospitality operation can be performed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a conceptual block diagram of an automobile user hospitality system (hereinafter also simply referred to as “system”) 100 according to an embodiment of the present invention. The system 100 includes a hospitality execution control unit 3 including a first computer to which various hospitality operation units 502 to 517, 534, 541, 548, 549, 550, 551, 552, and 1001B are connected, and various sensors and The vehicle-side mounting unit 100 including the hospitality decision-making unit 2 including the second computer to which the camera groups 518 to 528 are connected is configured as a main part thereof. Each of the first computer and the second computer includes a CPU, a ROM, and a RAM, and implements various functions described below by executing control software stored in the ROM using the RAM as a work memory.

  In the system 100, a series of operations related to the user's use of the car until the user approaches the car, gets into the car, drives the car or stays in the car, and then gets off the vehicle. It is divided into a plurality of predetermined scenes. Then, for each of the plurality of divided scenes, the hospitality operation units 502 to 517, 534, 541, 548, 549, 550, 551, 552, and 1001B assist the user in using the car, or enjoy the user. The hospitality operation for the purpose is performed. In the present embodiment, a horn 502 and a buzzer 503 are connected as a sound wave generator to the outside of the vehicle. Further, as a lighting device (lamps), a head lamp 504 (beam can be switched between high and low), a fog lamp 505, a hazard lamp 506, a tail lamp 507, a cornering lamp 508, a backup lamp 509, a stop lamp 510, indoor lighting 511 and an underfloor lamp 512 are connected. Further, as other hospitality operation units, an air conditioner 514, a car audio system (car stereo) 515, an electric seat 516, an angle adjustment drive unit 517 such as a side mirror and a rearview mirror, a car navigation system 534, and an door opening / closing assist. A mechanism (hereinafter referred to as a door assist mechanism) 541, an aroma generating unit 548 that releases a fragrance into the vehicle, an ammonia generating unit 549 for awareness and awakening for severe physical condition (including a state in which severe drowsiness is caused) (FIG. 50) As shown in the figure, it is attached to the center of the driving handle 340 so as to spout ammonia in the form of aiming near the driver's face), and a seat for alerting the driver and awakening from drowsiness Vibrator 550 (embedded in the seat bottom or backrest as shown in FIG. 58), Down to $ vibrator 551 (as shown in FIG. 50, is attached to the shaft of the handle 340), the noise canceller 1001B for reducing cabin noise is connected.

  FIG. 16 shows a configuration example of the indoor lighting 511, and a plurality of lighting sections each having a unique lighting color (in this embodiment, a red lighting 511r, an amber lighting 511u, a yellow lighting 511y, a white lighting) 511w and blue illumination 511b). In response to the control command signal input from the hospitality decision making unit 2 through the hospitality execution control unit 3, these lights are selected, and lighting control is performed in various lighting patterns according to the control command signal. . FIG. 19 shows a configuration example of the lighting control data determined according to the personality type of the user. The lighting control data is stored in the ROM of the hospitality decision making unit 2 and is read and used as needed by the control software. For example, for the active personality (SKC1 (see FIG. 18)), the red light 511r is selected and flashed (only the first, then continuously lighted), and for the gentle personality (SKC2), For example, the amber system lighting 511u is selected and fade-in lighting is performed, but this is only an example.

  In addition to the incandescent light bulb and the fluorescent lamp, the lighting device using a light emitting diode can be adopted as the lighting device. In particular, various illumination lights can be easily obtained by combining light emitting diodes of three primary colors of red (R), green (G), and blue (B). FIG. 39 shows an example of the circuit configuration. Each of the red (R), green (G), and blue (B) light emitting diodes 3401 is connected to a power source (Vs), and is switched by a transistor 3402. Driven. This switching is PWM controlled by a duty ratio determined by the period of a triangular wave (which may be a sawtooth wave) input to the comparator 3403 and the voltage level of the command signal. The input waveform of the command signal to the light emitting diodes 3401 of each color can be changed independently, and an illumination color of any color tone can be obtained according to the mixing ratio of the three light emission colors, and the color tone and illumination intensity pattern can be changed. It is also possible to change over time according to the input waveform of the command signal. Note that the light emission intensity of each color light emitting diode 3401 can be adjusted at the drive current level on the premise of continuous lighting, in addition to the PWM control method as described above, and this is combined with PWM control. A scheme is also possible.

  FIG. 72 shows the relationship between the mixing ratio (depending on the duty ratio) of each of red (R), green (G), and blue (B) light and the color of the visually recognized mixed light. Each is assigned an index (0 to 14) for selecting the emission color at the time of control, and the ROM of the hospitality execution control unit 3 (or the storage device 535 on the hospitality decision making unit 2 side: necessary for control as control reference information) Information may be transmitted to the hospitality execution control unit 3 by communication). The white illumination light is frequently used, and the index that defines the white color is determined so as to appear periodically on the array of the index so that the control can be smoothly transferred to and from the colored illumination light. Yes. In particular, with white (index: 6) in the middle as the boundary, each color of warm color (light orange → orange → red) and cold color (light blue → blue → blue purple) is arranged before and after that, According to the mental state, it is possible to smoothly switch from white illumination light to warm color illumination light or cold color illumination light.

  FIG. 17 shows a configuration example of the car audio system 515. The hospitality music performance control information such as music identification information and volume control information is input from the hospitality decision making section 2 through the hospitality execution control section 3. It has an interface unit 515a. The interface unit 515a is connected to a digital audio control unit 515e and music source databases 515b and 515c (the former is an MPEG3 database and the latter is a MIDI database) storing a large number of music source data. The music source data selected based on the music identification information is sent to the audio control unit via the interface unit 515a, where it is decoded into digital music waveform data, converted into analog by the analog conversion unit 515f, and then pre-amplifier 515g and power amplifier. After 515h, it is output from the speaker 515j at the volume specified by the hospitality music performance control information.

  FIG. 40 shows an outline of the door assist mechanism 541. A swing-type door (hereinafter also simply referred to as a “door”) 1101 for getting on and off is attached to the automobile 1100 via a door turning shaft 1103 at one edge of the entrance 1102. The door 1101 can be opened from a closed position where the door 1102 is closed by a manual operation to an arbitrary angle position. The manual door opening operation is power-assisted by a motor (actuator) 1010. In the present embodiment, the rotational output of the motor 1010 is directly torqued to the turning shaft 1103 as a rotational driving force of the door opening / closing assist while torque is increased via the reduction gear mechanism RG with respect to the door turning shaft 1103 that rotates together with the door 1101. I try to communicate.

  FIG. 41 is an example of a circuit diagram of the door assist mechanism 541. The door assist mechanism 541 has an obstacle detection unit that detects an obstacle outside the vehicle that interferes with the door during the opening operation of the door, and the actuator control unit, when no obstacle is detected, When the door is opened, the actuator enters a normal assist mode in which a positive assist force in the door opening direction is generated by the actuator. When the obstacle detection means detects an obstacle, the door closes the entrance / exit when the door is opened. The door by the actuator is in a collision suppression mode in which the door can be opened at least halfway in the door turning section that reaches the collision position where it collides with the obstacle while the collision between the obstacle and the door is suppressed. It is configured to control the assist.

  The actuator is a motor 1010 that can rotate in both forward and reverse directions, and is configured by a DC motor in this embodiment (of course, other types of motors such as an induction motor, a brushless motor, and a stepping motor may be used). The actuator control means rotates the motor in the forward direction in the positive assist mode, and rotates the motor 1010 in the reverse direction in the reverse assist mode. In this embodiment, the actuator control means is a bidirectional linear control type using a push-pull transistor circuit. The motor driver 1007 constitutes an actuator control means.

  Specifically, the motor driver 1007 includes a forward driving transistor 1073 connected to a positive power supply (voltage Vcc) and a reverse driving transistor 1074 connected to a negative power supply (voltage −Vcc). The drive instruction voltage VD is voltage-adjusted by the resistor 1071 and input to the base terminals of the transistors 1073 and 1074. A resistor 1072 is a feedback resistor for amplification, and a part of the collector-emitter current of both transistors 1073 and 1074 is converted into a voltage and returned to the base of each transistor. Thus, when VD is positive, the forward driving transistor 1073 causes the motor 1010 to pass a current proportional to VD, respectively, when the VD is negative. Accordingly, when the VD is positive, the motor 1010 rotates in the positive assist mode. When the VD is negative, the motor 1010 rotates in the reverse direction. The assist force is determined by a motor current corresponding to VD. The driving transistors 1073 and 1074 are provided with overcurrent protection transistors 1073t and 1074t, respectively. Reference numerals 1073R and 1074R denote overcurrent detection resistors, and reference numerals 1073D and 1074D denote flyback diodes.

  The door assist mechanism 541 is provided with an operation force detecting means 1002 for detecting the operation force of the door 1101, and as shown in FIG. 43 as a state (A) and a state (B), the actuator control means performs a positive assist mode. The operation of the actuator 1010 is controlled so that the positive assist force increases as the door operation force detected by the operation force detection means 1002 decreases. That is, when a person with weak power tries to open the door 1101, the positive assist force by the motor 1010 acts strongly and the door 1101 can be opened easily. On the other hand, when a strong person tries to open the door strongly, the positive assist force works relatively weakly. For example, if the control is performed so that the sum of the door opening torque generated by the external operating force and the door opening torque generated by the positive assist force is substantially constant, the door 1101 can be opened with a substantially constant standard torque regardless of who is operated. it can.

  In the circuit of FIG. 41, the above functions are realized as follows. The operating force detection means 1002 is a torque sensor 1002 provided on the door turning shaft 1103 as shown in FIG. 40, and the torsion torque generated in the door turning shaft 1103 appears more greatly as the door opening operating force acts more strongly. The output voltage of the sensor 1002 increases. Since the output voltage of the torque sensor 1002 is positive when the door is opened and negative when the door is closed, the direction of torque can be detected by the sign of the voltage. In the present embodiment, the output voltage of the torque sensor 1002 is amplified by the non-inverting amplifier 1003 and is output as the torque detection voltage Vst via the voltage follower 1004.

  The torque detection voltage Vst is input to the differential amplifier circuit 1005. The differential amplifier circuit 1005 compares the torque detection voltage Vst with the reference voltage Vref1, amplifies the difference ΔV (= Vref1−Vst) with a constant gain, and outputs it as a drive instruction voltage VD for the motor 1010. When the opening operation of the door 1101 is started, since the torque detection voltage Vst is initially small, ΔV is large, the output current of the motor 1010 is also large, and a large positive assist force is activated. Since the torque due to the positive assist force is superimposed on the door turning shaft 1103 together with the torque due to the external operation force, the torque detection voltage Vst increases by the contribution due to the positive assist force. Then, ΔV decreases and ΔV decreases. That is, when the torque by the positive assist force is returned to the door turning shaft 1103, the total torque of the external operation force and the positive assist force is reflected in the torque detection voltage Vst, and the door assist by the motor 1010 is made so as to approach Vref1. The drive is feedback controlled. As a result, in the case of a weak person, the assist motor current (that is, the assist torque AT) is kept large as much as the contribution by the external operation force is reduced. Conversely, in the case of a strong person, the assist motor current is It will be kept small.

  As is well known, the door 1101 can be opened and closed by either the vehicle exterior operation knob 1104E or the vehicle interior operation knob 1104. When the lock button 1104 is tilted, a known door lock mechanism 1320 shown in FIG. The door opening / closing operation by the knobs 1104E and 1104 becomes impossible. When the door lock mechanism 1320 is in a locked state, a door lock signal DRS is output and used for stop control of the motor 1010. In the present embodiment, the switch 1021 that has received the door lock signal DRS disconnects the reference voltage Vref1 from the differential amplifier circuit 1005, and shorts the inverting input terminal and the non-inverting input terminal of the differential amplifier circuit 1005. The input ΔV and thus the drive instruction voltage VD to the motor 1010 is forcibly set to zero to stop driving the motor 1010.

  In the circuit of FIG. 41, a comparator 1020 is provided that outputs an assist control signal SK1 when the sign of the torque detection voltage Vst becomes negative. A logical sum of the door lock signal DRS and the assist prohibition signal SK1 is input to the control terminal of the switch 1021 via the gate 1304, and the motor 1010 of the assist system SYS1 is controlled to stop even when the assist control signal SK1 is detected. It has come to be.

  Further, obstacle detection means for detecting an obstacle outside the vehicle that interferes with the door 1101 when the door 1101 is opened is provided. As the obstacle detection means, one that detects an obstacle that faces the side surface of the door 1101 can be adopted. If it does in this way, the obstacle which exists in the direction which the door 1101 opens can be detected correctly. As such an obstacle detection means, for example, a well-known proximity switch, a reflection optical sensor (including an infrared sensor), or an obstacle sensor 1050 such as an ultrasonic sensor can be employed.

  The detection output of the obstacle sensor 1050 is compared with a threshold value by the comparator 1051, and a signal indicating the presence / absence of detection of the obstacle is output in a binary manner. When the door 1101 is opened from the inside and is detected by the obstacle sensor 1050, the angular position of the door 1101 when the obstacle is detected becomes the limit angle position, and the detection signal SI ′ means that there is an obstacle. Is output, and the door assist control means that receives this performs control to prevent the subsequent door opening operation. In this embodiment, when the door 1101 reaches the limit angle position, the obstacle door turning lock mechanism 1300 for preventing the door from turning thereafter is provided as part of the door assist control means. .

  FIG. 42 shows a configuration example of the lock portion of the lock mechanism 1300. The main part of the lock part is a door side engaging part (male spline in this embodiment) 1312 provided on the turning shaft 1103 of the door 1101 and a vehicle body side fixed to the door side engaging part 1312. A vehicle body side engaging portion (female spline in this embodiment) 1313 that is detachably engaged at an arbitrary angle phase corresponding to the turning angle 1103 and locks the turning of the turning shaft 1103 at the angle phase of the engaged state. And have. The vehicle body side engaging portion 1313 is provided so as to be able to approach and separate from the door side engaging portion 1312 in the axial direction of the turning shaft 1103, and is locked with the vehicle body side engaging portion 1313 when approaching, and unlocked when separated. It becomes. In this embodiment, this approach / separation mechanism is configured by a known solenoid mechanism (cylinder mechanism or the like). The vehicle body side engaging portion 1313 is attached to the tip of a drive shaft 1314 having a spring receiving portion 1314B, and this drive shaft 1314 is driven by a solenoid 1301 that is driven to advance and retract in the axial direction by a solenoid 1301 housed in the case 1300C. When energized, the drive shaft 1314 pops out, and the vehicle body side engaging portion 1313 engages with the door side engaging portion 1312. On the other hand, when the solenoid is de-energized, the bias spring 1310 that engages with the spring receiving portion 1314B is elastically restored, and the drive shaft 1314 is retracted to disengage the vehicle body side engaging portion 1313 and the door side engaging portion 1312. Is done.

  As shown in FIG. 41, when the obstacle detection signal SI ′ is output, the drive switch (transistor: reference 1302 is a flyback diode for protection) 1303 is turned on, the solenoid 1301 is energized, and FIG. The vehicle body side engaging portion 1313 and the door side engaging portion 1312 engage with each other. At this time, the door 1101 is approaching an obstacle at an indeterminate position outside the vehicle. If it is, it will be locked at that angle. That is, the limit angle position is variably determined according to the door angle position when the obstacle detection unit detects the obstacle (that is, according to the position of the obstacle). Thereby, regardless of the relative distance of the obstacle with respect to the automobile, if the door approaches by the opening operation, the door opening operation is prevented so as not to hit the obstacle. At this time, since the opening operation of the door 1101 is hindered even if a positive assist force is generated by the motor 1010, it is clear that the door assist by the actuator is controlled so that the collision suppression mode is set.

  When the door operation signal EDS indicates a state in which the door is operated from the outside of the vehicle, the door assist suppression control mechanism (here, the door for obstacles) is used regardless of the detection output of the obstacle sensor 1050. The operation of the turning lock mechanism 1300) is restricted. Specifically, the detection signal SI ′ of the obstacle sensor 1050 binarized by the comparator 1051 and the binary external door operation signal EDS (when the door is operated from the outside, the opposite sign to the detection signal SI) This function is realized by using the logical product output SI of the gate 1051a as the drive signal of the drive switch 1303 described above.

  Instead of using the swing type door having the assist mechanism as described above, it is also possible to adopt a known electric automatic opening / closing mechanism or an electric slide type door having an assist mechanism.

    FIG. 44 is a functional block diagram illustrating a configuration example of the noise canceller 1001B. The main part of the noise canceller 1001B includes an active noise control mechanism main body 2010 that forms noise suppression means, and a necessary sound enhancement part (means) 2050. The active noise control mechanism 2010 is a noise that synthesizes an in-vehicle noise detection microphone (noise detection microphone) 2011 that detects noise invading into the vehicle, and a noise control waveform that is opposite in phase to the noise waveform detected by the in-vehicle noise detection microphone 2011. A control waveform synthesis unit (control sound generation unit) 2015. The noise control waveform is output from the noise control speaker 2018. There are also provided an error detection microphone 2012 for detecting an unerased noise component included in the vehicle interior sound after the noise control sound wave is superimposed, and an adaptive filter 2014 for adjusting a filter coefficient in a direction in which the level of the unerased noise is reduced. ing.

  Vehicle interior noise having a sound source in the vehicle itself includes engine sound, road surface sound, wind noise, etc. A plurality of vehicle interior noise detection microphones 2011 are distributed and arranged at positions suitable for detection of individual vehicle interior noise. ing. The vehicle interior noise detection microphones 2011 are at different positions as viewed from the passenger J, and there is a considerable phase difference between the noise waveform at the position picked up by the microphone 2011 and the noise waveform actually heard by the passenger J. . Therefore, in order to match this phase difference, the detection waveform of the vehicle interior noise detection microphone 2011 is appropriately supplied to the control sound generation unit 2015 via the phase adjustment unit 2013.

  Next, the necessary sound enhancement unit 2050 is configured to include an enhancement sound detection microphone 2051 and a necessary sound extraction filter 2053, and an extraction waveform of the necessary sound is given to the control sound generation unit 2015. Also here, the phase adjustment unit 2052 is provided as appropriate due to the same situation as the vehicle interior noise detection microphone 2011. The emphasis sound detection microphone 2051 includes an in-vehicle microphone 2051 for capturing a necessary sound outside the vehicle and an in-vehicle microphone 2051 for capturing a necessary sound inside the vehicle. Both can be configured with known directional microphones, and are mounted on the outside of the vehicle so that the angle range with strong directivity for sound detection faces the outside direction of the vehicle and the angle range with low directivity faces the inside direction of the vehicle. In the present embodiment, the entire microphone 2051 is attached so as to go out of the vehicle, but the inside area of the vehicle is set so that the angle area with low directivity is located inside the vehicle and only the angle area with strong directivity goes out of the car. It can also be installed across the outside of the vehicle. On the other hand, the in-vehicle microphone 2051 has a low directivity because the sound detection directivity angle range faces the front of the passenger so that the passenger's conversation sound can be selectively detected corresponding to each seat. It is attached so that the angle range faces in the opposite direction. Each of these emphasized sound detection microphones 2051 is connected to a necessary sound extraction filter 2053 that preferentially passes a necessary sound component of its input waveform (detected waveform). The audio input of the car audio system 515 in FIG. 1 is used as the in-vehicle necessary sound source 2019. The speaker output sound of this audio device (the speaker may be used as the noise control speaker 2018 or may be provided separately) is controlled so as not to be canceled even if the noise control waveform is superimposed.

  FIG. 45 shows an example of a hardware block diagram corresponding to the functional block diagram of FIG. A first DSP (Digital Signal Processor) 2100 constitutes a noise control waveform synthesis unit (control sound generation unit) 2015 and an adaptive filter 2014 (and further a phase adjustment unit 2013), and an in-vehicle noise detection microphone 2011 is a microphone amplifier. 2101 and an A / D converter 2102, and a noise control speaker 2018 are connected via a D / A converter 2103 and an amplifier 2104, respectively. On the other hand, the second DSP 2200 constitutes an extraction unit for the noise component to be suppressed, and the error detection microphone 2012 is not subject to suppression through the microphone amplifier 2101 and the A / D converter 2102 or audio input. An audio signal source, that is, a necessary sound source 2019 is connected via an A / D converter 2102.

  The necessary sound enhancement unit 2050 includes a third DSP 2300 that functions as a necessary sound extraction filter 2053, and a necessary sound detection microphone (emphasis sound detection microphone) 2051 is connected via a microphone amplifier 2101 and an A / D converter 2102. Yes. The third DSP 2300 functions as a digital adaptive filter. The filter coefficient setting process will be described below.

  Recognize caution and danger of emergency vehicles (ambulances, fire trucks, police cars, etc.) sirens, railroad crossing alarms, subsequent vehicle horns, whistle, human screams (children crying, women screaming, etc.) It is determined as necessary outside vehicle sound (emphasized sound), these sample sounds are recorded on a disk or the like, and are made into a library as reference emphasized sound data that can be read and reproduced. As for the conversation sound, a plurality of individual model sounds are similarly stored in a library as reference emphasized sound data. In addition, if the boarding candidate is fixedly fixed, if the model voice is prepared as reference enhancement sound data by the utterance of the model voice itself, the boarding candidate will get on Can enhance the accuracy of conversation sound.

  Then, an appropriate initial value is given to the filter coefficient, and the enhancement sound detection level by the enhancement sound detection microphone 2051 is set to the initial value. Next, each reference emphasis sound is read and output, and is detected by the emphasis sound detection microphone 2051. Then, the passing waveform of the adaptive filter is read, and the level of the waveform that has passed as the reference enhancement sound is measured. The above process is repeated until the detection level reaches the target value. In this way, the filter coefficient is subjected to learning processing so that the reference emphasis sound is successively replaced for both the vehicle exterior sound and the vehicle interior sound (conversation sound), and the detection level of the passing waveform is optimized. The necessary sound is extracted from the input waveform from the emphasized sound detection microphone 2051 by the necessary sound extraction filter 2053 having the filter coefficient adjusted as described above, and the extracted enhanced sound waveform is transferred to the second DSP 2200. The second DSP 2200 calculates a difference between the input waveform from the necessary sound source (audio output here) 2019 and the extracted enhanced sound waveform from the third DSP 2300 from the detection waveform of the in-vehicle noise detection microphone 2011.

  The filter coefficients of the digital adaptive filter incorporated in the first DSP 2100 are initialized prior to use of the system. First, various noises to be suppressed are determined, and those sample sounds are recorded on a disk or the like, and are made into a library as reproducible reference noise. Then, an appropriate initial value is given to the filter coefficient, and the noise level left by the error detection microphone 2012 is set to the initial value. Next, the reference noise is sequentially read out and output, and detected by the vehicle interior noise detection microphone 2011. The detection waveform of the vehicle interior noise detection microphone 2011 that has passed through the adaptive filter is read, and this is subjected to fast Fourier transform to decompose the noise detection waveform into sinusoidal elementary waves having different wavelengths. Then, an inverted elementary wave obtained by inverting the phase of each sine wave elementary wave is generated and synthesized again to obtain a noise control waveform having a phase opposite to that of the noise detection waveform. This is output from the noise control speaker 2018.

  If the coefficient of the adaptive filter is appropriately determined, only the noise component should be efficiently extracted from the waveform of the vehicle interior noise detection microphone 2011. Therefore, the noise control waveform synthesized based on the noise is used to generate the interior of the vehicle. Noise can be offset without excess or deficiency. However, if the setting of the filter coefficient is not appropriate, the waveform component that is not canceled out remains as a noise component. This is detected by the error detection microphone 2012. The level of the unerased noise component is compared with the target value. If the level is not lower than the target value, the filter coefficient is updated, and the same processing is repeated until it becomes lower than the target value. In this manner, the reference noise is replaced one after another, and the filter coefficient is subjected to learning processing so that the unerased noise component is minimized. During actual use, the noise component that remains unerased is constantly monitored, the filter coefficient is updated in real time so that it is always minimized, and the same processing as described above is performed to leave the necessary sound wave component. Only the noise level in the vehicle can be effectively reduced.

  Next, the user-side terminal device 1 is configured as a mobile phone as shown in FIG. 14 in the present embodiment (hereinafter also referred to as “mobile phone 1”). The mobile phone 1 includes a monitor 308 configured with a liquid crystal display, an input unit 305 including a keyboard, a transmitter 304, a receiver 303, and the like. A pulse sensor (heart rate sensor) 342 is also provided on the side surface.

  FIG. 15 is a block diagram showing an example of the electrical configuration of the mobile phone 1. The main part of the circuit includes an input / output unit 1311 and a control unit 310 including a CPU 312, a ROM 314, a RAM 313, and the like connected thereto. An input unit 305 and an on-hook / off-hook switch 306 are connected to the input / output unit 1311. The receiver 303 is connected to the input / output unit 1311 via the amplifier 315 and the D / A converter 316, and the transmitter 304 is connected to the input / output unit 1311 via the amplifier 317 and the A / D converter 318. Furthermore, a well-known GPS 554 for acquiring position information of the mobile phone 1 is connected to the input / output unit 1311.

  In this embodiment, in order to grasp the distance and azimuth relationship between the user side terminal device 1 and the vehicle, the user side terminal device 1 is provided with the GPS 554 in addition to the GPS 533 (FIG. 1) on the vehicle side, A method is adopted in which the terminal device 1 can independently acquire the position information, and the terminal position information is transmitted to the vehicle side via the wireless communication network. As a result, the vehicle side can acquire both the accurate vehicle position by the GPS 533 connected to itself and the accurate terminal position by the GPS 554 received from the user side terminal device 1, and the user side terminal device 1 and the vehicle The distance and azimuth relationship can be grasped very accurately. Moreover, the distance change and the approach direction change between the user-side terminal device 1 and the vehicle can be grasped in real time.

  Returning to FIG. 15, a communication device 323 is connected to the input / output unit 1311 of the mobile phone 1. The communication device 323 includes a connection interface 331 for connecting to the control unit 310, a modulator 332, a transmitter 333, a frequency synthesizer 334, a receiver 335, a demodulator 336, a duplexer 337, and the like connected thereto. ing. The data signal from the control unit 310 is modulated by the modulator 332 and further transmitted from the antenna 339 via the duplexer 337 by the transmitter 333. On the other hand, the received radio wave is received by the receiver 335 via the antenna 339 and the duplexer 337, demodulated by the demodulator 336, and then input to the I / O port 1311 of the control unit 310. When making a call, for example, an audio signal input from the transmitter 304 is amplified by the amplifier 317, further digitally converted by the A / D converter 318, and input to the control unit 310. The signal is processed by the control unit 310 as necessary, and then output from the receiver 303 via the D / A converter 316 and the amplifier 315.

  On the other hand, the connection interface 331 is connected to a control radio wave transmitter 338 that transmits a control radio wave. The control radio wave is transmitted from the antenna 339 via the duplexer 337. When the mobile phone 1 moves to another communication zone, the network-side radio network controller performs a known handover process based on the reception status of the control radio wave.

  Next, the mobile phone 1 is provided with the following functions for outputting ringtones and playing music. That is, ringtone data and music data (MPEG3 data or MIDI data: also used as a ringtone) downloaded by wireless reception are stored in the sound data flash ROM 316. In the case of MIDI data, musical tone data in which tone color, pitch, tone length, tempo, etc. are described according to the MIDI code is sent to the musical tone synthesis unit 307. The tone synthesizer 307 reads the waveform data of the specified tone color from the waveform ROM 358 functioning as a sound source while buffering the tone data, converts the frequency so that the pitch specified by the MIDI code is obtained, and specifies the tone data. This is sequentially output as digital waveform data according to the set tempo. The output digital waveform data is output from the speaker 311 via the analog conversion circuit 359 and the amplifier 350. Note that sound data composed of compressed waveform data such as MPEG3 is output from the speaker 311 via the analog conversion circuit 359 and the amplifier 350 after being decoded. In this embodiment, the timing information of the voice output by the tone synthesizer 357 is input to the sequencer 352, and the vibrator unit 354 and the LED unit 355 are driven in synchronization with music via the PWM unit 353, so that the sound output from the mobile phone 1 is output. The device has been devised to further enhance the hospitality effect in combination with vibration and LED light emission.

Next, the hospitality decision making unit 2 is connected to the following sensor / camera group. Some of these function as scene estimation information acquisition means and function as a biological state detection unit.
External camera 518: Takes a picture of a user approaching the car. Acquire user gestures and facial expressions as still images or videos. In order to magnify a user for photographing, an optical zoom method using a telephoto lens and a digital zoom method for digitally enlarging a photographed image can be used in combination.
Infrared sensor 519: Takes a thermography based on the infrared rays emitted from the face portion of the user approaching or riding the vehicle. By functioning as a body temperature measurement unit that is a biological state detection unit and measuring the temporal change waveform, it is possible to estimate the user's physical condition or mental state.

Seating sensor 520: Detects whether the user is seated on the seat. It can be composed of a proximity switch or the like embedded in the automobile seat. In addition, a seating sensor can be configured by a camera that captures a user seated on a seat. With this method, when a load source other than a person such as luggage is placed on the seat, it can be distinguished from a case where a person is seated, for example, a hospitality operation is performed only when a person is seated. Selection control is also possible. In addition, if a camera is used, it is possible to detect the motion of a seated user, and the detection information can be further diversified. In order to detect the user's movement on the seat, there is a method using a pressure sensor mounted on the seat.

  Further, in the present embodiment, as shown in FIG. 58, the posture of the seated user (driver) is based on the detection outputs of the seating sensors 520A, 520B, and 520C that are embedded in a plurality of seats and backrests of the seat The change is detected as a waveform. Both are configured by a pressure sensor that detects a seating pressure, and specifically, a reference sensor 520A is arranged at the center of the back of a user seated facing the front. The remaining sensor is composed of a left sensor 520B arranged to be deviated to the left side of the seat and a right sensor 520C arranged to be deviated to the right side of the seat. The difference between the output of the reference sensor 520A and the output of the right sensor 520C and the output of the left sensor 520B is calculated by the differential amplifiers 603 and 604, respectively. Input to the amplifier 605. The posture signal output Vout (second-type biological state parameter) is substantially a reference value (here, zero V) when the user is sitting facing the front, and when the posture is biased to the right, the output of the right sensor 520C is output. Since the output of the left sensor 520C decreases and shifts to the negative side, when the posture is biased to the left, the opposite is true and shifts to the positive side. Note that the right sensor 520C and the left sensor 520B are output by the adders 601 and 602 as an added value of the sensor output on the seat side and the sensor output on the back side, but the remaining sensor output and the back sensor output are output. (When doing so, the output on the backrest sensor side decreases when the driver turns forward, and the difference value increases, so this is detected as a larger posture collapse.) be able to.

-Face camera 521: Photographs the facial expression of the user who is seated. As shown in FIG. 49, the upper body including the face of the user (driver) who is attached to the rearview mirror 331 and the like and is seated on the seat is photographed obliquely from above the driver 337 from the front glass 337 side. The facial expression image is cut out from the image, and various facial expressions shown in FIG. 59 can be specified by comparing various facial expressions of the user with a master image prepared in advance. Regardless of the physical condition or physical condition, the order of facial expressions is determined in order of favorable condition, and points are assigned according to the order (for example, in the case of mental state, stability is “1”, distraction and anxiety “2”, excitement / anger is set to “3”, etc.), facial expressions can be used as discrete numerical parameters (second-type biological state parameters), and their temporal changes can be measured as discrete waveforms. Based on the waveform, it is possible to estimate a mental state or a physical condition. Note that a change in the posture of the driver can also be detected from the image shape of the upper body including the face and the position of the center of gravity on the image. That is, the change waveform of the center of gravity position can be used as a change waveform of posture (second-type biological condition parameter), and it is possible to estimate a mental state or a physical condition based on the waveform. In addition to the function as an acquisition source (biological condition detection unit) of user biological condition information used for hospitality control, it is also used for user authentication by biometrics. It is also possible to specify the direction of the face and line of sight by detecting the direction of the iris of the eyes (for example, if you look at the direction of the clock at times, it is estimated that you are impatient with time) Etc.) Further, based on the temporal change waveform of the angle of the line-of-sight direction (detecting the shake angle to the left and right with respect to the reference direction as a reference direction when the head is facing directly in front as the waveform change) (second-type biological condition parameter), It is also used to estimate the physical condition or mental state of the driver.
Microphone 522: Detects user voice. This can also function as a biological state detection unit.

Pressure sensor 523: It is attached to the grasping position of the steering wheel or shift lever of the vehicle by the user, and detects the gripping force of the user, the repetition frequency of gripping and releasing, etc. (biological state detection unit).
Blood pressure sensor 524: As shown in FIG. 50, the blood pressure sensor 524 is attached to the user grasping position of the steering wheel of the automobile (biological condition detection unit). The blood pressure value detected by the blood pressure sensor 524 is recorded as a waveform of the temporal change (first-type biological condition parameter), and is used for estimating the physical condition or mental condition of the driver based on the waveform.
Body temperature sensor 525: As shown in FIG. 50, the body temperature sensor 525 includes a temperature sensor attached to the user grasping position of the steering wheel of the automobile (biological condition detection unit). The body temperature value detected by the body temperature sensor 525 is recorded as a waveform of the temporal change (first type biological condition parameter), and is used to estimate the physical condition or mental state of the driver based on the waveform.
Skin resistance sensor 545: a well-known sensor that measures the resistance value of the body surface due to perspiration or the like, and is attached to a user grasping position of a car handle as shown in FIG. The skin resistance value detected by the skin resistance sensor 545 is recorded as a waveform of the temporal change (first type biological condition parameter), and is used to estimate the physical condition or mental condition of the driver based on the waveform.

Retina camera 526: Takes a user's retina pattern and is used for user authentication by biometrics.
49. Iris camera 527: As shown in FIG. 49, the camera is attached to a rearview mirror 331 or the like, takes an image of the user's iris (iris), and is used for user authentication by biometrics. When an iris image is used, collation / authentication is performed using the personality of the pattern and color. In particular, the iris pattern is an acquired component and has a low genetic influence, so there is a significant difference even in identical twins, and there is an advantage that it can be reliably identified. An authentication method using an iris pattern has features that it can quickly recognize and collate and has a low misidentification rate. Further, the physical condition or the mental condition can be estimated based on the temporal change of the pupil size (second type biological condition parameter) of the driver photographed by the iris camera.
Vein camera 528: The user's vein pattern is photographed and used for user authentication by biometrics.
-Door courtesy switch 537: Detects opening and closing of the door. It is used as a scene estimation information acquisition means for detecting the transition to the boarding scene and the getting-off scene.

  In addition, the output of the ignition switch 538 for detecting the start of the engine is branched and input to the hospitality determination unit 2. An illuminance sensor 539 for detecting the brightness level in the vehicle and a sound pressure sensor 540 for measuring the sound level in the vehicle are also connected to the hospitality decision making unit 2 in the same manner.

  Further, the hospitality decision making unit 2 may be a touch panel (a touch panel superimposed on the monitor of the car navigation system 534 may be used: in this case, input information is transferred from the hospitality execution control unit 3 to the hospitality decision making unit 2 And the like, and a storage device 535 configured by a hard disk drive or the like that functions as a hospitality operation information storage unit.

  On the other hand, the hospitality execution control unit 3 is also connected with a GPS 533 (also used in the car navigation system 534), a brake sensor 530, a vehicle speed sensor 531 and an acceleration sensor 532 for acquiring vehicle position information.

  The hospitality decision-making unit 2 acquires user biological state information including at least one of the personality, mental state, and physical condition of the user from detection information of one or more of the sensor / camera groups 518 to 528, and includes the contents thereof In response, it determines what hospitality operation is to be performed by which hospitality operation unit, and commands this to the hospitality execution control unit 3. In response to this, the hospitality execution control unit 3 causes the corresponding hospitality operation units 502 to 517, 534, 541, 548, 549, 550, 551, 552, and 1001B to execute the hospitality operation. That is, the hospitality decision making unit 2 and the hospitality execution control unit 3 cooperate with each other, and the hospitality operation units 502 to 517, 534, 541, 548, 549, 550, The function of changing the operation contents of 551, 552, and 1001B is realized. The hospitality execution control unit 3 is connected to a wireless communication device 4 that constitutes a vehicle side communication means (host side communication means). The wireless communication device 4 communicates with a user-side terminal device (mobile phone) 1 carried by a user of an automobile via a wireless communication network 1170 (FIG. 15).

  On the other hand, the car audio system 515 is provided with an operation unit 515d (FIG. 17) that is manually operated by the user, and by inputting music selection data from the operation unit 515d, desired music source data can be read and played. The volume / tone control signal from the operation unit 515d is input to the preamplifier 515g. This music selection data is transferred from the interface unit 515a to the hospitality decision making unit 2 via the hospitality execution control unit 3 of FIG. Based on the stored contents, a user-personality determination process described later is performed (that is, the operation unit 515d of the car audio system 515 can be said to constitute the function of the biological state detection unit).

  FIG. 18 shows an example of the database structure of the music source data, in which music source data (MPEG3 or MIDI) is stored in association with the song ID, song name, and genre code. In addition, each music source data includes the personality type estimated for the user who selected the music (“active”, “adult”, “optimistic”, “pessimistic”, “degenerate”, “ ”,“ Intellect ”,“ Romanticist ”, etc., as well as the age code (“ Infant ”,“ Children ”,“ Junior ”,“ Youth ”,“ Middle Age ”,“ Midpoint ”,“ Middle Age ”) , “Respect for the elderly”, “age unrelated”, etc.) and gender codes (“male”, “female” and “gender unrelated”) are stored in association with each other. The personality type code is one of user personality specifying information, and the age code and the sex code are sub-classes that are unrelated to the personality. Even if the personality of the user can be identified, if the music source that does not match the age group or gender is selected, the effect of “hospitality” to entertain the user is halved. Therefore, in order to further narrow down the suitability of the music source provided to the user, the sub-classification as described above is effective.

  On the other hand, each music source data also stores a song mode code in association with each other. The song mode code is data indicating the mental state and physical condition of the user who selected the song, and the relationship between the song and the song. In the present embodiment, the song mode code is “smooth”, “exhilarating”, “warm / healing”. And “Healing / α-wave system”. Since the personality type code, age code, gender code, genre code, and song mode code are data that are referred to when selecting the hospitality content specific to each user, these are collectively referred to as hospitality reference data. .

  In the ROM (or storage device 535) of the hospitality decision-making unit 2 in FIG. 1, a hospitality decision-making table 360 for storing hospitality contents for each scene is stored as shown in FIG. In this embodiment, an approach scene SCN1, a boarding scene SCN2, a preparation scene SCN3, a driving / staying scene SCN4, an exit scene SCN5, and a leaving scene SCN6 are set in this order in this order. Further, the following five hospitality genres (ST) are set for each scene, and one or more hospitality themes (OBJ) are set for each scene. The genre governs a plurality of themes for each scene, and belongs to the concept of “theme” in a broad sense.

  As will be described later, the approach scene is specified by the user-side GPS 554 and the car-side GPS 533 to identify the relative distance between the car and the user located outside the car and its change, and the user determines the car in advance. This is done by detecting the approach within a given distance. The boarding scene and the getting-off scene are specified based on the door opening detection output of the door courtesy switch 537. However, since it is not possible to specify whether it is a boarding scene or a getting-off scene only by door opening information, FIG. Thus, the scene flag 350 is provided to cope with this. The scene flag 350 has an individual scene flag corresponding to each scene, and each time a scene whose arrival order is determined in time series arrives, the flag corresponding to the scene is set to “arrival (flag value 1)”. I will do it. By specifying the latest flag of which the value is “1” in the scene flag 350 (the last one in the “1” flag row), it is possible to specify which scene is currently advanced.

  The preparation scene and the scene driving / staying scene are both specified by whether or not the above-mentioned seating sensor detects the user, but until the ignition switch 538 is turned on after entering the automobile, or It is recognized as a preparation scene until the ignition switch 538 is not turned ON and the continuation of sitting beyond a certain level is confirmed. Further, the transition to the leaving scene is identified by the door courtesy switch 537 detecting the door closing after the getting-off scene.

  The hospitality operation in each theme is controlled by the operation control application of the corresponding hospitality operation unit, and as shown in FIG. 6, these operation control applications are in the form of a theme application library 351 in the ROM (or the hospitality execution control unit 3). Stored in the storage device 535). The theme determined on the hospitality decision making unit 2 side is notified to the hospitality execution control unit 3, and the operation control application of the corresponding theme is read and executed there. When executing a motion control application, the priority of adoption is determined in advance according to the degree of user-oriented hospitality for multiple hospitality operations managed under each hospitality theme. The theme (or scene) is selected from the plurality of prepared hospitality operations having the highest priority. Specifically, as illustrated in FIGS. 7 to 13 (detailed later), the operation priority of a plurality of hospitality operation units (hospitality functions) (the larger the number, the higher the priority is displayed) Are selected for each hospitality theme and stored in the ROM of the hospitality execution control unit 3. That is, the function selection tables 371 and 372 identify a plurality of hospitality operation units that can be used in each scene, and preferentially according to the content of disturbance received by the user among the plurality of hospitality operation units that can be used. It shows the correspondence between what is used and the content of the disturbance.

  The operation of the automobile user hospitality system (hereinafter also simply referred to as “system”) 100 will be described below. 46 to 48 conceptually show an overall algorithm of a series of processes from hospitality decision making to hospitality operation execution in the system 100 (these three figures are shown by using corresponding round numbers as connectors, It should be read as a connection diagram). The hospitality main processes are “objective estimation (δ1)”, “personality adaptation (δ2)”, “state adaptation (δ3)”, “production correspondence (δ4)”, “function selection (δ5)”, “drive (δ6)”. And “state confirmation (δ7)”.

  First, in “objective estimation (δ1)”, the current scene is estimated by user position detection (β1) and user motion detection (β2). Specifically, the user position detection (β1) is performed by grasping and specifying the relative positional relationship (α1) between the user and the automobile. In the present embodiment, the user approach direction (α2) is also considered. On the other hand, the user motion detection (β2) is basically performed by sensors (scene estimation information acquisition means) that detect motions fixed for scene determination, such as door opening / closing operations and seating on a seat. The output is used (α6). Further, as in the case of detecting the transition from the preparation scene to the driving / staying scene based on the seating duration, the duration (α7) of the specific operation is also taken into consideration.

  FIG. 3 is a flowchart showing a flow of scene determination processing. This process is repeatedly executed at regular intervals during use of the automobile. First, in S1, the scene flag 350 in FIG. 5 is read. S2, S5, S8, S12, S16, and S20 are processes for determining which scene is currently advanced from the state of the scene flag 350. The scene flag 350 is set in order from the flag of the scene positioned earlier in time series, and the flag of the subsequent scene is not set once with the preceding scene interposed. .

  S2 to S4 are approach scene specifying processing. First, in S2, it is confirmed that the flag SCN1 for the approach scene is not “1” (that is, the approach scene has not yet arrived), and in S3, the GPS 533 ( From FIG. 1) and position information specified by the GPS 554 on the user side (mobile phone 1: FIG. 15), it is determined whether or not the user has approached the vehicle within a certain distance (for example, 50 m or less). If it is approaching, it is determined that the approach scene has been entered, and SCN1 is set to "1" in S4.

  S5 to S7 are boarding scene specifying processes. In S5, it is confirmed that the flag SCN2 for the boarding scene is not “1”, and in S6, it is determined whether the door is opened from the input information from the door courtesy switch 537. . If the door is open, it is determined that the boarding scene has been entered, and SCN2 is set to "1" in S7. Since it is confirmed that the current scene is SCN = 1, that is, an approaching scene, it is possible to easily determine that the “door open” in this situation is at the time of boarding.

  In the approaching scene and the boarding scene, if the user's approach to the car is for “riding → driving”, as described above, the hospitality operation may be performed on the premise of boarding. However, there may be a user approach that does not aim to “get on board → drive”, such as checking forgotten things in a car. In such a case, even if the user has approached the car, it may not be easy to shift to the riding operation (for example, the user simply looks into the car from the outside of the window, or to the handle of the door). For example, if you get stuck in your hand and don't move on to opening the door). Therefore, at the timing of transition from the preceding scene to the succeeding scene, a question for confirming the user's purpose in the succeeding scene is output as audio from a speaker or the like, and response information from the user (sound via the microphone) Based on the input), it is possible to determine the hospitality operation content in the subsequent scene. An example is shown below.

That is, when the user approaches the automobile and stops in front of the door and the operation is stagnant, the hospitality control unit proceeds with the hospitality control process just before the transition to the boarding scene. And if the user does not shift to opening the door for a certain period of time,
"Oh, don't you ride? I was glad that you came."
And so on. The user
“Hey, I just came to see if there was something left behind.
Suppose that The hospitality decision-making unit analyzes the contents of this answer and launches a hospitality operation module for confirming lost items from the keyword “forgotten things”.
“Then, look inside because it brightens the inside.”
In addition to the above message, the interior lighting is turned on brighter than usual, and a window is opened with a power window to make it easier to check inside.

  S8 to S11 are preparation scene specifying processes. In S8, it is confirmed that the flag SCN3 for the preparation scene is not “1”, and in S9, it is determined whether the user is seated from the input information from the seating sensor 520. If the user's seating is detected, it is determined that the preparation scene has been entered, and SCN3 is set to “1” in S10. At this stage, it is only detected that the seating has been completed, and it is only necessary to specify that the user is in a preparation stage to make a full transition to driving or staying in the vehicle. In S11, a seating timer used for determining the transition to the driving / staying scene is started.

  S12 to S15 are driving / staying scene specifying processing. In S12, it is confirmed that the flag SCN4 for the driving / staying scene is not “1”, and in S13, it is determined whether or not the user has started the engine from the input information from the ignition switch 538. If the engine has been started, it is immediately determined that the operation / stay scene has been entered, jumping to S15 and setting SCN4 to "1". On the other hand, even if the engine has not been started, if the seating timer has elapsed for a certain time (t1), it is determined that the user has boarded to stay in the vehicle (for example, for purposes other than driving), and the process proceeds to S15 and SCN4 Is set to “1” (if t1 has not elapsed, S15 is skipped in order to continue the preparation scene.

  S16 to S19 are processing for specifying the getting-off scene. In S16, it is confirmed that the flag SCN5 for the getting-off scene is not “1”, and in S17, it is determined whether the user has stopped the engine from the input information from the ignition switch 538. If the engine is stopped, the process proceeds to S18, and it is determined from the input information of the door courtesy switch 537 whether the user has opened the door. If the door is open, it is determined that the exit scene has been entered, and SCN5 is set to "1" in S19.

  S20 to S23 are separation scene specifying processes. In S20, it is confirmed that the flag SCN6 for the separated scene is not “1”, and in S21, it is determined from the input information from the ignition switch 538 and the seating sensor 520 whether the user has closed the door while leaving the seat. If Yes, the process proceeds to S22, and SCN6 is set to "1". Further, in S23, the getting-off timer is activated. When SCN6 is 1 in S20 (that is, when a separated scene has already arrived), the process proceeds to S24 and subsequent steps. The time t2 required for the hospitality process in the getting-off scene is measured by the getting-off timer. If t2 has already elapsed in S24, the scene flag is reset for the next hospitality process in S25, and the seating timer in S26. And reset the getting-off timer.

Returning to FIG. 46, if the scene is determined at γ1, the hospitality content in the scene is determined. This determination is made with reference to the hospitality decision table 360 of FIG. As described above, a plurality of hospitality genres are set for each scene, and a hospitality theme is set for each genre. As described above, genres and hospitality themes are variously set from the viewpoints of desires and orientations desired by users. More specifically, in each scene, the user wants to satisfy the requirements of “safety”, “easy”, and “comfortable” when using the car, and the demand is disturbed by some factors. The cause is identified as a disturbance. And it can be said that the purpose of the final system is to measure the response so that each individual request is satisfied by performing some response processing, that is, hospitality operation. The hospitality genre and hospitality theme are determined according to the type. Among these, the genre is determined based on the “disturbance” that can be found in common for each scene.
(ST1) Expect and excite users;
(ST2) Relax the user and give them peace of mind;
(ST3) Eliminate user anxiety and tension;
(ST4) Reducing the physical burden on the user;
(ST5) Assist with suitability according to the physical condition of the user;
5 genres are set.

  In FIG. 2, one of the hospitality themes belonging to the expectation / excitement genre ST1 and the relaxation / relaxation genre ST2 is selected according to the personality and mental state of the user (that is, these genres). Are selected exclusively from each other). Hospitality themes of other genres are simultaneously selected in each scene, and hospitality operations belonging to those themes are performed in parallel in the corresponding scenes.

  On the other hand, different hospitality themes belonging to each genre are set depending on the scene. The theme of each scene by genre is as described in FIG. There are also themes set across multiple scenes. For example, “I want to know the state of the destination” OBJ 331 spans two scenes of preparation and driving stay.

  The hospitality decision-making table 360 is used in accordance with the flow shown in FIG. 4 (this corresponds to the main part extracted from the hospitality main process indicated by δ1 to δ6 in FIGS. 46 to 48). In S101, the scene flag is read, and in S102, what the current scene is is specified. In S103, the hospitality theme corresponding to the identified scene is read, and the hospitality function (hospitality operation unit) belonging to the theme is selected with reference to the function selection tables 371 and 372 illustrated in FIGS. In step S105, the hospitality application for specifically operating the extracted hospitality function is selected from the theme-specific application library 351 in FIG. 6 and activated.

  Returning to FIG. 46, as correction items at the time of scene specification, the user's dressing detection (α3: can be grasped from the photographed image of the user's figure by the camera 518 (FIG. 1) when approaching), property detection ( (α4: baggage, etc.), gesture detection (α5: detected as a sign of an action directly related to scene estimation), and the like can also be executed. These detections effectively contribute to hospitality theme determination for each scene.

  Next, it progresses to (delta) 2 and becomes the process which adapts the content of hospitality to a user's individuality. Specifically, this is done by appropriately weighting each individual hospitality process according to the personality determination process described later and the determined personality, that is, in order to adapt to the individual user's personality. The object is to customize the combination of hospitality operations as appropriate, or to change the level of hospitality operations. The personality determination process requires personality determination processing β4 or ε2. Process ε2 is for obtaining personality classification by user input, such as questionnaire processing, etc., and process β4 is for determining personality classification more analytically from the user's actions, actions, thought patterns, facial expressions, etc. It is. As for the latter, a specific example of determining personality classification from music selection statistics is shown in the later-described embodiment. However, as in α10, a habit directly connected to personality determination is extracted from the user's action, or α11 In this way, it is possible to make a personality determination from the human phase.

  Proceeding to FIG. 47, in δ3, the hospitality content is adapted to the mental / physical state of the user. Although a specific example will be described later in this respect as well, mental / physical condition information reflecting the mental state and physical condition of the user is acquired based on the detection information of the biological state detection unit, and the user's Estimate mental or physical condition. As the biological state detection unit, an infrared sensor 519 (face color: α20), a face camera 521 (expression: α12, posture: α14, line of sight: α15, pupil diameter: α16), a pulse sensor 524 (heartbeat: α17), and the like can be adopted. In addition to these, sensors (502w, 530, 531, 532, 532a; erroneous operation rate: α13), blood pressure sensor (α18), breath sensor (alcohol: α21, for example, alcohol for expiration) Is detected), the seating sensor 520 (measures the weight distribution on the seat with the pressure sensor, detects the minute weight shift during driving, It is possible to determine whether the calmness has been impaired, or to detect the degree of fatigue of the driver by detecting how the weight is biased).

  Also here, the gist of the processing is to replace the output from the above-mentioned biological state detection unit with a numerical parameter indicating the mental state and physical condition (β5), and to change the mental state and physical condition of the user from the numerical parameter and its temporal change. Estimate (γ3, γ4) and give appropriate weighting to each hospitality process, that is, customize the combination of multiple hospitality actions to suit the estimated mental state and physical condition of the user, Alternatively, it is intended to change the degree of hospitality operation. Even if the hospitality is the same in the same scene and theme, as described above, if the user's personality is different, it is better to perform a hospitality operation that matches that personality. It is of course desirable to adjust the type and degree of hospitality.

  In this case, taking the case of illumination light as an example, the lighting color directed by the user differs depending on the personality (for example, the active type is red, the gentle type is green or blue), and the physical condition is good or bad Therefore, the demands on the illumination intensity (for example, when the physical condition is poor, the light amount is reduced to suppress the stimulation by illumination) are often different. The former is hospitality control for adjusting the frequency or wavelength of the illumination light (the wavelength becomes shorter in the order of red, green, and blue), and the latter is hospitality control for adjusting the amplitude of the illumination light. In addition, mental state is a factor related to both of them, and in a somewhat cheerful mental state, it is possible to employ red illumination light (frequency adjustment) to further boost the mood, and the color of the illumination light It is possible to increase brightness without changing (amplitude adjustment). Also, in the state of excessive excitement, processing such as adopting blue illumination light (frequency adjustment) to reduce feelings or reducing brightness without changing the color of the illumination light (amplitude adjustment) is considered. It is done. In the case of music, since it contains various frequency components, it is more complicated, but in order to enhance the arousal effect, to emphasize the high-frequency sound waves of about several hundred Hz to 10 kHz, or conversely to sink feelings The control pattern by frequency / amplitude, such as adopting so-called α wave music that combines the center frequency of sound wave fluctuations with the frequency (7-13 Hz: Schumann resonance) of the brain wave (α wave) when relaxing Can be grasped as well.

  With regard to the brightness and sound wave level in the vehicle, the suitability level can be set numerically for each hospitality theme in consideration of the personality, mental state and physical condition. As shown in FIGS. 7, 8, and 9, the function selection table 371 for each theme is accompanied by a control suitability value setting table 371a.

  The control suitability value setting table 371a is prepared for each hospitality theme of each scene, and is a collection of control suitability values to be set for a plurality of hospitality operation units to be used. In the numerical range corresponding to the operation output range of the hospitality operation unit (for example, the required illumination level and sound wave level), a value that matches each theme of each scene is found in advance through experiments, etc. The value is registered in the control suitability value setting table 371a as a value. Since there are individual differences in control suitability values, an average value of suitability values found for a plurality of people and representative values such as mode or median may be registered in the control suitability value setting table 371a.

  Then, the process proceeds to δ4 in FIG. For example, information (disturbance stimulus) on how much stimulus the user currently feels is obtained from the output of the illuminance sensor 539 (visual stimulus: α23), sound pressure sensor (auditory stimulus: α24), etc. in FIG. Environmental estimation: β6), the disturbance stimulus is converted into a numerical value that can be compared with the suitability value obtained from the personality (personality), mental state, and physical condition, and the disturbance is numerically estimated (γ6) . As the disturbance stimulus to be specified, a tactile stimulus (α25: for example, a pressure sensor 523 attached to the handle), an olfactory stimulus (α26: by an olfactory sensor), or the like can be used in combination. Regarding disturbance estimation, indirect stimulation from the space surrounding the user, specifically, height (α27), distance (α28), depth (α29), and the physique of the passenger or passenger (α30), etc. It is also possible to do.

  Next, at δ5, a function selection process is performed. Here, in order to reduce the difference between the disturbance stimulus and the aptitude value, the hospitality functions (hospitality operation units) having higher priorities shown in the function selection tables 371 and 372 are adopted in order, and each hospitality operation unit is selected at δ6. This is the driving process.

  In addition, information regarding whether or not the content or degree of the hospitality function actually selected is appreciated by the user is estimated from, for example, the output of the above-described biological state detection unit (δ7), or reply information by the user himself ( (It may be a direct input related to like / dislike intention indications, or may be inferred from an operation input that avoids disliked music or lighting) (δQ), and this is fed back It is possible to give a kind of learning effect to hospitality operation control (δQ, δ7 → ε5, ε6 and γ7). That is, it has a function of hospitality adjustment command means for commanding to adjust the control state of the hospitality operation based on the response information from the user who enjoyed the hospitality operation. In the present embodiment, a program routine for realizing the function is stored in the ROM of the hospitality determination unit 2.

  In this case, after the driving step of δ6, the state confirmation processing of δ7 is performed. This state confirmation processing is processing for monitoring how these states are changed in response to the result of hospitality driving, using processing similar to mental state estimation and physical condition estimation performed at γ3 and γ4. The result is fed back to the function selection process of δ4. As a result of monitoring, if the estimated mental state or physical condition seems to be improved, a command to maintain or further strengthen the currently selected hospitality movement is performed, and conversely, if it seems to deteriorate, A commander that suppresses or abolishes the currently selected hospitality operation is performed. If the mental state or physical condition shows a tendency to stabilize in the vicinity of the normal state, a command to maintain the state stably is performed.

  On the other hand, in δQ, the user's satisfaction with the hospitality operation is asked in the form of a question, and the answer information (preference (ε5: I want you to do more or stop it)), physical effect (ε6: hot, cold, noisy, etc.) This inquiry can be output as audio from the speaker 515S (it can also be visually displayed on the monitor 536 in FIG. 1) In either case, the question data is shown in FIG. 1, the hospitality operation ID and the control direction information are associated with each other and stored in the storage device 535 of Fig. 1. For example, the hospitality operation ID corresponds to "air conditioner", and the control direction information If it corresponds to “Temperature rise”, the question information should be set to “Is it too hot?” In retrieves the hospitality operation adopted at that time, sequentially reads and outputs the query data for the corresponding ID.

  The user's answer to this can be input by voice from the microphone 522, for example. The input content of the input speech is specified by a well-known speech conversion module, the meaning of the input speech is analyzed by a well-known language analysis module, and the answer result for the question data is specified. If it is simple, for example, a keyword list of answer candidates corresponding to the question content is created, and whether the keyword is included in the specified input content, and further, a keyword meaning negative It is possible to analyze whether it is not included and grasp the contents of the answer. For example, when asked “Is it hot”, the keywords “Yes”, “Ye”, “Hot”, “Hot”, “No”, “No”, “No”, “Cold”, “Just right” ”, Etc., and when the answer“ not hot ”is identified, the keyword“ hot ”and“ not ”match, and the answer to the question was negative can do. The speech conversion module and the language analysis module described above can be stored in the ROM of the hospitality decision making unit 2.

  In addition, as a function selection determination element of a system different from the above, the function state of the hospitality operation unit is determined (α31) and maintained as vehicle deterioration information (β8), and the function state contributes to either normal or abnormal It is also possible to determine whether or not (γ8), positively adopt the function that contributes to normality, and perform processing to avoid the function that contributes to abnormality.

  In addition, it is important to increase the hospitality effect by determining the concept of hospitality operation according to the type of vehicle and the content that matches the image of the vehicle. For high-end cars, a smart hospitality production that is generally calm and can emphasize luxury is effective, and conversely, it can be said that a bright and lively production is appropriate for sports and leisure vehicles.

Hereinafter, representative examples of hospitality in individual scenes will be described.
FIG. 28 shows the flow of the hospitality operation process in the approaching scene SCN1. The theme is “encouragement to ride a car” in FIG. 2 and belongs to the expectation / stimulation genre ST1 according to the personality classification of the user (OBJ111; for example, the personality classification is “active SKC1” (FIG. 18). ) And those belonging to the Relax / Peace genre ST2 (OBJ211; for example, when the personality classification is “soft SKC2” (FIG. 18)). Also, the user's physical condition or mental condition is estimated by the method described later, and the result is reflected in the hospitality process. In this embodiment, as described in detail later, “physical condition (mild / severe)”, “distraction concentration”, and “excitement (anger) state” are estimated as physical condition or mental condition. The hospitality operation is adjusted as shown in FIG. 67 according to each state.

  In S21 of FIG. 28, the approach direction of the user (that is, the terminal device 1) to the automobile is specified. On the automobile side, the direction of the automobile can be specified together with the position of the automobile from the position information by the GPS 533 and the history of changes in the traveling direction of the automobile leading to parking. Therefore, by referring to the position information of the user (from the GPS 554) sent from the mobile phone 1, whether the user is approaching the vehicle from, for example, the front side, the rear side, or the side, and the vehicle It is recognition of how far the user is approaching.

  Proceed to S22, and if the approach direction is from the front, proceed to S23 and select the front lamp group. As shown in FIG. 23, a headlamp 504, a fog lamp 505, and a cornering lamp 508 are used as the front lamp group in this embodiment. If the approach direction is from the rear, the process proceeds from S24 to S25, and the rear lamp group is selected. As shown in FIG. 24, as the rear lamp group, a tail lamp 507, a backup lamp 509, and a stop lamp 510 are used in this embodiment. In other cases, it is determined that the vehicle is approaching from the side, and the process proceeds to S26 to select a side lamp group. As shown in FIG. 25, a hazard lamp 506, a tail lamp 507, and an underfloor lamp 512 are used as side lamp groups in this embodiment.

  In S27, the distance between the car and the user is specified by the above method. If the distance between the car and the user can be specified, if the distance exceeds a first upper limit (for example, set to 20 m or more), the process proceeds to S29, and the long distance illumination mode is set. Moreover, if it exceeds the second upper limit value (for example, set to 5 m or more and less than 20 m), the process proceeds to S31 and the middle distance illumination mode is set. In other cases (that is, the second upper limit value or less), the process proceeds to S32, and the short distance illumination mode is set. When the user is farther from the car (that is, in order of short-distance illumination mode → medium-distance illumination mode → long-distance illumination mode), the total light quantity from each lamp (illumination) increases (when the beam angle is involved) , The amount of light that the user can see when standing in front of the illumination: For example, if the lamp is turned upward to make it a high beam, the amount of light that is visible will increase even if the intensity of the light source does not change from the low beam) The light emission operation of each individual lamp is controlled. This enhances the effect of lighting up the approach to the car and guiding the user to the car safely.

  FIG. 23 shows an operation example when the approaching direction of the user U is the front side. In the long-distance illumination mode, the headlamp 504 is turned on with a high beam, and in the intermediate-distance illumination mode, the amount of light is reduced as a low beam. That is, a method is employed in which the amount of visible light of the same lamp is changed by adjusting at least one of the light source intensity (adjustable by the drive voltage or the like) and the beam angle. On the other hand, in the short distance illumination mode, the fog lamp 505 or the cornering lamp 508 having a smaller light amount is switched. When the user U approaches from the front, the fog lamp 505 is turned on. When the user U moves toward the side of the vehicle, the corresponding side of the cornering lamp 508 is turned on.

  FIG. 24 shows an operation example when the approaching direction of the user U is the rear side. In the long distance illumination mode, all of the backup lamp 509, the tail lamp 507 and the stop lamp 510 are turned on, and in the middle distance illumination mode, only the tail lamp 507 and the stop lamp 510 are turned on to reduce the amount of light. That is, a method of changing the total light quantity by changing the number of lamps to be lit among a plurality of lamps is adopted. In the short-distance illumination mode, only the backup lamp 509, the tail lamp 507, or the stop lamp 510 is switched on. When the user U approaches from the rear center, only the tail lamp 507 (or only the stop lamp 510) is turned on. When the user U moves toward the side of the vehicle, the one on the corresponding side of the backup lamp 509 is used. Light up.

  FIG. 25 shows an operation example when the approaching direction of the user U is the side. In the long-distance illumination mode, all of the hazard lamps 506 and the plurality of underfloor lamps 512 are turned on. In the middle-distance illumination mode, only the hazard lamps 506 are extinguished to reduce the amount of light. In the short-distance illumination mode, only the lamps close to the user U among the plurality of underfloor lamps 512 are switched on. When the user U approaches from the center on the vehicle side, only the center underfloor lamp 512 is turned on, and when the user U moves in the vehicle length direction, the corresponding underfloor lamp 512 is switched on. As the user U approaches, the illumination angle of the underfloor lamp 512 may be changed to change the illumination area so as to guide the user U toward the automobile. In either case, in the short distance illumination mode, the room illumination 511 is also turned on to treat the user who tries to get into the car more politely.

  There is also a method of performing illumination with an illumination lighting pattern in which an image of a destination facing in the future is imagined. For example, if the destination is the sea, it is effective to light up with an illumination pattern reminiscent of a wave that gradually increases and then decreases the illuminance of blue illumination light.

  In this case, the illumination driving form described above has variations as shown in FIG. 67 according to the physical condition and mental state of the user. If it is “slightly poor physical condition”, for example, light that is not necessary among illumination lights used for illumination is reduced to improve visibility when the user approaches the automobile. Also, if it is “severe physical condition”, white or warm-colored darker lighting is adopted to reduce the psychological burden. On the other hand, when it is estimated that “concentration distraction” is performed, a lighting operation is performed to awaken the user (for example, it is more effective to use a stimulating wavelength of primary colors such as red and blue). is there). On the other hand, when it is estimated that the state is “excited (angry)”, the use of blue illumination light is effective in sinking an excessively high mental state.

  In addition, as a hospitality operation unit that can be controlled by a wireless command from the user terminal 1, for example, if peripheral equipment having a building-side illumination 1161 as shown in FIG. The operation of lighting up the vehicle by 1161 may be added to the hospitality operation. As shown in FIG. 27, in the long-distance lighting mode, the parking position becomes easier to understand by illuminating your car in the parking lot at night, and the effect of raising the feeling of the user before boarding by lighting up is also effective. Arise. On the other hand, in the middle-range or short-distance lighting mode, the area around the vehicle is widely illuminated, so the effect of guidance or assistance is enhanced, and foreign objects etc. on the user's route (foot) until getting into the vehicle Can be easily discovered.

The personality classification is determined by the following method, for example.
The user of the automobile stores in a user registration unit 600 (for example, a ROM of the hospitality decision making unit 2 (preferably configured with a flash ROM so that it can be rewritten)) or a storage device 535 as shown in FIG. In the user registration unit 600, each user name (or user ID (and personal identification number) and its personality type (see FIG. 18) are registered in association with each other. As will be described later, this personality type is acquired and accumulated as operation history information in a specific operation unit while the user continues to use the vehicle, and is estimated based on the accumulated operation history information. However, if the accumulation of operation history information is insufficient, such as immediately after the start of use of a car, or the personality type is not collected without intentionally collecting operation history information. If desired, the personality type information or information necessary for specifying the personality type information may be input by the user himself / herself and the personality type may be determined based on the input result as follows: .

  In FIG. 37, the personality type is displayed on the monitor 536 of FIG. 1 (the monitor of the car navigation system 534 may be substituted), and the user selects the personality type that suits him and inputs this from the input unit 529. . Here, the input unit is a touch panel overlaid on the monitor 536, and a selection input is made by touching the selection button 529B formed on the display. On the other hand, in FIG. 38, instead of directly inputting the personality type, a questionnaire is input for determining the personality type. Questionnaire questions are displayed on the monitor 536, and the user answers in the form of selecting an answer from the answer options (in this case, the options are configured with the selection button 529B, and the corresponding position on the touch panel 529 superimposed thereon is touched) Select input). By answering all the questions, one is uniquely determined from a personality type group determined in advance according to the combination of the answers.

  The user registration input including the user name is also made from the input unit 529 and stored in the user registration unit 600 together with the determined personality type. These series of inputs can also be performed from the mobile phone 1, and in this case, the input information is transferred to the automobile side by radio. In addition, when the user purchases a vehicle, there is a method in which the dealer side uses the input unit 529 or a dedicated input tool to perform user registration input in advance.

  Prior to using the car, user authentication is required. This is because, in particular, when a plurality of users are registered, different personality types are set depending on the users, and the contents of hospitality are also different. The simplest authentication method is a method in which a user ID and a personal identification number are transmitted from the mobile phone 1 to the vehicle side, and the hospitality decision-making unit 2 receives this and verifies the registered user ID and personal identification number. is there. In addition, biometrics authentication methods such as collation of facial photographs using a camera provided on the mobile phone 1, voice authentication, authentication using fingerprints, and the like can be employed. On the other hand, when the user approaches the car, only simple authentication using the user ID and the personal identification number is performed. After unlocking, the user gets into the car, and then the face camera 521, microphone 522, retina camera 526, iris described above. Biometrics authentication may be performed by the camera 527 or the vein camera 528.

  When the user is authenticated and specified as described above, the personality type (user biological state information) corresponding to the user is acquired by the hospitality decision making unit 2, and the selection of the corresponding hospitality operation unit and the operation pattern are selected. As described above, for example, if the specified personality type is “active SKC1”, the theme OBJ111 belonging to the expectation / promotion genre ST1 is selected, and if the specified personality type is “gentle SKC2”, relaxation / comfort is achieved. The theme OBJ211 belonging to the genre ST2 is selected. The process flow is exactly the same for other scenes.

  Hereinafter, specific examples of the function selection table will be described with reference to FIGS. In any function selection table, the vertical axis indicates the operation purpose determined according to the disturbance received by the user (however, some items do not depend on the disturbance exist), and the horizontal axis indicates the scene and the theme. It is configured as a two-dimensional matrix that represents the types of hospitality action units that can be employed. In the cell corresponding to each hospitality operation unit prepared for each operation purpose, the order of the hospitality operation units used preferentially for the operation purpose is designated by a number. A larger number means higher priority, and “0” indicates non-adoption. In addition, at the right end of each table, for the purpose of understanding, a disturbance type related to the operation purpose and a name of a means for detecting the disturbance are written together.

FIG. 7 shows a function selection table 371 corresponding to the expectation / exciting theme OBJ111. The purpose of operation is as follows.
(Brightness outside the car)
The disturbance type is “reduction in the amount of light outside the vehicle” and is detected by a light amount sensor outside the vehicle (because the approaching scene is the target, the sensor can be provided in an external facility such as a parking lot in addition to the vehicle itself (in this case The detection information of the sensor is acquired by communication.) When the amount of light outside the vehicle detected by this sensor falls below a certain threshold value, it can be determined that a disturbance state of “decrease in light amount outside the vehicle” has occurred.

(Intake of external light, generation of internal light)
The disturbance type is “in-vehicle light quantity reduction”, and is detected by the illuminance sensor 539 (FIG. 1). When the outside light amount detected by this sensor becomes less than a certain threshold value, it can be determined that the disturbance state “decrease in in-vehicle light amount” has occurred.

(Outside world blocking, noise cancellation)
The disturbance type is “in-vehicle noise increase”, and is detected by the noise detection microphone 2011 of FIG. In accordance with the vehicle interior noise level detected by this sensor, the noise canceller 1001B autonomously performs acoustic processing for vehicle interior noise reduction by the operation described above.

(In-car environment)
The disturbance type is “increase / decrease in vehicle interior temperature”, which is detected by the room temperature sensor 563 and the sunshine sensor 564 (FIG. 1). Disturbances related to “increase / decrease in interior temperature” occurred when the interior temperature deviated from the appropriate temperature (or when a factor that deviated (for example, when the amount of sunshine increased or decreased or the intake air temperature fluctuated) occurred. Is determined.

  With respect to entertainment elements and information provision, the hospitality operation is selected according to the user's preference and is basically irrelevant to disturbance. In this case, it is possible to select an appropriate hospitality operation according to the estimation result of the mental state or physical condition of the user by an algorithm described later.

  The function priorities of exterior lighting, interior lighting, window shielding (power window), and car audio are higher. In any case, in order to perform flashing, the setting value of the external lighting level for illumination by the outside lighting in the control aptitude value setting table 371a, the setting value of the inside lighting, the audio output level from the car audio system 515 and the mobile phone 1 ( Here, the musical sound levels relating to music output are all set high. The driving output levels of the lights 504 to 512 and the car audio system 515 of FIG. 1 are treated as hospitality so that the illuminance detection level of the illuminance sensor 539 of FIG. 1 and the sound pressure detection level of the sound pressure sensor 540 approach the above set values. It is controlled by the control unit 3. The audio output level of the mobile phone 1 is also set to a corresponding value by a radio command. In addition, even when the estimated mental state corresponds to distraction, it may be effective in increasing the degree of mental concentration in driving by expectation / pumping effects.

  On the other hand, FIG. 8 shows a function selection table 371 corresponding to the relaxing / relaxing theme OBJ211. The operation purpose / disturbance type is the same as in FIG. The function priority setting is the same as that of the expectation / excitation system, but the external illumination level setting value, the interior illumination setting value, and the musical sound level in the control aptitude value setting table 371a are higher than those of the expectation / excitation system theme OBJ111. It is set low, and a more gentle production is performed, including lighting colors and music selection. The same mild effect is also effective when the estimated mental state or physical condition corresponds to poor physical condition or excited state.

  The specific process is as follows. That is, when the user approaches to get into the car, the lighting device (FIGS. 23 to 25: reference numerals 504, 505, 507, and 509) differs depending on the acquired personality type (user biological state information). , 510, 511, 512: These operate as lighting devices that illuminate the exterior of the automobile (the interior light 511 also indirectly illuminates the exterior of the automobile with light leaking from the window)) It can be. When the expectation / exciting theme OBJ111 is selected, the amount of light emitted from the lighting apparatus involved in hospitality is increased or the number of blinks is increased, the headlamp 504 is turned into a high beam, the amount of light emitted from the red tail lamp 507 is increased, etc. , To produce a flashing up the user's approach to the car. On the other hand, when the relaxation / comfort system theme OBJ211 is selected, the amount of light emitted from the lighting device involved in hospitality is slightly reduced, flashing of flashing lighting is avoided, and the amount of light is gradually increased gradually. Alternatively, the lighting is performed in the order of the side lamp 512 illuminating the foot, the interior light 511, and the headlamp 504, and a soft effect such as slowly raising the car is performed. If the red-based tail lamp 507 is not employed, a change can be obtained in the overall illumination color as compared with the illumination mode for the “active” personality type. In addition, it is also possible to replace the incandescent lamp, the halogen lamp, and the like with the light emitting diode, including the head lamp and the tail lamp.

  Next, when the user approaches the vehicle, in addition to the lighting device as described above, a speaker (sound output unit) 311 provided in the mobile phone 1 (user side terminal device) should be used as a hospitality operation unit. You can also. In this case, the communication device 4 on the automobile side detects the approach of the mobile phone 1, that is, the user, and the speaker 311 with different output contents according to the personality type corresponding to the user (that is, the acquired user biological state information). The voice for hospitality is output. In the present embodiment, the voice data for hospitality is music source data, but it may be data of sound effects or human voices (so-called incoming voices or incoming voices). As shown in FIG. 1, the voice data for hospitality may be stored in a storage device 535 on the automobile side, and necessary data may be distributed to the mobile phone 1 via the communication device 4 or portable. Either may be stored in the sound data flash ROM 316 on the telephone 1 side. Here, the latter case will be described as an example.

  First, when a user is authenticated and specified, a personality type corresponding to the user is specified, and a list of hospitality voice data IDs stored in the sound data flash ROM 316 is acquired wirelessly from the mobile phone 1. Next, music source data corresponding to the specified personality type is selected from the list. Here, a plurality of music source data having different song mode codes are selected in order to perform a process that increases as the user approaches (here, a case where MIDI data is used is taken as an example).

  Here, as in the hospitality process with illumination described above, different effects are performed according to the distance (the process flow is the same as in FIG. 28). Corresponding to the user's mental state elevation, an order corresponding to the music mode code is set, and the music selection is performed so as to increase the spirit of elevation as the distance gets closer. Specifically, the closer to the car, the higher the mental state elevation, and the song mode code when approaching the user is "Healing / α wave system" or "Warm / Healing system" (for long distance) → The order is determined in the order of “exhilarating system” (for medium distance) → “lifting system” (for short distance). However, depending on your preference, it is of course possible to reverse the above order so that you get excited at first and calm down as you get closer to the car.

  First, as shown in FIG. 31, in the long-distance hospitality mode, the music source data ID (song ID) having the song mode code of “Healing / α wave system” or “Warm / Healing system” is transmitted to the mobile phone 1. (S201). The mobile phone 1 selects music source data corresponding to the ID and starts playing (S202). Next, in the medium distance hospitality mode shown in FIG. 32, the music source data ID (music ID) having the music mode code “exhilarating” is transmitted to the mobile phone 1 (S210). Then, the mobile phone 1 selects the music source data corresponding to the ID and starts playing, and as described above, the vibrator unit 354 and the LED unit 355 are driven in synchronization with the music, thereby enhancing the hospitality by sound output. (S211). Further, the lighting device on the automobile side may be blinked in conjunction with music (S212).

  When the user finally approaches the point of getting into the car, the short-distance hospitality mode shown in FIG. 33 is entered, and the climax of the climax is performed. That is, in S220 to S222, the processing is almost the same as that in the medium-distance hospitality mode, but the music source data is selected from the “rising system”. On the other hand, the music source data having the same ID is selected on the automobile side, and the performance in the car audio system 515 is started. In this case, if the power window is activated to open the window and output in synchronization with the performance of the mobile phone 1, the excitement effect can be further enhanced (S223). At this time, on the automobile side, if the pitch code of the main melody portion of the MIDI data is changed to be lower (or higher) by the frequency of forming the harmony pitch than the main melody portion of the mobile phone 1 side, and output, The output of the mobile phone 1 and the output of the car audio system 515 can be added, and the output timing of the main melody portion of the MIDI data is delayed (or advanced) by a fixed number of beats relative to the main melody portion on the mobile phone 1 side. If the output is changed as described above, it is possible to achieve a singing effect between the output of the mobile phone 1 and the output of the car audio system 515.

  In S224, the heart rate sensor 342 of the mobile phone 1 reads the user's heart rate, and the tempo code of the MIDI data is changed so that the tempo increases in proportion to the heart rate. Thereby, the music to be output is uptempoed in accordance with the heartbeat of the user, and the excitement effect is further enhanced. It should be noted that in the relaxation / comfort system theme OBJ211, it is possible not to perform the last flashy uplifting process for short distances.

  Also, in relation to the estimated mental state or physical condition, in poor physical condition, the music is played mainly in the low temperature range avoiding exciting high frequencies, or the volume is low if the poor physical condition is relatively heavy. And set the tempo to relax. Even in an excited state, it is effective to set the music tempo to a relaxed system. On the other hand, in the case of distraction, music that is effective for mood awakening, such as increasing the volume in reverse, percussion banging, screaming singing or piano dissonance (eg free jazz, hard rock, heavy metal, avant-garde music) Etc.) is effective.

  As shown in FIG. 2, in the approach scene SCN1, in the anxiety / tension relief genre ST3, “I want to know the position of the car (OBJ311)” and “Confirmation of forgotten / closed doors (OBJ312)”, in the physical burden reduction genre ST4 Each theme of “I want to load cargo smoothly (OBJ411)” is defined. The hospitality processing of these themes is executed in parallel with the hospitality processing of the themes OBJ111 to OBJ211 for enhancing feelings.

FIG. 10 shows the contents of the function selection table 371 corresponding to the theme “I want to know the position of the car (OBJ 311)”. The operation purpose / disturbance type is as follows.
(Car position notification)
The disturbance type is “large distance between the car and the user”, and distance detection is performed based on each positioning information of the car-side GPS 533 and the mobile phone-side GPS 554. When the distance exceeds a certain threshold, it can be determined that a disturbance state of “large distance between the car and the user” has occurred.
(In-car environment)
The disturbance type is “in-vehicle temperature increase / decrease”, which is the same as the operation purpose “in-vehicle environment” in FIG.
As for information collection, the hospitality operation is selected according to the user's preference, and is basically irrelevant to disturbance. In this case, it is possible to select an appropriate hospitality operation according to the estimation result of the mental state or physical condition of the user by an algorithm described later.

  The vehicle-side GPS 533, the mobile phone 1, the mobile phone-side GPS 554, the horn 502, and the exterior lighting (or interior lighting) are selected as the hospitality operation unit. Specifically, for example, the position information of the car-side GPS 533 is notified to the mobile phone 1 side, and the map is displayed on the monitor 308 (FIG. 14) together with the position information of the mobile phone-side GPS 554, and the relative position between the user and the car. To be able to grasp. Further, when the user approaches the vehicle at a predetermined distance or less, the position of the vehicle is directly notified to the user by blowing the horn 502 and lighting the vehicle exterior light (or vehicle interior light).

On the other hand, in the “confirmed thing / door lock confirmation (OBJ312)”, a message for prompting caution confirmation before departure (voice data can be stored in the ROM of the hospitality execution control unit 3 and the audio output hardware of the car audio system Can be used for output processing). Examples of messages that prompt attention confirmations include the following: “Is my license and wallet OK?”
・ (If the destination set in the car navigation system is an airport) “Did you have a passport?”
・ Did you lock the entrance door?
・ "Is the back window open?"
・ Did you turn off the air conditioner in the room?
・ Did you tighten the gas mains?

  Next, regarding the mental state or physical condition of the user, the temporal change of the facial expression of the user approaching the car (can be photographed with the camera 518 for external use) and the body temperature (which can be measured with the infrared sensor 519) is measured. It can be estimated from the waveform. As described above, if the estimated mental state is normal, the hospitality operation of the expectation / healing genre ST1 is performed, and the estimated mental state is unstable or angry (or excited) (or the physical condition is the physical condition). If it is defective), it can be a hospitality operation of the relaxation / relaxation genre ST2.

  FIG. 56 shows an example of a flowchart of facial expression change analysis processing. The change counter N is reset in SS151, and if the sampling timing comes in SS152, the process proceeds to SS153 to capture a face image. The face image is repeated until a front image capable of specifying a facial expression is obtained (SS154 → SS153). When the front image is obtained, the facial expression type is identified by sequentially comparing with the master image (included in the biometric authentication master data 432 in the storage device 535 (in the storage device 535)) (SS155). If the specified facial expression type is “stable”, “1” is set to the facial expression parameter I (SS156 → SS157). If the specified facial expression type is “anxiety / discomfort”, “2” is set to the facial expression parameter I (SS158 → SS159). If the specified facial expression type is “excitement / anger”, “3” is set to facial expression parameter I (SS160 → SS161).

  In SS 162, the facial expression parameter value I ′ acquired last time is read out and the change value ΔN is calculated. In SS 163, the value is added to the change counter N. The above processing is repeated until a predetermined sampling period expires (SS164 → SS152). If the sampling period expires, the process proceeds to SS165, where an average value I (which is converted into an integer) of the facial expression parameter I is calculated, and a determination can be made as a mental state corresponding to the facial expression value. Further, the larger the value of the change counter N, the greater the change in facial expression. For example, by setting a threshold value for the value of N, the expression change is changed from the value of N to “small change”, “increase”, “slight increase”. And “rapid increase”.

  On the other hand, FIG. 54 shows an example of a flow chart of the body temperature waveform analysis process. In the sampling routine, the body temperature value detected by the infrared sensor 519 is sampled every time the sampling timing set at a constant time interval comes. And record the waveform. In the waveform analysis routine, a body temperature value sampled in the latest fixed period is acquired as a waveform at SS53, a known fast Fourier transform process is performed on the waveform at SS54, and a frequency spectrum is obtained. The center frequency (or peak frequency) f is calculated. Further, in SS56, as shown in FIG. 53, the waveform is divided into a predetermined number of sections σ1, σ2,..., And in SS57, the body temperature average value for each section is calculated. Then, for each section, with the average body temperature value as the waveform center line, the integral amplitudes A1, A2,... Value). In SS59, the integral amplitude A of each section is averaged and determined as a representative value of the waveform amplitude.

  Note that the information sampling program for waveform acquisition, including the following processing, manages the schedule so that when a scene can be identified, only the biological state detection unit related to the scene is activated at regular time intervals. Is done. Further, although not shown in the drawing, the repetition of sampling does not continue indefinitely, as long as the above-described sampling period which has been determined so as to obtain the number of samplings required for waveform analysis as described above expires. The repetition is aborted.

  In SS60, it is checked whether or not the frequency f is larger than the upper limit threshold fu0. If it is larger, it is determined that the body temperature change being monitored is “sudden”. In SS62, it is checked whether or not the frequency f is smaller than the lower limit threshold fL0 (> fu0). If fu0 ≧ f ≧ fL0, the process proceeds to SS64, and the body temperature change being monitored is determined to be “standard”. Next, proceeding to SS65, the integrated amplitude A (average value) is compared with the threshold A0. If A> A0, it is determined that the average body temperature level being monitored is in the “variation” state. If A ≦ A0, it is determined that the average body temperature level being monitored is in the “maintenance (stable)” state.

  The determination (estimation) of the specific mental / physical state of the user is performed using the determination result relating to the temporal change of the biological condition parameter obtained in this way. Specifically, in the storage device 535, as shown in FIG. 51, it is determined that a plurality of specified states that are mental states or physical states to be determined by the user and individual specified states are established. In order to do so, a determination table 1601 is stored in which a combination of temporal change states of biological state parameters that should be detected by a plurality of biological state detection units is stored in association with each other.

  In the present embodiment, “diffused concentration”, “bad physical condition”, and “excited state” are defined as specific states. Specifically, “physical condition” is divided into a plurality of levels, here, “mild physical condition” and “severe physical condition”, and four basic specific states are defined. It should be noted that the “concentration distraction” and “excited state” can be divided into a plurality of levels in order to estimate a more detailed mental / physical state. In the present embodiment, in addition to the basic specified state, the biological state parameter is also used for the combined state of the physical state system and the mental state system (“concentration distraction” or “excited state”). Combinations of temporally changing states are uniquely determined to improve the estimation accuracy of these composite states.

  Furthermore, when the user feels some kind of discomfort due to incompatibility of hospitality operation or lack or excess of the degree, the user often shows a biological condition similar to a slight physical condition. “Uncomfortable feeling” and “slightly poor physical condition” are integrated as specified states (of course, they may be specified separately by changing threshold values of a plurality of parameter configurations involved).

  As biological condition parameters, including those used in subsequent scenes, “blood pressure”, “body temperature”, “skin resistance”, “expression”, “posture”, “line of sight”, “pupil (dimension)” and “ Each parameter of “steering” is covered. Even for the same parameter, the sensor or camera to be used is appropriately selected according to the scene, which is advantageous for obtaining the target biological condition parameter.

  As described above, in this approach scene, the user's facial expression by the external camera 518 and the user's body temperature by the infrared sensor 519 can be adopted as the biological condition parameters. According to the determination table 1601, the change in facial expression increases rapidly when concentration is distracted, and the change in facial expression also tends to increase when physical condition is poor or excited. Each can be identified as being in a state different from the normal state, but it is difficult to identify individual mental / physical conditions in detail. On the other hand, when looking at the body temperature, there is no significant change when the concentration is dissipated (that is, almost the same as normal), but when the physical condition is poor, it shows a gradual change. Exhibits rapid changes. Therefore, by combining these two, it becomes possible to identify “diffused concentration”, “bad physical condition”, and “excited state” from each other.

  The processing in this case is shown in FIG. 66 (this can be determined by the same idea regardless of the scene, and the basic flow is the same in the driving scene described later). Basically, a plurality of (in this case, facial expression and body temperature) biological condition parameters are collated with the collation information on the determination table, and the identified state corresponding to the matching combination is currently established. This is a process of specifying as a specific state. That is, in SS501 to SS508, a determination result (for example, “sudden decrease”) associated with the temporal change of each biological condition parameter by the analysis processing shown in the flowcharts of FIGS. Or “increase”). In SS509, in order to determine that each specified state has been established, to-be-matched information indicating what change tendency each biological condition parameter in the determination table 1601 should indicate, and the above determination The result is collated, and the collation counter of the specified state in which the collated information matches the determination result is incremented. In this case, for example, for all the biological state parameters, only the specified state in which the collated information matches the determination result may be adopted. However, if there are many biological state parameters to be referred to, it is determined as the collated information. The results rarely match for all the biological condition parameters, and the user's physical condition or mental condition cannot be flexibly estimated. Therefore, it is effective to consider the score (N) of the matching counter as “matching degree” and to determine the highest score, that is, the highest matching score, as the specified state (SS510).

  In FIG. 51, for example, when the average blood pressure level is determined to be “fluctuation”, the state of the same biological condition parameter is established into a plurality of specified states (“diffused concentration” or “excited state”). In this case, the collation counter of each specified state is incremented. For example, when it is determined that the average blood pressure level is “fluctuation”, the four collation counter values N1, N4, N12, and N13 are incremented.

  On the other hand, the match / mismatch between the information to be matched and the determination result is mostly determined by comparison with the threshold value of the biological condition parameter (frequency or amplitude, etc.) as described above. / When determining the discrepancy binary (that is, whether it is white or black), the degree of deviation between the indicated value of the actual parameter and the threshold value is buried as information. However, in actuality, when matching / non-coincidence is determined with a value close to the threshold value, it is a determination of “gray”. It is inherently desirable to handle the degree of contribution to the determination result smaller than when it is determined.

  As a method of solving this, instead of adding to the verification counter only when the information to be verified and the determination result are completely matched, it is possible to approach within a predetermined range without a complete match. If the result is obtained, it is conceivable to limit the score to a lower score than in the case of perfect match and add this to the verification counter. For example, when the information to be collated is “rapid increase”, 3 points are added if the determination result is “rapid increase”, 2 points are added for “increased”, and 1 point is added for “slight increase” Can be illustrated.

  Further, there are the following examples as a more accurate method. That is, as shown in FIG. 51, for each specified state, the sum (ν or μ) of the deviation between the value of each biological condition parameter involved and the threshold used for the determination is used, and based on the sum of the deviations. It is also possible to determine the specified state. Hereinafter, a case where the specified state having the largest total deviation is determined as the final state estimation result will be exemplified, but the determination method varies depending on the definition of the deviation, and is not limited thereto. Also, the specified state can be determined in combination with the aforementioned N. This will be described in more detail below. First, the calculation concept of the deviation for each biological condition parameter is summarized in Equation 1.

  The value of the biological condition parameter is generalized and represented by X, and the threshold used for determination is X0. Whether or not X contributes positively to the establishment of the specified state is determined by the magnitude relationship between X and X0. As an example, taking the blood pressure of FIG. 52 as an example, the frequency f and the amplitude A of the blood pressure time change waveform are adopted as the biological condition parameter X. Among these, for the amplitude A, the threshold value is A0, and when A> A0, the average blood pressure level is determined as “variation”, which is one of abnormal states. In this case, as shown in FIG. 51, it contributes positively to the establishment of the two specified states of “concentration distraction” and “excited state”.

  On the other hand, for the frequency f, two threshold values, that is, an upper limit value fu0 and a lower limit value fL0 are determined. In this case as well, as shown in FIG. 51, it positively contributes to the establishment of two specific states, “diffused concentration” and “excited state”. On the other hand, when f <fL0, it is determined that the blood pressure change is “slow”, which is one of abnormal states. In this case, it contributes positively to the establishment of two specified states (abnormalities), “slight physical condition / discomfort” and “severe physical condition”. Of course, in both cases, the magnitude relationship between the parameter value for positively contributing to the establishment of the specified state and the threshold value is reversed.

  On the other hand, if the specified state does not correspond to any of the above abnormal states, this should be determined as a normal state (which case is determined as a “normal state” is shown in FIGS. 57, FIG. 60 to FIG. 62, and FIG. 65, respectively). For example, in the case of FIG. 52, the average blood pressure level is determined to be normal (maintained) when A> A0, and the blood pressure change is determined to be normal (maintained) when fu0> f> fL0.

  In the present embodiment, the deviation value to be calculated is defined as a direction in which the deviation positively contributes to the establishment of the specified state, and X and X0 calculated according to the definition The difference value is adopted as the deviation value. If X> X0 is in the above positive contribution direction, the formula (1) to formula (5) are used (for example, f when the blood pressure change is determined to be “rapid”, or the average blood pressure level is determined to be “normal”. A), if X <X0 is a positive contribution direction, the deviations Δμ and Δν are obtained from the formulas (2) to (4) (for example, f when the blood pressure change is determined to be “slow”). Calculate Note that “μ” is used for the former and “ν” is used for the latter in order to distinguish between the case where the specified state is an abnormal state and the case where the specified state is a normal state.

Further, when the parameter value is located between the upper limit threshold and the lower limit threshold, the case of affirmation of establishment of the specified state (for example, f when determining the blood pressure change as “normal”) is handled as follows. To. That is, it is necessary to calculate the deviation according to (2) for the upper threshold and to calculate the deviation according to (4) for the lower threshold. In this case, as the parameter value is located at the center of the section between the upper limit threshold and the lower limit threshold, the validity of establishment of the specified state becomes higher. Therefore, the closer the parameter value is to the section median, the larger the parameter value is. A deviation defined as follows may be used. As an example, the calculated value of deviation according to (2) for the upper threshold is Δμ1, and the calculated value of deviation according to (4) for the lower threshold is Δμ2.
Δμs = (Δμ1 × Δμ2) ^1/2 (geometric mean of Δμ1 and Δμ2)
It is possible to use the composite deviation Δμs calculated in

  As described above, the deviations Δν and Δμ calculated for each parameter are added to the deviation point total counters ν0, μ1, μ2,... For each specified state as shown in FIG. 1: Expressions (4) and (6), or Expressions (7) and (8) in FIG. 77). The specified state (abnormal state or normal state) having the highest deviation point is determined as the state estimation result.

  Note that the contribution from each parameter in determining the specified state was treated as equivalent in the above example. You may make it handle. For example, in FIG. 51, when specifying “diffused concentration”, if there is a problem with the detection accuracy of facial expression change, the weighting coefficient when adding the parameter related to “facial expression” to the matching counter is set as the blood pressure or skin resistance. It is possible to make it smaller than the weighting factor. 77. Expressions (9) and (10) in FIG. 77 show addition expressions when using the weighting coefficient when adding the aforementioned deviations Δν and Δμ to the verification counter. Note that there are individual differences in the set values of the weighting factors, and it is possible to set them individually for each user. Further, the weighting factor may be set to a uniform value for each parameter regardless of the specified state, or the weighting factor of each parameter may differ depending on the specified state in order to perform higher-precision control. (In this case, the weighting factor constitutes a two-dimensional array).

  51. Which of the parameters matches with the information to be collated in FIG. 51, the calculated value of the deviation indicating the degree of coincidence, and the mental / physical state based on the result (FIG. 51). The estimation result of any one of the specified states is collected in the state specifying result table 472 (stored in the RAM or the storage device 535 of the hospitality decision making unit 2) in FIG. In this table 472, for each parameter, the contribution state to the state estimation result and the calculation result of the deviation are summarized. Regarding the contribution state to the state estimation result, parameters (in FIG. 77, blood pressure change, body temperature change, meaning of facial expression, posture) positively contributing to the specified state (slightly poor physical condition in FIG. 77) related to the estimation result Movement, line-of-sight movement, and pattern) and information for distinguishing parameters that are not.

  Specifically, when the state estimation result is “abnormal state (slightly poor physical condition in this case)”, “2” is assigned to the parameter that positively contributes to this. Also, for parameters that contribute non-positively, “0” is given to those indicating “normal state”. On the other hand, “1” is given as a third state (hereinafter also referred to as “neutral state”) that is not “normal state” but shows “abnormal state” different from the state estimation result. That is, information that can identify positive contributions and non-positive contributions to the state estimation results that constitute the “abnormal state”, more specifically, whether the non-positive contributions indicate “normal state”. Information that can be identified as indicating an “abnormal state” different from the state estimation result is stored as contribution information to the state determination. When the state estimation result is “normal state”, “0” is a parameter that contributes positively to “normal state”, and a parameter that contributes non-positively (that is, indicates an “abnormal state”). ) Is assigned “1”.

  Regarding the physical condition or mental state estimated and monitored as described above, if the point values contributing to each specified state (including normal state) are close to each other, Since the state estimation result is fixed, it is difficult to avoid a decrease in accuracy of the estimation result. Therefore, in order to compensate for this, when the point difference of the upper specified state is close to a certain level or less, a question for status confirmation is output to the user by voice or screen display, and the response information is It is possible to correct the state estimation result.

  Specifically, confirmation question information corresponding to each specified state is stored in the storage device 535 or the like for each scene. And when the point difference of the upper specified state is close to a certain level or less as described above, it is possible to check which of the specified states within the point difference is the true specified state A simple question. For example, a question in a format that reminds the specific state with the highest point is effective because it is easy for the user to understand and obtain a clear answer. In this case, with respect to the state estimation result finally determined with reference to the question result, the specified state or the determined state to be determined so that a parameter related to the specified state to be determined is dominant by an algorithm described later. If the threshold value or weighting coefficient of the parameter in the specified state that is competing with the point is corrected / changed, it is effective because the problem that the same question is repeated thereafter is reduced. Specific examples are given below.

(When the normal state point value is slightly above the slightly unwell point value)
(Question) "It looks a little unwell, but it's okay."
(Answer) “Yeah, it ’s okay.” → The normal state is confirmed as the estimation result. (Subsequently, the threshold value or weighting factor of the parameter in the normal state or in the state of competing with it is modified / changed by an algorithm described later so that the parameter points relating to the normal state become more dominant.)

(Slightly unwell point value is slightly higher than normal point)
(Question) “Your complexion is bad.
(Answer) “No, it's okay.” → The normal state is confirmed as the estimation result. (After that, the threshold value or weighting factor of the related parameter is corrected / changed by an algorithm described later until the parameter point related to the normal state exceeds the slightly poor physical condition point.)

(If the point of excitement (anger) is slightly above the point of slight physical condition)
(Question) “What did you do today?
(Answer) “No, it's just a little bad.” → A slight poor physical condition is confirmed as an estimation result. (After that, the threshold or weighting factor of the related parameter is corrected / changed until the parameter point related to the mild physical condition exceeds the point of the excitement (anger) state by an algorithm described later.)

(Slightly poor points are slightly above the points of excitement (anger))
(Question) "What happened, did you catch a cold?"
(Answer) “Noisy, no problem.” → The excitement (anger) state is confirmed as the estimation result. (After that, the threshold value or weighting factor of the related parameter is modified / changed by an algorithm described later until the parameter point related to the excitement (anger) state exceeds the slight poor physical condition point.)

  The processing relating to the state estimation correction as described above can be performed after the start of the hospitality operation in each scene, or can be performed prior to the start of the hospitality operation. In the latter case, the direction of the hospitality operation to be started can be corrected in the initial stage to the direction desired by the user, and the problem that the result of the subsequent hospitality greatly deviates from the user's desire can be prevented.

  Next, the hospitality process in the boarding scene SCN2 can be basically implemented as an extension of the process in the approach scene SCN1 (FIG. 2, OBJ121, OBJ221). That is, if the user gets into the car and the seating sensor 520 detects the user, the hospitality execution control unit 3 wirelessly transmits a performance stop command to the mobile phone 1. This completes the hospitality operation on the mobile phone 1. On the other hand, as for the theme of hospitality in the anxiety / tension relief genre ST3, “I want you to make the interior comfortable” (OBJ321: for example, keeping the interior at a suitable temperature by operating the air conditioner in advance, etc.) "Securing and trouble avoidance" (OBJ322). This can be achieved not only by the foot illumination by the underfloor lamp 512 of FIG. 1 but also by the obstacle suppression mode function of the obstacle and the door by the door assist mechanism 541 of FIG.

  Further, regarding the hospitality theme “I want to get into comfortably” (OBJ 421) of the physical burden reduction genre ST4, the door opening / closing operation can be reduced by the basic operation of the door assist mechanism 541. Since details of the operation of the door assist mechanism 541 have been described, they will not be repeated here. When it is estimated that the physical condition is poor, the burden on the user can be further reduced by controlling the assist force by the door assist mechanism 541 to be higher than normal. In the configuration of FIG. 41, the total torque of the external operating force and the positive assist force is reflected in the torque detection voltage Vst, and the door assist drive by the motor 1010 is feedback-controlled so as to approach Vref1, so that the physical condition is poor. As the user's door opening force decreases, the assist force automatically increases. Also, a method of increasing the assist force by changing this so that Vref1 increases when it is estimated that the state of poor physical condition is possible is also possible. In this case, when a part of the voltage dividing resistor that determines Vref1 is made variable and it is estimated that the physical condition is poor, it is possible to increase Vref1 by changing the voltage dividing resistance value.

  In addition, in the theme “I want to load my baggage easily” (OBJ422), for example, when the user has a large baggage or the user is estimated to be unwell with the camera 518 for outside the vehicle, the user can open the door. Instead of assisting, it automatically opens the door to a certain position, eliminates the need for door operation itself, and assists in loading baggage. It is also effective to assist the loading by informing the position of the trunk room or automatically opening the cover.

  Next, the preparation scene SCN3 and the driving / staying scene SCN4 are entered. In each theme (OBJ131, OBJ141 and OBJ231, OBJ241) of the expectation / excitement genre ST1 and the relaxation / relaxation genre ST2, the operation of the interior lighting 511 executed from the approaching scene SCN1 and the boarding scene SCN2, and the car audio system in the car The process of continuing the performance of 515 is mainly performed (however, the lighting color / pattern and the music selection (or volume) adapted to the scene are changed). In preparation scene SCN3, in order to calm down, lighting with reduced light intensity and exhilarating system ST3 or mild / healing SF selection in FIG. Therefore, an operation such as increasing the amount of illumination light and switching to the music selection of energizing / energizing AG can be exemplified. However, as described above, when an abnormal mental state or physical condition is estimated, the lighting drive pattern and music selection considering this are given priority as in the approaching scene.

  FIG. 13 shows a setting example of the function selection table 372 related to themes OBJ141 and OBJ142 of the expectation / stimulation genre ST1. The operation purpose / disturbance type is the same as in FIG. Out-of-vehicle lighting (5 at night only, 0 during daytime (non-operating)), in-vehicle lighting, power window closing operation, noise canceller, car audio system, DVD player, and other video output devices are selected as hospitality operation units. Regarding the reduction of the noise level in the vehicle, the operation of the noise canceller 1001B shown in FIGS. 44 and 45 contributes greatly to the deadline of the window due to the closing operation of the power window. As described above, the noise canceller 1001B leaves the specified necessary sound such as the car audio system 515, in-car conversation, or the necessary outside sound (emphasis sound) to be recognized as caution or danger by setting the adaptive filter. Because other noise components are canceled out, the music can be heard in a quieter environment, and the necessary outside sound is not missed. In addition, as shown in FIG. 67, in the case of poor physical condition, the specified necessary sound (warning sound / important sound) is left, and equalizing mainly for the low frequency range is performed on the audio output, thereby providing an effect. it can.

  In the control suitability value setting table 371a, the interior lighting level and the musical sound level are set relatively high. When targeting young people who originally prefer a noisy environment, noise in the car, such as wind noise, may contribute to the creation of the car's atmosphere, and there are more or less limitations with regard to picking up the necessary outside sound with an adaptive filter. Therefore, as the musical tone level in the vehicle is set higher, the reduction level of the noise level (the higher the value, the quieter it is) is somewhat suppressed. Note that the control of the musical sound level to the set value can be performed by adjusting the output volume of the car audio system 515 so that the detection level of the sound pressure sensor 540 in FIG. 1 approaches the target value. On the other hand, the control of the noise level to the set value can be performed by setting the target value level of the unerased noise component detected by the error detection microphone 2012 in FIG. 44 to a finite value indicating the desired noise level instead of zero. .

  FIG. 9 shows a setting example of the function selection table 371 related to the themes OBJ241 and OBJ242 of the relaxation / relaxation genre ST2. The operation purpose / disturbance type is the same as in FIG. The selection content of the hospitality operation unit is the same as that of the expectation / excitement genre ST1, but the illumination level and the musical sound level are set lower than the expectation / excitement genre ST1, and conversely the degree of noise level reduction is increased. As described above, it is also effective as an effect for cool-down in poor physical condition or in an excited state.

  Note that if the music performance in the approach scene SCN1 and the boarding scene SCN2 is based on MIDI, it is not easy to enjoy music in earnest, so the performance using the MPEG3 music database 515b (FIG. 17) is not possible. Switch. In this case, the hospitality decision making unit 2 (FIG. 1) selects music source data corresponding to the personality type of the user.

  However, if the user does not like the song automatically selected by the hospitality decision making unit 2, the user can switch the performance to a favorite song at any time by an input from the operation unit 515d. When the user selects a song by himself / herself, as shown in FIG. 20, the specific information (user name or user ID) of the user, the ID of the selected music source data, and the aforementioned hospitality reference data RD (personality type code) , Age code, gender code, genre code, and music mode code) are stored in the music selection record storage unit 403 (formed in the storage device 535 in FIG. 1) in a form associated with each other. In this embodiment, the date and time of music selection, the user's sex and age are also stored.

  As shown in FIG. 21, in the music selection record storage unit 403, statistical information 404 (stored in the storage device 535 in FIG. 1) of the music selection record is created for each user. In this statistical information 404, the music selection data is counted for each personality type code (SKC), and which personality type of music is selected most frequently is specified as a numerical parameter. As the simplest process, it is possible to specify the personality type having the highest frequency of music selection as the personality of the user. For example, if the number of track selections accumulated in the statistical information 404 reaches a certain level, for example, the personality type initially set by user input is replaced with the personality type derived from the statistical information 404 as described above. That's fine.

  By the way, the classification of personality of users is actually more complicated, and the taste of music is not so simple that it can be uniformly pushed into the same personality type. Also, it may easily change in the short term depending on the living environment (whether it is fulfilled or stress is accumulated) where the user is located. In this case, it is not strange that the taste of music fluctuates and the personality type derived from the statistics may also change. In this case, as shown in FIG. 21, if the statistics of the music selection results are not collected retroactively but limited to the most recent period (for example, 1 to 6 months), the statistics information 404 of the music selection results is created. In addition, short-term fluctuations in personality types can be reflected in the statistical results, and the hospitality content by music can be changed flexibly according to the user's condition.

  Also, even the same user does not always select music of the same personality type, and may be selected across music of other personality types. In this case, if the music is selected only from the personality type having the highest frequency of music selection, there may be a situation that is not always desirable in order to change the mood of the user. Therefore, a method is adopted in which the music selection probability expectation value to be assigned to each personality type is assigned according to the music selection frequency indicated by the statistical information 404 and randomly selected from each personality type in a weighted form according to the expected value. You can also. In this way, the music source that the user is more or less interested (ie, selected music) is preferentially selected from those with a high frequency of selection across multiple personality types, and occasionally other than your personality type You will be able to receive hospitality with the music of this, which will make you feel better. Specifically, a random number table composed of a certain number of random values is stored, and the number of random values assigned to each personality type is distributed in proportion to the music selection frequency. Next, it is possible to specify a personality type to be selected by generating a random number using a well-known random number generation algorithm and checking which personality type the obtained random number value is a random value assigned to. Become.

  In the statistical information 404, the frequency of music selection by music genre (JC), age (AC), and gender (SC) is also counted. The music source data belonging to the genre, age group or gender can be configured to be preferentially selected. If it does in this way, it will become possible to perform the hospitality music selection which matched by a user preference. A plurality of personality types can be assigned to one music source data.

  FIG. 30 is a flowchart showing an example of the process. When the music selection frequency statistics for each personality type are obtained as shown in FIG. 21, as shown in the lower part of FIG. 30, the random number values on the random number table are allocated to each personality type in proportion to the individual music selection frequency. . Next, in S108 of the flowchart, one arbitrary random number value is generated, and a personality type code corresponding to the acquired random number value is selected on the random number table. Next, in S109, the one corresponding to the personality code is selected from the lighting control data group of FIG. In S110, the music source data corresponding to the genre, age group, and sex with the highest frequency of music selection in FIG. 21 are extracted from the music source data corresponding to the acquired personality type code (of course, the personality is also used here). As in the case of determining the type, the genre, age group, and gender related to the music selection may be selected by a random distribution according to the frequency of each genre, age group, and gender). If there are a plurality of extracted music source data, one music source data ID among them may be selected by random numbers as in S111, or a list of music source data may be displayed on the monitor 536 ( As shown in FIG. 1, the user may manually select the operation unit 515 d (FIG. 17). In this way, lighting control of the lighting device in the automobile while the user is driving (or the user is staying) is performed according to the selected lighting control data, and music performance based on the selected music source data is transmitted to the car audio system. It is done.

  Hereinafter, other hospitality themes assigned to the preparation scene SCN3 and the driving / staying scene SCN4 will be described. The theme “I want to know the state of my destination / way” is a theme that is set across both scenes. For example, on the preparation scene SCN3 side (OBJ331), as shown in the function selection table 371 in FIG. The vehicle-side GPS 533 and the car navigation system 534 are selected as the hospitality operation unit, and with the destination setting, the situation of the site and the road is acquired via the wireless communication network, and the hospitality operation is performed on the monitor of the car navigation system 534. Is called. The operation purpose / disturbance type “in-vehicle brightness” / “in-vehicle environment” is the same as in the other function selection tables already described. With respect to entertainment elements and information provision, the hospitality operation is selected according to the user's preference and is basically irrelevant to disturbance. In this case, it is possible to select an appropriate hospitality operation according to the estimation result of the mental state or physical condition of the user by an algorithm described later. On the other hand, “in-car accommodation” can be independent of disturbance. On the other hand, if the positional relationship between the user and the handle or the seat can be specified by the separately provided user detection sensor 565 (FIG. 1), it is determined that a disturbance has occurred when the positional relationship is out of the proper state. It is possible to adjust the handle position and the front / rear position or height of the seat as a hospitality operation so that the disturbance is reduced.

  In the driving / staying scene, the personality type of the user can also be estimated using information other than the music selection performance of the music source. For example, operation performance data for each user can be accumulated, and the personality type of the user can be specified based on the analysis result of the operation performance data. Specific examples thereof will be described below. As shown in FIG. 22, an operation that is easily performed when the user feels stress during driving is determined in advance as a stress reflection operation, the corresponding stress reflection operation is detected by a corresponding detection unit, and the detection result is reflected in the stress. Stored and accumulated as operation statistics data 405 (FIG. 1: in storage device 535). And based on the accumulation result, the personality type of the user is estimated. The embodiment described below focuses on how to suppress the influence of personality factors that are undesirable in driving a car.

  In this embodiment, the stress reflection operation is horn operation (irritated and horns are struck), number of brakes (too much space between cars, step on brakes), number of lane changes (following previous car) Change lanes frequently when going over: horn switch that can be detected by steering wheel operation angle + steering wheel operation angle after winker operation (if the steering wheel operation angle is below a certain level, it is considered a lane change) 502a, the brake sensor 530, the blinker switch 502W, and the acceleration sensor 532 function as a stress reflection operation detection unit. As each operation occurs, the corresponding counter in the stress reflecting operation statistics storage unit 405 counts up and the number of times is recorded. It can be said that these operations reflect the orientation toward “dangerous driving”.

Further, the traveling vehicle speed is detected by the vehicle speed sensor 531, the acceleration is detected by the acceleration sensor 532, and the average speed V _N and the average acceleration _AN are calculated and stored in the stress reflecting operation statistics storage unit 405. Average acceleration A _N is the average value only during a period in which a certain level or higher acceleration increasing direction is detected is taken, less low speeds during periods of acceleration variations are not incorporated into the average value calculation. By doing so, the value of the average acceleration A _N is a value that reflects whether prefer or profusely in Dari depresses the accelerator, or sudden acceleration due to overtake the like. Further, the travel distance is calculated from the output integrated value of the vehicle speed sensor 531 and stored in the stress reflection operation statistics storage unit 405.

  Furthermore, the stress reflection operation statistics are created separately for the general road section and the highway section (the identification is possible by referring to the travel information from the car navigation system 534). In other words, when driving on a highway, if it is flowing smoothly, users who normally drive should be less likely to blow horns, step on brakes, or change lanes. This is because the number of reflection operations detected should be added with higher weight than the general road section. Further, since the average speed and the average acceleration are inevitably higher than those of the general road section, the influence can be mitigated by taking statistics by distinguishing the general road section and the highway section as described above.

An example of the personality determination algorithm using the stress reflection operation statistics is shown below, but is not limited thereto. First, regarding the number of horns Nh, the number of brakes N _B , and the number of lane changes N _LC , in general road sections (indicated by the suffix “O”) and highway sections (indicated by the suffix “E”) Multiply each value by the weighting factors α and β (where α <β: either coefficient may be fixed at 1 and the other coefficient may be displayed as a relative value) The value divided by L is calculated as the number of conversions (indicated by the subscript “Q”). On the other hand, the average speed and the average acceleration are similarly calculated as the converted average speed and the converted average acceleration by adding the values in the general road section and the values in the highway section by multiplying by the weighting factor. A value obtained by adding all of them is obtained as a personality estimation parameter ΣCh, and personality estimation is performed according to the value of the ΣCh.

  In the present embodiment, the range of the value of ΣCh is divided into a plurality of sections by predetermined different boundary values A1, A2, A3, and A4, and a personality type is assigned to each of the sections. Then, the reduction coefficients δ1, δ2, and δ3 (all greater than 0 and less than 1) are defined in association with the section to which the calculated ΣCh value belongs. An example of the flow of a specific personality analysis process using this is shown in FIG. As described above, the user is authenticated in S101, and the music selection record data 403 in FIG. 20 is acquired in S102. Then, in S103, the music selection statistics data 404 of FIG. 21 is created. Next, in S104, the information (running performance data) accumulated in the stress reflecting operation statistics storage unit 405 of FIG. 22 is read, and in S105, the value of ΣCh is calculated by the above method, and the corresponding personality type is determined. Specify the reduction coefficient δ. In S106, the most frequently used personality type is identified from the music selection record statistical information 404, and the apparent frequency is reduced by multiplying this by the reduction coefficient δ. As a result, for example, when a result that increases ΣCh is obtained in an “active” user, the direction toward dangerous driving that increases ΣCh is increased because of the “active” personality. This means that the frequency of music selection that boosts this can be suppressed by multiplying by the reduction factor δ, leading to safe driving. In addition, when a result that ΣCh is low is obtained for “adult” users, the music selection frequency corresponding to “adult” is suppressed by multiplying by the reduction factor δ, and the active music selection frequency is relatively Therefore, it is possible to enhance the safety by giving a moderate stimulus to the user and sharpening the driving.

  Next, during driving, it becomes more necessary to consider mental state and physical condition separately from personality. In the state where the user (driver) is seated in the driver's seat, more biological state detection units (sensors and cameras) for acquiring biological state parameters can be employed. Specifically, FIG. Infrared sensor 519, seating sensor 520, face camera 521, microphone 522, pressure sensor 523, blood pressure sensor 524, body temperature sensor 525, iris camera 527, and skin resistance sensor 545 can be used. These biological state detection units can capture the biological reaction of the user during driving from various angles, and the hospitality decision making unit 2 is the same as described in detail in the embodiment in the approach scene. The mental state and physical condition of the user are estimated from the temporal change information of the biological condition parameter to be detected, and the hospitality operation is performed in a form adapted to this.

  As described above, the facial expression information is obtained from the still image of the face photographed by the face camera 521. As shown in FIG. 34, the whole (or part: for example, eyes and mouth) image is converted into various psychological states. Compared to the master image in state or physical condition, whether the user is angry, calm, in good mood (eg fun and exciting), in bad mood (eg, discouraged or sad) Or whether they are exposed to anxiety or tension. Also, instead of using a master image unique to the user, the facial contour, eyes (or iris), mouth and nose positions and shapes are extracted as facial feature values common to all users, and the feature values are extracted. Can be compared with standard feature values measured and stored in advance in various psychological states or physical conditions. In addition, it can also be used for specification of a user's personality type by classifying and collating face types according to personality from the above facial feature quantities.

  The movement of the body includes a moving image of the user (for example, moving in small steps, frowning, etc.) taken by the face camera 521, a detection state of the pressure sensor 523 (for example, frequently releasing the hand from the handle) ) Or the like, for example, it can be determined whether the driving user is frustrated or not.

  The body temperature can be detected and specified by a body temperature detection unit such as a body temperature sensor 525 attached to the handle or a thermography of a face acquired by the infrared sensor 519. With the same algorithm as shown in FIG. 54, it is possible to determine whether the body temperature changes rapidly and the average body temperature level changes / maintenance. In addition, by registering the user's normal heat in advance and measuring the temperature shift from that normal temperature (especially on the high temperature side) with the body temperature detection unit, it is possible to detect more subtle changes in body temperature and thus the emotional movement caused by it. Is possible.

  FIG. 55 shows an example of a flowchart of the skin resistance change waveform analysis process. In the sampling routine, the skin resistance value detected by the skin resistance sensor 545 every time a sampling timing determined at a constant time interval arrives. Is sampled and the waveform is recorded. Then, in the waveform analysis routine, the skin resistance value sampled in the most recent fixed period in SS103 is acquired as a waveform, and in SS104, a well-known fast Fourier transform process is performed on the waveform to obtain a frequency spectrum. The center frequency (or peak frequency) f of the spectrum is calculated. 53, the waveform is divided into a certain number of sections σ1, σ2,..., And the average skin resistance value for each section is calculated in SS107. Then, integral amplitudes A1, A2,... Are calculated for each section using the average skin resistance value as the waveform center line. In SS109, the integral amplitude A of each section is plotted against time t, and the gradient α is obtained by least squares regression.

  In SS110, it is checked whether or not the frequency f is larger than the upper limit threshold fu0. In SS112, it is checked whether or not the frequency f is smaller than the lower limit threshold fL0 (> fu0), and if it is smaller, it is determined that the skin resistance change being monitored is “slow”. If fu0 ≧ f ≧ fL0, the process proceeds to SS114, and the skin resistance change being monitored is determined to be “standard”. Next, proceeding to SS115, the absolute value of the gradient α is compared with the threshold value α0. If | α | ≦ α0, it is determined that the average skin resistance level being monitored is in a “constant” state. In the case of | α |> α0, if the sign of α is positive, it is determined that the average skin resistance level being monitored is in an “increasing” state, and if it is negative, it is determined that it is in a “decreasing” state.

  As shown in FIG. 51, when the change in the detected skin resistance value is abrupt and the direction of the change is “increase”, it can be estimated that the mental state is “diffused concentration”. With regard to poor physical condition, mild ones are not so much reflected in the temporal change in skin resistance, but as the poor physical condition progresses, the change in skin resistance value gradually increases, so it is effective in estimating “severe poor physical condition” It is. When the skin resistance value decreases rapidly, it can be estimated with high accuracy that the state is “excited (angry)”.

Next, FIG. 57 shows an example of a flowchart of the attitude signal waveform analysis process. In the sampling routine, the attitude signal described with reference to FIG. 58 each time a sampling timing determined at a constant time interval arrives. The value (Vout) is sampled and the waveform is recorded (SS201, SS202). Then, in the waveform analysis routine, the attitude signal value sampled in the latest fixed period in SS203 is acquired as a waveform, and in SS204, a known fast Fourier transform process is performed on the waveform to obtain a frequency spectrum. The center frequency (or peak frequency) f of the spectrum is calculated. Further, in SS 206, as shown in FIG. 53, the waveform is divided into a predetermined number of sections σ1, σ2,... Then, integral amplitudes A1, A2,... Are calculated for each section using the average posture signal value as the waveform center line. In SS209, the integral amplitude A in each section is averaged and determined as a representative value of the waveform amplitude. Further, the SS210, calculates the variance sigma ² of the integrated amplitudes A.

In SS211, it is checked whether or not the frequency f is larger than the upper limit threshold fu0. If it is larger, it is determined that the posture change speed under monitoring is “increase”. Further, in SS213, it is checked whether or not the frequency f is smaller than the lower limit threshold fL0 (> fu0), and if it is smaller, it is determined that the posture change speed being monitored is “decrease”. If fu0 ≧ f ≧ fL0, the process proceeds to SS215, and it is determined that the posture changing speed being monitored is “normal”. Next, proceeding to SS216, the average value An of the integrated amplitude A is compared with a predetermined threshold value, and the posture movement amount is determined as one of “small change”, “slight increase”, and “rapid increase” ( The larger the average value An, the more the posture movement amount tends to increase). Further, it is determined that the SS217, when the value of the variance sigma ² of A is greater than or equal to the threshold value, attitude change is in the increasing or decreasing trend.

  The change in posture shows a significantly different tendency depending on the difference in the basic specified state (“physical condition”, “concentration distraction”, and “excited state”). It is. If it is normal, the user who is driving can maintain the tension necessary for driving while maintaining a proper posture. On the other hand, when physical condition is poor, gestures that occasionally change postures to relieve spiciness become noticeable, and the posture movement amount tends to slightly increase. However, when the physical condition further progresses (or when extreme sleepiness is attacked), the posture becomes unstable and wobbles, and the posture movement tends to increase or decrease. Since the posture movement at this time is unstable and the body control is not good, the speed of the posture movement is greatly reduced. Also, when the concentration is scattered, the posture movement increases and decreases slowly, but the posture control speed does not decrease so much because the body control is good. On the other hand, when the person is in an excited state, the posture movement increases rapidly and the movement speed increases because the patient becomes restless or frustrated.

FIG. 60 shows an example of a flow chart of the line-of-sight angle waveform analysis process. In the sampling routine, a face image is photographed at SS 252 every time a sampling timing determined at regular time intervals arrives, and the image is included in the image. Then, the pupil position and the face center position are specified, and in SS253, the blurring from the front direction of the pupil with respect to the face center position is calculated, and the line-of-sight angle θ can be obtained. In the waveform analysis routine, the line-of-sight angle value sampled in the most recent fixed period in SS254 is acquired as a waveform, and in SS255, a known fast Fourier transform process is performed on the waveform to obtain a frequency spectrum. In SS256, the frequency spectrum is obtained. The center frequency (or peak frequency) f of the spectrum is calculated. Further, in SS257, as shown in FIG. 53, the waveform is divided into a predetermined number of sections σ1, σ2,... In SS259, the integral amplitudes A1, A2,... Are calculated for each section using the average line-of-sight angle value as the waveform center line. In SS260, the integral amplitude A in each section is averaged and determined as a representative value An of the waveform amplitude. Further, the SS261, calculates the variance sigma ² of the integrated amplitudes A.

In SS262, it is checked whether or not the frequency f is larger than the upper limit threshold fu0. If it is larger, it is determined that the changing speed of the line-of-sight angle θ being monitored is “increase”. Further, in SS264, it is checked whether or not the frequency f is smaller than the lower limit threshold fL0 (> fu0), and if it is smaller, it is determined that the changing speed of the line-of-sight angle θ being monitored is “decrease”. If fu0 ≧ f ≧ fL0, the process proceeds to SS266, and it is determined that the changing speed of the line-of-sight angle θ being monitored is “normal”. Next, proceeding to SS267, the average value An of the integrated amplitude A is compared with a predetermined threshold value, and the change amount of the line-of-sight angle θ is set to one of “small change”, “slight increase”, and “rapid increase”. Determination (the larger the average value An is, the more the change amount of the line-of-sight angle θ tends to increase). Further, the SS268, if the value of the variance sigma ² of A is greater than or equal to the threshold, a condition in which a change in viewing angle θ is in a decrease trend, the words "modulated" state (so-called, a state where the eye is rove) Is determined.

  First, the line-of-sight angle θ is a decisive factor in estimating the distraction of the concentration because the amount of movement increases rapidly when the concentration is diffused, and the modulation is suddenly made. In addition, when a poor physical condition occurs, the amount of line-of-sight movement decreases according to the degree of the poor condition, which is also effective for estimating a poor physical condition. Also, the amount of gaze movement decreases even in the excited state, but when the physical condition is poor, it becomes difficult to follow the line of sight when the view changes, and the movement speed also decreases, while in the excited state the change of the visual field etc. The speed of the gaze movement that occurs from time to time, such as being sensitive to and scolding it, is so great that they can be distinguished from each other.

FIG. 61 shows an example of a flowchart of pupil diameter change analysis processing. In the sampling routine, every time a sampling timing determined at a constant time interval arrives, the SS 302 performs the user's operation with the iris camera 527 (FIG. 1). The iris is photographed, and in SS 303, the pupil diameter d is determined on the image. In the analysis routine, the pupil diameter d sampled in the latest fixed period in SS304 is acquired as a waveform. Further, in SS305, as shown in FIG. 53, the waveform is divided into a predetermined number of sections σ1, σ2,..., And the average pupil diameter dn for each section is calculated in SS306. Then, in SS307, the integrated amplitudes A1, A2,... Are calculated for each section using the average pupil diameter value as the waveform center line, and in SS308, the average value An of the integrated amplitude calculated for each section is calculated. Further, the SS309, calculates the variance sigma ² of the integrated amplitudes A.

In SS310, it is checked whether or not the pupil diameter average value dn is larger than the threshold value d0. If it is larger, the process proceeds to SS311 to determine “pupil open”. Further, the process proceeds to SS312 unless increased, determine whether variance sigma ² of the integrated amplitudes A of the pupil diameter change waveform is greater than the threshold value sigma ^{2 0,} it determines "pupil diameter variation" greater. If it is not larger, it is determined as “normal”.

  As shown in FIG. 51, the pupil diameter d changes significantly depending on the mental state of the user, and in particular, whether or not the user is in an excited state based on whether or not there is a specific pupil open state. It can be estimated with high accuracy. Further, when the pupil diameter varies, it can be estimated that the concentration is distracting.

  In the present invention, the driver's steering operation state is also used as a biological state parameter for estimating the driver's mental or physical condition. However, steering sampling and evaluation should be limited to straight running. Steering operation is not monitored or evaluated during periods when the steering angle is predicted to increase inevitably, such as when turning left or right or when changing lanes. It is desirable that the steering may be determined to be unstable even though it is normal. For example, if there is a blinker lighting operation, the blinker lighting period and a certain period before and after the steering operation is expected (for example, about 5 seconds before lighting and about 10 seconds after lighting) are evaluated. It should be excluded.

FIG. 62 shows an example of a flowchart of the steering angle waveform analysis process. In the sampling routine, every time a sampling timing determined at a fixed time interval arrives, the current value is output from the steering angle sensor 547 at SS352. The steering angle φ is read (for example, φ = 0 ° in a straight traveling neutral state, and defined as a touch angle to either the left or right (for example, the right angle is positive and the left angle is negative). In the accuracy analysis routine, a steering angle value sampled in a recent fixed period is acquired as a waveform in SS353, and a known fast Fourier transform process is performed on the waveform in SS354 to obtain a frequency spectrum. In SS355, the spectrum of the spectrum is obtained. The center frequency (or peak frequency) f is calculated, and in SS356, as shown in FIG. The waveform is divided into a fixed number of sections σ1, σ2, etc., and an average steering angle value for each section is calculated in SS357, and in SS358, the integral amplitude A1, the average steering angle value is set as the waveform center line for each section. A2 calculates the ‥. Then, the SS359, calculates the variance sigma ² of the integrated amplitudes a.

In SS360, it is checked whether or not the frequency f is larger than the upper limit threshold fu0. If it is larger, the process proceeds to SS361 and it is determined that the changing speed of the steering angle φ being monitored is “increase”. Further, in SS362, it is checked whether or not the frequency f is smaller than the lower limit threshold fL0 (> fu0), and if it is smaller, it is determined that the changing speed of the steering angle φ being monitored is “decrease”. If fu0 ≧ f ≧ fL0, the process proceeds to SS364, where it is determined that the changing speed of the steering angle φ being monitored is “normal”. Then, the process proceeds to SS365, it determines examined whether variance sigma ² of the integrated amplitudes A of change waveform of the steering angle φ is greater than the threshold value sigma ^{2 0,} larger if the steering error is the "increase" (SS366). If it is not larger, it is determined as “normal” (SS367).

  Further, the steering error can be detected not only by the above-described detection by the steering angle but also from the monitoring image by the traveling monitor camera 546 in FIG. The traveling monitor camera 546 can be attached to, for example, the center of the front of the automobile (for example, the center of the front grill), and captures the field of view ahead of the traveling direction as shown in FIG. Once the camera mounting position on the vehicle is determined, the vehicle width center position (vehicle side reference position) in the direction of travel in the field of view is also determined. For example, by identifying the shoulder line, center line, or lane separation line on the image The center position of the lane in which the vehicle is traveling can be specified on the image. And if the shift | offset | difference from said lane center position of said vehicle width center position is calculated | required, it can monitor whether the motor vehicle which it drives can keep the center of a lane. FIG. 64 is a flowchart showing an example of the processing flow. In SS401, a frame of a travel monitor image is acquired. The lane-side edge line (orange line) is extracted by well-known image processing and specified as the lane width position. In SS 403, the position that bisects the distance between the edge lines is calculated as the lane center position. On the other hand, in SS404, the vehicle width center position is plotted on the image frame, and the deviation amount η in the road width direction from the lane center position is calculated. This process is repeated for image frames captured at predetermined time intervals, and recorded as a time-change waveform of the shift amount η (SS405 → SS401).

  In this case, the steering accuracy analysis processing can be performed according to the flow shown in FIG. 65, for example. That is, in SS451, the integral amplitude A with respect to the center line of the waveform for the most recent fixed period is calculated, and in SS453, the average value ηn of the deviation amount η from the lane center position is calculated. In SS454, the integrated amplitude A is compared with a predetermined threshold A0, and if this threshold is exceeded, the process proceeds to SS455 and it is determined that the steering error is “increased”. When A is large, it means that the deviation amount η fluctuates greatly with respect to time, and shows a tendency of a kind of wobbling travel. On the other hand, if the center of the lane cannot be kept and the tendency to approach the end continues, even if the integral amplitude A is smaller than the threshold value A0 in SS454, the deviation amount η itself becomes large and should be determined as abnormal. . Therefore, in this case, the process proceeds to SS456, and if the deviation amount average value ηn exceeds the threshold value ηn0, the process proceeds to SS455 and it is determined that the steering error is “increase”. On the other hand, if the deviation average value ηn is smaller than the threshold value ηn0, the process proceeds to SS457 and is determined to be “normal”.

  As for the steering speed (response to steering), the waveform is subjected to a well-known fast Fourier transform process to obtain a frequency spectrum, the center frequency (or peak frequency) f of the spectrum is calculated, and the tendency is determined from the f. Is possible. In this case, it is checked whether the frequency f is larger than the upper limit threshold fu0. If it is larger, it is determined that the steering speed is “increased”. In SS362, it is checked whether or not the frequency f is smaller than the lower limit threshold fL0 (> fu0), and if it is smaller, it is determined that the steering speed is “decrease”. If fu0 ≧ f ≧ fL0, it is determined that the steering speed is “normal”.

  As shown in FIG. 51, it can be estimated that the driver is in a state of distraction or an excitement by detecting an increase in steering error. On the other hand, even when a severe physical condition (including a dozing state) occurs, normal steering is hindered, and this can be estimated from an increasing tendency of errors. On the other hand, poor physical condition and distraction of concentration tend to delay the response to steering, and this can be estimated from the decrease in steering speed. Further, in the excited state, it is irritating and it is easy to turn the steering wheel, so this can be estimated from the increase in the steering speed.

  Now, in the running scene, the process of specifying the specified state is performed according to the flow of FIG. In this case, since the number of the biological condition parameters to be referred to increases, the score of the matching counter is regarded as the “matching degree”, and the one with the highest score, that is, the one with the highest matching degree is determined as the specified state. The method is more effective. As described above, the addition to the verification counter will give a lower score than the case of perfect match if the collated information does not completely match the decision result, but the result that is close within the defined range is obtained. While limiting, this can be done to add to the verification counter.

  If the specified state can be specified, very many specific examples can be considered as the hospitality control corresponding to this. For example, in the theme “appropriate driving environment setting” OBJ441 in FIG. 2, as shown in the function selection table 371 in FIG. 12, the car navigation system 534 (for video output), the car audio system 515, the air conditioner 514, the interior lighting 511, and the steering wheel adjustment The unit and seat adjustment unit are selected as the hospitality operation unit, and as described above, the music selection is changed according to the mental state and physical condition of the driver (user), the set temperature of the air conditioner, the lighting color or lighting in the car Adjust the strength. In addition, the handle adjustment unit and the seat adjustment unit automatically adjust the position of the handle, the front / rear position of the seat, the angle of the backrest, etc. by the motor operation.For example, when it is determined that the feeling of tension is weakened, Raise the back and raise the seat, or raise the handle so that you can concentrate on driving. When it is determined that the user is tired, it is effective to finely adjust the angle of the backrest in such a direction that the user's movement showing discomfort is calmed down.

In addition to the above, there are the following modes.
・ Excited state (when it is determined that the person is feeling too high, or when it is determined that they are feeling angry or stressed): Playing quiet and comfortable music to calm down. In addition, the air-conditioning temperature is lowered, and a rhythm vibration that is slow (longer than that when the concentration is disseminated later) is generated and relaxed by the seat vibrator 550. Also, if it is assumed that overtaking from the following vehicle, interrupting, passing, horning, etc. are related to the driver's unpleasant mental state, “What, excuse me. Do n’t worry. "I love you as an adult," and so on. Also, when the speed exceeds (car speed detection) or is about to exceed: “Let's go slowly… the night is long. You ’re safe driving.” Output a prompt message.
When the concentration power is diffused: Impulse strong vibration is generated in the handle vibrator 551 and the seat vibrator 550 to promote concentration. Further, a strong odor for care is generated from the ammonia generator 549.
・ Unwell (if fatigue or disease symptoms (such as fever) are observed): Promote safe driving such as speed control, stopping or resting. When the railroad crossing or red signal is approached, caution information is output as a voice. In the worst case, notifications of driving suspension etc. are given by voice output or monitor display. Moreover, the fragrance which encourages relaxation is generated from a direction generation part. As for sleepiness, the same hospitality as when the concentration is distracted is also effective.
・ If you are feeling depressed (facial expression, body temperature): Play good music or change the lighting to something red or other exciting ones to boost your mood.

  A more specific example will be described taking as an example the selection of music for hospitality performed during driving. The personality type code described above provides a music source having a personality type code that matches the personality of the specified user, such as the personality type code of the music source to be selected. Used in a matching form. On the other hand, for the song mode code, the song mode assigned to the music source is not necessarily used to match and match the mental state and physical condition of the specified user. For example, it is used to set a certain mental state as a target value and to bring the user's mental state closer to this, such as selecting a mild / healing or healing / α wave music source. If the user's mental state elevation can be parameterized, the music mode code is also set in order corresponding to this, and the music selection control is performed so that the song mode code corresponding to the mental state elevation parameter is selected. be able to. Specifically, when it is determined that the mental state of the user is higher the higher the value of the mental state elevation parameter, the “rising system”, “exhilaration system”, “warm / healing system”, “healing / healing system” If you select a song mode code that is located at the lower part of the rank, the higher the value of the mental state elevation parameter is, the calmer it is if you feel too high When the song is selected, and when it is depressed, the song mode code is selected so that the song is selected so as to raise the mood. In the former case, the effect of suppressing excessive speed due to mood excitement, etc. is obtained, and in the latter case, the user's arousal is promoted and the driver's attention is improved. Contributes to driving. On the other hand, when the physical condition level is deteriorated, it can be said that it is desirable not to perform extreme music selection that causes the user to get tired as much as possible regardless of the above mental state.

  For example, as shown in FIG. 34, when the user's mental state is divided into three levels of excitement (anger), concentration distraction (anxiety / tension), and stability, the music of FIG. A mode code is uniquely associated. In this embodiment, “anger / healing” (SF) corresponds to “anger”, “exhilaration” (ST) corresponds to “anxiety / tension”, and “healing / revitalization” (AG) corresponds to stability. Attached (first setting).

  When using the car navigation system 534, when heading to a destination farther than a certain distance, the driver's tiredness is added on the way home, so the song mode code corresponding to make the driving calmer than going It can be set to lower the level (second setting). In FIG. 34, regarding “return”, “healing / α wave system” (HL) for “anger”, “mild / healing system” (SF) for “anxiety / tension”, “exhilaration system” (ST) for stability. ) Are associated.

  FIG. 35 shows a flowchart of the process. In S501, it is determined whether to go or return, and in S502 and S503, the music mode code is set to a corresponding level. In S504, the detection state of the biological state detection unit is read, and the mental state is estimated in S505 and S506. In the case of “stable state”, the processing of S507 is performed, in the case of “tension / anxiety”, the processing of S508 is performed, and in the case of “anger”, the processing of S509 is performed. Music performance is performed with music selection corresponding to each mental state (the personality type is determined separately by the above-described method, and the music selection corresponding to the mental state is performed in the music source group corresponding to the personality type). Note that, along with music performances, room lighting and air conditioner adjustment are also controlled in a form corresponding to each mental state. For example, in the case of “going” in the “stable state”, in addition to the performance music (AG), the red lighting is used and the room temperature is set to be slightly higher. In order to relax, “return” is performed with a refreshing amber system in addition to the performance of refreshing (or stable) music, and the room temperature is set a little lower than the going.

  In the case of “going” and “tension / anxiety”, in order to relax, in addition to playing exhilarating (or stable) music, the lighting is a calm amber system, and the room temperature is set slightly lower than the going. In “Return”, in addition to the performance of healing music (SF), white lighting is used, and the room temperature is further lowered. And if it is “going” or “angry”, it is necessary to cool down as soon as possible. In addition to playing soothing music (SF), use white lighting and use air conditioning to further increase the room temperature. Lower. “Return” uses music as a healing system (HL) and switches to blue lighting, but to prevent fatigue, the temperature is higher than “going” and “angry” so that the temperature does not drop drastically. Set to.

  Returning to FIG. 2, the following hospitality operations are possible in the getting-off scene SCN5 and the leaving scene SCN6. For example, in the theme “I want you to increase your sense of arrival at your destination” (OBJ151, OBJ161, OBJ251, OBJ261), you can aim for the arrival of the user with music and lighting suitable for the destination. "Let's play and have fun!" In addition, in the theme “Check for lost items / getting off” (OBJ351), it is possible to output a message for forgetting items in the car and for preventing infants from leaving the car (this operation is performed using the mobile phone 1) It can be continued with SCN6). For “OBJ352” and “OBJ551” to get off easily (OBJ352) and “OBJ352” when getting off the vehicle, the door assist mechanism 541 assists in opening and closing the door, and the obstacle-to-door collision suppression mode is the same as when getting on. Function can be activated. Even in a leaving scene, the operation of the outside camera 518 is used to monitor the traffic conditions around the vehicle, and when the oncoming vehicle or the following vehicle is approaching the user, the mobile phone 1 is used to call attention. It is possible to output a message.

  Next, even after the hospitality operation is started in each scene, the detection of the biological condition parameter and the monitoring of the physical condition or the mental condition based on the waveform analysis are continued, and the above-described state confirmation process (FIG. 48: δ7 or δQ). ). Details thereof will be described below. First, the basic hospitality process is selected according to the priority order for each scene and theme as described above by the function selection table 371 shown in FIGS. The appropriate control values of the individual hospitality operation units are given to the appropriate control value setting table 371a corresponding to the function selection table 371, and this is adopted as the default setting value for starting control. On the other hand, in the state adaptation process of δ3, the mental state or the physical condition is specified using the determination table 1601 of FIG. Then, according to the specified mental state or physical condition, a seasoned adjustment (correction) is performed on the appropriate control value of each hospitality operation unit according to the image shown in FIG. The default setting value can be set differently depending on the user. In this case, as shown in FIG. 73A, the default setting value of each user is stored as user-specific default setting data 434 in association with user specifying information (for example, user ID), and the user of the car is specified. If it can, the corresponding default setting data can be read and set as needed.

  The function selection table 371 and the control aptitude value setting table 371a are originally prepared for each scene / theme, but in the following, in order to explain a specific example of the driving scene more clearly, The main hospitality operations are extracted from the various hospitality themes adopted, and are shown as a comprehensive function selection table 372 and a control aptitude value setting table 471a, respectively, together with the corresponding control aptitude values.

  “Illumination level” means that the greater the value, the greater the amount of illumination light. As for “illumination color”, the set numerical value corresponds to the emission color index of FIG. “Air conditioning setting” means that the larger the numerical value, the higher the set room temperature. “Seat vibration” is defined by the amplitude and frequency of the vibration output of the seat vibrator. Both of these values mean that the larger the value, the higher the amplitude or frequency. Becomes a relaxing vibration). “Aroma” means that the greater the value, the greater the amount of fragrance released from the fragrance generating part. “Caution” means that the larger the numerical value, the larger the amount of ammonia released from the ammonia generating part. “Musical sound level” means that the larger the value, the higher the output volume from the car stereo. “Necessary sound capture” is a set value for the noise canceller. As the numerical value is larger, it means that processing for capturing the necessary sound of the part at a higher level is performed by the above-described mechanism. “Warning sound output” means that the output volume of a warning sound (due to a car stereo, buzzer, etc.) output when an abnormality occurs increases.

  In particular, in order to deal with emergencies and abnormalities (including poor physical condition of the user), on the function selection table 371, noise canceller (for capturing necessary sounds, etc.), car audio (warning sound output), and awareness (ammonia) The action priority of awakening is set higher. This setting is temporary in the event of an emergency or occurrence of an abnormality. Furthermore, if the aptitude value is changed after waiting for the user's response, there is a possibility that the response to an abnormality / emergency may be delayed. Therefore, as shown in FIG. 70, a dedicated control aptitude value setting table 471b is separately provided for an emergency or when an abnormality occurs, and can be used by switching from the normal control aptitude value setting table 471a as needed. desirable.

  For example, in the case of emergency, as is clear from comparison with FIG. 13, the setting of the illumination color has been changed from “7” (relaxed light orange) to “6” (white). Visibility is improved. In addition, the level of required external sound acquisition is changed to a high level (“5” → “6”). Further, the output level of the warning sound is changed to a high level (“7” → “9”). Further, as an example at the time of abnormality, the control suitability value setting table 471b in the case where a severe physical condition has occurred is illustrated, but here, the necessary sound capturing level is set to be larger (“5” → “8”), and further Settings are made to generate ammonia for care (“0” → “7”).

  Returning to FIG. 13, when the control suitability value of each hospitality operation unit is set as a default according to the control suitability value setting table 471a, the hospitality operation is once started according to the setting. A processing flow in this case is shown in FIG. In SS601, the contents of the control suitability value setting table 471a are read, and in SS602, control suitability values are set in each hospitality operation unit according to the contents. In SS603, the hospitality operation is started according to the set value.

Subsequently, in SS604, a question output process to the user is performed. As described above, the ID and control direction corresponding to the hospitality operation unit currently in operation are specified, and the corresponding one is searched and output by the question data in FIG. 73A. In SS605, an answer from the user to the question is acquired and the content is analyzed. FIG. 69 shows an example of a question and an input example of an answer. The questions related to the air conditioning, fragrance, and car stereo sound levels are illustrated, and questions relating to the preference of air conditioning (here, summer is assumed), preference for fragrance, and volume setting are made. The answer from the user is (1) “Air conditioning is bad and hot”,
(2) “I do not like it because it has a strong scent”
(3) “I want you to increase the volume more”
It is a content that means. In addition, there are also questions for obtaining a general impression on the degree of relaxation, and the answer is (4) “I am not relaxed because I am nervous”.

  In SS606, the control value to be changed is specified from the content of the answer. In FIG. 69, the set temperature for air conditioning, the level of fragrance release, and the volume of the car stereo are the change target control values. Further, the illumination color, illumination level (light quantity), and seat vibration amplitude that contribute to the improvement of the overall relaxation degree are also selected as the change target control values. In SS607, each control setting value is changed in a direction that satisfies the user orientation specified from the answer. In FIG. 69, the air conditioning temperature setting is lowered for (1) (“4” → “3”), and (2) is reduced by reducing the amount of fragrance released (“5” → “4”). ) And (3) correspond to each other by raising the tone level (“6” → “7”). Further, (4) is dealt with by adjusting the illumination light and the sheet vibration. Specifically, the illumination color is changed from a white color (“6”) to a calm warm color (light orange: “7”), and the illumination level is lowered (“7” → “6”). In addition, the amplitude of vibration by the seat vibrator is lowered (“3” → “2”) to emphasize a relaxed feeling.

  As described above, a part or all of the control aptitude values corrected in the question dialogue format can be registered as new default values, and can be used as an initial setting for hospitality operations when the next vehicle is used. .

  Next, FIG. 75 is a flowchart illustrating a state confirmation process and a hospitality operation adjustment process based on the confirmation contents. As described above, since the detection of the biological condition parameter and the monitoring of the physical condition or the mental condition based on the waveform analysis are continued even after the hospitality operation is started, SS651 leads the latest state estimation result. This process is performed by referring to the current state of the state identification result table 472. If the state estimation result is normal in SS652, the process is terminated (that is, the hospitality operation is continued under the currently set conditions).

  On the other hand, if it is not in a normal state, that is, if it is in any abnormal state, the process proceeds to SS653 and the hospitality control amount setting table 441 shown in FIG. 68 (stored in the ROM or the storage device 535 of the hospitality decision making unit 2). Referring to, the control amount of the hospitality operation unit is changed and adjusted. The content of the hospitality control amount setting table 441 is determined in a form corresponding to the control appropriate value adjustment image of the hospitality operation unit in FIG. Specifically, the following changes are made to the set values (see the control suitability value setting table 471a in FIG. 13).

When the estimated state is “slightly unwell (or uncomfortable)”.
・ "Reduce the necessity of the illumination light and improve the visibility when the user approaches the car." → Reduce the red illumination output (in FIG. 72, white With “(6”) as a reference, the emission color index is changed in the direction toward blue (for example, “−1”).
・ “Leave the specified required sound (warning sound / important sound) and equalize the audio output mainly in the low range” → Increase the setting value of required sound capture (for example, “+3”) . As shown in FIG. 71, the control suitability value can be changed not only for the sound level but also for the tone setting for the audio setting, and the bass setting value is increased relative to the high temperature setting value ( For example, low tone “+1”, high tone “−1”: high tone non-changeable).
・ "Change the direction to increase one or both of temperature and humidity to alleviate discomfort." → Increase the temperature setting of the air conditioner (for example, "+1") and turn on the humidifier (not shown in FIG. 13) Start operation.
• Maintain the current settings for other hospitality movements (eg vibration, fragrance).

When the estimated state is “severe physical condition” • “Set to white or warm color with darker lighting” → In FIG. 72, light is emitted in the direction toward red based on white (“6”) Change the color index (eg, “+1”). Further, the illumination light level is reduced (for example, “−1”).
・ "Slowly play a song with a low volume"-> Change to a relaxed song and decrease the volume setting level (for example, "-1": If the condition is not improved, the volume will eventually become zero, or the audio operation It may be set to stop).
・ Air conditioning will be maintained as it is so as not to stimulate the condition. Further, unnecessary hospitality operation stops (for example, vibration operation of the seat vibrator).
・ Aim to improve physical condition by aromatherapy effect, increase the output of fragrance (for example, “+1”).

  In the case of severe physical condition, it is also effective to perform a hospitality operation that avoids a driving operation by the user depending on the scene. For example, do not release the door lock in the approaching scene, prohibit getting in the car itself, output a message to stop driving with voice etc. after riding, and operate the speed limiter to exceed a certain speed An operation such as preventing the occurrence of the error can be exemplified.

When the estimated state is “distraction”. It is aggregated with the action to urge the user (driver) to wake up.
• “Warning by flash light or stimulating wavelength” → Change the emission color index in the direction toward blue based on white (“6”) (for example, “−1”). Alternatively, the index is greatly changed in the primary color main direction (red, blue, green). The illumination level is also increased (eg “+1”). As shown in FIG. 71, a set value is also provided for the illumination pattern, and for example, it is possible to switch from continuous lighting to intermittent lighting for generating flash light.
・ "Output warning sound" → Output warning sound immediately. Further, the set sound volume is increased (for example, “+1”).
-Maintain the current air conditioning, or lower the set temperature for awakening (reducing sleepiness).
・ Impulse vibration is generated in the seat vibrator or handle vibrator. Specifically, the set frequency is increased (for example, “+3”), and the amplitude is also increased (for example, “+3”).
-Release the fragrance (setting value "0") and release ammonia for care.

When the estimated state is “excited (angry, unstable)”. It is centralized in cooling and relieving the mental state of the user (driver).
• “Adopting blue lighting” → white (“6”) as a reference, change the emission color index in the direction toward blue (for example, “−1”).
・ "Change to a song that is effective in alleviating excitement, such as healing, etc." → The music selection method has already been explained.
-Air conditioning lowers the set temperature to cool the mental state (for example, "-1").
“Slow and relax the operation of the seat vibrator or handle vibrator” → decrease both frequency and amplitude (for example, “−1”).
-Increase the fragrance output (for example, “+1”) with the aim of maintaining the current state of direction or stabilizing the mind by aromatherapy effects.

  Returning to FIG. 75, the change / adjustment of the control amount of the hospitality operation unit is performed only on the parameter (control set value) for which a specific instruction relating to the change exists on the hospitality control amount setting table 441. If there are multiple parameters, all the parameters may be changed at once and reflected in the hospitality operation. In this embodiment, the contribution (effect) due to the change of each parameter can be confirmed separately. Therefore, the setting change related to a plurality of parameters is sequentially performed. The order of changing the setting values of these parameters (that is, the priority order for adjusting the hospitality operation) follows the priority order set in the function selection tables 371 and 372 (FIGS. 7 to 13).

  In SS654A, a cumulative satisfaction degree ΣJ described later is initialized. In SS654B, the parameter number N to be changed is initialized. In SS655, the parameter of the number N is changed based on the instruction value of the hospitality control amount setting table 441, and in SS656, the hospitality operation is continued for a certain period of time in the change setting state (hereinafter referred to as trial hospitality operation). Next, in SS657, the process proceeds to a process of determining a user's satisfaction level (referred to as “control satisfaction level”) for the hospitality operation. That is, the hospitality control amount is changed while referring to the satisfaction level of the user for the hospitality operation as feedback information.

  FIG. 76 shows an example of the control sufficiency determination process. In SS701, in order to check whether there is any change in the estimated state due to the trial hospitality operation of SS656, the state identification result table 472 (FIG. 77) is accessed again to check the contents of the monitoring information. Next, in SS 702, the contents of the monitoring information are compared with the previous contents (the contents of the previous state specifying result table 472 may be backed up in the RAM of the hospitality decision making unit 2 or the storage device 535).

  In SS703, an increment value of a parameter indicating “normal” is calculated. Specifically, the increment value ν is calculated as the sum of the parameter increment values Δν whose contribution to state determination is “0” in FIG. 77 (Equation (7) in FIG. 77). However, as a simpler value, the total number of parameters whose contribution to the state determination is “0” may be calculated. When the increment value ν is large, it means that the previously estimated “abnormal state” is resolved as a result of the trial hospitality operation, and is closer to the normal state than the previous time. In addition, when the increment value ν is small, it means that the state is getting worse (when the degree of deterioration is large, the increment value can be a negative number).

  Next, in SS704, the increment value of the parameter that contributes affirmatively to the current state estimation result (“abnormal state”) is calculated. Specifically, the increment value μ is calculated as the sum of the parameter increment values Δμ whose contribution to the state determination is “2” in FIG. 77 (formula (8) in FIG. 77). However, as a simpler value, the total number of parameters whose contribution to the state determination is “2” may be calculated. When the increment value μ is large, it means that the “abnormal state” estimated last time is getting worse as a result of the trial hospitality operation. Further, when the increment value μ is small, it means that the “abnormal state” is in the direction of elimination (if the degree of elimination is large, the increment value may be a negative number).

  That is, from the viewpoint of eliminating the “abnormal state”, the increment value μ contributes in the opposite direction to the increment value ν. Therefore, the degree of satisfaction J accompanying the current parameter setting change is calculated based on both the increment value μ and the increment value ν. Here, it is calculated as J = ν−μ (if μ and ν are always kept positive, the ratio of μ and ν (for example, μ / ν) can be used instead. ). The larger J is, the more remarkable the improvement of the user state associated with the current parameter setting change. On the other hand, in SS706, it is confirmed whether or not this value is negative. If J is negative, the user condition is worsened by the change in the parameter setting this time. Therefore, the process proceeds to SS707, and the parameter is excluded from the setting change target (hereinafter, the parameter is returned to the previous value, for example, and the current state is maintained, but the hospitality operation itself involving the parameter is stopped. There can be a method).

  On the other hand, if the satisfaction degree J is positive in SS706, this means that the parameter setting change this time was effective in improving the user state. The basic process is to proceed to SS711 and add the satisfaction level J to the cumulative satisfaction level ΣJ, but in this embodiment, before that, for the operation input unit of the hospitality operation unit corresponding to the parameter, Whether or not there is a retry operation by the user is also taken into consideration. Specifically, in SS708, a retry operation state to the operation input unit of the hospitality operation unit corresponding to the parameter is scanned. If the retry operation is not confirmed in SS709, the process proceeds to SS711.

  On the other hand, if a retry operation is confirmed, the process proceeds to SS710, and if the retry operation is an affirmative operation for the current parameter setting change, the priority of setting change of the parameter after the next time is set to the highest priority. Set. On the other hand, if the operation is negative, the parameter is excluded from the setting change target. For example, when a setting change for lowering the set temperature of the air conditioning is performed, but the user performs a retry operation for further lowering the temperature setting, the change of the set temperature of the air conditioning has the highest priority in the next and subsequent basic cycles. On the other hand, when the user performs an operation to increase the temperature setting in reverse, the set temperature of the air conditioning is not changed in the basic cycle after the next time. This completes the control sufficiency determination process.

  Returning to FIG. 75, in SS658, it is checked whether or not the cumulative sufficiency ΣJ has reached the threshold value. As for the cumulative sufficiency ΣJ, for example, all parameters are in “normal state”, and the full score value can be calculated from the sum of the assumed upper limit values of ν. The threshold value of the cumulative satisfaction degree ΣJ may be determined depending on whether or not a certain ratio is reached with reference to this perfect score.

  On the other hand, if the cumulative sufficiency ΣJ has not reached the threshold value, the process proceeds to SS659, and it is checked whether there is a parameter to be set next. If it exists, the parameter number N is incremented by 1, the process returns to SS655, and the process up to SS658 is repeated in the same manner for that parameter. If there is no target parameter, it means that all target parameter settings have been changed, so return to SS654B, re-initialize N, enter the next basic cycle, and repeat the same processing as above . In this case, in SS660, the parameter adjustment priority is changed so as to increase as the value of J increases. However, in SS 710 in FIG. 76, the parameter set at the highest level by the retry operation is given priority regardless of the value of J. In SS661, the parameter numbers are sorted according to the priority order. Thereby, in the next basic cycle, the parameters are adjusted according to the new priority. The hospitality operation adjustment process shown in FIG. 75 is repeatedly executed so that, for example, it automatically rises at a predetermined time interval and the appropriate hospitality operation is always continued stably.

Next, one of the important factors affecting the state estimation process is a threshold value to be set for each parameter (X0 in Formula 1: Specifically, FIG. 52, FIG. 54, FIG. 55, Figure 56, Figure 57, Figure 60, Figure 61, fu0, fL0, A0 of FIG. 62 and FIG. 65, α0, I0, N0, An0, Σ 2 0, d0 and ηn0). It may be difficult to set the threshold values of a large number of parameters to the optimum values all at once, and it is easily affected by individual differences among users to be monitored. Accordingly, it is more desirable to incorporate a process for correcting the above-mentioned threshold as necessary in the adjustment process of the hospitality operation.

  FIG. 78 is a flowchart showing an example in which a step for correcting the threshold value is incorporated in the process of FIG. Hereinafter, the difference from the processing in FIG. 75 will be mainly described. In this process, even if the basic cycle of the hospitality operation adjustment process is repeated a predetermined number of times, the process shifts to the threshold correction process when no improvement of a certain level or more is observed in the user state estimation result. First, processing for initializing the cycle counter C for threshold adjustment is added to SS654A. In the steps up to SS661, the related parameter adjustment steps are completed, and the hospitality operation adjustment process for one cycle is completed.

  In FIG. 75, the cycle of the hospitality operation adjustment process is repeated until the cumulative satisfaction degree ΣJ becomes greater than a predetermined level. In the process of FIG. 78, if the satisfaction degree ΣJ does not improve to a certain level or more after repeating this cycle a certain number of times, the process proceeds to the threshold value changing process of SS665. That is, each time the above cycle is repeated once, the threshold adjustment cycle counter C is incremented (SS662). If the value of C is less than or equal to the specified value C0 in SS663, the process returns to SS654B and proceeds to the next basic cycle. Further, when the value of C becomes larger than the prescribed value C0, the process proceeds to SS664, where the cumulative satisfaction degree ΣJ is set to a certain level (SS 658 is set to be smaller than the target value of the final cumulative satisfaction degree ΣJ related to the end determination of the adjustment process). If it is improved as described above, the process returns to SS654B and the next basic cycle is processed.

  On the other hand, when the improvement degree of the cumulative satisfaction degree ΣJ is insufficient in SS664, the threshold value changing process in SS665 is performed. FIG. 79 shows an example of the threshold value changing process. It is highly possible that the threshold change is necessary because the mental / physical state estimated to have been established was originally an error. Therefore, in order to get out of this state, for the parameter group that contributes positively to the currently estimated “abnormal state”, the contribution rate tends to decrease preferentially from the parameter with the higher contribution rate. It is desirable to change the threshold. Similarly, for the parameter group indicating the “normal state”, it is desirable to change the threshold in a direction in which the contribution rate increases in preference to the parameter having a low contribution rate. As the contribution rate, the deviation Δμ or Δν from the threshold value of each parameter that has already been described can be used.

  In FIG. 79, in SS1701, among the parameter group that positively contributes to the “abnormal state”, a process of correcting a certain amount of the upper n threshold values having a large Δμ in a direction in which Δμ decreases is performed. . Further, in SS1702, the lower n threshold values having a small Δν in the parameter group indicating “normal state” are corrected by a certain amount in the direction in which Δν increases. n may be 1 or 2 or more (in this case, it does not exclude all corresponding parameter groups).

  Only one of SS1701 and SS1702 can be implemented. In particular, it can be said that it is more desirable to implement SS1701 as essential in order to eliminate a state where the “abnormal state” currently estimated is an error. In this case, SS1702 can be omitted. In any case, when the process returns to the hospitality operation adjustment process of FIG. 78 after performing SS1701, the threshold value of the parameter that forms the basis of the abnormal state determination is changed, and the priority is forcibly lowered. If the threshold correction direction is correct, among the remaining parameters, the parameter reflecting the true physical condition / mental state is given an opportunity to increase its priority.

  On the other hand, SS1702 relates to the correction of the threshold value of the parameter group indicating the “normal state”. The currently estimated condition is “abnormal condition”, and when this estimate reflects the correct mental / physical condition, the parameter group indicating “normal condition” is used to estimate the mental / physical condition. This parameter is inherently ineligible. However, here, since the estimated “abnormal condition” does not reflect the correct mental / physical condition, at least some of the parameters indicating the “normal condition” are true mental / physical conditions. It may be a parameter suitable for state estimation. However, a parameter with a small Δν has a small contribution rate to the cumulative satisfaction degree J, and may be buried in the current hospitality operation adjustment process. Therefore, among the parameter group indicating the “normal state”, the lower n threshold values having a small Δν are corrected by a certain amount in the direction in which the Δν increases, whereby some of the lower parameters indicating the “normal state” are obtained. The priority can be raised.

  Note that there is also a method of changing the weighting coefficient shown in FIG. 77 instead of changing the threshold value as described above (or with changing the threshold value). In this case, in SS1701 of FIG. 79, among the parameter group that contributes positively to the “abnormal state”, a process of correcting a certain amount of the top n weighting factors having a large Δμ in a decreasing direction may be performed. Further, in SS1702, a process of correcting a certain amount of the lower n weighting factors having a small Δν in the increasing direction out of the parameter group indicating “normal state” may be performed.

  The default data of each threshold can be prepared and installed for each user, for example, at the car dealer side, but it is customized to a value unique to each user through the above threshold value changing process. It will be. Therefore, if the customized threshold value group is stored as the user-specific mental / physical condition determination threshold value 435 in association with the user specifying information as shown in FIG. 73A, the user of the car is specified from the next time. At this stage, a threshold value group corresponding to the user may be read and set as a default value. In addition to the above-mentioned default setting data 434 for each user, even if the user of the car changes, the hospitality operation is adjusted by using the control default value and threshold value unique to the user. For example, the car is shared by a plurality of users. Even in this case, the hospitality operation is optimized for each user, and any user can use the car comfortably.

  In addition, a plurality of biological state detection units (FIG. 1: sensor / camera groups 518 to 528) used for hospitality decision-making are provided in association with a plurality of seats of an automobile, and the mental state of a user sitting on each seat and The physical condition can also be detected independently. In this case, the hospitality determination unit 2 can determine the operation content of the hospitality operation unit based on the mental state and physical condition of a plurality of users corresponding to the set of biological state detection units. In this case, for example, it is possible to determine the operation content of the hospitality operation unit with priority given to the user having the worst estimated mental state and physical condition (for example, severe physical condition).

  73A, data unique to each user (user ID / password 600, biometric authentication master data 432, user-specific default setting data 434, user-specific mentality). / Physical condition determination threshold value 435, stress reflection operation statistical data 405, etc.), as shown in FIG. 1, in addition to the storage device on the vehicle side such as the storage device 535, the data of the management center 560 that can communicate with the vehicle You may memorize | store in the server 561 and you may make it use and acquire communication at any time according to the request | requirement from the motor vehicle side. In this way, in addition to reducing security problems such as misuse of the car by impersonation, the user switches to another car equipped with the hardware infrastructure structure of the car user hospitality system of the present invention. In this case, by acquiring unique data for each user from the management center 560, even in the car that is the transfer destination, the same hospitality as the previous car can be received, and a more flexible system construction Is possible.

  Although the embodiment of the automobile user hospitality system of the present invention has been described above, the present invention is not limited to the embodiment, and various modifications can be made without departing from the gist of the present invention. It is.

The block diagram which shows an example of an electrical structure of the user service system for motor vehicles of this invention. The schematic diagram which shows an example of the hospitality decision-making table. The flowchart which shows the flow of a scene determination process. The flowchart which shows the flow of hospitality main processing. The schematic diagram which shows the content of a scene flag. The figure which shows the concept of a theme-specific application library. The figure which shows the 1st example of a function selection table. The figure which shows the 2nd example of a function selection table. The figure which shows the 3rd example of a function selection table. The figure which shows the 4th example of a function selection table. The figure which shows the 5th example of a function selection table. The figure which shows the 6th example of a function selection table. The figure which unifies the representative function of several function selection tables, and shows with a control aptitude value setting table. The external appearance perspective view which shows an example of the user side terminal device comprised as a mobile telephone. The block diagram which shows an example of the electrical constitution of a user side terminal device. The block diagram which shows an example of the electrical structure of vehicle interior lighting. The block diagram which shows an example of the electrical constitution of a car audio system. The conceptual diagram which shows the content of a music source database. The conceptual diagram which shows the structural example of the lighting control data of an illuminating device. The conceptual diagram which shows the content of the music selection performance memory | storage part. The conceptual diagram which shows the content of the statistical information of a music selection track record. The conceptual diagram which shows the content of the stress reflection operation statistics memory | storage part. The schematic diagram which shows the 1st example of hospitality operation | movement when a user approaches a motor vehicle. The schematic diagram which similarly shows a 2nd example. The schematic diagram which similarly shows a 3rd example. The schematic diagram which similarly shows a 4th example. The schematic diagram which similarly shows a 5th example. The flowchart which shows the flow of a process of the hospitality operation | movement when a user approaches a motor vehicle. The flowchart which shows the flow of a personality analysis process. The flowchart which shows an example of hospitality source determination processing. The flowchart which shows the flow of a process in the long distance hospitality mode by music. The flowchart which similarly shows the flow of a process in medium distance hospitality mode. The flowchart which similarly shows the flow of a process in short distance hospitality mode. The schematic diagram which shows the example of mental state / physical condition estimation using the detection information from a biological condition detection part, and the determination of a music mode code. The flowchart which shows an example of the hospitality process during driving | running | working. The conceptual diagram which shows the content of user registration information. The schematic diagram which shows the 1st example of the input method of character classification determination. The schematic diagram which shows the 2nd example of the input method of character classification determination. The circuit diagram which shows an example of the illuminating device using a light emitting diode. Explanatory drawing of the mechanical component part of a door assist mechanism. The circuit diagram of a door assist mechanism. The schematic diagram which shows the structural example of the door rotation lock mechanism for obstacles. FIG. 42 is an operation explanatory diagram of the door assist mechanism of FIG. 41 in a normal state. The conceptual block diagram which shows the structural example of a noise canceller. The block diagram which similarly shows an example of a hardware configuration. The flowchart which shows the whole flow of the hospitality process in the user service system for motor vehicles. The flowchart following FIG. The flowchart following FIG. The schematic diagram which illustrates the attachment position of the camera in a vehicle. The schematic diagram which shows the example of attachment of the various sensors and hospitality operation | movement part to a handle | steering-wheel. The schematic diagram which shows an example of the determination table. The flowchart which shows an example of blood-pressure change waveform acquisition and its analysis algorithm. The schematic diagram which illustrates and illustrates some waveform analysis methods. The flowchart which shows an example of body temperature waveform acquisition and its analysis algorithm. The flowchart which shows an example of skin resistance waveform acquisition and its analysis algorithm. The flowchart which shows an example of a facial expression change analysis algorithm. The flowchart which shows an example of attitude | position signal waveform acquisition and its analysis algorithm. FIG. 3 is a circuit diagram showing an example of hardware for generating a posture signal waveform. The image figure of various specified states. The flowchart which shows an example of a gaze angle waveform acquisition and its analysis algorithm. The flowchart which shows an example of a pupil diameter waveform acquisition and its analysis algorithm. The flowchart which shows an example of steering angle waveform acquisition and its analysis algorithm. The image figure of a driving monitor image. The flowchart which shows an example of a driving | running | working monitor data acquisition process. The flowchart which shows an example of the steering precision analysis process using driving | running | working monitor data. The flowchart which shows an example of a state specific process. The figure which shows the relationship between a specific state and hospitality operation | movement type. The figure which shows the example of a hospitality control amount setting table. The figure which shows the example of a change of the default control setting value by a question dialog format. The figure which shows the example of the control aptitude value setting table used at the time of emergency or abnormality. The figure which shows the detailed setting example of the control suitability value with respect to audio | voice or illumination. The figure which shows the relationship between the mixing ratio of each illumination light, luminescent color, and an index of RGD full-color illumination. The figure which shows the structural example of the data for hospitality decision-making. The figure which shows the structural example of the data for a question. The flowchart which shows the flow of a change process of the default control setting value by a question dialog format. The flowchart which illustrates hospitality operation adjustment processing. The flowchart which shows the flow of a control satisfaction degree determination process. The figure which shows an example of the content of a state specific result table. The flowchart which illustrates the flow of the hospitality operation adjustment process including a threshold value change process. The flowchart which illustrates the flow of a threshold value change process.

Explanation of symbols

1 Mobile phone (user terminal device)
2 Hospitality decision-making unit (hospitality control unit, mental / physical condition estimation means)
3 Hospitality execution control unit (hospitality control unit)
4 Communication device (host side communication means)
100 Automotive User Hospitality System 311 Speaker (Audio Output Unit)
502-517,534 Hospitality operation unit 515 Car audio system 515b, 515c Music source database (hospitality operation information storage unit)
515d operation unit (music selection unit: biological state detection unit)
535 storage device (hospitality operation information storage unit, song selection result storage unit)
504 to 512 Lighting device 511 Indoor lighting (lighting device)
521 Face camera (biological condition detector)
523 Pressure-sensitive sensor (biological state detection unit)
519 Infrared sensor (biological condition detector)
525 Body temperature sensor (biological condition detector)
524 Pulse sensor (biological condition detector)
1170 Wireless communication network

Claims (12)

A plurality of hospitality operation unit performing to assist the use of the vehicles that by the user, or a hospitality operation to entertain users,
The predetermined disturbance detection means, and disturbance information obtaining means for obtaining the disturbance information applied to the user, according to the acquired the disturbance information is also Ru good in hospitality operation portion and the hospitality operation unit to be used Tenashi A hospitality decision-making unit having hospitality content determination means for determining the operation content;
To perform the hospitality operation according to the decisions made by the hospitality determination section comprises a hospitality control unit for controlling the operation of the corresponding hospitality operation portion,
The hospitality content determination means predetermines a correspondence relationship between the plurality of hospitality operation units that are used preferentially according to the content of the disturbance information received by the user and the content of the disturbance information. An automobile user hospitality system comprising hospitality function selection means for selecting a hospitality operation unit corresponding to the disturbance content indicated by the acquired disturbance information based on the correspondence relationship . A series of actions related to the use of the user's car until the user approaches the car, gets into the car, drives the car or stays in the car, and then gets off the vehicle. Divided into scenes, the plurality of hospitality operation units perform hospitality operations for assisting the use of the car by the user or delighting the user for each of the plurality of divided scenes. ,
Scene estimation information acquisition means for acquiring, as scene estimation information, a user position or action predetermined for each scene, scene specification means for specifying individual scenes based on the acquired scene estimation information, and Disturbance applied to the user by user biometric information acquisition means for acquiring user biocharacteristic information including at least one of the user's personality, mental state, and physical condition, and disturbance detection means predetermined in each of the identified scenes Disturbance information acquisition means for acquiring information,
The hospitality determination unit, according to claim 1, wherein according to the scene and the user biometric characteristic information and the disturbance information is also Ru good in hospitality operation portion and the hospitality operation unit to be used determining the Tenashi operation content Hospitality system for automobile users. Before SL hospitality function selector is configured to identify a plurality of the hospitality operation device usable in each of said scene, of the hospitality operation portion of the number of available plurality, depending on the contents of the said disturbance information that the user receives A function selection table storing means for storing a function selection table indicating a correspondence relationship between what is used preferentially and the content of the disturbance information; and a hospitality operation unit corresponding to the disturbance content indicated by the acquired disturbance information. The automobile user hospitality system according to claim 2 , which is found on the function selection table and determined as a hospitality operation unit that operates in the scene. The function selection table includes a plurality of hospitality operation units that are used preferentially in the disturbance information of a predetermined type, and includes information related to the use priority order of the hospitality operation units. Item 4. A user hospitality system for automobiles according to item 3 . The acquired user biometric information includes user personality specifying information for specifying the personality of the user, and the user personality specifying information is associated with the personality type of the user individually specified by the user personality specifying information. Then, a hospitality operation information storage unit that stores hospitality operation information that defines the operation content of each of the hospitality operation units is provided ,
The hospitality decision-making unit reads hospitality operation information corresponding to the personality type specified by the acquired user personality identification information from the hospitality operation information storage unit, and controls the operation of the hospitality operation unit based on the hospitality operation information. The automobile user hospitality system according to any one of claims 1 to 4 , wherein the system is commanded to a department. The user biometric characteristic information acquiring unit is configured to detect a predetermined biological state for estimating a mental state and a physical condition of the user, and based on the detected biological state, the user Mental / physical condition estimating means for estimating the mental condition or physical condition of
The automobile user hospitality system according to any one of claims 1 to 5 , wherein the hospitality determination unit determines a control suitability value of the hospitality operation according to the content of the estimated mental / physical state. The hospitality decision-making unit monitors the temporal transition of the mental / physical state of the user estimated by the mental / physical state estimation means, and the control aptitude value according to the temporal transition of the mental / physical state The hospitality user system for automobiles according to claim 6 which corrects the above. The hospitality decision-making unit having the requirements according to claim 5 , wherein the hospitality decision processing unit determines the hospitality operation content determination process corresponding to the personality type, and the control suitability of the hospitality operation according to the content of the mental / physical condition. The automobile user hospitality system according to claim 6 or 7 , which is performed prior to the value determination process. The determination processing by the hospitality function selector hospitality operation portions corresponding to the disturbance content indicated by the previous Kigairan information, performed after the determination process of the control appropriate value of the hospitality operation in accordance with the contents of the mental / physical condition The automobile user hospitality system according to any one of claims 4 to 6 . Hospitality theme for generally in accordance with the directivity of hospitality wants the previous SL user defined more, the theme in advance a plurality of the hospitality operation for each is being provided, furthermore,
The hospitality decision-making unit is configured to select one or more of the plurality of hospitality themes based on the user biometric information, and a plurality of the hospitality operations managed by each of the selected hospitality themes The automobile user hospitality system according to any one of claims 1 to 9 , further comprising: a hospitality operation selecting unit that collectively selects The hospitality theme is defined for each of the plurality of scenes,
The theme determining means automotive user hospitality system of claim 1 0, wherein and selects the hospitality theme corresponding to the specified the scene. Based on the response information from the user who enjoyed the hospitality operation, any of claims 1 to 1 1 having a hospitality adjustment commander means for commanding the respect to the hospitality control unit adjusts the control status of the hospitality operation A car user hospitality system according to claim 1.

Images