JP2010208540A - Control device, method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To control so as to suit to the state of a user. <P>SOLUTION: An image pick-up control part 141 controls an image pick-up part 125 to pick up the image of a user who operates a vehicle on which a vehicle control system 100 is mounted so as to acquire the image of the user. An accessory detection part 142 analyzes the image of the user who has been acquired by the control of the image pick-up control part 141, and detects an accessory attached to the user. A setting part 143 performs a control setting according to the accessory detected by the accessory detection part 142. A treatment execution part 144 executes a predetermined control treatment for controlling an on-vehicle device 102 based on a control set value 181 set by the setting part 143. This invention is applicable to, for example, a vehicle control device. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a control device, method, and program, and more particularly, to a control device, method, and program that can perform control more suitable for a user's condition.

  2. Description of the Related Art Conventionally, for example, there are devices that control settings such as a vehicle such as an automobile or various facilities mounted on the vehicle (see, for example, Patent Documents 1 to 3).

  For example, Patent Document 1 proposes an apparatus that performs voice recognition by measuring the level of a voice band signal, detecting a noise level and a voice section. Further, for example, Patent Document 2 proposes an apparatus that stores information correlated with a person's sense of warmth and adjusts the temperature and air volume of an air conditioner according to the sense of warmth. Further, for example, Patent Document 3 proposes a device that detects the position of the sun and the eyes of the driver with a camera and automatically lowers the sun visor based on the position.

JP 2003-114700 A JP 2007-308096 A JP 2008-44603 A

  However, for example, when the driver is wearing a mask, the driver's voice volume is generally lower or voice quality is changed than when the driver is not wearing a mask. In this case, the control according to the driver's accessory is not performed, and the control is not changed just because the driver is masked, so there is a possibility that the voice cannot be recognized accurately. It was.

  In addition, for example, when the driver is wearing a mask, it is generally considered that the driver is in a physical condition such as catching a cold, but in the case of the method described in Patent Document 2, The control according to the accessory is not performed, and the driver does not change the control just because the driver is masking, so the driver's physical condition is further deteriorated by, for example, overcooling. There was a fear.

  Furthermore, for example, when the driver is wearing sunglasses (sunglasses), the driver's field of view is generally darker than when he is not wearing sunglasses, but in the case of the method described in Patent Document 3, driving is performed. Control according to the person's accessory is not performed, and because the driver does not change the control because it is wearing sunglasses, it becomes darker than necessary and hinders safe driving There was a fear.

  The present invention has been proposed in view of such a situation, and it is possible to perform control suitable for the user's condition by detecting the user's accessory and performing control according to the accessory. It is something that can be done.

  One aspect of the present invention is an image pickup means for picking up an image of a user of a predetermined apparatus, a detection means for detecting an accessory in the user image obtained by the image pickup by the image pickup means, and a detection by the detection means. In accordance with the accessory, the control device includes a setting unit that performs setting for controlling the device, and a control unit that controls the device using a setting value set by the setting unit.

  In the first aspect of the present invention, a user of a predetermined device is imaged, an accessory existing in the user's image obtained by the imaging is detected, and the device is used for controlling the device according to the detected accessory. Is set, and the apparatus is controlled using the set value.

  Therefore, it is possible to perform control more suitable for the user's condition.

  For example, the imaging unit includes an imaging unit, the detection unit includes, for example, an accessory detection unit, the setting unit includes a setting unit, and the control unit includes a processing execution unit.

  The setting means can optimize the setting in accordance with a darker state than actual when the detection means detects sunglasses present in the user's image.

  The setting means can perform the setting so that the display on the navigation screen is brightened.

  The setting means can perform the setting so as to brighten the illumination of the instrument panel.

  The setting means can perform the setting of the threshold value of the operating condition so that the automatic anti-glare function is difficult to operate.

  The setting means can perform the setting of the threshold value of the operating condition so that the auto light function can be easily operated.

  The setting means can change the setting so that various types of illumination are brightened.

  The setting means can perform the setting of the threshold value of the operating condition so that the auto sun visor function is difficult to operate.

  The control means can change the setting so as to increase the transmittance of the sun visor.

  The setting means can perform control settings for the apparatus so as to further reduce the influence on the operation when an eye patch present in the user's image is detected by the detection means.

  The setting means can perform the setting so as to propose more breaks to the user.

  The setting means can perform the setting so that the interval between the device and another device is wide.

  The setting means can perform the setting so as to output information indicating an interval between the device and another device.

  The setting means can perform an audio warning in addition to the warning light.

  The setting unit can perform setting for controlling the apparatus so as to further reduce the influence on the operation when the detection unit detects a mask present in the image of the user.

  The setting means can change the warning by a scent to a warning by another method or perform the setting to make the scent stronger.

  The setting means can change the instruction input method to a method other than voice input, or perform the setting so as to improve the sensitivity of a voice input sensor.

  User state determination means for determining the state of the user can be further provided.

  When the user state determining unit determines that the user has hay fever, the setting unit can set the ventilation setting to the inside air circulation.

  When the user state determination unit determines that the user has hay fever, the setting unit can perform setting so as to increase the degree of cleanliness of the air cleaner.

  When the user state determining means determines that the user has a cold, the setting means can perform setting to increase the target temperature setting of the air conditioner.

  One aspect of the present invention is also a control method of a control device, wherein the imaging unit of the control device images a user of a predetermined device, and the detection unit of the control device is configured to capture the user's An accessory existing in the image is detected, and the setting unit of the control device performs setting for controlling the device according to the detected accessory, and the control unit of the control device is set This is a control method for controlling the apparatus using a set value.

  Therefore, it is possible to perform control more suitable for the user's condition.

  According to another aspect of the present invention, the computer further includes an imaging unit that images a user of a predetermined device, a detection unit that detects an accessory in the user's image obtained by imaging by the imaging unit, According to the accessory detected by the detecting means, a setting means for performing setting for control of the device, and a function for controlling the device using the setting value set by the setting means. It is a program.

  Therefore, it is possible to perform control more suitable for the user's condition.

  According to the present invention, it can be controlled. In particular, it is possible to perform control more suitable for the user's condition.

It is a block diagram which shows the structural example of the vehicle control system to which this invention is applied. It is a figure explaining the example of installation of an imaging part. It is a flowchart explaining the example of the flow of a vehicle control process. It is a flowchart explaining the other example of the flow of a vehicle control process. It is a flowchart explaining the further another example of the flow of a vehicle control process. It is a block diagram which shows the other structural example of the vehicle control system to which this invention is applied. It is a flowchart explaining the further another example of the flow of a vehicle control process. It is a figure explaining the structural example of the personal computer to which this invention is applied.

  FIG. 1 is a block diagram showing a configuration example of a vehicle control system to which the present invention is applied.

  A vehicle control system 100 shown in FIG. 1 is mounted on a vehicle such as an automobile, detects the state of a user who operates the vehicle, and controls the vehicle or equipment mounted on the vehicle according to the state of the user. It is a system that performs. More specifically, the vehicle control system 100 captures an image of a user who operates the vehicle, detects an accessory of the user, such as a mask or sunglasses (sunglasses), and the vehicle according to the detected accessory. Or, control equipment installed in the vehicle.

  As shown in FIG. 1, the vehicle control system 100 includes a vehicle control device 101 that performs control and an in-vehicle device 102 that is controlled.

  As shown in FIG. 1, the vehicle control apparatus 101 includes a control unit 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, an input unit 121, an output unit 122, a storage unit 123, a communication unit 124, An imaging unit 125 is included.

  The control unit 111 is configured by a microcomputer including, for example, a CPU (Central Processing Unit) (not shown). The control unit 111 executes various processes according to a program stored in the ROM 112 or a program loaded from the storage unit 123 to the RAM 113. The RAM 113 also appropriately stores data necessary for the control unit 111 to execute various processes.

  The control unit 111 realizes a predetermined function by executing a program or the like, controls the input unit 121 to the imaging unit 125, and controls the in-vehicle device 102. Each functional block shown in the control unit 111 in FIG. 1 indicates a function realized by the control unit 111 executing a program or the like. The control unit 111 includes, for example, a basic control unit 131 that performs basic control as a functional block. The basic control unit 131 includes an imaging control unit 141, an accessory detection unit 142, a setting unit 143, and a process execution unit 144.

  The imaging control unit 141 controls the imaging unit 125, images a user who operates a vehicle on which the vehicle control system 100 is mounted, and acquires an image of the user. The accessory detection unit 142 analyzes the image of the user acquired by the control of the imaging control unit 141, and includes an accessory (e.g., sunglasses, eye patch, or mask) that exists in the user image (shown in the image). Etc.). Note that an image analysis method and an accessory presence / absence determination method performed at this time are arbitrary.

  The accessory detection unit 142 includes a sunglasses detection unit 151, an eyepatch detection unit 152, and a mask detection unit 153. The sunglasses detection unit 151 detects sunglasses worn by the user. The eye patch detection unit 152 detects an eye patch worn by the user. The mask detection unit 153 detects a mask worn by the user. Of course, the accessory detection unit 142 may detect other accessories.

  The setting unit 143 performs control settings for the in-vehicle device 102 in accordance with the accessory (for example, sunglasses, eye patch, or mask) detected by the accessory detection unit 142, and is stored in the storage unit 123. The setting value 181 is updated, the control setting value 181 is newly created and stored in the storage unit 123, or the control setting value 181 stored in the storage unit 123 is deleted.

  The process execution unit 144 executes a predetermined control process for controlling the in-vehicle device 102 based on the control setting value 181 set by the setting unit 143.

  In addition to the basic control unit 131, the control unit 111 can also include functional blocks of a season information acquisition unit 161, a user information acquisition unit 162, and a user state determination unit 163.

  The season information acquisition unit 161 acquires season information indicating the current season from time information (not shown) stored in the storage unit 123 or the RAM 113, for example, and supplies it to the user state determination unit 163. For example, the user information acquisition unit 162 acquires user information 182 that is stored in the storage unit 123 and is information relating to a user registered in advance, and supplies the user information 182 to the user state determination unit 163.

  For example, when a mask is detected by the mask detection unit 153, the user state determination unit 163 includes season information indicating the current season acquired by the season information acquisition unit 161 and user information 182 acquired by the user information acquisition unit 162. The user state is determined based on the above. For example, the user state determination unit 163 determines whether the masked user has a cold or hay fever. The setting unit 143 sets a predetermined control process for controlling the in-vehicle device 102 based on the determination result by the user state determination unit 163 (generates, updates, or deletes the control setting value 181).

  In addition to the basic control unit 131, the control unit 111 can further include functional blocks of an inquiry acquisition unit 171 and an inquiry determination unit 172.

  The inquiry acquisition unit 171 acquires, for example, an inquiry count 183 that is stored in the storage unit 123 and indicates the limit number of queries per day for the user, and supplies it to the user state determination unit 163. The inquiry determination unit 172 determines whether or not the inquiry to the user has been performed a predetermined number of times specified in the inquiry number 183.

  The setting unit 143 sets a predetermined control process for controlling the in-vehicle device 102 based on the determination result by the inquiry determination unit 172 (generates, updates, or deletes the control setting value 181).

  The ROM 112 has a non-rewritable storage area, and stores software programs and data written at the time of factory shipment, for example. The RAM 113 has a rewritable storage area and temporarily holds a software program being executed and data being processed.

  The input unit 121 includes various input devices that accept user operations and information, such as buttons, switches, touch pads, and microphones. When the input unit 121 receives information such as a user operation or voice, the input unit 121 supplies the information to the control unit 111.

  The output unit 122 includes an output device such as a speaker, an LED (Light Emitting Diode), a monitor, or an output terminal. The output unit 122 outputs information for output (for example, data, sound, or image) supplied from the control unit 111 using an appropriate output device (including sound output and image display).

  The storage unit 123 has a rewritable nonvolatile storage area such as a flash memory or a hard disk. The storage unit 123 is, for example, a control setting value 181 that is a setting value for controlling the in-vehicle device 102, user information 182 that is information related to a user registered in advance, and a daily limit of questions that are asked to the user The inquiry number 183 indicating the number of times is stored, and the information is appropriately supplied to the control unit 111 as necessary.

  The communication unit 124 has a communication interface of a predetermined standard such as a modem, and performs wired or wireless communication processing via an arbitrary network including, for example, the Internet or a LAN (Local Area Network).

  The imaging unit 125 includes, for example, a predetermined imaging device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, images a subject, and supplies the obtained image data to the control unit 111. .

  The in-vehicle device 102 represents equipment mounted on the vehicle, that is, an apparatus controlled by the control unit 111. The in-vehicle device 102 includes a navigation device 191, an anti-glare device 192, a lighting device 193, a travel assist device 194, a warning device 195, a ventilation device 196, an air cleaner 197, and an air conditioner 198.

  The navigation device 191 provides various information to the driver through images, voices, etc., such as route guidance to the destination, current location notification, or peripheral information introduction. In the navigation device 191, the content of information to be provided, the information providing method and timing, the brightness of the screen, the sensitivity of voice input, and the like are controlled by the control unit 111.

  The anti-glare device 192 reduces the reflectance of the rearview mirror and the transmittance of the windshield based on the external environment, user instructions, and the like. For example, it is configured by a room mirror having an automatic anti-glare function that automatically adjusts the reflectance according to the situation, or a windshield having an automatic anti-glare function that automatically adjusts the transmittance according to the situation. This automatic anti-glare function, for example, grasps the positional relationship between the light source and the driver with an image sensor or the like, and when the light of a predetermined brightness or more is irradiated to the driver's eyes, the reflectance and transmittance are adjusted. This is a function of reducing the amount of light irradiated to the driver by reducing it and ensuring the driver's field of view. The anti-glare device 192 is controlled by the control unit 111, for example, to adjust the reflectance of the room mirror and the transmittance of the windshield (the automatic anti-glare function is activated) threshold (for example, brightness) and the reflection thereof. The adjustment amount of the rate and the transmittance is controlled.

  The lighting device 193 includes, for example, a headlight, a position lamp, a fog lamp, an adaptive front lighting system (AFS) lamp, a backup lamp, and a room lamp. ), And various types of illumination such as instrument panel illumination. In the illumination device 193, for example, brightness adjustment of various types of illumination is controlled by the control unit 111. Further, for example, with respect to illumination having an automatic light function that is turned on and off according to the ambient brightness detected by the illuminance sensor of the lighting device 193, the control unit 111 controls switching between turning on and off. The brightness setting or the like for which is performed is controlled.

  The travel assist device 194 is a device that assists in travel control of the vehicle, and is configured by, for example, ACC (Auto Cruise Control) that automatically travels the vehicle at a set speed. In the driving assist device 194, for example, the inter-vehicle distance setting of the function of ensuring the inter-vehicle distance from other vehicles by ACC is controlled by the control unit 111.

  The warning device 195 is a device that warns the driver or the like about an inappropriate operation or a dangerous state. The warning device 195 is controlled by the control unit 111 such as a warning method and a degree.

  The ventilation device 196 is a device that discharges air in the vehicle interior to the outside of the vehicle and takes in outside air or circulates air in the vehicle interior. In the ventilation device 196, for example, a ventilation method or the like is controlled by the control unit 111.

  The air cleaner 197 is a device that removes fine particles in the air, deodorizes, and the like. In the air cleaner 197, for example, the degree of air purification is controlled by the control unit 111.

  The air conditioner 198 is a device that adjusts the temperature of the passenger compartment by outputting warm air or cold air, or adjusts the humidity of the air in the passenger compartment. In the air conditioner 198, for example, target temperature setting is controlled by the control unit 111.

  FIG. 2 is a diagram illustrating an installation example of the imaging unit 125. As illustrated in FIG. 2, the imaging unit 125 images, for example, the vicinity of the face of a user (for example, a vehicle driver) who operates the steering wheel 201 on the steering wheel 201 of the vehicle on which the vehicle control device 101 is mounted. Installed in a possible posture.

  Of course, for example, the imaging unit 125 may be installed at a position other than this, such as the vicinity of the passenger seat or the vicinity of the rear seat. For example, the imaging unit 125 may be able to capture a user located in the passenger seat or the rear seat. Further, the imaging unit 125 may be configured by a plurality of cameras or the like, and the user may be captured at a plurality of positions.

  Next, a flow of vehicle control processing for controlling the in-vehicle device 102 executed by the vehicle control apparatus 101 will be described. First, an example of the flow of vehicle control processing when the accessory detection unit 142 detects sunglasses worn by the user and performs control based on the detection result will be described with reference to the flowchart of FIG. 3. .

  When the vehicle control process is started, in step S101, the imaging control unit 141 controls the imaging unit 125 to image the driver who is the user, and the driver's image (for example, an image near the driver's face). To get. In step S102, the sunglasses detection unit 151 of the accessory detection unit 142 analyzes the image of the driver and detects sunglasses existing in the image. In step S103, the sunglasses detection unit 151 determines whether the driver is wearing sunglasses (or whether the driver is wearing sunglasses) based on the detection result.

  If sunglasses are detected in the image and it is determined that the driver is wearing sunglasses, the process proceeds to step S104. In step S104, the setting unit 143 updates the brightness setting value of the monitor of the navigation device 191 included in the control setting value 181 so that the navigation screen of the navigation device 191 is brightened.

  In step S105, the setting unit 143 sets the illumination brightness of the instrument panel of the illumination device 193 included in the control setting value 181 so that the illumination of the instrument panel that is the illumination device 193 is brightened. Update the value.

  Further, in step S106, the setting unit 143 operates the automatic anti-glare function included in the control setting value 181 so that the automatic anti-glare function of the room mirror that is the anti-glare device 192 is difficult to operate (for example, brightness The threshold value of (Same) is updated.

  In step S107, the setting unit 143 updates the threshold value of the operation condition (for example, brightness) of the auto light function included in the control setting value 181 so that the auto light function of the lighting device 193 can be easily operated. To do.

  Furthermore, in step S <b> 108, the setting unit 143 updates the brightness setting values of the various illuminations of the illumination device 193 included in the control setting value 181 so that the various illuminations of the illumination device 193 are brightened.

  Further, in step S109, the setting unit 143 is included in the control set value 181 so that the auto sun visor function (automatic awning function) that is the automatic anti-glare function of the windshield that is the anti-glare device 192 is difficult to operate. The threshold value of the operating condition (for example, brightness) of the auto sun visor function is updated.

  Furthermore, in step S110, the setting unit 143 is included in the control setting value 181 so that the transmittance of the auto sun visor function (automatic awning function) that is the automatic anti-glare function of the windshield as the anti-glare device 192 is increased. Update the transmittance setting (adjustment amount) of the auto sun visor function.

  When the user (driver) is wearing sunglasses, the user's field of view is darker than when the user is not wearing sunglasses. Therefore, as described above, the setting unit 143 updates the control setting value 181 so as to reduce the influence of wearing sunglasses on the settings related to the brightness of the user's field of view among the various settings of the in-vehicle device 102. That is, the setting unit 143 optimizes the setting of the in-vehicle device 102 according to a darker state than actual.

  When the process of step S110 ends, the process proceeds to step S111. If it is determined in step S103 that the driver is not wearing sunglasses, the process proceeds to step S111.

  In step S <b> 111, the process execution unit 144 executes a control process for the device in the in-vehicle device 102 that has updated at least the set value, based on the updated control set value 181 (to reflect the updated set value). To do.

  When the process of step S111 ends, the vehicle control process ends. While the user is in the vehicle, the vehicle control process as described above is appropriately executed.

  By executing such vehicle control, the vehicle control apparatus 101 can perform control more suitable for the user's state according to the user's accessory.

  In addition, in the above, although the case of sunglasses was demonstrated as an example of a user's accessory, an accessory is arbitrary and may be other than this. For example, if the eyeglasses and the lens are incidental products that affect the brightness of the user's (driver's) field of view, such as a colored contact lens or a shade net or a color film, the vehicle control device 101 The vehicle-mounted device 102 can be controlled as in the case of the sunglasses described above.

  By the way, in the case of the sunglasses described above, the user's field of view is generally darker when worn than when not worn, but conversely, the user's field of view is brighter when worn than when not worn. In the case of a product, the setting unit 143 may perform control as described with reference to the flowchart of FIG. 3 so as to optimize the setting of the in-vehicle device 102 in accordance with a brighter state than actual.

  Next, an example of the flow of the vehicle control process when the accessory detection unit 142 detects the eye patch worn by the user and performs control based on the detection result will be described with reference to the flowchart of FIG. .

  When the vehicle control process is started, in step S131, the imaging control unit 141 controls the imaging unit 125 to image the driver who is the user, and the driver's image (for example, an image near the driver's face). To get. In step S132, the eye patch detection unit 152 of the accessory detection unit 142 analyzes the image of the driver and detects the eye patch present in the image. In step S133, the eyepatch detection unit 152 determines whether the driver is wearing the eyepatch (or whether the driver is carrying the eyepatch) based on the detection result.

  If the eye patch is detected in the image and it is determined that the driver is wearing the eye patch, the process proceeds to step S134. In step S134, the setting unit 143 updates the guidance setting value of the navigation device 191 included in the control setting value 181 so that the navigation device 191 makes a break proposal to the user (driver) earlier than usual. .

  When the eyepatch is worn, the user's field of view is blocked more than usual, and generally the degree of eye fatigue becomes intense. Therefore, the control unit 111 is configured so that the navigation device 191 can perform safe driving so that the driver can take more breaks than usual when the eyepatch is not worn, frequently relieve eye fatigue, and perform safe driving. Control the driver to encourage him to take breaks more often than usual. By doing so, it is expected that the driver will take more breaks than usual according to this guidance.

  In step S135, the setting unit 143 updates the inter-vehicle distance setting of the ACC, which is the travel assist device 194, included in the control setting value 181 so as to maintain the inter-vehicle distance wider than usual.

  Even when using the ACC, for example, when it is dangerous, the driver must perform operations such as deceleration and avoidance. However, when the eyepatch is worn, the user's field of view is blocked more than usual, and generally the operational ability is lower than the normal case where the eyepatch is not worn, such as a sense of distance being dull. There is a fear. Therefore, the control unit 111 performs control so as to ensure a wider inter-vehicle distance than a normal case where the eye patch is not worn so that the driver can perform safe driving. By doing so, it is expected that the driver can perform deceleration and avoidance operations with a margin.

  Furthermore, in step S136, the setting unit 143 updates the setting of the control setting value 181 so that the navigation device 191 presents the inter-vehicle distance to the driver, for example. In general, when the eye patch is worn, the operation ability may be lower than in a normal case where the eye patch is not worn. Therefore, the control unit 111 performs control so as to present the inter-vehicle distance so that the driver can perform safe driving. By doing so, it is expected that the driver is sufficiently aware of the inter-vehicle distance and sufficiently secures the inter-vehicle distance.

  In step S137, the setting unit 143 includes a warning method included in the control setting value 181 so that, in addition to the warning light and the guidance display, when the warning device 195 gives a warning, a warning by voice is also given. Update settings. Generally, when wearing an eye patch, the user's field of view is blocked more than usual, and the user is less likely to notice visual warnings. Therefore, the control unit 111 performs control such that a warning by voice is also given so that the user can easily understand the warning.

  As described above, the setting unit 143 updates the control setting value 181 so as to further reduce the influence on the safe driving (operation) of wearing the eyepatch among the settings related to the user's vision among the various settings of the in-vehicle device 102. To do. That is, the setting unit 143 optimizes the setting of the in-vehicle device 102 so that safe driving is more important.

  When the process of step S137 ends, the process proceeds to step S138. If it is determined in step S133 that the driver does not wear the eye patch, the process proceeds to step S138.

  In step S138, the process execution unit 144 executes control processing for at least the setting value of the in-vehicle device 102 based on the updated control setting value 181 (to reflect the updated setting value). To do.

  When the process of step S138 ends, the vehicle control process ends. While the driver is in the vehicle, the vehicle control process as described above is appropriately executed.

  By executing such vehicle control, the vehicle control apparatus 101 can perform control more suitable for the user's state according to the user's accessory.

  In the above, the case of the eye patch has been described as an example of the user accessory, but the accessory is optional and may be other than this. For example, if it is an accessory such as a hat or face with a collar that affects the size of the field of view of the user (driver), the vehicle control device 101 may be the in-vehicle device 102 as in the case of the eye patch described above. Can be controlled.

  Next, an example of the flow of vehicle control processing when the accessory detection unit 142 detects a mask worn by the user and performs control based on the detection result will be described with reference to the flowchart of FIG. .

  When the vehicle control process is started, in step S151, the imaging control unit 141 controls the imaging unit 125 to image the driver who is the user, and the driver's image (for example, an image near the driver's face). To get. In step S152, the mask detection unit 153 of the accessory detection unit 142 analyzes the image of the driver and detects a mask present in the image. In step S153, based on the detection result, the mask detection unit 153 determines whether the driver is wearing a mask (or whether the driver is carrying a mask).

  If a mask is detected in the image and it is determined that the driver is wearing the mask, the process proceeds to step S154. In step S154, the setting unit 143 changes the warning by the scent performed by the warning device 195 (scent warning) to a warning by another method or includes the warning included in the control setting value 181 so as to strengthen the scent. Update the settings.

  In general, when a mask is worn, the user's nose is covered with the mask, and thus the sensitivity to the user's fragrance is duller than in a normal case where the mask is not worn. Therefore, the control unit 111 controls the driver so that the scent at the time of the warning is increased or the warning is performed by another method so that the driver can easily grasp the warning.

  In step S155, the setting unit 143 includes the control setting value 181 so that the input method of the user instruction accepted by the navigation device 191 is changed from voice input to another method or the sensitivity of voice input is increased. The setting related to the user instruction input method of the navigation device 191 is updated.

  In general, when wearing a mask, the mouth of the user is covered with the mask, so there is a risk that the voice volume may be lower or the voice quality may be changed compared to a normal case where the mask is not worn. . Therefore, when the navigation device 191 receives a user instruction by voice input, it may be difficult to correctly accept the user instruction if the user wears a mask. Therefore, the control unit 111 changes the reception method of the user instruction input of the navigation device 191 included in the control setting value 181 or the voice input so that the navigation device 191 can receive the user instruction more accurately. Control to increase the sensitivity of the microphone (voice sensor) used in

  When the process of step S155 ends, the season information acquisition unit 161 acquires season information indicating the current season (time and date), and the user information acquisition unit 162 stores the user information 182 stored in the storage unit 123. The included disease information indicating the driver's disease is acquired.

  In step S156, when the driver's disease information and season information are acquired, the user state determination unit 163 determines the health state of the driver based on the information.

  In step S157, the user state determination unit 163 determines whether or not the driver has developed hay fever based on the determination result of step S156. For example, when the driver's chronic disease includes hay fever corresponding to the current season, the user state determination unit 163 determines that the cause of the driver's masking is the onset of hay fever. If it is determined that the driver has developed hay fever, the process proceeds to step S158.

  In step S158, the setting unit 143 updates the air conditioning setting included in the control setting value 181 so that the ventilation device 196 sets the ventilation mode to the inside air circulation that blocks the outside air and circulates the inside air indoors. If outside air is taken in, there is a risk that pollen may enter the passenger compartment. Therefore, the control unit 111 sets the operation mode of the ventilator 196 to the inside air circulation so as not to make the driver's hay fever symptom worse as much as possible. To.

  In step S159, the setting unit 143 updates the cleanliness setting included in the control set value 181 so as to increase the cleanliness of the air cleaner 197. Thereby, the control part 111 can remove more pollen from the air of a vehicle interior, and can suppress the deterioration of the symptom of a driver | operator's hay fever.

  When the process of step S <b> 159 ends, the inquiry acquisition unit 171 acquires the inquiry count 183 stored in the storage unit 123.

  In step S160, the inquiry determination unit 172 determines whether or not the number of questions that have been made so far is within a predetermined value set by the number of questions 183 based on the number of questions 183. To do. If it is determined that the value is within the predetermined value, the process proceeds to step S161.

  In step S161, for example, the setting unit 143 makes an arbitrary inquiry to the driver such as “How is the state today?”, “Take care”, or “The medicine of ○○ is effective” The inquiry setting included in the control setting value 181 is updated so that the navigation device 191 performs the predetermined number of times set in the inquiry number 183. Such an inquiry can give the driver a sense of security that the vehicle control device 101 performs control in consideration of his / her physical condition. In addition, the driver himself can be aware of his / her physical condition and can expect to perform safe driving according to his / her physical condition.

  When the process of step S161 ends, the process proceeds to step S167. If it is determined in step S160 that the number of questions exceeds a predetermined value, the process proceeds to step S167. In other words, questions are asked only a predetermined number of times per day. Exceeding the limit and questioning persistently can make the driver uncomfortable. The setting unit 143 can make the driver uncomfortable by limiting the number of questions to a predetermined number or less.

  In step S157, for example, when it is determined that the illness of the driver does not include hay fever corresponding to the current season and the driver does not develop hay fever, the process proceeds to step S162. . In step S162, the user state determination unit 163 determines whether or not the driver has a cold based on the determination result of step S156. If it is determined that the driver has a cold, the process proceeds to step S163.

  In step S163, the setting unit 143 causes the air conditioner 198 to set the air conditioner included in the control set value 181 so that the room temperature in the vehicle interior is higher than when the driver is in a healthy state without catching a cold. Update the target temperature setting of the conditioner 198. That is, the setting unit 143 makes the target temperature setting of the air conditioner 198 higher than when the driver is healthy.

  As a result, the air conditioner 198 can adjust the temperature in accordance with the physical condition of the driver, and can suppress the deterioration of the physical condition of the driver due to, for example, excessive cooling.

  In step S164, the setting unit 143 searches and sets a medical facility such as a hospital or a pharmacy as a destination when the destination of the navigation device 191 is set, for example, rather than when the driver does not catch a cold. In order to facilitate, the setting of the navigation device 191 included in the control setting value 181 is updated. In general, when a driver has a cold, the driver is more likely to drive a vehicle to a medical facility such as a hospital or pharmacy than when the driver is in a healthy state. Therefore, for example, in the destination setting GUI of the navigation device 191, an icon indicating the nearest hospital in the current location is preferentially displayed on the map image, or “search for the nearest hospital” is dedicated to the hospital search. The control unit 111 can improve the operability of the navigation device 191 by generating and displaying the GUI button.

  In step S165, the inquiry determination unit 172 determines, based on the inquiry number 183, whether or not the number of questions made to date is within a predetermined value set by the inquiry number 183. To do. If it is determined that the value is within the predetermined value, the process proceeds to step S166.

  In step S166, the setting unit 143 makes an arbitrary inquiry to the driver, such as “How is the state today?”, “Take care”, or “The medicine of ○○ is effective” The inquiry setting included in the control setting value 181 is updated so that the navigation device 191 performs the predetermined number of times set in the inquiry number 183. Such an inquiry can give the driver a sense of security that the vehicle control device 101 performs control in consideration of his / her physical condition. In addition, the driver himself can be aware of his / her physical condition and can expect to perform safe driving according to his / her physical condition.

  When the process of step S166 ends, the process proceeds to step S167. If it is determined in step S165 that the number of questions exceeds a predetermined value, the process proceeds to step S167. In other words, the question is made only a predetermined number of times per day so as not to make the driver uncomfortable.

  If it is determined in step S153 that the driver is not masking, or if it is determined in step S162 that the driver does not have a cold, the process proceeds to step S167.

  In step S167, based on the updated control setting value 181 (in order to reflect the updated setting value), the process execution unit 144 executes a control process for the device in the in-vehicle device 102 that has updated at least the setting value. To do.

  When the process of step S167 ends, the vehicle control process ends. While the driver is in the vehicle, the vehicle control process as described above is appropriately executed.

  By executing such vehicle control, the vehicle control apparatus 101 can perform control more suitable for the user's state according to the user's accessory.

  In the above, the case of a mask has been described as an example of the user's accessory, but the accessory is optional and may be other than this. For example, if it is an accessory such as a mask or a muffler that covers the mouth or nose of the user (driver), the vehicle control device 101 controls the in-vehicle device 102 as in the case of the mask described above. be able to.

  In the above, it has been described that detection is individually performed for each accessory such as detection of sunglasses, detection of eye patch, and detection of mask, but not limited thereto, for the user's image obtained by imaging, A plurality of types of accessory items such as sunglasses, eye patch, and mask may be detected. In this case, the control as described above is appropriately executed according to the detected accessory. By doing in this way, the vehicle control apparatus 101 can identify what accessory goods exist, and can control the vehicle-mounted device 102 appropriately according to the identification result.

  In the above description, the control setting is performed according to the user's accessory. However, the present invention is not limited to this, and the vehicle control device 101 detects a change in the user's accessory and installs the vehicle in response to the change. The control setting of the device 102 may be updated.

  FIG. 6 is a block diagram showing another configuration example of the vehicle control system to which the present invention is applied.

  In FIG. 6, a vehicle control system 300 is a system in which the vehicle control device 301 controls the in-vehicle device 102 as in the vehicle control system 100 of FIG. 1. The vehicle control device 301 corresponds to the vehicle control device 101 of FIG. 1 and basically has the same configuration as the vehicle control device 101 and realizes the same function. However, the vehicle control device 301 includes a control unit 311 instead of the control unit 111 of the vehicle control device 101.

  As illustrated in FIG. 6, the control unit 311 realizes a predetermined function by executing a program or the like, controls the input unit 121 to the imaging unit 125, and controls the in-vehicle device 102. The control unit 311 includes, for example, an imaging control unit 141, an image analysis unit 321, a change determination unit 322, a setting unit 143, and a process execution unit 144 as functional blocks.

  The image analysis unit 321 analyzes a user image (for example, an image near the user's face) obtained by the control of the imaging control unit 141. Based on the analysis result, the change determination unit 322 detects an apparent change of the user and determines the presence or absence. For example, in the user image, when the accessory worn by the user is different from the user accessory in the user image registered in advance, the change determination unit 322 determines that the accessory has changed.

  An example of the flow of the vehicle control process executed by the vehicle control device 301 of FIG. 6 will be described with reference to the flowchart of FIG.

  When the vehicle control process is started, in step S301, the imaging control unit 141 controls the imaging unit 125 to image the driver who is the user, and the driver's image (for example, an image near the driver's face). To get. In step S302, the image analysis unit 321 analyzes the image of the driver and detects a change in the user who is the subject. In step S303, based on the detection result, the change determination unit 322 determines whether or not there is an apparent change in the driver who is the subject in the driver image.

  If it is determined that there is no apparent change, the process proceeds to step S304. In step S304, the setting unit 143 updates the control setting value 181 based on the fact that there is no change. When the process of step S304 ends, the process proceeds to step S313.

  If it is determined in step S303 that there is an apparent change, the process proceeds to step S305. In step S305, the change determination unit 322 determines whether or not there is a change in the body part of the driver who is the subject in the driver image. If it is determined that there is a change, the process proceeds to step S306. In step S306, the setting unit 143 updates the setting for the control setting value 181 based on a change in the body part.

  When the process of step S306 ends, the process proceeds to step S307. If it is determined in step S305 that there is no change in the body part, the process in step S306 is omitted, and the process proceeds to step S307.

  In step S307, the change determination unit 322 determines whether or not the driver's incidental object as the subject is the same in the driver's image. If it is determined as usual, the process proceeds to step S308. In step S308, the setting unit 143 updates the setting based on the normal incidental for the control setting value 181. When the process of step S308 ends, the process proceeds to step S313.

  If it is determined in step S307 that the accessory is different from usual, the process proceeds to step S309.

  In step S309, the change determination unit 322 determines whether there is always an accessory in the driver's image that is not an accessory of the driver who is the subject. If it is determined that there is an accessory that is not always worn by the driver, the process proceeds to step S310. In step S <b> 310, the setting unit 143 updates the setting for the control setting value 181 based on the fact that there are many incidental items.

  When the process of step S310 ends, the process proceeds to step S311. If it is determined in step S309 that there is no always incidental accessory, the process proceeds to step S311.

  In step S <b> 311, the change determination unit 322 determines whether there is always an accessory of the driver who is the subject in the driver's image. If it is determined that there is no accessory that the driver always wears, the process proceeds to step S312. In step S312, the setting unit 143 updates the setting for the control setting value 181 based on the fact that there are few incidental items.

  When the process of step S312 ends, the process proceeds to step S313. If it is determined in step S311 that there is always an accessory, the process proceeds to step S313.

  In step S313, based on the updated control setting value 181 (in order to reflect the updated setting value), the process execution unit 144 executes a control process for the device in the in-vehicle device 102 that has updated at least the setting value. To do.

  In step S314, the control unit 311 determines whether or not to end the vehicle control process. If it is determined that the vehicle control process is not ended, the control unit 311 returns to step S301, and the subsequent processes are repeated. If it is determined in step S314 that the vehicle control process is to be terminated, the vehicle control process is terminated.

  By executing such vehicle control, the vehicle control device 301 can update the control set value 181 in accordance with a change in the user's accessory and the like, and can perform control more suitable for the user's state. it can.

  In addition, although the case where the setting of the vehicle or the device mounted on the vehicle is updated has been described above, the configuration of the device mounted on an apparatus other than the vehicle is not limited to this. Good. That is, the present invention can be applied to a control device that controls a device based on the detection result of an accessory of a user who operates the device.

  The series of processes described above can be executed by hardware or can be executed by software. In this case, for example, it may be configured as a personal computer as shown in FIG.

  In FIG. 8, the CPU 401 of the personal computer 400 executes various processes according to a program stored in the ROM 402 or a program loaded from the storage unit 413 to the RAM 403. The RAM 403 also appropriately stores data necessary for the CPU 401 to execute various processes.

  The CPU 401, ROM 402, and RAM 403 are connected to each other via a bus 404. An input / output interface 410 is also connected to the bus 404.

  The input / output interface 410 includes an input unit 411 including a keyboard and a mouse, a display including a CRT (Cathode Ray Tube) and an LCD (Liquid Crystal Display), an output unit 412 including a speaker, and a hard disk. A communication unit 414 including a storage unit 413 and a modem is connected. The communication unit 414 performs communication processing via a network including the Internet.

  A drive 415 is connected to the input / output interface 410 as necessary, and a removable medium 421 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted, and a computer program read from them is It is installed in the storage unit 413 as necessary.

  When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 8, the recording medium is distributed to distribute the program to the user separately from the apparatus main body, and includes a magnetic disk (including a flexible disk) on which the program is recorded, an optical disk ( It is only composed of removable media 421 consisting of CD-ROM (compact disc-read only memory), DVD (including digital versatile disc), magneto-optical disc (including MD (mini disc)), or semiconductor memory. Rather, it is composed of a ROM 402 on which a program is recorded and a hard disk included in the storage unit 413, which is distributed to the user in a state of being incorporated in the apparatus main body in advance.

  The program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of devices (apparatuses).

  In addition, in the above description, the configuration described as one device (or processing unit) may be divided and configured as a plurality of devices (or processing units). Conversely, the configurations described above as a plurality of devices (or processing units) may be combined into a single device (or processing unit). Of course, a configuration other than that described above may be added to the configuration of each device (or each processing unit). Furthermore, if the configuration and operation of the entire system are substantially the same, a part of the configuration of a certain device (or processing unit) may be included in the configuration of another device (or other processing unit). . That is, the embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

DESCRIPTION OF SYMBOLS 100 Vehicle control system 101 Vehicle control apparatus 102 Vehicle-mounted device 111 Control part 131 Basic control part 141 Imaging control part 142 Auxiliary product detection part 143 Setting part 144 Process execution part 163 User state determination part 172 Inquiry determination part 181 Control setting value 300 Vehicle control System 301 Vehicle control device 321 Image analysis unit 322 Change determination unit

Claims (23)

Imaging means for imaging a user of a predetermined device;
Detecting means for detecting an accessory in the image of the user obtained by imaging by the imaging means;
Setting means for performing settings for controlling the device according to the accessory detected by the detection means;
A control device comprising: control means for controlling the device using the set value set by the setting means. The control device according to claim 1, wherein the setting unit optimizes the setting in accordance with a darker state than actual when sunglasses detected in the user's image are detected by the detection unit. The control device according to claim 2, wherein the setting unit performs the setting so that a display on a navigation screen is brightened. The control device according to claim 2, wherein the setting unit performs the setting so that illumination of the instrumental panel is brightened. The control device according to claim 2, wherein the setting unit performs the setting of the threshold value of the operating condition so that the automatic anti-glare function is difficult to operate. The control device according to claim 2, wherein the setting unit performs the setting of a threshold value of an operation condition so that an auto light function is easily activated. The control device according to claim 2, wherein the setting unit changes the setting so that various types of illumination are brightened. The control device according to claim 2, wherein the setting unit performs the setting of a threshold value of an operation condition so that an auto sun visor function is difficult to operate. The control device according to claim 2, wherein the control unit changes the setting so as to increase a transmittance of a sun visor. The control apparatus according to claim 2, wherein the setting unit performs setting for controlling the apparatus so as to further reduce an influence on an operation when an eye patch existing in the user's image is detected by the detection unit. The control device according to claim 10, wherein the setting unit performs the setting so as to propose more breaks to the user. The control device according to claim 10, wherein the setting unit performs the setting so as to increase a distance between the device and another device. The control device according to claim 10, wherein the setting unit performs the setting so that information indicating an interval between the device and another device is output. The control device according to claim 10, wherein the setting unit issues an audio warning in addition to an alarm lamp warning. The control device according to claim 1, wherein, when the detection unit detects a mask present in the image of the user, the setting unit performs setting for controlling the device so as to further reduce the influence on the operation. The control device according to claim 15, wherein the setting unit changes the warning based on a scent to a warning based on another method, or performs the setting so that the scent is strengthened. The control device according to claim 15, wherein the setting unit changes the instruction input method to a method other than voice input, or performs the setting so as to improve the sensitivity of a voice input sensor. The control apparatus according to claim 16, further comprising user state determination means for determining the state of the user. When the user state determining means determines that the user has hay fever,
The control device according to claim 16, wherein the setting means sets the ventilation setting to the inside air circulation. When the user state determining means determines that the user has hay fever,
The control device according to claim 16, wherein the setting unit performs setting so as to increase a degree of cleaning of the air cleaner. When the user state determining means determines that the user has a cold,
The control device according to claim 16, wherein the setting means performs setting so as to increase a target temperature setting of the air conditioner. A control method for a control device, comprising:
The imaging means of the control device images a user of a predetermined device,
The detection means of the control device detects an accessory that exists in the image of the user obtained by imaging,
The setting unit of the control device performs setting for control of the device according to the detected accessory.
The control means of the control device controls the device using a set value that has been set. Computer
Imaging means for imaging a user of a predetermined device;
Detecting means for detecting an accessory in the image of the user obtained by imaging by the imaging means;
Setting means for performing settings for controlling the device according to the accessory detected by the detection means;
The program for functioning as a control means which controls the said apparatus using the setting value set by the said setting means.

Images