WO2023281977A1 - Wakefulness maintaining device and wakefulness maintaining method - Google Patents
Wakefulness maintaining device and wakefulness maintaining method Download PDFInfo
- Publication number
- WO2023281977A1 WO2023281977A1 PCT/JP2022/023313 JP2022023313W WO2023281977A1 WO 2023281977 A1 WO2023281977 A1 WO 2023281977A1 JP 2022023313 W JP2022023313 W JP 2022023313W WO 2023281977 A1 WO2023281977 A1 WO 2023281977A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- occupant
- stimulus
- seat belt
- pull
- drowsiness
- Prior art date
Links
- 206010062519 Poor quality sleep Diseases 0.000 title claims description 85
- 238000000034 method Methods 0.000 title claims description 66
- 206010041349 Somnolence Diseases 0.000 claims abstract description 164
- 230000000638 stimulation Effects 0.000 claims abstract description 90
- 238000012423 maintenance Methods 0.000 claims description 61
- 230000000694 effects Effects 0.000 claims description 8
- 230000037007 arousal Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 description 23
- 208000032140 Sleepiness Diseases 0.000 description 19
- 230000037321 sleepiness Effects 0.000 description 19
- 230000006870 function Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 210000003128 head Anatomy 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 210000000744 eyelid Anatomy 0.000 description 3
- 230000004397 blinking Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000000873 masking effect Effects 0.000 description 2
- 230000029058 respiratory gaseous exchange Effects 0.000 description 2
- 230000004936 stimulating effect Effects 0.000 description 2
- 241001282135 Poromitra oscitans Species 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 238000002485 combustion reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R22/00—Safety belts or body harnesses in vehicles
- B60R22/34—Belt retractors, e.g. reels
- B60R22/46—Reels with means to tension the belt in an emergency by forced winding up
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
Definitions
- the present disclosure relates to a wakefulness maintenance device and a wakefulness maintenance method.
- Patent Document 1 discloses a means for retracting a seat belt as a means for performing an actuation to encourage awakening.
- Patent Document 1 only the pulling in of the seat belt is taken into consideration to promote wakefulness. Even if the seat belt is retracted in the same way, it may not be an appropriate stimulus depending on the condition of the seat belt and the condition of the subject. Therefore, in the technology disclosed in Patent Literature 1, there is a risk that the stimulus to maintain wakefulness by pulling in the seat belt may not be an appropriate stimulus for the subject.
- One object of this disclosure is to provide a wakefulness maintenance device and wakefulness maintenance method that make it possible to make the wakefulness maintenance stimulus by pulling in the seat belt a more appropriate stimulus for the subject.
- a wakefulness maintenance device of the present disclosure is a wakefulness maintenance device that can be used in a vehicle. Based on the occupant-related state identification unit that identifies the state and the degree of drowsiness of the occupant identified by the occupant-related state identification unit that is equal to or greater than the first threshold, a stimulus is generated by pulling in the seat belt worn by the occupant. and an attraction control unit for performing a certain attraction stimulation, the attraction control unit changing the manner of the attraction stimulation according to the occupant-related state specified by the occupant-related state specifying unit.
- a wakefulness maintenance method of the present disclosure is a wakefulness maintenance method that can be used in a vehicle, comprising: An occupant-related state identification step of identifying an occupant-related state, which is a state related to the occupant, and based on the fact that the degree of drowsiness of the occupant identified in the occupant-related state identification step is equal to or greater than a predetermined threshold, a pull-in control step for performing a pull-in stimulus, which is a stimulus due to pull-in of the seat belt, and in the pull-in control step, the mode of the pull-in stimulus is changed according to the occupant-related state specified in the occupant-related state specifying step.
- the occupant's withdrawal stimulation which is a stimulation caused by the withdrawal of the seat belt worn by the occupant, is performed, so it is possible to maintain wakefulness by the withdrawal stimulation. become.
- the mode of the attraction stimulus is changed according to the occupant-related state, which is a state related to the occupant, the stimulus is more suitable for the subject than when the mode of the attraction stimulus is not changed regardless of the occupant-related state. it becomes possible to As a result, it is possible to make the stimulus for maintaining wakefulness by retracting the seat belt more suitable for the subject.
- FIG. 1 is a diagram showing an example of a schematic configuration of a wakefulness maintenance system 1;
- FIG. 1 is a diagram showing an example of a schematic configuration of an HCU 10;
- FIG. 10 is a diagram showing an example of shortening the interval between stimulations within one set of motive stimulations as the occupant's drowsiness level increases.
- FIG. 10 is a diagram showing an example in which the frequency of each set of the entrainment stimulus is increased as the drowsiness level of the occupant increases.
- 4 is a flowchart showing an example of the flow of wakefulness maintenance-related processing in the HCU 10.
- FIG. It is a figure which shows an example of a schematic structure of HCU10a.
- FIG. 4 is a flowchart showing an example of a flow of wakefulness maintenance-related processing for a fellow passenger in HCU 10.
- FIG. It is a figure which shows an example of a schematic structure of the wakefulness maintenance system 1b. It is a figure which shows an example of a schematic structure of HCU10b. It is a figure which shows an example of a schematic structure of HCU10c.
- FIG. 5 is a diagram for explaining an example of a motor current value according to how loose a seat belt is;
- a wakefulness maintenance system 1 shown in FIG. 1 is used in an automobile (hereinafter simply referred to as a vehicle) and includes an HCU (Human Machine Interface Control Unit) 10, a seat ECU 20, an indoor camera 30, a display device 40, a seatbelt actuator 50, and a seat belt sensor 60 .
- the HCU 10, the seat ECU 20, and the seat belt sensor 60 may be configured to be connected to an in-vehicle LAN (see LAN in FIG. 1).
- a vehicle using the wakefulness maintenance system 1 is not necessarily limited to an automobile as long as it uses a seat belt.
- a vehicle equipped with the wakefulness maintenance system 1 is hereinafter referred to as an own vehicle.
- the seat ECU 20 is an electronic control unit that controls the seat environment, such as adjusting the seat position of the seat of the vehicle.
- the seat ECU 20 adjusts the seat position by controlling a motor for adjusting the seat position of the vehicle (hereinafter referred to as a seat motor).
- Seat motors include a slide motor for adjusting the slide position and a reclining motor for adjusting the reclining position.
- the slide position indicates the adjusted position of the seat with respect to the longitudinal direction of the vehicle.
- the reclining position indicates the adjustment angle of the inclination of the seat back.
- the seat back corresponds to the backrest portion. Adjustment of the slide position and the reclining position may be performed according to the setting input from the occupant.
- a setting input from a passenger may be received via a switch or the like, for example.
- the seat ECU 20 sequentially detects the slide position and the reclining position.
- the slide position may be detected, for example, from the rotation angle of the slide motor.
- the reclining position can be detected from the rotation
- the slide position and the reclining position are electrically adjustable will be described as an example, but this is not necessarily the case.
- some or all of the slide position and reclining position may not be electrically adjustable and may require manual adjustment.
- the slide position may be detected by a sensor that detects the slide position.
- the reclining position may be detected by a sensor that detects the reclining position.
- the indoor camera 30 captures an image of a predetermined range inside the vehicle. It is assumed that the indoor camera 30 captures an image of a range including at least the driver's seat of the own vehicle. The indoor camera 30 may capture an image of a range including the driver's seat, the front passenger's seat, and the rear seats of the own vehicle. A plurality of cameras may be used as the indoor camera 30, and the imaging range may be shared by the plurality of cameras.
- the indoor camera 30 includes, for example, a near-infrared light source, a near-infrared camera, and a control unit for controlling them. The indoor camera 30 captures an image of the occupant irradiated with near-infrared light by the near-infrared light source.
- the indoor camera 30 will be described as capturing an image of at least the driver in the driver's seat.
- An image captured by the near-infrared camera is image-analyzed by the control unit.
- the control unit detects the opened/closed state of the occupant's eyelids, face orientation, line-of-sight direction, arousal level, posture, etc., based on the occupant feature amount extracted by image analysis of the captured image.
- the degree of arousal may be detected by, for example, the degree of opening and closing of the eyelids.
- the presentation device 40 is installed in the vehicle and presents information to the interior of the vehicle.
- the presentation device 40 presents information according to instructions from the HCU 10 .
- the presentation device 40 may present information at least to the driver.
- the presentation device 40 may present information to fellow passengers other than the driver.
- the presentation device 40 includes a display 41 and an audio output device 42 .
- the display 41 presents information by displaying information.
- a meter MID Multi Information Display
- CID Center Information Display
- HUD Head-Up Display
- the meter MID is a display device provided in front of the driver's seat in the passenger compartment.
- the meter MID may be configured to be provided on the meter panel.
- the CID is a display device placed in the center of the instrument panel of the vehicle.
- the HUD is provided, for example, on an instrument panel inside the vehicle.
- the HUD projects a display image formed by the projector onto a predetermined projection area on the front windshield as a projection member. The image light reflected by the front windshield to the interior of the vehicle is perceived by the driver seated in the driver's seat.
- the driver can visually recognize the virtual image of the display image formed in front of the front windshield overlapping a part of the foreground.
- the HUD may be configured to project the display image onto a combiner provided in front of the driver's seat instead of the front windshield.
- the audio output device 42 presents information by outputting audio.
- a speaker or the like can be used as the audio output device 42 .
- the seatbelt actuator 50 feeds and retracts the seatbelt of the vehicle. Retraction of the seat belt causes retraction of the seat belt. In this embodiment, the occupant wearing a seat belt is stimulated by the retraction of the seat belt to keep them awake.
- the seat belt actuator 50 is, for example, a motor.
- the seatbelt actuator 50 feeds and retracts the seatbelt of the own vehicle according to instructions from the HCU 10 .
- the seat belt actuator 50 is provided at least in the driver's seat. Note that the seat belt actuator 50 may be configured to be provided for each seat.
- the seatbelt sensor 60 is a sensor that detects the amount of withdrawal of the seatbelt by the seatbelt actuator 50 .
- the seat belt sensor 60 may be an encoder that detects the rotation angle of the seat belt actuator 50 as a motor. In this case, this rotation angle may be treated as the withdrawal amount of the seat belt.
- the HCU 10 is mainly composed of a microcomputer equipped with a processor, memory, I/O, and a bus connecting them.
- the HCU 10 executes a control program stored in the memory to execute various types of processing such as processing related to keeping the occupants of the own vehicle awake (hereinafter referred to as “wakefulness maintenance related processing”).
- This HCU 10 corresponds to a wakefulness maintenance device.
- Memory as used herein, is a non-transitory tangible storage medium for non-transitory storage of computer-readable programs and data.
- a non-transitional physical storage medium is implemented by a semiconductor memory, a magnetic disk, or the like.
- a schematic configuration of the HCU 10 will be described below.
- the HCU 10 includes an occupant-related state identification unit 101, a presentation control unit 102, an optimum determination unit 103, and a pull-in control unit 104 as functional blocks. Execution of the processing of these functional blocks by the computer corresponds to execution of the wakefulness maintaining method.
- a part or all of the functions executed by the HCU 10 may be configured as hardware using one or a plurality of ICs or the like. Also, some or all of the functional blocks provided by the HCU 10 may be implemented by a combination of software executed by a processor and hardware members.
- the occupant-related state identification unit 101 identifies a state related to the occupants of the own vehicle (hereinafter referred to as occupant-related state).
- the processing in the occupant-related state identification unit 101 corresponds to the occupant-related state identification step.
- the occupant-related state identification unit 101 has a drowsiness identification unit 111, a slackness identification unit 112, and a physique identification unit 113 as sub-functional blocks.
- the drowsiness identification unit 111 identifies the degree of drowsiness of the occupant of the vehicle.
- the drowsiness identifying unit 111 may identify the degree of drowsiness from the awakening level detected by the indoor camera 30 .
- the degree of drowsiness may be specified by the drowsiness specifying unit 111 from the image captured by the indoor camera 30 without detecting the awakening level with the indoor camera 30 .
- the drowsiness identification unit 111 identifies drowsiness levels classified into six stages described below. For example, sleepiness levels may be classified according to the NEDO evaluation method.
- a drowsiness level of 0 is the degree of not being sleepy at all (Not Sleepy). Drowsiness level 0 can be rephrased as wakefulness.
- the characteristics of drowsiness level 0 include the following. First, the movement of the line of sight is fast and frequent. The second is that the cycle of blinking is stable. The third is that it involves physical movement. Sleepiness level 1 is the degree corresponding to Slightly Sleepy. The drowsiness level 1 or more can also be rephrased as a non-awakened state. The characteristics of sleepiness level 1 include the following. The first is that the lips are open. The second is that the movement of the line of sight is slow. Sleepiness level 2 is the degree of sleepiness.
- the characteristics of drowsiness level 2 include the following. The first is slow and frequent blinking. The second is that there is movement of the mouth. The third is that you can see the re-sitting in the seat. The fourth is that the gesture of putting a hand on the face can be seen.
- the division between sleepiness level 2 or higher and sleepiness level less than 2 can also be rephrased as a division of whether or not the subject is aware of sleepiness.
- a drowsiness level of 2 or higher is a category in which the subject perceives drowsiness.
- a sleepiness level of less than 2 is a category in which the subject does not perceive sleepiness.
- Drowsiness level 3 is the degree of rather sleepy.
- the characteristics of sleepiness level 3 include the following. The first is that there are blinks that are presumed to be conscious. Second, unnecessary body movements such as shaking the head and moving the shoulders up and down are observed. The third is frequent yawning and deep breathing. The fourth is that the blink and the movement of the line of sight are slow.
- the division between drowsiness level 3 or higher and drowsiness level less than 3 can also be rephrased as a division of whether or not the subject needs to be warned.
- a sleepiness level of 3 or higher is a category that requires a warning to the subject.
- a drowsiness level of less than 3 is a category in which the subject does not need to be alerted.
- Drowsiness level 4 is the degree corresponding to Very Sleepy.
- the characteristics of drowsiness level 4 include the following. The first is the tilting of the head forward. The second is that the head falls backwards.
- Sleepiness level 5 is a degree corresponding to sleeping (Sleeping). Drowsiness level 5 can be rephrased as a sleeping state. Drowsiness level 5 is characterized by closing the eyelids for a few seconds.
- the degree of drowsiness is classified into the above six categories as an example, but it is not necessarily limited to this.
- it may be configured to at least distinguish whether or not the target person needs to be warned.
- it is good also as a structure which distinguishes at least whether a subject is aware of drowsiness, and whether a subject's warning is required.
- the drowsiness identifying unit 111 may identify the subject's drowsiness based on the biological information measured by a biosensor that measures the subject's biological information.
- the biosensor may be provided in the vehicle, such as in the steering wheel, seat, or the like.
- the biosensor may be configured to be provided in a wearable device worn by the subject. If the wearable device is provided with a biosensor, the HCU 10 may acquire the measurement result of the biosensor via short-range wireless communication, for example.
- biological information measured by a biological sensor include respiration, pulse, heart rate, skin temperature, and the like.
- the slackness specifying unit 112 specifies the slackness of the seat belt worn by the occupant of the vehicle.
- the slackness identifying unit 112 may identify the slackness of the seat belt using the results detected by the indoor camera 30 .
- the slackness specifying unit 112 may specify the slackness of the seat belt from the posture detected by the indoor camera 30 and the seat slide position acquired from the seat ECU 20 .
- the slackness of the seat belt is greatly specified as the divergence in the longitudinal direction of the own vehicle between the position of the subject's head and the sliding position of the seat on which the subject is seated increases. good.
- the slackness identifying unit 112 may classify the slackness of the seat belt into two stages, i.e., slackness and not slackness. In addition, when the slackness identification unit 112 detects a motion of loosening the seat belt by hand, the slackness degree of the seat belt is determined to be one of two levels: loose and not loose. should be specified.
- the posture and movement of the occupant may be identified by the occupant-related state identification unit 101 based on the image captured by the indoor camera 30 .
- the physique identifying unit 113 identifies the physique of the occupant by recognizing the image captured by the indoor camera 30 .
- the width of the occupant's torso, the width of the shoulders, etc. may be specified as the physique.
- the physique identifying unit 113 may be configured to authenticate each passenger by face authentication or the like, and store the physique of each crew member when he/she wears light clothing in the non-volatile memory of the HCU 10 .
- the physique when wearing light clothes the physique when wearing light clothes for each passenger may be stored by overwriting the physique specified as smaller for the same passenger and leaving it in the non-volatile memory. This is because it is presumed that the smaller the physique is identified, the lighter the occupant is wearing.
- the presentation control unit 102 causes the presentation device 40 to present information.
- the presentation control unit 102 may cause the presentation device 40 to issue an alarm when the drowsiness level specified by the drowsiness specifying unit 111 is 3 or higher.
- a warning may be displayed on the display 41 .
- a warning sound or warning voice may be output from the voice output device 42 .
- the optimum determination unit 103 determines the mode of stimulation by retraction of the seat belt (hereinafter referred to as retraction stimulation) according to the occupant-related state identified by the occupant-related state identification unit 101 . It is preferable that the optimum determination unit 103 determines at least one of the intensity and pattern of the attraction stimulation as the aspect of the attraction stimulation according to the degree of drowsiness of the occupant identified by the drowsiness identification unit 111 .
- one set of the entrainment stimulus is a plurality of stimuli. The first stimulation within one set is called the starting stimulation. The second and subsequent stimulations within one set are called subsequent stimulations. It is preferable that the initial stimulus has a weaker intensity than the subsequent stimulus.
- the attraction stimulus is two times and the stimulus is one set.
- the level of intensity of stimulus may be expressed by the length of duration of one stimulus or by the speed of retraction of the seat belt.
- the intensity of the stimulus may be expressed by the retraction amount of the seat belt.
- the optimum determination unit 103 determines the pattern of the attraction stimulus so that the interval between stimulations in one set of the attraction stimulation becomes shorter as the drowsiness level of the occupant identified by the drowsiness identification unit 111 increases. is preferred. This is because the shorter the intervals between a plurality of stimulations in one set, the easier it is for a sense of warning to be conveyed.
- FIG. 3 an example is shown in which the interval between stimulations within one set of attraction stimulations is shortened as the drowsiness level of the occupant increases.
- the vertical axis of the graph in FIG. 3 indicates the presence or absence of stimulation. Specifically, 0 indicates no stimulation, and 1 indicates the presence of stimulation.
- the horizontal axis of FIG. 3 indicates time in milliseconds (ms).
- F in FIG. 3 indicates the starting stimulus.
- S in FIG. 3 indicates the subsequent stimulation.
- F+S in FIG. 3 represents one set of stimuli.
- the interval between stimulations in one set at drowsiness level 3 may be made shorter than that at drowsiness level 2. This is because at drowsiness level 2, the target person feels drowsiness but has not yet reached a level at which a warning is necessary, so the need to issue a warning is lower than at drowsiness level 3.
- the stimulation interval in one set should be 500 ms or longer.
- the stimulation interval in one set should be 100 ms or more and less than 500 ms. The reason why the interval between stimulations in one set is set to 100 ms or longer is to allow the subject to distinguish and recognize two stimulations in one set.
- this pattern for drowsiness level 3 is called pattern A
- this pattern for drowsiness level 2 is called pattern B.
- the duration of the initial stimulus is shorter than the duration of the subsequent stimulus and is weaker in intensity than the subsequent stimulus.
- the optimal determination unit 103 determines the pattern of the attraction stimulus so that the frequency of each set of the attraction stimulus increases as the degree of drowsiness of the occupant identified by the drowsiness identification unit 111 increases. is preferred. This is because the higher the frequency of stimulation for each set, the easier it is for a sense of warning to be conveyed.
- FIG. 4 an example is shown in which the frequency of each set of entrainment stimuli is increased as the drowsiness level of the occupant increases.
- the vertical axis of the graph in FIG. 4 indicates the presence or absence of stimulation. Specifically, 0 indicates no stimulation, and 1 indicates the presence of stimulation.
- the horizontal axis of FIG. 4 indicates time in seconds (s).
- F+S in FIG. 4 represents one set of stimuli.
- the frequency of stimulation for each set at sleepiness level 3 may be set higher than that at sleepiness level 2. This is because in the case of drowsiness level 2, it is less necessary to give a warning than in the case of drowsiness level 3, and it is preferable to give priority to suppressing annoyance.
- the frequency of stimulation for each set may be one set per 1000 to 120 seconds.
- the frequency of stimulation for each set should be one set for 80 to 100 seconds.
- the optimum determination unit 103 determines a higher strength of the pulling stimulus for the seat belt as the looseness of the seat belt specified by the looseness specifying unit 112 increases. This is because the greater the slackness of the seat belt, the more difficult it is for the pulling stimulus to be transmitted to the subject.
- the optimum determination unit 103 may determine a target retraction amount of the seat belt (hereinafter referred to as a target retraction amount) as the strength of the retraction stimulus.
- the optimum determination unit 103 may specify an index (hereinafter referred to as intensity level) divided into a plurality of stages as the intensity of the attraction stimulus.
- the optimum determination unit 103 determines that the physique of the occupant identified by the physique identification unit 113 is larger than the physique of the occupant in the past when the occupant was lightly dressed (hereinafter referred to as the reference physique), It is preferable to determine the strength of the pull-in stimulus for the seat belt worn by the occupant higher than in the case where it is not determined that the occupant is larger than the reference physique of the occupant. This is because if the clothing is thick, the attraction stimulus is less likely to be transmitted to the subject.
- the reference physique the physique of each crew member when lightly dressed, which was previously stored in the non-volatile memory by the physique identifying unit 113, may be used. If the physique at the time of thin clothing is not stored in the non-volatile memory, the processing according to whether or not it is determined that the physique is larger than the reference physique may be omitted.
- the optimal determination unit 103 determines that the attraction stimulus for the seatbelt worn by the occupant is greater than when the physique of the occupant is less than the specified value. It is preferable to determine the strength to be high. This is because there is a high possibility that the pull-in stimulus is less likely to be transmitted to a passenger with a large physique.
- the specified value the value of the average physique of an ordinary person may be used. The prescribed value may be different depending on gender.
- the optimum determination unit 103 may increase the target entrainment amount and intensity level by the amount that satisfies the conditions. Further, the optimum determination unit 103 may be configured to increase the strength of the attraction stimulus as the drowsiness level of the passenger identified by the drowsiness identification unit 111 increases.
- the retraction control unit 104 causes the seatbelt actuator 50 to feed and retract the seatbelt of the vehicle.
- the processing in this pull-in control unit 104 corresponds to the pull-in control step.
- the pull-in control unit 104 causes the pull-in stimulus to be performed by winding up the seat belt.
- the retraction stimulus one stimulus may be performed after the seat belt is retracted until the seat belt is returned to the retraction amount before retraction.
- the pull-in control unit 104 may cause the occupant to pull in the seat belt worn by the occupant.
- the first threshold is a value that can be set arbitrarily. It is preferable that the first threshold be a value lower than the value that determines whether or not the subject needs to be warned. In the following description, it is assumed that the first threshold is level 2 of drowsiness. According to this, when the occupant's drowsiness level is such that a warning is not necessary, by maintaining wakefulness only with the withdrawal stimulus, it is possible to reduce the annoyance of maintaining wakefulness due to the warning from the presentation device 40. be possible.
- the entrainment control unit 104 performs entrainment stimulation according to the pattern and/or intensity determined by the optimum determination unit 103 . If the optimum determination unit 103 determines only one of the pattern and the intensity, the attraction control unit 104 causes the attraction stimulation to be performed according to the determined one. When both the pattern and the intensity are determined by the optimum determination unit 103, the attraction control unit 104 causes the attraction stimulation to be performed according to the determined pattern and intensity. That is, the attraction-in control unit 104 changes the mode of the attraction-in stimulation according to the occupant-related state specified by the occupant-related state specifying unit 101 .
- the target retraction amount is determined as the strength by the optimum determining unit 103
- the actually required retraction amount is specified from the retraction amount of the seat belt detected by the seat belt sensor 60 and the target retraction amount. It should be stimulating.
- the intensity level is determined as the intensity by the optimum determining unit 103
- the target attraction amount is calculated so as to increase as the intensity level increases, and the attraction stimulation is performed in the same manner as described above. Let it be.
- the optimal determination unit 103 determines at least one of the intensity and pattern of the attraction stimulus according to the degree of drowsiness of the passenger identified by the drowsiness identification unit 111, the following may be done.
- the drawing-in control unit 104 changes at least one of the strength and pattern of the drawing-in stimulus according to the drowsiness level of the occupant identified by the drowsiness identification unit 111 .
- the entrainment control unit 104 may shorten the interval between the entrainment stimuli within one set as the drowsiness level of the occupant identified by the drowsiness identification unit 111 increases.
- the drawing-in control unit 104 may increase the frequency of each set of the drawing-in stimulus as the drowsiness level of the occupant identified by the drowsiness identification unit 111 increases.
- the entrainment control unit 104 may make the initial stimulus in one set of the entrainment stimulus weaker in intensity than the subsequent stimulus.
- the pull-in control unit 104 may increase the strength of the pull-in stimulus for the seat belt as the looseness of the seat belt specified by the looseness specifying unit 112 increases.
- the optimum determination unit 103 determines that the physique of the occupant identified by the physique identification unit 113 is larger than the reference physique of the occupant and determines the strength of the attraction stimulus to be high, the following may be performed.
- the pull-in control unit 104 determines that the physique of the occupant identified by the physique identification unit 113 is larger than the reference physique of the occupant
- the drawing-in control unit 104 determines that the occupant is larger than the reference physique of the occupant. It is sufficient to increase the strength of the retraction stimulus for the seat belt worn by the occupant.
- the attraction control unit 104 controls the attraction stimulation for the seat belt worn by the occupant as compared to when the physique of the occupant is less than the prescribed value. Strength should be increased.
- the pull-in control unit 104 does not perform the pull-in stimulation when the occupant's face direction detected by the indoor camera 30 is tilted to the left or right. This is because when the driver's face is tilted to the left or right, there is a high possibility that the driver will be hindered from driving. It is preferable to limit this attraction stimulus only when the passenger is the driver.
- the withdrawal control unit 104 may cause the temporarily stopped withdrawal stimulation to be performed. Whether the face is oriented to the left or right or to the front may be determined using a determination threshold value for distinguishing between them.
- the flowchart of FIG. 5 may be configured to start when, for example, a switch (hereinafter referred to as a power switch) for starting the internal combustion engine or motor generator of the vehicle is turned on.
- a switch hereinafter referred to as a power switch
- the function to execute the process related to maintaining wakefulness must be turned on. The configuration may be added.
- step S1 the drowsiness identification unit 111 identifies the drowsiness level of the driver.
- step S2 if the drowsiness level is 2 or higher (YES in S2), the process proceeds to step S3. On the other hand, when the drowsiness level is less than 2, the process proceeds to step S12.
- step S3 if the drowsiness level is 3 or higher (YES in S3), the process proceeds to step S4. On the other hand, when the drowsiness level is 2, the process moves to step S5.
- step S4 the optimum determination unit 103 determines the pattern of the entrainment stimulation according to the drowsiness level specified in S1, and proceeds to step S6.
- step S4 where the drowsiness level is 3 or higher, pattern A may be determined.
- step S5 the optimum determination unit 103 determines the pattern of the entrainment stimulation according to the drowsiness level specified in S1, and the process proceeds to step S6.
- step S5 where the drowsiness level is 2, pattern B may be determined.
- step S6 the slackness identifying unit 112 identifies the slackness of the seat belt worn by the driver. If the seat belt is loose (YES in S6), the process proceeds to step S9. On the other hand, if the seat belt is not loosened (NO in S6), the process proceeds to step S7. For example, if the degree of slackness specified by the degree-of-slackness specifying unit 112 is only two categories of looseness and not-looseness, the following may be done. If it is specified by the looseness specifying unit 112 that it is loose, it is determined that it is loose, and if it is specified that it is not loose, it is determined that it is not loose.
- the degree of slackness specified by the slackness specifying unit 112 is three or more categories, the following may be performed. If the degree of slackness identified by the degree of slackness identification unit 112 is equal to or greater than a certain value, it is assumed that the joint is loose, and if the degree of slackness is less than the certain value, it is judged that the joint is not loose.
- the constant value referred to here may be set arbitrarily.
- step S7 the physique identifying unit 113 identifies the physique of the driver. If the specified driver's physique is larger than the driver's standard physique and is thickly dressed (YES in S7), the process proceeds to step S9. On the other hand, if the driver is not thickly dressed (NO in S7), the process proceeds to step S8.
- step S8 if the physique of the driver identified by the physique identification unit 113 is greater than or equal to the specified value (YES in S8), the process proceeds to step S9. On the other hand, if the physique of the driver is less than the specified value (NO in S8), the process proceeds to step S10. In step S9, the optimum determination unit 103 determines the strength of the attraction stimulus to be higher than the default strength.
- step S10 the attraction control unit 104 determines whether or not the attraction stimulation is possible. As an example, when the face direction of the driver detected by the indoor camera 30 is tilted to the left or right, it may be determined that the entrainment stimulus is impossible. On the other hand, if the driver faces the front, it may be determined that the attraction stimulus is possible. In S10, when it is determined that the attraction stimulus is possible (YES in S10), the process proceeds to step S11. On the other hand, when it is determined that the attraction stimulus is impossible (NO in S10), the process proceeds to step S12.
- step S11 the pull-in control unit 104 causes the seat belt worn by the driver to pull in.
- the entrainment stimulation is performed according to the pattern determined in S4 or S5. Also, in S11, if the process of S9 has been performed, the entrainment stimulation is performed with the intensity determined in S9. In S11, if the process of S9 has not been performed, the entrainment stimulation may be performed with the default intensity.
- step S12 if it is time to end the wakefulness maintenance related process (YES in S12), the wakefulness maintenance related process ends. On the other hand, if it is not the end timing of the wakefulness maintenance related process (NO in S12), the process returns to S1 and repeats the process.
- An example of the termination timing of the wakefulness maintenance related process is that the power switch of the host vehicle is turned off, or that the function of executing the wakefulness maintenance related process is switched off.
- the flowchart in FIG. 5 shows an example in which the degree of increasing the intensity of the attraction stimulus is uniform regardless of how many conditions for increasing the intensity of the attraction stimulus are satisfied, this is not necessarily the case.
- the degree of increasing the intensity of the attraction stimulus may be increased as the number of conditions satisfying the condition for increasing the intensity of the attraction stimulus increases.
- the pulling stimulus which is a stimulus caused by the pulling of the seat belt worn by the driver. Awakening can be maintained.
- the pattern and intensity of the attraction stimulus are changed according to the drowsiness level of the driver, the looseness of the seat belt worn by the driver, and the physique of the driver, the pattern and intensity of the attraction stimulus can be changed regardless of these conditions. It is possible to provide a more appropriate stimulus for the driver as compared with the case where the is not changed. As a result, it is possible to make the stimulus for maintaining wakefulness by retracting the seat belt more suitable for the subject.
- Embodiment 2 In the first embodiment, the configuration is shown in which the target of the attraction stimulus is only the driver, but this is not necessarily the case. For example, a configuration may be adopted in which the target persons of the attraction stimulus are the driver and the fellow passenger (hereinafter referred to as Embodiment 2). An example of the second embodiment will be described below with reference to the drawings.
- the wakefulness-maintaining system 1 of Embodiment 2 is the same as the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10a instead of the HCU 10.
- FIG. 1 The wakefulness-maintaining system 1 of Embodiment 2 is the same as the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10a instead of the HCU 10.
- the HCU 10a includes, as functional blocks, an occupant-related state identification unit 101a, a presentation control unit 102a, an optimum determination unit 103a, and a retraction control unit 104a.
- This HCU 10a also corresponds to a wakefulness maintenance device. Execution of the process of each functional block of the HCU 10a by the computer corresponds to execution of the wakefulness maintaining method.
- the occupant-related state identification unit 101a is the same as the occupant-related state identification unit 101 of Embodiment 1, except that it also identifies, as occupant-related states, states related to fellow passengers in the vehicle in addition to the driver.
- the processing in the occupant-related state identification section 101a also corresponds to the occupant-related state identification step.
- the occupant-related state identification unit 101a has a drowsiness identification unit 111a, a slackness identification unit 112, and a physique identification unit 113 as sub-functional blocks.
- the occupant-related state identification unit 101a is the same as the occupant-related state identification unit 101 of the first embodiment except that the drowsiness identification unit 111a is replaced with the drowsiness identification unit 111a.
- the occupant-related state identifying unit 101a preferably also identifies the posture of the fellow passenger or the reclining state of the seat.
- the posture of the fellow passenger may be the inclination of the upper body of the fellow passenger with respect to the longitudinal direction of the vehicle.
- the posture of the fellow passenger may be specified by recognizing the image captured by the indoor camera 30 .
- the reclining state of the passenger's seat may be identified from the reclining position obtained from the seat ECU 20 .
- the drowsiness identification unit 111a is the same as the drowsiness identification unit 111 of the first embodiment, except that it also identifies the drowsiness level, which is the degree of drowsiness of the passenger in the vehicle.
- the drowsiness level of the fellow passenger may also be identified in the same manner as the drowsiness level of the driver.
- the indoor camera 30 captures not only the driver's seat but also the passenger's seat such as the passenger's seat and the rear seat.
- the presentation control unit 102a is the same as the presentation control unit 102 of the first embodiment, except that it presents information for fellow passengers (hereinafter referred to as information for fellow passengers) that notifies that the drowsiness level of the driver is high. .
- the presentation control unit 102a may cause the presentation device 40 to present information for fellow passengers when the drowsiness level of the driver identified by the drowsiness identification unit 111a is 3 or higher.
- the presentation device 40 for presenting information for fellow passengers includes a CID as a display device 41 and a speaker as an audio output device 42 .
- the optimum determining unit 103a is identical to the optimum determining unit 103 of the first embodiment, except that the mode of the attraction stimulus is determined according to the occupant-related state specified by the occupant-related state specifying unit 101a for the fellow passenger of the own vehicle. It is the same. Determination of the mode of attraction stimulus for the fellow passenger by the optimum determination unit 103a will be described below.
- the optimum determination unit 103a determines that the pattern of the entrainment stimulation is a pattern in which a plurality of stimulations constitutes one set. good. Also, the initial stimulus may be determined to be weaker in intensity than the subsequent stimulus. As an example, the pattern B described in the first embodiment may be determined. On the other hand, when the passenger's drowsiness level specified by the drowsiness specifying unit 111a is 0 and is in an awake state, the pattern of the attraction stimulus may be determined as a pattern in which one stimulus is one set. This pattern will be referred to as pattern C hereinafter.
- the intensity of the entraining stimulus may be the same weak stimulus as the starting stimulus when multiple stimuli are set as one set pattern. According to this, when the fellow passenger is in an awake state, the number of stimuli in one set is reduced and the stimuli are also weakened, making it possible to make the stimuli less annoying. On the other hand, when the fellow passenger is in a non-awakened state, by increasing the number of stimulations in one set and strengthening the stimulation, it is possible to invite the passenger into an awakened state.
- the pull-in control unit 104a is the same as the pull-in control unit 104 of the first embodiment, except that the seat belt actuator 50 also causes the seat belt to be fed out and retracted for the passenger.
- the processing in the pull-in control unit 104a also corresponds to the pull-in control step.
- the attraction stimulus for the fellow passenger in the attraction control unit 104a will be described below.
- the pull-in control unit 104a When the driver's drowsiness specified by the drowsiness specifying unit 111a is less than the second threshold, the pull-in control unit 104a preferably does not perform the pull-in stimulation for the seat belt worn by the fellow passenger. It is preferable that the pull-in control unit 104a performs a pull-in stimulation for the seat belt worn by the fellow passenger based on whether the drowsiness of the driver identified by the drowsiness identification unit 111a is equal to or greater than the second threshold.
- the second threshold is a value that can be set arbitrarily.
- the second threshold is preferably a value that determines whether or not a warning is required for the driver. In the following description, it is assumed that the second threshold is drowsiness level 3.
- the attraction control unit 104a causes the attraction stimulation to be performed according to the stimulation mode determined by the optimum determination unit 103a when performing the attraction stimulation for the fellow passenger. If the sleepiness level of the fellow passenger identified by the sleepiness identification unit 111a corresponds to the non-awakened state, the pull-in control unit 104a may perform the following.
- the entrainment control unit 104a may perform a set of entrainment stimulations consisting of a plurality of stimulations, and make the first stimulation in one set have a weaker intensity than the subsequent stimulations.
- the drawing-in control unit 104a may perform the following.
- the entrainment control unit 104a performs entrainment stimulation with one stimulation set as one set, and sets the intensity of the stimulation to that of the first stimulation in one set when the fellow passenger's drowsiness level corresponds to the non-awakened state. It should be strength.
- the pull-in control unit 104a determines whether the posture of the fellow passenger identified by the occupant-related state identification unit 101a or the reclining state of the seat is When the effect of the pulling stimulus is estimated to be low, it is preferable not to perform the pulling stimulus for the seat belt worn by the fellow passenger. This is because when the seat back of the seat on which the fellow passenger sits is lying on the floor side for a certain amount or more, there is a high possibility that the retraction stimulus will not be transmitted to the subject even if the seat belt is retracted.
- the state in which the entrainment stimulus effect is estimated to be low may be determined in advance by experiments, simulations, or the like.
- the retraction control unit 104a does not perform the retraction stimulus for the seat belt worn by the fellow passenger, if the degree of urgency is high, the seating of the fellow passenger It is also possible to forcibly raise the sheet to be pulled and then perform the drawing stimulation.
- This configuration may be used only when an electric seat capable of electrically switching the reclining position is employed. According to the above configuration, even if the passenger's posture or the reclining state of the seat is a state in which the effect of the attraction stimulus is estimated to be low, the effect of the attraction stimulus is increased when the degree of urgency is high. becomes possible.
- a case of high urgency includes a case where the driver's drowsiness level does not improve for a certain period of time or longer, a case where the driver's drowsiness is getting worse, and the like.
- the presentation control unit 102a When presenting fellow-passenger-oriented information, the presentation control unit 102a preferably causes the fellow-passenger-oriented information to be presented after the attraction control unit 104a performs the attraction-in stimulus for the fellow-passenger described above. This is because the presentation of information from the presentation device 40 of the vehicle is mainly directed to the driver, and therefore the information for the fellow passenger cannot be conveyed to the fellow passenger only by performing the information for the fellow passenger from the presentation device 40 alone. This is because it is highly unlikely that By presenting the information for the fellow passenger after the attraction stimulus for the fellow passenger is performed, the information for the fellow passenger can be easily conveyed to the fellow passenger.
- the flow of wakefulness maintenance related processing for the driver in the HCU 10a may be the same as that shown in the flowchart of FIG. 5 of the first embodiment.
- the flowchart of FIG. 7 may be configured to start when the presence of a fellow passenger is confirmed in the own vehicle.
- the occupant-related state identifying unit 101a can identify the states of the occupants other than the driver, the presence of the fellow passenger may be confirmed.
- the fact that the function for executing the process related to maintaining wakefulness is turned on also means that the process shown in FIG. It may be configured to be added to the start condition of the flow chart.
- step S21 the drowsiness identification unit 111a identifies the drowsiness level of the driver.
- step S22 if the drowsiness level of the driver is equal to or higher than the second threshold (YES in S22), the process proceeds to step S23. On the other hand, if the drowsiness level of the driver is less than the second threshold, the process proceeds to step S32. For example, sleepiness level 3 is set as the second threshold.
- step S23 if the passenger's posture or seat reclining state specified by the occupant-related state specifying unit 101a is in a state in which it is estimated that the effect of the entrainment stimulus is low (i.e., not subject to stimulus) (YES in S23) ), the process moves to step S24. On the other hand, if the effect of the attraction stimulus is not estimated to be low (NO in S23), the process proceeds to step S26. Whether or not the passenger's posture or seat reclining state identified by the occupant-related state identification unit 101a is a state in which the effect of the attraction stimulus is estimated to be low may be determined by the withdrawal control unit 104a.
- step S24 if the degree of urgency is high (YES in S24), go to step S25. On the other hand, if the degree of urgency is not high (NO in S24), the process proceeds to step S32. Whether or not the degree of urgency is high may be determined by the pull-in control unit 104a.
- step S25 the HCU 10a instructs the seat ECU 20 to raise the seat back of the electric seat on which the fellow passenger sits, and the process proceeds to step S26.
- the reclining position at which the seatback is raised may be a position corresponding to a state in which it is estimated that the pulling stimulus is highly effective.
- step S26 the drowsiness identification unit 111a identifies the fellow passenger's drowsiness level.
- step S27 if the passenger's sleepiness level is 0 (YES in S27), the process proceeds to step S28. On the other hand, if the fellow passenger's drowsiness level is 1 or more and is in a non-awakened state, the process proceeds to step S29.
- step S28 the optimum determination unit 103a determines a pattern in which one stimulus is one set as the pattern of the attraction stimulus, and the process proceeds to step S30.
- the pattern C described above may be determined.
- step S29 the optimum determination unit 103a determines a pattern in which a plurality of stimuli constitutes one set as the pattern of the attraction stimulus, and the process proceeds to step S30.
- the pattern B described above may be determined.
- step S30 the pull-in control unit 104a causes the seat belt worn by the fellow passenger to pull in.
- a drawing stimulus is performed according to the pattern determined at S28 or S29.
- step S31 the presentation control unit 102a causes the presentation device 40 to present information for fellow passengers.
- step S32 if it is time to end the wakefulness maintenance related process (YES in S32), the wakefulness maintenance related process ends. On the other hand, if it is not the end timing of the wakefulness maintenance related process (NO in S32), the process returns to S21 and repeats the process.
- An example of the termination timing of the wakefulness maintenance related process is that the power switch of the host vehicle is turned off, or that the function of executing the wakefulness maintenance related process is switched off.
- the processing of S23 to S25 may be configured to be performed between the processing of S28, S29 and S30. Further, in the flowchart of FIG. 7, if the seat on which the fellow passenger is seated is not an electric seat, the processing of S24 to S25 may be omitted, and if YES in S23, the process may proceed to S32. In this case, the presentation control unit 102a may present the information for the fellow passenger without performing the pull-in stimulation of the seat belt worn by the fellow passenger. Further, in the case of NO in S24, the presentation control unit 102a may present the information for the fellow passenger without performing the pull-in stimulation of the seat belt worn by the fellow passenger.
- the following may be performed once the process of presenting the information for the fellow passenger after performing the pull-in stimulation of the seat belt worn by the fellow passenger. For example, until the drowsiness level of the driver becomes less than the second threshold, the information for the fellow passenger may be presented, but the pull-in stimulation of the seat belt worn by the fellow passenger may not be performed. According to this, it is possible to reduce the annoyance of a fellow passenger who notices the fellow-passenger-oriented information by the attracting-in stimulus, and to receive the fellow-passenger-oriented information even after the fellow-passenger has noticed the fellow-passenger-oriented information.
- the attraction control unit 104a notifies the fellow passenger that the drowsiness level of the driver does not fall below the second threshold value within a certain period of time after the stimulation, even though the driver is caused to perform the attraction stimulation. It may be a condition for stimulating.
- the fixed period referred to here may be set arbitrarily. According to this, even when the drowsiness level of the driver improves to less than the second threshold value due to the attraction stimulus, it is possible to reduce the troublesomeness and waste of having the fellow passenger perform the attraction stimulus.
- the drowsiness level wakes up even with the cooperation of the passenger.
- the degree of power it is possible to provide the passenger with an entrainment stimulus to obtain the cooperation of the passenger in improving the drowsiness of the driver.
- the slackness specifying unit 112 and the physique specifying unit 113 do not specify the slackness of the seat belt and the physique of the fellow passenger, but this is not necessarily the case.
- the slackness specifying unit 112 and the physique specifying unit 113 may also be configured to specify the slackness of the seat belt and the physique of the fellow passenger.
- the optimum determining unit 103a may determine the strength of the attraction stimulus for the fellow passenger according to the slackness of the seat belt and the physique of the fellow passenger, similarly to the optimum deciding unit 103 of the first embodiment.
- the pull-in control unit 104a may change the strength of the pull-in stimulus for the fellow passenger according to the slackness of the seat belt and the physique of the fellow passenger.
- Embodiment 3 In the above-described embodiment, the configuration for identifying the looseness of the seat belt using the result detected by the indoor camera 30 is shown, but the configuration is not necessarily limited to this. For example, the configuration of Embodiment 3 below may be used. An example of the third embodiment will be described below with reference to the drawings.
- the wakefulness maintenance system 1b of Embodiment 3 is used in a vehicle.
- the wakefulness maintenance system 1b includes an HCU 10b, a seat ECU 20, an indoor camera 30, a presentation device 40, a seatbelt actuator 50, a seatbelt sensor 60, and a pressure sensor 70, as shown in FIG.
- the wakefulness-maintaining system 1b is similar to the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10b instead of the HCU 10 and that it includes a pressure sensor .
- the pressure sensor 70 is provided on the side of the seat belt that contacts the occupant when the seat belt is worn. As a result, the pressure sensor 70 outputs a pressure value corresponding to the looseness of the seat belt when the occupant wears the seat belt.
- the pressure-sensitive sensor 70 is provided on the seat belt of the seat on which the occupant who is the object of the pulling stimulus sits. The pressure value detected by the pressure sensor 70 may be output to the HCU 10b.
- the HCU 10b includes an occupant-related state identification unit 101b, a presentation control unit 102, an optimum determination unit 103b, and a pull-in control unit 104 as functional blocks.
- the HCU 10b is the same as the HCU 10 of the first embodiment, except that it includes an occupant-related state identification unit 101b and an optimum determination unit 103b instead of the occupant-related state identification unit 101 and the optimum determination unit 103.
- This HCU 10b also corresponds to a wakefulness maintenance device. Execution of the process of each functional block of the HCU 10b by the computer corresponds to execution of the wakefulness maintaining method.
- the occupant-related state identification unit 101b is the same as the occupant-related state identification unit 101 of the first embodiment, except that some processing is different.
- the processing in the occupant-related state identification section 101b also corresponds to the occupant-related state identification step.
- the occupant-related state identification unit 101b has a drowsiness identification unit 111 and a slackness identification unit 112b as sub-functional blocks.
- the occupant-related condition identification unit 101b has the occupant-related condition identification unit 101b of the first embodiment, except that it has a slackness identification unit 112a instead of the slackness identification unit 112 and that it does not have the physique identification unit 113. It is similar to the state identification unit 101 .
- the slackness specifying unit 112b uses the result detected by the pressure sensor 70 to specify the slackness of the seat belt. Based on the pressure value detected by the pressure sensor 70, the slackness specifying unit 112b utilizes the relationship that the pressure value detected by the pressure sensor 70 decreases as the slackness of the seat belt increases. , the slackness of the seat belt should be specified.
- the degree of slackness of the seat belt may be specified by classifying it into three or more levels, or by classifying it into two levels, that is, looseness and not slackness. In the case of classifying into two stages of loosening and not loosening and specifying, it is possible to classify and specify whether the pressure value is equal to or less than the threshold value for this class.
- the optimal determination unit 103b uses the slackness specified by the slackness specifying unit 112b instead of the slackness specified by the slackness specifying unit 112, and does not use the physique of the occupant specified by the physique specifying unit 113. Except for this, it is the same as the optimum determining unit 103 of the first embodiment.
- the optimum determining unit 103b determines a higher strength of the pulling stimulus for the seat belt as the degree of slackness of the seat belt specified by the slackness specifying unit 112b increases.
- the configuration of the third embodiment and the configuration of the second embodiment may be combined. Even with the configuration of the third embodiment, the strength of the retraction stimulus is changed according to the degree of looseness of the seat belt worn by the occupant. , it becomes possible to make it a more appropriate stimulus for the occupant.
- Embodiment 4 As a configuration for specifying the looseness of the seat belt, for example, the configuration of the following embodiment 4 may be used. An example of the fourth embodiment will be described below with reference to the drawings.
- the wakefulness-maintaining system 1 of Embodiment 4 is the same as the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10c instead of the HCU 10.
- FIG. 10c The wakefulness-maintaining system 1 of Embodiment 4 is the same as the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10c instead of the HCU 10.
- the HCU 10c includes an occupant-related state identification unit 101c, a presentation control unit 102, an optimum determination unit 103c, a pull-in control unit 104, and a current monitor unit 105 as functional blocks.
- the HCU 10c is similar to that of the first embodiment, except that it includes an occupant-related state identification unit 101c and an optimum determination unit 103c instead of the occupant-related state identification unit 101 and the optimum determination unit 103, and a current monitor unit 105. It is the same as HCU10.
- This HCU 10c also corresponds to a wakefulness maintenance device. Execution of the process of each functional block of the HCU 10c by the computer corresponds to execution of the wakefulness maintaining method.
- the current monitor unit 105 acquires the motor current value of the seatbelt actuator 50 .
- the occupant-related state identification unit 101c is the same as the occupant-related state identification unit 101 of the first embodiment, except that some processing is different. The processing in the occupant-related state identification unit 101c also corresponds to the occupant-related state identification step.
- the occupant-related state identification unit 101c has a drowsiness identification unit 111 and a slackness identification unit 112c as sub-functional blocks.
- the occupant-related state identification unit 101c has the occupant-related state identification unit 101c of the first embodiment, except that it has the slackness identification unit 112c instead of the slackness identification unit 112 and that it does not have the physique identification unit 113. It is similar to the state identification unit 101 .
- the looseness specifying unit 112c uses the motor current value acquired by the current monitor unit 105 to specify the looseness of the seat belt.
- the slackness specifying unit 112c uses the relationship that the motor current value acquired by the current monitor unit 105 decreases as the slackness of the seat belt increases. From the value, the slackness of the seat belt can be identified. For example, when the drowsiness of the driver is greater than or equal to the first threshold, the looseness specifying unit 112c periodically energizes the seatbelt actuator 50 to wind the seatbelt, and adjusts the motor current value of the seatbelt actuator 50 to You should get it. After the motor current value is acquired, the seat belt actuator 50 may return the seat belt retraction amount to the amount before the motor current value was acquired.
- LL in FIG. 11 indicates an example in which the degree of looseness of the seat belt is large.
- SL in FIG. 11 indicates an example in which the looseness of the seat belt is small.
- t(s) in FIG. 11 be the masking time required to identify the degree of looseness.
- M(A) in FIG. 11 is the threshold value of the motor current. The energization of the seatbelt actuator 50 may be continued until the motor current exceeds the threshold value M(A) after the masking time t(s) has elapsed. This should prevent the seat belt from being wound too much.
- the motor current value of the seat belt actuator 50 is output at a lower value as the degree of looseness of the seat belt increases.
- the slackness of the seat belt specified by the slackness specifying unit 112c may be specified by classifying it into three or more stages, or it may be specified by classifying it into two stages, i.e., loose and not loose. good. In the case of classifying into two stages of loosening and not loosening and specifying, it is possible to classify and specify whether the pressure value is equal to or less than the threshold value for this class.
- Optimal determination section 103b uses the degree of slackness identified by slackness identification section 112c instead of the degree of slackness identified by slackness identification section 112, and does not use the physique of the occupant identified by physique identification section 113. Except for this, it is the same as the optimum determining unit 103 of the first embodiment.
- the optimum determining unit 103c determines a higher strength of the pulling stimulus for the seat belt as the degree of slackness of the seat belt specified by the slackness specifying unit 112c increases.
- the configuration of the fourth embodiment and the configuration of the second embodiment may be combined. Even with the configuration of Embodiment 4, the strength of the retraction stimulus is changed according to the degree of looseness of the seat belt worn by the occupant. , it becomes possible to make it a more appropriate stimulus for the occupant.
- the HCUs 10, 10a, 10b, and 10c are responsible for the wakefulness maintenance related process, but this is not necessarily the case.
- the HCUs 10, 10a, 10b, and 10c and another ECU may be responsible for the wakefulness maintenance related process, or the other ECU may be responsible for the wakefulness maintenance related process.
- the wakefulness maintenance systems 1 and 1b are used in automobiles in the above-described embodiments, the configuration is not necessarily limited to this.
- the wakefulness maintenance systems 1 and 1b can be used in various moving bodies as long as they use seat belts.
- controller and techniques described in this disclosure may also be implemented by a special purpose computer comprising a processor programmed to perform one or more functions embodied by a computer program.
- the apparatus and techniques described in this disclosure may be implemented by dedicated hardware logic circuitry.
- the apparatus and techniques described in this disclosure may be implemented by one or more special purpose computers configured in combination with a processor executing a computer program and one or more hardware logic circuits.
- the computer program may also be stored as computer-executable instructions on a computer-readable non-transitional tangible recording medium.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- Medical Informatics (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Educational Technology (AREA)
- Developmental Disabilities (AREA)
- Biophysics (AREA)
- Child & Adolescent Psychology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Hospice & Palliative Care (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Mechanical Engineering (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The present invention comprises: an occupant-related state identification unit (101) that identifies an occupant-related state, which is related to an occupant of a vehicle and includes at least the degree of drowsiness of the occupant; and a pulling control unit (104) that, if the degree of drowsiness of the occupant identified by a drowsiness identification unit (111) in the occupant-related state identification unit (101) is greater than or equal to a first threshold, causes a pulling stimulation that is generated by pulling the seat belt worn by the occupant. The pulling control unit (104) changes the mode of pulling stimulation in accordance with the occupant-related state identified by the occupant-related state identification unit (101).
Description
この出願は、2021年7月5日に日本に出願された特許出願第2021-111687号を基礎としており、基礎の出願の内容を、全体的に、参照により援用している。
This application is based on Patent Application No. 2021-111687 filed in Japan on July 5, 2021, and the content of the underlying application is incorporated by reference in its entirety.
本開示は、覚醒維持装置及び覚醒維持方法に関するものである。
The present disclosure relates to a wakefulness maintenance device and a wakefulness maintenance method.
特許文献1には、覚醒を促すためのアクチュエーションを行う手段として、シートベルトを引き込む手段が開示されている。
Patent Document 1 discloses a means for retracting a seat belt as a means for performing an actuation to encourage awakening.
しかしながら、特許文献1では、シートベルトを引き込むことで覚醒を促すことまでしか考慮されていない。シートベルトを同じように引き込んだとしても、シートベルトの状態,対象者の状態によっては、適切な刺激にならないことが考えられる。よって、特許文献1に開示の技術には、シートベルトの引き込みによる覚醒維持の刺激が対象者にとって適切な刺激にならないおそれがあった。
However, in Patent Document 1, only the pulling in of the seat belt is taken into consideration to promote wakefulness. Even if the seat belt is retracted in the same way, it may not be an appropriate stimulus depending on the condition of the seat belt and the condition of the subject. Therefore, in the technology disclosed in Patent Literature 1, there is a risk that the stimulus to maintain wakefulness by pulling in the seat belt may not be an appropriate stimulus for the subject.
この開示のひとつの目的は、シートベルトの引き込みによる覚醒維持の刺激を対象者にとってより適切な刺激にすることを可能にする覚醒維持装置及び覚醒維持方法を提供することにある。
One object of this disclosure is to provide a wakefulness maintenance device and wakefulness maintenance method that make it possible to make the wakefulness maintenance stimulus by pulling in the seat belt a more appropriate stimulus for the subject.
上記目的は独立請求項に記載の特徴の組み合わせにより達成され、また、下位請求項は、開示の更なる有利な具体例を規定する。請求の範囲に記載した括弧内の符号は、一つの態様として後述する実施形態に記載の具体的手段との対応関係を示すものであって、本開示の技術的範囲を限定するものではない。
The above object is achieved by the combination of features described in the independent claims, and the subclaims define further advantageous embodiments of the disclosure. Reference numerals in parentheses in the claims indicate corresponding relationships with specific means described in embodiments described later as one mode, and do not limit the technical scope of the present disclosure.
上記目的を達成するために、本開示の覚醒維持装置は、車両で用いることが可能な覚醒維持装置であって、少なくとも車両の乗員の眠気の度合いを含む、乗員に関連する状態である乗員関連状態を特定する乗員関連状態特定部と、乗員関連状態特定部で特定する乗員の眠気の度合いが第1の閾値以上であることをもとに、その乗員の装着するシートベルトの引き込みによる刺激である引き込み刺激を行わせる引き込み制御部とを備え、引き込み制御部は、乗員関連状態特定部で特定する乗員関連状態に応じて、引き込み刺激の態様を変化させる。
To achieve the above object, a wakefulness maintenance device of the present disclosure is a wakefulness maintenance device that can be used in a vehicle. Based on the occupant-related state identification unit that identifies the state and the degree of drowsiness of the occupant identified by the occupant-related state identification unit that is equal to or greater than the first threshold, a stimulus is generated by pulling in the seat belt worn by the occupant. and an attraction control unit for performing a certain attraction stimulation, the attraction control unit changing the manner of the attraction stimulation according to the occupant-related state specified by the occupant-related state specifying unit.
上記目的を達成するために、本開示の覚醒維持方法は、車両で用いることが可能な覚醒維持方法であって、少なくとも1つのプロセッサにより実行される、少なくとも車両の乗員の眠気の度合いを含む、乗員に関連する状態である乗員関連状態を特定する乗員関連状態特定工程と、乗員関連状態特定工程で特定した乗員の眠気の度合いが所定の閾値以上であることをもとに、その乗員の装着するシートベルトの引き込みによる刺激である引き込み刺激を行わせる引き込み制御工程とを含み、引き込み制御工程では、乗員関連状態特定工程で特定した乗員関連状態に応じて、引き込み刺激の態様を変化させる。
To achieve the above object, a wakefulness maintenance method of the present disclosure is a wakefulness maintenance method that can be used in a vehicle, comprising: An occupant-related state identification step of identifying an occupant-related state, which is a state related to the occupant, and based on the fact that the degree of drowsiness of the occupant identified in the occupant-related state identification step is equal to or greater than a predetermined threshold, a pull-in control step for performing a pull-in stimulus, which is a stimulus due to pull-in of the seat belt, and in the pull-in control step, the mode of the pull-in stimulus is changed according to the occupant-related state specified in the occupant-related state specifying step.
これらによれば、乗員の眠気の度合いが所定の閾値以上であることをもとに、その乗員の装着するシートベルトの引き込みによる刺激である引き込み刺激を行わせるので、引き込み刺激によって覚醒維持が可能になる。また、乗員に関連する状態である乗員関連状態に応じて、引き込み刺激の態様を変化させるので、乗員関連状態にかかわらず引き込み刺激の態様を変化させない場合に比べ、対象者にとってより適切な刺激にすることが可能になる。その結果、シートベルトの引き込みによる覚醒維持の刺激を対象者にとってより適切な刺激にすることが可能になる。
According to these, based on the fact that the occupant's degree of drowsiness is equal to or higher than a predetermined threshold, the occupant's withdrawal stimulation, which is a stimulation caused by the withdrawal of the seat belt worn by the occupant, is performed, so it is possible to maintain wakefulness by the withdrawal stimulation. become. In addition, since the mode of the attraction stimulus is changed according to the occupant-related state, which is a state related to the occupant, the stimulus is more suitable for the subject than when the mode of the attraction stimulus is not changed regardless of the occupant-related state. it becomes possible to As a result, it is possible to make the stimulus for maintaining wakefulness by retracting the seat belt more suitable for the subject.
図面を参照しながら、開示のための複数の実施形態を説明する。なお、説明の便宜上、複数の実施形態の間において、それまでの説明に用いた図に示した部分と同一の機能を有する部分については、同一の符号を付し、その説明を省略する場合がある。同一の符号を付した部分については、他の実施形態における説明を参照することができる。
A plurality of embodiments for disclosure will be described with reference to the drawings. For convenience of explanation, in some embodiments, parts having the same functions as the parts shown in the drawings used in the explanation so far are denoted by the same reference numerals, and the explanation thereof may be omitted. be. The description in the other embodiments can be referred to for the parts with the same reference numerals.
(実施形態1)
<覚醒維持システム1の概略構成>
以下、本実施形態について図面を用いて説明する。図1に示す覚醒維持システム1は、自動車(以下、単に車両)で用いられるものであり、HCU(Human Machine Interface Control Unit)10、シートECU20、室内カメラ30、提示装置40、シートベルトアクチュエータ50、及びシートベルトセンサ60を含んでいる。例えばHCU10、シートECU20、及びシートベルトセンサ60は、車内LAN(図1のLAN参照)と接続される構成とすればよい。覚醒維持システム1を用いる車両は、シートベルトを用いる車両であれば、必ずしも自動車に限るものではないが、以下では自動車に用いる場合を例に挙げて説明を行う。覚醒維持システム1を搭載している車両を以降では自車と呼ぶ。 (Embodiment 1)
<Schematic configuration ofwakefulness maintenance system 1>
Hereinafter, this embodiment will be described with reference to the drawings. Awakefulness maintenance system 1 shown in FIG. 1 is used in an automobile (hereinafter simply referred to as a vehicle) and includes an HCU (Human Machine Interface Control Unit) 10, a seat ECU 20, an indoor camera 30, a display device 40, a seatbelt actuator 50, and a seat belt sensor 60 . For example, the HCU 10, the seat ECU 20, and the seat belt sensor 60 may be configured to be connected to an in-vehicle LAN (see LAN in FIG. 1). A vehicle using the wakefulness maintenance system 1 is not necessarily limited to an automobile as long as it uses a seat belt. A vehicle equipped with the wakefulness maintenance system 1 is hereinafter referred to as an own vehicle.
<覚醒維持システム1の概略構成>
以下、本実施形態について図面を用いて説明する。図1に示す覚醒維持システム1は、自動車(以下、単に車両)で用いられるものであり、HCU(Human Machine Interface Control Unit)10、シートECU20、室内カメラ30、提示装置40、シートベルトアクチュエータ50、及びシートベルトセンサ60を含んでいる。例えばHCU10、シートECU20、及びシートベルトセンサ60は、車内LAN(図1のLAN参照)と接続される構成とすればよい。覚醒維持システム1を用いる車両は、シートベルトを用いる車両であれば、必ずしも自動車に限るものではないが、以下では自動車に用いる場合を例に挙げて説明を行う。覚醒維持システム1を搭載している車両を以降では自車と呼ぶ。 (Embodiment 1)
<Schematic configuration of
Hereinafter, this embodiment will be described with reference to the drawings. A
シートECU20は、自車の座席のシート位置の調整といったシート環境についての制御を行う電子制御装置である。例えば、シートECU20は、自車のシート位置を調整するためのモータ(以下、シートモータ)を制御することでシート位置を調整する。シートモータとしては、スライド位置を調整するスライドモータ,リクライニング位置を調整するリクライニングモータが挙げられる。スライド位置とは、自車の前後方向に対するシートの調整位置を示す。リクライニング位置とは、シートバックの傾きの調整角度を示す。シートバックは、背もたれ部に相当する。スライド位置及びリクライニング位置の調整は、乗員からの設定入力に応じて行えばよい。乗員からの設定入力は、例えばスイッチ等を介して受け付ければよい。また、シートECU20は、スライド位置及びリクライニング位置を逐次検出する。スライド位置については、例えばスライドモータの回転角から検出すればよい。リクライニング位置については、リクライニングモータの回転角から検出すればよい。
The seat ECU 20 is an electronic control unit that controls the seat environment, such as adjusting the seat position of the seat of the vehicle. For example, the seat ECU 20 adjusts the seat position by controlling a motor for adjusting the seat position of the vehicle (hereinafter referred to as a seat motor). Seat motors include a slide motor for adjusting the slide position and a reclining motor for adjusting the reclining position. The slide position indicates the adjusted position of the seat with respect to the longitudinal direction of the vehicle. The reclining position indicates the adjustment angle of the inclination of the seat back. The seat back corresponds to the backrest portion. Adjustment of the slide position and the reclining position may be performed according to the setting input from the occupant. A setting input from a passenger may be received via a switch or the like, for example. Also, the seat ECU 20 sequentially detects the slide position and the reclining position. The slide position may be detected, for example, from the rotation angle of the slide motor. The reclining position can be detected from the rotation angle of the reclining motor.
本実施形態では、スライド位置及びリクライニング位置が電動で調整可能な場合を例に挙げて説明するが、必ずしもこれに限らない。例えば、スライド位置及びリクライニング位置の一部若しくは全部が、電動で調整可能でなく、手動で調整が必要な構成であってもよい。スライド位置が電動で調整可能でない場合、スライド位置は、スライド位置を検出するセンサによって検出すればよい。リクライニング位置が電動で調整可能でない場合、リクライニング位置は、リクライニング位置を検出するセンサによって検出すればよい。
In this embodiment, a case in which the slide position and the reclining position are electrically adjustable will be described as an example, but this is not necessarily the case. For example, some or all of the slide position and reclining position may not be electrically adjustable and may require manual adjustment. If the slide position is not electrically adjustable, the slide position may be detected by a sensor that detects the slide position. If the reclining position is not electrically adjustable, the reclining position may be detected by a sensor that detects the reclining position.
室内カメラ30は、自車の車室内の所定範囲を撮像する。室内カメラ30は、少なくとも自車の運転席を含む範囲を撮像するものとする。室内カメラ30は、自車の運転席の他、助手席及び後部座席を含む範囲を撮像してもよい。室内カメラ30としては、複数台のカメラを用い、複数台のカメラで撮像範囲を分担してもよい。室内カメラ30は、例えば近赤外光源及び近赤外カメラと、これらを制御する制御ユニット等とによって構成される。室内カメラ30は、近赤外光源によって近赤外光を照射された乗員を、近赤外カメラによって撮影する。本実施形態では、室内カメラ30は、少なくとも運転席の乗員である運転者を撮影するものとして説明を行う。近赤外カメラによる撮像画像は、制御ユニットによって画像解析される。制御ユニットは、撮像画像を画像解析して抽出した乗員の特徴量をもとに、乗員の瞼の開閉状態,顔向き,視線方向,覚醒度,姿勢等を検出する。覚醒度の検出は、例えば瞼の開閉の度合いによって検出すればよい。
The indoor camera 30 captures an image of a predetermined range inside the vehicle. It is assumed that the indoor camera 30 captures an image of a range including at least the driver's seat of the own vehicle. The indoor camera 30 may capture an image of a range including the driver's seat, the front passenger's seat, and the rear seats of the own vehicle. A plurality of cameras may be used as the indoor camera 30, and the imaging range may be shared by the plurality of cameras. The indoor camera 30 includes, for example, a near-infrared light source, a near-infrared camera, and a control unit for controlling them. The indoor camera 30 captures an image of the occupant irradiated with near-infrared light by the near-infrared light source. In the present embodiment, the indoor camera 30 will be described as capturing an image of at least the driver in the driver's seat. An image captured by the near-infrared camera is image-analyzed by the control unit. The control unit detects the opened/closed state of the occupant's eyelids, face orientation, line-of-sight direction, arousal level, posture, etc., based on the occupant feature amount extracted by image analysis of the captured image. The degree of arousal may be detected by, for example, the degree of opening and closing of the eyelids.
提示装置40は、自車に設けられて、自車の室内に向けて情報提示を行う。提示装置40は、HCU10の指示に従って情報提示を行う。提示装置40は、少なくとも運転者に向けて情報提示を行えばよい。提示装置40は、運転者以外の同乗者にも情報提示を行っても構わない。提示装置40は、表示器41及び音声出力装置42を含む。
The presentation device 40 is installed in the vehicle and presents information to the interior of the vehicle. The presentation device 40 presents information according to instructions from the HCU 10 . The presentation device 40 may present information at least to the driver. The presentation device 40 may present information to fellow passengers other than the driver. The presentation device 40 includes a display 41 and an audio output device 42 .
表示器41は、情報を表示することで情報提示を行う。表示器41としては、例えばメータMID(Multi Information Display),CID(Center Information Display),HUD(Head-Up Display)を用いることができる。メータMIDは、車室内のうちの運転席の正面に設けられる表示装置である。一例として、メータMIDは、メータパネルに設けられる構成とすればよい。CIDは、自車のインスツルメントパネルの中央に配置される表示装置である。HUDは、車室内のうちの例えばインスツルメントパネルに設けられる。HUDは、プロジェクタによって形成される表示像を、投影部材としてのフロントウインドシールドに既定された投影領域に投影する。フロントウインドシールドによって車室内側に反射された画像の光は、運転席に着座するドライバによって知覚される。これにより、ドライバは、フロントウインドシールドの前方にて結像される表示像の虚像を、前景の一部と重ねて視認可能となる。HUDは、フロントウインドシールドの代わりに、運転席の正面に設けられるコンバイナに表示像を投影する構成としてもよい。音声出力装置42は、音声を出力することで情報提示を行う。音声出力装置42としては、スピーカ等が挙げられる。
The display 41 presents information by displaying information. As the display 41, for example, a meter MID (Multi Information Display), CID (Center Information Display), HUD (Head-Up Display) can be used. The meter MID is a display device provided in front of the driver's seat in the passenger compartment. As an example, the meter MID may be configured to be provided on the meter panel. The CID is a display device placed in the center of the instrument panel of the vehicle. The HUD is provided, for example, on an instrument panel inside the vehicle. The HUD projects a display image formed by the projector onto a predetermined projection area on the front windshield as a projection member. The image light reflected by the front windshield to the interior of the vehicle is perceived by the driver seated in the driver's seat. As a result, the driver can visually recognize the virtual image of the display image formed in front of the front windshield overlapping a part of the foreground. The HUD may be configured to project the display image onto a combiner provided in front of the driver's seat instead of the front windshield. The audio output device 42 presents information by outputting audio. A speaker or the like can be used as the audio output device 42 .
シートベルトアクチュエータ50は、自車のシートベルトの送り出し及び巻き取りを行う。シートベルトの巻き取りによって、シートベルトの引き込みが生じる。本実施形態では、シートベルトを装着している乗員に対して、このシートベルトの引き込みによる刺激によって覚醒維持を図る。シートベルトアクチュエータ50は、例えばモータとする。シートベルトアクチュエータ50は、HCU10の指示に従って、自車のシートベルトの送り出し及び巻き取りを行う。シートベルトアクチュエータ50は、少なくとも運転席に設けられる。なお、シートベルトアクチュエータ50は、座席ごとに設けられる構成としてもよい。
The seatbelt actuator 50 feeds and retracts the seatbelt of the vehicle. Retraction of the seat belt causes retraction of the seat belt. In this embodiment, the occupant wearing a seat belt is stimulated by the retraction of the seat belt to keep them awake. The seat belt actuator 50 is, for example, a motor. The seatbelt actuator 50 feeds and retracts the seatbelt of the own vehicle according to instructions from the HCU 10 . The seat belt actuator 50 is provided at least in the driver's seat. Note that the seat belt actuator 50 may be configured to be provided for each seat.
シートベルトセンサ60は、シートベルトアクチュエータ50によるシートベルトの引き出し量を検出するセンサである。例えば、シートベルトセンサ60は、モータとしてのシートベルトアクチュエータ50の回転角度を検出するエンコーダとすればよい。この場合、この回転角度をシートベルトの引き出し量として扱うことにすればよい。
The seatbelt sensor 60 is a sensor that detects the amount of withdrawal of the seatbelt by the seatbelt actuator 50 . For example, the seat belt sensor 60 may be an encoder that detects the rotation angle of the seat belt actuator 50 as a motor. In this case, this rotation angle may be treated as the withdrawal amount of the seat belt.
HCU10は、プロセッサ、メモリ、I/O、これらを接続するバスを備えるマイクロコンピュータを主体として構成される。HCU10は、メモリに記憶された制御プログラムを実行することで自車の乗員の覚醒維持に関する処理(以下、覚醒維持関連処理)等の各種の処理を実行する。このHCU10が覚醒維持装置に相当する。ここで言うところのメモリは、コンピュータによって読み取り可能なプログラム及びデータを非一時的に格納する非遷移的実体的記憶媒体(non- transitory tangible storage medium)である。また、非遷移的実体的記憶媒体は、半導体メモリ又は磁気ディスクなどによって実現される。なお、HCU10の概略構成については以下で述べる。
The HCU 10 is mainly composed of a microcomputer equipped with a processor, memory, I/O, and a bus connecting them. The HCU 10 executes a control program stored in the memory to execute various types of processing such as processing related to keeping the occupants of the own vehicle awake (hereinafter referred to as “wakefulness maintenance related processing”). This HCU 10 corresponds to a wakefulness maintenance device. Memory, as used herein, is a non-transitory tangible storage medium for non-transitory storage of computer-readable programs and data. A non-transitional physical storage medium is implemented by a semiconductor memory, a magnetic disk, or the like. A schematic configuration of the HCU 10 will be described below.
<HCU10の概略構成>
続いて、図2を用いて、HCU10の概略構成について説明を行う。HCU10は、図2に示すように、乗員関連状態特定部101、提示制御部102、最適決定部103、及び引き込み制御部104を機能ブロックとして備える。また、コンピュータによってこれらの機能ブロックの処理が実行されることが、覚醒維持方法が実行されることに相当する。なお、HCU10が実行する機能の一部又は全部を、一つ或いは複数のIC等によりハードウェア的に構成してもよい。また、HCU10が備える機能ブロックの一部又は全部は、プロセッサによるソフトウェアの実行とハードウェア部材の組み合わせによって実現されてもよい。 <Schematic configuration ofHCU 10>
Next, a schematic configuration of theHCU 10 will be described with reference to FIG. 2 . As shown in FIG. 2, the HCU 10 includes an occupant-related state identification unit 101, a presentation control unit 102, an optimum determination unit 103, and a pull-in control unit 104 as functional blocks. Execution of the processing of these functional blocks by the computer corresponds to execution of the wakefulness maintaining method. A part or all of the functions executed by the HCU 10 may be configured as hardware using one or a plurality of ICs or the like. Also, some or all of the functional blocks provided by the HCU 10 may be implemented by a combination of software executed by a processor and hardware members.
続いて、図2を用いて、HCU10の概略構成について説明を行う。HCU10は、図2に示すように、乗員関連状態特定部101、提示制御部102、最適決定部103、及び引き込み制御部104を機能ブロックとして備える。また、コンピュータによってこれらの機能ブロックの処理が実行されることが、覚醒維持方法が実行されることに相当する。なお、HCU10が実行する機能の一部又は全部を、一つ或いは複数のIC等によりハードウェア的に構成してもよい。また、HCU10が備える機能ブロックの一部又は全部は、プロセッサによるソフトウェアの実行とハードウェア部材の組み合わせによって実現されてもよい。 <Schematic configuration of
Next, a schematic configuration of the
乗員関連状態特定部101は、自車の乗員に関連する状態(以下、乗員関連状態)を特定する。この乗員関連状態特定部101での処理が乗員関連状態特定工程に相当する。乗員関連状態特定部101は、眠気特定部111、緩み具合特定部112、及び体格特定部113をサブ機能ブロックとして有している。
The occupant-related state identification unit 101 identifies a state related to the occupants of the own vehicle (hereinafter referred to as occupant-related state). The processing in the occupant-related state identification unit 101 corresponds to the occupant-related state identification step. The occupant-related state identification unit 101 has a drowsiness identification unit 111, a slackness identification unit 112, and a physique identification unit 113 as sub-functional blocks.
眠気特定部111は、自車の乗員の眠気の度合いを特定する。眠気特定部111は、室内カメラ30で検出した覚醒度から眠気の度合いを特定すればよい。なお、室内カメラ30で覚醒度まで検出せずに、室内カメラ30での撮像画像から眠気特定部111で眠気の度合いを特定してもよい。一例として、眠気特定部111は、以下で説明する6段階に区分された眠気レベルを特定する。例えば、眠気レベルの区分は、NEDOの評定方法に従った区分とすればよい。
The drowsiness identification unit 111 identifies the degree of drowsiness of the occupant of the vehicle. The drowsiness identifying unit 111 may identify the degree of drowsiness from the awakening level detected by the indoor camera 30 . Note that the degree of drowsiness may be specified by the drowsiness specifying unit 111 from the image captured by the indoor camera 30 without detecting the awakening level with the indoor camera 30 . As an example, the drowsiness identification unit 111 identifies drowsiness levels classified into six stages described below. For example, sleepiness levels may be classified according to the NEDO evaluation method.
眠気レベル0は、全く眠くなさそう(Not Sleepy)に該当する度合いである。眠気レベル0は覚醒状態と言い換えることができる。眠気レベル0の特徴としては、以下が挙げられる。1つ目は、視線の移動が速く頻繁である。2つ目は、瞬きの周期が安定していることである。3つ目は、身体の動きを伴うことである。眠気レベル1は、やや眠そう(Slightly Sleepy)に該当する度合いである。眠気レベル1以上は非覚醒状態と言い換えることもできる。眠気レベル1の特徴としては、以下が挙げられる。1つ目は、唇が開いていることである。2つ目は、視線の移動が遅いことである。眠気レベル2は、眠そう(Sleepy)に該当する度合いである。眠気レベル2の特徴としては、以下が挙げられる。1つ目は、瞬きがゆっくりで頻発することである。2つ目は、口の動きがあることである。3つ目は、座席での座り直しが見られることである。4つ目は、顔に手をやる仕草が見られることである。眠気レベル2以上と眠気レベル2未満との区分は、対象者が眠気を自覚するか否かの区分と言い換えることもできる。眠気レベル2以上が、対象者が眠気を自覚する区分である。眠気レベル2未満が、対象者が眠気を自覚しない区分である。
A drowsiness level of 0 is the degree of not being sleepy at all (Not Sleepy). Drowsiness level 0 can be rephrased as wakefulness. The characteristics of drowsiness level 0 include the following. First, the movement of the line of sight is fast and frequent. The second is that the cycle of blinking is stable. The third is that it involves physical movement. Sleepiness level 1 is the degree corresponding to Slightly Sleepy. The drowsiness level 1 or more can also be rephrased as a non-awakened state. The characteristics of sleepiness level 1 include the following. The first is that the lips are open. The second is that the movement of the line of sight is slow. Sleepiness level 2 is the degree of sleepiness. The characteristics of drowsiness level 2 include the following. The first is slow and frequent blinking. The second is that there is movement of the mouth. The third is that you can see the re-sitting in the seat. The fourth is that the gesture of putting a hand on the face can be seen. The division between sleepiness level 2 or higher and sleepiness level less than 2 can also be rephrased as a division of whether or not the subject is aware of sleepiness. A drowsiness level of 2 or higher is a category in which the subject perceives drowsiness. A sleepiness level of less than 2 is a category in which the subject does not perceive sleepiness.
眠気レベル3は、かなり眠そう(Rather Sleepy)に該当する度合いである。眠気レベル3の特徴としては、以下が挙げられる。1つ目は、意識的と推測される瞬きがあることである。2つ目は、頭を振る,肩の上下運動等の無用な身体の動きが見られることである。3つ目は、あくびが頻発し、深呼吸も見られることである。4つ目は、瞬きも視線の動きも遅いことである。眠気レベル3以上と眠気レベル3未満との区分は、対象者に警報が必要になるか否かの区分と言い換えることもできる。眠気レベル3以上が、対象者に警報が必要な区分である。眠気レベル3未満が、対象者に警報が必要でない区分である。
Drowsiness level 3 is the degree of rather sleepy. The characteristics of sleepiness level 3 include the following. The first is that there are blinks that are presumed to be conscious. Second, unnecessary body movements such as shaking the head and moving the shoulders up and down are observed. The third is frequent yawning and deep breathing. The fourth is that the blink and the movement of the line of sight are slow. The division between drowsiness level 3 or higher and drowsiness level less than 3 can also be rephrased as a division of whether or not the subject needs to be warned. A sleepiness level of 3 or higher is a category that requires a warning to the subject. A drowsiness level of less than 3 is a category in which the subject does not need to be alerted.
眠気レベル4は、非常に眠そう(Very Sleepy)に該当する度合いである。眠気レベル4の特徴としては、以下が挙げられる。1つ目は、頭が前方に傾くことである。2つ目は、頭が後方に倒れることである。眠気レベル5は、眠っている(Sleeping)に該当する度合いである。眠気レベル5は睡眠状態と言い換えることができる。眠気レベル5の特徴は、瞼を数秒間閉じることである。
Drowsiness level 4 is the degree corresponding to Very Sleepy. The characteristics of drowsiness level 4 include the following. The first is the tilting of the head forward. The second is that the head falls backwards. Sleepiness level 5 is a degree corresponding to sleeping (Sleeping). Drowsiness level 5 can be rephrased as a sleeping state. Drowsiness level 5 is characterized by closing the eyelids for a few seconds.
本実施形態では、眠気の度合いを以上の6つに区分する場合を例に挙げて説明するが、必ずしもこれに限らない。例えば、対象者の警報が必要であるか否かを少なくとも区分する構成としてもよい。また、対象者が眠気を自覚するか否かと、対象者の警報が必要であるか否かとを、少なくとも区分する構成としてもよい。
In this embodiment, the case where the degree of drowsiness is classified into the above six categories will be described as an example, but it is not necessarily limited to this. For example, it may be configured to at least distinguish whether or not the target person needs to be warned. Moreover, it is good also as a structure which distinguishes at least whether a subject is aware of drowsiness, and whether a subject's warning is required.
本実施形態では、対象者の眠気を室内カメラ30での撮像画像をもとに特定する構成を示したが、必ずしもこれに限らない。例えば、対象者の生体情報を計測する生体センサで計測した生体情報をもとに、対象者の眠気を眠気特定部111で特定する構成としてもよい。生体センサは、ステアリングホイール,シート等に設けるといったように自車に設ける構成としてもよい。また、生体センサは、対象者が装着するウェアラブルデバイスに設けられる構成としてもよい。ウェアラブルデバイスに生体センサが設けられている場合には、例えば近距離無線通信を介して、生体センサでの計測結果をHCU10が取得する構成とすればよい。生体センサで計測する生体情報の一例としては、呼吸,脈拍,心拍,皮膚の温度等が挙げられる。
In this embodiment, a configuration is shown in which the drowsiness of the subject is identified based on the image captured by the indoor camera 30, but this is not necessarily the case. For example, the drowsiness identifying unit 111 may identify the subject's drowsiness based on the biological information measured by a biosensor that measures the subject's biological information. The biosensor may be provided in the vehicle, such as in the steering wheel, seat, or the like. Also, the biosensor may be configured to be provided in a wearable device worn by the subject. If the wearable device is provided with a biosensor, the HCU 10 may acquire the measurement result of the biosensor via short-range wireless communication, for example. Examples of biological information measured by a biological sensor include respiration, pulse, heart rate, skin temperature, and the like.
緩み具合特定部112は、自車の乗員の装着するシートベルトの緩み具合を特定する。緩み具合特定部112は、室内カメラ30で検出した結果を用いて、シートベルトの緩み具合を特定すればよい。例えば、緩み具合特定部112は、室内カメラ30で検出した姿勢と、シートECU20から取得するシートのスライド位置とから、シートベルトの緩み具合を特定すればよい。具体例としては、対象者の頭部の位置とその対象者の着座するシートのスライド位置との自車の前後方向における乖離が大きくなるのに応じて、シートベルトの緩み具合を大きく特定すればよい。これは、シートのスライド位置に対して乗員が前のめりになっているほどシートベルトが緩んでいる可能性が高いためである。緩み具合特定部112は、シートベルトの緩み具合を、緩んでいると緩んでいないとの2段階に区分して特定しても構わない。他にも、緩み具合特定部112は、シートベルトを手で緩める動きを検出した場合には、シートベルトの緩み具合として、緩んでいると緩んでいないとの2段階のうちの緩んでいると特定すればよい。なお、乗員の姿勢,動きは、室内カメラ30での撮像画像をもとに乗員関連状態特定部101で特定する構成としてもよい。
The slackness specifying unit 112 specifies the slackness of the seat belt worn by the occupant of the vehicle. The slackness identifying unit 112 may identify the slackness of the seat belt using the results detected by the indoor camera 30 . For example, the slackness specifying unit 112 may specify the slackness of the seat belt from the posture detected by the indoor camera 30 and the seat slide position acquired from the seat ECU 20 . As a specific example, if the slackness of the seat belt is greatly specified as the divergence in the longitudinal direction of the own vehicle between the position of the subject's head and the sliding position of the seat on which the subject is seated increases. good. This is because the more the occupant leans forward with respect to the sliding position of the seat, the more likely the seat belt is loosened. The slackness identifying unit 112 may classify the slackness of the seat belt into two stages, i.e., slackness and not slackness. In addition, when the slackness identification unit 112 detects a motion of loosening the seat belt by hand, the slackness degree of the seat belt is determined to be one of two levels: loose and not loose. should be specified. The posture and movement of the occupant may be identified by the occupant-related state identification unit 101 based on the image captured by the indoor camera 30 .
体格特定部113は、室内カメラ30での撮像画像を画像認識することで、乗員の体格を特定する。例えば、乗員の胴体の横幅,肩幅等を体格として特定すればよい。体格特定部113では、個々の乗員を顔認証等によって個人認証し、乗員別に薄着時の体格をHCU10の不揮発性メモリに格納する構成とすればよい。薄着時の体格については、同一の乗員について、より小さく特定された体格を上書きして不揮発性メモリに残すことで、乗員別の薄着時の体格を格納すればよい。これは、同一の乗員であれば、体格がより小さく特定されるほど薄着であると推定されるためである。
The physique identifying unit 113 identifies the physique of the occupant by recognizing the image captured by the indoor camera 30 . For example, the width of the occupant's torso, the width of the shoulders, etc. may be specified as the physique. The physique identifying unit 113 may be configured to authenticate each passenger by face authentication or the like, and store the physique of each crew member when he/she wears light clothing in the non-volatile memory of the HCU 10 . As for the physique when wearing light clothes, the physique when wearing light clothes for each passenger may be stored by overwriting the physique specified as smaller for the same passenger and leaving it in the non-volatile memory. This is because it is presumed that the smaller the physique is identified, the lighter the occupant is wearing.
提示制御部102は、提示装置40から情報を提示させる。一例として、提示制御部102は、眠気特定部111で特定した眠気レベルが3以上である場合に、提示装置40から警報を行わせればよい。例えば、表示器41に警告を表示させればよい。他にも、音声出力装置42から警告音,警告音声を出力させればよい。
The presentation control unit 102 causes the presentation device 40 to present information. As an example, the presentation control unit 102 may cause the presentation device 40 to issue an alarm when the drowsiness level specified by the drowsiness specifying unit 111 is 3 or higher. For example, a warning may be displayed on the display 41 . Alternatively, a warning sound or warning voice may be output from the voice output device 42 .
最適決定部103は、乗員関連状態特定部101で特定する乗員関連状態に応じて、シートベルトの引き込みによる刺激(以下、引き込み刺激)の態様を決定する。最適決定部103は、眠気特定部111で特定する乗員の眠気の度合いに応じて、引き込み刺激の態様として、引き込み刺激の強度及びパターンの少なくともいずれかを決定することが好ましい。本実施形態では、引き込み刺激は、複数回の刺激が1セットであるものとする。1セット内での1回目の刺激を先発刺激と呼ぶ。1セット内での2回目以降の刺激を後発刺激と呼ぶ。先発刺激は、後発刺激よりも弱い強度の刺激とすることが好ましい。これは、対象者が運転者の場合に、運転者を驚かせて運転に支障が生じる状況を生じにくくさせるためである。以下では、引き込み刺激が2回の刺激が1セットである例を挙げて説明する。また、刺激の強度の高低は、1つの刺激の継続時間の長短で表現してもよいし、シートベルトの引き込みの速度で表現してもよい。他にも、刺激の強度の高低は、シートベルトの引き込み量で表現してもよい。
The optimum determination unit 103 determines the mode of stimulation by retraction of the seat belt (hereinafter referred to as retraction stimulation) according to the occupant-related state identified by the occupant-related state identification unit 101 . It is preferable that the optimum determination unit 103 determines at least one of the intensity and pattern of the attraction stimulation as the aspect of the attraction stimulation according to the degree of drowsiness of the occupant identified by the drowsiness identification unit 111 . In this embodiment, it is assumed that one set of the entrainment stimulus is a plurality of stimuli. The first stimulation within one set is called the starting stimulation. The second and subsequent stimulations within one set are called subsequent stimulations. It is preferable that the initial stimulus has a weaker intensity than the subsequent stimulus. This is to make it less likely that a situation in which the target person is a driver will startle the driver and hinder driving. In the following, an example will be described in which the attraction stimulus is two times and the stimulus is one set. Moreover, the level of intensity of stimulus may be expressed by the length of duration of one stimulus or by the speed of retraction of the seat belt. Alternatively, the intensity of the stimulus may be expressed by the retraction amount of the seat belt.
最適決定部103は、眠気特定部111で特定する乗員の眠気レベルが高くなるのに応じて、引き込み刺激の1セット内での刺激の間隔を短くさせるように、引き込み刺激のパターンを決定することが好ましい。これは、1セット内での複数の刺激の間隔が短くなるのに応じて、警告感が伝わりやすくなるためである。
The optimum determination unit 103 determines the pattern of the attraction stimulus so that the interval between stimulations in one set of the attraction stimulation becomes shorter as the drowsiness level of the occupant identified by the drowsiness identification unit 111 increases. is preferred. This is because the shorter the intervals between a plurality of stimulations in one set, the easier it is for a sense of warning to be conveyed.
ここで、図3を用いて、乗員の眠気レベルが高くなるのに応じて引き込み刺激の1セット内での刺激の間隔を短くさせる例を示す。図3のグラフの縦軸が刺激の有無を示している。具体的には、0が刺激なし、1が刺激ありを示している。図3の横軸がミリ秒(ms)単位の時間を示している。図3のFが先発刺激を示している。図3のSが後発刺激を示している。図3のF+Sが1セットの刺激を示している。
Here, using FIG. 3, an example is shown in which the interval between stimulations within one set of attraction stimulations is shortened as the drowsiness level of the occupant increases. The vertical axis of the graph in FIG. 3 indicates the presence or absence of stimulation. Specifically, 0 indicates no stimulation, and 1 indicates the presence of stimulation. The horizontal axis of FIG. 3 indicates time in milliseconds (ms). F in FIG. 3 indicates the starting stimulus. S in FIG. 3 indicates the subsequent stimulation. F+S in FIG. 3 represents one set of stimuli.
図3に示すように、例えば、眠気レベル2の場合よりも眠気レベル3の場合の1セット内での刺激の間隔を短くさせればよい。これは、眠気レベル2の場合は、対象者が眠気を感じているが警報が必要なレベルに達していないため、眠気レベル3の場合に比べ、警告を伝える必要性が低いためである。一例としては、眠気レベル2の場合は、1セット内での刺激の間隔を500ms以上とすればよい。眠気レベル3の場合は、1セット内での刺激の間隔を100ms以上500ms未満とすればよい。1セット内での刺激の間隔を100ms以上とするのは、対象者が1セット内の2回の刺激を区別して認識できるようにするためである。以降では、眠気レベル3の場合のこのパターンをパターンA,眠気レベル2の場合のこのパターンをパターンBと呼ぶ。図3の例では、先発刺激の継続時間が、後発刺激の継続時間よりも短い、後発刺激よりも強度の弱い刺激となっている。
As shown in FIG. 3, for example, the interval between stimulations in one set at drowsiness level 3 may be made shorter than that at drowsiness level 2. This is because at drowsiness level 2, the target person feels drowsiness but has not yet reached a level at which a warning is necessary, so the need to issue a warning is lower than at drowsiness level 3. For example, in the case of drowsiness level 2, the stimulation interval in one set should be 500 ms or longer. In the case of drowsiness level 3, the stimulation interval in one set should be 100 ms or more and less than 500 ms. The reason why the interval between stimulations in one set is set to 100 ms or longer is to allow the subject to distinguish and recognize two stimulations in one set. Hereinafter, this pattern for drowsiness level 3 is called pattern A, and this pattern for drowsiness level 2 is called pattern B. In the example of FIG. 3, the duration of the initial stimulus is shorter than the duration of the subsequent stimulus and is weaker in intensity than the subsequent stimulus.
最適決定部103は、眠気特定部111で特定する乗員の眠気の度合いが高くなるのに応じて、引き込み刺激の1セットごとの刺激の頻度を高くさせるように、引き込み刺激のパターンを決定することが好ましい。これは、1セットごとの刺激の頻度が高くなるのに応じて、警告感が伝わりやすくなるためである。
The optimal determination unit 103 determines the pattern of the attraction stimulus so that the frequency of each set of the attraction stimulus increases as the degree of drowsiness of the occupant identified by the drowsiness identification unit 111 increases. is preferred. This is because the higher the frequency of stimulation for each set, the easier it is for a sense of warning to be conveyed.
ここで、図4を用いて、乗員の眠気レベルが高くなるのに応じて引き込み刺激の1セットごとの刺激の頻度を高くさせる例を示す。図4のグラフの縦軸が刺激の有無を示している。具体的には、0が刺激なし、1が刺激ありを示している。図4の横軸が秒(s)単位の時間を示している。図4のF+Sが1セットの刺激を示している。
Here, using FIG. 4, an example is shown in which the frequency of each set of entrainment stimuli is increased as the drowsiness level of the occupant increases. The vertical axis of the graph in FIG. 4 indicates the presence or absence of stimulation. Specifically, 0 indicates no stimulation, and 1 indicates the presence of stimulation. The horizontal axis of FIG. 4 indicates time in seconds (s). F+S in FIG. 4 represents one set of stimuli.
図4に示すように、例えば、眠気レベル2の場合よりも眠気レベル3の場合の1セットごとの刺激の頻度を高くさせればよい。これは、眠気レベル2の場合は、眠気レベル3の場合に比べ、警告を伝える必要性が低く、煩わしさを抑えることを優先することが好ましいためである。一例としては、眠気レベル2の場合は、パターンBとして、1セットごとの刺激の頻度を1000~120sにつき1セットの刺激とすればよい。眠気レベル3の場合は、パターンAとして、1セットごとの刺激の頻度を80~100sについて1セットの刺激とすればよい。
As shown in FIG. 4, for example, the frequency of stimulation for each set at sleepiness level 3 may be set higher than that at sleepiness level 2. This is because in the case of drowsiness level 2, it is less necessary to give a warning than in the case of drowsiness level 3, and it is preferable to give priority to suppressing annoyance. As an example, in the case of drowsiness level 2, as pattern B, the frequency of stimulation for each set may be one set per 1000 to 120 seconds. In the case of drowsiness level 3, as pattern A, the frequency of stimulation for each set should be one set for 80 to 100 seconds.
最適決定部103は、緩み具合特定部112で特定するシートベルトの緩み具合が大きくなるのに応じて、そのシートベルトについての引き込み刺激の強度を高く決定することが好ましい。これは、シートベルトの緩み具合が大きいほど、引き込み刺激が対象者に伝わりにくいためである。一例として、最適決定部103では、引き込み刺激の強度として、シートベルトの目標とする引き込み量(以下、目標引き込み量)を決定すればよい。最適決定部103は、引き込み刺激の強度として、複数段階に区分された指標(以下、強度レベル)を特定してもよい。
It is preferable that the optimum determination unit 103 determines a higher strength of the pulling stimulus for the seat belt as the looseness of the seat belt specified by the looseness specifying unit 112 increases. This is because the greater the slackness of the seat belt, the more difficult it is for the pulling stimulus to be transmitted to the subject. As an example, the optimum determination unit 103 may determine a target retraction amount of the seat belt (hereinafter referred to as a target retraction amount) as the strength of the retraction stimulus. The optimum determination unit 103 may specify an index (hereinafter referred to as intensity level) divided into a plurality of stages as the intensity of the attraction stimulus.
最適決定部103は、体格特定部113で特定した乗員の体格が、その乗員についての基準となる薄着時の過去の体格(以下、基準体格)よりも大きいと判断する場合には、その乗員についての基準体格よりも大きいと判断しない場合に比べ、その乗員の装着するシートベルトについての引き込み刺激の強度を高く決定することが好ましい。これは、衣服が厚手の場合には、引き込み刺激が対象者に伝わりにくいためである。基準体格については、体格特定部113で不揮発性メモリに過去に格納した乗員別の薄着時の体格を用いればよい。この薄着時の体格が不揮発メモリに格納されていなかった場合には、基準体格よりも大きいと判断したか否かに応じた処理を省略すればよい。
If the optimum determination unit 103 determines that the physique of the occupant identified by the physique identification unit 113 is larger than the physique of the occupant in the past when the occupant was lightly dressed (hereinafter referred to as the reference physique), It is preferable to determine the strength of the pull-in stimulus for the seat belt worn by the occupant higher than in the case where it is not determined that the occupant is larger than the reference physique of the occupant. This is because if the clothing is thick, the attraction stimulus is less likely to be transmitted to the subject. As for the reference physique, the physique of each crew member when lightly dressed, which was previously stored in the non-volatile memory by the physique identifying unit 113, may be used. If the physique at the time of thin clothing is not stored in the non-volatile memory, the processing according to whether or not it is determined that the physique is larger than the reference physique may be omitted.
最適決定部103は、体格特定部113で特定した乗員の体格が規定値以上の場合には、その乗員の体格が規定値未満の場合に比べ、その乗員の装着するシートベルトについての引き込み刺激の強度を高く決定することが好ましい。これは、体格の大きな乗員は引き込み刺激が伝わりにくい可能性が高いためである。規定値については、一般人の平均的な体格の値を用いればよい。規定値については、性別で異なる値としてもよい。
When the physique of the occupant identified by the physique identification unit 113 is equal to or greater than a specified value, the optimal determination unit 103 determines that the attraction stimulus for the seatbelt worn by the occupant is greater than when the physique of the occupant is less than the specified value. It is preferable to determine the strength to be high. This is because there is a high possibility that the pull-in stimulus is less likely to be transmitted to a passenger with a large physique. As for the specified value, the value of the average physique of an ordinary person may be used. The prescribed value may be different depending on gender.
なお、最適決定部103は、引き込み刺激の強度を高く決定する条件を複数満たす場合には、条件を満たす分だけ目標引き込み量,強度レベルを増やして決定すればよい。また、最適決定部103は、眠気特定部111で特定する乗員の眠気レベルが高くなるのに応じて、引き込み刺激の強度を高く決定する構成としても構わない。
It should be noted that, if a plurality of conditions for determining the intensity of the entrainment stimulus to be high are satisfied, the optimum determination unit 103 may increase the target entrainment amount and intensity level by the amount that satisfies the conditions. Further, the optimum determination unit 103 may be configured to increase the strength of the attraction stimulus as the drowsiness level of the passenger identified by the drowsiness identification unit 111 increases.
引き込み制御部104は、シートベルトアクチュエータ50に、自車のシートベルトの送り出し及び巻き取りを行わせる。この引き込み制御部104での処理が引き込み制御工程に相当する。引き込み制御部104は、シートベルトの巻き取りによって、引き込み刺激を行わせる。引き込み刺激は、シートベルトを引き込んだ後、引き込み前の引き込み量まで戻すまでを1つの刺激とすればよい。
The retraction control unit 104 causes the seatbelt actuator 50 to feed and retract the seatbelt of the vehicle. The processing in this pull-in control unit 104 corresponds to the pull-in control step. The pull-in control unit 104 causes the pull-in stimulus to be performed by winding up the seat belt. As for the retraction stimulus, one stimulus may be performed after the seat belt is retracted until the seat belt is returned to the retraction amount before retraction.
引き込み制御部104は、眠気特定部111で特定する乗員の眠気の度合いが第1の閾値以上であることをもとに、その乗員の装着するシートベルトの引き込み刺激を行わせればよい。第1の閾値は、任意に設定可能な値である。第1の閾値は、対象者に警報が必要か否かを区分する値よりも低い値とすることが好ましい。以下では、第1の閾値は眠気レベル2であるものとして説明する。これによれば、乗員の眠気レベルが、警報が必要ない度合いの場合に、引き込み刺激だけで覚醒維持を行うことで、提示装置40での警報によって覚醒維持が行われる煩わしさを低減することが可能になる。
Based on the fact that the degree of drowsiness of the occupant identified by the drowsiness identification unit 111 is greater than or equal to the first threshold, the pull-in control unit 104 may cause the occupant to pull in the seat belt worn by the occupant. The first threshold is a value that can be set arbitrarily. It is preferable that the first threshold be a value lower than the value that determines whether or not the subject needs to be warned. In the following description, it is assumed that the first threshold is level 2 of drowsiness. According to this, when the occupant's drowsiness level is such that a warning is not necessary, by maintaining wakefulness only with the withdrawal stimulus, it is possible to reduce the annoyance of maintaining wakefulness due to the warning from the presentation device 40. be possible.
引き込み制御部104は、最適決定部103で決定したパターン及び/又は強度に従って、引き込み刺激を行わせる。引き込み制御部104は、最適決定部103でパターン及び強度のいずれかしか決定しなかった場合は、決定されたその一方に従って、引き込み刺激を行わせる。引き込み制御部104は、最適決定部103でパターン及び強度のいずれも決定した場合は、決定されたパターン及び強度に従って、引き込み刺激を行わせる。つまり、引き込み制御部104は、乗員関連状態特定部101で特定する乗員関連状態に応じて、引き込み刺激の態様を変化させる。最適決定部103で強度として目標引き込み量が決定されている場合には、シートベルトセンサ60で検出したシートベルトの引き出し量と、目標引き込み量とから、実際に必要な引き込み量を特定して引き込み刺激を行わせればよい。最適決定部103で強度として強度レベルが決定されている場合には、この強度レベルが高くなるのに応じて多くなるように目標引き込み量を算出し、上述したのと同様にして引き込み刺激を行わせればよい。
The entrainment control unit 104 performs entrainment stimulation according to the pattern and/or intensity determined by the optimum determination unit 103 . If the optimum determination unit 103 determines only one of the pattern and the intensity, the attraction control unit 104 causes the attraction stimulation to be performed according to the determined one. When both the pattern and the intensity are determined by the optimum determination unit 103, the attraction control unit 104 causes the attraction stimulation to be performed according to the determined pattern and intensity. That is, the attraction-in control unit 104 changes the mode of the attraction-in stimulation according to the occupant-related state specified by the occupant-related state specifying unit 101 . When the target retraction amount is determined as the strength by the optimum determining unit 103, the actually required retraction amount is specified from the retraction amount of the seat belt detected by the seat belt sensor 60 and the target retraction amount. It should be stimulating. When the intensity level is determined as the intensity by the optimum determining unit 103, the target attraction amount is calculated so as to increase as the intensity level increases, and the attraction stimulation is performed in the same manner as described above. Let it be.
最適決定部103で、眠気特定部111で特定する乗員の眠気の度合いに応じて、引き込み刺激の強度及びパターンの少なくともいずれかを決定した場合は、以下のようにすればよい。引き込み制御部104は、眠気特定部111で特定した乗員の眠気レベルに応じて、引き込み刺激の強度及びパターンの少なくともいずれかを変化させる。引き込み制御部104は、眠気特定部111で特定した乗員の眠気レベルが高くなるのに応じて、引き込み刺激の1セット内での刺激の間隔を短くさせればよい。引き込み制御部104は、眠気特定部111で特定した乗員の眠気レベルが高くなるのに応じて、引き込み刺激の1セットごとの刺激の頻度を高くさせればよい。引き込み制御部104は、引き込み刺激の1セット内での先発刺激を後発刺激よりも弱い強度にさせればよい。
If the optimal determination unit 103 determines at least one of the intensity and pattern of the attraction stimulus according to the degree of drowsiness of the passenger identified by the drowsiness identification unit 111, the following may be done. The drawing-in control unit 104 changes at least one of the strength and pattern of the drawing-in stimulus according to the drowsiness level of the occupant identified by the drowsiness identification unit 111 . The entrainment control unit 104 may shorten the interval between the entrainment stimuli within one set as the drowsiness level of the occupant identified by the drowsiness identification unit 111 increases. The drawing-in control unit 104 may increase the frequency of each set of the drawing-in stimulus as the drowsiness level of the occupant identified by the drowsiness identification unit 111 increases. The entrainment control unit 104 may make the initial stimulus in one set of the entrainment stimulus weaker in intensity than the subsequent stimulus.
最適決定部103で、緩み具合特定部112で特定するシートベルトの緩み具合が大きくなるのに応じて、そのシートベルトについての引き込み刺激の強度を高く決定した場合は、以下のようにすればよい。引き込み制御部104は、緩み具合特定部112で特定するシートベルトの緩み具合が大きくなるのに応じて、そのシートベルトについての引き込み刺激の強度を高くさせればよい。
When the optimal determination unit 103 determines the strength of the pulling stimulus for the seat belt to be increased as the degree of slackness of the seat belt specified by the slackness determination unit 112 increases, the following may be performed. . The pull-in control unit 104 may increase the strength of the pull-in stimulus for the seat belt as the looseness of the seat belt specified by the looseness specifying unit 112 increases.
最適決定部103で、体格特定部113で特定した乗員の体格が、その乗員についての基準体格よりも大きいと判断して引き込み刺激の強度を高く決定した場合には、以下のようにすればよい。引き込み制御部104は、体格特定部113で特定した乗員の体格が、その乗員についての基準体格よりも大きいと判断する場合には、その乗員についての基準体格よりも大きいと判断しない場合に比べ、その乗員の装着するシートベルトについての引き込み刺激の強度を高くさせればよい。
When the optimum determination unit 103 determines that the physique of the occupant identified by the physique identification unit 113 is larger than the reference physique of the occupant and determines the strength of the attraction stimulus to be high, the following may be performed. . When the pull-in control unit 104 determines that the physique of the occupant identified by the physique identification unit 113 is larger than the reference physique of the occupant, the drawing-in control unit 104 determines that the occupant is larger than the reference physique of the occupant. It is sufficient to increase the strength of the retraction stimulus for the seat belt worn by the occupant.
最適決定部103で、体格特定部113で特定した乗員の体格が規定値以上であって引き込み刺激の強度を高く決定した場合には、以下のようにすればよい。引き込み制御部104は、体格特定部113で特定した乗員の体格が規定値以上の場合には、その乗員の体格が規定値未満の場合に比べ、その乗員の装着するシートベルトについての引き込み刺激の強度を高くさせればよい。
If the physique of the occupant identified by the physique identification section 113 is equal to or greater than the specified value and the strength of the entrainment stimulus is determined to be high by the optimum determination section 103, the following may be performed. When the physique of the occupant identified by the physique identification unit 113 is equal to or greater than a prescribed value, the attraction control unit 104 controls the attraction stimulation for the seat belt worn by the occupant as compared to when the physique of the occupant is less than the prescribed value. Strength should be increased.
引き込み制御部104は、室内カメラ30で検出した乗員の顔向きが左右に傾いている場合には、引き込み刺激を行わせないことが好ましい。これは、運転者の顔向きが左右に傾いている場合は、運転を阻害する可能性が高くなるためである。この引き込み刺激の制限は、乗員が運転者である場合に限ることが好ましい。引き込み制御部104は、室内カメラ30で検出した乗員の顔向きが正面に戻った場合に、一旦中止していた引き込み刺激を行わせればよい。顔向きが左右を向いているか正面を向いているかは、これらを区別するための判定用閾値を用いて判定すればよい。
It is preferable that the pull-in control unit 104 does not perform the pull-in stimulation when the occupant's face direction detected by the indoor camera 30 is tilted to the left or right. This is because when the driver's face is tilted to the left or right, there is a high possibility that the driver will be hindered from driving. It is preferable to limit this attraction stimulus only when the passenger is the driver. When the occupant's face orientation detected by the indoor camera 30 returns to the front, the withdrawal control unit 104 may cause the temporarily stopped withdrawal stimulation to be performed. Whether the face is oriented to the left or right or to the front may be determined using a determination threshold value for distinguishing between them.
<HCU10での覚醒維持関連処理>
続いて、図5のフローチャートを用いて、HCU10での覚醒維持関連処理の流れの一例について説明を行う。図5のフローチャートは、例えば、自車の内燃機関又はモータジェネレータを始動させるためのスイッチ(以下、パワースイッチ)がオンになった場合に開始する構成とすればよい。他にも、操作デバイスを介して覚醒維持関連処理を実行する機能のオンオフの設定を切り替えることができる構成の場合には、覚醒維持関連処理を実行する機能がオンとなっていることも条件に加える構成とすればよい。 <Arousal maintenance related processing inHCU 10>
Next, an example of the flow of wakefulness maintenance-related processing in theHCU 10 will be described using the flowchart of FIG. The flowchart of FIG. 5 may be configured to start when, for example, a switch (hereinafter referred to as a power switch) for starting the internal combustion engine or motor generator of the vehicle is turned on. In addition, in the case of a configuration in which the on/off setting of the function to execute the process related to maintaining wakefulness can be switched via the operation device, the function to execute the process related to maintaining wakefulness must be turned on. The configuration may be added.
続いて、図5のフローチャートを用いて、HCU10での覚醒維持関連処理の流れの一例について説明を行う。図5のフローチャートは、例えば、自車の内燃機関又はモータジェネレータを始動させるためのスイッチ(以下、パワースイッチ)がオンになった場合に開始する構成とすればよい。他にも、操作デバイスを介して覚醒維持関連処理を実行する機能のオンオフの設定を切り替えることができる構成の場合には、覚醒維持関連処理を実行する機能がオンとなっていることも条件に加える構成とすればよい。 <Arousal maintenance related processing in
Next, an example of the flow of wakefulness maintenance-related processing in the
まず、ステップS1では、眠気特定部111が、運転者の眠気レベルを特定する。ステップS2では、眠気レベルが2以上の場合(S2でYES)には、ステップS3に移る。一方、眠気レベルが2未満の場合には、ステップS12に移る。ステップS3では、眠気レベルが3以上の場合(S3でYES)には、ステップS4に移る。一方、眠気レベルが2の場合には、ステップS5に移る。
First, in step S1, the drowsiness identification unit 111 identifies the drowsiness level of the driver. In step S2, if the drowsiness level is 2 or higher (YES in S2), the process proceeds to step S3. On the other hand, when the drowsiness level is less than 2, the process proceeds to step S12. In step S3, if the drowsiness level is 3 or higher (YES in S3), the process proceeds to step S4. On the other hand, when the drowsiness level is 2, the process moves to step S5.
ステップS4では、最適決定部103が、S1で特定した眠気レベルに応じて、引き込み刺激のパターンを決定し、ステップS6に移る。眠気レベルが3以上であるS4では、前述したパターンAを決定すればよい。ステップS5では、最適決定部103が、S1で特定した眠気レベルに応じて、引き込み刺激のパターンを決定し、ステップS6に移る。眠気レベルが2であるS5では、前述したパターンBを決定すればよい。
In step S4, the optimum determination unit 103 determines the pattern of the entrainment stimulation according to the drowsiness level specified in S1, and proceeds to step S6. In S4 where the drowsiness level is 3 or higher, pattern A may be determined. In step S5, the optimum determination unit 103 determines the pattern of the entrainment stimulation according to the drowsiness level specified in S1, and the process proceeds to step S6. In S5 where the drowsiness level is 2, pattern B may be determined.
ステップS6では、緩み具合特定部112が、運転者の装着するシートベルトの緩み具合を特定する。そして、シートベルトが緩んでいる場合(S6でYES)には、ステップS9に移る。一方、シートベルトが緩んでいない場合(S6でNO)には、ステップS7に移る。例えば、緩み具合特定部112で特定する緩み具合が、緩んでいると緩んでいないとの2区分だけである場合には、以下のようにすればよい。緩み具合特定部112で緩んでいると特定した場合に緩んでいるとし、緩んでいないと特定した場合に緩んでいないとすればよい。緩み具合特定部112で特定する緩み具合が、3区分以上の場合には、以下のようにすればよい。緩み具合特定部112で特定した緩み具合が一定値以上の場合に緩んでいるとし、緩み具合が一定値未満の場合に緩んでいないとすればよい。ここで言うところの一定値は任意に設定可能とすればよい。
In step S6, the slackness identifying unit 112 identifies the slackness of the seat belt worn by the driver. If the seat belt is loose (YES in S6), the process proceeds to step S9. On the other hand, if the seat belt is not loosened (NO in S6), the process proceeds to step S7. For example, if the degree of slackness specified by the degree-of-slackness specifying unit 112 is only two categories of looseness and not-looseness, the following may be done. If it is specified by the looseness specifying unit 112 that it is loose, it is determined that it is loose, and if it is specified that it is not loose, it is determined that it is not loose. If the degree of slackness specified by the slackness specifying unit 112 is three or more categories, the following may be performed. If the degree of slackness identified by the degree of slackness identification unit 112 is equal to or greater than a certain value, it is assumed that the joint is loose, and if the degree of slackness is less than the certain value, it is judged that the joint is not loose. The constant value referred to here may be set arbitrarily.
ステップS7では、体格特定部113で運転者の体格を特定する。そして、特定した運転者の体格が、運転者の基準体格よりも大きい、厚着である場合(S7でYES)には、ステップS9に移る。一方、運転者の基準体格以下の、厚着でない場合(S7でNO)には、ステップS8に移る。
In step S7, the physique identifying unit 113 identifies the physique of the driver. If the specified driver's physique is larger than the driver's standard physique and is thickly dressed (YES in S7), the process proceeds to step S9. On the other hand, if the driver is not thickly dressed (NO in S7), the process proceeds to step S8.
ステップS8では、体格特定部113で特定した運転者の体格が規定値以上の場合(S8でYES)には、ステップS9に移る。一方、運転者の体格が規定値未満の場合(S8でNO)には、ステップS10に移る。ステップS9では、最適決定部103が、引き込み刺激の強度をデフォルトの強度よりも高く決定する。
In step S8, if the physique of the driver identified by the physique identification unit 113 is greater than or equal to the specified value (YES in S8), the process proceeds to step S9. On the other hand, if the physique of the driver is less than the specified value (NO in S8), the process proceeds to step S10. In step S9, the optimum determination unit 103 determines the strength of the attraction stimulus to be higher than the default strength.
ステップS10では、引き込み制御部104が、引き込み刺激が可能か否かを判定する。一例として、室内カメラ30で検出した運転者の顔向きが左右に傾いている場合には引き込み刺激が不可能と判定すればよい。一方、運転者の顔向きが正面を向いている場合には引き込み刺激が可能と判定すればよい。S10では、引き込み刺激が可能と判定した場合(S10でYES)には、ステップS11に移る。一方、引き込み刺激が不可能と判定した場合(S10でNO)には、ステップS12に移る。
In step S10, the attraction control unit 104 determines whether or not the attraction stimulation is possible. As an example, when the face direction of the driver detected by the indoor camera 30 is tilted to the left or right, it may be determined that the entrainment stimulus is impossible. On the other hand, if the driver faces the front, it may be determined that the attraction stimulus is possible. In S10, when it is determined that the attraction stimulus is possible (YES in S10), the process proceeds to step S11. On the other hand, when it is determined that the attraction stimulus is impossible (NO in S10), the process proceeds to step S12.
ステップS11では、引き込み制御部104が運転者の装着するシートベルトの引き込み刺激を行わせる。S11では、S4若しくはS5で決定したパターンに従った引き込み刺激を行わせる。また、S11では、S9の処理が行われていた場合には、S9で決定した強度で引き込み刺激を行わせる。S11では、S9の処理が行われていなかった場合には、デフォルトの強度で引き込み刺激を行わせればよい。
In step S11, the pull-in control unit 104 causes the seat belt worn by the driver to pull in. In S11, the entrainment stimulation is performed according to the pattern determined in S4 or S5. Also, in S11, if the process of S9 has been performed, the entrainment stimulation is performed with the intensity determined in S9. In S11, if the process of S9 has not been performed, the entrainment stimulation may be performed with the default intensity.
ステップS12では、覚醒維持関連処理の終了タイミングであった場合(S12でYES)には、覚醒維持関連処理を終了する。一方、覚醒維持関連処理の終了タイミングでなかった場合(S12でNO)には、S1に戻って処理を繰り返す。覚醒維持関連処理の終了タイミングの一例としては、自車のパワースイッチがオフになったこと,覚醒維持関連処理を実行する機能がオフに切り替わったこと等がある。
In step S12, if it is time to end the wakefulness maintenance related process (YES in S12), the wakefulness maintenance related process ends. On the other hand, if it is not the end timing of the wakefulness maintenance related process (NO in S12), the process returns to S1 and repeats the process. An example of the termination timing of the wakefulness maintenance related process is that the power switch of the host vehicle is turned off, or that the function of executing the wakefulness maintenance related process is switched off.
図5のフローチャートでは、引き込み刺激の強度を高くする条件をいくつ満たすかにかかわらず、引き込み刺激の強度を高くする度合いが一律である例を示したが、必ずしもこれに限らない。例えば、引き込み刺激の強度を高くする条件を満たす数が多くなるのに応じて、引き込み刺激の強度を高める度合いを上げる構成としてもよい。
Although the flowchart in FIG. 5 shows an example in which the degree of increasing the intensity of the attraction stimulus is uniform regardless of how many conditions for increasing the intensity of the attraction stimulus are satisfied, this is not necessarily the case. For example, the degree of increasing the intensity of the attraction stimulus may be increased as the number of conditions satisfying the condition for increasing the intensity of the attraction stimulus increases.
<実施形態1のまとめ>
実施形態1の構成によれば、運転者の眠気レベルが所定の閾値以上であることをもとに、運転者の装着するシートベルトの引き込みによる刺激である引き込み刺激を行わせるので、引き込み刺激によって覚醒維持が可能になる。また、運転者の眠気レベル,運転者が装着するシートベルトの緩み具合,運転者の体格に応じて、引き込み刺激のパターン,強度を変化させるので、これらの状態にかかわらず引き込み刺激のパターン,強度を変化させない場合に比べ、運転者にとってより適切な刺激にすることが可能になる。その結果、シートベルトの引き込みによる覚醒維持の刺激を対象者にとってより適切な刺激にすることが可能になる。 <Summary ofEmbodiment 1>
According to the configuration of the first embodiment, based on the fact that the drowsiness level of the driver is equal to or higher than a predetermined threshold, the pulling stimulus, which is a stimulus caused by the pulling of the seat belt worn by the driver, is performed. Awakening can be maintained. In addition, since the pattern and intensity of the attraction stimulus are changed according to the drowsiness level of the driver, the looseness of the seat belt worn by the driver, and the physique of the driver, the pattern and intensity of the attraction stimulus can be changed regardless of these conditions. It is possible to provide a more appropriate stimulus for the driver as compared with the case where the is not changed. As a result, it is possible to make the stimulus for maintaining wakefulness by retracting the seat belt more suitable for the subject.
実施形態1の構成によれば、運転者の眠気レベルが所定の閾値以上であることをもとに、運転者の装着するシートベルトの引き込みによる刺激である引き込み刺激を行わせるので、引き込み刺激によって覚醒維持が可能になる。また、運転者の眠気レベル,運転者が装着するシートベルトの緩み具合,運転者の体格に応じて、引き込み刺激のパターン,強度を変化させるので、これらの状態にかかわらず引き込み刺激のパターン,強度を変化させない場合に比べ、運転者にとってより適切な刺激にすることが可能になる。その結果、シートベルトの引き込みによる覚醒維持の刺激を対象者にとってより適切な刺激にすることが可能になる。 <Summary of
According to the configuration of the first embodiment, based on the fact that the drowsiness level of the driver is equal to or higher than a predetermined threshold, the pulling stimulus, which is a stimulus caused by the pulling of the seat belt worn by the driver, is performed. Awakening can be maintained. In addition, since the pattern and intensity of the attraction stimulus are changed according to the drowsiness level of the driver, the looseness of the seat belt worn by the driver, and the physique of the driver, the pattern and intensity of the attraction stimulus can be changed regardless of these conditions. It is possible to provide a more appropriate stimulus for the driver as compared with the case where the is not changed. As a result, it is possible to make the stimulus for maintaining wakefulness by retracting the seat belt more suitable for the subject.
(実施形態2)
実施形態1では、引き込み刺激の対象者を運転者のみとする構成を示したが、必ずしもこれに限らない。例えば、引き込み刺激の対象者を運転者及び同乗者とする構成(以下、実施形態2)としてもよい。以下では、実施形態2の一例について図を用いて説明する。実施形態2の覚醒維持システム1は、HCU10の代わりにHCU10aを含む点を除けば、実施形態1の覚醒維持システム1と同様である。 (Embodiment 2)
In the first embodiment, the configuration is shown in which the target of the attraction stimulus is only the driver, but this is not necessarily the case. For example, a configuration may be adopted in which the target persons of the attraction stimulus are the driver and the fellow passenger (hereinafter referred to as Embodiment 2). An example of the second embodiment will be described below with reference to the drawings. The wakefulness-maintainingsystem 1 of Embodiment 2 is the same as the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10a instead of the HCU 10. FIG.
実施形態1では、引き込み刺激の対象者を運転者のみとする構成を示したが、必ずしもこれに限らない。例えば、引き込み刺激の対象者を運転者及び同乗者とする構成(以下、実施形態2)としてもよい。以下では、実施形態2の一例について図を用いて説明する。実施形態2の覚醒維持システム1は、HCU10の代わりにHCU10aを含む点を除けば、実施形態1の覚醒維持システム1と同様である。 (Embodiment 2)
In the first embodiment, the configuration is shown in which the target of the attraction stimulus is only the driver, but this is not necessarily the case. For example, a configuration may be adopted in which the target persons of the attraction stimulus are the driver and the fellow passenger (hereinafter referred to as Embodiment 2). An example of the second embodiment will be described below with reference to the drawings. The wakefulness-maintaining
まず、図6を用いてHCU10aの概略構成についての説明を行う。HCU10aは、図6に示すように、乗員関連状態特定部101a、提示制御部102a、最適決定部103a、及び引き込み制御部104aを機能ブロックとして備える。このHCU10aも覚醒維持装置に相当する。また、コンピュータによってHCU10aの各機能ブロックの処理が実行されることが、覚醒維持方法が実行されることに相当する。
First, the schematic configuration of the HCU 10a will be described using FIG. As shown in FIG. 6, the HCU 10a includes, as functional blocks, an occupant-related state identification unit 101a, a presentation control unit 102a, an optimum determination unit 103a, and a retraction control unit 104a. This HCU 10a also corresponds to a wakefulness maintenance device. Execution of the process of each functional block of the HCU 10a by the computer corresponds to execution of the wakefulness maintaining method.
乗員関連状態特定部101aは、乗員関連状態として、運転者以外にも自車の同乗者に関連する状態も特定する点を除けば、実施形態1の乗員関連状態特定部101と同様である。この乗員関連状態特定部101aでの処理も乗員関連状態特定工程に相当する。乗員関連状態特定部101aは、眠気特定部111a、緩み具合特定部112、及び体格特定部113をサブ機能ブロックとして有している。乗員関連状態特定部101aは、眠気特定部111の代わりに眠気特定部111aを有している点を除けば、実施形態1の乗員関連状態特定部101と同様である。
The occupant-related state identification unit 101a is the same as the occupant-related state identification unit 101 of Embodiment 1, except that it also identifies, as occupant-related states, states related to fellow passengers in the vehicle in addition to the driver. The processing in the occupant-related state identification section 101a also corresponds to the occupant-related state identification step. The occupant-related state identification unit 101a has a drowsiness identification unit 111a, a slackness identification unit 112, and a physique identification unit 113 as sub-functional blocks. The occupant-related state identification unit 101a is the same as the occupant-related state identification unit 101 of the first embodiment except that the drowsiness identification unit 111a is replaced with the drowsiness identification unit 111a.
乗員関連状態特定部101aは、同乗者の姿勢若しくはシートのリクライニングの状態も特定することが好ましい。同乗者の姿勢は、自車の前後方向に対する同乗者の上体の傾きとすればよい。同乗者の姿勢については、室内カメラ30での撮像画像を画像認識することで特定すればよい。同乗者のシートのリクライニングの状態については、シートECU20から取得するリクライニング位置から特定すればよい。
The occupant-related state identifying unit 101a preferably also identifies the posture of the fellow passenger or the reclining state of the seat. The posture of the fellow passenger may be the inclination of the upper body of the fellow passenger with respect to the longitudinal direction of the vehicle. The posture of the fellow passenger may be specified by recognizing the image captured by the indoor camera 30 . The reclining state of the passenger's seat may be identified from the reclining position obtained from the seat ECU 20 .
眠気特定部111aは、自車の同乗者の眠気の度合いである眠気レベルも特定する点を除けば、実施形態1の眠気特定部111と同様である。同乗者の眠気レベルについても、運転者の眠気レベルと同様にして特定すればよい。実施形態2では、室内カメラ30が運転席だけでなく、助手席,後部座席といった同乗者の座席も含む範囲を撮像するものとする。
The drowsiness identification unit 111a is the same as the drowsiness identification unit 111 of the first embodiment, except that it also identifies the drowsiness level, which is the degree of drowsiness of the passenger in the vehicle. The drowsiness level of the fellow passenger may also be identified in the same manner as the drowsiness level of the driver. In the second embodiment, it is assumed that the indoor camera 30 captures not only the driver's seat but also the passenger's seat such as the passenger's seat and the rear seat.
提示制御部102aは、運転者の眠気レベルが高いことを通知する同乗者向けの情報(以下、同乗者向け情報)を提示させる点を除けば、実施形態1の提示制御部102と同様である。例えば、提示制御部102aは、眠気特定部111aで特定した運転者の眠気レベルが3以上である場合に、提示装置40から同乗者向け情報を提示させればよい。同乗者向け情報を提示させる提示装置40としては、表示器41としてのCID,音声出力装置42としてのスピーカが挙げられる。
The presentation control unit 102a is the same as the presentation control unit 102 of the first embodiment, except that it presents information for fellow passengers (hereinafter referred to as information for fellow passengers) that notifies that the drowsiness level of the driver is high. . For example, the presentation control unit 102a may cause the presentation device 40 to present information for fellow passengers when the drowsiness level of the driver identified by the drowsiness identification unit 111a is 3 or higher. The presentation device 40 for presenting information for fellow passengers includes a CID as a display device 41 and a speaker as an audio output device 42 .
最適決定部103aは、自車の同乗者について乗員関連状態特定部101aで特定する乗員関連状態にも応じて、引き込み刺激の態様を決定する点を除けば、実施形態1の最適決定部103と同様である。以下では、最適決定部103aでの、同乗者についての引き込み刺激の態様の決定について説明する。
The optimum determining unit 103a is identical to the optimum determining unit 103 of the first embodiment, except that the mode of the attraction stimulus is determined according to the occupant-related state specified by the occupant-related state specifying unit 101a for the fellow passenger of the own vehicle. It is the same. Determination of the mode of attraction stimulus for the fellow passenger by the optimum determination unit 103a will be described below.
最適決定部103aは、眠気特定部111aで特定した同乗者の眠気レベルが1以上の非覚醒状態である場合には、引き込み刺激のパターンを、複数回の刺激が1セットのパターンと決定すればよい。また、先発刺激は、後発刺激よりも弱い強度の刺激と決定すればよい。一例としては、実施形態1で述べたパターンBと決定すればよい。一方、眠気特定部111aで特定した同乗者の眠気レベルが0の覚醒状態である場合には、引き込み刺激のパターンを、1回の刺激が1セットのパターンと決定すればよい。このパターンを以降ではパターンCとする。引き込み刺激の強度については、複数回の刺激を1セットのパターンとする場合の先発刺激と同じ弱い刺激とすればよい。これによれば、同乗者が覚醒状態の場合には1セットの刺激数を減らすとともに刺激も弱め、刺激に対す煩わしさを感じにくくさせることが可能になる。一方、同乗者が非覚醒状態の場合には、1セットの刺激数を増やすとともに刺激も強めることで、覚醒状態に誘うことを可能にする。
If the passenger's drowsiness level identified by the drowsiness identification unit 111a is 1 or more and is in a non-awakened state, the optimum determination unit 103a determines that the pattern of the entrainment stimulation is a pattern in which a plurality of stimulations constitutes one set. good. Also, the initial stimulus may be determined to be weaker in intensity than the subsequent stimulus. As an example, the pattern B described in the first embodiment may be determined. On the other hand, when the passenger's drowsiness level specified by the drowsiness specifying unit 111a is 0 and is in an awake state, the pattern of the attraction stimulus may be determined as a pattern in which one stimulus is one set. This pattern will be referred to as pattern C hereinafter. The intensity of the entraining stimulus may be the same weak stimulus as the starting stimulus when multiple stimuli are set as one set pattern. According to this, when the fellow passenger is in an awake state, the number of stimuli in one set is reduced and the stimuli are also weakened, making it possible to make the stimuli less annoying. On the other hand, when the fellow passenger is in a non-awakened state, by increasing the number of stimulations in one set and strengthening the stimulation, it is possible to invite the passenger into an awakened state.
引き込み制御部104aは、シートベルトアクチュエータ50に、同乗者のシートベルトの送り出し及び巻き取りも行わせる点を除けば、実施形態1の引き込み制御部104と同様である。この引き込み制御部104aでの処理も引き込み制御工程に相当する。以下では、引き込み制御部104aでの、同乗者についての引き込み刺激について説明する。
The pull-in control unit 104a is the same as the pull-in control unit 104 of the first embodiment, except that the seat belt actuator 50 also causes the seat belt to be fed out and retracted for the passenger. The processing in the pull-in control unit 104a also corresponds to the pull-in control step. The attraction stimulus for the fellow passenger in the attraction control unit 104a will be described below.
引き込み制御部104aは、眠気特定部111aで特定する運転者の眠気が第2の閾値未満の場合は、同乗者の装着するシートベルトについての引き込み刺激を行わせないことが好ましい。引き込み制御部104aは、眠気特定部111aで特定する運転者の眠気が第2の閾値以上であることをもとに、同乗者の装着するシートベルトについての引き込み刺激を行わせることが好ましい。第2の閾値は、任意に設定可能な値である。第2の閾値は、運転者に警報が必要か否かを区分する値とすることが好ましい。以下では、第2の閾値は眠気レベル3であるものとして説明する。これによれば、運転者の眠気レベルが、警報が必要な度合いの場合に、運転者への引き込み刺激だけで運転者の覚醒維持を行うことができなかった場合に、同乗者へも引き込み刺激を行うことで、同乗者の協力も得て運転者の覚醒維持を行うことが可能になる。
When the driver's drowsiness specified by the drowsiness specifying unit 111a is less than the second threshold, the pull-in control unit 104a preferably does not perform the pull-in stimulation for the seat belt worn by the fellow passenger. It is preferable that the pull-in control unit 104a performs a pull-in stimulation for the seat belt worn by the fellow passenger based on whether the drowsiness of the driver identified by the drowsiness identification unit 111a is equal to or greater than the second threshold. The second threshold is a value that can be set arbitrarily. The second threshold is preferably a value that determines whether or not a warning is required for the driver. In the following description, it is assumed that the second threshold is drowsiness level 3. FIG. According to this, when the drowsiness level of the driver is such that an alarm is necessary, and if the driver's stimulus alone cannot keep the driver awake, the stimulus also attracts the passenger. By doing so, it is possible to keep the driver awake with the cooperation of the fellow passengers.
引き込み制御部104aは、同乗者について引き込み刺激を行わせる場合に、最適決定部103aで決定した刺激の態様に従って、引き込み刺激を行わせる。引き込み制御部104aは、眠気特定部111aで特定した同乗者の眠気レベルが非覚醒状態に該当する場合には、以下のようにすればよい。引き込み制御部104aは、複数回の刺激を1セットとする引き込み刺激を行わせるとともに、1セット内での最初の刺激をその後の刺激よりも弱い強度にさせればよい。一方、引き込み制御部104aは、眠気特定部111aで特定した同乗者の眠気レベルが覚醒状態に該当する場合には、以下のようにすればよい。引き込み制御部104aは、1回の刺激を1セットとする引き込み刺激を行わせるとともに、刺激の強度を、同乗者の眠気レベルが非覚醒状態に該当する場合の1セット内での最初の刺激の強度とすればよい。
The attraction control unit 104a causes the attraction stimulation to be performed according to the stimulation mode determined by the optimum determination unit 103a when performing the attraction stimulation for the fellow passenger. If the sleepiness level of the fellow passenger identified by the sleepiness identification unit 111a corresponds to the non-awakened state, the pull-in control unit 104a may perform the following. The entrainment control unit 104a may perform a set of entrainment stimulations consisting of a plurality of stimulations, and make the first stimulation in one set have a weaker intensity than the subsequent stimulations. On the other hand, if the fellow passenger's drowsiness level identified by the drowsiness identification unit 111a corresponds to the wakeful state, the drawing-in control unit 104a may perform the following. The entrainment control unit 104a performs entrainment stimulation with one stimulation set as one set, and sets the intensity of the stimulation to that of the first stimulation in one set when the fellow passenger's drowsiness level corresponds to the non-awakened state. It should be strength.
引き込み制御部104aは、眠気特定部111aで特定する運転者の眠気が第2の閾値以上の場合であっても、乗員関連状態特定部101aで特定する同乗者の姿勢若しくはシートのリクライニングの状態が、引き込み刺激の効果が低いと推定される状態である場合には、同乗者の装着するシートベルトについての引き込み刺激を行わせないことが好ましい。これは、同乗者の着座するシートのシートバックが床側に一定以上寝ている状態では、シートベルトを引き込んでも、引き込み刺激が対象者に伝わらない可能性が高いためである。引き込み刺激の効果が低いと推定される状態は、予め実験,シミュレーション等で求めておいたものを用いる構成とすればよい。
Even if the drowsiness of the driver identified by the drowsiness identification unit 111a is equal to or greater than the second threshold value, the pull-in control unit 104a determines whether the posture of the fellow passenger identified by the occupant-related state identification unit 101a or the reclining state of the seat is When the effect of the pulling stimulus is estimated to be low, it is preferable not to perform the pulling stimulus for the seat belt worn by the fellow passenger. This is because when the seat back of the seat on which the fellow passenger sits is lying on the floor side for a certain amount or more, there is a high possibility that the retraction stimulus will not be transmitted to the subject even if the seat belt is retracted. The state in which the entrainment stimulus effect is estimated to be low may be determined in advance by experiments, simulations, or the like.
また、上述のようにして、引き込み制御部104aが、同乗者の装着するシートベルトについての引き込み刺激を行わせないようにした場合であっても、緊急度が高い場合には、同乗者の着座するシートを強制的に起こした上で、引き込み刺激を行わせる構成としてもよい。この構成は、リクライニング位置を電動で切り替えることのできる電動シートを採用する場合に限ればよい。以上の構成によれば、同乗者の姿勢若しくはシートのリクライニングの状態が、引き込み刺激の効果が低いと推定される状態であった場合でも、緊急度の高い場合には、引き込み刺激の効果を上げることが可能になる。緊急度の高い場合とは、運転者の眠気レベルが一定時間以上改善されない場合,運転者の眠気が悪化していっている場合等が挙げられる。
Further, as described above, even when the retraction control unit 104a does not perform the retraction stimulus for the seat belt worn by the fellow passenger, if the degree of urgency is high, the seating of the fellow passenger It is also possible to forcibly raise the sheet to be pulled and then perform the drawing stimulation. This configuration may be used only when an electric seat capable of electrically switching the reclining position is employed. According to the above configuration, even if the passenger's posture or the reclining state of the seat is a state in which the effect of the attraction stimulus is estimated to be low, the effect of the attraction stimulus is increased when the degree of urgency is high. becomes possible. A case of high urgency includes a case where the driver's drowsiness level does not improve for a certain period of time or longer, a case where the driver's drowsiness is getting worse, and the like.
提示制御部102aは、同乗者向け情報を提示させる場合に、引き込み制御部104aで上述した同乗者についての引き込み刺激が行われた後に、同乗者向け情報を提示させることが好ましい。これは、車両の提示装置40からの情報提示は運転者に向けたものが主であるため、提示装置40からの同乗者向け情報を単体で行うだけでは、同乗者に同乗者向け情報が伝わらない可能性が高いためである。同乗者についての引き込み刺激が行われた後に、同乗者向け情報を提示させることで、同乗者向け情報が同乗者に伝わりやすくなる。
When presenting fellow-passenger-oriented information, the presentation control unit 102a preferably causes the fellow-passenger-oriented information to be presented after the attraction control unit 104a performs the attraction-in stimulus for the fellow-passenger described above. This is because the presentation of information from the presentation device 40 of the vehicle is mainly directed to the driver, and therefore the information for the fellow passenger cannot be conveyed to the fellow passenger only by performing the information for the fellow passenger from the presentation device 40 alone. This is because it is highly unlikely that By presenting the information for the fellow passenger after the attraction stimulus for the fellow passenger is performed, the information for the fellow passenger can be easily conveyed to the fellow passenger.
<HCU10aでの覚醒維持関連処理>
ここで、図7のフローチャートを用いて、HCU10aでの同乗者についての覚醒維持関連処理の流れの一例について説明を行う。HCU10aでの運転者についての覚醒維持関連処理の流れは、実施形態1の図5のフローチャートで示したのと同様とすればよい。図7のフローチャートは、自車において同乗者の存在が確認された場合に開始する構成とすればよい。HCU10aでは、乗員関連状態特定部101aで運転者以外の乗員の状態が特定できた場合に、同乗者の存在が確認されたものとすればよい。なお、操作デバイスを介して覚醒維持関連処理を実行する機能のオンオフの設定を切り替えることができる構成の場合には、覚醒維持関連処理を実行する機能がオンとなっていることも、図7のフローチャートの開始条件に加える構成とすればよい。 <Arousal Maintenance Related Processing inHCU 10a>
Here, an example of the flow of wakefulness maintenance-related processing for a fellow passenger in theHCU 10a will be described using the flowchart of FIG. The flow of wakefulness maintenance related processing for the driver in the HCU 10a may be the same as that shown in the flowchart of FIG. 5 of the first embodiment. The flowchart of FIG. 7 may be configured to start when the presence of a fellow passenger is confirmed in the own vehicle. In the HCU 10a, if the occupant-related state identifying unit 101a can identify the states of the occupants other than the driver, the presence of the fellow passenger may be confirmed. It should be noted that in the case of a configuration in which the on/off setting of the function for executing the process related to maintaining wakefulness can be switched via the operation device, the fact that the function for executing the process related to maintaining wakefulness is turned on also means that the process shown in FIG. It may be configured to be added to the start condition of the flow chart.
ここで、図7のフローチャートを用いて、HCU10aでの同乗者についての覚醒維持関連処理の流れの一例について説明を行う。HCU10aでの運転者についての覚醒維持関連処理の流れは、実施形態1の図5のフローチャートで示したのと同様とすればよい。図7のフローチャートは、自車において同乗者の存在が確認された場合に開始する構成とすればよい。HCU10aでは、乗員関連状態特定部101aで運転者以外の乗員の状態が特定できた場合に、同乗者の存在が確認されたものとすればよい。なお、操作デバイスを介して覚醒維持関連処理を実行する機能のオンオフの設定を切り替えることができる構成の場合には、覚醒維持関連処理を実行する機能がオンとなっていることも、図7のフローチャートの開始条件に加える構成とすればよい。 <Arousal Maintenance Related Processing in
Here, an example of the flow of wakefulness maintenance-related processing for a fellow passenger in the
まず、ステップS21では、眠気特定部111aが、運転者の眠気レベルを特定する。ステップS22では、運転者の眠気レベルが第2の閾値以上の場合(S22でYES)には、ステップS23に移る。一方、運転者の眠気レベルが第2の閾値未満の場合には、ステップS32に移る。例えば、第2の閾値は眠気レベル3とする。
First, in step S21, the drowsiness identification unit 111a identifies the drowsiness level of the driver. In step S22, if the drowsiness level of the driver is equal to or higher than the second threshold (YES in S22), the process proceeds to step S23. On the other hand, if the drowsiness level of the driver is less than the second threshold, the process proceeds to step S32. For example, sleepiness level 3 is set as the second threshold.
ステップS23では、乗員関連状態特定部101aで特定する同乗者の姿勢若しくはシートのリクライニングの状態が、引き込み刺激の効果が低いと推定される状態(つまり、刺激対象外)である場合(S23でYES)には、ステップS24に移る。一方、引き込み刺激の効果が低いと推定される状態でない場合(S23でNO)には、ステップS26に移る。乗員関連状態特定部101aで特定する同乗者の姿勢若しくはシートのリクライニングの状態が、引き込み刺激の効果が低いと推定される状態か否かについては、引き込み制御部104aで判断すればよい。
In step S23, if the passenger's posture or seat reclining state specified by the occupant-related state specifying unit 101a is in a state in which it is estimated that the effect of the entrainment stimulus is low (i.e., not subject to stimulus) (YES in S23) ), the process moves to step S24. On the other hand, if the effect of the attraction stimulus is not estimated to be low (NO in S23), the process proceeds to step S26. Whether or not the passenger's posture or seat reclining state identified by the occupant-related state identification unit 101a is a state in which the effect of the attraction stimulus is estimated to be low may be determined by the withdrawal control unit 104a.
ステップS24では、緊急度が高い場合(S24でYES)には、ステップS25に移る。一方、緊急度が高くない場合(S24でNO)には、ステップS32に移る。緊急度が高いか否かは、引き込み制御部104aで判断すればよい。ステップS25では、HCU10aがシートECU20に指示を行い、同乗者の着座する電動シートのシートバックを起こさせ、ステップS26に移る。シートバックを起こさせる際のリクライニング位置は、引き込み刺激の効果が高いと推定される状態にあたる位置とすればよい。
In step S24, if the degree of urgency is high (YES in S24), go to step S25. On the other hand, if the degree of urgency is not high (NO in S24), the process proceeds to step S32. Whether or not the degree of urgency is high may be determined by the pull-in control unit 104a. In step S25, the HCU 10a instructs the seat ECU 20 to raise the seat back of the electric seat on which the fellow passenger sits, and the process proceeds to step S26. The reclining position at which the seatback is raised may be a position corresponding to a state in which it is estimated that the pulling stimulus is highly effective.
ステップS26では、眠気特定部111aが、同乗者の眠気レベルを特定する。ステップS27では、同乗者の眠気レベルが0の覚醒状態の場合(S27でYES)には、ステップS28に移る。一方、同乗者の眠気レベルが1以上の非覚醒状態の場合には、ステップS29に移る。
In step S26, the drowsiness identification unit 111a identifies the fellow passenger's drowsiness level. In step S27, if the passenger's sleepiness level is 0 (YES in S27), the process proceeds to step S28. On the other hand, if the fellow passenger's drowsiness level is 1 or more and is in a non-awakened state, the process proceeds to step S29.
ステップS28では、最適決定部103aが、引き込み刺激のパターンとして、1回の刺激が1セットのパターンを決定し、ステップS30に移る。一例として、前述したパターンCを決定すればよい。ステップS29では、最適決定部103aが、引き込み刺激のパターンとして、複数回の刺激が1セットのパターンを決定し、ステップS30に移る。一例として、前述したパターンBを決定すればよい。
In step S28, the optimum determination unit 103a determines a pattern in which one stimulus is one set as the pattern of the attraction stimulus, and the process proceeds to step S30. As an example, the pattern C described above may be determined. In step S29, the optimum determination unit 103a determines a pattern in which a plurality of stimuli constitutes one set as the pattern of the attraction stimulus, and the process proceeds to step S30. As an example, the pattern B described above may be determined.
ステップS30では、引き込み制御部104aが、同乗者の装着するシートベルトの引き込み刺激を行わせる。S30では、S28若しくはS29で決定したパターンに従った引き込み刺激を行わせる。ステップS31では、提示制御部102aが、提示装置40から同乗者向け情報を提示させる。
In step S30, the pull-in control unit 104a causes the seat belt worn by the fellow passenger to pull in. At S30, a drawing stimulus is performed according to the pattern determined at S28 or S29. In step S31, the presentation control unit 102a causes the presentation device 40 to present information for fellow passengers.
ステップS32では、覚醒維持関連処理の終了タイミングであった場合(S32でYES)には、覚醒維持関連処理を終了する。一方、覚醒維持関連処理の終了タイミングでなかった場合(S32でNO)には、S21に戻って処理を繰り返す。覚醒維持関連処理の終了タイミングの一例としては、自車のパワースイッチがオフになったこと,覚醒維持関連処理を実行する機能がオフに切り替わったこと等がある。
In step S32, if it is time to end the wakefulness maintenance related process (YES in S32), the wakefulness maintenance related process ends. On the other hand, if it is not the end timing of the wakefulness maintenance related process (NO in S32), the process returns to S21 and repeats the process. An example of the termination timing of the wakefulness maintenance related process is that the power switch of the host vehicle is turned off, or that the function of executing the wakefulness maintenance related process is switched off.
図7のフローチャートでは、S23~S25の処理を、S28及びS29とS30との処理の間に行う構成としてもよい。また、図7のフローチャートでは、同乗者の着座するシートが電動シートでない場合には、S24~S25の処理を省略し、S23でYESの場合にS32に移る構成としてもよい。この場合に、同乗者の装着するシートベルトの引き込み刺激を行わせずに、提示制御部102aが同乗者向け情報を提示させる構成としてもよい。また、S24でNOの場合についても、同乗者の装着するシートベルトの引き込み刺激を行わせずに、提示制御部102aが同乗者向け情報を提示させる構成としてもよい。
In the flowchart of FIG. 7, the processing of S23 to S25 may be configured to be performed between the processing of S28, S29 and S30. Further, in the flowchart of FIG. 7, if the seat on which the fellow passenger is seated is not an electric seat, the processing of S24 to S25 may be omitted, and if YES in S23, the process may proceed to S32. In this case, the presentation control unit 102a may present the information for the fellow passenger without performing the pull-in stimulation of the seat belt worn by the fellow passenger. Further, in the case of NO in S24, the presentation control unit 102a may present the information for the fellow passenger without performing the pull-in stimulation of the seat belt worn by the fellow passenger.
なお、図7のフローチャートにおいて、同乗者の装着するシートベルトの引き込み刺激を行わせてから同乗者向け情報を提示させる処理を一旦行った後は、以下のようにしてもよい。例えば、運転者の眠気レベルが第2の閾値未満となるまで、同乗者向け情報は提示させるが、同乗者の装着するシートベルトの引き込み刺激を行わせない構成としてもよい。これによれば、引き込み刺激によって同乗者向け情報に気づいた同乗者に対して、同乗者向け情報に気づいた後も引き込み刺激が行われる煩わしさを低減することが可能になる。
It should be noted that in the flowchart of FIG. 7, the following may be performed once the process of presenting the information for the fellow passenger after performing the pull-in stimulation of the seat belt worn by the fellow passenger. For example, until the drowsiness level of the driver becomes less than the second threshold, the information for the fellow passenger may be presented, but the pull-in stimulation of the seat belt worn by the fellow passenger may not be performed. According to this, it is possible to reduce the annoyance of a fellow passenger who notices the fellow-passenger-oriented information by the attracting-in stimulus, and to receive the fellow-passenger-oriented information even after the fellow-passenger has noticed the fellow-passenger-oriented information.
また、引き込み制御部104aは、運転者に引き込み刺激を行わせたにもかかわらず、その刺激後の一定期間内に運転者の眠気レベルが第2の閾値未満とならないことを、同乗者に引き込み刺激を行わせる条件としてもよい。ここで言う一定期間は任意に設定可能とすればよい。これによれば、運転者が引き込み刺激で眠気レベルが第2の閾値未満に改善する場合にも同乗者に引き込み刺激を行わせる煩わしさ及び無駄を低減することが可能になる。
In addition, the attraction control unit 104a notifies the fellow passenger that the drowsiness level of the driver does not fall below the second threshold value within a certain period of time after the stimulation, even though the driver is caused to perform the attraction stimulation. It may be a condition for stimulating. The fixed period referred to here may be set arbitrarily. According to this, even when the drowsiness level of the driver improves to less than the second threshold value due to the attraction stimulus, it is possible to reduce the troublesomeness and waste of having the fellow passenger perform the attraction stimulus.
実施形態2の構成によれば、運転者が引き込み刺激に慣れが生じて引き込み刺激で眠気レベルの改善が困難になった場合であって、その眠気レベルが同乗者の協力を得ても覚醒させるべき度合いの場合に、同乗者に引き込み刺激を行って、運転者の眠気改善についての同乗者の協力を得ることが可能になる。
According to the configuration of the second embodiment, when the driver becomes accustomed to the entrainment stimulus and it becomes difficult to improve the drowsiness level with the entrainment stimulus, the drowsiness level wakes up even with the cooperation of the passenger. In the case of the degree of power, it is possible to provide the passenger with an entrainment stimulus to obtain the cooperation of the passenger in improving the drowsiness of the driver.
なお、実施形態2では、緩み具合特定部112及び体格特定部113で同乗者についてのシートベルトの緩み具合,体格を特定しない構成を示したが、必ずしもこれに限らない。例えば、緩み具合特定部112及び体格特定部113で同乗者についてのシートベルトの緩み具合,体格も特定する構成としてもよい。この場合、最適決定部103aが、実施形態1の最適決定部103と同様に、同乗者についての引き込み刺激の強度を、同乗者についてのシートベルトの緩み具合,体格に応じて決定してもよい。そして、引き込み制御部104aが、同乗者についての引き込み刺激の強度を、同乗者についてのシートベルトの緩み具合,体格に応じて変化させてもよい。
In the second embodiment, the slackness specifying unit 112 and the physique specifying unit 113 do not specify the slackness of the seat belt and the physique of the fellow passenger, but this is not necessarily the case. For example, the slackness specifying unit 112 and the physique specifying unit 113 may also be configured to specify the slackness of the seat belt and the physique of the fellow passenger. In this case, the optimum determining unit 103a may determine the strength of the attraction stimulus for the fellow passenger according to the slackness of the seat belt and the physique of the fellow passenger, similarly to the optimum deciding unit 103 of the first embodiment. . Then, the pull-in control unit 104a may change the strength of the pull-in stimulus for the fellow passenger according to the slackness of the seat belt and the physique of the fellow passenger.
(実施形態3)
前述の実施形態では、室内カメラ30で検出した結果を用いて、シートベルトの緩み具合を特定する構成を示したが、必ずしもこれに限らない。例えば、以下の実施形態3の構成としてもよい。以下では、実施形態3の一例について図を用いて説明する。 (Embodiment 3)
In the above-described embodiment, the configuration for identifying the looseness of the seat belt using the result detected by theindoor camera 30 is shown, but the configuration is not necessarily limited to this. For example, the configuration of Embodiment 3 below may be used. An example of the third embodiment will be described below with reference to the drawings.
前述の実施形態では、室内カメラ30で検出した結果を用いて、シートベルトの緩み具合を特定する構成を示したが、必ずしもこれに限らない。例えば、以下の実施形態3の構成としてもよい。以下では、実施形態3の一例について図を用いて説明する。 (Embodiment 3)
In the above-described embodiment, the configuration for identifying the looseness of the seat belt using the result detected by the
実施形態3の覚醒維持システム1bは、車両で用いられるものである。覚醒維持システム1bは、図8に示すように、HCU10b、シートECU20、室内カメラ30、提示装置40、シートベルトアクチュエータ50、シートベルトセンサ60、及び感圧センサ70を含んでいる。覚醒維持システム1bは、HCU10の代わりにHCU10bを含む点と、感圧センサ70を含む点とを除けば、実施形態1の覚醒維持システム1と同様である。
The wakefulness maintenance system 1b of Embodiment 3 is used in a vehicle. The wakefulness maintenance system 1b includes an HCU 10b, a seat ECU 20, an indoor camera 30, a presentation device 40, a seatbelt actuator 50, a seatbelt sensor 60, and a pressure sensor 70, as shown in FIG. The wakefulness-maintaining system 1b is similar to the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10b instead of the HCU 10 and that it includes a pressure sensor .
感圧センサ70は、シートベルトの、シートベルトを装着した場合に乗員に接触する側に設けられる。これにより、感圧センサ70は、乗員がシートベルトを装着した場合に、そのシートベルトの緩み具合に応じた圧力値を出力する。感圧センサ70は、引き込み刺激の対象とする乗員の着座するシートのシートベルトに設ける。感圧センサ70で検出する圧力値は、HCU10bに出力すればよい。
The pressure sensor 70 is provided on the side of the seat belt that contacts the occupant when the seat belt is worn. As a result, the pressure sensor 70 outputs a pressure value corresponding to the looseness of the seat belt when the occupant wears the seat belt. The pressure-sensitive sensor 70 is provided on the seat belt of the seat on which the occupant who is the object of the pulling stimulus sits. The pressure value detected by the pressure sensor 70 may be output to the HCU 10b.
HCU10bは、図9に示すように、乗員関連状態特定部101b、提示制御部102、最適決定部103b、及び引き込み制御部104を機能ブロックとして備える。HCU10bは、乗員関連状態特定部101及び最適決定部103の代わりに、乗員関連状態特定部101b及び最適決定部103bを備える点を除けば、実施形態1のHCU10と同様である。このHCU10bも覚醒維持装置に相当する。また、コンピュータによってHCU10bの各機能ブロックの処理が実行されることが、覚醒維持方法が実行されることに相当する。
As shown in FIG. 9, the HCU 10b includes an occupant-related state identification unit 101b, a presentation control unit 102, an optimum determination unit 103b, and a pull-in control unit 104 as functional blocks. The HCU 10b is the same as the HCU 10 of the first embodiment, except that it includes an occupant-related state identification unit 101b and an optimum determination unit 103b instead of the occupant-related state identification unit 101 and the optimum determination unit 103. This HCU 10b also corresponds to a wakefulness maintenance device. Execution of the process of each functional block of the HCU 10b by the computer corresponds to execution of the wakefulness maintaining method.
乗員関連状態特定部101bは、一部の処理が異なる点を除けば、実施形態1の乗員関連状態特定部101と同様である。この乗員関連状態特定部101bでの処理も乗員関連状態特定工程に相当する。乗員関連状態特定部101bは、眠気特定部111及び緩み具合特定部112bをサブ機能ブロックとして有している。乗員関連状態特定部101bは、緩み具合特定部112の代わりに緩み具合特定部112aを有している点と、体格特定部113を有していない点とを除けば、実施形態1の乗員関連状態特定部101と同様である。
The occupant-related state identification unit 101b is the same as the occupant-related state identification unit 101 of the first embodiment, except that some processing is different. The processing in the occupant-related state identification section 101b also corresponds to the occupant-related state identification step. The occupant-related state identification unit 101b has a drowsiness identification unit 111 and a slackness identification unit 112b as sub-functional blocks. The occupant-related condition identification unit 101b has the occupant-related condition identification unit 101b of the first embodiment, except that it has a slackness identification unit 112a instead of the slackness identification unit 112 and that it does not have the physique identification unit 113. It is similar to the state identification unit 101 .
緩み具合特定部112bは、感圧センサ70で検出した結果を用いて、シートベルトの緩み具合を特定する。緩み具合特定部112bは、シートベルトの緩み具合が大きくなるのに応じて、感圧センサ70で検出される圧力値が小さくなる関係を利用して、感圧センサ70で検出される圧力値から、シートベルトの緩み具合を特定すればよい。シートベルトの緩み具合は、3段階以上に区分して特定してもよいし、緩んでいると緩んでいないとの2段階に区分して特定してもよい。緩んでいると緩んでいないとの2段階に区分して特定する場合は、圧力値がこの区分のための閾値以下か否かで区分して特定すればよい。
The slackness specifying unit 112b uses the result detected by the pressure sensor 70 to specify the slackness of the seat belt. Based on the pressure value detected by the pressure sensor 70, the slackness specifying unit 112b utilizes the relationship that the pressure value detected by the pressure sensor 70 decreases as the slackness of the seat belt increases. , the slackness of the seat belt should be specified. The degree of slackness of the seat belt may be specified by classifying it into three or more levels, or by classifying it into two levels, that is, looseness and not slackness. In the case of classifying into two stages of loosening and not loosening and specifying, it is possible to classify and specify whether the pressure value is equal to or less than the threshold value for this class.
最適決定部103bは、緩み具合特定部112で特定した緩み具合の代わりに緩み具合特定部112bで特定した緩み具合を用いる点と、体格特定部113で特定した乗員の体格を用いない点とを除けば、実施形態1の最適決定部103と同様である。最適決定部103bは、緩み具合特定部112bで特定するシートベルトの緩み具合が大きくなるのに応じて、そのシートベルトについての引き込み刺激の強度を高く決定する。
The optimal determination unit 103b uses the slackness specified by the slackness specifying unit 112b instead of the slackness specified by the slackness specifying unit 112, and does not use the physique of the occupant specified by the physique specifying unit 113. Except for this, it is the same as the optimum determining unit 103 of the first embodiment. The optimum determining unit 103b determines a higher strength of the pulling stimulus for the seat belt as the degree of slackness of the seat belt specified by the slackness specifying unit 112b increases.
なお、実施形態3の構成と実施形態2の構成とを組み合わせても構わない。実施形態3の構成であっても、乗員が装着するシートベルトの緩み具合に応じて、引き込み刺激の強度を変化させるので、シートベルトの緩み具合にかかわらず引き込み刺激の強度を変化させない場合に比べ、乗員にとってより適切な刺激にすることが可能になる。
Note that the configuration of the third embodiment and the configuration of the second embodiment may be combined. Even with the configuration of the third embodiment, the strength of the retraction stimulus is changed according to the degree of looseness of the seat belt worn by the occupant. , it becomes possible to make it a more appropriate stimulus for the occupant.
(実施形態4)
また、シートベルトの緩み具合を特定する構成として、例えば、以下の実施形態4の構成としてもよい。以下では、実施形態4の一例について図を用いて説明する。実施形態4の覚醒維持システム1は、HCU10の代わりにHCU10cを含む点を除けば、実施形態1の覚醒維持システム1と同様である。 (Embodiment 4)
Further, as a configuration for specifying the looseness of the seat belt, for example, the configuration of the following embodiment 4 may be used. An example of the fourth embodiment will be described below with reference to the drawings. The wakefulness-maintainingsystem 1 of Embodiment 4 is the same as the wakefulness-maintaining system 1 of Embodiment 1 except that it includes an HCU 10c instead of the HCU 10. FIG.
また、シートベルトの緩み具合を特定する構成として、例えば、以下の実施形態4の構成としてもよい。以下では、実施形態4の一例について図を用いて説明する。実施形態4の覚醒維持システム1は、HCU10の代わりにHCU10cを含む点を除けば、実施形態1の覚醒維持システム1と同様である。 (Embodiment 4)
Further, as a configuration for specifying the looseness of the seat belt, for example, the configuration of the following embodiment 4 may be used. An example of the fourth embodiment will be described below with reference to the drawings. The wakefulness-maintaining
ここで、図10を用いてHCU10cの概略構成についての説明を行う。HCU10cは、図10に示すように、乗員関連状態特定部101c、提示制御部102、最適決定部103c、引き込み制御部104、及び電流モニタ部105を機能ブロックとして備える。HCU10cは、乗員関連状態特定部101及び最適決定部103の代わりに、乗員関連状態特定部101c及び最適決定部103cを備える点と、電流モニタ部105を備える点とを除けば、実施形態1のHCU10と同様である。このHCU10cも覚醒維持装置に相当する。また、コンピュータによってHCU10cの各機能ブロックの処理が実行されることが、覚醒維持方法が実行されることに相当する。
Here, the schematic configuration of the HCU 10c will be explained using FIG. As shown in FIG. 10, the HCU 10c includes an occupant-related state identification unit 101c, a presentation control unit 102, an optimum determination unit 103c, a pull-in control unit 104, and a current monitor unit 105 as functional blocks. The HCU 10c is similar to that of the first embodiment, except that it includes an occupant-related state identification unit 101c and an optimum determination unit 103c instead of the occupant-related state identification unit 101 and the optimum determination unit 103, and a current monitor unit 105. It is the same as HCU10. This HCU 10c also corresponds to a wakefulness maintenance device. Execution of the process of each functional block of the HCU 10c by the computer corresponds to execution of the wakefulness maintaining method.
電流モニタ部105は、シートベルトアクチュエータ50のモータ電流値を取得する。乗員関連状態特定部101cは、一部の処理が異なる点を除けば、実施形態1の乗員関連状態特定部101と同様である。この乗員関連状態特定部101cでの処理も乗員関連状態特定工程に相当する。乗員関連状態特定部101cは、眠気特定部111及び緩み具合特定部112cをサブ機能ブロックとして有している。乗員関連状態特定部101cは、緩み具合特定部112の代わりに緩み具合特定部112cを有している点と、体格特定部113を有していない点とを除けば、実施形態1の乗員関連状態特定部101と同様である。
The current monitor unit 105 acquires the motor current value of the seatbelt actuator 50 . The occupant-related state identification unit 101c is the same as the occupant-related state identification unit 101 of the first embodiment, except that some processing is different. The processing in the occupant-related state identification unit 101c also corresponds to the occupant-related state identification step. The occupant-related state identification unit 101c has a drowsiness identification unit 111 and a slackness identification unit 112c as sub-functional blocks. The occupant-related state identification unit 101c has the occupant-related state identification unit 101c of the first embodiment, except that it has the slackness identification unit 112c instead of the slackness identification unit 112 and that it does not have the physique identification unit 113. It is similar to the state identification unit 101 .
緩み具合特定部112cは、電流モニタ部105で取得したモータ電流値を用いて、シートベルトの緩み具合を特定する。緩み具合特定部112cは、シートベルトの緩み具合が大きくなるのに応じて、電流モニタ部105で取得されるモータ電流値が小さくなる関係を利用して、電流モニタ部105で取得されるモータ電流値から、シートベルトの緩み具合を特定すればよい。緩み具合特定部112cは、運転者の眠気が例えば第1の閾値以上である場合に、定期的にシートベルトアクチュエータ50に通電させてシートベルトを巻き取らせ、シートベルトアクチュエータ50のモータ電流値を取得すればよい。シートベルトアクチュエータ50は、モータ電流値が取得された後は、モータ電流値の取得前のシートベルトの引き込み量に戻せばよい。
The looseness specifying unit 112c uses the motor current value acquired by the current monitor unit 105 to specify the looseness of the seat belt. The slackness specifying unit 112c uses the relationship that the motor current value acquired by the current monitor unit 105 decreases as the slackness of the seat belt increases. From the value, the slackness of the seat belt can be identified. For example, when the drowsiness of the driver is greater than or equal to the first threshold, the looseness specifying unit 112c periodically energizes the seatbelt actuator 50 to wind the seatbelt, and adjusts the motor current value of the seatbelt actuator 50 to You should get it. After the motor current value is acquired, the seat belt actuator 50 may return the seat belt retraction amount to the amount before the motor current value was acquired.
ここで、図11を用いて、シートベルトの緩み具合に応じたモータ電流値の一例を示す。図11のLLが、シートベルトの緩み具合が大きい場合の例を示す。図11のSLが、シートベルトの緩み具合が小さい場合の例を示す。図11のt(s)は、緩み具合の特定に必要なマスキング時間とする。図11のM(A)は、モータ電流の閾値とする。シートベルトアクチュエータ50への通電は、マスキング時間t(s)の経過後、モータ電流が閾値M(A)を超えるまで継続すればよい。これにより、シートベルトを巻き取り過ぎないようにすればよい。図11に示すように、シートベルトアクチュエータ50のモータ電流値は、シートベルトアクチュエータ50に通電した場合に、シートベルトの緩み具合が大きくなると、より低い値が出力される。
Here, using FIG. 11, an example of the motor current value corresponding to the looseness of the seat belt is shown. LL in FIG. 11 indicates an example in which the degree of looseness of the seat belt is large. SL in FIG. 11 indicates an example in which the looseness of the seat belt is small. Let t(s) in FIG. 11 be the masking time required to identify the degree of looseness. M(A) in FIG. 11 is the threshold value of the motor current. The energization of the seatbelt actuator 50 may be continued until the motor current exceeds the threshold value M(A) after the masking time t(s) has elapsed. This should prevent the seat belt from being wound too much. As shown in FIG. 11, when the seat belt actuator 50 is energized, the motor current value of the seat belt actuator 50 is output at a lower value as the degree of looseness of the seat belt increases.
なお、緩み具合特定部112cで特定するシートベルトの緩み具合は、3段階以上に区分して特定してもよいし、緩んでいると緩んでいないとの2段階に区分して特定してもよい。緩んでいると緩んでいないとの2段階に区分して特定する場合は、圧力値がこの区分のための閾値以下か否かで区分して特定すればよい。
The slackness of the seat belt specified by the slackness specifying unit 112c may be specified by classifying it into three or more stages, or it may be specified by classifying it into two stages, i.e., loose and not loose. good. In the case of classifying into two stages of loosening and not loosening and specifying, it is possible to classify and specify whether the pressure value is equal to or less than the threshold value for this class.
最適決定部103bは、緩み具合特定部112で特定した緩み具合の代わりに緩み具合特定部112cで特定した緩み具合を用いる点と、体格特定部113で特定した乗員の体格を用いない点とを除けば、実施形態1の最適決定部103と同様である。最適決定部103cは、緩み具合特定部112cで特定するシートベルトの緩み具合が大きくなるのに応じて、そのシートベルトについての引き込み刺激の強度を高く決定する。
Optimal determination section 103b uses the degree of slackness identified by slackness identification section 112c instead of the degree of slackness identified by slackness identification section 112, and does not use the physique of the occupant identified by physique identification section 113. Except for this, it is the same as the optimum determining unit 103 of the first embodiment. The optimum determining unit 103c determines a higher strength of the pulling stimulus for the seat belt as the degree of slackness of the seat belt specified by the slackness specifying unit 112c increases.
なお、実施形態4の構成と実施形態2の構成とを組み合わせても構わない。実施形態4の構成であっても、乗員が装着するシートベルトの緩み具合に応じて、引き込み刺激の強度を変化させるので、シートベルトの緩み具合にかかわらず引き込み刺激の強度を変化させない場合に比べ、乗員にとってより適切な刺激にすることが可能になる。
Note that the configuration of the fourth embodiment and the configuration of the second embodiment may be combined. Even with the configuration of Embodiment 4, the strength of the retraction stimulus is changed according to the degree of looseness of the seat belt worn by the occupant. , it becomes possible to make it a more appropriate stimulus for the occupant.
(実施形態5)
前述の実施形態では、緩み具合特定部112,112a,112b,112cで特定した緩み具合,体格特定部113で特定した体格に応じて、引き込み刺激の態様を変化させる構成を示したが、必ずしもこれに限らない。例えば、緩み具合特定部112,112a,112b,112cで特定した緩み具合,体格特定部113で特定した体格に応じた引き込み刺激の態様の変化を行わせえない構成としてもよい。 (Embodiment 5)
In the above-described embodiment, a configuration was shown in which the mode of attraction stimulus is changed according to the looseness specified by the looseness specifying units 112, 112a, 112b, and 112c and the physique specified by the physique specifying unit 113, but this is not necessarily the case. is not limited to For example, a configuration may be adopted in which the mode of the attraction stimulus is not changed according to the slackness specified by the slackness specifying units 112 , 112 a , 112 b , and 112 c and the physique specified by the physique specifying unit 113 .
前述の実施形態では、緩み具合特定部112,112a,112b,112cで特定した緩み具合,体格特定部113で特定した体格に応じて、引き込み刺激の態様を変化させる構成を示したが、必ずしもこれに限らない。例えば、緩み具合特定部112,112a,112b,112cで特定した緩み具合,体格特定部113で特定した体格に応じた引き込み刺激の態様の変化を行わせえない構成としてもよい。 (Embodiment 5)
In the above-described embodiment, a configuration was shown in which the mode of attraction stimulus is changed according to the looseness specified by the
(実施形態6)
前述の実施形態では、覚醒維持関連処理をHCU10,10a,10b,10cが担う構成を示したが、必ずしもこれに限らない。例えば、覚醒維持関連処理をHCU10,10a,10b,10cと他のECUとで担う構成としてもよいし、覚醒維持関連処理を他のECUが担う構成としてもよい。 (Embodiment 6)
In the above-described embodiment, the HCUs 10, 10a, 10b, and 10c are responsible for the wakefulness maintenance related process, but this is not necessarily the case. For example, the HCUs 10, 10a, 10b, and 10c and another ECU may be responsible for the wakefulness maintenance related process, or the other ECU may be responsible for the wakefulness maintenance related process.
前述の実施形態では、覚醒維持関連処理をHCU10,10a,10b,10cが担う構成を示したが、必ずしもこれに限らない。例えば、覚醒維持関連処理をHCU10,10a,10b,10cと他のECUとで担う構成としてもよいし、覚醒維持関連処理を他のECUが担う構成としてもよい。 (Embodiment 6)
In the above-described embodiment, the
(実施形態7)
前述の実施形態では、覚醒維持システム1,1bが自動車で用いられる構成を示したが、必ずしもこれに限らない。覚醒維持システム1,1bはシートベルトを用いる移動体であれば、種々の移動体で用いることが可能である。 (Embodiment 7)
Although the wakefulness maintenance systems 1 and 1b are used in automobiles in the above-described embodiments, the configuration is not necessarily limited to this. The wakefulness maintenance systems 1 and 1b can be used in various moving bodies as long as they use seat belts.
前述の実施形態では、覚醒維持システム1,1bが自動車で用いられる構成を示したが、必ずしもこれに限らない。覚醒維持システム1,1bはシートベルトを用いる移動体であれば、種々の移動体で用いることが可能である。 (Embodiment 7)
Although the
なお、本開示は、上述した実施形態に限定されるものではなく、請求項に示した範囲で種々の変更が可能であり、異なる実施形態にそれぞれ開示された技術的手段を適宜組み合わせて得られる実施形態についても本開示の技術的範囲に含まれる。また、本開示に記載の制御部及びその手法は、コンピュータプログラムにより具体化された一つ乃至は複数の機能を実行するようにプログラムされたプロセッサを構成する専用コンピュータにより、実現されてもよい。あるいは、本開示に記載の装置及びその手法は、専用ハードウェア論理回路により、実現されてもよい。もしくは、本開示に記載の装置及びその手法は、コンピュータプログラムを実行するプロセッサと一つ以上のハードウェア論理回路との組み合わせにより構成された一つ以上の専用コンピュータにより、実現されてもよい。また、コンピュータプログラムは、コンピュータにより実行されるインストラクションとして、コンピュータ読み取り可能な非遷移有形記録媒体に記憶されていてもよい。
It should be noted that the present disclosure is not limited to the above-described embodiments, and can be modified in various ways within the scope of the claims, and can be obtained by appropriately combining technical means disclosed in different embodiments. Embodiments are also included in the technical scope of the present disclosure. The controller and techniques described in this disclosure may also be implemented by a special purpose computer comprising a processor programmed to perform one or more functions embodied by a computer program. Alternatively, the apparatus and techniques described in this disclosure may be implemented by dedicated hardware logic circuitry. Alternatively, the apparatus and techniques described in this disclosure may be implemented by one or more special purpose computers configured in combination with a processor executing a computer program and one or more hardware logic circuits. The computer program may also be stored as computer-executable instructions on a computer-readable non-transitional tangible recording medium.
Claims (12)
- 車両で用いることが可能な覚醒維持装置であって、
少なくとも前記車両の乗員の眠気の度合いを含む、前記乗員に関連する状態である乗員関連状態を特定する乗員関連状態特定部(101,101a,101b,101c)と、
前記乗員関連状態特定部で特定する前記乗員の眠気の度合いが第1の閾値以上であることをもとに、その乗員の装着するシートベルトの引き込みによる刺激である引き込み刺激を行わせる引き込み制御部(104,104a)とを備え、
前記引き込み制御部は、前記乗員関連状態特定部で特定する前記乗員関連状態に応じて、前記引き込み刺激の態様を変化させる覚醒維持装置。 A wakefulness maintenance device that can be used in a vehicle,
an occupant-related state identifying unit (101, 101a, 101b, 101c) that identifies an occupant-related state, which is a state related to the occupant, including at least the degree of drowsiness of the occupant of the vehicle;
Based on the fact that the degree of drowsiness of the occupant specified by the occupant-related state specifying unit is equal to or greater than a first threshold, a retraction control unit that performs a retraction stimulus, which is a stimulus caused by retraction of the seat belt worn by the occupant. (104, 104a);
The wakefulness maintenance device, wherein the withdrawal control section changes the mode of the withdrawal stimulus in accordance with the occupant-related state specified by the occupant-related state specifying section. - 請求項1に記載の覚醒維持装置であって、
前記引き込み制御部は、前記乗員関連状態特定部で特定する前記乗員の眠気の度合いに応じて、前記引き込み刺激の態様として、前記引き込み刺激の強度及びパターンの少なくともいずれかを変化させる覚醒維持装置。 The wakefulness maintenance device according to claim 1,
The wake-up control unit changes at least one of the intensity and pattern of the pull-in stimulus as the mode of the pull-in stimulus according to the degree of drowsiness of the occupant specified by the occupant-related state specifying unit. - 請求項2に記載の覚醒維持装置であって、
前記引き込み制御部は、前記引き込み刺激を複数回の刺激を1セットとして行わせるものであり、前記乗員関連状態特定部で特定する前記乗員の眠気の度合いが高くなるのに応じて、前記引き込み刺激の態様として、複数回の刺激を1セットとする前記引き込み刺激の1セット内での刺激の間隔を短くさせる覚醒維持装置。 The wakefulness maintenance device according to claim 2,
The pull-in control unit causes the pull-in stimulation to be performed a plurality of times as one set. 3. A device for maintaining wakefulness, in which stimulation intervals are shortened in one set of the withdrawal stimulations, wherein one set consists of a plurality of stimulations. - 請求項2又は3に記載の覚醒維持装置であって、
前記引き込み制御部は、前記引き込み刺激を複数回の刺激を1セットとして行わせるものであり、前記乗員関連状態特定部で特定する前記乗員の眠気の度合いが高くなるのに応じて、前記引き込み刺激の態様として、複数回の刺激を1セットとする前記引き込み刺激の1セットごとの刺激の頻度を高くさせる覚醒維持装置。 The wakefulness maintenance device according to claim 2 or 3,
The pull-in control unit causes the pull-in stimulation to be performed a plurality of times as one set. 3. A device for maintaining wakefulness, which increases the frequency of stimulation for each set of the attraction stimulations, each set consisting of a plurality of stimulations. - 請求項2~4のいずれか1項に記載の覚醒維持装置であって、
前記引き込み制御部は、前記引き込み刺激を複数回の刺激を1セットとして行わせるものであり、複数回の刺激を1セットとする前記引き込み刺激の1セット内での最初の刺激をその後の刺激よりも弱い強度にさせる覚醒維持装置。 The wakefulness maintenance device according to any one of claims 2 to 4,
The attraction control unit performs the attraction stimulation as one set of a plurality of stimulations, and the first stimulation in one set of the attraction stimulation, which is a set of the plurality of stimulations, is performed more than the subsequent stimulations. An arousal maintenance device that makes the intensity weaker. - 請求項1~5のいずれか1項に記載の覚醒維持装置であって、
前記乗員関連状態特定部は、前記車両の乗員の眠気の度合いの他、少なくとも前記乗員の装着するシートベルトの緩み具合を含む前記乗員関連状態を特定するものであり、
前記引き込み制御部は、前記乗員関連状態特定部で特定する前記シートベルトの緩み具合が大きくなるのに応じて、前記引き込み刺激の態様として、そのシートベルトについての前記引き込み刺激の強度を高くさせる覚醒維持装置。 The wakefulness maintenance device according to any one of claims 1 to 5,
The occupant-related state identification unit identifies the occupant-related state including at least the looseness of the seat belt worn by the occupant in addition to the degree of drowsiness of the occupant of the vehicle,
The pull-in control unit increases the strength of the pull-in stimulus for the seat belt as a mode of the pull-in stimulus in response to an increase in the looseness of the seat belt specified by the occupant-related state specifying unit. maintenance device. - 請求項6に記載の覚醒維持装置であって、
前記乗員関連状態特定部(101,101a)は、前記車両の室内を撮像する室内カメラ(30)で撮像する前記乗員の撮像画像を画像認識することで前記乗員の体格も前記乗員関連状態として特定するものであり、
前記引き込み制御部は、前記乗員関連状態特定部で特定する前記乗員の体格が、その乗員についての基準となる薄着時の過去の体格よりも大きいと判断する場合には、その乗員についての基準となる体格よりも大きいと判断しない場合に比べ、その乗員の装着するシートベルトについての前記引き込み刺激の強度を高くさせる覚醒維持装置。 The wakefulness maintenance device according to claim 6,
The occupant-related state identification unit (101, 101a) identifies the physique of the occupant as the occupant-related state by recognizing the captured image of the occupant captured by an indoor camera (30) that captures the interior of the vehicle. and
When the pull-in control unit determines that the physique of the occupant identified by the occupant-related state identification unit is larger than the physique of the occupant in the past when the occupant was lightly dressed, the physique of the occupant is determined as the reference for the occupant. A wakefulness maintaining device that increases the strength of the retraction stimulus for the seat belt worn by the occupant, compared to the case where it is not determined that the occupant is larger than the physique of the occupant. - 請求項6又は7に記載の覚醒維持装置であって、
前記乗員関連状態特定部(101,101a)は、前記車両の室内を撮像する室内カメラ(30)で撮像する前記乗員の撮像画像を画像認識することで前記乗員の体格も前記乗員関連状態として特定するものであり、
前記引き込み制御部は、前記乗員関連状態特定部で特定する前記乗員の体格が規定値以上の場合には、その乗員の体格が前記規定値未満の場合に比べ、その乗員の装着するシートベルトについての前記引き込み刺激の強度を高くさせる覚醒維持装置。 The wakefulness maintenance device according to claim 6 or 7,
The occupant-related state identification unit (101, 101a) identifies the physique of the occupant as the occupant-related state by recognizing the captured image of the occupant captured by an indoor camera (30) that captures the interior of the vehicle. and
When the physique of the occupant identified by the occupant-related state identification unit is equal to or greater than a specified value, the seat belt worn by the occupant is more likely to be seat belt-tight than when the physique of the occupant is less than the specified value. A wakefulness maintenance device that increases the intensity of the withdrawal stimulus. - 請求項1~8のいずれか1項に記載の覚醒維持装置であって、
前記乗員関連状態特定部(101,101b,101c)は、前記乗員関連状態として前記車両の運転者に関連する状態を特定するものであり、
前記引き込み制御部は、前記運転者の装着するシートベルトについての前記引き込み刺激を行わせる覚醒維持装置。 The wakefulness maintenance device according to any one of claims 1 to 8,
The occupant-related state identification unit (101, 101b, 101c) identifies a state related to the driver of the vehicle as the occupant-related state,
The pull-in control unit is an awake maintenance device that causes the pull-in stimulus to be applied to the seat belt worn by the driver. - 請求項1~8のいずれか1項に記載の覚醒維持装置であって、
前記乗員関連状態特定部(101a)は、前記乗員関連状態として前記車両の運転者及び同乗者に関連する状態を特定するものであり、
前記引き込み制御部(104a)は、前記運転者及び前記同乗者の装着するシートベルトについての前記引き込み刺激を行わせることが可能であり、前記乗員関連状態特定部で特定する前記運転者の眠気が第2の閾値未満の場合は前記同乗者の装着するシートベルトについての前記引き込み刺激を行わせない一方、前記乗員関連状態特定部で特定する前記運転者の眠気が前記第2の閾値以上であることをもとに、前記同乗者の装着するシートベルトについての前記引き込み刺激を行わせる覚醒維持装置。 The wakefulness maintenance device according to any one of claims 1 to 8,
The occupant-related state identification unit (101a) identifies a state related to the driver and fellow passengers of the vehicle as the occupant-related state,
The pull-in control unit (104a) is capable of causing the pull-in stimulus for seat belts worn by the driver and the passenger, and the drowsiness of the driver specified by the occupant-related condition specifying unit. If it is less than the second threshold, the retraction stimulus for the seat belt worn by the fellow passenger is not performed, while the drowsiness of the driver identified by the occupant-related condition identification unit is equal to or greater than the second threshold. Based on this, an arousal maintaining device for performing the retraction stimulus for the seat belt worn by the fellow passenger. - 請求項10に記載の覚醒維持装置であって、
前記引き込み制御部は、前記乗員関連状態特定部で特定する前記運転者の眠気が前記第2の閾値以上の場合であっても、前記乗員関連状態特定部で特定する前記同乗者の姿勢若しくはシートのリクライニングの状態が、前記引き込み刺激の効果が低いと推定される状態である場合には、前記同乗者の装着するシートベルトについての前記引き込み刺激を行わせない覚醒維持装置。 The wakefulness maintenance device according to claim 10,
Even if the driver's drowsiness specified by the occupant-related state specifying unit is equal to or greater than the second threshold value, the pull-in control unit determines whether the posture or the seat of the fellow passenger specified by the occupant-related state specifying unit is a state in which the effect of the retraction stimulus is estimated to be low, the wakefulness maintaining device does not apply the retraction stimulus to the seat belt worn by the fellow passenger. - 車両で用いることが可能な覚醒維持方法であって、
少なくとも1つのプロセッサにより実行される、
少なくとも前記車両の乗員の眠気の度合いを含む、前記乗員に関連する状態である乗員関連状態を特定する乗員関連状態特定工程と、
前記乗員関連状態特定工程で特定した前記乗員の眠気の度合いが所定の閾値以上であることをもとに、その乗員の装着するシートベルトの引き込みによる刺激である引き込み刺激を行わせる引き込み制御工程とを含み、
前記引き込み制御工程では、前記乗員関連状態特定工程で特定した前記乗員関連状態に応じて、前記引き込み刺激の態様を変化させる覚醒維持方法。 A wakefulness maintenance method that can be used in a vehicle, comprising:
executed by at least one processor;
an occupant-related condition identifying step of identifying an occupant-related condition, which is a condition associated with the occupant, including at least a degree of drowsiness of the occupant of the vehicle;
a pull-in control step of performing a pull-in stimulus, which is a pull-in stimulus of the seat belt worn by the occupant, based on the fact that the degree of drowsiness of the occupant identified in the occupant-related state identification step is equal to or greater than a predetermined threshold; including
The method for maintaining wakefulness, wherein in the attraction control step, a mode of the attraction stimulus is changed in accordance with the occupant-related state identified in the occupant-related state identification step.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021-111687 | 2021-07-05 | ||
JP2021111687A JP2023008263A (en) | 2021-07-05 | 2021-07-05 | Wakefulness maintaining device and wakefulness maintaining method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023281977A1 true WO2023281977A1 (en) | 2023-01-12 |
Family
ID=84800538
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/023313 WO2023281977A1 (en) | 2021-07-05 | 2022-06-09 | Wakefulness maintaining device and wakefulness maintaining method |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2023008263A (en) |
WO (1) | WO2023281977A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0671338U (en) * | 1993-03-22 | 1994-10-07 | 日産ディーゼル工業株式会社 | Dozing driving alarm device |
JP2000006759A (en) * | 1998-06-22 | 2000-01-11 | Nippon Seiko Kk | Occupant constraining/protecting device for vehicle |
JP2005028916A (en) * | 2003-07-08 | 2005-02-03 | Tokai Rika Co Ltd | Control device of seat belt device |
JP2009261516A (en) * | 2008-04-23 | 2009-11-12 | Toyota Motor Corp | Estimation device for wakefulness level |
JP2014511301A (en) * | 2011-02-18 | 2014-05-15 | 本田技研工業株式会社 | System and method for responding to driver behavior |
JP2020011614A (en) * | 2018-07-18 | 2020-01-23 | トヨタ自動車株式会社 | Seatbelt control device |
-
2021
- 2021-07-05 JP JP2021111687A patent/JP2023008263A/en active Pending
-
2022
- 2022-06-09 WO PCT/JP2022/023313 patent/WO2023281977A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0671338U (en) * | 1993-03-22 | 1994-10-07 | 日産ディーゼル工業株式会社 | Dozing driving alarm device |
JP2000006759A (en) * | 1998-06-22 | 2000-01-11 | Nippon Seiko Kk | Occupant constraining/protecting device for vehicle |
JP2005028916A (en) * | 2003-07-08 | 2005-02-03 | Tokai Rika Co Ltd | Control device of seat belt device |
JP2009261516A (en) * | 2008-04-23 | 2009-11-12 | Toyota Motor Corp | Estimation device for wakefulness level |
JP2014511301A (en) * | 2011-02-18 | 2014-05-15 | 本田技研工業株式会社 | System and method for responding to driver behavior |
JP2020011614A (en) * | 2018-07-18 | 2020-01-23 | トヨタ自動車株式会社 | Seatbelt control device |
Also Published As
Publication number | Publication date |
---|---|
JP2023008263A (en) | 2023-01-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11195405B2 (en) | Dozing alert apparatus | |
EP3390131B1 (en) | Method for operating a motor vehicle with a state monitoring device, driver assistance system and motor vehicle | |
CN105015445B (en) | Driver used for vehicles carries out the method and system of auxiliary relevant to people | |
US20180319407A1 (en) | Integration of occupant monitoring systems with vehicle control systems | |
CN104908687B (en) | Method for allowing an increased performance nap in a motor vehicle | |
US8823792B2 (en) | Wakefulness level estimation apparatus | |
JP5177102B2 (en) | Driving assistance device | |
US20190100175A1 (en) | Automatic brake control apparatus and computer-readable non-transitory storage medium | |
US11751784B2 (en) | Systems and methods for detecting drowsiness in a driver of a vehicle | |
JP5125866B2 (en) | Sleep support system | |
WO2022124163A1 (en) | Awakening device, and awakening stimulus control method | |
KR102679466B1 (en) | Vehicle and control method for the same | |
US11430231B2 (en) | Emotion estimation device and emotion estimation method | |
JP7087286B2 (en) | Awakening maintenance device | |
WO2023281977A1 (en) | Wakefulness maintaining device and wakefulness maintaining method | |
CN110239555A (en) | A kind of device and method of auxiliary vehicle safety operation | |
CN116901881A (en) | Vehicle occupant monitoring and sedation system | |
WO2019026553A1 (en) | Alertness maintenance device | |
JP7494771B2 (en) | Driver Awakening Maintenance Device | |
JP2022179108A (en) | Awakening support system | |
JP2023017603A (en) | Awakening Support Device and Awakening Support Method | |
JP2024115254A (en) | Control device and control system | |
JP2022155395A (en) | Driving assistance system | |
JP2022155393A (en) | Driving assistance system | |
JP2022188678A (en) | Control device, control system, and control method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22837396 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22837396 Country of ref document: EP Kind code of ref document: A1 |