JP2020136748A - Crewman monitoring device - Google Patents

Abstract

To improve performance in detection and monitoring of a crewman in a chamber of a vehicle by reducing a dead angle of a crewman detection unit.SOLUTION: A crewman monitoring device comprises: an image sensor 3a and a biological sensor 3d that detect a crewman M in a vehicle chamber K of a vehicle 30 in a non-contact manner; a control unit that monitors the crewman on the basis of a detection result from them; and a moving unit 4 that moves the image sensor 3a and the biological sensor 3d to cross directions F and B in the vehicle chamber K in which sheets 31 to 34 on which each crewman M sit are arranged. A detection range G of the image sensor 3a and a detection range E of the biological sensor 3d are set to be shifted in the cross directions F and B of the vehicle 30 so as to be achieved to left and right both side walls of the vehicle chamber K. The control unit moves the detection ranges G and E of the image sensor 3a and the biological sensor 3d so as to exceed a backrest part 3y of the sheets 31 to 34 while moving the image sensor 3a and the biological sensor 3d by the moving unit 4 in the cross directions F and B.SELECTED DRAWING: Figure 2A

Description

The present invention relates to an occupant monitoring device that monitors an occupant in a vehicle interior.

Crew monitoring devices that monitor occupants in a vehicle are known to prevent accidents in the vehicle (for example, Patent Documents 1 to 5). This occupant monitoring device is provided with an occupant detection unit that detects occupants in the room in a non-contact manner. In order to improve the detection performance of the occupant, a plurality or a plurality of types of occupant detection units may be used.

In Patent Document 1, as an occupant detection unit, an imaging device that images the face of a driver of an automobile and a biological sensor that transmits and receives radio waves to detect biological information such as the driver's heart rate and blood pressure are provided. There is. Then, based on the data of the image captured by the imaging device and the biological information detected by the biological sensor, the driver's arousal state and physical condition are determined, and the driver is warned based on the determination result. There is.

In Patent Document 2, as an occupant detection unit, a camera that images the interior of an automobile, an ultrasonic sensor that detects a change in wind pressure inside the vehicle, a microphone that detects a sound inside the vehicle, or a change in load applied to a seat is detected. A seat sensor is provided. In addition, an abnormality detection unit for detecting an environmental abnormality in the vehicle interior, such as an internal air temperature sensor or a CO sensor, is provided. Then, when the occupant detection unit detects the intrusion of the occupant into the vehicle interior and the abnormality detection unit detects an environmental abnormality in the vehicle interior, the alarm device is operated to issue an alarm to the occupant or the outside of the vehicle. Or, in-vehicle devices such as power windows and air conditioners are operated to mitigate environmental abnormalities.

In Patent Document 3 and Patent Document 4, an infrared sensor for detecting the head of an occupant seated in the front seat or the rear seat of an automobile is provided as an occupant detection unit. Further, in Patent Document 3, an infrared sensor is fixed backward on the upper side of the windshield in order to accurately detect the number, face, and position of occupants. Then, the occupant detection range of the infrared sensor is set based on the result of detecting the seated state of the occupants in each seat by the seatbelt switch. In Patent Document 4, an infrared sensor is fixed backward from the center line of the driver's seat back to the inside of the vehicle in order to detect an occupant seated in the rear seat without being affected by a blind spot or the outside air temperature. ..

In Patent Document 5, two surveillance cameras, a human detection sensor, or a weight detection sensor are provided as occupant detection units in the vehicle interior of a railway vehicle. Two rails are laid on the ceiling (or wall) in the vehicle interior at predetermined intervals in the left-right direction of the vehicle. Each surveillance camera moves in the front-rear direction of the vehicle along each rail and images the inside of the vehicle. The human detection sensor is fixed to the ceiling, wall, or shelf, and detects an occupant in the vehicle interior. The weight sensor is located under the seat in the vehicle interior and detects the seating of the occupant by the change of the load. Then, based on the image captured by the surveillance camera, the detection result of the human sensing sensor, or the detection result of the weight sensing sensor, the occupant is detected, the degree of congestion in the vehicle interior is calculated, and the surveillance camera is calculated according to the degree of congestion. Is moving.

On the other hand, Patent Document 6 discloses a structure in which a roof camera that images the outer periphery of an automobile is moved in the front-rear direction along a roof rail installed on the upper surface of the automobile. Further, Patent Document 7 discloses a technique in which rails extending in the front-rear direction and the left-right direction are installed on the ceiling of the vehicle interior of an automobile, and the projector is moved along the rails. Further, Patent Document 8 discloses a technique in which a rail extending in the front-rear direction is installed on the floor of the vehicle interior of an automobile, and a power supply device is moved along the rail.

JP-A-2018-158696 Japanese Patent No. 5201531 Japanese Unexamined Patent Publication No. 2005-186878 Japanese Unexamined Patent Publication No. 2005-257327 Japanese Unexamined Patent Publication No. 2012-69022 Japanese Unexamined Patent Publication No. 2008-162308 JP-A-2009-298201 Japanese Unexamined Patent Publication No. 2008-149752

The area outside the detection range of the occupant detection unit is a blind spot where the occupant detection unit cannot detect the occupant. Therefore, when the detection range of the occupant detection unit is narrower than the interior of the vehicle, a blind spot of the occupant detection unit occurs in the interior.

Further, in the interior of the vehicle, a plurality of seats on which the occupant sits are arranged in the front-rear direction and the left-right direction. In particular, in vehicles such as automobiles, railroad vehicles, and airplanes, where the length in the front-rear direction (total length) is longer than the length in the left-right direction (width), the interior is also longer in the front-rear direction than the length in the left-right direction. The number of seats arranged in the front-rear direction is larger than the number of seats arranged in the direction. The seat is provided with a seating portion, a backrest portion, and a headrest, and a structure such as a metal frame is provided inside these portions. The surface of each part of the sheet is covered with a light-shielding leather or cloth.

Therefore, when the occupant detection unit is fixed in the vehicle interior, a blind spot of the occupant detection unit is generated on the side opposite to the occupant detection unit with respect to the backrest portion and the headrest of the seat. In addition, even if an attempt is made to fix the occupant detection unit at a position in the vehicle interior where blind spots are not generated as much as possible, it is difficult to fix the occupant detection unit at an appropriate position because the number and arrangement of seats differ depending on the vehicle. is there. Further, even if the occupant detection unit is fixed at a position where a blind spot is not generated as much as possible, if the number or arrangement of seats is changed by the user, a blind spot may be generated or the blind spot may be widened. Further, even when the occupant detection unit is moved in the front-rear direction in the vehicle interior as in Patent Document 5, the detection range of the occupant detection unit must reach both ends of the vehicle interior in the left-right direction in which the occupant detection unit cannot move. For example, blind spots of the occupant detection unit are generated at both the left and right ends. If a blind spot of the occupant detection unit is generated in the interior of the vehicle as described above, the performance of detecting and monitoring the occupant in the interior is deteriorated.

An object of the present invention is to provide an occupant monitoring device capable of reducing a blind spot of an occupant detection unit and improving the performance of detecting and monitoring an occupant in a vehicle interior.

The occupant monitoring device according to the present invention includes an occupant detection unit that non-contactly detects an occupant in the vehicle interior, and a control unit that controls the occupant detection unit and monitors the occupant based on the detection result of the occupant detection unit. To be equipped. The occupant detection unit includes a first occupant detection unit and a second occupant detection unit provided in the room of different types, and the detection range of the first occupant detection unit and the detection range of the second occupant detection unit are vehicles. It is set to deviate in the front-rear direction and reach both side walls of the room in the left-right direction of the vehicle. Further, a moving unit for moving the first occupant detection unit and the second occupant detection unit is provided in the front-rear direction of the room in which a plurality of seats on which the occupants sit are arranged. The control unit controls the moving unit to move the first occupant detection unit and the second occupant detection unit in the front-rear direction, and shifts the detection range of the first occupant detection unit and the detection range of the second occupant detection unit. , Move it over the backrest of the seat.

According to the above, the first occupant detection unit and the second occupant detection unit of different types are provided in the vehicle interior, and the detection ranges of the first occupant detection unit and the second occupant detection unit are shifted in the front-rear direction of the vehicle. .. Therefore, the detection ranges of the first occupant detection unit and the second occupant detection unit can be expanded in the front-rear direction. Further, the detection ranges of the first occupant detection unit and the second occupant detection unit are set so as to reach both side walls of the vehicle in the left-right direction of the vehicle. Therefore, it is possible to reduce the blind spots of the first occupant detection unit and the second occupant detection unit that occur at both ends in the left-right direction of the room. Further, the moving unit moves the first occupant detection unit and the second occupant detection unit in the front-rear direction in the room in which a plurality of seats on which the occupants sit are arranged. Then, the detection ranges of the first occupant detection unit and the second occupant detection unit move in the front-rear direction so as to exceed the backrest portion of the seat. Therefore, the detection ranges of the first occupant detection unit and the second occupant detection unit are further expanded in the front-rear direction to reduce the blind spots of the first occupant detection unit and the second occupant detection unit generated at the end of the room in the front-rear direction. Can be made to. In addition, the number of installations of the first occupant detection unit and the second occupant detection unit can be kept small. Further, it is possible to reduce the blind spot of each occupant detection unit generated on the side opposite to each occupant detection unit with respect to the backrest portion of the seat in the room and the headrest provided on the backrest portion. In addition, even if the number and arrangement of seats differ depending on the vehicle, or the number and arrangement of seats can be changed by the user, the movable range of the moving parts of the first occupant detection unit and the second occupant detection unit is taken into consideration. Then, since the first occupant detection unit and the second occupant detection unit may be installed in an appropriate range, their installation can be facilitated. In addition, the blind spot of each occupant detection unit caused by the number and arrangement of seats can be reduced. As described above, it is possible to reduce the blind spot of each occupant detection unit and improve the performance of detecting and monitoring the occupant in the room.

In the present invention, in the occupant monitoring device, the control unit moves the first occupant detection unit and the second occupant detection unit in the front-rear direction by the moving unit not only when the vehicle is operating but also when the vehicle is stopped. The occupant may be monitored based on the detection results of the first occupant detection unit and the second occupant detection unit while moving to.

Further, in the present invention, in the occupant monitoring device, the moving unit includes the first occupant detection unit and the second occupant detection unit along the ceiling in the room and the center line of the vehicle parallel to the front-rear direction. You may move it.

Further, in the present invention, in the occupant monitoring device, the moving unit includes a single rail laid on the ceiling of the room along the center line, and the first occupant detection unit and the second occupant detection unit are It may be installed on a rail so as to line up in the front-rear direction, and may move in the front-rear direction along this rail.

Further, in the present invention, in the occupant monitoring device, the first occupant detection unit and the second occupant detection unit move in the front-rear direction to obtain the detection range of the first occupant detection unit and the detection range of the second occupant detection unit. However, the occupant space provided with the seat in the room and the load space continuously provided behind the occupant space may be moved.

Further, in the present invention, in the occupant monitoring device, the first occupant detection unit may have a camera that images the interior of the vehicle, and may detect the occupant based on the image captured by the camera. Further, the second occupant detection unit has a transmitter / receiver that transmits / receives radio waves, receives the reflected wave of the radio wave transmitted indoors by this transmitter / receiver, detects biological information based on the reflected wave, and detects the biological information. The occupant may be detected based on the information. Further, the control unit determines the occupant state or the indoor state based on the occupant detection result output from the first occupant detection unit and the image data of the camera, or is output from the second occupant detection unit. The state of the occupant may be determined based on the detection result of the occupant and the biological information.

Further, in the present invention, the occupant monitoring device further includes a position detection unit that detects the position of the first occupant detection unit and the position of the second occupant detection unit, and the control unit includes the first occupant detection unit and the second occupant detection unit. Based on the detection results of the occupant detection unit and the position detection unit, the optimum positions of the first occupant detection unit and the second occupant detection unit, which are optimal for detecting the occupant, are determined, respectively, and the first movement unit and the position detection unit determine the optimum positions. The occupant detection unit and the second occupant detection unit may be moved to the optimum positions.

Further, in the present invention, in the occupant monitoring device, the control unit moves the first occupant detection unit and the second occupant detection unit to the optimum positions, respectively, and then the first occupant detection unit and the second occupant detection unit. Based on the detection result, the occupant is monitored, the success or failure of the predetermined movement condition is determined, and when the movement condition is satisfied, the detection results of the first occupant detection unit, the second occupant detection unit, and the position detection unit are displayed again. Based on this, the optimum positions of the first occupant detection unit and the second occupant detection unit may be determined, and the first occupant detection unit and the second occupant detection unit may be moved to the optimum positions, respectively.

Further, in the present invention, in the occupant monitoring device, the control unit determines the position of the occupant or the arrangement of the seat based on the detection result of the position detection unit, the first occupant detection unit, or the second occupant detection unit. Further, the optimum positions of the first occupant detection unit and the second occupant detection unit may be determined based on the position of the occupant or the arrangement of the seat.

Further, in the present invention, the occupant monitoring device further includes a communication unit for communicating with the external device, and the control unit transmits the occupant monitoring result to the external device by the communication unit and is based on the occupant monitoring result. When the success or failure of the predetermined alarm condition is determined and the alarm condition is satisfied, the predetermined alarm instruction signal may be transmitted to the external device by the communication unit.

According to the present invention, it is possible to provide an occupant monitoring device capable of reducing the blind spot of the occupant detection unit and improving the performance of detecting and monitoring the occupant in the vehicle interior.

It is a block diagram of the occupant monitoring apparatus by embodiment of this invention. It is a side view of the vehicle interior of the vehicle equipped with the occupant monitoring device of FIG. It is a side view of the vehicle interior of the vehicle equipped with the occupant monitoring device of FIG. It is a side view of the vehicle interior of the vehicle equipped with the occupant monitoring device of FIG. It is a top view of the vehicle interior of the vehicle equipped with the occupant monitoring device of FIG. It is a top view of the vehicle interior of the vehicle equipped with the occupant monitoring device of FIG. It is a top view of the vehicle interior of the vehicle equipped with the occupant monitoring device of FIG. It is a figure which showed the structure of the moving part of FIG. It is a flowchart which showed the operation of the occupant monitoring apparatus of FIG. It is a continuation flowchart of FIG. 5A.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In each figure, the same parts or corresponding parts are designated by the same reference numerals.

First, the configuration of the occupant monitoring device 10 of the present embodiment will be described.

FIG. 1 is a configuration diagram of the occupant monitoring device 10. The occupant monitoring device 10 is mounted on a vehicle 30 composed of a four-wheeled vehicle, and monitors occupants in the vehicle interior of the vehicle 30. The vehicle 30 is an example of the "vehicle" of the present invention.

The occupant monitoring device 10 includes a control unit 1, a storage unit 2, an occupant detection unit 3, a moving unit 4, a position detection unit 5, and a communication unit 6.

The control unit 1 is composed of a CPU and a memory. The control unit 1 controls the operation of each unit of the occupant monitoring device 10. The storage unit 2 is composed of a memory. Information for the control unit 1 to control the operation of each unit and to monitor the occupants in the vehicle interior is stored in the storage unit 2. The control unit 1 reads the information from the storage unit 2 and records the information related to the monitoring of the occupant in the storage unit 2.

The occupant detection unit 3 has an image sensor 3a and a biological sensor 3d that non-contactly detect an occupant in the vehicle interior of the vehicle 30.

The image sensor 3a includes a camera 3c, an illumination unit 3L, and an image processing unit 3b. The camera 3c images the interior K of the vehicle 30. The illumination unit 3L is composed of LEDs and illuminates the imaging range of the camera 3c. The image processing unit 3b performs image processing on the captured image of the camera 3c to generate image data. The image sensor 3a detects an occupant in the vehicle interior based on the image data generated by the image processing unit 3b.

The control unit 1 determines the state of the occupant and the state of the vehicle interior based on the detection result of the occupant output from the image sensor 3a and the image data. The occupant's state in this case includes, for example, the number, position, type, posture, arousal / sleep state of the occupant, or physical or behavioral biological information of the occupant. In addition, the types of occupants include, for example, healthy adults, unhealthy adults, children, and pets (small animals). Further, the state of the passenger compartment includes the arrangement of seats on which the occupants in the passenger compartment sit or the configuration of the passenger compartment.

The biosensor 3d includes a transmitter / receiver 3e and a signal processing unit 3f. The transmitter / receiver 3e transmits a radio wave into the vehicle interior and receives the reflected wave. The signal processing unit 3f performs predetermined signal processing on the electric signal based on the reflected wave received by the transmitter / receiver 3e. The biosensor 3d detects biometric information based on the electrical signal processed by the signal processing unit 3f, and detects the occupant based on the biometric information.

The control unit 1 determines the state of the occupant based on the detection result of the occupant output from the biological sensor 3d and the biological information. The occupant's state in this case includes, for example, the number, position, type, arousal / sleep state of the occupant, or biological information such as heart rate and blood pressure. Further, the control unit 1 monitors the occupant based on the detection results of the image sensor 3a and the biological sensor 3d and the image data of the camera 3c.

The moving unit 4 is provided with motors 4a and 4d. The moving unit 4 moves the image sensor 3a and the biological sensor 3d in the vehicle interior by the driving force of the motors 4a and 4d. Details of the moving unit 4 will be described later.

The position detection unit 5 includes an encoder provided in the vicinity of each of the motors 4a and 4d, and a detection circuit for detecting a pulse emitted from each encoder (details are not shown). When the motors 4a and 4d rotate, pulses synchronized with the rotation are emitted from each encoder. The position detection unit 5 detects the pulse by the detection circuit, and detects the positions of the image sensor 3a and the biological sensor 3d, respectively, based on the number of pulses and the like.

As another example, for example, a plurality of sensors (photoelectric sensor, proximity sensor, etc.) for detecting the image sensor 3a and the biosensor 3d are arranged at predetermined intervals on the locus on which the image sensor 3a and the biosensor 3d move. May be good. Then, the positions of the image sensor 3a and the biosensor 3d may be detected based on the on / off state of the sensor.

The communication unit 6 includes a circuit for communicating with an external device via a communication bus 11 provided in the vehicle 30. The vehicle 30 is equipped with a vehicle-side ECU (electronic control unit) 12, an alarm device 13, and a communication device 14 for a portable device as external devices. The vehicle-side ECU 12, the alarm device 13, and the portable device communication device 14 are electrically connected to the communication bus 11. The control unit 1 transmits the monitoring result of the occupants in the vehicle interior and a predetermined signal to the vehicle side ECU 12 via the communication bus 11 by the communication unit 6, and the vehicle side ECU 12 transmits the power supply of the vehicle 30 and the traveling drive source (engine, etc.). ), Doors, and information indicating conditions such as vehicle speed.

The alarm device 13 includes, for example, a display or speaker that gives an alarm to an occupant in the vehicle interior of the vehicle 30, a horn or lighting that gives an alarm to a person outside the vehicle 30 or the like. The communication device 14 for a portable device wirelessly communicates with a portable device (not shown) such as a FOB or a smartphone carried by the user of the vehicle 30. The vehicle-side ECU 12 gives an alarm to the inside and outside of the vehicle 30 by the alarm device 13 based on the signal and information received from the occupant monitoring device 10 via the communication bus 11. Alternatively, the portable device communication device 14 communicates with the portable device to give a visual or auditory alarm to the user from the portable device.

2A to 2C are side views of the interior K of the vehicle 30 on which the occupant monitoring device 10 is mounted. 3A to 3C are plan views of the interior K of the vehicle 30 on which the occupant monitoring device 10 is mounted. Note that FIGS. 2A and 3A show the same state, FIGS. 2B and 3B show the same state, and FIGS. 2C and 3C show the same state. Further, in each figure, F represents the front, B represents the rear, U represents the upper side, and D represents the lower side.

As shown in FIGS. 2A to 3C, the passenger compartment K of the vehicle 30 is composed of a passenger space Ka on which the passenger M rides and a luggage space Kb on which luggage is placed. The cargo space Kb is continuously provided behind B behind the occupant space Ka.

In the occupant space Ka, a plurality of seats 31 to 34 on which the occupant M sits are arranged in the front-rear directions F and B of the vehicle 30. Specifically, as shown in FIG. 3A and the like, a driver's seat 31 is installed on the front side (F direction side) of the occupant space Ka so as to face the steering wheel 35, and on the left side (L direction side) thereof. Is equipped with a passenger seat 32. A rear seat bench seat 33 is installed behind the seats 31 and 32, and a rear seat bench seat 34 is also installed behind the rear seat bench seat 33.

The seat 31 and the seat 32 in the first row from the front side are separated from each other in the left-right directions L and R at predetermined intervals. The seats 31 and 32 in the first row and the bench seats 33 in the second row are separated from each other in the front-rear directions F and B at predetermined intervals. The bench seat 33 in the second row and the bench seat 34 in the third row are separated from each other in the front-rear directions F and B at predetermined intervals. Several occupants can be seated on the bench seats 33 and 34. Further, the bench seats 33 and 34 can be separated into several seats.

Each of the seats 31 to 34 is provided with a seating portion 3x on which the occupant M sits, a backrest portion 3y on which the occupant M leans back, and a headrest 3z that supports the head of the occupant M. As shown in FIG. 2A and the like, the headrest 3z is provided above the backrest portion 3y. The seats 31 to 34 are installed so that the backrest portion 3y, the headless, and the 3z face the front F of the vehicle 30. The positions of the seats 31 to 34 can be adjusted in the front-rear directions F and B. The angle of the backrest portion 3y of each of the sheets 31 to 34 can also be adjusted.

An image sensor 3a, a biosensor 3d, and a moving portion 4 are provided on the ceiling 36 of the vehicle interior K. The moving portion 4 includes a single rail 41. The rail 41 is laid on the ceiling 36 along a center line Q (FIG. 3A or the like) parallel to the front-rear directions F and B of the vehicle 30. The image sensor 3a and the biosensor 3d are installed on the rail 41 so as to line up in the front-rear directions F and B. The biosensor 3d is located behind B behind the image sensor 3a.

The image sensor 3a faces diagonally downward (diagonally between the rear B and the lower D) with respect to the rear B of the vehicle 30. Therefore, the imaging range of the camera 3c, that is, the detection range G of the image sensor 3a, extends at a predetermined angle in the vertical direction (vertical direction U, D) and in the horizontal direction orthogonal to the vertical direction.

As shown in FIG. 2A and the like, the detection range G of the image sensor 3a is set so as to reach the floor 37 of the vehicle interior K. Further, the detection range G of the image sensor 3a is set so as to reach the side wall 38b on the rear B behind the vehicle interior K. Further, as shown in FIG. 3A and the like, the detection range G of the image sensor 3a is set to reach both side walls 38r and 38l of the vehicle interior K in the left-right directions L and R.

The biosensor 3d faces downward D as shown in FIG. 2A and the like. Therefore, the detection range E of the biosensor 3d extends at a predetermined angle in the vertical direction and the horizontal direction, respectively, as shown in FIGS. 2A and 3A. The detection range E of the biosensor 3d is set to reach the floor 37 as shown in FIG. 2A and the like. Further, the detection range E of the biosensor 3d is set so as to capture two rows of sheets adjacent to the front-rear directions F and B among the plurality of sheets 31 to 34, as shown in FIGS. 2A and 3A. ing. Further, the detection range E of the biosensor 3d is set to reach the left and right side walls 38r and 38l of the vehicle interior K as shown in FIG. 3A and the like. Further, the detection range G of the image sensor 3a and the detection range E of the biosensor 3d are set so as to deviate from each other in the front-rear directions F and B.

FIG. 4 is a diagram showing the structure of the moving portion 4. In FIG. 4, (a) shows the cross-sectional structure of the moving portion 4 around the image sensor 3a, and (b) shows the cross-sectional structure of the moving portion 4 around the biological sensor 3d.

As shown in FIG. 4, the moving unit 4 includes rails 41, carriages 42a, 42d, driven rollers 43a, 43d, drive rollers 44a, 44d, and motors 4a, 4d.

The rail 41 is formed with a groove 41 m that opens downward D. The groove 41m extends in the front-rear direction F and B (FIG. 2A and the like) of the vehicle 30. The opening 41k of the groove 41m is narrower than the inside of the groove 41m. Driven rollers 43a and 43d are engaged in the groove 41m. The driven rollers 43a and 43d roll on the inner surface of the groove 41m.

The carriages 42a and 42d are provided with a protrusion 42t protruding upward U, a holding portion 42b opening downward D, and a storage portion 42e. The protruding portions 42t of the carriages 42a and 42b penetrate the opening 41k and are connected to the rotating shafts 43j of the driven rollers 43a and 43d, respectively.

As shown in FIG. 4A, the image sensor 3a is held by the holding portion 42b of the carriage 42a. The camera 3c of the image sensor 3a is exposed from the lower surface of the carriage 42a so that the vehicle interior K can be imaged. The motor 4a is held in the storage portion 42e of the carriage 42a. The rotating shaft 4j of the motor 4a penetrates the carriage 42a and is connected to the rotating shaft 44j of the drive roller 44a. The drive roller 44a rolls on the outer surface of the rail 41.

As shown in FIG. 4B, the biological sensor 3d is held in the holding portion 42b of the carriage 42d. The transmitter / receiver 3e of the biosensor 3d is exposed from the lower surface of the carriage 42d so that radio waves can be transmitted / received to / from the vehicle interior K. The motor 4d is held in the storage portion 42e of the carriage 42d. The rotating shaft 4j of the motor 4d penetrates the carriage 42d and is connected to the rotating shaft 44j of the drive roller 44d. The drive roller 44d rolls on the outer surface of the rail 41.

As the motors 4a and 4d rotate, the drive rollers 44a and 44d roll on the outer surface of the rail 41. Then, the carriages 42a and 42d move in the front-rear directions F and B along the ceiling 36 and the rail 41. Further, the driven rollers 43a and 43d roll on the inner surface of the groove 41m. Then, the image sensor 3a and the biosensor 3d held by the carriages 42a and 42d also move in the front-rear directions F and B along the ceiling 36 and the rail 41 as shown in FIGS. 2A to 3C.

As the image sensor 3a moves in the front-rear directions F and B as described above, as shown in FIGS. 2A to 3C, the detection range G of the image sensor 3a is the seat 31 in at least the first row of the vehicle interior K. It moves in the front-rear direction F and B so as to cross the backrest portion 3y of 32. Further, the detection range E of the biosensor 3d moves in the front-rear directions F and B so as to exceed the backrest portions 3y of the seats 31 to 33 in the first and second rows of the vehicle interior K.

Further, the image sensor 3a and the biosensor 3d move to the front F, and as shown in FIGS. 2A and 3A, the image sensor 3a is located in front of the seats 31 and 32 in the front row (first row) of the occupant space Ka. The biosensor 3d is located above U between the sheets 31 and 32. Then, the detection range G of the image sensor 3a and the detection range E of the biosensor 3d reach the seating portions 3x of the seats 31 and 32. The position Paf of the image sensor 3a shown in FIGS. 2A and 3A is the initial position of the movable range of the image sensor 3a, and the position Pdf of the biosensor 3d is the initial position of the movable range of the biosensor 3d.

Further, the image sensor 3a and the biosensor 3d move backward B, and as shown in FIGS. 2C and 3C, the image sensor 3a is located on the seat 33 in the second row, and the biosensor 3d is in the third row. It is located on the seat 34. Then, the detection range G of the image sensor 3a reaches the rear B behind the seat 33. Further, the detection range E of the biosensor 3d reaches the cargo space Kb located behind the seat 34 B. The position Pab of the image sensor 3a shown in FIGS. 2C and 3C is the rearward limiting position of the movable range of the image sensor 3a, and the position Pdb of the biosensor 3d is the rearward limiting position of the movable range of the biosensor 3d.

The detection ranges G and E of the image sensor 3a and the biosensor 3d are narrower than those of the vehicle interior K. Therefore, the outside of the detection ranges G and E of the image sensor 3a and the biosensor 3d is a blind spot where the occupant M cannot be detected by the image sensor 3a and the biosensor 3d. However, as shown in FIGS. 2A to 3C, the image sensor 3a and the biosensor 3d move in the front-rear directions F and B along the rail 41, so that the detection ranges G and E of the image sensor 3a and the biosensor 3d are also increased. Move in the front-back directions F and B. Therefore, the range in which the occupant M can be detected by the image sensor 3a and the biological sensor 3d is substantially expanded to the entire area of the occupant space Ka in the vehicle interior K.

The surface of each part of each sheet 31 to 34 is covered with a cloth or leather having a light-shielding property. The image sensor 3a faces the backrest portion 3y and the headrest 3z of each of the seats 31 to 34. Therefore, the optical image captured by the camera 3c of the image sensor 3a is blocked by the backrest portion 3y and the headrest 3z of each of the sheets 31 to 34. Then, as shown in FIGS. 2A to 3C, a blind spot on the side opposite to the image sensor 3a with respect to the backrest portion 3y and the headrest 3z of each seat 31 to 34, where the occupant M cannot be detected by the image sensor 3a. (Cross-hatched part) occurs.

Further, a structure such as a metal frame is provided inside each part of each of the sheets 31 to 34. Therefore, the radio waves transmitted and received by the transmitter / receiver 3e of the biosensor 3d and the reflected waves thereof are blocked by the sheets 31 to 34. Then, as shown in FIGS. 2A to 2C, a blind spot where the occupant M cannot be detected by the biosensor 3d on the side opposite to the biosensor 3d with respect to the backrest 3y and the headrest 3z of each seat 31 to 34. (Staggered hatching part) occurs.

However, as shown in FIGS. 2A to 3C, when the image sensor 3a and the biosensor 3d move in the front-rear directions F and B, the detection ranges G and E of the image sensor 3a and the biosensor 3d also move in the front-rear directions F and B. The position and size of the blind spots of the image sensor 3a and the biosensor 3d change. Then, the blind spot at a certain position (for example, FIG. 2A) of one of the image sensor 3a and the biological sensor 3d (for example, the image sensor 3a) is at another position (for example, FIGS. 2B and 2C) of the one sensor. The occupant M in the above is included in the detectable range, and the occupant M of the other sensor (for example, the biological sensor 3d) is included in the detectable range. Therefore, the blind spots outside the detection ranges G and E of the image sensor 3a and the biosensor 3d and the blind spots of the image sensor 3a and the biosensor 3d caused by the sheets 31 to 34 are reduced. In particular, the blind spots of the image sensor 3a and the biological sensor 3d generated by the seats 31 to 34 are substantially eliminated from the occupant space Ka of the vehicle interior K.

The detection signal indicating the detection result of the image sensor 3a and the data of the captured image of the camera 3c are transmitted to the control unit 1 by short-range wireless communication such as Bluetooth (registered trademark). The detection signal indicating the detection result of the biosensor 3d and the biometric information detected by the biosensor 3d are also transmitted to the control unit 1 by short-range wireless communication. Further, the control signal from the control unit 1 is also transmitted to the image sensor 3a and the biosensor 3d by short-range wireless communication.

As another example, for example, electrical wiring may be provided along the rail 41, and contacts may be provided in the image sensor 3a and the biosensor 3d. In this case, when the contacts of the image sensor 3a and the biosensor 3d come into contact with the electrical wiring of the rail 41, the detection results, image data, and the like are transmitted from the sensors 3a and 3d to the control unit 1. Further, the control signal from the control unit 1 is also transmitted to the image sensor 3a and the biosensor 3d via the electrical wiring and the contactor.

Power is supplied to the image sensor 3a, the biosensor 3d, the motors 4a, and 4d from, for example, batteries (not shown) provided in the carriages 42a and 42d. A charging unit (not shown) for charging the battery is provided at a predetermined position on the rail 41.

As another example, a feeding line may be provided in the groove 41m of the rail 41 in the front-rear direction F and B, and a current collecting coil may be provided in the driven rollers 43a and 43d so as to be close to the feeding line. Then, the electric power acquired by the current collecting coil from the feeding line may be supplied to the image sensor 3a, the biological sensor 3d, the motors 4a, and 4d.

Next, the operation of the occupant monitoring device 10 will be described.

5A and 5B are flowcharts showing the operation of the occupant monitoring device 10. The control unit 1 of the occupant monitoring device 10 is turned on by the information received from the vehicle side ECU 12 via the communication bus 11 and the communication unit 6 (step S1 in FIG. 5A), and the door is closed. It is detected (step S2 in FIG. 5A). Then, the control unit 1 drives the moving unit 4 based on the detection result of the position detecting unit 5 to move the image sensor 3a and the biological sensor 3d to their respective initial positions Paf and Pdf (FIGS. 2A and 3A). (Step S3 in FIG. 5A).

Next, the control unit 1 detects the occupant M in the vehicle interior K and the biological information thereof by the biological sensor 3d while moving the biological sensor 3d to the rear limiting position Pdb by the moving unit 4, and obtains the detection result. Recording is performed in the storage unit 2 (step S4 in FIG. 5A). Further, the control unit 1 captures the vehicle interior K with the camera 3c while moving the image sensor 3a to the rear limiting position Pab by the moving unit 4, and the occupant in the vehicle interior K with the image sensor 3a based on the captured image. M is detected, and the detection result and the image data of the camera 3c are recorded in the storage unit 2 (step S5 in FIG. 5A).

In step S4 and step S5, for example, the control unit 1 places the biosensor 3d and the image sensor 3a between the initial positions Pdf and Paf and the rear limiting positions Pdb and Pab by the moving unit 4 and the position detecting unit 5. Stop each at a predetermined position. Then, at each position, the occupant M and the biological information are detected by the biological sensor 3d, and the detection result is associated with the information indicating the position of the biological sensor 3d and recorded in the storage unit 2. Further, at each position, the vehicle interior K is imaged by the camera 3c, the occupant M is detected by the image sensor 3a, and the detection result and the image data of the camera 3c are associated with the information indicating the position of the image sensor 3a. , Record in the storage unit 2.

Next, the control unit 1 determines the vehicle interior K based on the position detection results of the biosensor 3d and the image sensor 3a by the position detection unit 5, the detection result of the biosensor 3d, the detection result of the image sensor 3a, or the image data. The position of the occupant M or the arrangement of the seats 31 to 34 is determined, and the determination result is recorded in the storage unit 2 (step S6 in FIG. 5A). Further, the control unit 1 determines the optimum positions of the biosensor 3d and the image sensor 3a, which are optimal for detecting the occupant M, based on the determination result, and records the determination result in the storage unit 2 ( Step S7 in FIG. 5A. Then, the control unit 1 moves the biosensor 3d and the image sensor 3a to the optimum positions by the moving unit 4 and the position detecting unit 5 (step S8 in FIG. 5A).

After that, the control unit 1 detects the occupant M and the biological information by the biological sensor 3d, and records the detection result in the storage unit 2 (step S9 in FIG. 5A). Further, the control unit 1 determines the state of the occupant M based on the detection result of the biological sensor 3d, and records the determination result in the storage unit 2 (step S10 in FIG. 5A). The state of the occupant M at this time includes, for example, the number, position, type, arousal / sleep state of the occupant, and biological information such as heart rate and blood pressure.

Further, the control unit 1 captures the vehicle interior K with the camera 3c, detects the occupant M with the image sensor 3a based on the captured image, and records the detection result and the image data of the camera 3c in the storage unit 2. (Step S11 in FIG. 5A). Further, the control unit 1 determines the state of the occupant M and the state of the vehicle interior K based on the detection result of the image sensor 3a and the image data of the camera 3c, and records the determination result in the storage unit 2. (Step S12 in FIG. 5A). The state of the occupant M at this time includes, for example, the number, position, type, awakening / sleeping state of the occupant, physical or behavioral biological information of the occupant, and the like. Further, the state of the vehicle interior K includes, for example, the arrangement of the seats 31 to 34 or the configuration of the vehicle interior K.

Then, the control unit 1 monitors the occupant M in the vehicle interior K based on the detection results and the determination results in steps S9 to S12, and records the monitoring results in the storage unit 2 (FIG. 5A). Step S13).

Next, the control unit 1 determines the success or failure of the predetermined movement condition based on the results of the above steps S9 to S13. For example, if the results of the same item do not match between the state of the occupant M determined based on the detection result of the biological sensor 3d and the state of the occupant M determined based on the detection result of the image sensor 3a, control is performed. Part 1 determines that the movement condition is satisfied (step S14: YES in FIG. 5B).

Alternatively, when unclear data is included in the detection results of the biological sensor 3d and the image sensor 3a, and the determination result of the state of the occupant M and the state of the vehicle interior K based on the detection results, the control unit 1 performs. It is determined that the movement condition is satisfied (step S14: YES in FIG. 5B). Alternatively, based on the detection result of the image sensor 3a, it is determined that the seats are provided in three or more rows in the front-rear direction F and B in the passenger space Ka of the vehicle interior K, or the seats are in the passenger space Ka in the front-rear direction F. , B is provided in two rows, and when it is determined that the cargo space Kb is continuous with the occupant space Ka, the control unit 1 determines that the movement condition is satisfied (step S14: YES in FIG. 5B). Alternatively, when there is a change between the previous monitoring result of the occupant M and the monitoring result of the current occupant M (step S13 in FIG. 5B), the control unit 1 determines that the movement condition is satisfied (step S14 in FIG. 5B). : YES).

When the movement condition is satisfied, the control unit 1 reads from the storage unit 2 the latest position of the occupant M or the seat arrangement recorded in the storage unit 2 in step S10 or step S12 of FIG. 5A (step S15 of FIG. 5B). Next, the control unit 1 redetermines the optimum positions of the biosensor 3d and the image sensor 3a based on the position of the occupant M or the arrangement of the seat, and updates the record of the optimum position of the storage unit 2 (FIG. Step S16 of 5B). Then, the control unit 1 moves the biosensor 3d and the image sensor 3a to the optimum positions by the moving unit 4 and the position detecting unit 5, respectively (step S17 in FIG. 5B). After that, the control unit 1 returns to step S9 of FIG. 5A and repeatedly executes the subsequent processes.

On the other hand, when the above-mentioned movement condition is not satisfied (step S14: NO in FIG. 5B), the control unit 1 determines the success or failure of the predetermined alarm condition based on the monitoring result in step S13 in FIG. 5A (step S14: NO in FIG. 5B). Step S18 in FIG. 5B. For example, when it is determined that the physical condition of the occupant M is abnormal, the control unit 1 determines that the alarm condition is satisfied (step S18: YES in FIG. 5B).

Alternatively, if it is determined that the occupant M is not seated in any of the seats 31 to 34 in the correct posture while the vehicle 30 is traveling (vehicle speed> 0), the control unit 1 determines that the warning condition is satisfied. Judgment (step S18: YES in FIG. 5B). Alternatively, when it is determined that there is an occupant M (for example, a child, a pet, an unhealthy adult, or an adult who is sleeping soundly) who cannot get off by himself / herself in the passenger compartment K with the power of the vehicle 30 turned off, control is performed. Part 1 determines that the alarm condition has been satisfied (step S18: YES in FIG. 5B). so

When the alarm condition is satisfied, the control unit 1 transmits a predetermined alarm instruction signal and the monitoring result of the occupant M to the vehicle side ECU 12 via the communication bus 11 by the communication unit 6 (step S19 in FIG. 5B). When the vehicle-side ECU 12 receives the warning instruction signal and the monitoring result of the occupant M from the occupant monitoring device 10, the alarm device 13 or the portable communication device 14 is used to notify the vehicle interior K, the vehicle outside, or the portable device based on these. Give a predetermined alarm.

On the other hand, when the above alarm condition is not satisfied (step S18: NO in FIG. 5B), the control unit 1 confirms whether or not the inquiry signal of the monitoring result is received from the vehicle side ECU 12 (FIG. 5B). Step S20). Then, if the communication unit 6 receives the inquiry signal of the monitoring result from the vehicle side ECU 12 via the communication bus 11 (step S20: YES in FIG. 5B), the control unit 1 is connected to the communication bus 11 by the communication unit 6. The monitoring result of the occupant M is transmitted to the vehicle-side ECU 12 via the above (step S21 in FIG. 5B).

On the other hand, if the inquiry signal of the monitoring result is not received from the vehicle side ECU 12 (step S20: NO in FIG. 5B), the control unit 1 confirms the state of the power supply of the vehicle 30 (step S22 in FIG. 5B). Further, even after the monitoring result is transmitted (step S19 or step S21 in FIG. 5B), the control unit 1 confirms the state of the power supply of the vehicle 30 (step S22 in FIG. 5B). Then, if the power of the vehicle 30 is in the on state (step S22: NO in FIG. 5B), the control unit 1 returns to step S9 in FIG. 5A and repeatedly executes the subsequent processes.

Further, if the power supply of the vehicle 30 is in the off state (step S22: YES in FIG. 5B), the control unit 1 determines whether or not the predetermined stop condition is satisfied. For example, when the remaining amount of the battery of the vehicle 30 which is the source of power to the occupant monitoring device 10 is equal to or more than a predetermined amount, or when the power of the vehicle 30 remains off, the control unit 1 has a stop condition. It is determined that this is not the case (step S23: NO in FIG. 5B). Then, the control unit 1 returns to step S3 of FIG. 5A and repeatedly executes the subsequent processes.

On the other hand, for example, when the remaining amount of the battery of the vehicle 30 is less than a predetermined amount or when the power of the vehicle 30 is turned on again, the control unit 1 determines that the stop condition is satisfied (step S23 in FIG. 5B: YES). In this case, the operation of the occupant monitoring device 10 ends. After that, the control unit 1 returns to step S1 of FIG. 5A and executes the subsequent processing.

According to the above embodiment, the image sensor 3a and the biosensor 3d of different types are provided in the vehicle interior K of the vehicle 30 as the occupant detection unit 3, and the detection ranges G and E of the image sensor 3a and the biosensor 3d are the vehicle. It is displaced in the front-rear direction F and B of 30. Therefore, the detection ranges G and E of the image sensor 3a and the biosensor 3d can be expanded in the front-rear directions F and B. Further, the detection ranges G and E of the image sensor 3a and the biosensor 3d are set to reach the side walls 38l and 38r of the vehicle interior K in the left-right directions L and R of the vehicle 30, respectively. Therefore, the blind spots of the image sensor 3a and the biological sensor 3d generated at both ends of the vehicle interior K in the left-right directions L and R can be reduced.

Further, the moving unit 4 moves the image sensor 3a and the biological sensor 3d in the front-rear direction of the vehicle interior K in which a plurality of seats 31 to 34 on which the occupant M sits are arranged. Then, the detection range G of the image sensor 3a moves in the front-rear directions F and B so as to exceed the backrest portions 3y of the sheets 31 and 32, and the detection range E of the biosensor 3d becomes the back of the sheets 31 to 33. It moves in the front-rear direction F and B so as to cross the leaning portion 3y. Therefore, the detection ranges G and E of the image sensor 3a and the biosensor 3d are further expanded in the front-rear directions F and B, and the image sensor 3a and the biosensor 3d generated at the ends of the front-rear directions F and B of the vehicle interior K The blind spot can be reduced. In addition, the number of image sensors 3a and biosensors 3d installed can be kept small. Further, an image generated on the opposite side of the image sensor 3a and the opposite side of the biological sensor 3d with respect to the backrest portion 3y of the seats 31 to 34 in the vehicle interior K and the headrest 3z provided on the backrest portion 3y. The blind spots of the sensor 3a and the biological sensor 3d can be reduced.

Further, even if the number and arrangement of seats differ depending on the vehicle type of the vehicle 30, or the number and arrangement of seats can be changed by the user, the movable range by the moving part 4 of the image sensor 3a and the biosensor 3d can be changed. In consideration of this, the image sensor 3a and the biosensor 3d may be installed in an appropriate range, so that their installation can be facilitated. In addition, the blind spots of the image sensor 3a and the biosensor 3d caused by the number and arrangement of sheets can be reduced.

From the above, in the occupant monitoring device 10, it is possible to reduce the blind spots of the image sensor 3a and the biological sensor 3d and improve the detection performance of the occupant M in the vehicle interior K. Further, the control unit 1 can improve the monitoring performance of monitoring the occupant M in the vehicle interior K by the image sensor 3a and the biological sensor 3d.

Further, in the above embodiment, the control unit 1 uses the moving unit 4 to move the image sensor 3a and the biological sensor 3d in the front-rear direction not only when the power of the vehicle 30 is on but also when the vehicle 30 is in the off state. While moving to F and B, the occupant M is monitored based on the detection results of the image sensor 3a and the biosensor 3d. Therefore, when the power is turned on and the vehicle 30 is operating, that is, when a traveling drive source such as an engine is started or when the vehicle 30 is traveling, the occupant M in the vehicle interior K is pressed. The occupant M can be reliably detected and monitored. Further, even when the power of the vehicle 30 is turned off and the vehicle 30 is stopped, that is, when the traveling drive source is stopped or when the vehicle 30 is parked, the occupant M in the vehicle interior K is displayed. The occupant M can be reliably detected and monitored. Further, even after the driver of the vehicle 30 gets off, the occupant M such as a child, a pet, or an adult left behind in the vehicle interior K can be reliably detected and the occupant M can be monitored.

Further, in the above embodiment, the moving portion 4 is an image sensor along the ceiling 36 in the vehicle interior K, which has relatively few obstacles, and the center line Q parallel to the front-rear directions F and B of the vehicle 30. The 3a and the biosensor 3d are moved. Therefore, the image sensor 3a and the biosensor 3d can be easily moved in the front-rear directions F and B. In addition, obstacles intervening between the image sensor 3a and the biosensor 3d and the occupant M are reduced, and the blind spots of the image sensor 3a and the biosensor 3d can be further reduced. Then, the image sensor 3a and the biological sensor 3d from above the vehicle interior K make it easier to detect the occupants M on the center line Q and on both sides of the center line Q, and the detection performance of the occupant M can be improved.

Further, in the above embodiment, the moving unit 4 includes a single rail 41 laid on the ceiling 36 of the vehicle interior K along the center line Q of the vehicle 30, and includes the image sensor 3a and the biosensor 3d. , It is installed on the rail 41 so as to line up with the front-rear directions F and B, and moves in the front-rear directions F and B along the rail 41. Therefore, the rail 41 of the moving portion 4 and other components can be easily installed on the ceiling 36 of the vehicle interior K, which has relatively few obstacles. Further, the image sensor 3a and the biosensor 3d can be reliably moved in the front-rear directions F and B along the ceiling 36 and the rail 41.

Further, in the above embodiment, the image sensor 3a and the biosensor 3d move in the front-rear directions F and B, so that the detection range G of the image sensor 3a and the detection range E of the biosensor 3d become the occupant space of the vehicle interior K. The Ka and the cargo space Kb continuously provided behind the occupant space Ka are moved. Therefore, not only the occupant M in the occupant space Ka in the vehicle interior K but also the occupant in the cargo space Kb can be detected by the image sensor 3a and the biological sensor 3d, and the occupant can be monitored by the control unit 1. Become.

Further, in the above embodiment, the occupant M is detected based on the image obtained by capturing the vehicle interior K by the camera 3c of the image sensor 3a, and the detection result and the image data of the camera 3c are output to the control unit 1. .. Further, the radio wave type biosensor 3d detects the occupant M and the biometric information, and outputs the detection result to the control unit 1. Therefore, the performance of detecting the occupant M in the vehicle interior K by the image sensor 3a and the biosensor 3d can be further improved. Further, the control unit 1 can determine in detail the state of the occupant M and the state of the vehicle interior K based on the detection results of the image sensor 3a and the biological sensor 3d and the image data of the camera 3c. Further, the control unit 1 can monitor the occupant M in detail based on the determination results, and the monitoring performance can be further improved.

Further, in the above embodiment, the control unit 1 detects the position of the image sensor 3a and the biosensor 3d, the detection result of the position detection unit 5, the detection result of the image sensor 3a and the biosensor 3d, or the image data of the camera 3c. Based on the above, the position of the occupant M or the arrangement of the seats 31 to 34 is determined. Then, the control unit 1 determines the optimum positions of the image sensor 3a and the biological sensor 3d based on the position of the occupant M or the arrangement of the seats 31 to 34, respectively, and the moving unit 4 determines the optimum positions of the image sensor 3a and the living body at the optimum positions. Move the sensor 3d. Therefore, the image sensor 3a and the biosensor 3d are moved to the optimum positions according to the position of the occupant M in the vehicle interior K or the arrangement of the seats 31 to 34, and the image sensor 3a and the biosensor 3d detect the occupant M. The performance can be further improved, and the performance of monitoring the occupant M by the control unit 1 can also be further improved.

Further, in the above embodiment, the control unit 1 monitors the occupant M based on the detection results of the image sensor 3a and the biosensor 3d after moving the image sensor 3a and the biosensor 3d to the optimum positions. , Judge the success or failure of the predetermined movement conditions. Then, when the movement condition is satisfied, the control unit 1 again determines the optimum positions of the image sensor 3a and the biosensor 3d based on the detection results of the image sensor 3a, the biosensor 3d, and the position detection unit 5, and the optimum position is determined. The image sensor 3a and the biosensor 3d are moved to the positions. Therefore, even if the occupant M moves in the vehicle interior K, the occupant M moves in and out of the vehicle interior K, or the positions of the seats 31 to 34 are changed, the image sensor 3a and the biosensor 3d are used each time. Can be moved to the optimum position to improve the detection performance of the occupant M by the image sensor 3a and the biological sensor 3d, and the monitoring performance of the occupant M by the control unit 1.

Further, in the above embodiment, since the control unit 1 transmits the monitoring result of the occupant M to the vehicle side ECU 12 by the communication unit 6, the vehicle side ECU 12 controls the operation of the in-vehicle device based on the monitoring result of the occupant M. can do. Further, the control unit 1 determines the success or failure of the predetermined alarm condition based on the monitoring result of the occupant M, and when the alarm condition is satisfied, the communication unit 6 transmits the predetermined alarm instruction signal to the vehicle side ECU 12. Therefore, when there is an abnormality in the occupant M in the vehicle interior K, an alarm instruction signal is transmitted from the occupant monitoring device 10 to the vehicle side ECU 12. Then, the vehicle-side ECU 12 can operate the alarm device 13 and the portable communication device 14 based on the alarm instruction signal to give an appropriate alarm to the vehicle interior K, the vehicle outside, or the portable device.

In the present invention, various embodiments other than those described above can be adopted.

For example, in the above embodiment, an example in which an image sensor 3a and a biological sensor 3d are provided as the occupant detection unit 3 is shown, but the present invention is not limited to this. In addition to this, two or more types of occupant detection units may be provided, or at least one type of occupant detection unit may be provided in plurality. Further, for example, the occupant seated in the front row seat may be imaged by a fixed camera.

Further, in the above embodiment, an example in which the image sensor 3a and the biological sensor 3d are moved by the moving unit 4 having the structure shown in FIG. 4 is shown, but the present invention is not limited to this. The image sensor 3a and the biosensor 3d may be moved in the front-rear directions F and B by a moving portion having a structure other than that shown in FIG. For example, one or a plurality of rails 41 for moving the image sensor 3a and the biosensor 3d may be provided on the ceiling 36 or the floor 37 of the vehicle interior K. Further, the rail 41 may be provided at a distance from the center line Q. Further, instead of the rail 41, a wire material such as a wire or a ring material such as a chain belt may be used. Further, the image sensor 3a and the biosensor 3d may be attached to such a wire or ring material, and the image sensor 3a and the biosensor 3d may be moved as the wire or ring material moves. Further, the image sensor 3a and the biosensor 3d may be moved by the same drive source such as a motor.

Further, in the embodiment of FIGS. 5A and 5B, when the power of the vehicle 30 is turned on (step S1 of FIG. 5A) or turned off (step S22 of FIG. 5B: YES), the image sensor 3a and the biosensor 3d are initially initialized. An example is shown in which the occupant M is detected by the image sensor 3a and the biological sensor 3d while moving from the positions Paf and Pdf to the rear limiting positions Pab and Pdb, but the present invention is not limited to this. In addition to this, for example, with the image sensor 3a stopped at the initial position Paf, the vehicle interior K is imaged by the camera 3c, and the control unit 1 determines the configuration of the vehicle interior K and the arrangement of the seats based on the captured image. The presence or absence of obstacles around the rail 41 and the rail 41 may be determined, and based on the determination result, whether or not the image sensor 3a and the biological sensor 3d can be moved, whether or not the movement is necessary, or the amount of movement may be determined.

Further, in the embodiment of FIGS. 5A and 5B, the control unit 1 determines the position of the occupant M in the vehicle interior K or the arrangement of the seats 31 to 34 based on the detection results of the image sensor 3a and the biological sensor 3d. An example in which the optimum positions of the image sensor 3a and the biosensor 3d are further determined based on the result is shown, but the present invention is not limited to this. In addition to this, the control unit 1 may determine the optimum positions of the image sensor 3a and the biosensor 3d based on other situations such as the configuration of the vehicle interior K.

Further, in the embodiment of FIGS. 5A and 5B, when the control unit 1 receives an inquiry of the monitoring result from the vehicle side ECU 12 (step S20: YES in FIG. 5B), the control unit 1 transmits the monitoring result of the occupant M to the vehicle side ECU 12. Although the transmitted example is shown, the present invention is not limited to this. In addition to this, for example, every time the control unit 1 monitors the occupant M based on the detection results of the image sensor 3a and the biological sensor 3d, the monitoring result may be transmitted to the vehicle side ECU 12.

Further, in the above embodiment, an example is shown in which the occupant space Ka and the cargo space Kb detect and monitor the occupant M in the passenger compartment K which is continuous with the front-rear directions F and B of the vehicle 30, but the vehicle is independent of the cargo space. The present invention is also applicable to detect and monitor occupants in the occupant space. The present invention is also applicable when detecting and monitoring an occupant in a vehicle interior in which one row, two rows, or four or more rows of seats are arranged in the front-rear direction.

Further, in the above embodiment, an example in which the present invention is applied to the occupant monitoring device 10 mounted on the vehicle 30 made of a four-wheeled vehicle is given, but it is similar to an automobile such as a large bus, a railroad vehicle, or an airplane. The present invention can also be applied to an occupant monitoring device mounted on another vehicle.

1 Control unit 3 Crew detection unit 3a Image sensor (1st occupant detection unit)
3c camera 3d biosensor (second occupant detector)
3e Transmitter / receiver 3y Backrest 4 Moving unit 5 Position detection unit 6 Communication unit 10 Crew monitoring device 12 Vehicle side ECU (external device)
30 Vehicles (Vehicles)
31-34 Seats 36 Ceiling 38l, 38r Both left and right walls in the room 41 Rail E Biosensor detection range F, B Front-rear direction G Image sensor detection range K Vehicle interior (indoor)
Ka Crew space Kb Load space L, R Left-right direction M Crew Q Center line

Claims (10)

A occupant detector that detects occupants in the vehicle's interior in a non-contact manner
In an occupant monitoring device including a control unit that controls the occupant detection unit and monitors the occupant based on the detection result of the occupant detection unit.
The occupant detection unit includes a first occupant detection unit and a second occupant detection unit of different types provided in the room.
The detection range of the first occupant detection unit and the detection range of the second occupant detection unit are set so as to deviate in the front-rear direction of the vehicle and reach both side walls of the room in the left-right direction of the vehicle. ,
A moving unit for moving the first occupant detection unit and the second occupant detection unit in the front-rear direction of the room in which a plurality of seats on which the occupants sit are arranged is further provided.
The control unit controls the moving unit to move the first occupant detection unit and the second occupant detection unit in the front-rear direction, while detecting the detection range of the first occupant detection unit and the second occupant. An occupant monitoring device characterized in that the detection range of the detection unit is moved so as to exceed the backrest portion of the seat. In the occupant monitoring device according to claim 1,
The control unit moves the first occupant detection unit and the second occupant detection unit in the front-rear direction by the moving unit not only when the vehicle is operating but also when the vehicle is stopped. An occupant monitoring device, characterized in that the occupant is monitored based on the detection results of the first occupant detection unit and the second occupant detection unit. In the occupant monitoring device according to claim 1 or 2.
The moving unit is characterized in that the first occupant detection unit and the second occupant detection unit are moved along the ceiling in the room and the center line of the vehicle parallel to the front-rear direction. Crew monitoring device. In the occupant monitoring device according to claim 3,
The moving portion includes a single rail laid on the ceiling of the room along the centerline.
The occupant monitoring device is characterized in that the first occupant detection unit and the second occupant detection unit are installed on the rail so as to be aligned in the front-rear direction and move in the front-rear direction along the rail. In the occupant monitoring device according to any one of claims 1 to 4.
By moving the first occupant detection unit and the second occupant detection unit in the front-rear direction, the detection range of the first occupant detection unit and the detection range of the second occupant detection unit become the seat in the room. An occupant monitoring device characterized in that the occupant space provided with the occupant space and a load space continuously provided behind the occupant space are moved. In the occupant monitoring device according to any one of claims 1 to 5.
The first occupant detection unit has a camera that images the inside of the room, detects the occupant based on the image captured by the camera, and detects the occupant.
The second occupant detection unit has a transmitter / receiver that transmits / receives radio waves, receives reflected waves of radio waves transmitted into the room by the transmitter / receiver, detects biological information based on the reflected waves, and detects the biological information. Detect the occupant based on the information
The control unit determines the state of the occupant or the state of the room based on the detection result of the occupant output from the first occupant detection unit and the image data of the camera, or detects the second occupant. An occupant monitoring device for determining the state of the occupant based on the detection result of the occupant output from the unit and the biological information. In the occupant monitoring device according to claim 6,
A position detection unit for detecting the position of the first occupant detection unit and the position of the second occupant detection unit is further provided.
The control unit is the first occupant detection unit and the second occupant, which are optimal for detecting the occupant based on the detection results of the first occupant detection unit, the second occupant detection unit, and the position detection unit. An occupant monitoring device characterized in that the optimum position of the detection unit is determined, and the moving unit and the position detecting unit move the first occupant detection unit and the second occupant detection unit to the optimum positions, respectively. .. In the occupant monitoring device according to claim 7.
The control unit moves the first occupant detection unit and the second occupant detection unit to the optimum positions, respectively, and then based on the detection results of the first occupant detection unit and the second occupant detection unit. While monitoring the occupant, the success or failure of the predetermined movement condition is determined, and when the movement condition is satisfied, again based on the detection results of the first occupant detection unit, the second occupant detection unit, and the position detection unit. The optimum positions of the first occupant detection unit and the second occupant detection unit are determined, and the first occupant detection unit and the second occupant detection unit are moved to the optimum positions, respectively. Crew monitoring device. In the occupant monitoring device according to claim 7 or 8.
The control unit determines the position of the occupant or the arrangement of the seat based on the detection results of the position detection unit, the first occupant detection unit, or the second occupant detection unit, and further determines the position of the occupant or the position of the occupant. An occupant monitoring device characterized in that the optimum positions of the first occupant detection unit and the second occupant detection unit are determined based on the arrangement of the seats. In the occupant monitoring device according to any one of claims 1 to 9.
It also has a communication unit for communicating with external devices.
The control unit transmits the monitoring result of the occupant to the external device by the communication unit, determines the success or failure of the predetermined alarm condition based on the monitoring result of the occupant, and when the alarm condition is satisfied, the predetermined alarm An occupant monitoring device characterized in that an instruction signal is transmitted to the external device by the communication unit.

Images