DE202010017265U1 - Vehicle interior state detection device - Google Patents

Abstract

A vehicle interior state detection device for a vehicle comprising: lighting means (15; 210) for emitting infrared rays into a vehicle compartment; an image pickup means (16; 220) for picking up an image inside the vehicle compartment into which the infrared rays from the lighting means (15; 210) are emitted; and recognition means (18; 18 '; 230) for recognizing specified information based on the image captured by the image capturing means (16; 220), the vehicle including multiple rows of seats (4, 5, 6), objects of the image captured by the Image recording means (16) is recorded, the seats (4, 5, 6) which are movable relative to passengers (B; A-D) who sit on the rows of seats (4, 5, 6), the recording means (16 ' ) the image of the passenger (C, D) sitting on the rows of seats (4, 5, 6) at a time, and the detection means (18; 18 '; 230) a size of the passengers (C, D), who sit on the rows of seats (4, 5, 6), and / or a positional relationship between the rows of seats ...

Description

The present invention relates to a vehicle interior condition recognizing apparatus comprising illuminating means for irradiating infrared rays into a vehicle compartment, image pickup means for picking up an image inside the vehicle compartment into which the infrared rays are radiated from the illuminating means, and recognizing means for recognizing specified information based on that of US Pat Image pickup included image includes.

Conventionally, the detection of the presence of a passenger seated on a seat is performed, for example, to determine the need for inflation of an airbag. According to known technology, a pressure sensor or a strain sensor is provided on a seat surface, which detects whether or not the passenger is seated on the seat.

When the pressure sensor or the strain sensor is provided as described above, there is a concern that the detection of a passenger may be caused due to fluctuations of detections of the sensor caused by position changes of the passenger, vehicle vibrations during driving or the like, could be inaccurate. Further, even if the detection of the passenger is detected, the size of the passenger can not be detected. Accordingly, there is a concern that the inflation control of the airbag could not be performed properly. For example, if the airbag were forcibly inflated even though the child is relatively small in size, the safety of the passenger would rather be impaired.

Therefore, recently, not only the detection of the presence of a passenger but also the detection of the passenger's height or the like based on images of a vehicle space being taken have been performed. For example, US Patent Application Publication No. 2007/176402 discloses the vehicle interior condition detecting system that irradiates the illumination device to radiate infrared rays on the seat, such as the driver's seat or the passenger's seat, from the vehicle ceiling section, the image pickup device attached to the ceiling section is provided above and in front of the seat and receives images of the seat to which the infrared rays are radiated from the lighting unit, and the control device which displays information showing the condition or the like of the passenger sitting on the seat; generated based on the images taken by the image pickup device.

Meanwhile, International Patent Publication No. WO 2005/032887 discloses the passenger detection system in which successive images of light stripes are taken, which are projected onto an object through a light curtain positioned by a light source positioner, by generating a 3D surface model the image processing is applied to the images obtained by subtracting background images from the captured successive images, and the passenger's detection or the passenger's body size determination are performed using the 3D surface model.

The systems disclosed in the publications described above have the advantage that the proper control of the inflation of the airbag can be provided, since not only the detection of the presence of a passenger, but also the detection of the passenger's body size (e.g. Adult or child). However, if the seat is provided so as to be movable relative to a vehicle body, the distance between the image pickup device and an object from which an image is to be taken may change depending on the seating position, so that the detected one Passenger's size or the like does not change properly even though the passenger is the same. Consequently, there is a problem that the size of the passenger sitting on the seat or a positional relationship between the seat and the passenger seated on the seat would not be precisely determined.

The present invention has been made in view of the above-described problem, and it is an object of the present invention to provide a vehicle interior condition recognition apparatus and a computer program product which measures the size of the passenger sitting on the seat or a positional relationship between the seat and the passenger sitting in the seat, can determine precisely.

The object is solved by the features of the independent claims. Preferred embodiments of the present invention are subject of the dependent claims.

According to the invention, there is provided a vehicle interior vehicle condition detecting apparatus for a vehicle, comprising: illumination means for radiating infrared rays into a vehicle compartment; an image pickup means for picking up an image within the vehicle space into which the infrared rays are emitted from the illumination means; and a Recognition means for recognizing specified information based on the image captured by the image pickup means, the vehicle including a plurality of rows of seats, objects of the image taken by the image pickup means comprising seats movable relative to passengers seated on the rows of seats Receiving means, the image of the passenger sitting on the rows of seats, at a time, and the detection means determines a size of the passengers sitting on the rows of seats, and / or a positional relationship between the rows of seats and the passengers sitting on the rows of seats by comparing at least part of a contour of the seat with at least part of a contour of the passenger sitting on the seat on the captured image.

According to the invention, there is further provided a vehicle interior condition detecting apparatus comprising: illumination means for radiating infrared rays into a vehicle compartment; an image pickup means for picking up an image within the vehicle space into which the infrared rays are emitted from the illumination means; and recognizing means for recognizing specified information based on the image picked up by the image pickup means, wherein objects of the image picked up by the image pickup means comprise a seat movable relative to a vehicle body and a passenger seated on the vehicle body Seat sits, and the detection means determines a size of the passenger sitting on the seat, and / or a positional relationship between the seat and the passenger sitting on the seat, by at least part of a contour of the seat with at least one part a contour of the passenger sitting on the seat on the captured image, the detection means further comprising a degree of concentration of the passenger sitting on the driver's seat on a driving operation based on a position of a head portion of the passenger seated on the driver's seat; certainly.

Since the size of the passenger sitting on the seat and / or the positional relationship between the seat and the passenger sitting on the seat are determined based on a comparison of the contours of the seat and the passenger, according to the In the foregoing, such provisions are made precise even when the seat moves relative to the vehicle body. For example, when the results of such determinations are used in the airbag inflation control apparatus for a vehicle accident, the proper airbag inflation control may be provided according to the passenger's body size or the positional relationship between the seat and the passenger, thereby providing safety Vehicle accident is ensured.

According to one embodiment, the degree of concentration is determined based on a position of the eyes and the mouth of the passenger.

According to another embodiment, an inattentive driving style is determined when both eyes of the driver are on the right or left side of a standard line and / or the driver's sleep is determined when both eyes are in a lower area, wherein the detection device preferably the Concentration level determined to be low if at least one of these conditions persists for a specified period of time.

According to another embodiment, the recognition means determines the size of the passenger sitting on the seat by comparing the contour of the seat with the contour of the passenger seated on the seat on the captured image.

According to another embodiment, the seat includes a pair of seats arranged substantially side by side in a vehicle width direction, and the image pickup means is provided at a specified position which allows the image pickup means to pick up both images from the seats at the same time Seats from which images are picked up by the image pickup means, preferably a driver's seat and a passenger seat.

According to another embodiment, the image pickup means is provided in the vicinity of a pillar member extending substantially vertically along a side wall of the vehicle compartment, the image pickup means being preferably provided in the vicinity of an upper end portion of a front pillar as the pillar member and / or a projecting portion Projecting portion is provided in the vicinity of an upper end portion of a pillar garnish, which forms an inner surface of the front pillar, and the image pickup means is housed in the protrusion portion.

According to another embodiment, the image pickup means is provided on a side portion of the vehicle compartment on the driver's seat side, and an identifier is provided which compares with the passenger's size substantially on an inner surface of a seat back of the passenger seat can be.

According to a further embodiment, the seat is at an upper end thereof with a Headrest equipped with the height of the headrest is adjustable, and the detection means further determines the height of the headrest relative to the passenger sitting on the seat, based on an image of the headrest, which is received by the Bildaufnahmemitlel, wherein the image pickup means preferably on a front side position of the vehicle compartment is provided, which allows the image pickup means to receive the image of the headrest from the front of the vehicle, the seat preferably comprises a pair of seats, which are arranged substantially side by side in a vehicle width direction, and / or the image pickup means is provided at the specified position, which allows the image pickup means to receive the images of the two headrests of the seats at the same time from the front of the vehicle.

According to another embodiment, a rear seat is provided behind the driver's seat and the passenger seat and / or the image pickup means preferably captures respective images of a headrest of the rear seat and / or the headrests of the driver's seat and the passenger's seat at the same time.

According to another embodiment, the objects of the image taken by the image pickup means include a head portion of the passenger sitting on the driver's seat, and / or the recognition means further determines a concentration degree of the passenger sitting on the driver's seat to a driving operation based on a position of the captured image of the head portion of the passenger sitting on the driver's seat.

According to another embodiment, the detection means determines a difference in height between the headrest of the seat and the head portion of the passenger sitting on the seat.

According to another embodiment, a pair of first seats arranged substantially side by side and a second seat provided behind the first seats are provided in the vehicle compartment, the first seats and the second seat having seat belts to passengers restraining each of the seatbelts having a shoulder belt portion for restraining a shoulder portion of each of the passengers, the image pickup means being provided at an upper portion of the vehicle space located in front of seat backs of the first seats, the lighting means a first illuminating means provided at an upper portion of the vehicle compartment which is located in front of the seat recliners of the first seats and radiating infrared rays to the rear, and / or comprising a second illuminating means located behind the seat backs of the first seats and in front of a seat back of the seat second seat provided i radiates back and infrared rays to the rear, and wherein the detection means determines at least one seated state of the passenger sitting on the second seat.

According to another embodiment, the recognition means is configured to recognize an application state of the shoulder belt portion of the first seats and / or an application state of the shoulder belt portion of the second seat.

According to another embodiment, the second illumination means is configured to emit near infrared rays at substantially the same time as the first illumination means and / or the image capture means is positioned substantially at a central portion of the vehicle compartment in a vehicle width direction and / or the detection means is configured to a state of to recognize a specified portion of the shoulder belt portion, which is located near a vehicle body inner side portion.

According to another embodiment, in an application state thereof, the shoulder belt portion extends from a pillar on the vehicle body inner side portion to a passenger seated on the second seat, and the detection means is configured to control the state of the shoulder belt portion between the pillar and the passenger seated on the vehicle second seat sits to recognize.

According to the invention there is further provided a computer program product comprising computer-implemented instructions which, when loaded and executed on a suitable system, may perform the steps of:
Radiating infrared rays into a vehicle compartment;
Capturing an image within the vehicle space into which the infrared rays are emitted from the illumination means; and
Recognizing specified information based on the image taken by the image pickup means,
wherein objects of the image picked up by the image pickup means comprise a seat movable relative to a vehicle body and a passenger sitting on the seat, and
Determining a size of the passenger seated on the seat and / or a positional relationship between the seat and the passenger seated on the seat by comparing at least a portion of a contour of the seat with at least a portion of a contour of the passenger seated on sitting on the seat, on the picture taken,
wherein the detection means further determines a degree of concentration of the passenger sitting on the driver's seat on a driving operation based on a position of a head portion of the passenger sitting on the driver's seat.

Other features, aspects and advantages of the present invention will become apparent from the following description with reference to the accompanying drawings.

1 FIG. 13 is a side view showing an entire structure of a vehicle to which a vehicle interior condition recognition apparatus according to a first embodiment of the present invention is attached.

2 is a top view of the vehicle.

3 is a plan view of a vehicle compartment of the vehicle.

4 is a perspective view of an upper portion of a front pillar.

5 is a sectional view taken along the line VV of 4 ,

6 Fig. 10 is a diagram showing an example of an image taken by an image pickup means.

7 Fig. 10 is a block diagram showing a control system of the vehicle interior condition recognition apparatus.

8th FIG. 10 is a flowchart of a control process executed by the vehicle interior state recognition device. FIG.

9A - 9C Fig. 10 is diagrams explaining a determination process of a degree of concentration of a passenger sitting on a driver's seat; 9A is a picture of a passenger's head section when the passenger is concentrated; 9B is an image of a head portion of the passenger when the passenger has an inattentive driving style; 9C is a picture of a passenger's head section when the passenger is sleeping.

10 FIG. 15 is a diagram showing a comparative example for explaining actions of the present embodiment. FIG.

11 Fig. 15 is a diagram showing a modification of the present embodiment.

12 FIG. 13 is a side view showing the overall structure of the vehicle to which a vehicle interior condition detecting device according to a second embodiment of the present invention is attached.

13 is a plan view of the vehicle compartment of the vehicle.

14 Fig. 16 is a diagram showing an example of the image taken by the image pickup means.

15 FIG. 10 is a block diagram showing a control system of the vehicle interior condition recognizing apparatus according to the second embodiment. FIG.

16 FIG. 10 is a flowchart of a control operation executed by the vehicle interior state recognizing apparatus according to the second embodiment. FIG.

17 is a diagram that explains how to determine the height of a headrest.

18 Fig. 15 is a diagram explaining a modification of the second embodiment.

19 is a side view of a vehicle A according to a third embodiment of the present invention.

20 FIG. 10 is a plan view showing a state of the vehicle compartment of the present embodiment. FIG.

21 FIG. 15 is a perspective view showing a protective portion B. FIG.

22A Fig. 15 is a diagram showing a discrimination pattern D1 formed on an upper surface of a seatbelt B11; 22B FIG. 15 is a diagram showing a discrimination pattern D2 formed on a rear surface of the seatbelt B11.

23 is a view from behind of an image pickup section 220 is considered.

24 is an elevational view of seats S3a, S3b, S3c.

25 FIG. 10 is a block diagram showing a functional construction of a state recognizing apparatus. FIG 200 shows.

26 is a flowchart of the state recognition device 200 ,

27A is a specific flowchart of a Seat belt attachment warning processing (step S211); 27B FIG. 15 is a specific flowchart of head restraint height warning processing (step S212).

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. Although the embodiments are described separately, it will be understood that a single feature or features of one embodiment may be combined with another embodiment and vice versa.

EMBODIMENT 1

1 to 3 FIG. 12 shows an overall structure of a vehicle to which a vehicle interior state recognition apparatus according to a first embodiment of the present invention is attached. The vehicle shown in these figures is an automobile of the so-called minivan type, which has a total of three rows of seats on a vehicle floor 1 having. More specifically, a driver's seat 2 and a passenger seat 3 at a front portion on the vehicle floor 1 provided, and behind these seats are first separate rear seats 4 . 5 and a second integral rear seat 6 (a so-called bank seat). The driver's seat 2 and the passenger seat 3 are supported such that they slide lengthwise along seat slide rails 14 are movable on the vehicle floor 1 are arranged.

An instrument panel 7 that extends in a vehicle width direction is in front of the driver's seat 2 and the passenger seat 3 intended. A steering wheel 8th is at a section of the instrument panel 7 on one side of the driver's seat 2 arranged. A windshield 9 is located above the instrument panel 7 and a pair of front pillars 10 which are substantially vertical at the same pitch or skew angle as the windshield 9 is on both sides of the windshield 9 (ie, both-sided walls of a front end of the vehicle compartment). Further, behind the pair of front pillars 10 a pair of middle columns 11 provided, extending over an area of the vehicle floor 1 to a roof 13 extend. A side glass 12 for a front door is located between the middle pillar 11 and the front pillar 10 ,

A lighting device 15 that emits infrared rays into the vehicle compartment is substantially at the roof 13 provided at a position close to the front end portion of the roof 13 in front of back or seat backrests 2a . 3a the seats 2 . 3 is. More specifically, the lighting means 15 of the present embodiment, for example, a plurality of infrared LEDs emitting near-infrared rays.

Further, an image pickup means 16 taking pictures of the interior of the vehicle compartment, on the front pillar 10 the right side provided on the driver's seat side. This image pickup device 16 The present embodiment preferably consists of a CCD camera sensitive to the infrared rays emitted by the illumination means 15 be broadcast. Thus, the image pickup means 16 any images in the illumination area of the illumination means 15 properly absorb originating infrared rays.

4 is a perspective view of an upper portion of the front pillar 10 (right), on which the image pickup means 16 is provided. 5 Fig. 15 is a sectional view detailing a placement portion of the image pickup means 16 shows. This front pillar 10 preferably comprises an outer and an inner panel 20 . 21 consisting of metal panel members and a pillar trim 22 consisting of a resin panel member and an inner surface of the inner panel 21 off or covered. A projecting portion or projecting portion 22a which projects substantially into the vehicle interior is at a wall portion of the pillar garnish 22 provided, which is an environment of the upper end portion of the front pillar 10 (near the roof 13 ) corresponds. The image pickup device 16 is preferably within the projecting portion 22a arranged.

The pillar trim 22 is preferably via a clip 33 preferably detachable on the inner panel 21 appropriate ( 5 ). A curtain airbag 23 which inflates in a vehicle side impact is between the pillar trim 22 and the interior panel 21 arranged and extends along a lower-side side portion of the front pillar 10 , In a vehicle side impact, the clip 33 according to the inflation of the curtain airbag 23 solved, leaving the pillar trim 22 in a direction of an arrow X in 5 is deformed. Then the curtain airbag blows 23 out of a gap caused by the deformation of the pillar trim described above 22 is generated on and covers the side glass or window 12 ,

The image pickup device 16 that inside the tab section 22a is arranged, is preferably closer to the windshield 9 as the curtain airbag 23 , That is the curtain airbag 23 is along the lower side portion of the front pillar 10 arranged, the front side portion of the side glass 12 corresponds, and the projecting portion 22a and the image pickup means 16 are preferably at one Place arranged above and in front of the curtain airbag 23 near the windshield 9 located.

The image pickup device 16 is arranged so that it is directed downwards and obliquely backwards, as in 3 is shown, so that the multiple seats including the at least one driver's seat 2 and the passenger seat 3 in this image pickup area R may be included. Images of the vehicle compartment taken by the image pickup device 16 are included in 6 shown. More specifically, according to this example shown, a passenger sits on each seat of the driver's seat 2 , the passenger seat 3 , the first back seat 5 the left side and the second rear seat 6 , which are denoted by the reference numerals A, B, C and D. In the following, the passenger A is on the driver's seat 2 referred to as a driver seat passenger, the passenger B in the passenger seat 3 is referred to as a passenger seat passenger and the passengers C, D are referred to as rear seat passengers. In the figures, a reference numeral designates 30 a seat belt, and each of the passengers A-D is through the seat belt 30 retained.

As it is in 6 is a recognizer 32 made of a material similar to that of the lighting means 15 reflected near infrared rays, and which is formed in a belt shape, preferably on an inner surface of the seat back 3a the passenger seat 3 intended. This detection means 32 is provided to determine the body size of the passenger B in the passenger seat 3 to simplify, which will be described in detail later. Thus, the recognition means extends 32 over a specified length along the side surface of the seat back 3a and has a scale 32a to provide standard information for determining the passenger seat passenger B height. This scale 32a can be applied in several scale types, which are not limited to those having some display lines but to those having a surface treatment to provide different reflection ratios thereon.

7 FIG. 10 is a block diagram showing a control system of the vehicle interior state recognizing apparatus of the present embodiment. FIG. A control unit 17 In this figure, an apparatus for controlling respective components of the vehicle as a whole, which comprises known CPU, ROM, RAM, HDD and so on. With this control unit 17 are preferably the illumination means described above 15 and image pickup means 16 and the airbag device 24 , a warning device 25 , an ignition sensor 26 , a shift position sensor 27 , a buckle sensor 28 and a crash sensor 29 coupled.

The airbag device 24 FIG. 10 is a device that includes the airbags provided at respective portions in the vehicle compartment, inflators for inflating the airbags, and so forth. The above-described curtain airbag 23 ( 4 and 5 ) and other airbags, such as an airbag for the driver, attached to the steering wheel 8th is provided, an airbag for the passenger, attached to the instrument panel 7 in front of the passenger seat 3 is provided (not shown) are through the airbag device 24 included or included in this.

The warning device described above 25 is a device for alerting the passenger that some events that are not preferable or desirable have occurred. If the inattentive driving or the sleep of the driver seat passenger A by a detection means 18 is detected, which will be described below, for example, the warning device 25 effective and warns the passenger. The warning device 25 preferably includes functions of indicating a warning indication on the instrument panel 7 , generating alarm sounds with alarm or the like, and so on.

The above-described ignition sensor 26 is a sensor for detecting the ON / OFF of an ignition device for starting a drive source (eg, engine) of the vehicle. The above-described shift position sensor 27 is a sensor for detecting a position (P range, D range, R range and others) of a shift lever, not shown. The buckle sensor described above 28 is a sensor attached to a buckle (not shown) for attaching the above-described seat belts 30 is provided at the seats. This sensor 28 Detects if the seat belt 30 is used or not, by detecting whether a tongue at the top of the seat belt 30 is engaged with the buckle described above or not.

The above-described impact sensor 29 is a sensor for detecting the occurrence of the collision of the (own) vehicle (frontal impact or side impact), which may consist of a G-sensor, for example, to detect an acceleration acting on the own vehicle and the direction of the acceleration. The control unit described above 17 includes the detection means 18 and the airbag control means 19 ,

The detection means 18 recognizes various information based on the images of the vehicle compartment taken by the image pickup means 16 to be delivered. For example, this means 18 Functions of determining a degree of concentration of the driver seat passenger A on a driving operation and a height of the passenger seat passenger B on. The airbag control means 19 performs the inflation control of the airbag device 24 out. For example, this control means 19 Functions of the inflation of the airbag of the airbag device 24 according to the type of vehicle impact, frontal impact or side impact, and performing or prohibiting the inflation of the passenger-seat airbag according to the body size of the passenger-seat passenger B detected by the detection means 18 is detected on.

8th Fig. 10 is a flowchart of a control process performed by the control unit 17 is performed. The flowchart of 8th shows the control process of the image recognition by the recognition means 18 , After starting this flow chart, detections of the ignition sensor become 26 , the shift position sensor 27 , the buckle sensor 28 and so on to execute the control (step S1).

Next, based on the detection of the ignition sensor 26 which has been read in step S1, determines that the ignition is ON or not (step S2). When the determination is YES and the ignition is ON, based on the detection of the shift position sensor 27 determines whether or not the shift position is D range (step S3).

When the determination in step S3 is YES and the range is the D range (ie, the vehicle is running), it is determined whether or not a predetermined time T1 (for example, 1-3 seconds) from the shift to the D range has elapsed ( Step S4). If the determination is YES and the lapse of the T1 is confirmed, the control of the irradiation of the near-infrared rays by the illumination means becomes 15 in the vehicle compartment started (step S5).

Next, the image pickup control by the image pickup means 16 in a state in which the near-infrared rays are radiated into the vehicle space (step S6). The of the receiving means 16 recorded images include at least respective images of the driver's seat 2 and / or his passenger A and the passenger seat 3 and his passenger B, as is in 6 is shown. These captured images become the detection means 18 and stored after a specified applied image processing (step S7).

Subsequently, the control of determining the body size of the passenger seat passenger B by the detection means 18 executed (step S8). More specifically, the height of the passenger seat passenger B is determined by a passenger seat height H with the recognizer 32 attached to the seat back 3a the passenger seat 3 is provided based on the captured images ( 6 ), which are read in in step S7, is compared.

The passenger seat passenger B body height determination results (step S8) become in the inflation control of the airbag device 24 by the airbag control means 19 used. If the seat height of the passenger seat passenger B is less than a specified altitude and, for example, it is determined that the passenger B is a child or a relatively small adult belonging to a group of 5% of the smallest American women (AF05), the Passenger seat airbag inflation prohibited or restricted even when a vehicle crash occurs. Thus, the passenger-seat airbag is inflated at a normal high speed only for an adult having a normal body size so that the safety of the passenger can be properly ensured.

Next, the control of verifying is performed that the seat with the seat belt 30 engaged with the buckle and the buckle sensor 28 Is ON and the passenger is actually sitting on the seat (step S9). More specifically, the seat on which the passenger actually sits is identified based on the images read in step S7, and this identified seat and the seat in which the buckle sensor is ON (that is, the seat belt is used) are verified, thereby Match or no match is confirmed.

Thereafter, based on the verification results from step S9, it is determined whether or not the seat in which the buckle sensor is ON completely coincides with the seat on which the passenger sits (step S10). When the determination NO is determined, the warning control for the passenger is made by operating the warning device 25 executed (step S11). When there is at least one seat in which the buckle sensor is OFF, although the passenger is actually seated thereon (that is, when there is a seat in which the seat belt 30 is not used by the passenger sitting on it), the determination in step 10 NO, so that the warning is performed in step S11.

Then the condition of the seat belt 30 in its use state based on the images of the vehicle space read in step S7 (step S12). It is determined based on this confirmation, whether a twist on a safety belt 30 occurs or not (step S13). If a twist on a seat belt 30 occurs and the determination is YES, the warning control for the passenger is made by operating the warning device 25 executed (step S14).

Next, the control of the determination of the concentration degree of the driver seat passenger A on the driving operation by the detection means 18 based on the images read in step S7 (step S15).

9A - 9C are diagrams explaining the determination process of the concentration degree of the driver seat passenger A. In these figures, vertical and lateral lines L1, L2 represented by one-dot lines show the standard lines defined by the position of the head portion of the passenger A. " The detection means described above 18 determines the degree of concentration of the passenger A by determining the positional relationship between the position of both eyes and the mouth of the passenger A and the standard lines L1, L2 described above. 9A shows the positions of the eyes and the mouth of the passenger when the passenger A focuses on the driving (dz the passenger is looking straight ahead). In this case, the driver's eyes are in the upper area above the standard line L2, and the driver's mouth is on the standard line L1.

Meanwhile, shows 9B a state in which the passenger A drives inattentive. In this case, both eyes of the driver may be on the right or left relative to the standard line L1. 9C shows a state in which the passenger A sleeps. In this case, both eyes of the driver may be in the lower area below the standard line L2. The detection means 18 determines that the degree of concentration of passenger A is low (that is, the driver drives inattentive or sleeps) when the conditions of 9B or 9C for a specified period of time or longer.

Referring again to the flowchart of FIG 8th the control will be further described. After determining the degree of concentration of the passenger A, it is determined in step S16 whether the degree of concentration of the passenger A is low or not, that is, whether the state of inattentive driving or sleeping, as shown in FIG 9B . 9C is shown for a specified period of time or longer. When the determination of the low concentration degree of the passenger A and the determination is YES, the warning control for the passenger A is made by operating the warning device 25 executed (step S17).

Then, based on the detection of the ignition sensor 26 determines whether the ignition is OFF or not (step S18). If the determination is made YES, the control flow ends. When it is determined that the vehicle travel is stopped and the determination is made NO, the control returns to step S5 after a predetermined specified time period T2 (for example, 10 seconds) has elapsed (step S19), and then becomes the same Control repeated. Thus, the above-described processing of radiating the near-infrared rays into the vehicle space, taking the images and so on is always repeated after the specified time T2.

As described above, the vehicle interior condition recognizing apparatus of the present embodiment includes the illumination means 15 radiating the near infrared rays into the vehicle compartment, the image pickup means 16 that captures the images inside the vehicle compartment into which the near infrared rays through the illumination means 15 be broadcast, and the detection means 18 containing the specified information based on that of the image pickup means 16 recognize captured pictures. In this case, the objects include those of the image pickup means 16 taken pictures the driver's seat 2 and the passenger seat 3 which are movable relative to the vehicle body and so on, and the recognition means 18 determines the size of the passenger B who sits in the passenger seat by the recognizer 32 of the passenger seat with the passenger B sitting in the passenger seat on which recorded image compares. Thereby, the body size of the passenger seat passenger B can be determined precisely.

That is, because the driver's seat 2 and the passenger seat 3 according to the present embodiment, are supported so as to be longitudinally along the seat slide rails 14 on the vehicle floor 1 are movable, the size of passengers A, B can be on the seats 2 . 3 change as the distance between the seats changes 2 . 3 and the image pickup means 16 due to the longitudinal movement of the seats 2 . 3 changes. Consequently, there is a concern that the passenger's passenger's body B's height can not be precisely determined only by simply performing the image recognition on the contour of the passenger seat passenger B. However, according to the present embodiment, the determination of the body size of the passenger seat passenger B based on the comparison with the recognizer 32 at the front passenger seat 3 is provided, so that the determination despite the relative movement of the passenger seat 3 can be made precisely to the vehicle body or the vehicle body. Further, for example, when the results of this determination are used in the vehicle-on-airbag inflation control apparatus, the airbag inflation control is properly according to the passenger-seat passenger B height, thereby ensuring safety in a vehicle crash ,

As it is in 9A - 9C Further, according to the present embodiment, the concentration degree of the driver seat passenger A is determined on the driving operation (inattentive driving or driver's sleep) based on the position of the head portion of the passenger A that is the image pickup means 16 is recorded. Thereby, the concentration degree of the driver seat passenger A on the driving operation can be properly determined by using the same image as that for determining the size of the passenger seat passenger B. Thus, any car accidents caused by inattentive driving or sleeping of the driver can be prevented by appropriate warnings.

As it is in 1 - 3 is shown, according to the present embodiment, the image pickup means 16 also essentially at the front pillar 10 is provided, which extends substantially vertically along the side wall of the front end of the vehicle compartment at the specified position, which or the image pickup means 16 allows both pictures of the driver's seat 2 as well as the passenger seat 3 to record at the same time. Thereby, the images of the two seats can be taken at the same time without using a particular camera having an extremely large image area (for example, a camera with a fisheye lens or a wide-angle lens), and thus can provide the proper images without improper distortion to be obtained.

While an image pickup 116 at the central section of the instrument panel 7 could be provided, which is provided at the front end of the vehicle compartment, as in 10 is shown, this layout would take a fairly large pickup area R of the image pickup means 116 require the pictures of the two seats 2 . 3 to record at the same time. This would require using a special camera, such as a camera with a fisheye lens or a wide-angle lens, and this would cause the problem that the captured image would be distorted improperly. Since the vehicle compartment according to the present embodiment of the image pickup means 16 is recorded, approximately at the front pillar 10 is provided, which is located on the side of the vehicle compartment, the pictures of the two seats 2 . 3 Without the use of a specific camera as described above and without improper distortion properly recorded at the same time. Consequently, the body size of the passenger seat passenger B and the concentration degree of the driver seat passenger A can be precisely picked up based on the captured images.

As it is in 4 or 5 is shown, according to the present embodiment, the projecting portion 22a in particular approximately at the pillar trim 22 provided, which is the inner surface of the front pillar 10 forms, and the image pickup means 16 is in this protrusion section 22a accommodated. Thereby, the arrangement place of the image pickup means 16 be properly secured without the placement of other parts (eg the curtain airbag) 23 ) to obstruct or block the inside of the front pillar 10 are housed. Since the projecting portion 22a in the vicinity of the upper end portion of the front pillar 10 is provided, can effectively prevent the view forward through the windshield 9 from the projecting portion 22a is blocked.

Since the protrusion portion described above 22a and the above-described image pickup means 16 on the side of the windshield 9 from the curtain airbag 23 are provided inside the front pillar 10 (between the pillar trim 22 and the interior panel 21 ) is inflating the curtain airbag 23 not through the image pickup means 16 and other limbs obstructed or blocked, thereby properly inflating the curtain airbag 23 and the safety of the passenger are ensured.

Further, according to the present embodiment, the image pickup means 16 preferably on the front pillar 10 on the side of the driver's seat (on the right side in the figures), and the recognizer 32 is preferably on the inner surface of the seat back 3a the passenger seat 3 is provided as a comparison object for determining the body size of the passenger seat passenger B. Even in the event that the height of the passenger seat passenger B is so large that the detection of the passenger seat 3 From the front is bad or heavy, thereby the recognition element 32 properly from the image pickup means 16 be recognized, which is provided on the side portion of the vehicle compartment on the side of the driver's seat. Thus, the height of the Passenger seat passenger B can be determined precisely regardless of the condition.

In the event that a side airbag on the outer surface of the seat back 3a is provided for a vehicle side impact, the above-described detection member 32 on the inner surface of the seat back 3a be properly arranged without obstructing or blocking the inflation of the side airbag.

While according to the present embodiment, the images of the driver's seat 2 and the passenger seat 3 from the image pickup means 16 to be taken up, that at the front pillar 10 is provided, and the degree of concentration of the driver's seat passenger A and the body size of the passenger seat passenger is determined based on the captured images, in the event that an airbag exists in front of the rear seat passenger passengers C and D, as it in 6 10), the body size of these passengers C, D may be determined in the same manner for the passenger seat passenger B to determine the inflation of the above-described airbag according to the passenger's body size.

However, there is concern that only the image pickup 16 at the front pillar 10 is arranged, the images of the above-described rear seat passengers C, D can not accommodate. Therefore, it may be preferable to use an additional image pickup means 16 ' at the middle pillar 11 to provide, as it is in 11 is shown. This image pickup device 16 ' can take pictures of these passengers C, D, without the driver's seat 2 and the passenger seat 3 which may provide a more accurate determination of passenger size. Furthermore, an additional lighting means 15 ' preferably at the central portion of the roof 13 above the first rear seats 4 . 5 be provided to obtain clearer recorded images.

While according to the embodiment described above, the illumination means 15 on the roof 13 is provided and the image pickup means 16 at the front pillar 10 is provided as it is in 1 - 3 and others can show these means 15 . 16 together at the front pillar 10 be provided. In this case, however, it may be necessary for the projecting portion 22a ( 4 and 5 ) and, in addition, this attachment of the means 15 . 16 Create or require more complex attachment structures to provide a sufficient arrangement space for the funds 15 . 16 sure. Accordingly, the embodiment described above with the separately provided means 15 . 16 be more advantageous in this regard.

The manner of precisely determining the body size of the passenger seat passenger B is not limited to the embodiment described above. For example, the height of the seat back 3a the passenger seat 3 in the detection means 18 can be stored, and the determination of the body size of the passenger seat passenger B can be made based on the comparison with the stored height of the seat back. In any case, the body size of the passenger seat passenger B can be precisely determined by the contour of the passenger seat 3 is compared with the contour of the passenger seat passenger B on the captured image.

While according to the embodiment described above, the driver's seat 2 and the passenger seat 3 are worn so that they are lengthwise along the seat slide rails 14 Movable, these seats can 2 . 3 with a tilting mechanism to vertically move their seating surfaces or a lateral sliding mechanism to move the seats in the vehicle width direction. Even if the seats according to the present invention are configured to be movable in any direction, the passenger body size can be precisely determined regardless of the position of the seats.

EMBODIMENT 2

A second embodiment will be described with reference to FIG 12 to 18 described. According to the second embodiment, a recognition means determines 18 ' Further, the height of the headrest relative to the passenger sitting on the seat, based on an image of the headrest, that of the image pickup means 16 is added, in addition to the determination functions described in the first embodiment described above. Hereinafter, structures of the second embodiment that are the same as those of the first embodiment will be denoted by the same reference numerals and detailed descriptions thereof will be omitted.

At upper sections of back or seat backrests 41 . 42 the driver and passenger seats 2 . 3 are headrests 51 . 52 provided to support a rear head portion of the passengers. These headrests 51 . 52 are on the seat backrests 41 . 42 supported by sliding rods K1 vertically supported relative to the seat backs 41 . 42 slide or move ( 12 ). The height of the headrests 51 . 52 is adjustable within a specified range by the vertical movement of the slide rods K1, respectively.

The same structure is preferably also for the first rear seats 4 . 5 and the second rear seats 6 applied. That is, headrests 53 . 54 are via sliding or push rods K2 on the seat backrests 43 . 44 the first rear seats 4 . 5 supported or worn so that the height of the headrests 53 . 54 each within a specified range is adjustable. Furthermore, headrests 55 . 56 on both sides of a back or seat back 45 the second back seat 6 supported or supported via sliding or push rods K3, so that the height of the headrests 55 . 56 each within a specified range by the vertical movement of the slide rods K3 is adjustable.

In the example shown, the headrests 53 - 56 the first and second rear seats 4 - 6 that are of the normal type headrests 51 . 52 (so-called pillow-type head restraints) of the driver's seat 2 and the passenger seat 3 are different, so-called saddle-type headrests, which have the shape of an inverted L in a side view. That's because the vertical length of the seat, which is the headrests 53 - 56 contains, suitably made low, so that the seat backs 43 - 45 the rear seats 4 - 6 without impairment or obstruction by the headrests 53 - 56 can be properly folded in a completely flat state forward. In the event that such a complete flat arrangement is not required, the headrests can 53 - 56 the rear seats 4 - 6 Headrests of the cushion type, such as those of the driver's seat 2 and the passenger seat 3 ,

The detection means 18 ' has the function of determining the height of the respective headrests 51 - 56 the seats 2 - 6 in addition to the functions of determining the degree of concentration of the passenger A on the driving operation and determining the body size of the passenger B on the front passenger seat 3 sitting.

The following is the control or regulation of a control unit 17 ' of the present embodiment will be described with reference to a flowchart shown in FIG 16 is shown. At this time, steps S101-S107 and S111-S122 of FIG 16 essentially the same as steps S1-S7 and S8-S19 of FIG 8th of the first embodiment described above, and steps S108-S110 of FIG 16 are new according to the second embodiment. Accordingly, the control according to the second embodiment will be described mainly with reference to steps S108-S110, and a detailed description of steps S101-S107 and S111-S122 will be omitted.

After the step S107, the image pickup means determines 1 the height of the headrests 51 - 56 the seats 2 - 6 based on the images read in step S107 ( 14 ) (Step S108). 17 is a diagram that explains how the height of the headrests 51 - 56 is determined. It will determine the height of the headrest 51 of the driver's seat 2 described as an example. The determination of the height of the other headrests is the same.

The height of the headrest 51 of the driver's seat 2 is determined by comparing the contour of the passenger's head section (driver's seat passenger A) as shown in FIG 17 is shown. More specifically, a lower side G of a side portion of the headrest 51 and a chin portion F of the driver seat passenger A on the image, and it is determined whether a gap (height difference) Y therebetween lies within a predetermined specified range (for example, ± 5 cm). Thus it is determined if the height of the headrest 51 suitable or not. For example, when a display mark M on the lower side G of the side portion of the headrest 51 attached as it is by a single-dotted line in 17 is shown, the detection of the portion G can be made easy and secure, whereby the gap Y is obtained precisely.

The gap Y between the lower side G of the side portion of the headrest 51 and the chin portion F of the driver's seat passenger A can be obtained as actual measurements by, for example, the actual height H2 of the headrest 51 is compared. That is, when the actual measurement or measurement data of the height H2 of the headrest 51 in a memory of the control unit 17 ' has been stored, the actual dimensions of the gap Y can be obtained by using these stored data as reference data.

The above-described determination of the height of the headrest can equally for the other seats (the passenger seat 3 , the first and second rear seats 4 - 6 ) are applied and executed. This Hähenbestimmung can only be performed for the seats on which the passengers sit. At the in 14 For example, the passengers sit, for example, only in the passenger seat 3 , the left first back seat 5 and the right side of the second rear seat 6 , The height determination can be for the headrests 52 . 54 . 55 for passengers B, C, D, except the headrest 51 be performed for the driver's seat passenger A.

There is a case in which a child is sitting on a seat other than the driver's seat 2 sitting. In this case, the chin portion of the child may be positioned on a plane that is much lower than the lower side portion of the headrest. Therefore, the above-described manner of determination can not function properly. If the child is determined by the size of the head section or seat height (the Seat height H1 of 14 ), it is therefore preferable that the above-described height determination of the headrest is prohibited.

There is also a case where it can be determined that the height of one of the headrests 51 - 56 due to improper temporary sitting position of the passenger (for example, the passenger sitting with a torso leaning forward) is unsuitable (ie, the above-described gap Y is out of the specified range). In the event that the above-described inappropriate sitting manner of the passenger is detected, it is therefore preferable that the above-described height determination of the headrest for the seat on which such a passenger sits is prevented. Therefore, the height determination of the headrest is performed for the seat on which the passenger sits in the proper sitting position, so that the appropriate height determination of the headrest can be provided.

After the height determination of the headrest described above is completed, the image pickup means determines 18 ' Referring again to the flowchart of FIG 16 Based on the height determination, whether or not there is a headrest of an improper height (step S109). That is, if there is a head restraint, the in 17 has the gap Y which is outside the specified range, the determination in step S109 is YES.

When the existence of the headrest of the improper height is determined with the determination result YES in step S109, a warning control for the passenger is made by an operation of the warning device 25 executed (step S110). If it is determined that the height of the headrest 54 of the left first rear seat 5 unsuitable, sends the warning device 25 For example, a steering alarm or the like, the counsels, the height of the headrest 54 of the first rear seat 5 to correct (the push rod K2 (see 12 ) of the headrest 54 vertical setting) or generates an error message to indicate the situation.

According to the present embodiment, the recognition means determines 18 ' as described above, the height of the headrests 51 - 56 relative to the passengers sitting on the seats, based on the images of the headrests taken by the image pickup device 16 be recorded. This can increase the height of the headrests 51 - 56 relative to the passengers seated on the seats, are determined precisely based on the recorded images of the headrests. When the results of such determinations are used in the warning device and the like, the height of the headrests can be kept within the appropriate range, so that the safety in a vehicle impact (especially the rear impact) can be effectively improved.

More specifically, according to the present embodiment, the gaps Y between the lower sides G of the side portions of the headrests 51 - 56 and the chin sections F of the passengers as the height determinations of the headrests 51 - 56 through the image pickup means 18 ' certainly ( 17 ), This can be easily and safely determined whether the height of the headrests 51 - 56 is set so as to properly support the head portion of the seated passengers or not, and the safety in a vehicle impact can be improved by the warning using the determination results more effectively.

While in the present embodiment, the image pickup means 16 on the right-hand front pillar 10 on the side of the driver's seat 2 is provided and the pictures of the headrests 51 - 56 all seats disposed in the vehicle compartment in the present embodiment of this single image pickup means 16 can be included, the headrest 53 the right-hand first rear seat 4 and the right-side headrest 55 the second back seat 6 behind the driver's seat 2 may be located in a hidden area that is located on 14 is predictable, so there is a concern that the images of these particular headrests can not be properly recorded.

In this case, one can think about the width of the headrests 53 . 55 to the right side of the vehicle, which is the same side as the arrangement side of the image pickup means 16 , 18 shows an example in which the width of the headrest 53 of the first rear seat 4 is increased toward the right side of the vehicle. The center P1 of the headrest 53 shown in this figure is offset toward the right side of the vehicle relative to the center P2 of the seat so that the width of a right side part of the headrest 53 is relatively enlarged from the center P2 of the seat. This arrangement of the headrest 53 can effectively prevent the above-described point of the headrest 53 in the hidden area of the front seat (the driver's seat 2 ), thereby properly determining the height of the headrest 53 provided. This also applies to the right-side headrest 55 the second back seat 6 ,

While in the present embodiment, the column Y between the lower sides G of the side portions of the headrests 51 - 56 and the chin portions F of the passengers are detected to the height of the headrests 51 - 56 to determine For example, another mode may be used as long as the height of the headrest relative to the passenger's head portion can be effectively determined. For example, the height of the headrest can be determined by obtaining a gap between the upper end of the passenger's head portion and the lower side of the headrest.

While the above-described embodiment shows the case where the present invention is applied to a minivan-type vehicle equipped with the three rows of seats, the present invention can naturally be applied to a vehicle equipped with the front and rear two rows of seats is (for example, a sedan-type vehicle) or applied to a two-seater vehicle equipped only with the driver's seat and the passenger's seat.

EMBODIMENT 3

A third embodiment will be described with reference to FIG 19 to 27 described.

A vehicle A includes seats S1a, S1b (first seats) arranged substantially side by side in a vehicle compartment, seats S2a, S2b (second seats) disposed behind seats S1a, S1b, seats S3a, S3b, S3c located behind the seats S2a, S2b, and a restraining section B in which passengers sitting on the seats are restrained.

The seat S1a is a driver's seat and the seat S1b is a passenger seat. The seats S2a, S2b are a time series seat for two passengers. The seats S3a, S3b, S3c are a third row seat comprising a so-called bench seat for two passengers and a single seat for a passenger. Each of the seats has a longitudinal movement mechanism (slide mechanism) and a reclining mechanism (recline mechanism) that reclines a seat back thereof longitudinally about its lower end portion. While the present embodiment is described in such a manner that the first-row seats S1a, S1b are the first seats and the second-row seats S2a, S2b are the second seats, the present invention can be applied in such a manner that the second-row seats S2a, S2b first seats and the third row seats S3a, S3b, S3c are the second seat.

On both-side vehicle body side portions, A pillars Pa, B pillars Pb, C pillars Pc, and D pillars Pd are preferably provided from the front in this order. A front door FD is disposed at an opening formed between the A pillar Pa and the B pillar Pb, and a rear door RD is disposed at an opening formed between the B pillar Pb and the C pillar Pc is formed. The restraining section B includes restraint sections B1a, B1b (seat belt device) of the seats S1a, S1b provided on the B-side pillars Pb, restraint sections B2a, B2b of the seats S2a, S2b provided on the both-side C pillars Pc, and Retaining portions B3a, B3c of the seats S3a, S3c, which are provided on the double-sided D-pillars Pd.

21 FIG. 16 is a perspective view showing the retaining portion B. FIG. 22A FIG. 15 is a diagram showing a discrimination pattern D1 formed on an upper surface of the seatbelt B11, and FIG 22B FIG. 15 is a diagram showing a discrimination pattern D2 formed on a rear surface of the seatbelt B11. The restraining portion B includes a seatbelt B11, a tongue B12 arranged to be movable along the seatbelt B11, a buckle B13 provided on the vehicle body side and engaging with the tongue B12, a wrapper, and the like. Aufrollabschnitt B14, which is provided on the vehicle body inner side portion and the seat belt B11 winds up, and an armature B15, which is provided on the vehicle body inner side portion above the Aufrollabschnitts B14. At this time, the restraining portion B of the seat S3b is not provided with the above-described retracting portion B14 and the armature B15.

The seat belt B11 preferably includes a shoulder belt portion SB which restrains the shoulder portion and the chest portion of the passenger seated on the seat S2a, and a lap belt portion LB which retains the waist portion and the stomach portion of the passenger seated on the seat S2a. The tongue B12 determines the length of the shoulder portion SB and the lap belt portion LB, and is positioned at tips of the shoulder portion SB and the lap belt portion LB. The buckle B13 is provided between the seats, which are arranged substantially side by side at a position corresponding to each seat. The roll-up portion B14 is a belt retractor that biases the seat belt B11 in a biasing direction and is accommodated in the vehicle body inner side portion (B pillar Pb, C pillar Pc, D pillar Pd). The armature B15 supports the seat belt B11 extending upward from the roll-up portion B14, so that the seat belt B11 can be pulled down to the shoulder portion of the passenger. The shoulder belt portion SB, in its application state, extends from the vehicle body inner side portion to the passenger seated on the seat having a discrimination member D formed on its upper surface and its rear surface.

The discriminator D preferably includes the first discrimination pattern D1 formed on the upper surface of the shoulder belt portion SB and the second discrimination pattern D2 formed on the rear surface of the shoulder belt portion SB. These discrimination patterns D1, D2 are different from each other. The first discrimination pattern D1 consists, for example, of a reflective member glued or woven into the upper surface along an edge. The second discriminating pattern D2 consists, for example, of a reflecting member which is glued to the rear surface in a zigzag shape along an edge or woven into it. The discrimination member D is formed at a specified position on the seat belt B11 so as not to be rolled up in the roll-up portion B14 when the seat belt B11 does not restrain the passenger seated on the seat, that is, when the majority of the seat belt B11 is rolled up by the roll-up portion B14, so that the seat belt B11 is almost straight from the belt retractor provided between a belt line (a lower edge of a side window) and a vehicle floor to the shoulder anchor B15 at the upper portion of the column and may also extend from the shoulder anchor B15 to a ground anchor Bx provided near the vehicle floor. Thereby, the discriminator D can be properly provided on the shoulder belt portion SB by using the existing reeling-up portion B14, which prevents a large size of the reeling-up portion B14. While in the present embodiment, the discriminator D is provided to improve the discriminating function of the shoulder belt portion SB, it is not indispensable to the present invention. While the shoulder belt portion SB has the discrimination patterns D1, D2 having mutually different patterns on the both-side surfaces, it may have either one of both patterns on either side.

23 is a view from behind of an image pickup section 220 is considered. 24 is an elevation of the seats S3a, S3b, S3c. 25 FIG. 10 is a block diagram showing a functional construction of a state recognizing apparatus. FIG 200 shows.

The state recognition device 200 includes a lighting section 210 provided in the vehicle compartment, and preferably radiating near infrared rays into the vehicle compartment, an image pickup section 220 which is provided approximately at an upper portion of the vehicle compartment, which is located in front of the seat backs of the seats S1a, S2b and receives images inside the vehicle compartment, in which the infrared rays from the illumination means 210 be broadcast, a recognition section 230 indicating the state of the vehicle compartment based on that of the image pickup means 220 detects captured images, a Detektierabschnitt 240 which detects the engaged state of the tongue B12 and the buckle B13, and a determination section 250 indicative of the application state of the seatbelt B11 based on the engagement state detected by the detection means 240 is detected, and the application state of the shoulder belt portion SB determined by the recognition section 230 is detected.

The infrared rays are the electromagnetic waves whose wavelength is longer than that of the visible beam in or at red, but shorter than that of the electric wave. The infrared rays have a wavelength of about 0.7-1000 μm (1 mm) and are generally divided into three classes, near-infrared rays, mid-infrared rays and far-infrared rays, depending on the wavelength. The near infrared rays have the wavelength of about 0.7-2.5 ìm and are not visible to the naked eye, but for a CCD camera or the like. While the passenger has no problems with those of the lighting section 210 Therefore, the images may be properly picked up by the CCD camera or the like. Thus, in the present embodiment, near-infrared rays are preferably used.

An LED (narrow: light emitting diode), for example, as the lighting section 210 used. The lighting section 210 comprises a first illumination means 211 provided at an upper portion of the vehicle space, which is located in front of the seat backs of the seats S1a, S1b, and radiating the near-infrared rays backward and rearward, and a second illuminating means 212 which is located behind the seat backs of the seats S1a, S1b and in front of the seat backs of the seats S2a, S2b and radiates the near-infrared rays backwards or to the rear.

According to the present embodiment, the first and second lighting sections are 211 . 212 at central portions of the vehicle compartment (at a center line CL) in the vehicle width direction. The first lighting section 211 is for example on an overhead console or roof console 202 arranged, which is provided at a front end portion of the roof. The second lighting section 212 is behind the first lighting section 211 arranged The lighting section 211 illuminates the seats S1a, S1b, and the second lighting section 212 Illuminates the seats S2a, S2b, so that the border or edge of the seat belts and the first and second row seats can be easily detected.

The first and the second illumination section 211 . 212 are connected to an electronic control unit ECU and execute their lighting based on control signals of the ECU. These lighting sections 211 . 212 The near-infrared rays emit at substantially the same time. That is, the illumination command signals become the illumination sections 211 . 212 fed at substantially the same time. During the lighting section 210 of the present embodiment is positioned at the central portion of the vehicle space in the vehicle width direction to reduce the number of lighting portions, it may be positioned at different portions, not the central portion, due to relatively low cost of the LED.

The image pickup section 220 For example, in the vehicle width direction, as the CCD camera is provided at the central portion of the vehicle space, as shown in FIG 20 is shown. The image pickup section 220 is like the first lighting section 211 at the roof console 202 positioned. Further, the image pickup section is 220 connected to the ECU and transmits the captured images to the ECU based on the control signal of the ECU.

The recognition section 230 recognizes the application state of the shoulder belt portions SB of the seats S1a, S1b, S2a, S2b. The detection means 230 In the present embodiment, a state of a specified portion C1 of the shoulder belt portion SB located near the vehicle body inner side portion not covered by the first-row seat can be recognized. That is, the detection means 230 may recognize the state of the shoulder belt portion SB between the vehicle body inner side portion and the passenger seated on the seat S2a or S2b. The above-described specified portion C1 of the shoulder belt portion SB does not overlap with the passenger sitting on the seat S1a or S1b, so that the detection of the application state can be improved. Furthermore, the recognition section 230 recognize the application state of the shoulder belt portion SB, such as its twisted state, by setting the first and second discrimination patterns D1, D2 at the specified portions C1 and C2 (C2 is a lower portion of the shoulder belt portion as shown in FIG 23 is shown) recognizes. The recognition section 230 For example, which is preferably a central processing unit CPU of the ECU, for example, performs various recognition processing based on that of the image pickup section 220 taken pictures and the signals from the Detektierabschnitt 240 by.

The detection section 240 is a buckle switch, which detects whether the tongue B12 is applied to the buckle B13. The detection section 240 is connected to the ECU. For example, a traction drive switch and the like will also be referred to as the detecting section 240 used. The determination section 250 For example, CPU is the ECU and detects whether or not the tongue B12 corresponding to the passenger's seat is properly attached to the buckle B13 corresponding to the passenger's seat. That is, when the seats are arranged close to each other, there is a concern that the tongue B12 is erroneously applied to the buckle B13 of the seat. Consequently, the determining section is 250 provided to prevent this incorrect application.

26 is an example of a flowchart of the state recognition device 200 , First, in step S201, it is determined whether the travel drive switch is ON. If ON in step 201 is determined, in step 202 determines if all doors are closed or not. If it is determined in step S202 that all doors are closed, in step S202 203 determines whether the gear is a drive range (D-range) or not. When the driving range is determined in step S203, it is determined in step S204 whether or not a specified time T1 (for example, 1-3 seconds) has elapsed from the gear shift to the driving range. If the respective conditions of steps S201-204 are not met, the respective determinations are repeated until these conditions are satisfied.

When the timing T1 is determined in step S204, the illumination portion is irradiated 210 in step S205, the near-infrared rays into the vehicle compartment. In step S206, the image pickup section then takes 230 the images of the vehicle compartment into which the near infrared rays are emitted. In the next step S207, the image pickup section guides 240 the specified image processing (for example, filter processing) and the passenger sitting are recognized in step S208. For example, the head portion of the passenger (including the eyes and the mouth of the passenger) and its position are recognized as this seat occupant's recognition processing. In step S209, the image with the seat belt buckle switch ON and the seat recognized as that on which the passenger is seated are then determined or verified by the image recognition. Subsequently, it is determined in step S210 whether or not this verification applies to all seats. If it is determined in step S210 that there is a seat to which the verification does not apply, there is a possibility that the passenger's sitting due to the shape of the passenger's hair, the direction of the face of the passenger or the like is not determined. Accordingly, in step S211, the control proceeds to a routine of determining the passenger based on the position of the seat belt.

Next, in step S212, the warning is executed if the height of the headrest is not appropriate. Then, in the next step S213, the twist state of the seat belt is detected, and it is determined in the next step S214 whether or not the seat belt is twisted based on this detection result. If the occurrence of the twist is determined in step S214, the passenger is warned of the safety belt effect from this concern. Then, in step S216, it is determined whether or not the travel drive switch is OFF. If it is determined in step S216 that the travel drive switch is ON, it is determined in step S217 whether or not a timer has counted a specified time T2 (for example, 0.01-1 second). When the counting of the specified time T2 is determined in step S217, the control returns to step S205. If the counting of the specified time T2 is not determined in step S217, the control returns to step S216. When the travel drive switch OFF is determined in step S216, the control ends.

The detailed processing of steps S211 and S212 will be described below. 27A FIG. 14 is a specific flowchart of a seat belt attachment warning processing (step S211) and FIG 27B FIG. 15 is a specific flowchart of head restraint height warning processing (step S212).

First, the detailed processing of the step S211 will be described. The application state of the seat belt is recognized in step S211a. This detection of the application state means recognizing whether the seat belt is worn or not. In the next step S211b, the seat with the buckle switch ON and the seat with the seat belt attached thereto are then verified. In the next step S211c, it is determined whether the seat with the buckle switch ON detected by the detecting section 240 is completely coincident with the seat with the seat belt applied thereto, which is detected by the image recognition processing. If it is determined in step S211c that they do not coincide, there is a concern that the tongue is erroneously attached to an incorrect seat belt buckle. Consequently, the warning of this concern is executed and the processing chain of step S211 ends. When the complete coincidence is determined in step S211c, the processing of step S211 ends without a warning.

Next, the detailed processing of the step S212 will be described. The height of the lower end portion (chin portion) of the head portion of the passenger and the height of the lower end portion of the headrest are verified in step S212a. These heights are obtained by the above-described image pickup processing. Then, in step S212b, it is determined whether or not a gap in height between the lower end portion of the passenger's head portion and the lower end portion of the headrest is within a specified range (for example, ± 5 cm). If it is determined in step S212b that the gap is not within the specified range, there is a concern that the safety of the passenger can not be ensured (that is, an excessive impact would act on the passenger's neck). Accordingly, the passenger is warned of this concern in step S212c and the processing chain of step S212 ends. If it is determined in step S212b that the gap is within the specified range, the processing of step S212 ends without a warning. According to the present embodiment, as described above, the application state of the seat belts of the seats arranged longitudinally can be more accurately recognized, which restricts an increase in cost.

Accordingly, there is provided a vehicle interior condition detecting apparatus comprising: illumination means for radiating infrared rays into a vehicle compartment, image pickup means for picking up an image within the vehicle compartment into which the infrared rays are radiated from the illumination means, and recognition means for recognizing specified information based on that of the vehicle Image pickup means taken image, wherein objects of the image, which is received by the image pickup means comprise a seat which is movable relative to a vehicle body and a passenger sitting on the seat, and the detection means is a size of the passenger sitting on the seat , and / or a positional relationship between the seat and the passenger seated on the seat is determined by comparing at least a portion of a contour of the seat with at least a portion of a contour of the passenger seated on the seat on the captured image ,

According to the above, since the size of the passenger sitting on the seat or the positional relationship between the seat and the passenger sitting on the seat is determined based on a comparison of the contours of the seat and the passenger, such determinations can be made precisely even if the seat moves relative to the vehicle body. For example, when the results of such determinations are used in the airbag inflation control apparatus for a vehicle accident, the proper airbag inflation control may be provided according to the passenger's body size or the positional relationship between the seat and the passenger, thereby providing safety Vehicle accident is ensured.

Specifically, the seat includes a pair of seats arranged substantially side by side in a vehicle width direction, and the image pickup means is provided at a specified position that allows the image pickup means to take both images of the seats at the same time. Thereby, the images of the two seats can be taken at the same time without using a particular camera having an extremely large image area (for example, a camera with a fisheye lens or a wide-angle lens), and thus can provide the proper images without improper distortion to be obtained.

In particular, the image pickup means is provided in the vicinity of a pillar member which extends substantially vertically along a side wall of the vehicle compartment. Thereby, the arrangement space of the image pickup means can be properly secured by using the pillar member.

Specifically, the seats from which images are picked up by the image pickup means are a driver's seat and a passenger seat, and the image pickup means is provided in the vicinity of an upper end portion of a front pillar as the pillar member. Thereby, the images of the driver's seat and the passenger's seat can be properly picked up by the image pickup means provided on the front pillar.

Specifically, a projecting portion is provided in the vicinity of an upper end portion of a pillar garnish forming an inner surface of the front pillar, and the image pickup means is housed in the projecting portion. Thereby, the arrangement place of the image pickup means can be properly secured without obstructing the arrangement of other parts (eg, a curtain airbag) housed inside the front pillar. Further, since the protrusion portion is provided in the vicinity of the upper end portion of the front pillar, the forward view through the windshield can be effectively prevented from being blocked by the protrusion portion.

Specifically, the recognition means determines the size of the passenger sitting in the passenger seat by comparing at least the contour of the passenger seat with the contour of the passenger sitting on the seat on the captured image, and the recognition means further determines a degree of concentration of the passenger, seated on the driver's seat, on a driving operation based on a position of a head portion of the passenger sitting on the driver's seat. Thereby, the passenger's degree of concentration on the driving operation can be properly determined by using the same image as that used for determining the size of the passenger sitting in the passenger seat. Thus, any car accident caused by inattentive driving or sleeping of the driver can be prevented by appropriate warnings.

Specifically, the seats from which images are picked up by the image pickup means are a driver's seat and a passenger's seat, and the image pickup means is provided on a side portion of the vehicle space on the driver's seat side, and an identifier is provided which coincides with the driver's seat Size of the passenger can be compared to an inner surface of a back or seat back of the passenger seat. Even in the case that the passenger's body size sitting in the passenger seat is so large that the recognition of the front passenger's seat becomes difficult from the front, the recognizing member can be properly recognized by the image pickup means attached to the side portion of the vehicle Vehicle space is provided on the side of the driver's seat. Thus, the passenger's body size sitting in the front-passenger seat can be precisely determined regardless of the condition.

In particular, the seat is provided with a headrest at an upper end thereof, the height of the headrest being adjustable, and the detecting means further determines the height of the headrest relative to the passenger seated on the seat based on an image of the headrest is picked up by the image pickup means. Thereby, the height of the headrest relative to the passenger seated on the seats can be precisely determined based on the captured image of the headrest. When the result of such determinations is used in the warning device and the like, the height of the headrest can be kept within an appropriate range, so that the safety in a vehicle impact (in particular the rear impact) can be effectively improved.

In particular, the image pickup means is provided on a front side portion of the vehicle compartment, which is the image pickup means allows the image of the headrest to be taken from the front of the vehicle. Thereby, the image of the contour of the headrest can be picked up without being obstructed by the head portion of the seated passenger, so that the height of the headrest can be accurately determined despite the head portion of the passenger.

Specifically, the seat includes a pair of seats arranged substantially side by side in a vehicle width direction, and the image pickup means is provided at the specified position enabling the image pickup means to take the images of the two headrests of the seats from the front of the vehicle at the same time take. Thereby, the images of the two seats can be taken at the same time without using a particular camera having an extremely large image area (for example, a camera with a fisheye lens or a wide-angle lens), and thus can provide the proper images without improper distortion to be obtained.

In particular, the image pickup means is provided in the vicinity of a pillar member which extends substantially vertically along a side wall of the vehicle compartment. Thereby, the arrangement space of the image pickup means can be properly secured by using the pillar member.

Specifically, the seats from which images are picked up by the image pickup means are a driver's seat and a passenger seat, and the image pickup means is provided in the vicinity of an upper end portion of a front pillar as the pillar member. Thereby, the images of the driver's seat and the passenger's seat can be properly picked up by the image pickup means provided on the front pillar.

In particular, a rear seat is provided behind the driver's seat and the passenger's seat, and the image pickup means picks up respective images of a headrest of the rear seat and the headrests of the driver's seat and the passenger's seat at the same time. Thereby, the images of the headrests of the seats in the vehicle compartment can be picked up by the single image pickup means, so that the height of each headrest can be efficiently and properly determined based on the captured images.

Specifically, the objects of the image taken by the image pickup means include a head portion of the passenger sitting on the driver's seat, and the recognition means further determines a concentration degree of the passenger sitting on the driver's seat on a driving operation based on a position of the picked up Image of the passenger's headboard sitting on the driver's seat. Thereby, the degree of concentration of the passenger on the driving operation can be properly determined by using the same image as used for determining the height of the headrest. Thus, any car accident caused by inattentive driving or sleeping of the driver can be prevented by appropriate warnings.

In particular, the detection means determines a difference in height between the headrest of the seat and the head portion of the passenger seated on the seat. Thereby, it can be easily and surely determined whether the height of the headrest is set to an appropriate position capable of properly supporting the head portion of the seated passenger, and if the result of such determination is used in a warning device and the like, safety can be improved Vehicle impact can be improved more effectively.

In particular, a pair of first seats arranged substantially side by side and a second seat provided behind the first seats are provided in the vehicle compartment, the first seats and the second seat having seat belts for carrying passengers thereon each seat belt having a shoulder belt portion for restraining a shoulder portion of each of the passengers, the image pickup means being provided at an upper portion of the vehicle space located in front of seat backs of the first seats, wherein the illumination means is a first illumination means seated at an upper portion of the vehicle compartment located in front of the seat recliners of the first seats and radiating infrared rays to the rear, and comprising second lighting means provided behind the seat backs of the first seats and in front of a seat back of the second seat, and Infrared rays towards radiate, and wherein the detection means determines at least one seated state of the passenger sitting on the second seat. More specifically, the above-described detection means detects an application state of the shoulder belt portion of the second seat. Thereby, the precise detection of the shoulder portion of the second seat can be provided, which enables the detection of the state before the seat backs of the first seats. Consequently, the application state of the seat belts of the seats arranged longitudinally can be accurately recognized without an increase in cost.

In particular, the second illumination means emits near-infrared rays at substantially the same time as the first illumination means. Thereby, the shoulder portion of the second seat can be recognized more precisely.

In particular, the image pickup means is positioned substantially at a central portion of the vehicle compartment in a vehicle width direction. Thereby, the image area taken by the image pickup means can be properly enlarged.

Specifically, the detection means detects a state of a specified portion of the shoulder belt portion located near a vehicle body inner side portion. Thereby, the shoulder belt portion of the second seat can be more precisely recognized because the specified portion of the shoulder belt portion located near the vehicle body inner side portion can be provided so as not to overlap with the seated passenger when viewed from the front of the vehicle.

Specifically, in an application state thereof, the shoulder belt portion extends from a pillar on the vehicle body inner side portion toward a passenger seated on the second seat, and the detection means detects the state of the shoulder belt portion between the pillar and the passenger seated on the second seat. Thereby, the shoulder belt portion of the second seat can be accurately recognized.

In particular, the detection means further recognizes an application state of the shoulder belt portion of the first seats. Thereby, the state of the shoulder belt portions of the first and second seats can be recognized.

In connection with the above, a method for recognizing a vehicle interior condition may be implemented, comprising the steps of:
Radiating infrared rays into a vehicle compartment;
Capturing an image within the vehicle space into which the infrared rays are emitted from the illumination means; and
Recognizing specified information based on the image taken by the image pickup means,
wherein objects of the image picked up by the image pickup means comprise a seat movable relative to a vehicle body and a passenger seated on the seat, and
Determining a size of the passenger seated on the seat and / or a positional relationship between the seat and the passenger seated on the seat by comparing at least a portion of a contour of the seat with at least a portion of a contour of the passenger seated on sitting on the seat, on the picture taken.

Further provided is a computer program product comprising computer-implemented instructions which, when loaded and executed on a suitable system, may perform the steps of the method as described above, the computer program product in particular being a computer-readable storage medium, a signal and / or a data stream is executed.

The present invention is not limited to the above-described embodiments, and any other modifications and improvements can be made within the spirit of the present invention as defined in the appended claims.

Claims (17)

A vehicle interior condition recognition device for a vehicle, comprising: a lighting means ( 15 ; 210 ) for radiating infrared rays into a vehicle compartment; an image pickup means ( 16 ; 220 ) for taking an image within the vehicle compartment into which the infrared rays from the illumination means ( 15 ; 210 ) are broadcast; and a recognition means ( 18 ; 18 '; 230 ) for recognizing specified information based on the the image pickup means ( 16 ; 220 ), the vehicle has several rows of seats ( 4 . 5 . 6 ) contains objects of the image that are captured by the image acquisition means ( 16 ), the seats ( 4 . 5 . 6 ) movable relative to passengers (B; A-D) resting on the rows of seats (B; 4 . 5 . 6 ), the receiving means ( 16 ' ) the image of the passenger (C, D) sitting on the rows of seats ( 4 . 5 . 6 ) seat, at one time, and the detection means ( 18 ; 18 '; 230 ) a size of the passengers (C, D) sitting on the rows of seats ( 4 . 5 . 6 ), and / or a positional relationship between the rows of seats ( 4 . 5 . 6 ) and the passengers (C, D) seated on the rows of seats by determining at least part of a contour of the seat (C, D). 4 . 5 . 6 ) with at least a part of a contour of the passenger (C, D) sitting on the seat on the recorded image compares. A vehicle interior condition recognition apparatus comprising: a lighting means ( 15 ; 210 ) for radiating infrared rays into a vehicle compartment; an image pickup means ( 16 ; 220 ) for taking an image within the vehicle compartment into which the infrared rays from the illumination means ( 15 ; 210 ) are broadcast; and a recognition means ( 18 ; 18 '; 230 ) for recognizing specified information based on that of the image pickup means ( 16 ; 220 ), wherein objects of the image taken by the blinding device ( 16 ; 220 ), a seat ( 3 ; 2 - 6 ; S1a, S1b, S2a, S2b) movable relative to a vehicle body and a passenger (B; A-D) mounted on the seat (Fig. 3 ; 2 - 6 ; S1a, S1b, S2a, S2b), and the recognition means ( 18 ; 18 '; 230 ) a size of the passenger (B) lying on the seat ( 3 ), and / or a positional relationship between the seat ( 2 - 6 ; S1a, S1b, S2a, S2b) and the passenger (A-D) sitting on the seat, determined by at least a part of a contour of the seat ( 3 ; 2 - 6 ; S1a, S1b, S2a, S2b) with at least a part of a contour of the passenger (B; A-D) sitting on the seat, on the recorded image, the recognition means ( 18 ) also a degree of concentration of the passenger (A) sitting in the driver's seat ( 2 is seated on a driving operation based on a position of a head portion of the passenger (A) sitting on the driver's seat (FIG. 2 ), determined. The vehicle interior condition recognition apparatus according to claim 2, wherein the concentration degree is determined based on a position of the eyes and the mouth of the passenger (A). Vehicle interior condition recognition apparatus according to claim 2 or 3, wherein an inattentive driving is determined when both eyes of the driver on the right or left side of a standard line (L1) and / or the sleep of the driver is determined when both eyes in a lower area Preferably, the recognizer determines the degree of concentration as low if at least one of these conditions persists for a specified period of time. Vehicle interior condition recognition device according to one of the preceding claims, wherein the recognition means ( 18 ) the size of the passenger (B) sitting on the seat ( 3 ) sits, by comparing the contour of the seat ( 3 ) with the contour of the passenger (B) lying on the seat ( 3 ), determined on the recorded image. Vehicle interior condition recognition device according to one of the preceding claims, wherein the seat has a pair of seats ( 2 . 3 ), which are arranged substantially side by side in a vehicle width direction, and the image pickup means (FIG. 16 ) is provided at a specified position that the image pickup means ( 16 ) allows both images of the seats ( 2 . 3 ) at the same time, wherein the seats from which images through the image pickup means ( 16 ), preferably a driver's seat ( 2 ) and a passenger seat ( 3 ) are. Vehicle interior condition recognition device according to one or more of the preceding claims, wherein the image acquisition means ( 16 ) is provided in the vicinity of a pillar member which extends substantially vertically along a side wall of the vehicle compartment, the image pickup means ( 16 ) preferably in the vicinity of an upper end portion of a front pillar ( 10 ) is provided as the column member and / or a projecting portion ( 22a ) in the vicinity of an upper end portion of a pillar trim ( 22 ) is provided, which has an inner surface of the front pillar ( 10 ), and the image pickup means ( 16 ) in the projecting portion (FIG. 22a ) is housed. Vehicle interior condition recognition device according to one or more of the preceding claims, wherein the image acquisition means ( 16 ) on a side portion of the vehicle compartment on the driver's seat side ( 2 ) and an identifier ( 32 ) is provided with the size of the passenger (B) substantially on an inner surface of a seat back ( 3a ) of the passenger seat ( 3 ) can be compared. Vehicle interior condition recognition device according to one or more of the preceding claims, wherein the seat ( 2 - 6 ) at an upper end thereof with a headrest ( 51 - 56 ), the height of the headrest ( 51 - 56 ) and the detection means ( 18 ' ) the height of the headrest ( 51 - 56 ) relative to the passenger (A-D) sitting on the seat ( 2 - 6 ), based on a picture of the headrest ( 51 - 56 ) determined by the image pickup means ( 16 ), wherein the image pickup means ( 16 ) is preferably provided at a front side position of the vehicle compartment, which is the image pickup means ( 16 ) allows the image of the headrest ( 51 - 56 ) from the front of the vehicle, the seat preferably comprising a pair of seats ( 2 . 3 ), which are arranged substantially side by side in a vehicle width direction, and / or the image pickup means (FIG. 16 ) is provided at the specified position that the image pickup means ( 16 ) allows the images of the two headrests ( 51 . 52 ) of the seats ( 2 . 3 ) at the same time from the front of the vehicle. Vehicle interior condition recognition device according to one or more of the preceding claims, wherein a rear seat ( 4 . 5 ) behind the driver's seat ( 2 ) and the passenger seat ( 3 ) is provided and / or the image pickup means ( 16 ) respective images of a headrest ( 53 . 54 ) of the rear seat ( 4 . 5 ) and / or the headrests ( 51 . 52 ) of the driver's seat ( 2 ) and the passenger seat ( 3 ) preferably at the same time. A vehicle interior condition recognition device according to one or more of the preceding claims, wherein the objects of the image captured by the image acquisition means ( 16 ), a head portion of the passenger (A) sitting in the driver's seat ( 2 ), comprise and / or the recognition means ( 18 ' ) also a degree of concentration of the passenger (A) sitting in the driver's seat ( 2 is seated on a driving operation, preferably based on a position of the picked-up image of the head portion of the passenger (A) sitting on the driver's seat (FIG. 2 ), determined. Vehicle interior condition recognition device according to one or more of the preceding claims, wherein the recognition means ( 18 ' ) a difference in height between the headrest ( 51 - 56 ) of the seat ( 2 - 6 ) and the head section of the passenger (A-D) sitting on the seat ( 2 - 6 ), determined. A vehicle interior condition recognizing apparatus according to one or more of the preceding claims, wherein a pair of first seats (S1a, S1b) disposed substantially side by side and a second seat (S2a, S2b) provided behind the first seats (S1a, S1b) is provided in the vehicle compartment, wherein the first seats (S1a, S1b) and the second seat (S2a, S2b) have seat belts (B11) for restraining passengers seated thereon, each of the seat belts (B11) having a shoulder belt portion (SB) for retaining a shoulder portion of each of the passengers, wherein the image pickup means ( 220 ) is provided at an upper portion of the vehicle compartment, which is located in front of seat backs of the first seats (S1a, S1b), wherein the lighting means ( 210 ) a first illumination means ( 211 ) provided at an upper portion of the vehicle compartment, which is located in front of the seat backs of the first seats (S1a, S1b) and radiating infrared rays to the rear, and / or a second illumination means ( 212 ), which is provided behind the seat backs of the first seats (S1a, S1b) and in front of a seat back of the second seat (S2a, S2b) and emits infrared rays to the rear, and wherein the detection means ( 230 ) determines at least one seated state of the passenger seated on the second seat (S2a, S2b). Vehicle interior condition recognition apparatus according to claim 13, wherein the recognition means ( 230 ) is configured to recognize an application state of the shoulder belt portion (SB) of the first seats (S1a, S1b) and / or a condition of attachment of the shoulder belt portion (SB) of the second seat (S2a, S2b). Vehicle interior condition recognition device according to claim 13 or 14, wherein the second illumination means ( 212 ) is configured to emit near-infrared rays at substantially the same time as the first illumination means ( 211 ) and / or the image receiving means ( 220 ) is positioned substantially at a central portion of the vehicle compartment in a vehicle width direction and / or the detection means ( 230 ) is configured to detect a state of a specified portion of the shoulder belt portion (SB) located near a vehicle body inner side portion. The vehicle interior condition recognizing apparatus according to one or more of the preceding claims, wherein the shoulder belt portion (SB) extends in an application state thereof from a pillar (Pc) on the vehicle body inner side portion to a passenger seated on the second seat (S2a, S2b) and the detecting means ( 230 ) is configured to detect the state of the shoulder belt portion (SB) between the pillar (Pc) and the passenger seated on the second seat (S2a, S2b). A computer program product comprising computer-implemented instructions that, when loaded and executed in a suitable system, may perform the steps of: emitting infrared radiation into a vehicle compartment; Taking an image within the vehicle compartment into which the infrared rays from the illumination means ( 15 ; 210 ) are broadcast; and recognizing specified information based on that of the image pickup means ( 16 ; 220 ), wherein objects of the image captured by the image-receiving means ( 16 ; 220 ), a seat ( 3 ; 2 - 6 ; S1a, S1b, S2a, S2b) movable relative to a vehicle body and a passenger (B; A-D) mounted on the seat (Fig. 3 ; 2 - 6 ; S1a, S1b, S2a, S2b), and determining a size of the passenger (B) sitting on the seat ( 3 ), and / or a positional relationship between the seat ( 2 - 6 ; S1a, S1b, S2a, S2b) and the passenger (A-D) sitting on the seat by comparing at least a part of a contour of the seat ( 3 ; 2 - 6 ; S1a, S1b, S2a, S2b) with at least part of a contour of the passenger (B; A-D) seated on the seat on the recorded image, the detection means ( 18 ) also a degree of concentration of the passenger (A) sitting in the driver's seat ( 2 is seated on a driving operation based on a position of a head portion of the passenger (A) sitting on the driver's seat (FIG. 2 ), determined.

Images