EP3103063A1 - Erkennung einer sitzbelegung mittels einer kamera - Google Patents
Erkennung einer sitzbelegung mittels einer kameraInfo
- Publication number
- EP3103063A1 EP3103063A1 EP15716492.2A EP15716492A EP3103063A1 EP 3103063 A1 EP3103063 A1 EP 3103063A1 EP 15716492 A EP15716492 A EP 15716492A EP 3103063 A1 EP3103063 A1 EP 3103063A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- seat
- interest
- camera
- area
- pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
- B60R21/01512—Passenger detection systems
- B60R21/0153—Passenger detection systems using field detection presence sensors
- B60R21/01538—Passenger detection systems using field detection presence sensors for image processing, e.g. cameras or sensor arrays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/002—Seats provided with an occupancy detection means mounted therein or thereon
- B60N2/0021—Seats provided with an occupancy detection means mounted therein or thereon characterised by the type of sensor or measurement
- B60N2/0024—Seats provided with an occupancy detection means mounted therein or thereon characterised by the type of sensor or measurement for identifying, categorising or investigation of the occupant or object on the seat
- B60N2/0026—Seats provided with an occupancy detection means mounted therein or thereon characterised by the type of sensor or measurement for identifying, categorising or investigation of the occupant or object on the seat for distinguishing between humans, animals or objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
- G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
- G06K19/06009—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
- G06K19/06018—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking one-dimensional coding
- G06K19/06028—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking one-dimensional coding using bar codes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
- G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
- G06K19/06009—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
- G06K19/06037—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking multi-dimensional coding
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/593—Recognising seat occupancy
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
- H04N23/23—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only from thermal infrared radiation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/002—Seats provided with an occupancy detection means mounted therein or thereon
- B60N2/0021—Seats provided with an occupancy detection means mounted therein or thereon characterised by the type of sensor or measurement
- B60N2/0024—Seats provided with an occupancy detection means mounted therein or thereon characterised by the type of sensor or measurement for identifying, categorising or investigation of the occupant or object on the seat
- B60N2/0027—Seats provided with an occupancy detection means mounted therein or thereon characterised by the type of sensor or measurement for identifying, categorising or investigation of the occupant or object on the seat for detecting the position of the occupant or of occupant's body part
- B60N2/0028—Seats provided with an occupancy detection means mounted therein or thereon characterised by the type of sensor or measurement for identifying, categorising or investigation of the occupant or object on the seat for detecting the position of the occupant or of occupant's body part of a body part, e.g. of an arm or a leg
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2210/00—Sensor types, e.g. for passenger detection systems or for controlling seats
- B60N2210/10—Field detection presence sensors
- B60N2210/16—Electromagnetic waves
- B60N2210/18—Infrared
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2210/00—Sensor types, e.g. for passenger detection systems or for controlling seats
- B60N2210/10—Field detection presence sensors
- B60N2210/16—Electromagnetic waves
- B60N2210/22—Optical; Photoelectric; Lidar [Light Detection and Ranging]
- B60N2210/24—Cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
Definitions
- the invention relates to a method for detecting an occupancy of a seat by means of a camera and a Vorrich ⁇ device for performing this method, which has a camera. Especially in the field of passenger transport, it is of
- the object of the present invention is to provide a method for the reliable detection of seat occupancy, in particular in complex environments.
- This object is achieved by a method having the Merkma ⁇ len of claim 1. Furthermore, the invention has for its object to provide a durable device for performing this method.
- the inventive method for detecting occupancy of a seat provides that a camera is oriented such that it detects at least one area of interest of the seat.
- the area of interest is identified in a picture taken by the camera and a position of the area of interest is stored.
- subsequently captured by the camera images is selected by means of the evaluation device at the stored position of the region of interest and compared with at least one ge ⁇ stored image pattern. Depending on a result of this comparison, the seat is recognized as occupied.
- An area of interest is to be understood as meaning an image area which is to be used for the evaluation of the images. These may be, for example, certain areas of the seat.
- a head area of the seat is detected as Interes ⁇ sen Scheme.
- a head region is to be understood as that region of the seat in which a head of a person sitting on the seat is usually located. If the seat has a head shell, the head region of this seat can advantageously be formed by this head shell.
- the detection of the head range as an interest area offers among others part the advantage that are stored in the header field of rare luggage or clothing than in other areas of the sit ⁇ zes.
- the position of the area of interest designates the position of the respective area of interest in the room or, in the case of a constant camera orientation, the position of this area of interest in the overall image of the camera.
- the method according to the invention enables a reliable detection of occupancy of the seat in complex environments.
- a camera can also be used to detect the occupancy of multiple seats.
- Devices for carrying out the method can therefore realized low-cost who ⁇ the. Since only the areas of interest for seat occupancy detection are evaluated, it is not necessary for the entire seat to be visible on the images taken by the camera. For example, in passenger compartments of vehicles, one or more cameras can be installed on the ceilings. In addition, it is possible to use already existing cameras for other purposes in the passenger compartments for the implementation of the method.
- the core-optical process works wear-free and therefore permanently reliable compared to the sensors described in the beginning, which are arranged in the seats and mechanically loaded.
- the identified area of interest is stored as a picture pattern.
- the selected area of interest is then compared with this image pattern. Is obtained as the result of this comparison a deviation of the selected region of interest from ⁇ of the image pattern, the seat is detected as being occupied.
- a plausibility check is performed before the seat is recognized as occupied.
- the deviation from the image pattern found as a result is preferably compared with a parameterized disturbance pattern.
- a geometrical shape resembling a human body part can serve as a parameterized disturbance pattern.
- a circle with variable radius can be provided as a parameterized image of a human head as a parameterized interference pattern.
- the seat is detected as occupied when the parameterized Stö ⁇ approximately pattern can be brought by the choice situated within specified parameter limits parameters except at least at a predetermined minimum level to cover.
- this means can be ge ⁇ selects a radius of the circle with which the performing circuit can be sufficiently accurately ge ⁇ introduced with the deviation to cover the interference pattern, the deviation as a human head is scored and the seat recognized as occupied.
- the parameterized interference pattern used is an ellipse having predetermined parameter limits for its principal axis length and its minor axis length. This already allows an acceptable approximation of the perturbation pattern to the human head shape. In principle, however, the human head shape can be approximated with an arbitrarily large number of parameters and in this way the number of incorrect seat occupancy detections can be further reduced. In practice, the use of a parameterized human head shape as a parameterized perturbation pattern has proven particularly useful because the human head, or at least much of it, is very often uncovered.
- the deviation can be examined by means of the evaluation device for biometric features of a human head.
- the seat is then recognized as occupied if a predetermined minimum amount of biometric Characteristics in the deviation is found. In this way, the proportion of incorrect seat occupancy detections can be reduced in another way or further.
- biometric ⁇ -specific features while all recognizable features of the human body come into question. For example, the number of eyes, the number of ear, eye distance, the eye-nose distance or other features abandonedwer ⁇ tet can be.
- a message can be sent to the vehicle attendant that the seat is not occupied by a person but by another object, if that is the case Use case is an advantage.
- an infrared camera is used as the camera.
- the seat is identified as occupied if, in the comparison carried out by means of the evaluation device, a structure is found as a result in the selected area of interest that matches at least one of these at least one thermal pattern to a predetermined minimum size.
- This embodiment ⁇ variant has the advantage that the seat occupancy can be reliably detected regardless of the lighting situation.
- humans can be recognized more simply and therefore more cost effectively than cameras operating in the visible wavelength range.
- a passive infrared camera is used.
- one identified in the investigatedbe is arranged ⁇ rich, read the seat identifying marking off and stored, a read-out information.
- ⁇ DERS preferably, this is done before is selected by the Ausretevor ⁇ direction of the region of interest and compared with the stored image pattern.
- the reading of the mentioned Marking allows identification of the detected by the camera seat. If the camera detects the interest preparation ⁇ che plurality of seats, the jeweili ⁇ ge interest area may be associated with a particular seat in this manner.
- the occupancy states that are recognized in the various Interes ⁇ sen Symposiumen, then can be assigned particular seats.
- the occupancy of a seat may thus be stored for each identified seat, optionally together with its position within the vehicle, and / or provided for further processing.
- the marker may be implemented as a bar code or two-dimensional code. Such codes are reliably readable. In addition, they can be conveniently printed on the seat or stuck on ⁇ .
- the read Informa ⁇ tion, or the read-out information of several seats, with stored master data are compared.
- These stored master data may, for example, be the number of seats in a room detected by the camera or the identification data of these seats.
- a warning message can be output and / or the read-out of the markings identifying the seat or the seats can be repeated.
- a seat is detected as one or more Entprellept be advantageously carried out to prevent countries to that of the busy status of the seat is mistakenly lifted onto ⁇ , for example in consequence of a transient getting up, toilet or Bistro visit of a passenger.
- Occupied status is not canceled until a specified period has expired, provided that the seat is not recognized as occupied within this time period.
- the predetermined period of time is preferably chosen differently for different driving conditions of the vehicle in which the seat is arranged. For example, if a vehicle is moving on the open route, a longer time is given than if the vehicle is currently stopping at a stop.
- the occupancy detection of a seat can be switched off or ignored during driving conditions, which are known to involve a large number of person movements, for example at stop parts with entry and exit movements. In this way, the An ⁇ partially incorrect occupant detection can also be reduced.
- the camera is aligned in such a way that it detects the respectively associated area of interest of several seats. Furthermore, the method according to the invention or any further development thereof is carried out for at least a part, preferably for each, of these seats. In this way, it is possible to detect the occupancy states of several seats which are located in the detection area of this one camera with a single camera and thus with little outlay on equipment.
- the camera in the change can be aligned such that they alternately detects the Interes ⁇ sen Schemee different seats or seat of various groups. If the camera detects only one seat at each orientation, the occupancy status of different seats can be detected in this way. If, on the other hand, the camera detects different seat groups in different orientations, the occupancy states of the seats of these seat groups can be detected with little expenditure on equipment in this way.
- the detection of the occupancy states of a ⁇ individual seats of a seat group is carried out by, methods of the invention or a belie ⁇ bige further, is carried out as described above, detects each corresponding area of interest of the various seats of the seating arrangement and for each of these seats.
- the device according to the invention has, in addition to the camera, an evaluation device which is set up to identify areas of interest based on pattern recognition in images recorded by the camera and to store them together with their position.
- the evaluation device is further adapted to compare areas of interest based on the camera ⁇ taken images with stored image patterns.
- position of a field of interest is to be understood in the sense explained above.
- the device is preferably set up to identify several areas of interest in an image recorded by the camera and to store their positions. This makes it possible to identify the occupancy states of several seats in the manner described in connection with the method in a cost-effective manner.
- the evaluation device is advantageously set up to store the identified areas of interest, to determine deviations in the comparison and to compare these ascertained deviations with a parameterized disturbance pattern. This enables a more reliable detection of the seat occupancy state in the manner described above.
- a further reduction of false occupant detection enables the use of an evaluation device which is adapted to store identified regions of interest to detect deviations in the comparison and to examine these deviations determined on biometric features ei ⁇ nes human head toward.
- the camera is designed as an infrared camera, preferably a passive Inf ⁇ rarotski.
- the evaluation device is to be ⁇ aimed to identify, in the above comparison of regions of interest with stored image patterns in the areas of interest a structure that matches a pattern of the stored image of at least a predetermined minimum.
- the pre ⁇ directional areas of interest can be made of are evaluated by an infrared camera captured images and the advantages described in connection with the corresponding embodiment of the method can be utilized.
- the evaluation device is set up to identify and read markings of the seat contained in the images recorded by the camera. These markers are particularly preferably
- Barcodes or two-dimensional codes allow reliable reading of the information using best practices and devices. A recognized occupation state can thus clearly a particular seat to ⁇ ordered and these are located. If a Infrarotka ⁇ mera used the markings are expediently designed ⁇ be heated. In particular, the dashes of the
- Barcodes are heatable designed so that the individual lines are visible in a thermal image.
- a ⁇ averaging means by which the data read out of the markings of one or more seats as well as the, or may be the, busy status suregelei ⁇ tet.
- the occupancy states of the seats can be made available for further processing in this way.
- the camera is preferably equipped with a detector and an Op ⁇ tik, which is capable of fluorescence or Phosphorescent a fluorescent or phosphorescent to detect decorative marking. This makes it possible to read the markings mounted on the seats even under difficult lighting conditions, provided that fluorescent or phosphorescent markings are provided.
- FIG. 1 shows a schematic representation of a first embodiment ⁇ example of the method according to the invention
- FIG. 3 shows an area of interest of the seat from FIG. 2, the area of interest from FIG. 3 in the case of a seating position
- 2 is a schematic illustration of a comparison of a deviation from an image pattern with a parameterized interference pattern, a basic representation of a second exemplary embodiment of the method according to the invention, the seat from FIG. 2 with a position of an area of interest, an area of interest of the seat from FIG.
- FIG. 9 shows the area of interest from FIG. 8 in the case of occupancy of the seat, FIG.
- FIG. 10 shows a schematic representation of an embodiment of the device according to the invention.
- FIG. 1 shows a schematic diagram of a first exemplary embodiment of the method according to the invention. This will be explained in more detail by ⁇ following with the aid of the illustrations of Figures 2 to 5.
- a camera so aligned 10 that it detects at least a region of interest of a seat 30th
- the aligned camera Initial Deutschensstory be ⁇ accepted 10.
- a Interes ⁇ sen Scheme identified by means of an evaluation device in the Initialmaschinestruck and this is stored along with its position as the image pattern 12.
- a header area as the area of interest
- This head portion 32 is shown in FIG 3 again separately and is formed substantially by ei ⁇ ne head shell 36 of the seat 30.
- the head portion 32a may be identified as exactly, it can still residues of a handle 34 of the seat 30 umfas ⁇ sen.
- the head region 32a from FIG. 3 thus simultaneously represents the at least one and, in the exemplary embodiment of FIG. zige stored image pattern 40 is.
- the head region 32a has a marking, which is designed as a barcode 38.
- this may be fluorescent or phosphorescent bar code.
- This mark which identifies the seat 30 is subsequently read out 13 and the read-out information is stored.
- a follower image is taken by means of the camera and the region of interest is selected at the stored position of the head region 32a in this subsequent image 14.
- the seat 30 from FIG 2 of this next screen shows entstammende area of interest consequently turn egg nen head portion 32b of the seat 30. This is Darge provides ⁇ in FIG. 4
- a person prior to taking the subsequent image, a person has seated on the seat 30 whose head is arranged in the head region 32b. This head thus represents a deviation 41 with respect to the head region 32a.
- the seat 30 of FIG 2 this means a comparison of the head portion 32b of FIG 4 with the Rickmus ⁇ ter 40 representing head portion 32a of FIG Deviation 41 detected.
- the embodiment of FIG 1 provides a plausibility check 17 in the width ⁇ ren. If, in this case, the deviation 41 is considered to be plausible for a seat occupancy, the seat 30 is recognized as being occupied 18. Otherwise, the seat 30 is deemed free 20.
- FIG. 5 illustrates a plausibility check on the basis of a comparison of the deviation 41 with a parameterized disturbance pattern.
- parameterized disturbance pattern is thereby an elliptic interference patterns used 42, wherein a major axis length 46 and 44, the parame ter ⁇ represent a minor axis length of this elliptical interference pattern 42nd Parameter limits are specified for these parameters within which the minor axis length 44 and the major axis length 46 can be varied to bring the elliptic interference patterns bestmög ⁇ Lich except 41 to cover.
- this has already been done.
- the elliptical interference pattern 42 could be made to coincide with the deviation 41 to a large extent.
- the deviation is to further reduce false detections of a seat occupancy 41 searches on biometric characteristics of a human head out under ⁇ .
- the deviation 41 is checked on the basis of test routines known per se, whether the deviation 41 has at least one eye 48 and one lug 50.
- other biometric features can be used. In the example of FIG 5, these biometric features are present, so that the seat is recognized as occupied 18.
- FIG 1 provides that for a previously recognized as occupied seat, for which in the comparison 16 of the area of interest of the next image with the image ⁇ pattern no deviation is detected whose occupancy status is canceled only after a predetermined period of time. If this minimum time for a free recognition is reached, then the seat is recognized as free 20. If this minimum time for the free recognition is not reached, then the
- the predetermined time and thus the minimum ⁇ time for the free recognition can, as described above, depending on the driving condition of a vehicle in which the seat 30 mon ⁇ tiert, vary. Easier for understanding the conductedsbei ⁇ play of 1 to 5 has been described by one ertude- th from the camera seat 30th If the camera but so exclusively directed to detect the respective associated area of interest of several seats, the further process steps for each of these seats and each zuge culinaryi ⁇ gen areas of interest can be performed and the assignment of each of these seats will be recognized in this way.
- FIG. 6 shows a schematic representation of a second embodiment of the method according to the invention. This is in more detail below erläu ⁇ tert by means of the representations of 7 to 9.
- a camera is first aligned 10 such that it detects at least one area of interest of the seat 30.
- the camera which is a passivated ⁇ ve infrared camera in the embodiment of Figure 6, a Initialtechnischessent added 10.
- an evaluation tevoriques a researcher'slica
- a region which surrounds a heated bar code 68 is selected as the region of interest.
- the position 61 of the region of interest is indicated in Fi gur ⁇ 7, which do not an infrared image of the seat 30, son ⁇ countries representing an ordinary image of said seat 30 by means of a dashed line.
- FIG. 8 shows the area of interest 62a identified in the initialization screen. Since the initialization picture is a
- the heated bar code 68 appears bright in the illustration of Figure 8 and the cold environment black. As the process progresses, the heated bar code becomes
- FIG. 9 As can be seen in Figure 9, has again set before recording of the next image, a person on the seat 30 so ⁇ that in the interest portion 62b a thermal image of a human head can be seen.
- the one shown in Figure 9 surroundbe ⁇ rich 62b with different image patterns stored heat of a human head is compared 56. This comparison 56 is performed by the evaluation device. Since the area of interest 62b illustrated in FIG.
- a structure 64 is found in the area of interest 62b within the scope of this comparison 56, which corresponds to one of the stored thermal image patterns of a human head to a required minimum size. As a result, the seat is recognized as being occupied 58. If, on the other hand, no structure sufficiently matched to a thermal image would be found, the seat would be recognized as being free 60.
- the seat is the 60th recognized as free If this minimum time does not reach the free recognition, however, the busy status is maintained and exclusively selected in Next Tier ⁇ th next screen of the area of interest 54 contained therein and compared with the thermal imaging patterns 56.
- the default Time duration and thus the minimum time for the free ⁇ identifier can, as described above, depending on the driving condition of a vehicle in which the seat 30 is mounted, vary. In this way, it can be prevented that the occupancy status of the seat is erroneously canceled, for example due to a passenger getting up temporarily or due to a toilet visit.
- this device has an evaluation device 82.
- the evaluation device 82 is set up to identify areas of interest in images recorded by the camera 80 on the basis of pattern recognition methods known per se and to save them together with the position of the areas of interest.
- the evaluation ⁇ device 82 is adapted to compare the areas of interest with stored image patterns, and to determine deviations.
- the evaluation device 82 has a memory device 84 and a computing device 86.
- the evaluation device 82 is further configured to compare the determined deviation 41 with the parameterized, elliptical interference pattern 42, thereby matching the interference pattern as far as possible with the deviation 41 in the manner described above.
- the evaluation device 82 is adapted to the deviation at least to the biometric features of the presence of at least one eye and a nose towards investigate.
- the evaluation unit 82 adapted to identify the bar code 38 in taken by the camera 80 on ⁇ images and to read and store the information read.
- the evaluation device 82 shown in FIG 6 also comprises a conveying means 88, by means of which the data read from the bar code data 38 of the seat 30 and its busy state can be forwarded, examples of play to a higher level bearbeitungsvorrich ⁇ processing of a vehicle.
- the device shown in FIG. 10 can be used to carry out the method according to FIG.
- the camera 80 and the evaluation device 82 are designed for the simultaneous detection and processing of areas of interest of several seats. As a result, the occupancy states of several seats can be recognized with comparatively little expenditure on equipment.
- the camera 80 is rotatable by means of a positioning device 90 and stored variable in inclination so that it can be aligned in alternation DER art to detect alternately Interes ⁇ sen Schemee different seats or seat groups. In this way, the occupancy conditions of even more seats can be detected with little equipment.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- Transportation (AREA)
- Signal Processing (AREA)
- Aviation & Aerospace Engineering (AREA)
- Toxicology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Seats For Vehicles (AREA)
- Image Processing (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Geophysics And Detection Of Objects (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102014207009.0A DE102014207009A1 (de) | 2014-04-11 | 2014-04-11 | Erkennung einer Sitzbelegung mittels einer Kamera |
| PCT/EP2015/057822 WO2015155328A1 (de) | 2014-04-11 | 2015-04-10 | Erkennung einer sitzbelegung mittels einer kamera |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP3103063A1 true EP3103063A1 (de) | 2016-12-14 |
Family
ID=52875149
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP15716492.2A Ceased EP3103063A1 (de) | 2014-04-11 | 2015-04-10 | Erkennung einer sitzbelegung mittels einer kamera |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US10296797B2 (de) |
| EP (1) | EP3103063A1 (de) |
| CN (1) | CN206520507U (de) |
| DE (1) | DE102014207009A1 (de) |
| RU (1) | RU173633U1 (de) |
| WO (1) | WO2015155328A1 (de) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102015104768B4 (de) * | 2015-03-27 | 2023-03-16 | Bundesdruckerei Gmbh | Zugangssystem mit Personenerkennungsvorrichtung |
| JP6984992B2 (ja) * | 2015-09-30 | 2021-12-22 | 日本電気株式会社 | 情報処理装置、情報処理方法、プログラム、および席予約システム |
| DE102016003315A1 (de) | 2016-03-17 | 2016-10-06 | Daimler Ag | Verfahren zur Erfassung einer Sitzbelegung |
| DE102016207376A1 (de) * | 2016-04-29 | 2017-11-02 | Robert Bosch Gmbh | Verfahren und Vorrichtung zum Erkennen von zumindest einer Position einer Person und/oder einer veränderten Position der Person oder einer weiteren Person für ein Fahrzeug und Verfahren zum Aktivieren eines Personenschutzmittels für ein Fahrzeug |
| JP2017222337A (ja) * | 2016-06-14 | 2017-12-21 | アイシン精機株式会社 | 着座状態検出装置 |
| CN109398302A (zh) * | 2018-10-30 | 2019-03-01 | 四川长虹电器股份有限公司 | 基于AprilTag标签的车内儿童状态监测系统 |
| KR102601354B1 (ko) * | 2018-11-29 | 2023-11-13 | 현대모비스 주식회사 | 영상기반 승객 검출 및 안전벨트 착용 검출 장치와 방법 |
| DE102019206233A1 (de) * | 2019-04-30 | 2020-11-05 | Siemens Mobility GmbH | Verfahren zur Bereitstellung von Trainingsdaten für adaptierbare Situationserkennungsalgorithmen sowie Verfahren zur automatisierten Situationserkennung von Betriebssituationen eines Fahrzeugs zur öffentlichen Personenbeförderung |
| CN113516112B (zh) * | 2021-09-14 | 2021-11-30 | 长沙鹏阳信息技术有限公司 | 一种基于聚类的规则排列物体自动识别及编号方法 |
| EP4216173A1 (de) | 2022-01-21 | 2023-07-26 | Aptiv Technologies Limited | Verfahren und system zur sitzbelegungserkennung |
| KR102570386B1 (ko) * | 2023-03-17 | 2023-08-28 | (주)지앤티솔루션 | 다인승전용차로 내 차량의 탑승인원 검지를 위한 서비스 제공 시스템 및 방법 |
| US20240428447A1 (en) * | 2023-06-22 | 2024-12-26 | Honeywell International S.R.O. | System and method for detecting the positioning of a person relative to a seat |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140032098A1 (en) * | 2012-07-26 | 2014-01-30 | Garmin Switzerland Gmbh | Navigation device and method for guiding high-occupancy vehicles |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9008854B2 (en) * | 1995-06-07 | 2015-04-14 | American Vehicular Sciences Llc | Vehicle component control methods and systems |
| US9129505B2 (en) | 1995-06-07 | 2015-09-08 | American Vehicular Sciences Llc | Driver fatigue monitoring system and method |
| JP3843971B2 (ja) * | 2003-07-29 | 2006-11-08 | 日産自動車株式会社 | 乗員検知装置 |
| DE102004020255B4 (de) * | 2004-03-12 | 2008-03-20 | Daimler Ag | Überwachungssystem für Fahrzeuge |
| FR2877279B1 (fr) | 2004-11-03 | 2008-06-27 | Faurecia Sieges Automobile | Systeme de detection de presence d'un occupant sur un siege de vehicule automobile, siege adapte a ce systeme et vehicule comportant un tel systeme |
| RU58087U1 (ru) * | 2006-03-06 | 2006-11-10 | Закрытое Акционерное Общество "Весоизмерительная Компания "Тензо-М" | Устройство для индикации наличия пассажира на сидении транспортного средства |
| CN102348576A (zh) * | 2009-03-10 | 2012-02-08 | 株式会社藤仓 | 头枕位置调整装置及头枕位置调整方法 |
| JP5636102B2 (ja) * | 2011-06-17 | 2014-12-03 | 本田技研工業株式会社 | 乗員検知装置 |
| US9549257B2 (en) * | 2013-03-27 | 2017-01-17 | Pinnacle Peak Holdings Corporation | Feedback cancellation for vehicle communications system |
-
2014
- 2014-04-11 DE DE102014207009.0A patent/DE102014207009A1/de not_active Withdrawn
-
2015
- 2015-04-10 US US15/301,990 patent/US10296797B2/en active Active
- 2015-04-10 CN CN201590000427.XU patent/CN206520507U/zh not_active Expired - Fee Related
- 2015-04-10 EP EP15716492.2A patent/EP3103063A1/de not_active Ceased
- 2015-04-10 WO PCT/EP2015/057822 patent/WO2015155328A1/de not_active Ceased
- 2015-04-10 RU RU2016139715U patent/RU173633U1/ru active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140032098A1 (en) * | 2012-07-26 | 2014-01-30 | Garmin Switzerland Gmbh | Navigation device and method for guiding high-occupancy vehicles |
Also Published As
| Publication number | Publication date |
|---|---|
| RU173633U1 (ru) | 2017-09-04 |
| US10296797B2 (en) | 2019-05-21 |
| DE102014207009A1 (de) | 2015-10-15 |
| US20170116489A1 (en) | 2017-04-27 |
| CN206520507U (zh) | 2017-09-26 |
| WO2015155328A1 (de) | 2015-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2015155328A1 (de) | Erkennung einer sitzbelegung mittels einer kamera | |
| DE102019134141B4 (de) | Sicherheitsgurt-Zustandsbestimmungsverfahren | |
| EP3393875B1 (de) | Verfahren zum verbesserten erkennen von objekten durch ein fahrerassistenzsystem | |
| DE102012202271A1 (de) | Vorrichtung und Verfahren zur Reifenprüfung | |
| DE102018213268A1 (de) | Verfahren zur anwendung in einem fahrzeug | |
| DE102019103963A1 (de) | Ildgebungsvorrichtung | |
| DE102022103818A1 (de) | Verfahren und system zum erkennen eines sitzbelegungszustands einer sitzanordnung auf basis von radarpunktwolken | |
| EP2260699B1 (de) | Optisch gestützte Nutztierortungsvorrichtung | |
| DE102015205094A1 (de) | Vorrichtung zum automatischen Erfassen eines Zustands eines Objekts, Auswertevorrichtung zum automatischen Bestimmen eines vorbestimmten Zustands eines Objekts und Verfahren zum automatischen Bestimmen eines vorbestimmten Zustands eines Objekts | |
| DE102010003669A1 (de) | Verfahren und Vorrichtung zur Lokalisierung von Personen in einem vorgegebenen Bereich | |
| EP2320384A1 (de) | Verfahren zur Kennzeichenerkennung und Mautkategorisierung von Fahrzeugen | |
| DE102022107150A1 (de) | Elektronische Vorrichtung und Verfahren zum Überwachen des Verhaltens eines Fahrers beim Fahren eines Fahrzeugs, zugehöriges elektronisches Überwachungssystem und Computerprogramm | |
| DE102016120066A1 (de) | Computer-implementiertes Verfahren zum Kontrollieren bzw. Testen eines Objekterkennungssystems | |
| DE102019211459A1 (de) | Verfahren und Vorrichtung zum Überprüfen einer Kalibrierung von Umfeldsensoren | |
| WO2024115346A1 (de) | Verfahren und system zum erkennen eines sitzpelegungszustands in einem fahrzeug | |
| EP3172697A1 (de) | Vorrichtung zur optischen geschlechtserkennung eines schlachtschweins | |
| DE102023108510A1 (de) | Verfahren und System zur Messung der Geschwindigkeit von Fahrzeugen im Straßenverkehr | |
| DE102007055704A1 (de) | Vorrichtung und Verfahren zum Zählen von Tieren beim Transport | |
| DE102012205000B3 (de) | Verfahren und Vorrichtung zur Zählung von Objekten | |
| DE102007033133A1 (de) | Verfahren und Vorrichtung zur Detektion von Objekten | |
| EP3540507A1 (de) | Bildaufnahmevorrichtung und verfahren zum aufnehmen einer bildaufnahme eines dokuments und verwendung | |
| DE102024118431B3 (de) | Sicherheitsgurt eines Fahrzeugs | |
| DE102019211557A1 (de) | Bahnsignalerkennung für autonome Schienenfahrzeuge | |
| EP3563356B1 (de) | Verfahren und vorrichtung zum detektieren eines sicherheitsfadens in einem wertdokument | |
| DE102023131282B3 (de) | Verfahren und Vorrichtung zum Prüfen eines Sicherheitselements für ein Sicherheitsdokument |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20160909 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIEMENS AKTIENGESELLSCHAFT |
|
| 17Q | First examination report despatched |
Effective date: 20180625 |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIEMENS MOBILITY GMBH |
|
| APBK | Appeal reference recorded |
Free format text: ORIGINAL CODE: EPIDOSNREFNE |
|
| APBN | Date of receipt of notice of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA2E |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R003 |
|
| APAF | Appeal reference modified |
Free format text: ORIGINAL CODE: EPIDOSCREFNE |
|
| APBT | Appeal procedure closed |
Free format text: ORIGINAL CODE: EPIDOSNNOA9E |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
| 18R | Application refused |
Effective date: 20200604 |