JP2023543339A - Vehicle interior occupant detection method and device, electronic equipment, and storage medium - Google Patents

Abstract

The present disclosure relates to a method and device for detecting an occupant in a vehicle, an electronic device, and a storage medium. The method includes: acquiring an image of the interior of the vehicle (S11); detecting a riding area of a target occupant belonging to a predetermined target range in the vehicle interior based on the image (S12); The method includes generating alert information in response to detecting that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range (S13). [Selection diagram] Figure 1

Description

This application is a Chinese patent application filed with the National Intellectual Property Office of China on August 31, 2020, with application number 202010896370.3 and the title of the invention is "Vehicle interior occupant detection method and device, electronic equipment and storage medium". claims priority, the entire disclosure of which is incorporated herein by reference.

The present disclosure relates to the field of computer vision technology, and in particular to a method and apparatus for detecting an occupant in a vehicle, electronic equipment, and a storage medium.

Currently, the automotive electronics industry is rapidly developing and providing a convenient and comfortable cabin environment for people to ride. Increasing the intelligence and safety of vehicle interiors is an important direction for the development of the current automobile industry. Improving riding safety for passengers is important.

The present disclosure provides technical means for vehicle interior occupant detection.

According to one aspect of the present disclosure,
Obtaining images of the interior of the vehicle,
Detecting a riding area of a target occupant belonging to a predetermined target range in the vehicle interior based on the image;
Provided is a method for detecting an occupant in a vehicle interior, the method comprising: generating alert information in response to detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range. .

An image of the interior of the vehicle is acquired, and based on the image, a riding area of a target occupant belonging to a predetermined target range in the vehicle interior is detected, and the riding area of the target occupant is determined to be non-conforming to the predetermined target range. By generating alert information in response to the detection of the vehicle being in the permitted riding area, riding safety for the occupant can be improved.

In one possible embodiment, the target occupants belonging to the predetermined target audience range include child occupants;
Generating the alert information in response to the detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range includes:
The method includes generating attention-calling information in response to detecting that the riding area for the child occupant is a front seat area of the vehicle interior.

This embodiment generates alert information in response to detecting that the riding area of the child occupant is the front seat area of the vehicle interior, so that the child occupant can ride in the front seat area of the vehicle interior. It is possible to alert children when they get on the vehicle, contributing to improving riding safety for child passengers.

In one possible embodiment, the target occupants belonging to the predetermined target range are:
including at least one of a child occupant below a first predetermined age threshold, a child occupant below a second predetermined age threshold, and a child occupant below a third predetermined age threshold;
Generating the alert information in response to the detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range includes:
generating alert information in response to detecting that a riding area for a child occupant under the first predetermined age threshold is a front seat area of a vehicle interior;
In response to it being detected that the riding area for a child occupant under the second predetermined age threshold, which is smaller than the first predetermined age threshold, is a front seat area or a non-safety seat area of the vehicle interior, generating arousal information; and
Generating alert information in response to detecting that a passenger area for a child occupant who is less than the third predetermined age threshold, which is greater than the first predetermined age threshold, is a front driver's seat area of the vehicle interior. including at least one of the following.

In this embodiment, in response to the detection that the riding area of the child occupant under the first predetermined age threshold is the front seat area of the vehicle interior, the alerting information is generated, and the target The driver or other occupant may be alerted to seat the occupant in the rear seat area, or the target occupant may be alerted to move to the rear seat area themselves. In response to detecting that the riding area of a child occupant under the second predetermined age threshold is a front seat area or a non-safety seat area of the vehicle interior, generating alert information It is possible to alert the driver or other occupants to seat the occupant in the rear seat area and to seat the target occupant in the child safety seat. In response to detecting that the riding area of the child occupant under the third predetermined age threshold is the front driver's seat area of the vehicle interior, generating alert information to prompt the child passenger to leave the driver's seat area. The target occupant can be alerted to the situation.

In one possible embodiment, the target occupants belonging to the predetermined target range include occupants who have reached a fourth predetermined age threshold;
Generating the alert information in response to the detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range includes:
The method includes generating alert information in response to detecting that the riding area of the occupant who has reached the fourth predetermined age threshold is a front seat area of the vehicle interior.

In this embodiment, the fourth predetermined age threshold is generated by generating the alert information in response to the detection that the passenger area of the occupant who has reached the fourth predetermined age threshold is the front seat area of the vehicle interior. When an elderly passenger who has reached a predetermined age threshold gets into the front seat area of the vehicle, a warning can be given, contributing to improving riding safety for the elderly.

In one possible embodiment, the target occupants belonging to the predetermined target range include occupants whose age meets a predetermined age threshold restriction condition;
Detecting the riding area of a target occupant belonging to a predetermined target range within the vehicle interior based on the image described above includes:
Detecting the age of an occupant in the vehicle interior based on the image;
determining whether or not the occupant is a target occupant belonging to a predetermined target range based on a matching result between the age of the occupant and the predetermined age threshold restriction condition;
The method includes detecting a riding area of the occupant in response to the occupant being the target occupant.

In this embodiment, the age of the occupant in the vehicle interior is detected based on the image, and based on a matching result between the age of the occupant and the predetermined age threshold restriction condition, the occupant falls within a predetermined target range. A target occupant belonging to a predetermined target range within the vehicle interior is determined by determining whether the occupant is a target occupant and detecting the riding area of the occupant depending on whether the occupant is the target occupant. It is possible to accurately specify the riding area of the passenger.

In one possible embodiment, detecting the age of the occupant in the vehicle interior based on the image includes:
The method includes detecting the age of an occupant in the vehicle interior based on a face area in the image to obtain the age of the occupant in the vehicle interior.

By detecting the age of the occupant in the vehicle interior based on the face area in the image and obtaining the age of the occupant in the vehicle interior, the user does not need to input age information in advance, and the age of the occupant in the vehicle interior is obtained based on the image. The age of the occupant in the room can be directly identified, and the convenience of age detection can be improved.

In one possible embodiment, detecting the age of the occupant in the vehicle interior based on the image includes:
acquiring face information of the occupant in the vehicle interior based on the image;
In response to the fact that the actual age information corresponding to the facial information of the passenger is obtained through matching from the passenger information data acquired in advance, the age information of the passenger is determined based on the actual age information corresponding to the facial information of the passenger. identifying the age of the person;

Based on the image, facial information of the occupant in the vehicle interior is acquired, and actual age information corresponding to the facial information of the occupant is obtained through matching from the previously acquired occupant information data. By specifying the age of the occupant based on actual age information corresponding to facial information of the occupant, the age of the occupant can be accurately specified using previously acquired occupant information data.

In one possible embodiment, the method comprises:
Obtaining geolocation information of the vehicle;
and adjusting a predetermined age threshold corresponding to the predetermined target range based on riding area restriction information corresponding to the geolocation information, wherein the riding area restriction information corresponds to the predetermined target range. including a restrictive correspondence between a predetermined age threshold corresponding to a non-permitted riding area and a corresponding predetermined age threshold.

According to this embodiment, by adjusting the predetermined age threshold according to the traffic regulations of the area where the vehicle is located, it is possible to make the adjusted predetermined age threshold match the local traffic regulations.

In one possible embodiment, after generating the alerting information,
obtaining user feedback information including actual age information of the subject occupant;
The method further includes storing a correspondence between facial information of the target occupant and actual age information of the target occupant based on the user feedback information.

In this embodiment, by obtaining user feedback information and storing a correspondence between facial information of the target occupant and actual age information of the target occupant based on the user feedback information, When the target occupant is detected, based on the actual age information of the target occupant, further, the riding area of the target occupant corresponds to an unauthorized riding area for a predetermined target range to which the target occupant belongs. As a result, more accurate matching results can be obtained.

In one possible embodiment, the method comprises:
The method further includes adjusting a predetermined age threshold corresponding to a predetermined target range to which the target occupant belongs, depending on a mismatch between the target occupant's actual age information and the detected age information.

In this embodiment, a predetermined age threshold corresponding to a predetermined range of subjects to which the target occupant belongs is adjusted according to a discrepancy between the actual age information of the target occupant and the detected age information. This contributes to improving the accuracy of subsequent age detection, and as a result, contributes to further improving riding safety for the target occupant.

In one possible embodiment, the method comprises:
obtaining an age threshold adjustment request;
The method further includes adjusting a predetermined age threshold corresponding to the predetermined target range based on the age threshold adjustment request.

In this embodiment, the user can adjust the age threshold according to actual demand by obtaining an age threshold adjustment request and adjusting a predetermined age threshold corresponding to the predetermined target range based on the age threshold adjustment request. The predetermined age threshold value corresponding to the predetermined target range can be flexibly adjusted, which contributes to further improving riding safety for target occupants belonging to the predetermined target range.

According to one aspect of the present disclosure,
a first acquisition module for acquiring images inside the vehicle;
a detection module for detecting a riding area of a target occupant belonging to a predetermined target range in the vehicle interior based on the image;
A vehicle interior occupant detection device comprising: a generation module for generating alert information in response to detection that the target occupant's riding area corresponds to a non-permitted riding area for the predetermined target person range. I will provide a.

In one possible embodiment, the target occupants belonging to the predetermined target audience range include child occupants;
The generation module is
It is used to generate attention-calling information in response to the detection that the riding area of the child passenger is the front seat area of the vehicle interior.

In one possible embodiment, the target occupants belonging to said predetermined target range are child occupants below a first predetermined age threshold, child occupants below a second predetermined age threshold, and child occupants below a third predetermined age threshold. including at least one of the crew members;
The generation module is
generating alert information in response to detecting that a riding area for a child occupant under the first predetermined age threshold is a front seat area of a vehicle interior;
In response to it being detected that the riding area for a child occupant under the second predetermined age threshold, which is smaller than the first predetermined age threshold, is a front seat area or a non-safety seat area of the vehicle interior, generating arousal information; and
Generating alert information in response to detecting that a passenger area for a child occupant who is less than the third predetermined age threshold, which is greater than the first predetermined age threshold, is a front driver's seat area of the vehicle interior. It is used to perform at least one of the following:

In one possible embodiment, the target occupants belonging to the predetermined target range include occupants who have reached a fourth predetermined age threshold;
The generation module is
It is used to generate alert information in response to the detection that the passenger area of the occupant who has reached the fourth predetermined age threshold is the front seat area of the vehicle interior.

In one possible embodiment, the target occupants belonging to the predetermined target range include occupants whose age meets a predetermined age threshold restriction condition;
The detection module includes:
detecting the age of the occupant in the vehicle interior based on the image;
Determining whether or not the occupant is a target occupant belonging to a predetermined target range based on a matching result between the age of the occupant and the predetermined age threshold restriction condition;
It is used to detect the riding area of the occupant depending on whether the occupant is the target occupant.

In one possible embodiment, the detection module comprises:
The age of the occupant in the vehicle interior is detected based on the face area in the image, and is used to obtain the age of the occupant in the vehicle interior.

In one possible embodiment, the detection module comprises:
acquiring face information of the occupant in the vehicle interior based on the image;
In response to the fact that the actual age information corresponding to the facial information of the passenger is obtained through matching from the passenger information data acquired in advance, the age information of the passenger is determined based on the actual age information corresponding to the facial information of the passenger. It is used to determine the age of a person.

In one possible embodiment, the device comprises:
a second acquisition module for acquiring geolocation information of the vehicle;
further comprising a first adjustment module for adjusting a predetermined age threshold corresponding to the predetermined target range based on riding area restriction information corresponding to the geolocation information, the riding area restriction information comprising: A restrictive correspondence between a predetermined age threshold corresponding to a predetermined audience range and a non-permitted riding area is included.

In one possible embodiment, the device comprises:
a third acquisition module for acquiring user feedback information including actual age information of the target occupant;
The apparatus further includes a storage module for storing a correspondence between facial information of the target occupant and actual age information of the target occupant based on the user feedback information.

In one possible embodiment, the device comprises:
The system further includes a second adjustment module for adjusting a predetermined age threshold corresponding to a predetermined target range to which the target occupant belongs, depending on a discrepancy between the target occupant's actual age information and the detected age information. .

In one possible embodiment, the device comprises:
a fourth acquisition module for acquiring an age threshold adjustment request;
The method further includes a third adjustment module for adjusting a predetermined age threshold corresponding to the predetermined target range based on the age threshold adjustment request.

According to one aspect of the present disclosure, the one or more processors include one or more processors and a memory for storing executable instructions, the one or more processors comprising executable instructions stored in the memory. An electronic device is provided that is configured to perform the method described above by calling .

According to one aspect of the present disclosure, there is provided a computer-readable storage medium having computer program instructions stored thereon, the computer-readable storage medium having computer program instructions that, when executed by a processor, effectuate the method described above. Provide a storage medium.

According to one aspect of the present disclosure, there is provided a computer program product comprising computer readable code, the computer readable code, when operated on an electronic device, causing a processor of the electronic device to implement the method described above. Provide a computer program that executes.

In an embodiment of the present disclosure, an image of the interior of the vehicle is acquired, and a riding area of a target occupant belonging to a predetermined target range in the vehicle interior is detected based on the image, and the riding area of the target occupant is Riding safety for passengers can be improved by generating alert information in response to detection of a non-permitted riding area for a predetermined target range.

It is to be understood that the foregoing general description and the following detailed description are exemplary and interpretive only and are not intended to limit the disclosure.

Other features and aspects of the present disclosure will become clear from the following detailed description of exemplary embodiments with reference to the drawings.

The drawings herein are incorporated as part of the specification, illustrate embodiments according to the present disclosure, and are used together with the specification to explain the technical means of the present disclosure.
5 shows a flowchart of a method for detecting a vehicle interior occupant according to an embodiment of the present disclosure. 1 shows a schematic diagram of an application scene of an embodiment of the present disclosure. FIG. 6 shows a schematic diagram of another application scene of the embodiment of the present disclosure. 1 shows a block diagram of a vehicle interior occupant detection device according to an embodiment of the present disclosure. FIG. 8 shows a block diagram of an electronic device 800 according to an embodiment of the present disclosure. 19 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure.

Various exemplary embodiments, features, and aspects of the present disclosure are described in detail below with reference to the drawings. The same reference numerals in the drawings indicate elements of the same or similar function. Although various aspects of the embodiments are illustrated in the drawings, the drawings need not be drawn to scale unless otherwise indicated.

The term "exemplary" herein means "serving as an example, embodiment, or illustrative." Any embodiment described herein as "exemplary" is not to be construed as preferred or superior to other embodiments.

The term "and/or" herein merely describes a related relationship, and indicates that three relationships can exist. For example, A and/or B can represent three cases: a case where only A exists, a case where A and B exist simultaneously, and a case where only B exists. Moreover, the term "at least one" in this specification indicates any one of a plurality or any combination of at least two of a plurality. For example, "containing at least one of A, B, and C" can indicate that one or more elements selected from the set consisting of A, B, and C are included.

In addition, many specific details are set forth in the following specific embodiments to better explain the present disclosure. Those skilled in the art should understand that the present disclosure may equally be practiced without any specific details. In some embodiments, detailed descriptions of methods, means, elements, and circuits that are well known to those skilled in the art are omitted to emphasize the spirit of the present disclosure.

In an embodiment of the present disclosure, an image of the interior of the vehicle is acquired, and a riding area of a target occupant belonging to a predetermined target range in the vehicle interior is detected based on the image, and the riding area of the target occupant is Riding safety for passengers can be improved by generating alert information in response to detection of a non-permitted riding area for a predetermined target range.

FIG. 1 shows a flowchart of a method for detecting a vehicle interior occupant according to an embodiment of the present disclosure. The vehicle interior occupant detection method may be executed by a vehicle interior occupant detection device. In one possible embodiment, the vehicle interior occupant detection method may be performed by a terminal device, a server or another processing device. Here, the terminal device includes an in-vehicle device, a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, and a computer. It may be a device, a wearable device, etc. Here, the in-vehicle device may be an in-vehicle infotainment or a domain controller in the vehicle interior, and is used to monitor images, etc. in an OMS (Occupant Monitoring System) or a DMS (Driver Monitor System). It may also be a device host or the like for performing data processing operations. In some possible embodiments, the vehicle interior occupant detection method may be implemented by a processor invoking computer readable instructions stored in a memory. As shown in FIG. 1, the vehicle interior occupant detection method includes steps S11 to S13.

In step S11, an image of the interior of the vehicle is acquired.

Embodiments of the present disclosure can be used in at least one type of vehicle, such as a private car, a shared car, a ride-hailing car, a taxi, etc.

In one possible embodiment, the image of the interior of the vehicle may be one or more video frames within a video stream of the interior of the vehicle. In this embodiment, a video stream inside the vehicle interior may be collected by a camera installed inside or outside the vehicle interior. For example, the camera provided in the vehicle interior may include an OMS camera, a DMS camera, or the like.

In step S12, based on the image, a riding area of a target occupant belonging to a predetermined target range in the vehicle interior is detected.

In embodiments of the present disclosure, the predetermined target range may be a predetermined target range having predetermined attributes, such as children, elderly people, and disabled people. The predetermined target range may further include a customized target group, for example, a target group that is not the registered driver of the vehicle compartment, and is not particularly limited thereto. The target occupant may refer to an occupant who belongs to a predetermined target range among the occupants in the vehicle interior. The boarding area refers to a position area where a passenger appears in a vehicle, and may include at least one of a seating area, a boarding area, a stay area, and the like.

In the embodiment of the present disclosure, based on the image, at least one of the characteristics of the occupant, such as the face, clothes, body shape, and height, is extracted to determine whether the occupant has attributes in a predefined target range. By determining whether or not the occupant belongs to a predetermined target range, it may be determined. Alternatively, it may be determined whether the occupant belongs to a predetermined target range based on the occupant's biometric feature recognition results (for example, face identification results). In one example, face identification may be performed based on the image to obtain a facial identification result of the occupant. If it is determined that the occupant is a registered driver of the vehicle compartment based on the facial recognition result of the occupant, it may be determined that the occupant does not belong to a predetermined target range. If it is determined that the occupant is not the registered driver of the vehicle compartment based on the facial recognition result of the occupant, at least one of the characteristics of the occupant such as face, clothing, body shape, height, etc. is extracted and the If it is determined that the occupant has an attribute of a predefined target range based on at least one of the occupant's characteristics such as face, clothing, body shape, height, etc., the occupant falls within the predefined target range. When it is determined that the passenger does not have the attributes of a predefined target range based on at least one of the characteristics of the passenger, such as face, clothing, body shape, height, etc. , it may be determined that the occupant does not belong to a predetermined target range. Alternatively, if it is determined that the occupant is not the registered driver of the vehicle compartment based on the facial recognition result of the occupant, it may be directly determined that the occupant belongs to a predetermined target range. For example, in at least one application scene of a ride-hailing car, a taxi, a commercial vehicle, etc., if it is determined that the occupant is not the registered driver of the vehicle compartment based on the facial recognition result of the occupant, the occupant is It may be directly determined that the person belongs to a predetermined target range.

In one possible embodiment, detecting the riding area of a target occupant belonging to a predetermined target range within the vehicle interior based on the image includes detecting a predetermined area within the vehicle interior based on the image. detecting whether or not there is a target occupant belonging to a predetermined target range; and detecting a riding area of the target occupant in response to the detection of the target occupant belonging to a predetermined target range; including. According to this embodiment, it is possible to first detect target occupants in the vehicle interior that belong to a predetermined target range, and then to detect the riding area of each target occupant.

In another possible embodiment, detecting the riding area of a target occupant belonging to a predetermined target range within the vehicle interior based on the image includes detecting a riding area of a target occupant within the vehicle interior based on the image. Detecting whether or not there is a target occupant belonging to a predetermined target range for each riding area, and based on the detection result of the target occupant belonging to the predetermined target range for each boarding area. , specifying a riding area of a target occupant belonging to a predetermined target range in the vehicle interior. For example, in this embodiment, for any riding area, an image area corresponding to the riding area is specified based on the image, and a target belonging to a predetermined target range is identified in the image area corresponding to the riding area. It may also be possible to detect whether or not an occupant is present.

In one possible embodiment, the vehicle interior may be divided in advance into a plurality of set areas, and detecting the riding area of the target occupant may include selecting a set area in which the target occupant is present among the plurality of set areas. It may also include detecting. For example, the setting areas may include a front seat area, a rear seat area, a driver seat area, a passenger seat area, and the like.

As an example of this embodiment, the riding area of the target occupant is specified based on the image coordinates of the target occupant in the image coordinate system corresponding to the image inside the vehicle interior, and the correspondence between the image coordinates and the riding area. Good too.

As another example of the embodiment, the riding area of the target occupant is determined based on the range of the image coordinates of the target occupant in the image coordinate system corresponding to the image inside the vehicle interior, and the correspondence between the image coordinate range and the riding area. It may be specified.

As another example of this embodiment, based on the image coordinates of the target occupant in the image coordinate system corresponding to the image inside the vehicle interior, and the mapping relationship between the image coordinate system and the spatial coordinate system inside the vehicle interior, The spatial coordinates of the target occupant may be specified, and the riding area of the target occupant may be specified based on the spatial coordinates of the target occupant in the spatial coordinate system and the correspondence between the spatial coordinates and the riding area. good.

As another example of this embodiment, based on the image coordinate range of the target occupant in the image coordinate system corresponding to the image inside the vehicle interior, and the mapping relationship between the image coordinate system and the spatial coordinate system inside the vehicle interior, the spatial coordinate system identifying the spatial coordinate range of the target occupant in the spatial coordinate system, and specifying the riding area of the target occupant based on the spatial coordinate range of the target occupant in the spatial coordinate system and the correspondence between the spatial coordinate range and the riding area; You can do it like this.

In another possible embodiment, the riding area of the target occupant may include the coordinates of the target occupant within the vehicle interior or a coordinate range to which the target occupant belongs. In one example, the riding area of the target occupant may include image coordinates or an image coordinate range of the target occupant in an image coordinate system corresponding to an image inside the vehicle interior. In another example, the riding area of the target occupant may include a spatial coordinate or a spatial coordinate range of the target occupant in a spatial coordinate system within the vehicle interior.

In step S13, alerting information is generated in response to detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range.

In an embodiment of the present disclosure, the non-permitted boarding area for the predetermined target range may refer to an area in the vehicle interior where boarding of the predetermined target range is not permitted. Here, the unauthorized riding area is at least one of one or more predetermined areas obtained by dividing the interior space of the vehicle interior in advance according to the positions of fixed members such as seats and center consoles in the vehicle interior. It's okay. For example, the unauthorized riding area for the predetermined target range may include a front seating area and/or a non-safety seating area of the passenger compartment.

In one possible embodiment, the target occupant's boarding area may include the target occupant's boarding area. In this embodiment, the alerting information may be generated in response to detection that the boarding area for the target occupant corresponds to a non-permitted boarding area in the predetermined target range. In this embodiment, it is not necessary to determine whether or not the target occupant is sitting, and in response to the detection that the boarding area of the target occupant corresponds to an unauthorized boarding area of the predetermined target range. It is possible to generate alert information. In this embodiment, when it is detected that the target occupant is boarding the vehicle from an unauthorized boarding area within a predetermined target range to which the target occupant belongs, a warning is issued, thereby achieving the effect of timely alerting. obtain. As an example of this embodiment, the unauthorized boarding area of the predetermined target range may include a front door area of the vehicle. In this example, when it is detected that the target occupant gets into the vehicle through the front door, a warning may be given.

In another possible embodiment, the target occupant's riding area may include the target occupant's seating area. In this embodiment, the alert information may be generated in response to detection that the seating area of the target occupant corresponds to a non-permitted seating area within the predetermined range of targets.

In an embodiment of the present disclosure, the alerting information may be issued by a display, a speaker, etc. in the vehicle interior. For example, the alert information may include audio information such as "Children are not allowed to sit in the front seat."

In one possible embodiment, the alerting information may be generated depending on an unauthorized riding area for a predetermined target range to which the target occupant belongs. For example, if the unauthorized riding area for the predetermined target range to which the target occupant belongs is the front seat area, the warning information may include information that "sit in the front seat area is not allowed."

In another possible embodiment, the alerting information may be generated depending on a permitted boarding area of a predetermined target range to which the target occupant belongs. In this embodiment, the permitted boarding area for the predetermined target range may indicate an area within the vehicle interior in which boarding of the predetermined target range is permitted. For example, the permitted riding area for the predetermined target range may be a rear seat area or a rear seat safety seat area. For example, if the permitted boarding area of the predetermined target range to which the target occupant belongs is the rear seat area, the alert information may include information "Please sit in the rear seat area." Alternatively, if the permitted riding area of the predetermined target range to which the target occupant belongs is the rear seat safety seat area, the alert information may include information such as "Please seat the child in the rear seat safety seat area". good.

In the embodiment of the present disclosure, by generating the alert information, the target occupant is alerted to the driver or other occupants to seat the target occupant in a safe and appropriate position in the vehicle, or It is possible to alert the target occupant to move to a safe and appropriate position within the room.

In an embodiment of the present disclosure, an image of the interior of the vehicle is acquired, and a riding area of a target occupant belonging to a predetermined target range in the vehicle interior is detected based on the image, and the riding area of the target occupant is By generating alert information in response to detection of a non-permitted boarding area for a predetermined target range, it is possible to voluntarily alert passengers to the non-permitted boarding area, and prevent passengers from boarding the vehicle. Safety can be improved.

In one possible embodiment, generating the alert information in response to detecting that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range includes: When the vehicle is started and the vehicle speed is 0, generating alert information in response to detecting that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target passenger range. It may also include doing. According to this embodiment, it is possible to alert the driver or other occupants immediately after starting the vehicle, so that the driver or other occupants are instructed to seat the target occupant in a safe and appropriate position in the vehicle interior before the vehicle starts running. It is possible to alert the target occupant, or to alert the target occupant to move to a safe and appropriate position within the vehicle interior before the vehicle starts running.

In one possible embodiment, the target occupants belonging to the predetermined target audience range include child occupants, and the above-mentioned riding area of the target occupant may fall into an unauthorized riding area for the predetermined target audience range. Generating the alert information in response to the detection includes generating the alert information in response to the detection that the riding area of the child occupant is a front seat area of the vehicle interior. including. Because children are often not knowledgeable about traffic laws and riding area rules, and because there is a greater risk when children ride in the front seat area than adults, this embodiment requires that the child occupant's riding area be located near the vehicle. By generating alert information in response to the detection that the seat is in the front seat area of the passenger compartment, it is possible to alert the child occupant when the child occupant rides in the front seat area of the vehicle cabin. It is possible to effectively deal with the risk problem caused by incorrect riding areas in the riding scene, and contributes to improving riding safety for child passengers.

In this embodiment, the occupant type of the occupant in the vehicle interior may be detected based on the image, and an occupant belonging to the child category may be specified as the target occupant. In this embodiment, a plurality of occupant types, such as a child type, a young adult type, and an elderly type, are set in advance, and the occupants are classified based on the image, and it is determined whether or not there is an occupant belonging to the child type in the vehicle interior. In other words, it may be determined whether or not there is a child occupant in the vehicle interior. In this embodiment, it is not necessary to identify the age of the occupant before performing classification, and the type of occupant can be directly identified.

In one possible embodiment, the target occupants belonging to said predetermined target range are child occupants below a first predetermined age threshold, child occupants below a second predetermined age threshold, and child occupants below a third predetermined age threshold. Generating alert information in response to a detection that the riding area of the target occupant including at least one of the occupants corresponds to a non-permitted riding area for the predetermined target range. , generating alert information in response to detecting that a passenger area for a child occupant under the first predetermined age threshold is a front seat area of the vehicle interior; and the first predetermined age threshold. generating alert information in response to detecting that a riding area for a child occupant under the second predetermined age threshold, which is smaller than the second predetermined age threshold, is a front seat area or a non-safety seat area of the vehicle interior; and alert information in response to the detection that the riding area of a child occupant under the third predetermined age threshold, which is greater than the first predetermined age threshold, is the front driver's seat area of the vehicle interior. generating at least one of the following.

As an example of the embodiment, the target occupants belonging to the predetermined target range include a child passenger who is less than a first predetermined age threshold, and the riding area of the target occupant described above is relative to the predetermined target range. Generating the alert information in response to detecting that the riding area corresponds to an unauthorized riding area includes: the riding area for a child passenger under the first predetermined age threshold is a front seat area of the vehicle interior; The method includes generating alert information in response to the detection of the problem.

In this example, the first predetermined age threshold may be determined based on the age of the child who is not permitted to ride in the front seat area of the vehicle compartment. For example, the first predetermined age threshold may be determined based on the age of a child who is not permitted to ride in the front seat area of the vehicle compartment as defined by traffic regulations. For example, if children under the age of 12 are not permitted to ride in the front seat area of the passenger compartment, the first predetermined age threshold may be set to 12 years.

As another example of the embodiment, the target occupants belonging to the predetermined target range include child occupants below a second predetermined age threshold, and the riding area of the target occupant described above is within the predetermined target range. Generating alert information in response to detecting that the vehicle falls under an unauthorized boarding area for a child occupant who is less than the second predetermined age threshold, which is smaller than the first predetermined age threshold; The method includes generating alert information in response to detecting that the area is a front seat area or a non-safety seat area of the vehicle interior.

In this example, the second predetermined age threshold may be determined based on the age of the child who is required to use the safety seat when riding. For example, if it is stipulated that children under 4 years old need to use a safety seat when riding, the second predetermined age threshold may be set to 4 years old.

As another example of the embodiment, the target occupants belonging to the predetermined target range include child occupants below a first predetermined age threshold and child occupants below a second predetermined age threshold; Generating the alert information in response to the detection that the riding area of the occupant falls under the unauthorized riding area for the predetermined target range may include: generating alert information in response to detecting that the boarding area is a front seat area of the passenger compartment; generating alert information in response to the detection of the safety seat area or the non-safety seat area.

As another example of the embodiment, the target occupants belonging to the predetermined target range include child occupants below a third predetermined age threshold, and the riding area of the target occupant described above is within the predetermined target range. Generating alert information in response to detecting that the ride falls under an unauthorized riding area for a child occupant who is less than the third predetermined age threshold that is greater than the first predetermined age threshold; The method includes generating alert information in response to detecting that the area is a front driver's seat area of a vehicle interior.

In this example, the third predetermined age threshold may be determined based on the age at which driving is permitted. For example, the third predetermined age threshold may be 18 years old, 16 years old, etc.

In one example, in order to further improve the safety of the vehicle, the vehicle may It may also be possible to prohibit the startup of .

In this embodiment, in response to the detection that the riding area of the child occupant under the first predetermined age threshold is the front seat area of the vehicle interior, the alerting information is generated, and the target The driver or other occupant may be alerted to seat the occupant in the rear seat area, or the target occupant may be alerted to move to the rear seat area themselves. In response to detecting that the riding area of a child occupant under the second predetermined age threshold is a front seat area or a non-safety seat area of the vehicle interior, generating alert information It is possible to alert the driver or other occupants to seat the occupant in the rear seat area and to seat the target occupant in the child safety seat. In response to detecting that the riding area of the child occupant under the third predetermined age threshold is the front driver's seat area of the vehicle interior, generating alert information to prompt the child passenger to leave the driver's seat area. The target occupant can be alerted to the situation.

The above embodiment subdivides the non-permitted riding areas corresponding to children of different ages by dividing the non-permitted riding areas for children according to different age thresholds. By issuing a warning when a child is in an unauthorized boarding area corresponding to the child's age threshold, a more targeted warning can be realized.

In one possible embodiment, the target occupants belonging to said predetermined target audience range include occupants who have reached a fourth predetermined age threshold, and said target occupant's riding area is non-conforming to said predetermined target audience range. Generating the alert information in response to the detection that the riding area corresponds to the permitted riding area means that the riding area of the occupant who has reached the fourth predetermined age threshold is the front seat area of the vehicle interior. The method includes generating alert information in response to the detection of the warning information. In this embodiment, the occupant who has reached the fourth predetermined age threshold may refer to an elderly occupant who has reached the fourth predetermined age threshold. For example, the fourth predetermined age threshold may be 65 years old, 60 years old, 70 years old, etc. In this embodiment, the fourth predetermined age threshold is generated by generating the alert information in response to the detection that the passenger area of the occupant who has reached the fourth predetermined age threshold is the front seat area of the vehicle interior. When an elderly passenger who has reached a predetermined age threshold gets into the front seat area of the vehicle, a warning can be given, contributing to improving riding safety for the elderly.

In one possible embodiment, the target occupants belonging to the predetermined target range include occupants of an age that satisfies a predetermined age threshold restriction condition, Detecting the riding area of the target occupant belonging to the passenger range includes detecting the age of the occupant in the vehicle interior based on the image, and a matching result between the age of the occupant and the predetermined age threshold restriction condition. determining whether or not the occupant is a target occupant belonging to a predetermined target range based on the target occupant; and detecting a riding area of the occupant in response to the fact that the occupant is the target occupant. ,including.

In this embodiment, the age of at least one occupant in the vehicle interior may be detected based on the image. For example, the ages of all occupants in the vehicle may be detected based on the image. The number of the predetermined age threshold limiting conditions may be one or more. For example, different predetermined subject ranges may correspond to different predetermined age threshold restrictions. For any occupant in the vehicle interior, the age of the occupant may be matched with the predetermined age threshold restriction condition. For example, the predetermined age threshold restriction condition may include at least one of reaching a first predetermined age threshold, a second predetermined age threshold, a third predetermined age threshold, and a fourth predetermined age threshold. May include. By matching the age of the occupant with one or more predetermined age threshold limiting conditions, it is possible to obtain a matching result between the age of the occupant and the predetermined age threshold limiting condition. For example, if the age of the passenger is 6 years old and the first predetermined age threshold is 12 years old, it can be determined that the age of the passenger and the predetermined age threshold restriction condition match, and thereby , it can be determined that the occupant is a target occupant belonging to a predetermined target range.

In this embodiment, the age of the occupant in the vehicle interior is detected based on the image, and based on a matching result between the age of the occupant and the predetermined age threshold restriction condition, the occupant falls within a predetermined target range. A predetermined target range within the vehicle interior is determined based on age detection by determining whether or not the occupant is a target occupant, and detecting the riding area of the occupant according to the fact that the occupant is the target occupant. It is possible to accurately determine the target occupant belonging to the target occupant, and to specify the riding area of the target occupant.

As an example of the embodiment, detecting the age of the occupant in the vehicle interior based on the image described above may include detecting the age of the occupant in the vehicle interior based on the face area in the image, This includes obtaining the ages of the occupants in the vehicle. In this example, by detecting the age of the occupant in the vehicle interior based on the face area in the image and obtaining the age of the occupant in the vehicle interior, the user does not need to input age information in advance, and the age of the occupant in the vehicle interior is obtained. Based on this, the age of the occupant in the vehicle interior can be directly identified, and the convenience of age detection can be improved.

In one example, the image or an image corresponding to a face area in the image is input to a neural network, and the age of the occupant in the vehicle interior is detected through the neural network to obtain the age of the occupant in the vehicle interior. It's okay. In this example, the speed and accuracy of age detection can be improved by detecting the age of the occupant in the vehicle interior based on the image using a neural network.

As another example of the embodiment, detecting the age of the occupant in the vehicle interior based on the image described above may include acquiring facial information of the occupant in the vehicle interior based on the image. , in response to the fact that the actual age information corresponding to the facial information of the passenger is obtained through matching from the passenger information data acquired in advance, the age information corresponding to the facial information of the passenger is obtained. and determining the age of the occupant.

In this example, the pre-obtained occupant information data may include facial information of the occupant and corresponding actual age information. In this example, occupant information data is obtained in advance from a memory provided in the vehicle interior, a user terminal (for example, a terminal such as a vehicle owner's mobile phone), a server connected to the vehicle to which the vehicle compartment belongs, etc. You may also obtain it.

In this example, the passenger's facial information may include at least one of the passenger's identification information, facial features, and facial images.

In one example, the facial information of the occupant includes identification information of the occupant, and the facial information of the occupant in the vehicle interior is acquired based on the image as described above, and matching is performed from the occupant information data acquired in advance. Accordingly, in response to obtaining the actual age information corresponding to the facial information of the occupant, specifying the age of the occupant based on the actual age information corresponding to the facial information of the occupant, Face identification is performed based on the image to obtain the identification information of the occupant in the vehicle interior, and actual age information corresponding to the identification information of the occupant is obtained by matching from the occupant information data obtained in advance. and determining the age of the occupant based on actual age information corresponding to identity information of the occupant.

In another example, the facial information of the passenger includes facial features of the passenger, and the facial information of the passenger in the vehicle interior is acquired based on the image, and the facial information of the passenger in the vehicle interior is obtained from previously acquired passenger information data. , in response to obtaining actual age information corresponding to the facial information of the occupant through matching, specifying the age of the occupant based on the actual age information corresponding to the facial information of the occupant; extracts facial features based on the image, obtains the facial features of the occupant in the vehicle interior, and performs matching from pre-obtained occupant information data to obtain actual age information corresponding to the facial features of the occupant. and determining the age of the occupant based on actual age information corresponding to facial features of the occupant.

In another example, the facial information of the passenger includes a facial image of the passenger, and the facial information of the passenger in the vehicle interior is acquired based on the image, and the facial information of the passenger in the vehicle interior is obtained from previously acquired passenger information data. , in response to obtaining actual age information corresponding to the facial information of the occupant through matching, specifying the age of the occupant based on the actual age information corresponding to the facial information of the occupant; is that the actual age information corresponding to the facial image of the passenger is obtained by cutting out the facial image of the passenger in the vehicle interior based on the image and matching from the passenger information data obtained in advance. Accordingly, the method may include identifying the age of the occupant based on actual age information corresponding to the facial image of the occupant.

In this example, facial information of the occupant in the vehicle interior is acquired based on the image, and actual age information corresponding to the facial information of the occupant is obtained through matching from previously acquired occupant information data. In accordance with the present invention, the age of the occupant is accurately specified using pre-obtained occupant information data by specifying the age of the occupant based on actual age information corresponding to face information of the occupant. This contributes to quickly identifying the unauthorized boarding area corresponding to the age group to which the occupant belongs, and further contributing to determining whether or not the passenger's boarding area is in the corresponding non-boarding area.

In one example, in response to the fact that the actual age information corresponding to the facial information of the passenger could not be identified through matching from the passenger information data acquired in advance, the age of the passenger is detected based on the facial area in the image. , the age of the occupant may be obtained.

In another possible embodiment, the target occupants belonging to the predetermined target range include occupants of an occupant type that matches the set occupant type, and the target occupants in the vehicle interior are determined based on the image. Detecting the riding area of the target occupant belonging to the passenger range includes detecting the occupant type of the occupant in the vehicle interior based on the image, and based on the matching result between the occupant type of the occupant and the set occupant type. determining whether the occupant is a target occupant belonging to a predetermined target range based on the target occupant; and detecting a riding area of the occupant in response to the fact that the occupant is the target occupant; May include. In this embodiment, the passenger type is a child type, a young adult type, or an elderly type, and the set passenger type includes a child type and/or an elderly type, and when the passenger type of the passenger is a child type or an elderly type, The riding area of the passenger may be detected. Alternatively, the occupants in each riding area in the vehicle interior may be detected first, and then the occupants in each riding area may be classified. According to this embodiment, the type of occupant can be directly associated with a predetermined target range, and the efficiency of detecting an occupant can be improved.

In one possible embodiment, the method comprises obtaining geolocation information of a vehicle and determining a predetermined age threshold corresponding to the predetermined audience range based on riding area restriction information corresponding to the geolocation information. The riding area restriction information includes a restriction correspondence between a predetermined age threshold corresponding to a predetermined target range and a non-permitted riding area. Here, the geolocation information of the vehicle may be obtained by GPS (Global Positioning System), or may be manually set by a user such as a driver.

For example, in City A, the unauthorized riding area for child occupants under 12 years of age is the front seat area of the vehicle interior, and the unauthorized riding area for child occupants under 4 years old is the front seat area of the vehicle interior or non-safety seats. area. In City B, the unauthorized riding area for child passengers under the age of 14 is the front seat area of the vehicle interior, and the unauthorized riding area for child passengers under the age of 5 years is the front seat area or non-safety seat area of the vehicle interior. be. If the vehicle is determined to be in city A based on the vehicle's geolocation information, the first predetermined age threshold may be adjusted to 12 years of age and the second predetermined age threshold may be adjusted to 4 years of age. If it is determined that the vehicle is in city B based on the vehicle's geolocation information, the first predetermined age threshold may be adjusted to 14 years of age and the second predetermined age threshold may be adjusted to 5 years of age.

According to this embodiment, by adjusting the predetermined age threshold according to the traffic regulations of the area where the vehicle is located, it is possible to make the adjusted predetermined age threshold match the local traffic regulations. This makes it possible to appropriately adjust the age threshold for each different region.

In one possible embodiment, after generating the alerting information, obtaining user feedback information including actual age information of the target occupant, and based on the user feedback information, facial information of the target occupant and the and storing a correspondence with actual age information of the target occupant.

In one example of such an embodiment, the actual age information may include precise age information. For example, the actual age information may include date of birth. Also, for example, the actual age information may include a precise number of years, such as 4 years and 2 months. As another example of the embodiment, the actual age information may include approximate age information, such as, for example, more than 4 years old, less than 4 years old, more than 12 years old, etc. In one example of such an embodiment, user feedback information may be obtained through in-vehicle infotainment. As another example of such an embodiment, user feedback information may be obtained from a user terminal. In this embodiment, the facial information of the target occupant may include at least one of a facial image, facial features, and identification information of the target occupant.

In this embodiment, by obtaining user feedback information and storing a correspondence between facial information of the target occupant and actual age information of the target occupant based on the user feedback information, When the target occupant is detected, based on the actual age information of the target occupant, further, the riding area of the target occupant corresponds to an unauthorized riding area for a predetermined target range to which the target occupant belongs. As a result, more accurate matching results can be obtained.

In one possible embodiment, the method comprises determining a predetermined age threshold corresponding to a predetermined audience range to which the target occupant belongs, depending on the discrepancy between the actual age information and the detected age information of the target occupant. Further including adjusting.

In this embodiment, the detected age information of the target occupant may refer to age information obtained by performing age detection on the target occupant based on the image.

For example, if the actual age of the target occupant is identified as 4 years old based on the actual age information of the target occupant, and the detected age information of the target occupant is 5 years old, then the target occupant belongs to A predetermined age threshold (for example, a second predetermined age threshold) corresponding to a predetermined target range may be adjusted to 5 years.

As an example of the embodiment, a predetermined age threshold corresponding to a predetermined range of subjects to which the target occupant belongs is automatically adjusted depending on a mismatch between the actual age information of the target occupant and the detected age information. You can do it like this. As another example of the embodiment, a predetermined age threshold corresponding to a predetermined target range to which the target occupant belongs is adjusted depending on a discrepancy between the target occupant's actual age information and the detected age information. A predetermined age threshold corresponding to a predetermined target range to which the target occupant belongs may be adjusted in response to receiving the user confirmation command. good.

In this embodiment, the age is determined by adjusting a predetermined age threshold corresponding to a predetermined range of subjects to which the target occupant belongs, depending on the discrepancy between the actual age information of the target occupant and the detected age information. Even if there is an error in the detection result, it is possible to timely detect and alert based on the unauthorized riding area corresponding to the actual age, contributing to further improving riding safety for the target occupant.

In one possible embodiment, the method further comprises: obtaining an age threshold adjustment request; and adjusting a predetermined age threshold corresponding to the predetermined audience range based on the age threshold adjustment request. include. In this embodiment, the user can adjust the age threshold according to actual demand by obtaining an age threshold adjustment request and adjusting a predetermined age threshold corresponding to the predetermined target range based on the age threshold adjustment request. The predetermined age threshold value corresponding to the predetermined target range can be flexibly adjusted, which contributes to further improving riding safety for target occupants belonging to the predetermined target range.

As an example of the embodiment, an age threshold adjustment request may be obtained by an in-vehicle infotainment, and a predetermined age threshold corresponding to the predetermined target range may be adjusted based on the age threshold adjustment request. good. According to this example, the user can flexibly adjust the predetermined age threshold corresponding to the predetermined target range using the in-vehicle infotainment.

As another example of the embodiment, an age threshold adjustment request may be obtained from a user terminal, and a predetermined age threshold corresponding to the predetermined target range may be adjusted based on the age threshold adjustment request. good. For example, the user terminal may be a vehicle owner's mobile phone, tablet, etc. According to this example, the user can flexibly adjust the predetermined age threshold corresponding to the predetermined target range using the user terminal.

As an example of the embodiment, adjusting the predetermined age threshold corresponding to the predetermined target range based on the age threshold adjustment request described above may include adjustment confirmation based on the age threshold adjustment request. adjusting a predetermined age threshold corresponding to the predetermined audience range based on the age threshold adjustment request in response to generating a request and receiving a confirmation instruction corresponding to the adjustment confirmation request; It may also include. In this example, the adjustment confirmation request may be to inform the user of the risks of adjusting a predetermined age threshold corresponding to a predetermined target range.

It is understood that the embodiments of each of the above methods mentioned in this disclosure can be combined with each other to form embodiments as long as they do not violate principles or logic; The explanation will be omitted. Also, those skilled in the art will understand that in the above method according to a specific embodiment, the order of execution of each step should be specifically determined by its function and possible internal logic.

FIG. 2 shows a schematic diagram of one application scene of the embodiment of the present disclosure. As shown in FIG. 2, information may be collected by an OMS camera, and the information collected by the OMS camera may include images of the interior of the vehicle. The processor may acquire an image of the interior of the vehicle from the OMS camera. The processor may detect whether or not there is a child occupant under the age of 12 in the vehicle interior based on the image of the vehicle interior. If there are no child occupants under the age of 12 in the vehicle interior, there is no need to issue a warning. If there is a child occupant under the age of 12 in the vehicle interior, it may be detected whether or not there is a child occupant under the age of 4 in the vehicle interior. If there is no child occupant under the age of 4 in the vehicle interior, that is, if the child occupant in the vehicle interior is 4 years of age or older but less than 12 years of age, the determination is made as to whether the child occupant under 12 years of age is in the front passenger seat position. You may decide whether If No, no warning will be given. If Yes, give a warning. If there is a child occupant under the age of 4 in the vehicle interior, it is determined whether the child occupant under the age of 4 is in the rear safety seat. If Yes, no warning will be given. If no, give a warning. In FIG. 2, a warning may refer to generating attention-calling information.

FIG. 3 shows a schematic diagram of another application scene of the embodiment of the present disclosure. As shown in FIG. 3, information may be collected by an OMS camera and/or a DMS camera, and the information collected by the OMS camera and/or the DMS camera may include images inside the vehicle interior. The processor may acquire an image of the interior of the vehicle from the OMS camera and/or the DMS camera. The processor may detect whether a minor under the age of 18 is present in the driver's seat based on the image inside the vehicle interior. If Yes, give a warning. If No, no warning will be given. In FIG. 3, a warning may refer to generating attention-calling information.

Furthermore, the present disclosure provides a vehicle interior occupant detection device, an electronic device, a computer-readable storage medium, and a program. Any of these can be used to realize any one of the vehicle interior occupant detection methods according to the present disclosure, and for the corresponding technical means and effects, please refer to the corresponding description in the method section, and for details. Further explanations will be omitted.

FIG. 4 shows a block diagram of a vehicle interior occupant detection device according to an embodiment of the present disclosure. As shown in FIG. 4, the vehicle interior occupant detection device includes a first acquisition module 41 for acquiring an image of the interior of the vehicle, and a first acquisition module 41 for acquiring an image of the interior of the vehicle; a detection module 42 for detecting an occupant's riding area; and generating alert information in response to detecting that the target occupant's riding area corresponds to an unauthorized riding area for the predetermined target range. and a generation module 43 for generating.

In one possible embodiment, the target occupants belonging to the predetermined target range include child occupants, and the generation module 43 is configured to detect that the child occupant's riding area is a front seat area of a vehicle interior. It is used to generate alert information according to the situation.

In one possible embodiment, the target occupants belonging to said predetermined target range are child occupants below a first predetermined age threshold, child occupants below a second predetermined age threshold, and child occupants below a third predetermined age threshold. The generation module 43 generates a warning in response to detecting that the riding area of the child occupant under the first predetermined age threshold is the front seat area of the vehicle interior. generating information, wherein it is detected that a riding area for a child occupant who is less than the first predetermined age threshold and less than the second predetermined age threshold is a front seat area or a non-safety seat area of the vehicle interior; generating alert information in accordance with the above, and the riding area for a child passenger whose age is less than the third predetermined age threshold, which is greater than the first predetermined age threshold, is a front driver's seat area of the vehicle interior; The information is used to perform at least one of the following: generating alert information in response to the detection of such a problem.

In one possible embodiment, the target occupants belonging to the predetermined target range include occupants who have reached a fourth predetermined age threshold, and the generation module 43 is configured to determine the number of occupants who have reached the fourth predetermined age threshold. It is used to generate alert information in response to the detection that the passenger area is the front seat area of the vehicle interior.

In one possible embodiment, the target occupants belonging to the predetermined target range include occupants whose age meets a predetermined age threshold restriction condition, and the detection module 42 is configured to detect occupants in the vehicle interior based on the image. and determining whether or not the occupant is a target occupant belonging to a predetermined target range based on a matching result between the age of the occupant and the predetermined age threshold restriction condition. , and detecting the riding area of the occupant depending on the fact that the occupant is the target occupant.

In one possible embodiment, the detection module 42 is used to detect the age of the occupant in the vehicle interior based on the face area in the image to obtain the age of the occupant in the vehicle interior.

In one possible embodiment, the detection module 42 acquires facial information of the occupant in the vehicle interior based on the image, and determines the facial information of the occupant by matching from previously acquired occupant information data. In response to obtaining the corresponding actual age information, the age of the occupant is specified based on the actual age information corresponding to the facial information of the occupant.

In one possible embodiment, the device comprises a second acquisition module for acquiring geolocation information of a vehicle and corresponding to the predetermined audience range based on riding area restriction information corresponding to the geolocation information. a first adjustment module for adjusting a predetermined age threshold for adjusting a predetermined age threshold, wherein the riding area restriction information is configured to adjust a predetermined age threshold corresponding to a predetermined target audience range and a non-permitted riding area; Contains correspondence.

In one possible embodiment, the device comprises a third acquisition module for acquiring user feedback information including actual age information of the target occupant; and facial information of the target occupant based on the user feedback information. and a storage module for storing a correspondence between the target occupant's actual age information and the target occupant's actual age information.

In one possible embodiment, the device determines a predetermined age threshold corresponding to a predetermined audience range to which the target occupant belongs, depending on the discrepancy between the actual age information and the detected age information of the target occupant. It further includes a second adjustment module for adjustment.

In one possible embodiment, the apparatus comprises a fourth acquisition module for obtaining an age threshold adjustment request and adjusting a predetermined age threshold corresponding to the predetermined subject range based on the age threshold adjustment request. and a third adjustment module for adjusting.

In an embodiment of the present disclosure, an image of the interior of the vehicle is acquired, and a riding area of a target occupant belonging to a predetermined target range in the vehicle interior is detected based on the image, and the riding area of the target occupant is Riding safety for passengers can be improved by generating alert information in response to detection of a non-permitted riding area for a predetermined target range.

In some embodiments, the functions or modules possessed by the apparatus according to the embodiments of the present disclosure can be used to perform the methods described in the method embodiments described above, and the specific implementation and techniques thereof Regarding the practical effects, reference may be made to the description of the above-mentioned method embodiments, and for the sake of brevity, a detailed description will be omitted here.

Embodiments of the present disclosure further include a computer-readable storage medium having computer program instructions stored thereon, the computer-readable storage medium having computer program instructions stored thereon, the computer-readable storage medium causing the computer program instructions, when executed by a processor, to effectuate the method described above. I will provide a. The computer-readable storage medium may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium.

Embodiments of the present disclosure further provide a computer program comprising computer readable code, the computer readable code, when operated on an electronic device, causing a processor of the electronic device to execute instructions for implementing the method. Provide a computer program to be executed.

Embodiments of the present disclosure further include a computer program product for storing computer-readable instructions, the instructions, when executed, causing a computer to perform a method for detecting a vehicle interior occupant according to any one of the embodiments above. Providing another computer program product that causes operations to be performed.

Embodiments of the present disclosure further include one or more processors and a memory for storing executable instructions, the one or more processors storing executable instructions stored in the memory. An electronic device is provided that is configured to invoke and perform the above method.

The electronic device may be provided as a terminal, server, or other type of device. The electronic device may be an in-vehicle infotainment or a domain controller in a vehicle interior, a device host, etc. for performing data processing operations such as images in an OMS or DMS.

FIG. 5 shows a block diagram of an electronic device 800 according to an embodiment of the present disclosure. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

Referring to FIG. 5, electronic device 800 includes processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816. may include one or more of the following.

Processing component 802 typically controls the overall operation of electronic device 800, such as operations related to display, telephone calls, data communications, camera operations, and recording operations. Processing component 802 may include one or more processors 820 that execute instructions to perform all or some steps of the methods described above. Processing component 802 may also include one or more modules for interaction with other components. For example, processing component 802 may include a multimedia module for interaction with multimedia component 808.

Memory 804 is configured to store various types of data to support operations on electronic device 800. These data include, by way of example, instructions for any application programs or methods operating on electronic device 800, contact data, phone book data, messages, pictures, videos, etc. Memory 804 can be, for example, static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), etc. ), magnetic memory, flash memory, magnetic disks or optical disks, or combinations thereof.

Power supply component 806 supplies power to each component of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with power generation, management, and distribution for electronic device 800.

Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some examples, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, it may be implemented as a touch screen that receives input signals from a user. The touch panel includes one or more touch sensors to detect touches, slides, and gestures on the touch panel. The touch sensor may detect not only the boundaries of a touch or slide operation, but also the duration and pressure associated with the touch or slide operation. In some examples, multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or an imaging mode, the front camera and/or the rear camera may receive external multimedia data. Each front and rear camera may have a fixed optical lens system or a focal length and optical zoom capability.

Audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes one microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a calling mode, a recording mode, or a voice recognition mode. It is composed of The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some examples, audio component 810 further includes a speaker for outputting audio signals.

I/O interface 812 provides an interface between processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.

The sensor component 814 includes one or more sensors for evaluating the status of various aspects of the electronic device 800. For example, the sensor component 814 can detect the on/off state of the electronic device 800, the relative positioning of components such as a display and a keypad of the electronic device 800; Changes in the position of a certain component of the device 800, presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and changes in the temperature of the electronic device 800 can be detected. Sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor component 814 may further include an optical sensor for use in imaging applications, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor. In some examples, the sensor component 814 may further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 816 is configured to provide wired or wireless communication between electronic device 800 and other devices. For example, the electronic device 800 is configured to support long-term wireless networks (WiFi), second generation mobile communication technology (2G), third generation mobile communication technology (3G), fourth generation mobile communication technology (4G)/general mobile communication technology. wireless networks based on communication standards, such as advanced mobile communication technology (LTE), fifth generation mobile communication technology (5G), or a combination thereof; In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a near field communication (NFC) module to facilitate near field communication. For example, the NFC module can be implemented by Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth® (BT) technology, and other technologies.

In an exemplary embodiment, electronic device 800 includes one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processors (DSPDs), programmable logic devices (PLDs), field programmable gate arrays, etc. (FPGA), controller, microcontroller, microprocessor or other electronic components and can be used to carry out the above method.

The exemplary embodiment further provides a non-volatile computer readable storage medium, such as a memory 804 containing computer program instructions, which, when executed by a processor 820 of the electronic device 800, perform the method described above. can be executed.

FIG. 6 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, electronic device 1900 may be provided as a server. Referring to FIG. 6, electronic device 1900 includes a processing component 1922 that includes one or more processors, and memory resources, typically memory 1932, for storing instructions executable by processing component 1922, such as an application program. including. The application program stored in memory 1932 may include one or more modules, each module corresponding to one set of instructions. Processing component 1922 is also configured to perform the methods described above by executing the instructions.

Electronic device 1900 further includes a power supply component 1926 configured to perform power management for electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and input/output (I/O). O) may include an interface 1958. The electronic device 1900 has an operating system stored in the memory 1932, such as a Microsoft server operating system (Windows Server (registered trademark)), an operating system using an Apple graphical user interface (Mac OS X (registered trademark)), or a multi-user operating system. and multi-process computer operating systems (Unix®), free and open source Unix-like operating systems (Linux®), open source Unix-like operating systems (FreeBSD®) or similar Be able to act based on what you do.

The exemplary embodiment further provides a non-volatile computer readable storage medium, such as a memory 1932 containing computer program instructions that, when executed by the processing component 1922 of the electronic device 1900, are provided. The above method can be executed.

The present disclosure may be a system, method and/or computer program product. A computer program product may include a computer readable storage medium having computer readable program instructions for causing a processor to implement aspects of the present disclosure.

A computer-readable storage medium may be any tangible device capable of storing and storing instructions for use in an instruction execution device. The computer readable storage medium may be, for example, but not limited to, electrical storage, magnetic storage, optical storage, electromagnetic storage, semiconductor storage, or any suitable combination of the above. Further specific examples (non-exhaustive list) of computer readable storage media include portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM). or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, perforated card on which instructions are stored, e.g. or mechanical encoding devices such as protrusion structures in slots, and any suitable combinations of the above. A computer-readable storage medium as used herein refers to the instantaneous signal itself, e.g. radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagated through waveguides or other transmission media (e.g. fiber optic cables). (pulsed light passing through) or electrical signals transmitted over electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to each computing/processing device or connected to a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. It may also be downloaded to an external computer or external storage device via the computer. A network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface within each computing/processing device receives computer readable program instructions from the network, transfers the computer readable program instructions to computer readable storage within each computing/processing device. Store it on a medium.

Computer program instructions for performing operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine language instructions, machine-dependent instructions, microcode, firmware instructions, state configuration data, or objects such as Smalltalk, C++, etc. The source code or target code may be written in any combination of one or more programming languages, including oriented programming languages and general procedural programming languages such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, or as a standalone software package, or partially executed on the user's computer. and may be executed partially on a remote computer or entirely on a remote computer or server. When involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or wide area network (WAN), or may be connected to the user's computer (e.g., via an Internet service provider). may be connected to an external computer (via the Internet). In some embodiments, state information in computer-readable program instructions is utilized to personalize an electronic circuit, such as a programmable logic circuit, field programmable gate array (FPGA), or programmable logic array (PLA), to Aspects of the present disclosure may be implemented by circuitry executing computer-readable program instructions.

Aspects of the present disclosure have been described herein with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure; each block of the flowcharts and/or block diagrams, It should be understood that any combination of blocks in the flowcharts and/or block diagrams can be implemented by computer-readable program instructions.

These computer readable program instructions are provided to a processor of a general purpose computer, special purpose computer or other programmable data processing device, and when executed by the processor of the computer or other programmable data processing device, the instructions are provided in a flowchart and a Apparatus may be constructed to perform the functions/acts specified in one or more blocks of a block diagram. These computer readable program instructions may be stored on a computer readable storage medium to cause a computer, programmable data processing device and/or other equipment to operate in a particular manner. Thus, a computer-readable storage medium having instructions stored thereon includes an article of manufacture having instructions for implementing aspects of the functionality/acts specified in one or more blocks of a flowchart and/or block diagram.

Computer-readable program instructions are loaded into a computer, other programmable data processing device, or other equipment and are executed by the computer by causing the computer, other programmable data processing device, or other equipment to perform a sequence of operational steps. An executable process may also be generated. In this manner, instructions executed on a computer, other programmable data processing device, or other equipment implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

The flowchart and block diagrams in the drawings illustrate possible system architecture, functionality, and operation of systems, methods, and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or portion of instructions, and each block in the flowchart or block diagram may represent a module, program segment, or portion of instructions for implementing a specified logical function. Contains one or more executable instructions. In some alternative implementations, the functions depicted in the blocks may be implemented out of the order shown in the figures. For example, two consecutive blocks may execute substantially in parallel or, depending on the functionality, may execute in reverse order. It should be noted that each block in the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, may be implemented by a dedicated system based on hardware that performs a specified function or operation, or may be implemented by a dedicated system based on hardware that performs a specified function or operation. It should also be noted that the implementation may be implemented through a combination of hardware and computer instructions.

The computer program product can be specifically implemented by hardware, software, or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium. In another alternative embodiment, the computer program product is embodied as a software product, such as a Software Development Kit (SDK).

Although the embodiments of the present disclosure have been described above, the above description is merely illustrative, not exhaustive, and is not limited to the disclosed embodiments. Various modifications and changes will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology chosen herein may suitably interpret the principles, practical applications, or improvements over existing technology of each embodiment, or allow others skilled in the art to understand each embodiment presented herein. It is for.

Claims (15)

Obtaining images of the interior of the vehicle,
Detecting a riding area of a target occupant belonging to a predetermined target range in the vehicle interior based on the image;
Generating alert information in response to detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range. Detection method. Target occupants belonging to the predetermined target range include child occupants,
Generating the alert information in response to the detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range includes:
2. Vehicle interior occupant detection according to claim 1, further comprising: generating caution information in response to detecting that the child passenger's riding area is a front seat area of the vehicle interior. Method. The target occupants belonging to the predetermined target range include at least one of a child occupant below a first predetermined age threshold, a child occupant below a second predetermined age threshold, and a child occupant below a third predetermined age threshold. ,
Generating the alert information in response to the detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range includes:
generating alert information in response to detecting that a riding area for a child occupant under the first predetermined age threshold is a front seat area of a vehicle interior;
In response to it being detected that the riding area for a child occupant under the second predetermined age threshold, which is smaller than the first predetermined age threshold, is a front seat area or a non-safety seat area of the vehicle interior, generating arousal information; and
Generating alert information in response to detecting that a passenger area for a child occupant who is less than the third predetermined age threshold, which is greater than the first predetermined age threshold, is a front driver's seat area of the vehicle interior. The method for detecting an occupant in a vehicle interior according to claim 1 or 2, characterized in that the method includes at least one of the following. The target occupants belonging to the predetermined target range include occupants who have reached a fourth predetermined age threshold,
Generating the alert information in response to the detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range includes:
10. The method of claim 1, further comprising: generating caution information in response to detecting that the riding area of the occupant who has reached the fourth predetermined age threshold is a front seat area of the vehicle interior. The method for detecting an occupant inside a vehicle according to any one of items 1 to 3. The target occupants belonging to the predetermined target range include occupants whose age satisfies a predetermined age threshold restriction condition,
Detecting the riding area of a target occupant belonging to a predetermined target range within the vehicle interior based on the image described above includes:
Detecting the age of an occupant in the vehicle interior based on the image;
determining whether or not the occupant is a target occupant belonging to a predetermined target range based on a matching result between the age of the occupant and the predetermined age threshold restriction condition;
The method for detecting an occupant in a vehicle interior according to any one of claims 1 to 4, further comprising detecting a riding area of the occupant depending on whether the occupant is the target occupant. Detecting the age of the occupant in the vehicle interior based on the image described above includes:
6. The method for detecting an occupant in a vehicle interior according to claim 5, further comprising detecting the age of the occupant in the vehicle interior based on a face area in the image to obtain the age of the occupant in the vehicle interior. Detecting the age of the occupant in the vehicle interior based on the image described above includes:
acquiring face information of the occupant in the vehicle interior based on the image;
In response to the fact that the actual age information corresponding to the facial information of the passenger is obtained through matching from the passenger information data acquired in advance, the age information of the passenger is determined based on the actual age information corresponding to the facial information of the passenger. 6. The method for detecting an occupant in a vehicle interior according to claim 5, further comprising: specifying the age of the occupant. Obtaining geolocation information of the vehicle;
further comprising: adjusting a predetermined age threshold corresponding to the predetermined target range based on ride area restriction information corresponding to the geolocation information;
8. The riding area restriction information includes a restriction correspondence relationship between a predetermined age threshold corresponding to a predetermined target range and a non-permitted riding area. The vehicle interior occupant detection method described. After generating the alert information,
obtaining user feedback information including actual age information of the subject occupant;
9. The method according to claim 1, further comprising: storing a correspondence relationship between face information of the target occupant and actual age information of the target occupant based on the user feedback information. The method for detecting an occupant inside a vehicle according to item (1). The method further includes adjusting a predetermined age threshold corresponding to a predetermined range of subjects to which the target occupant belongs, depending on a discrepancy between the actual age information and the detected age information of the target occupant. The method for detecting an occupant in a vehicle interior according to any one of claims 1 to 9. obtaining an age threshold adjustment request;
The vehicle according to any one of claims 1 to 10, further comprising: adjusting a predetermined age threshold corresponding to the predetermined target range based on the age threshold adjustment request. Indoor occupant detection method. a first acquisition module for acquiring images inside the vehicle;
a detection module for detecting a riding area of a target occupant belonging to a predetermined target range in the vehicle interior based on the image;
The vehicle is characterized in that it includes a generation module for generating attention-calling information in response to detection that the riding area of the target occupant corresponds to a non-permitted riding area for the predetermined target range. Indoor occupant detection device. one or more processors;
a memory for storing executable instructions;
The one or more processors include:
An electronic device configured to call an executable instruction stored in the memory to execute the method for detecting an occupant in a vehicle interior according to any one of claims 1 to 11. A computer-readable storage medium storing computer program instructions, the computer program instructions, when executed by a processor, implementing a method for detecting a vehicle interior occupant according to any one of claims 1 to 11. A computer-readable storage medium characterized by: A computer program comprising a computer readable code, wherein when the computer readable code is operated on an electronic device, a processor of the electronic device executes the method according to any one of claims 1 to 11. A computer program characterized by executing instructions for realizing.