CN111986453A - Reminder system, vehicle comprising same, and corresponding method and medium - Google Patents
Reminder system, vehicle comprising same, and corresponding method and medium Download PDFInfo
- Publication number
- CN111986453A CN111986453A CN201910425894.1A CN201910425894A CN111986453A CN 111986453 A CN111986453 A CN 111986453A CN 201910425894 A CN201910425894 A CN 201910425894A CN 111986453 A CN111986453 A CN 111986453A
- Authority
- CN
- China
- Prior art keywords
- occupant
- vehicle
- item
- image
- occupants
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
Abstract
The present invention provides a system for reminding a passenger to carry an article belonging to the passenger in a vehicle, which comprises the following components: an information acquisition unit that acquires at least occupant images of one or more occupants and item images of one or more items within a vehicle; a matching unit that determines a matching relationship between the occupant and the article based on at least the occupant image and the article image; the judging unit is used for judging whether one or more passengers do not carry the belonged articles when the passengers are detected to have the intention of getting off the vehicle; and the reminding unit is used for outputting a reminding signal when the judging unit judges that the one or more passengers have the intention of getting off but do not carry the belonged articles. Related methods, vehicles, and computer readable media are also disclosed. The invention can specifically remind or not remind, eliminates or reduces false reminding in the prior art, and improves the driving comfort and the passenger experience.
Description
Technical Field
The present invention relates to the field of vehicle technology, and more particularly, to a system for reminding a passenger of carrying his belongings in a vehicle, a vehicle including the same, and a corresponding method and computer-readable storage medium.
Background
People's trip is more and more depending on the vehicle, when people leave the vehicle, the condition of forgetting own article often appears to arouse many unnecessary troubles and losses.
For example, when a passenger gets off a taxi, a bus or a private car, the passenger forgets to take his personal belongings away, so that personal property is lost; the car owner forgets the mobile phone, the handbag and the like in the car, so that the mobile phone is not around when needing to be used. In addition, leaving valuables in the vehicle for a long time can also cause safety hazards of the vehicle, for example, lawless persons can destroy the vehicle to obtain property in the vehicle, resulting in damage to the vehicle and loss of property. In order to solve the problems, the prior art provides a system and a method for detecting whether a driver or a passenger leaves articles in a vehicle and reminding the driver or the passenger in time when the driver or the passenger gets off the vehicle.
However, in many cases, occupants (including the driver and passengers) in the same vehicle may have different destinations, or some of the occupants may need to alight before reaching a common destination without going to the common destination. In such a case, existing solutions for alerting the driver or passenger give a false alert that the passenger has not left his or her item in the vehicle when he or she gets off the vehicle, but also gives an alert that his or her item has left the vehicle due to the items of other passengers in the vehicle. Such a situation can be annoying and inconvenient for both the occupants of the alighting car and other occupants of the vehicle.
Therefore, there is a need for a system and method for detecting whether or not there is a left-behind item belonging to one or more occupants (driver or passenger) in a vehicle when the occupants get off the vehicle, and reminding the occupants.
Disclosure of Invention
In order to solve the technical problems, the invention provides a solution for reminding passengers to carry belonged articles in a vehicle, which can specifically judge whether articles belonging to a specific passenger exist in the vehicle or not when the specific passenger(s) in the vehicle get off the vehicle so as to provide very targeted reminding, reduce the annoyance and inconvenience to the passengers getting off and other passengers on the vehicle when reminding is sent, and improve the user experience.
Specifically, according to a first aspect of the present invention, there is provided a system for reminding an occupant of carrying an item to which the occupant belongs in a vehicle, the system comprising:
an information acquisition unit configured to acquire at least occupant images of one or more occupants and item images of one or more items within the vehicle;
a matching unit configured to determine a matching relationship between the occupant and the item based on at least the occupant image and the item image;
The judging unit is configured to judge whether the one or more passengers have the purpose of getting off the vehicle, and when the one or more passengers are judged to have the purpose of getting off the vehicle, further judge whether the one or more passengers do not carry the belonged items; and
and the reminding unit is configured to output a reminding signal when the judging unit judges that the one or more passengers have the intention of getting off the vehicle but do not carry the belonged articles.
In one embodiment, the matching unit is configured to determine, based on at least the occupant image and the item image, a matching relationship between the occupant and the item by at least one of: (i) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a distance between a body part of the occupant and the item object is smaller than a predetermined value; and (ii) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a body part of the occupant has a minimum distance from the item object.
In one embodiment, the determination unit is further configured to determine whether there is an intention to get off the vehicle for one or more occupants based on the occupant image of the one or more occupants acquired by the information acquisition unit.
In one embodiment, the system further includes a voice collecting unit configured to collect at least voice information of one or more occupants within the vehicle, and the determining unit is further configured to determine whether the one or more occupants have an intention to get off the vehicle based on the collected voice information.
In one embodiment, the system further includes a vehicle state detection unit configured to detect a vehicle state, and the determination unit is further configured to determine whether the one or more occupants have an intention to get off the vehicle based on the detected vehicle state.
In one embodiment, the determination unit determines whether the one or more occupants do not carry the article to which they belong based on the occupant image and the article image acquired by the information acquisition unit to determine whether a distance between the one or more occupants and the article having a matching relationship therewith is greater than a separation threshold distance.
In one embodiment, the matching unit is further configured to ignore the determined matching relationship between the occupant and the item according to a user input.
In one embodiment, the alert signal comprises at least one of a visual alert signal, an audible alert signal, and a tactile alert signal.
According to a second aspect of the invention, there is provided a vehicle comprising a system according to the first aspect of the invention.
According to a third aspect of the present invention, there is provided a method for use in a vehicle for alerting an occupant to carry an item to which the occupant belongs, the method comprising:
capturing at least occupant images of one or more occupants within the vehicle and item images of one or more items;
determining a matching relationship between the occupant and the item based on at least the occupant image and the item image;
judging whether the one or more passengers have the purpose of getting off the vehicle, and further judging whether the one or more passengers do not carry the belongings when judging that the one or more passengers have the purpose of getting off the vehicle; and
and when judging that the one or more passengers have the intention of getting off the vehicle but do not carry the belonged articles, outputting a reminding signal.
In one embodiment, determining the matching relationship between the occupant and the item based on at least the occupant image and the item image is performed by at least one of: (i) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a distance between a body part of the occupant and the item object is smaller than a predetermined value; and (ii) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a body part of the occupant has a minimum distance from the item object.
In one embodiment, determining whether the one or more occupants have an intent to disembark is based on at least one of:
an occupant image of the one or more occupants acquired;
voice information of one or more occupants within the vehicle; and
the detected vehicle status information.
In one embodiment, it is determined whether the one or more occupants do not carry an item to which they belong based on the acquired occupant images and item images to determine whether a distance between the one or more occupants and the item having a matching relationship therewith is greater than a separation threshold distance.
In one embodiment, the method further comprises ignoring the determined matching relationship between the occupant and the item based on user input.
In one embodiment, the alert signal comprises at least one of a visual alert signal, an audible alert signal, and a tactile alert signal.
According to a fourth aspect of the present invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method according to the third aspect of the present invention.
By utilizing the scheme of the invention, when a specific passenger (or a plurality of passengers) in the vehicle gets off the vehicle, the specific passenger(s) can be reminded or not reminded specifically according to the condition that whether the articles are left on the vehicle or not, so that the needless pertinence reminding in the prior art is eliminated or reduced, and the driving comfort and the passenger experience are improved.
Drawings
FIG. 1 shows a schematic diagram of a system for alerting occupants in a vehicle to carry their belongings in accordance with an embodiment of the present invention; and
FIG. 2 shows a schematic diagram of a method for alerting occupants in a vehicle to carry their belongings according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
FIG. 1 shows a schematic diagram of a system 100 for alerting occupants in a vehicle to carry their belongings according to an embodiment of the present invention. As shown, the system 100 includes an information acquisition unit 110, a matching unit 120, a determination unit 130, and a reminder unit 140.
The information collection unit 110 may be configured to collect at least occupant images of one or more occupants and item images of one or more items within the vehicle. It is noted that in this context, the term "occupant" includes both the driver and the passenger. In addition, the term "occupant image" refers to an image of one, more, or all body parts containing one or more occupants therein, and the term "item image" refers to an image containing one or more items therein. Indeed, the information collecting unit 110 may be configured to collect at least images including both one or more occupants and one or more items. The images (occupant images, item images, or images containing both occupants and items) may comprise a single image or a sequence of images (i.e., video).
In some embodiments, the information gathering unit 110 may be disposed at a plurality of locations within the vehicle that are convenient/suitable for gathering images of occupants and/or items within the vehicle. For example, the information collection unit 110 may be provided on a ceiling wall (roof of the vehicle interior) of the cab, in which case the information collection unit 110 can collect image information of occupants and/or articles in the vehicle interior from a top view ("bird's eye view"). In addition, the information collecting unit 110 may be disposed at various positions, such as above/below the seat, behind the backrest, above the dashboard, above the center console, below the armrest of the seat, and the like, so as to collect image information in the seat area, the dashboard area, and the center console area, and thus collect image information in the vehicle in an all-around manner, thereby preventing missing of the image information, which may cause the vehicle to have an article left therein and not be found.
The matching unit 120 is communicably connected with the information collecting unit 110. The matching unit 120 may be configured to determine a matching relationship between the occupant and the item based on at least the occupant image and the item image. Specifically, the matching unit 120 receives the image acquired by the information acquisition unit 110 and performs image analysis to determine the matching relationship between the occupant and the article. Herein, determining a matching relationship between an occupant and an item may refer to determining ownership of the item by the occupant or determining attribution of the item to the occupant. For example, assuming that two occupants a and B and 5 items, the cell phone 01, the cell phone 02, the key string 03, the key string 04, and the wallet 05, are present and detected in the image acquired by the information acquisition unit 110, wherein the cell phone 01, the key string 03, and the wallet 05 are attributed to the occupant a (i.e., are items thereof), and the cell phone 02 and the key string 04 are attributed to the occupant B (i.e., are items thereof), it can be determined that the cell phone 01, the key string 03, and the wallet 05 (items 01, 03, 05) have a matching relationship with the occupant a, and the cell phone 02 and the key string 04 (items 02, 04) have a matching relationship with the occupant B.
In particular, in some embodiments, the information acquisition unit 110 may continuously acquire images within the vehicle, and may include occupants and/or items in the images. The occupant image may include a face and body parts (e.g., upper limbs, hands, arms, etc.). Through image processing (face recognition, etc.), different occupants and their body parts within the vehicle can be identified. The item images may include various categories of items, such as items that a typical driver and passenger may bring to the vehicle, such as cell phones, purses, keys, cups, backpacks, and the like. When a driver or a passenger (or a new passenger) enters the vehicle, the information collection unit 110 detects the passenger, performs image processing by image processing technology such as face recognition to recognize the passenger, for example, as a new passenger, and assigns a new passenger identification to the passenger. Similar to the detection and identification of occupants, when an item is present in the field of view of the information acquisition unit 110 (i.e., capable of being acquired/detected by the information acquisition unit 110), the information acquisition unit 110 detects the item, performs image processing by image processing techniques such as image classification to identify the item, e.g., as a newly present item, and assigns a new item identification to the item. Based on the unique occupant identification for each occupant and the unique item identification for each item, a matching relationship between the occupant and the item belonging to the occupant may be determined. Such a matching relationship may be determined based on one or more criteria. In some embodiments, the matching unit 120 may be configured to determine, based on at least the occupant image and the item image, a matching relationship between the occupant and the item by at least one of: (i) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific article included in the article image when a distance between a body part of the specific occupant and the specific article is smaller than a predetermined value; and (ii) determining that there is a matching relationship between the occupant and the item when the body part of the specific occupant included in the occupant image has a minimum distance from the specific item object included in the item image. For example, the information acquisition unit 110 detects the occupant a, and detects the article 01, and in the case that the distance from the body part (e.g., hand) of the occupant a to the article 01 is within a predetermined threshold (e.g., 10cm), the article may be considered to be owned by the occupant a, that is, it is determined that there is a matching relationship between the occupant a and the article 01. As another example, the information acquisition unit 110 detects the occupant a, and detects the articles 01 and 02 (for example, two articles of the same category), and in the case that the distance from the body part (for example, the hand) of the occupant a to the article 01 is shorter (i.e., the distance is closest) than the distance to the article 02, the article 01 may be considered to be owned by the occupant a, that is, it is determined that there is a matching relationship between the occupant a and the article 01. In some cases, it may be determined that both items 01 and 02 have a matching relationship with occupant A (e.g., occupant A has two cell phones 01 and 02) based on the criteria described above. It should be appreciated that the distance comparison described above is preferably performed when the item first appears within the field of view of the information acquisition unit 110. In addition, the above distance may refer to a distance between the contour of the body part of the occupant and the contour of the article, or a distance between geometric centers thereof. Further, it is easy to understand that the kinds and the number of articles having a matching relationship with the occupant a are not limited.
After the matching relationship between the passenger and the article is determined, when the specific passenger gets off or has the intention to get off the vehicle, the specific passenger can be reminded when the article having the matching relationship with the specific passenger is found to be left in the vehicle. In particular, the determination unit 130 may determine whether one or more occupants do not carry their belonged items (i.e., items) when the one or more occupants are determined to have the intention to get off. In this context, "there is an intention to get off the vehicle" means an intention that the occupant is about to get up to get off the vehicle. The determination of the intent of one or more occupants to disembark may include a variety of ways. In one embodiment, it is determined whether there is an intention of the one or more occupants to get off the vehicle based on the captured occupant images of the one or more occupants, e.g., it is determined that there is an intention of the occupant to get off the vehicle if a body part (e.g., legs) of the occupant is detected to move in an outboard direction. In another embodiment, the system 100 may further include a voice collecting unit (not shown), which may be integrated with the information collecting unit 110 as an image and audio collecting unit, configured to collect voice information of at least one or more occupants in the vehicle, and the determining unit 130 may be further configured to determine whether there is an intention to get off the vehicle for the one or more occupants based on the collected voice information. For example, an occupant may speak words such as "i am to", "i want to get off", etc. when getting off quickly, whereupon the occupant's intent to get off may be recognized through audio processing (e.g., voice recognition). In yet another embodiment, the system 100 may include a vehicle state detection unit (not shown) disposed in the vehicle, configured to detect a vehicle state, and the determination unit 130 is further configured to determine whether the one or more occupants have an intention to alight from the vehicle based on the detected vehicle state. Specifically, the vehicle state detection unit detects one or more states of the vehicle, the determination unit 130 communicates with the vehicle state detection unit and receives a vehicle state signal indicating a vehicle state, and determines whether the occupant has an intention to exit the vehicle (get off the vehicle) based on the received vehicle state signal. According to some embodiments of the present invention, the vehicle state detection unit may be one or more sensors provided in the vehicle, which are capable of collecting one or more vehicle states of the vehicle and transmitting a vehicle state signal generated based on the vehicle states to the determination unit. Wherein the vehicle status signal is related to an occupant's intent to exit the vehicle, including a status of use of any seat within the vehicle, a status of use of a vehicle key and/or door lock, a status of use of a door handle of the vehicle, a status of use of an engine or powertrain of the vehicle, or a status of use of an in-vehicle power system of the vehicle. For example, the vehicle state detection unit may include, but is not limited to, a first pressure sensor provided under a seat, a second pressure sensor provided at a door lock of a vehicle, a third pressure sensor provided at a door handle of the vehicle, a first monitoring device provided for monitoring a use state of an engine or a power transmission system of the vehicle, and a second monitoring device provided for monitoring a use state of an in-vehicle power supply system of the vehicle. The vehicle state detection unit can detect at least one of a use state of any seat in the vehicle, a use state of a vehicle key and/or a door lock, a use state of a vehicle door handle, a use state of an engine or a power transmission system of the vehicle, or a use state of an in-vehicle power supply system of the vehicle. In one example, when the occupant gets up from the seat for a relatively long time, the pressure value detected by the first pressure sensor may instantaneously become zero, and the determination unit may determine that the seat is in the idle state and the occupant has an intention to get off the vehicle after receiving the change information of the pressure value from the vehicle state detection unit. In particular, when all the seats are in the idle state, it can be determined that the vehicle state indicates that all the occupants in the vehicle have an intention to leave the vehicle. Various mechanisms for determining whether an occupant has an intent to alight from the vehicle will occur to those skilled in the art and will not be described in detail herein. In some embodiments, determining whether the one or more occupants are not carrying their belongings comprises: determining whether a distance between the one or more occupants and an item having a matching relationship therewith is greater than a separation threshold distance based on the occupant image and the item image acquired by the information acquisition unit. Specifically, when it is determined that the passenger has the intention to get off the vehicle, that is, when the passenger needs to be reminded, the information acquisition unit 110 searches the inside of the vehicle to find whether there is any "forgotten" item. Specifically, for a specific occupant having an intention to get off the vehicle, the information acquisition unit 110 determines whether there is any item having a matching relationship with the specific occupant outside a predetermined threshold distance (determines whether or not "forgotten"), and if so, gives a reminder; otherwise, no reminder is given. In some embodiments, the alert signal comprises at least one of a visual alert signal, an audible alert signal, and a tactile alert signal. In particular, the searched image of the forgotten article may be displayed in the in-vehicle display; may sound (including a "beep" sound or voice prompt); and/or vibrate components within the vehicle (e.g., seat, steering wheel, etc.). In particular, the reminder may not be directed to a person with an intent to disembark, the reminder may be indicated to a driver or other passenger, who may in turn remind the person with the intent to disembark. In fact, the reminder signal may include any form of signal that indicates to the driver and/or passenger that the item has been forgotten to occur.
In some embodiments, the matching unit 120 is further configured to ignore the matching relationship between the occupant and the item determined by the matching unit according to a user input. In fact, there are many items and components within the vehicle, most of which may not belong to the passenger or be an object of anti-forgetting. In order to prevent items in the vehicle that do not match a particular occupant from being misassigned as belonging to the particular occupant, thereby also giving a false alert, the matching unit 120 may be configured to ignore the determined matching relationship between the occupant and the item according to the user input, such that the occupant is not alerted to such an item when the occupant gets off the vehicle. According to some embodiments of the present invention, the matching unit 120 may further classify the category to which the left-over item belongs, and specifically, when determining that the left-over item exists in the vehicle, the matching unit 120 may compare the left-over item with preset classification information to determine whether to send a prompt to the passenger when the left-over item exists. For example, the matching unit 120 may store classification information of the legacy article. For example, paper, books, ropes, etc. may be set as a type that does not require reminding, while mobile phones, purses, backpacks, keys, etc. may be set as a type that requires reminding. After the information collecting unit 110 finally determines the specific category of the left-over article, the category to which the left-over article belongs may be classified according to the classification information of the matching unit 120, and the determining unit 130 may determine whether to issue a reminder to the passenger (to remind the passenger of the category that needs to be reminded).
Reminder systems according to some embodiments of the invention have been described above. The reminding system according to the embodiment of the invention is suitable for being installed or integrated in a vehicle (such as a car, a passenger car, a van and the like), and can detect whether the left-over articles (such as a mobile phone, a wallet, a backpack or keys and the like) exist at various positions in the vehicle in a computer vision and image recognition mode and correspondingly remind a specific passenger (a driver or a passenger) in the vehicle. Accordingly, the invention also provides a vehicle comprising a system for reminding an occupant of carrying his belongings in the vehicle according to some embodiments of the invention.
FIG. 2 shows a schematic diagram of a method 200 for alerting occupants in a vehicle to carry their belongings in accordance with an embodiment of the present invention.
As shown in FIG. 2, a method 200 for alerting occupants in a vehicle to carry their belongings includes:
s210: capturing at least occupant images of one or more occupants within the vehicle and item images of one or more items;
s220: determining a matching relationship between the occupant and the item based on at least the occupant image and the item image;
s230: judging whether the one or more passengers have the purpose of getting off the vehicle, and further judging whether the one or more passengers do not carry the belongings when judging that the one or more passengers have the purpose of getting off the vehicle; and
S240: and when judging that the one or more passengers have the intention of getting off the vehicle but do not carry the belonged articles, outputting a reminding signal.
In one embodiment, in the method S200, based on at least the occupant image and the item image, a matching relationship between the occupant and the item is determined by at least one of: (i) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a distance between a body part of the occupant and the item object is smaller than a predetermined value; and (ii) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a body part of the occupant has a minimum distance from the item object.
In one embodiment, in the method S200, it is determined whether the one or more occupants have an intention to get off the vehicle based on at least one of:
an occupant image of the one or more occupants acquired;
voice information of one or more occupants within the vehicle; and
the detected vehicle state.
In one embodiment, in the method S200, it is determined whether the one or more occupants do not carry their belongings based on the acquired occupant images and item images to determine whether a distance between the one or more occupants and an item having a matching relationship therewith is greater than a separation threshold distance.
In one embodiment, the method S200 further includes ignoring the determined matching relationship between the occupant and the item based on user input.
In one embodiment, the alert signal comprises at least one of a visual alert signal, an audible alert signal, and a tactile alert signal.
Yet another aspect of the invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of the above. For example, the computer program, when executed by a processor, is capable of instructing the processor and/or the respective component to carry out the steps of: capturing at least occupant images of one or more occupants within the vehicle and item images of one or more items; determining a matching relationship between the occupant and the item based on at least the occupant image and the item image; judging whether the one or more passengers have the purpose of getting off the vehicle, and further judging whether the one or more passengers do not carry the belongings when judging that the one or more passengers have the purpose of getting off the vehicle; and outputting a reminding signal when judging that the one or more passengers have the intention of getting off the vehicle but do not carry the belonged articles.
It should be understood that the various elements of the above-described system 100 for alerting occupants of a vehicle to carry their belongings may be implemented in whole or in part by software, hardware, and combinations thereof. The units can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the units.
In an embodiment, a computer device is provided, comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, the processor implementing the steps of the method in any of the above embodiments when executing the computer program. The computer device may be a server or a vehicle-mounted terminal. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement the method of the invention for alerting an occupant of the vehicle to carry his belongings.
It will be appreciated by those skilled in the art that the schematic diagram of the system 100 for alerting occupants of a vehicle to carry their belongings shown in fig. 1 is merely a block diagram of a portion of the structure associated with the present solution and does not constitute a definition of the hardware/software/firmware to which the present solution applies, and a particular system may include more or less components than shown in the drawings, or combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the steps in implementing the methods according to the above embodiments of the present invention may be instructed to be performed by the relevant hardware by a computer program, which may be stored in a non-volatile computer-readable storage medium, and which, when executed, may include the steps of the above embodiments of the methods. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
While the present invention has been described in connection with the embodiments, it is to be understood by those skilled in the art that the foregoing description and drawings are merely illustrative and not restrictive of the broad invention, and that this invention not be limited to the disclosed embodiments. Various modifications and variations are possible without departing from the spirit of the invention.
Claims (14)
1. A system for alerting occupants within a vehicle to carry their belongings, the system comprising:
an information acquisition unit configured to acquire at least occupant images of one or more occupants and item images of one or more items within the vehicle;
a matching unit configured to determine a matching relationship between the occupant and the item based on at least the occupant image and the item image;
the judging unit is configured to judge whether the one or more passengers have the purpose of getting off the vehicle, and when the one or more passengers are judged to have the purpose of getting off the vehicle, further judge whether the one or more passengers do not carry the belonged items; and
And the reminding unit is configured to output a reminding signal when the judging unit judges that the one or more passengers have the intention of getting off the vehicle but do not carry the belonged articles.
2. The system according to claim 1, wherein the matching unit is configured to determine, based on at least the occupant image and the item image, a matching relationship between the occupant and the item by at least one of: (i) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a distance between a body part of the occupant and the item object is smaller than a predetermined value; and (ii) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a body part of the occupant has a minimum distance from the item object.
3. The system according to claim 1 or 2, wherein the determination unit is further configured to determine whether there is an intention to get off the vehicle for one or more occupants based on the occupant image of the one or more occupants acquired by the information acquisition unit.
4. The system according to claim 1 or 2, characterized in that the system further comprises a voice collecting unit configured to collect at least voice information of one or more occupants in the vehicle, and the judging unit is further configured to judge whether there is an intention of getting off the vehicle by the one or more occupants based on the collected voice information.
5. The system according to claim 1 or 2, characterized in that the system further comprises a vehicle state detection unit configured to detect a vehicle state, and the determination unit is further configured to determine whether the one or more occupants have an intention to get off the vehicle based on the detected vehicle state.
6. The system according to claim 1 or 2, wherein the judging unit judges whether or not the one or more occupants do not carry the article to which they belong based on the occupant image and the article image acquired by the information acquiring unit to determine whether or not the distance between the one or more occupants and the article having a matching relationship therewith is larger than a separation threshold distance.
7. The system according to claim 1 or 2, wherein the matching unit is further configured to ignore the determined matching relationship between the occupant and the item according to a user input.
8. A vehicle comprising a system according to any one of claims 1-7.
9. A method for alerting occupants within a vehicle to carry items to which they belong, the method comprising:
capturing at least occupant images of one or more occupants within the vehicle and item images of one or more items;
determining a matching relationship between the occupant and the item based on at least the occupant image and the item image;
judging whether the one or more passengers have the purpose of getting off the vehicle, and further judging whether the one or more passengers do not carry the belongings when judging that the one or more passengers have the purpose of getting off the vehicle; and
and when judging that the one or more passengers have the intention of getting off the vehicle but do not carry the belonged articles, outputting a reminding signal.
10. The method of claim 9, wherein determining the matching relationship between the occupant and the item based on at least the occupant image and the item image is performed by at least one of: (i) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a distance between a body part of the occupant and the item object is smaller than a predetermined value; and (ii) determining that there is a matching relationship between a specific occupant included in the occupant image and a specific item object included in the item image when a body part of the occupant has a minimum distance from the item object.
11. The method of claim 9 or 10, wherein determining whether the one or more occupants have an intent to alight is based on at least one of:
an occupant image of the one or more occupants acquired;
voice information of one or more occupants within the vehicle; and
the detected vehicle state.
12. The method according to claim 9 or 10, wherein it is determined whether the one or more occupants do not carry the items to which they belong based on the acquired occupant image and item image to determine whether a distance between the one or more occupants and the items having a matching relationship therewith is greater than a separation threshold distance.
13. The method according to claim 9 or 10, further comprising ignoring the determined matching relationship between the occupant and the item according to a user input.
14. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 9 to 13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910425894.1A CN111986453A (en) | 2019-05-21 | 2019-05-21 | Reminder system, vehicle comprising same, and corresponding method and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910425894.1A CN111986453A (en) | 2019-05-21 | 2019-05-21 | Reminder system, vehicle comprising same, and corresponding method and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111986453A true CN111986453A (en) | 2020-11-24 |
Family
ID=73436311
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910425894.1A Pending CN111986453A (en) | 2019-05-21 | 2019-05-21 | Reminder system, vehicle comprising same, and corresponding method and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111986453A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112832615A (en) * | 2021-01-04 | 2021-05-25 | 东风柳州汽车有限公司 | Safe door opening method, device and equipment for assisting passengers to get off and storage medium |
| CN113705543A (en) * | 2021-10-27 | 2021-11-26 | 珠海市魅族科技有限公司 | In-vehicle article anti-forgetting monitoring method, device, equipment and medium |
| CN115862068A (en) * | 2022-12-06 | 2023-03-28 | 北京崇迅科技有限公司 | Computer data information processing method and system based on big data |
| WO2023071175A1 (en) * | 2021-10-29 | 2023-05-04 | 上海商汤智能科技有限公司 | Method and apparatus for associating person with object in vehicle, and electronic device and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006338535A (en) * | 2005-06-03 | 2006-12-14 | Matsushita Electric Ind Co Ltd | Method and device for preventing things from being left behind in car |
| WO2015025435A1 (en) * | 2013-08-23 | 2015-02-26 | イデアクロス株式会社 | System for preventing items from being left behind, method for provision of information to driver of passenger vehicle, and computer program |
| CN204406627U (en) * | 2014-11-27 | 2015-06-17 | 上海市杨浦区平凉路第三小学 | A kind of alarm set forgeing article |
| CN105374159A (en) * | 2014-08-11 | 2016-03-02 | 林昭宏 | Article loss preventing device and method |
| CN105680892A (en) * | 2016-03-31 | 2016-06-15 | 北京小米移动软件有限公司 | Correlation article reminding method and device |
| CN106560836A (en) * | 2015-10-02 | 2017-04-12 | Lg电子株式会社 | Apparatus, Method And Mobile Terminal For Providing Object Loss Prevention Service In Vehicle |
| CN106781315A (en) * | 2016-11-29 | 2017-05-31 | 北京小米移动软件有限公司 | A kind of based reminding method and device |
| CN107585096A (en) * | 2016-07-08 | 2018-01-16 | 奥迪股份公司 | Anti- forgetting system for prompting, method and vehicle |
| CN107599971A (en) * | 2017-09-04 | 2018-01-19 | 驭势（上海）汽车科技有限公司 | Specific aim is got off based reminding method and device |
| CN109117772A (en) * | 2018-08-01 | 2019-01-01 | 上海博泰悦臻网络技术服务有限公司 | The method and system for reminding article to lose |
| CN109263544A (en) * | 2017-07-18 | 2019-01-25 | 通用汽车环球科技运作有限责任公司 | Method and apparatus for notifying object |
-
2019
- 2019-05-21 CN CN201910425894.1A patent/CN111986453A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006338535A (en) * | 2005-06-03 | 2006-12-14 | Matsushita Electric Ind Co Ltd | Method and device for preventing things from being left behind in car |
| WO2015025435A1 (en) * | 2013-08-23 | 2015-02-26 | イデアクロス株式会社 | System for preventing items from being left behind, method for provision of information to driver of passenger vehicle, and computer program |
| CN105374159A (en) * | 2014-08-11 | 2016-03-02 | 林昭宏 | Article loss preventing device and method |
| CN204406627U (en) * | 2014-11-27 | 2015-06-17 | 上海市杨浦区平凉路第三小学 | A kind of alarm set forgeing article |
| CN106560836A (en) * | 2015-10-02 | 2017-04-12 | Lg电子株式会社 | Apparatus, Method And Mobile Terminal For Providing Object Loss Prevention Service In Vehicle |
| CN105680892A (en) * | 2016-03-31 | 2016-06-15 | 北京小米移动软件有限公司 | Correlation article reminding method and device |
| CN107585096A (en) * | 2016-07-08 | 2018-01-16 | 奥迪股份公司 | Anti- forgetting system for prompting, method and vehicle |
| CN106781315A (en) * | 2016-11-29 | 2017-05-31 | 北京小米移动软件有限公司 | A kind of based reminding method and device |
| CN109263544A (en) * | 2017-07-18 | 2019-01-25 | 通用汽车环球科技运作有限责任公司 | Method and apparatus for notifying object |
| CN107599971A (en) * | 2017-09-04 | 2018-01-19 | 驭势（上海）汽车科技有限公司 | Specific aim is got off based reminding method and device |
| CN109117772A (en) * | 2018-08-01 | 2019-01-01 | 上海博泰悦臻网络技术服务有限公司 | The method and system for reminding article to lose |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112832615A (en) * | 2021-01-04 | 2021-05-25 | 东风柳州汽车有限公司 | Safe door opening method, device and equipment for assisting passengers to get off and storage medium |
| CN113705543A (en) * | 2021-10-27 | 2021-11-26 | 珠海市魅族科技有限公司 | In-vehicle article anti-forgetting monitoring method, device, equipment and medium |
| WO2023071175A1 (en) * | 2021-10-29 | 2023-05-04 | 上海商汤智能科技有限公司 | Method and apparatus for associating person with object in vehicle, and electronic device and storage medium |
| CN115862068A (en) * | 2022-12-06 | 2023-03-28 | 北京崇迅科技有限公司 | Computer data information processing method and system based on big data |
| CN115862068B (en) * | 2022-12-06 | 2023-10-13 | 中软国际科技服务有限公司 | Big data-based computer data information processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111986453A (en) | Reminder system, vehicle comprising same, and corresponding method and medium | |
| US11281919B2 (en) | Object detection and passenger notification | |
| US10946873B2 (en) | Distracted driving elimination system | |
| CN109690609B (en) | Passenger assist device, method, and program | |
| CN106560836B (en) | Apparatus, method and mobile terminal for providing anti-loss of goods service in vehicle | |
| CN107585096A (en) | Anti- forgetting system for prompting, method and vehicle | |
| JP4519891B2 (en) | Vehicle information notification device | |
| US20160046296A1 (en) | Method and device for assigning a driver of a vehicle to a driver class stored in the vehicle and representing a specific driving behaviour of the driver, and computer program product for that purpose | |
| JP6167690B2 (en) | Vehicle interior monitoring device | |
| KR20210121015A (en) | Detection of leftover objects | |
| US20180079356A1 (en) | Alighting notification device | |
| JP6657415B2 (en) | Information providing device and moving body | |
| TW201328340A (en) | Noticing system and method for looking for passengers | |
| JP2018142130A (en) | Control device and system thereof | |
| JP6851048B2 (en) | Taxi baggage forgetting prevention system | |
| CN111382665B (en) | Information processing apparatus and computer-readable storage medium | |
| CN112455330B (en) | Method and device for preventing articles in vehicle trunk from being lost and vehicle | |
| US10981574B2 (en) | Biological information storage system and in-vehicle biological information storage device | |
| CN113705543A (en) | In-vehicle article anti-forgetting monitoring method, device, equipment and medium | |
| US20220295216A1 (en) | Electronic device monitoring system | |
| JP2001097070A (en) | Person recognizing device for vehicle | |
| WO2022025088A1 (en) | Vehicle safety support system | |
| CN213322875U (en) | Leave over article detection device in car | |
| CN111931734A (en) | Method and device for identifying lost object, vehicle-mounted terminal and storage medium | |
| CN116834691A (en) | Reminding method and system for in-vehicle legacy object, computer storage medium and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201124 |
|
| RJ01 | Rejection of invention patent application after publication |