CN113920576A - Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle - Google Patents

Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle Download PDF

Info

Publication number
CN113920576A
CN113920576A CN202010647126.3A CN202010647126A CN113920576A CN 113920576 A CN113920576 A CN 113920576A CN 202010647126 A CN202010647126 A CN 202010647126A CN 113920576 A CN113920576 A CN 113920576A
Authority
CN
China
Prior art keywords
vehicle
person
behavior
identifying
losing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010647126.3A
Other languages
Chinese (zh)
Inventor
唐帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Audi AG
Original Assignee
Audi AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi AG filed Critical Audi AG
Priority to CN202010647126.3A priority Critical patent/CN113920576A/en
Publication of CN113920576A publication Critical patent/CN113920576A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B3/00Audible signalling systems; Audible personal calling systems
    • G08B3/10Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Electromagnetism (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

The embodiment of the disclosure relates to a method, a device, equipment and a storage medium for identifying lost object behaviors of people on a vehicle. The method comprises the following steps: the method comprises the steps of obtaining vehicle interior condition data of a vehicle at a first moment, determining a current article set corresponding to vehicle personnel according to the vehicle interior condition data, and identifying whether the vehicle personnel have a behavior of losing objects outside the vehicle according to the current article set and a pre-obtained original article set.

Description

Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle
Technical Field
The present disclosure relates to the field of artificial intelligence technologies, and in particular, to a method and an apparatus for identifying an object loss behavior of an on-vehicle person, and a computer-readable storage medium.
Background
With the rapid development of society, the quantity of vehicles kept is increasing day by day, and traveling by taking vehicles becomes an important daily traveling mode for people, such as traveling by taking public transport means, traveling by taking automatic driving vehicles, and the like.
At present, the phenomenon that people on the vehicle lose objects outside the vehicle randomly when taking the vehicle to move out generally occurs in the society, so that not only can the pollution of the surrounding environment be caused, but also various traffic accidents can be caused, and great potential safety hazards are brought to the driving safety.
Therefore, in order to effectively reduce the phenomenon that the vehicle occupant loses things outside the vehicle according to the intention, a method for identifying the vehicle occupant losing things needs to be provided.
Disclosure of Invention
An object of the disclosed embodiment is to provide a new technical solution for identifying the lost object behavior of the personnel on the vehicle.
According to a first aspect of the present disclosure, there is provided a method for identifying a lost object behavior of a person on a vehicle, the method including:
acquiring in-vehicle condition data of a vehicle at a first time;
determining a current article set corresponding to the on-board personnel according to the in-board condition data;
and identifying whether the personnel on the vehicle has the behavior of losing objects outside the vehicle according to the current object set and the pre-acquired original object set.
Optionally, identifying whether the person on the vehicle has an act of losing the object outside the vehicle according to the current item set and the original item set comprises:
judging whether the current article set is consistent with the original article set;
under the condition that the current article set is consistent with the original article set, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle;
and under the condition that the current item set is inconsistent with the original item set, identifying that the person on the vehicle has the behavior of losing the object outside the vehicle.
Optionally, identifying whether the person on the vehicle has an action of losing the object outside the vehicle according to the current item set and the original item set, further comprising:
acquiring vehicle exterior condition data of a vehicle at a second moment in time under the condition that the current item set is inconsistent with the original item set, wherein the first moment is earlier than the second moment;
judging whether the goods outside the vehicle exist or not according to the vehicle exterior condition data;
identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the objects outside the vehicle exist;
and under the condition that no goods outside the vehicle exist, identifying that the person on the vehicle does not have the behavior of losing the goods outside the vehicle.
Optionally, identifying whether the person on the vehicle has an action of losing the object outside the vehicle according to the current item set and the original item set, further comprising:
determining a difference item between the current item set and the original item set in the case that an off-board item exists outside the vehicle;
judging whether the difference object is consistent with the object outside the vehicle;
identifying that the on-board person has a behavior of losing objects outside the vehicle if the difference object is consistent with the off-board object;
and under the condition that the difference object is inconsistent with the object outside the vehicle, identifying that the person on the vehicle does not have a behavior of losing the object outside the vehicle.
Optionally, identifying whether the person on the vehicle has an action of losing the object outside the vehicle according to the current item set and the original item set, further comprising:
under the condition that the goods outside the vehicle exist, judging whether the time difference between the second moment and the first moment is lower than a preset threshold value or not;
under the condition that the time difference is lower than a preset threshold value, identifying that the person on the vehicle has a behavior of losing objects outside the vehicle;
and under the condition that the time difference is not lower than a preset threshold value, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
Optionally, identifying whether the person on the vehicle has an action of losing the object outside the vehicle according to the current item set and the original item set, further comprising:
under the condition that an article outside the vehicle exists, acquiring the window state of the vehicle within a specific time period, wherein the specific time period is a time period from the first time to the second time;
identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the vehicle window state comprises an open state;
and under the condition that the window state does not contain an opening state, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
Optionally, identifying whether the person on the vehicle has an action of losing the object outside the vehicle according to the current item set and the original item set, further comprising:
under the condition that the current article set is inconsistent with the original article set, acquiring a position relation between the hand of the person on the vehicle and the window of the vehicle at a third moment, wherein the third moment is earlier than the first moment;
under the condition that the position relation is that the hands of the on-board personnel are positioned outside the window of the vehicle, identifying that the on-board personnel have a behavior of losing objects outside the vehicle;
and under the condition that the hand of the person on the vehicle is positioned in the window of the vehicle in the position relation, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
Optionally, the method further comprises: in the case where it is recognized that the on-board person has a behavior toward a lost outside the vehicle, performing at least one of:
firstly, warning the object loss behavior of people on the vehicle through vehicle-mounted visual equipment of the vehicle; secondly, warning the object loss behavior of people on the vehicle through a vehicle-mounted loudspeaker of the vehicle; and thirdly, planning a parking route through an automatic driving system of the vehicle, and controlling the vehicle to park to a specified position according to the parking route.
Optionally, the step of obtaining the original set of items includes:
monitoring whether personnel on the vehicle exist in the vehicle;
acquiring in-vehicle condition data of a vehicle under the condition that on-vehicle personnel are monitored to be present in the vehicle;
and determining and acquiring an original article set corresponding to the personnel on the vehicle according to the in-vehicle condition data.
According to a second aspect of the present disclosure, there is provided an apparatus for recognizing a lost article behavior of a person on a vehicle, comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring the vehicle interior condition data of a vehicle at a first moment;
the determining module is used for determining a current article set corresponding to the on-board personnel according to the in-board condition data;
and the identification module is used for identifying whether the personnel on the vehicle has the behavior of losing objects outside the vehicle according to the current object set and the pre-acquired original object set.
According to a third aspect of the present disclosure, there is provided an embodiment of an apparatus for identifying a loss behavior of an on-vehicle person, including a device for identifying a loss behavior of an on-vehicle person according to the third aspect of the present specification, or the apparatus includes:
a memory for storing executable commands;
and the processor is used for executing the method for identifying the lost object behavior of the personnel on the vehicle according to the first aspect of the specification under the control of the executable command.
According to a fourth aspect of the present disclosure, there is also provided an embodiment of a computer-readable storage medium, which stores executable instructions that, when executed by a processor, perform the method for identifying a loss behavior of an on-vehicle person according to the first aspect of the present specification.
The beneficial effect of the embodiment of the present disclosure lies in that, the present embodiment compares the current article set corresponding to the person on the vehicle currently with the original article set corresponding to the person on the vehicle when the person on the vehicle has just got on the vehicle, and can effectively identify whether the person on the vehicle has a behavior of losing objects outside the vehicle, thereby greatly reducing the phenomenon that the person on the vehicle loses objects outside the vehicle at will when taking the vehicle to move out.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a block diagram of a hardware configuration of a lost object behavior recognition apparatus for an on-vehicle person according to an embodiment of the present disclosure;
fig. 2 is a flowchart of a method for identifying a lost object behavior of a person on a vehicle according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of an apparatus for identifying a lost object behavior of an on-vehicle person according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a lost object behavior recognition device for an on-vehicle person according to an embodiment of the present disclosure.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
< hardware configuration >
Fig. 1 is a block diagram of a hardware configuration of a lost object behavior recognition device for an on-vehicle person according to an embodiment of the present disclosure.
The loss behavior recognition device 1000 of the vehicle occupant may be a virtual machine or a physical machine. The loss behavior recognition apparatus 1000 for the in-vehicle person may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like. The processor 1100 may be a central processing unit CPU, a microprocessor MCU, or the like. The memory 1200 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, a USB interface, a headphone interface, and the like. Communication device 1400 is capable of wired or wireless communication, for example. The display device 1500 is, for example, a liquid crystal display panel, a touch panel, or the like. The input device 1600 may include, for example, a touch screen, a keyboard, and the like. A user can input/output voice information through the speaker 1700 and the microphone 1800.
As applied to this embodiment, the memory 1200 is used to store a computer program that controls the processor 1100 to operate to perform a data processing method according to any embodiment of the present invention. The computer program instructions may be designed by the skilled person in accordance with the disclosed solution. How the computer program controls the operation of the processor 1100 is well known in the art and will not be described in detail herein.
Although a plurality of devices are shown in fig. 1 for each of the loss behavior recognition apparatuses 1000 of the vehicle occupant, the present invention may be directed to only some of the devices, for example, the loss behavior recognition apparatus 1000 of the vehicle occupant may be directed to only the memory 1200 and the processor 1100.
In addition, the device 1000 for identifying the lost object behavior of the on-board person may be installed inside the vehicle or outside the vehicle, and the device 1000 for identifying the lost object behavior of the on-board person may receive the in-vehicle condition data collected by the vehicle through the network, determine the current object set corresponding to the on-board person according to the in-vehicle condition data, and finally identify whether the on-board person has a behavior of losing objects outside the vehicle according to the current object set and the pre-obtained original object set.
In the above description, the skilled person will be able to design instructions in accordance with the disclosed solution. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
< method examples >
The embodiment of the disclosure provides a method for identifying a lost object behavior of a person on a vehicle, as shown in fig. 2, the method comprises the following steps:
s201: in-vehicle condition data of a vehicle is acquired at a first time.
In the embodiment of the present disclosure, since the present invention is intended to identify whether the person in the vehicle has a behavior of losing objects outside the vehicle by comparing the object set carried by the person in the vehicle immediately before the vehicle gets on the vehicle and the object set carried by the person in the vehicle at the current time, in the process of identifying whether the person in the vehicle has the behavior of losing objects outside the vehicle, it is first necessary to determine the object carried by the person in the vehicle at the current time.
Further, in the embodiment of the present disclosure, in order to determine the items carried by the persons in the vehicle at the present time, the in-vehicle condition data of the vehicle needs to be acquired at the first time.
Here, the first time point refers to the current time point, that is, the acquired in-vehicle condition data is in-vehicle condition data of the vehicle at the current time point.
In addition, the in-vehicle condition data can be image data acquired through an in-vehicle camera, and can reflect the condition of articles carried by people on the vehicle.
S202: and determining the current article set corresponding to the personnel on the vehicle according to the in-vehicle condition data.
Further, since the in-vehicle condition data is image data acquired by the in-vehicle camera, after the in-vehicle condition data of the vehicle is acquired, the embodiment of the disclosure may perform image recognition on the in-vehicle condition data acquired by the in-vehicle camera through a pre-created image recognition model, so as to recognize the current item set corresponding to the on-vehicle person.
It should be noted that, in practical applications, articles discarded outside the window by the vehicle occupant are generally paper articles, bottle articles, plastic articles and cloth articles, so that the embodiments of the present disclosure can simulate an actual riding situation in the process of creating a sample image set of an image recognition model, obtain an in-vehicle image without paper articles, bottle articles, plastic articles and cloth articles, and an in-vehicle image with at least one of paper articles, bottle articles, plastic articles and cloth articles, create the sample image set according to the obtained in-vehicle image, and then train the image recognition model according to the sample image set.
Of course, the articles discarded outside the vehicle window by the vehicle occupant are not only paper articles, bottle articles, plastic articles and cloth articles, but also other various articles, the more the types of the articles contained in the sample image are, the higher the accuracy of identifying whether the vehicle occupant has the behavior of losing the articles outside the vehicle is, and the specific identification of which articles can be determined according to the actual situation.
It should be noted that, in order to distinguish the item set carried by the vehicle occupant immediately when the vehicle occupant gets into the vehicle from the item set carried by the vehicle occupant at the current time, in the embodiment of the present disclosure, the item set carried by the vehicle occupant immediately when the vehicle occupant gets into the vehicle is defined as the original item set, and the item set carried by the vehicle occupant at the current time is defined as the current item set.
Current collections of items include items carried by personnel onboard the vehicle, such as backpacks, water bottles, and the like.
S203: and identifying whether the personnel on the vehicle has the behavior of losing objects outside the vehicle according to the current object set and the pre-acquired original object set.
Furthermore, after the current article set corresponding to the vehicle personnel is determined, whether the vehicle personnel has the behavior of losing the object outside the vehicle can be identified according to the current article set and the pre-acquired original article set.
It should be noted that, because the present invention is intended to identify whether the vehicle occupant has a behavior of losing objects outside the vehicle by comparing the object set carried by the vehicle occupant immediately when the vehicle occupant gets into the vehicle with the object set carried by the vehicle occupant at the present time, in the embodiment of the present disclosure, whether the vehicle occupant has a behavior of losing objects outside the vehicle may specifically be as follows:
judging whether the current article set is consistent with the original article set; under the condition that the current article set is consistent with the original article set, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle; and under the condition that the current item set is inconsistent with the original item set, identifying that the person on the vehicle has the behavior of losing the object outside the vehicle.
For example, assume that the pre-acquired original set of items includes: knapsack and mineral water bottle, the current collection of articles of determining includes: and the backpack judges that the current object set is inconsistent with the original object set, and identifies that the person on the vehicle has the behavior of losing objects outside the vehicle.
In addition, since the original article set is an article carried by a person in the vehicle when the person gets on the vehicle, in the embodiment of the present disclosure, the obtaining of the original article set may specifically be as follows:
monitoring whether the on-board personnel exist in the vehicle or not, acquiring the on-board condition data of the vehicle under the condition that the on-board personnel exist in the vehicle, and determining and acquiring an original article set corresponding to the on-board personnel according to the on-board condition data.
It should be noted that the detection of the presence of the on-board person in the vehicle indicates that the on-board person has just got on the vehicle.
By the method, the current article set corresponding to the on-board personnel at present is compared with the original article set corresponding to the on-board personnel when the on-board personnel just get on the vehicle, whether the on-board personnel have the behavior of losing articles outside the vehicle can be effectively identified, and the phenomenon that the on-board personnel lose articles outside the vehicle at will when taking the vehicle to move out is greatly reduced.
In practical applications, there is a possibility that a person on a vehicle does not lose objects outside a window, but some objects in an original object set are placed in a pocket or a backpack, so that the current object set is inconsistent with the original object set, and therefore, in order to improve the accuracy of identifying the object losing behavior of the person on the vehicle, the embodiment of the disclosure provides the following two implementation modes for identifying whether the person on the vehicle has the behavior of losing objects outside the vehicle under the condition that the current object set is inconsistent with the original object set.
The first embodiment: when the vehicle personnel lose objects outside the vehicle window, the hands of the vehicle personnel tend to extend out of the vehicle window, so that the position relation between the hands of the vehicle personnel and the vehicle window of the vehicle at the third moment is obtained under the condition that the current object set is inconsistent with the original object set; under the condition that the position relation is that the hands of the on-board personnel are positioned outside the window of the vehicle, identifying that the on-board personnel have a behavior of losing objects outside the vehicle; and under the condition that the hand of the person on the vehicle is positioned in the window of the vehicle in the position relation, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
It should be noted that when it is determined that the current item set is inconsistent with the original item set, it is determined that a certain item disappears in the original item set at the moment, and if the vehicle occupant has a behavior of losing an item, the hand of the vehicle occupant tends to stick out of the window before the first time, so that the third time is earlier than the first time, the third time may be a time before the first time, or may be a time before the first time, N is an integer greater than 1, the larger N is, the farther the third time is from the first time is, the lower the accuracy rate of identifying whether the vehicle occupant has a behavior of losing an item outside the vehicle is, and conversely, the smaller N is, the closer the third time is from the first time is, the higher the accuracy rate of identifying whether the vehicle occupant has a behavior of losing an item outside the vehicle is.
The second embodiment: after the person on the vehicle loses objects outside the window, corresponding objects exist in the vehicle exterior identification, so under the condition that the current object set is inconsistent with the original object set, vehicle exterior condition data of the vehicle are obtained at a second moment, wherein the first moment is earlier than the second moment; judging whether the goods outside the vehicle exist or not according to the vehicle exterior condition data; identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the objects outside the vehicle exist; and under the condition that no goods outside the vehicle exist, identifying that the person on the vehicle does not have the behavior of losing the goods outside the vehicle.
It should be noted that, if the on-board person has a lost behavior, the discarded object may appear outside the vehicle only after the first time, and therefore the first time is earlier than the second time, that is, only after the on-board person is recognized to have the behavior of losing the object outside the vehicle at the first time, the vehicle exterior condition data of the vehicle need to be acquired at the second time, and based on the vehicle exterior condition data, whether the object outside the vehicle exists outside the vehicle is determined, so as to recognize that the on-board person has the behavior of losing the object outside the vehicle according to the object outside the vehicle.
It should be noted that the second time may be a time subsequent to the first time, or may be a time N subsequent to the first time, where N is an integer greater than 1, and the larger N indicates that the second time is farther from the first time and the lower the accuracy of identifying whether the on-vehicle person has a behavior toward the object lost outside the vehicle, and conversely, the smaller N indicates that the second time is closer to the first time and the higher the accuracy of identifying whether the on-vehicle person has a behavior toward the object lost outside the vehicle.
Further, even if it is determined that an object outside the vehicle exists, the object outside the vehicle may be thrown out by a pedestrian or another vehicle outside the vehicle and is not lost by a vehicle occupant outside the vehicle, and therefore, in order to improve the accuracy of the behavior of identifying the lost object of the vehicle occupant, the embodiments of the present disclosure provide the following three embodiments of identifying whether the vehicle occupant has the behavior of losing the object outside the vehicle on the basis of determining that the object outside the vehicle exists.
The first embodiment: determining a difference item between the current item set and the original item set in the case that an off-board item exists outside the vehicle; judging whether the difference object is consistent with the object outside the vehicle; identifying that the on-board person has a behavior of losing objects outside the vehicle if the difference object is consistent with the off-board object; and under the condition that the difference object is inconsistent with the object outside the vehicle, identifying that the person on the vehicle does not have a behavior of losing the object outside the vehicle.
The second embodiment: under the condition that the goods outside the vehicle exist, judging whether the time difference between the second moment and the first moment is lower than a preset threshold value or not; under the condition that the time difference is lower than a preset threshold value, identifying that the person on the vehicle has a behavior of losing objects outside the vehicle; and under the condition that the time difference is not lower than a preset threshold value, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
Here, it should be noted that the time difference between the second time and the first time can reflect the possibility that the vehicle-exterior article is discarded by the vehicle occupant, and the smaller the time difference, the smaller the possibility that the vehicle-exterior article is discarded by the vehicle occupant, whereas the larger the time difference, the greater the possibility that the vehicle-exterior article is discarded by the vehicle occupant, and the time difference lower than a certain probability can directly confirm that the vehicle-exterior article is not discarded by the vehicle occupant, so that it is necessary to set a threshold value to determine which interval time difference can indicate that the vehicle-exterior article is directly related to the vehicle occupant.
Third embodiment: under the condition that an article outside the vehicle exists, acquiring the window state of the vehicle within a specific time period, wherein the specific time period is a time period from the first time to the second time; identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the vehicle window state comprises an open state; and under the condition that the window state does not contain an opening state, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
It should be noted that, since the vehicle occupant wants to lose an object outside the vehicle, the time when the window of the vehicle is in the open state is between the first time and the second time, and therefore, in the embodiment of the present disclosure, the specific time period is a time period between the first time and the second time.
It should be noted that the above three embodiments may be used alone or in combination, that is, at least two of the first, second, and third embodiments may be used in combination, and the combined use may improve the accuracy of identifying whether the vehicle occupant has the behavior of losing the object outside the vehicle.
In the embodiment of the disclosure, in order to further reduce the phenomenon that the person on the vehicle loses objects outside the vehicle at will when the person on the vehicle moves out, after the person on the vehicle is identified to have the behavior of losing objects outside the vehicle by the above method, the person on the vehicle is prompted to have the behavior of losing objects through the window at present, so that the person on the vehicle can develop the habit of losing objects through the window at will.
In the disclosed embodiment, at least one of the following three items can be executed to prompt the vehicle occupant that the vehicle window lost behavior exists currently.
The first item: and warning the object loss behavior of personnel on the vehicle through the vehicle-mounted vision equipment of the vehicle.
The second term is: and warning the object loss behavior of personnel on the vehicle through a vehicle-mounted loudspeaker of the vehicle.
The third item: and planning a parking route through an automatic driving system of the vehicle, and controlling the vehicle to park to a specified position according to the parking route.
It should be noted that the behavior of losing objects for warning the vehicle-mounted person through the vehicle-mounted vision device of the vehicle is a behavior of losing objects of a vehicle window of the vehicle-mounted person prompted from a visual angle, for example, the vehicle-mounted person is warned by displaying warning slogans of a character type, an image type, an icon type or a video type through a display screen of the vehicle, and the vehicle-mounted person is warned through a warning lamp inside the vehicle or a warning lamp outside the vehicle; the behavior of warning the lost object of the personnel on the vehicle through the vehicle-mounted loudspeaker of the vehicle is to prompt the behavior of the lost object of the vehicle window of the personnel on the vehicle from the angle of sound, for example, warning voice, warning buzzing or external whistle is sent out through the vehicle-mounted loudspeaker of the vehicle; and planning a parking route through the automatic driving system of the vehicle, and controlling the vehicle to park to a specified position according to the parking route, wherein the behavior of the lost object of the windows of the people on the vehicle is prompted from the parking behavior.
In addition, controlling the vehicle to stop at the specified position is, in particular, stopping the vehicle at the specified position by controlling a power system, a steering system, and a braking system of the vehicle.
< apparatus embodiment >
As shown in fig. 3, the embodiment of the present disclosure further provides a device 30 for identifying a lost object behavior of a person on a vehicle, where the device 30 includes: an acquisition module 301, a determination module 302, an identification module 303 and an execution module 304;
an obtaining module 301, configured to obtain in-vehicle condition data of a vehicle at a first time;
a determining module 302, configured to determine, according to the in-vehicle status data, a current item set corresponding to a person on the vehicle;
and the identification module 303 is configured to identify whether the person in the vehicle has a behavior of losing objects outside the vehicle according to the current object set and a pre-acquired original object set.
In an embodiment, the identifying module 303 is specifically configured to determine whether the current item set is consistent with the original item set; under the condition that the current article set is consistent with the original article set, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle; and under the condition that the current item set is inconsistent with the original item set, identifying that the person on the vehicle has the behavior of losing the object outside the vehicle.
In one embodiment, the identifying module 303 is further configured to, in a case where the current item set is inconsistent with the original item set, obtain vehicle-exterior condition data of the vehicle at a second time, where the first time is earlier than the second time; judging whether the goods outside the vehicle exist or not according to the vehicle exterior condition data; identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the objects outside the vehicle exist; and under the condition that no goods outside the vehicle exist, identifying that the person on the vehicle does not have the behavior of losing the goods outside the vehicle.
In one embodiment, the identification module 303 is further configured to determine a difference item between the current item set and the original item set if an off-board item is present; judging whether the difference object is consistent with the object outside the vehicle; identifying that the on-board person has a behavior of losing objects outside the vehicle if the difference object is consistent with the off-board object; and under the condition that the difference object is inconsistent with the object outside the vehicle, identifying that the person on the vehicle does not have a behavior of losing the object outside the vehicle.
In one embodiment, the identification module 303 is further configured to determine whether a time difference between the second time and the first time is lower than a preset threshold value when an object outside the vehicle exists; under the condition that the time difference is lower than a preset threshold value, identifying that the person on the vehicle has a behavior of losing objects outside the vehicle; and under the condition that the time difference is not lower than a preset threshold value, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
In one embodiment, the identification module 303 is further configured to, in a case where an object outside the vehicle exists, acquire a window state of the vehicle within a specific time period, where the specific time period is a time period from the first time to the second time; identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the vehicle window state comprises an open state; and under the condition that the window state does not contain an opening state, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
In one embodiment, the identifying module 303 is further configured to, in a case that the current item set is inconsistent with the original item set, obtain a position relationship between a hand of a person on the vehicle and a window of the vehicle at a third time, where the third time is earlier than the first time; under the condition that the position relation is that the hands of the on-board personnel are positioned outside the window of the vehicle, identifying that the on-board personnel have a behavior of losing objects outside the vehicle; and under the condition that the hand of the person on the vehicle is positioned in the window of the vehicle in the position relation, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
In one embodiment, the executing module 304 is configured to, in a case that the identifying module 303 identifies that the person on the vehicle has a behavior of losing outside the vehicle, execute at least one of the following: firstly, warning the object loss behavior of people on the vehicle through vehicle-mounted visual equipment of the vehicle; secondly, warning the object loss behavior of people on the vehicle through a vehicle-mounted loudspeaker of the vehicle; and thirdly, planning a parking route through an automatic driving system of the vehicle, and controlling the vehicle to park to a specified position according to the parking route.
In one embodiment, the obtaining module 301 is specifically configured to monitor whether an on-board person exists in a vehicle; acquiring in-vehicle condition data of a vehicle under the condition that on-vehicle personnel are monitored to be present in the vehicle; and determining and acquiring an original article set corresponding to the personnel on the vehicle according to the in-vehicle condition data.
< apparatus embodiment >
In the embodiment of the present disclosure, there is further provided a lost article behavior recognition device 40 of a person on a vehicle as shown in fig. 4, where the lost article behavior recognition device 40 of the person on the vehicle includes the lost article behavior recognition device 30 of the person on the vehicle described in the embodiment of the present specification.
In further embodiments, the loss behavior recognition device 40 for the on-board person may also include a memory and a processor. The memory is for storing a computer program. The processor is adapted to perform the method described in any of the method embodiments of the present specification under control of a computer program stored in the memory.
The lost object behavior recognition device of the vehicle occupant may be a terminal device. The lost object behavior recognition device of the vehicle personnel can also be a server which is in communication connection with the terminal device. The device for identifying the lost object behavior of the vehicle personnel can further comprise a terminal device and a server connected with the terminal device, and is not limited herein.
< computer-readable storage Medium embodiment >
The present embodiments provide a computer-readable storage medium having stored therein an executable command that, when executed by a processor, performs a method described in any of the method embodiments of the present specification.
The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims (12)

1. A lost object behavior recognition method for people on a vehicle comprises the following steps:
acquiring in-vehicle condition data of a vehicle at a first time;
determining a current article set corresponding to the on-board personnel according to the in-board condition data;
and identifying whether the personnel on the vehicle has the behavior of losing objects outside the vehicle according to the current object set and the pre-acquired original object set.
2. The method of claim 1, wherein identifying whether the on-board person has an act of losing an item out of the vehicle based on the current set of items and the original set of items comprises:
judging whether the current article set is consistent with the original article set;
under the condition that the current article set is consistent with the original article set, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle;
and under the condition that the current item set is inconsistent with the original item set, identifying that the person on the vehicle has the behavior of losing the object outside the vehicle.
3. The method of claim 2, wherein identifying whether the on-board person has an act of losing an item out of the vehicle based on the current set of items and the original set of items further comprises:
acquiring vehicle exterior condition data of a vehicle at a second moment in time under the condition that the current item set is inconsistent with the original item set, wherein the first moment is earlier than the second moment;
judging whether the goods outside the vehicle exist or not according to the vehicle exterior condition data;
identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the objects outside the vehicle exist;
and under the condition that no goods outside the vehicle exist, identifying that the person on the vehicle does not have the behavior of losing the goods outside the vehicle.
4. The method of claim 3, wherein identifying whether the on-board person has an act of losing an item out of the vehicle based on the current set of items and the original set of items further comprises:
determining a difference item between the current item set and the original item set in the case that an off-board item exists outside the vehicle;
judging whether the difference object is consistent with the object outside the vehicle;
identifying that the on-board person has a behavior of losing objects outside the vehicle if the difference object is consistent with the off-board object;
and under the condition that the difference object is inconsistent with the object outside the vehicle, identifying that the person on the vehicle does not have a behavior of losing the object outside the vehicle.
5. The method of claim 3, wherein identifying whether the on-board person has an act of losing an item out of the vehicle based on the current set of items and the original set of items further comprises:
under the condition that the goods outside the vehicle exist, judging whether the time difference between the second moment and the first moment is lower than a preset threshold value or not;
under the condition that the time difference is lower than a preset threshold value, identifying that the person on the vehicle has a behavior of losing objects outside the vehicle;
and under the condition that the time difference is not lower than a preset threshold value, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
6. The method of claim 3, wherein identifying whether the on-board person has an act of losing an item out of the vehicle based on the current set of items and the original set of items further comprises:
under the condition that an article outside the vehicle exists, acquiring the window state of the vehicle within a specific time period, wherein the specific time period is a time period from the first time to the second time;
identifying that the person on the vehicle has a behavior of losing objects outside the vehicle when the vehicle window state comprises an open state;
and under the condition that the window state does not contain an opening state, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
7. The method of claim 2, wherein identifying whether the on-board person has an act of losing an item out of the vehicle based on the current set of items and the original set of items further comprises:
under the condition that the current article set is inconsistent with the original article set, acquiring a position relation between the hand of the person on the vehicle and the window of the vehicle at a third moment, wherein the third moment is earlier than the first moment;
under the condition that the position relation is that the hands of the on-board personnel are positioned outside the window of the vehicle, identifying that the on-board personnel have a behavior of losing objects outside the vehicle;
and under the condition that the hand of the person on the vehicle is positioned in the window of the vehicle in the position relation, identifying that the person on the vehicle does not have a behavior of losing objects outside the vehicle.
8. The method of claim 1, further comprising: in the case where it is recognized that the on-board person has a behavior toward a lost outside the vehicle, performing at least one of:
firstly, warning the object loss behavior of people on the vehicle through vehicle-mounted visual equipment of the vehicle; secondly, warning the object loss behavior of people on the vehicle through a vehicle-mounted loudspeaker of the vehicle; and thirdly, planning a parking route through an automatic driving system of the vehicle, and controlling the vehicle to park to a specified position according to the parking route.
9. The method of claim 1, wherein the step of obtaining the original set of items comprises:
monitoring whether personnel on the vehicle exist in the vehicle;
acquiring in-vehicle condition data of a vehicle under the condition that on-vehicle personnel are monitored to be present in the vehicle;
and determining and acquiring an original article set corresponding to the personnel on the vehicle according to the in-vehicle condition data.
10. A lost article behavior recognition device for a person on a vehicle, comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring the vehicle interior condition data of a vehicle at a first moment;
the determining module is used for determining a current article set corresponding to the on-board personnel according to the in-board condition data;
and the identification module is used for identifying whether the personnel on the vehicle has the behavior of losing objects outside the vehicle according to the current object set and the pre-acquired original object set.
11. A loss behavior recognition apparatus for an on-vehicle person, comprising the loss behavior recognition device for an on-vehicle person according to claim 10, or comprising:
a memory for storing executable commands;
a processor for executing the method for identifying a loss behavior of an on-board person according to any one of claims 1 to 9 under the control of the executable command.
12. A computer-readable storage medium storing executable instructions that, when executed by a processor, perform the method for identifying a loss behavior of an on-board person according to any one of claims 1 to 9.
CN202010647126.3A 2020-07-07 2020-07-07 Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle Pending CN113920576A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010647126.3A CN113920576A (en) 2020-07-07 2020-07-07 Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010647126.3A CN113920576A (en) 2020-07-07 2020-07-07 Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle

Publications (1)

Publication Number Publication Date
CN113920576A true CN113920576A (en) 2022-01-11

Family

ID=79231311

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010647126.3A Pending CN113920576A (en) 2020-07-07 2020-07-07 Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle

Country Status (1)

Country Link
CN (1) CN113920576A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130112461A (en) * 2012-04-04 2013-10-14 주식회사 만도 System for preventing lost article on inner vehicle
CN108248549A (en) * 2018-01-30 2018-07-06 北京汽车股份有限公司 Vehicle-mounted passenger identifying system, vehicle and vehicle-mounted passenger recognition methods
CN109685016A (en) * 2018-12-26 2019-04-26 上海理工大学 Cab-getter's lost article fetches system
CN109766804A (en) * 2018-12-28 2019-05-17 百度在线网络技术(北京)有限公司 Item identification method, device, equipment and storage medium based on vehicle-mounted scene
KR102005956B1 (en) * 2018-03-19 2019-07-31 김대훈 Image recognition apparatus in the inside of vehicle
CN110399767A (en) * 2017-08-10 2019-11-01 北京市商汤科技开发有限公司 Occupant's dangerous play recognition methods and device, electronic equipment, storage medium
CN110706700A (en) * 2019-09-29 2020-01-17 深圳市元征科技股份有限公司 In-vehicle disturbance prevention alarm method and device, server and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130112461A (en) * 2012-04-04 2013-10-14 주식회사 만도 System for preventing lost article on inner vehicle
CN110399767A (en) * 2017-08-10 2019-11-01 北京市商汤科技开发有限公司 Occupant's dangerous play recognition methods and device, electronic equipment, storage medium
CN108248549A (en) * 2018-01-30 2018-07-06 北京汽车股份有限公司 Vehicle-mounted passenger identifying system, vehicle and vehicle-mounted passenger recognition methods
KR102005956B1 (en) * 2018-03-19 2019-07-31 김대훈 Image recognition apparatus in the inside of vehicle
CN109685016A (en) * 2018-12-26 2019-04-26 上海理工大学 Cab-getter's lost article fetches system
CN109766804A (en) * 2018-12-28 2019-05-17 百度在线网络技术(北京)有限公司 Item identification method, device, equipment and storage medium based on vehicle-mounted scene
CN110706700A (en) * 2019-09-29 2020-01-17 深圳市元征科技股份有限公司 In-vehicle disturbance prevention alarm method and device, server and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
费腾;江龙;杨帅帅;杜克石;: "随岳高速智能视频分析系统建设探究", 中国交通信息化, no. 1, 3 April 2018 (2018-04-03) *

Similar Documents

Publication Publication Date Title
WO2022062659A1 (en) Intelligent driving control method and apparatus, vehicle, electronic device, and storage medium
KR102205240B1 (en) Unexpected Impulse Change Collision Detector
US11312298B2 (en) Modulating attention of responsible parties to predicted dangers of self-driving cars
KR102183189B1 (en) Intra-vehicular mobile device management
US20150116493A1 (en) Method and system for estimating gaze direction of vehicle drivers
US10970899B2 (en) Augmented reality display for a vehicle
US11807273B2 (en) Methods and apparatus to provide accident avoidance information to passengers of autonomous vehicles
FI124068B (en) A method to improve driving safety
CN110667506B (en) Collision recognition method, device, equipment and storage medium
CN103116399A (en) Providing a user interface experience based on inferred vehicle state
US11567509B2 (en) Control system, control method, and non-transitory storage medium
CN112991684A (en) Driving early warning method and device
CN110254442B (en) Method and apparatus for controlling vehicle display
CN114463985A (en) Driving assistance method, device, equipment and storage medium
CN114125695B (en) Slope driving warning method, device and equipment of vehicle and storage medium
CN113838273A (en) Vehicle-based reminding method and device, electronic equipment and storage medium
KR102319383B1 (en) Method and apparatus for automatically reporting traffic rule violation vehicles using black box images
CN111278708A (en) Method and device for assisting driving
CN113920576A (en) Method, device, equipment and storage medium for identifying object loss behavior of personnel on vehicle
CN113879313A (en) Driver fatigue detection method and device
US20200218263A1 (en) System and method for explaining actions of autonomous and semi-autonomous vehicles
CN113147794A (en) Method, device and equipment for generating automatic driving early warning information and automatic driving vehicle
CN114022899A (en) Method and device for detecting body part of vehicle occupant extending out of vehicle window and vehicle
CN113822449B (en) Collision detection method, collision detection device, electronic equipment and storage medium
CN113401071B (en) Display control device, display control method, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination