CN117456696A

CN117456696A - Method for reminding in-car object of leaving behind prevention and vehicle-mounted terminal

Info

Publication number: CN117456696A
Application number: CN202210843381.4A
Authority: CN
Inventors: 胡宏伟
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-07-18
Filing date: 2022-07-18
Publication date: 2024-01-26

Abstract

The application provides a method for reminding a vehicle-mounted object of leaving behind and a vehicle-mounted terminal, and relates to the technical field of terminals. According to the attribution relation between the object and the personnel in the vehicle, under the condition that the personnel in the vehicle is confirmed to get off the vehicle but the object with the attribution relation is still on the vehicle, the warning can be carried out according to the preset object carry-over reminding strategy, so that the object carry-over in the vehicle is avoided. The method comprises the following steps: in the case where it is determined that the number of in-vehicle personnel is at least one, the in-vehicle object attribution is determined. And after detecting that a first person in the personnel in the vehicle gets off the vehicle, alarming according to a preset object carry-over reminding strategy under the condition that the object belonging to the first person is left in the vehicle according to the object attribution.

Description

Method for reminding in-car object of leaving behind prevention and vehicle-mounted terminal

Technical Field

The embodiment of the application relates to the technical field of terminals, in particular to a method for reminding objects in a vehicle of leaving behind and a vehicle-mounted terminal.

Background

The automobile behavior brings convenience to people and brings hidden trouble problems. For example, many passengers often leave some objects in the vehicle after getting off the vehicle, and the subsequent recovery process is inconvenient for the passengers. Even more, the child (or pet) is forgotten in the automobile, which affects the mental health of the child and risks casualties.

At present, after a vehicle is flameout and all doors are determined to be closed and locked, a vehicle-mounted terminal monitors vital signs in the vehicle through a millimeter wave radar according to preset duration. If vital signs exist in the vehicle within the preset time, the vehicle-mounted terminal carries out alarm prompt.

However, the method only aims at the problem of vital sign carry-over, and the personnel getting off the vehicle still cannot find the carry-over of non-vital signs in the vehicle in time.

Disclosure of Invention

In order to solve the technical problem, the application provides an in-vehicle object anti-leaving reminding method and an in-vehicle terminal. According to the technical scheme, according to the attribution relation between the object and the personnel in the vehicle, under the condition that the personnel in the vehicle is confirmed to get off the vehicle but the object with the attribution relation is still on the vehicle, the warning can be carried out according to the preset object carry-over reminding strategy, so that the carry-over of the object in the vehicle is avoided.

In order to achieve the technical purpose, the embodiment of the application provides the following technical scheme:

in a first aspect, a method for reminding an object in a vehicle of remaining is provided. The method comprises the following steps: and determining the attribution of the object in the vehicle under the condition that the number of the personnel in the vehicle is at least one. A first person of the in-vehicle persons is detected to get off the vehicle. Responding to the getting-off of the first personnel, and alarming according to a preset object leaving reminding strategy under the condition that the object belonging to the first personnel remains in the car according to the object attribution.

In this way, when it is determined that a passenger gets off the vehicle, it can be determined whether the passenger leaves an object in the vehicle according to the attribution of the object. If the alighting personnel leave objects in the vehicle, the alighting personnel can alarm according to a preset object leave reminding strategy. Thereby realize in time reminding personnel of getting off object carry-over, reduce the influence of object carry-over to personnel of getting off.

In addition, the vehicle-mounted terminal reminds the left object by determining the attribution of the object, so that the real left object can be timely found and taken away by passengers when the interference to passengers due to false detection is reduced, and the vehicle-using experience of the passengers is improved.

According to a first aspect, determining an in-vehicle object attribution comprises: and acquiring an in-vehicle image. And determining a human body area corresponding to the in-vehicle personnel and an object area corresponding to the in-vehicle object in the in-vehicle image, and determining a human body label of the human body area. And establishing a attribution relation of the object region and the human body label corresponding to the human body region according to the distance between the object region and the human body region, wherein the attribution relation is used for representing attribution of the object corresponding to the object region.

Thus, the vehicle-mounted terminal establishes the attribution relation between the object and personnel in the vehicle by shooting images according to the existing configuration (such as a camera and the like) in the vehicle, namely, the attribution of the object is determined. Then the real-time determination of whether the left object exists in the vehicle can be realized according to the object attribution, so that the cost for determining the object attribution is reduced.

According to the first aspect, or any implementation manner of the first aspect, according to a distance between an object area and a human body area, a attribution relationship of a human body tag corresponding to the object area and the human body area is established, including: the Euclidean distance between the average coordinate position of the object region and the average coordinate position of the human body region, and the pixel depth distance between the average pixel depth of the object region and the average pixel depth of the human body region are determined. Determining a first human body region in the human body region nearest to the first object region in the object regions according to the sum of the Euclidean distance and the pixel depth distance; the first object region is an object region corresponding to a first object belonging to a first person, and the first person region corresponds to the first person. A first attribution relationship of the first object area and a first person tag of the first person area is established.

Therefore, through the image analysis method, the attribution relation between each passenger and the object carried by the passenger in the vehicle can be established. Thus, after any one or more passengers get off, whether an object is left can be determined according to the attribution relation.

According to a first aspect, or any implementation manner of the first aspect, detecting that a first person out of in-vehicle persons gets off the vehicle includes: and determining that the first person corresponding to the reduced human body labels gets off according to the reduction of the number of the human body labels.

Thus, according to the existing configuration (such as a camera) in the vehicle, the human body tag of the passenger is created through an image analysis method, so that the change of the human body tag in the vehicle can be determined, whether the passenger gets off the vehicle or not and whether the left object exists in the vehicle or not can be determined in real time. Therefore, the object leaving of passengers is timely reminded, and the influence of the object leaving on the passengers is reduced.

According to the first aspect, or any implementation manner of the first aspect, the preset object leave-on reminding policy includes one or several of the following: reminding mode, reminding duration and reminding times; the reminding mode comprises one or more of the following: the car lamp blinks, the display screen in the car displays reminding information, the voice broadcast in the car and the reminding and alarming through the personnel electronic equipment in the car.

Thus, the types of objects in different vehicles are combined, and the problem of object carry-over of passengers is prompted by adopting different reminding modes. Therefore, the problem of reminding passengers of leaving objects can be solved, a more accurate passenger reminding scheme is provided, and the alarm information can be accurately received by passengers.

According to the first aspect, or any implementation manner of the first aspect, in response to the first person getting off, according to the object attribution, in a case that it is determined that an object attributed to the first person remains in the vehicle, an alarm is given according to a preset object leave reminding policy, including: in response to the first person getting off, it is determined that the first object attributed to the first person remains in the vehicle based on the object attribution. Determining an object type of the first object; the object type includes any of the following: electronic equipment, living things, off-body objects other than electronic equipment and living things. And alarming the carry-over of the first object according to a preset object carry-over reminding strategy corresponding to the object type.

According to the first aspect, or any implementation manner of the first aspect, in a case that the first object is an electronic device, the alarming for the leaving of the first object according to a preset leaving object alarming policy corresponding to the object type includes: and (3) under the condition that the first alarming times do not reach the first threshold value, alarming in one or more early warning modes of flashing of the car lamp, whistling, display of a reminding message on the display screen in the car and voice broadcasting in the car according to the first time, and/or under the condition that communication connection with the first object is established, sending the first alarming information to wearable equipment worn by the first person through the first object.

According to the first aspect, or any implementation manner of the first aspect, in a case that the first object is a living object, according to a preset object carry-over reminding policy corresponding to an object type, carrying-over of the first object is alarmed, including: alarming in a warning mode of flashing or whistling of the car lamp according to the second duration, and/or sending second warning information to the electronic equipment of the first person under the condition that the electronic equipment of the first person is not left in the car is determined; and, in case that the alarm release instruction is not received beyond the second time period, alarming.

According to the first aspect, or any implementation manner of the first aspect, in a case that the first object is an off-body object other than an electronic device and a living object, according to a preset object carry-over reminding policy corresponding to an object type, carrying-over of the first object is alarmed, including: and (3) under the condition that the second alarming times do not reach the second threshold value, alarming by one or more early warning modes of flashing of the car lamp, whistling, display of a reminding message on the display screen in the car and voice broadcasting in the car according to the third duration, and/or under the condition that the electronic equipment of the first person is not left in the car, sending the third alarming information to the electronic equipment of the first person.

According to the first aspect, or any implementation manner of the first aspect, the method further includes: and stopping alarming after detecting that the vehicle is unlocked or receiving the alarming release instruction.

In some embodiments, after the vehicle occupant receives the carry-over object alert, the vehicle may be returned to take the carry-over object. Therefore, in the process of reminding according to the object carry-over strategy, the unlocking of the vehicle is detected, and the fact that the passengers return to solve the object carry-over problem can be determined. Then the carry-over object reminder may be stopped. Or, the person is inconvenient to retrieve the left-over object or the left-over object does not need to be retrieved in time, so that an alarm unlocking instruction can be sent to the vehicle-mounted terminal for instructing the vehicle-mounted terminal to stop alarming. Thus, a flexible legacy object alert mechanism is implemented.

In a second aspect, a vehicle-mounted terminal is provided. The vehicle-mounted terminal comprises: the device comprises a processor, a camera and a memory. Wherein the memory and the camera are coupled to the processor, the memory is configured to store computer program code, the computer program code comprising computer instructions that, when read from the memory by the processor, cause the vehicle terminal to perform: and determining the attribution of the object in the vehicle under the condition that the number of the personnel in the vehicle is at least one. A first person of the in-vehicle persons is detected to get off the vehicle. Responding to the getting-off of the first personnel, and alarming according to a preset object leaving reminding strategy under the condition that the object belonging to the first personnel remains in the car according to the object attribution.

According to a second aspect, determining an in-vehicle object attribution comprises: and acquiring an in-vehicle image. And determining a human body area corresponding to the in-vehicle personnel and an object area corresponding to the in-vehicle object in the in-vehicle image, and determining a human body label of the human body area. And establishing a attribution relation of the object region and the human body label corresponding to the human body region according to the distance between the object region and the human body region, wherein the attribution relation is used for representing attribution of the object corresponding to the object region.

According to a second aspect, or any implementation manner of the second aspect, the establishing, according to a distance between the object area and the human body area, a attribution relationship of a human body tag corresponding to the object area and the human body area includes: the Euclidean distance between the average coordinate position of the object region and the average coordinate position of the human body region, and the pixel depth distance between the average pixel depth of the object region and the average pixel depth of the human body region are determined. Determining a first human body region in the human body region nearest to the first object region in the object regions according to the sum of the Euclidean distance and the pixel depth distance; the first object region is an object region corresponding to a first object belonging to a first person, and the first person region corresponds to the first person. A first attribution relationship of the first object area and a first person tag of the first person area is established.

According to a second aspect, or any implementation manner of the second aspect, detecting that a first person out of the in-vehicle persons gets off the vehicle includes: and determining that the first person corresponding to the reduced human body labels gets off according to the reduction of the number of the human body labels.

According to a second aspect, or any implementation manner of the second aspect, the preset object leaving alert policy includes one or several of the following: reminding mode, reminding duration and reminding times; the reminding mode comprises one or more of the following: the car lamp blinks, the display screen in the car displays reminding information, the voice broadcast in the car and the reminding and alarming through the personnel electronic equipment in the car.

According to a second aspect, or any implementation manner of the second aspect, in response to the first person getting off, according to the object attribution, in a case that it is determined that an object attributed to the first person remains in the vehicle, alarming according to a preset object leave reminding policy includes: in response to the first person getting off, it is determined that the first object attributed to the first person remains in the vehicle based on the object attribution. Determining an object type of the first object; the object type includes any of the following: electronic equipment, living things, off-body objects other than electronic equipment and living things. And alarming the carry-over of the first object according to a preset object carry-over reminding strategy corresponding to the object type.

According to a second aspect, or any implementation manner of the second aspect, in a case where the first object is an electronic device, the alarming for the leaving of the first object according to a preset leaving-of-object alarming policy corresponding to the object type includes: and (3) under the condition that the first alarming times do not reach the first threshold value, alarming in one or more early warning modes of flashing of the car lamp, whistling, display of a reminding message on the display screen in the car and voice broadcasting in the car according to the first time, and/or under the condition that communication connection with the first object is established, sending the first alarming information to wearable equipment worn by the first person through the first object.

According to a second aspect, or any implementation manner of the second aspect, in a case that the first object is a living object, according to a preset object carry-over reminding policy corresponding to an object type, the method for alarming carry-over of the first object includes: alarming in a warning mode of flashing or whistling of the car lamp according to the second duration, and/or sending second warning information to the electronic equipment of the first person under the condition that the electronic equipment of the first person is not left in the car is determined; and, in case that the alarm release instruction is not received beyond the second time period, alarming.

According to a second aspect, or any implementation manner of the second aspect, in a case that the first object is an off-body object other than an electronic device and a living object, the alarming for the leaving of the first object according to a preset object leaving reminding policy corresponding to the object type includes: and (3) under the condition that the second alarming times do not reach the second threshold value, alarming by one or more early warning modes of flashing of the car lamp, whistling, display of a reminding message on the display screen in the car and voice broadcasting in the car according to the third duration, and/or under the condition that the electronic equipment of the first person is not left in the car, sending the third alarming information to the electronic equipment of the first person.

According to a second aspect, or any implementation manner of the second aspect, when the processor reads the computer readable instructions from the memory, the in-vehicle terminal is further caused to perform the following operations: and stopping alarming after detecting that the vehicle is unlocked or receiving the alarming release instruction.

The technical effects corresponding to the second aspect and any implementation manner of the second aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein.

In a third aspect, embodiments of the present application provide a vehicle comprising: the device comprises a processor, a camera and a memory. Wherein the memory and the camera are coupled to the processor, the memory being for storing computer program code, the computer program code comprising computer instructions which, when read from the memory by the processor, cause the vehicle to perform the method of the first aspect or any of the embodiments of the first aspect.

The technical effects corresponding to the third aspect and any implementation manner of the third aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, and are not described herein again.

In a fourth aspect, embodiments of the present application provide an electronic device, including: the device comprises a processor, a camera and a memory. Wherein the memory and the camera are coupled to the processor, the memory being for storing computer program code comprising computer instructions which, when read from the memory by the processor, cause the electronic device to perform the method of the first aspect or any of the embodiments of the first aspect.

The technical effects corresponding to the fourth aspect and any implementation manner of the fourth aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein.

In a fifth aspect, an embodiment of the present application provides a vehicle-mounted terminal, where the vehicle-mounted terminal has a function of implementing the method for reminding an object in a vehicle of preventing carryover as described in the first aspect and any one of possible implementation manners of the first aspect. The functions may be implemented by hardware, or by corresponding software executed by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

The technical effects corresponding to the fifth aspect and any implementation manner of the fifth aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein.

In a sixth aspect, a computer readable storage medium is provided. The computer readable storage medium stores a computer program (which may also be referred to as instructions or code) which, when executed by the in-vehicle terminal, causes the in-vehicle terminal to perform the method of the first aspect or any of the embodiments of the first aspect.

The technical effects corresponding to the sixth aspect and any implementation manner of the sixth aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein.

In a seventh aspect, embodiments of the present application provide a computer program product for causing an in-vehicle terminal to perform the method of the first aspect or any one of the embodiments of the first aspect when the computer program product is run on the in-vehicle terminal.

The technical effects corresponding to the seventh aspect and any implementation manner of the seventh aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein again.

In an eighth aspect, embodiments of the present application provide circuitry comprising processing circuitry configured to perform the first aspect or the method of any one of the embodiments of the first aspect.

The technical effects corresponding to any implementation manner of the eighth aspect and the sixth aspect may refer to the technical effects corresponding to any implementation manner of the first aspect and the first aspect, and are not described herein again.

In a ninth aspect, an embodiment of the present application provides a chip system, including at least one processor and at least one interface circuit, where the at least one interface circuit is configured to perform a transceiver function and send an instruction to the at least one processor, and when the at least one processor executes the instruction, the at least one processor performs the method of the first aspect or any implementation manner of the first aspect.

The technical effects corresponding to the ninth aspect and any implementation manner of the ninth aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, and are not described herein again.

Drawings

Fig. 1 is a schematic diagram of a communication system to which an in-vehicle object anti-carryover reminding method according to an embodiment of the present application is applied;

fig. 2 is a schematic hardware structure of a vehicle-mounted terminal according to an embodiment of the present application;

fig. 3 is a schematic view of an internal structure of a vehicle according to an embodiment of the present application;

fig. 4 is a schematic flow chart of a method for reminding an object in a vehicle of remaining in an embodiment of the present application;

fig. 5 is a second schematic flow chart of a method for reminding an object in a vehicle of remaining in an embodiment of the present application;

fig. 6 is a flowchart of a method for reminding an object in a vehicle of remaining in an embodiment of the present application;

FIG. 7 is a schematic diagram of an interface provided in an embodiment of the present application;

fig. 8 is a flowchart of a method for reminding an object in a vehicle of remaining in an embodiment of the present application;

fig. 9 is a flowchart of a method for reminding an object in a vehicle of remaining in an embodiment of the present application;

fig. 10 is a flowchart of a method for reminding an object in a vehicle of remaining in an embodiment of the present application;

Fig. 11 is a schematic structural diagram of a vehicle-mounted terminal according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application are described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, the terminology used in the embodiments below is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include, for example, "one or more" such forms of expression, unless the context clearly indicates to the contrary. It should also be understood that in the various embodiments herein below, "at least one", "one or more" means one or more than two (including two).

Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise. The term "coupled" includes both direct and indirect connections, unless stated otherwise. The terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

In the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as examples, illustrations, or descriptions. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

Fig. 1 is a schematic diagram of a communication system to which the in-vehicle object anti-carryover reminding method provided in the embodiment of the present application is applied. As shown in fig. 1, the communication system includes at least an in-vehicle terminal 100.

Alternatively, the in-vehicle terminal 100 may be a vehicle, an automobile, a car machine, or the like. The operating system installed in the in-vehicle terminal 100 includes, but is not limited toOr other operating system. The in-vehicle terminal 100 may not be equipped with an operating system. The specific type of the in-vehicle terminal 100, whether the operating system is installed, and the installed operating system are not limited in this application.

In some embodiments, the in-vehicle terminal 100 is capable of human-to-vehicle, vehicle-to-outside (vehicle-to-vehicle, vehicle-to-server) communication. For example, as shown in fig. 1, the communication system may further include an electronic device 200 and a server 300.

In some examples, the electronic device 200 is an electronic device carried by a person in the vehicle, and the vehicle-mounted terminal 100 can establish a wireless communication connection with one or more electronic devices 200 in the vehicle, so that when the vehicle-mounted terminal determines that a left object of a certain passenger exists in the vehicle, the vehicle-mounted terminal can send an alarm message to the passenger through the electronic device 200 of the passenger to prompt the passenger that the object of the passenger is left in the vehicle, and help the passenger to quickly find the left object.

Alternatively, the electronic device 200 is a terminal device such as a mobile phone, a wearable device, a tablet, an artificial intelligence (artificial intelligence, AI) device, or the like. The embodiments of the present application are not limited to a particular type of electronic device 200.

In some examples, the in-vehicle terminal 100 may alert the relevant departments through the server 300 when it is determined that the in-vehicle left-behind object is an object with vital signs such as a child or a pet, thereby reducing the risk of casualties.

Alternatively, the server 300 may be a device or network device having a computing function, such as a cloud server or a network server. The server 300 may be a server, a server cluster formed by a plurality of servers, or a cloud computing service center.

By way of example, fig. 2 shows a schematic structural diagram of the in-vehicle terminal 100.

The in-vehicle terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a wireless communication module 160, an audio module 170, a sensor module 180, keys 190, a motor 191, a lamp 192, a camera 193, a display 194, and the like.

It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the in-vehicle terminal 100. In other embodiments of the present application, the in-vehicle terminal 100 may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing function of in-vehicle terminal 100. The processor 110 and the display screen 194 communicate through a DSI interface to realize the display function of the in-vehicle terminal 100.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the in-vehicle terminal 100, or may be used to transfer data between the in-vehicle terminal 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other terminal devices, such as AR devices, etc.

It should be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is only illustrative, and does not limit the structure of the vehicle-mounted terminal 100. In other embodiments of the present application, the vehicle terminal 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.

The wireless communication function of the in-vehicle terminal 100 can be realized by an antenna, a wireless communication module 160, a modem processor, a baseband processor, and the like.

The antenna is used for transmitting and receiving electromagnetic wave signals. Each antenna in the in-vehicle terminal 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antennas may be multiplexed into diversity antennas of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., applied to the in-vehicle terminal 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via an antenna.

In some embodiments, the in-vehicle terminal 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the in-vehicle terminal 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

For example, as shown in the schematic internal structure of the in-vehicle terminal 100 of fig. 3, the camera 193 may include the camera 31 disposed at the front passenger's seat middle roof (e.g., mirror position). Alternatively, the in-vehicle terminal 100 may further include more cameras, such as the camera 32.

In some embodiments, when the vehicle terminal 100 determines that the vehicle is in a start state and the door is closed, the camera 193 may capture images of the vehicle according to a preset period, and the attribution relationship between the object and the person in the vehicle may be determined through image analysis and comparison. Thereafter, in the case where it is determined that the in-vehicle personnel is reduced, the in-vehicle terminal 100 may determine whether or not an object belonging to the reduced personnel is reserved in the in-vehicle terminal 100 according to the attribution relation.

The in-vehicle terminal 100 realizes a display function by a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may be manufactured using a liquid crystal display (liquid crystal display, LCD), for example, using an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (FLED), a Mini-led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the in-vehicle terminal 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

For example, there are some automobiles with gradually and fully digital display in the cabin, and one or more display screens are arranged in the cabin for displaying the contents of a digital instrument panel, a vehicle-mounted entertainment system and the like. As shown in fig. 3, a plurality of display screens, such as a center control screen 33 on a center console, a display screen 34 in front of a left rear passenger and a display screen 35 in front of a right rear passenger, are provided in the cabin. It will be appreciated that other displays may be included in the cabin, such as a display in front of the passenger in the co-driver's seat (also known as the front passenger), a dashboard, etc.

In some embodiments, in the case where the in-vehicle terminal 100 determines that the left-behind object exists in the vehicle and other people exist in the vehicle, a prompt message may be displayed through the display screen 194 to prompt the other people that the left-behind object exists in the vehicle. Thus, other people can timely process the left-over object according to the prompt information, and loss is avoided.

Optionally, in the case that the vehicle-mounted terminal 100 determines that the left object exists in the vehicle, the positions of other persons in the vehicle can be determined, and prompt information can be displayed on the display screen 194 corresponding to the persons, so that the persons can be helped to quickly notice the prompt information. For example, the in-vehicle terminal 100 determines that there is a left-behind object in the rear-row of the vehicle and that there is no passenger in the rear-row, and may display a prompt message on the center control screen 33 shown in fig. 3 to prompt the driver or the passenger in time and that there is a left-behind object in the rear-row.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to realize expansion of the memory capability of the in-vehicle terminal 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data (such as audio data, phonebook, etc.) created during use of the in-vehicle terminal 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 110 performs various functional applications and data processing of the in-vehicle terminal 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110. The in-vehicle terminal 100 may play, record, etc. music through the audio module 170. The audio module 170 may include a speaker, a receiver, a microphone, a headphone interface, an application processor, etc. to implement audio functions.

The vehicle lamp 192 may be used to instruct the vehicle terminal to turn, illuminate, etc.

In some embodiments, the in-vehicle terminal 100 may perform the left object reminder in a variety of ways upon determining that a left object is present in the vehicle. For example, the prompt message is displayed through the display 194, the prompt audio is played through the audio module 170, the vehicle lamp 192 blinks to prompt, etc.

The sensor module 180 may include a pressure sensor, a gyroscope sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

Touch sensors, also known as "touch devices". The touch sensor may be disposed on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, which is also referred to as a "touch screen". The touch sensor is used to detect a touch operation acting on or near it. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor may be disposed on the surface of the vehicle-mounted terminal 100 at a different location than the display 194.

The keys 190 include a side control key, a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The in-vehicle terminal 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the in-vehicle terminal 100.

The following describes in detail the method for reminding the in-vehicle object of leaving behind, which is provided in the embodiment of the present application, taking the in-vehicle terminal 100 as an example of the in-vehicle terminal.

Fig. 4 is a schematic flow chart of a method for reminding an object in a vehicle of being left behind according to an embodiment of the present application. As shown in fig. 4, the method includes the following steps.

S401, the vehicle-mounted terminal determines that the vehicle door is closed, and the vehicle is in a starting state.

In some embodiments, after the vehicle terminal is started, the vehicle door is determined to be closed, and it can be determined that the current environment in the vehicle is in a relatively static state, that is, the articles carried by the driver and the passengers are basically fixed. Then, the in-vehicle terminal can start to recognize the human body tag and the object attribution.

S402, the vehicle-mounted terminal determines the attribution of the object.

In some embodiments, the vehicle-mounted terminal may perform in-vehicle object recognition in a preset manner, so as to determine personnel, objects, and attribution relations of the personnel and the objects existing in the vehicle. Wherein, the personnel generally existing in the vehicle comprise drivers and passengers possibly existing in the vehicle, and the objects in the vehicle comprise articles carried by the personnel in the vehicle, living things (such as pets) and the like.

Optionally, the preset mode includes one or more modes of photographing identification, millimeter radar wave identification, bluetooth signal identification, wi-Fi signal identification, seat sensor identification, weighing component identification in a storage compartment in a vehicle door, and the like.

For example, the in-vehicle terminal acquires an in-vehicle image through the camera 193 shown in fig. 2, and then recognizes an in-vehicle object through an image recognition algorithm to determine the object attribution. It should be noted that, the image recognition algorithm may refer to the prior art, and the embodiment of the present application does not limit this.

The vehicle-mounted terminal detects faces of images in the vehicle to determine the number of people in the vehicle. Further, the vehicle-mounted terminal can confirm the ages of the people in the vehicle through face detection, for example, the people with the ages greater than the preset ages (such as 12 years) and the people with the ages less than or equal to the preset ages are distinguished. In addition, the image in the vehicle is subjected to semantic segmentation through an image recognition algorithm, so that the areas corresponding to a human body, a pet, electronic equipment (such as a mobile phone and the like), a body-separated object and the like and the intrinsic area in the vehicle (namely, the area corresponding to an object existing in the vehicle before the vehicle is in a starting state) can be distinguished, the segmented areas are marked, the human body area corresponding to a person with the age higher than the preset age is determined, and corresponding human body labels such as P1, P2 and P3 and the like are marked. Wherein, the human body label of the human body area corresponding to the driver is marked as P1.

Thereafter, the in-vehicle terminal may establish a attribution relationship between the human body tag and the other object (i.e., determine the object attribution). Optionally, the vehicle-mounted terminal can determine the attribution relationship between the object and the human body label according to the distance between the object and the human body label marking area.

For example, the vehicle-mounted terminal can determine the Euclidean distance E1 between the average coordinate position of each object region and the average coordinate position of the human body region in the image through an image recognition algorithm. And the vehicle-mounted terminal can determine the depth information of objects in the vehicle image through an image recognition algorithm, obtain depth maps of different pixel positions, and further determine the distance E2 between the average depth of each object area in the depth maps and the average depth of the human body area. Then, the in-vehicle terminal may determine a distance e=e1+e2 between the object and the human body, and mark the object corresponding to the object region closest to the human body region as the object belonging to the human body region. Namely, the distance E between each object area and each human body area is calculated, under the condition that the distance E is minimum, the object corresponding to the object area can be determined to be marked and attributed to the human body area corresponding to the minimum distance E, and the vehicle-mounted terminal can establish the attribution relation between the object and the human body label of the human body area.

Optionally, in the distance calculating process, the area corresponding to the person with the age less than or equal to the preset age is attributed to the human body area nearest to the person. Or, attributing the areas corresponding to the pets in the vehicle and the people with the ages less than or equal to the preset ages to the human body areas corresponding to the drivers, namely attributing to P1.

For another example, the vehicle-mounted terminal determines the outline of the object in the vehicle through millimeter radar waves, so as to identify the human body in the vehicle and determine the attribution of the object close to the human body.

For another example, if the vehicle-mounted terminal provides a Wi-Fi local area network in the vehicle, the vehicle-mounted terminal can determine the number of electronic devices in the vehicle according to the electronic devices connected to the Wi-Fi local area network. Alternatively, the vehicle terminal may determine the number of electronic devices present in the vehicle by scanning in-vehicle signals (e.g., bluetooth signals, mobile communication signal lights).

For another example, the in-vehicle terminal can recognize the number of passengers by the seat sensor.

For another example, the vehicle terminal determines whether a person in the vehicle places an object in the storage compartment through a weight change detected by a weighing part in the storage compartment in the vehicle door. If the vehicle-mounted terminal determines that the weight of the object in a certain storage grid is increased compared with the weight of the object in the storage grid before the vehicle door is closed and the vehicle is in a starting state, the vehicle-mounted terminal can determine that the person in the vehicle places own articles in the storage grid. And, on-vehicle terminal has confirmed under the circumstances that the object has been placed in the storing check, can be directly according to the position of storing check, confirm the attribution of the object in this storing check. Such as objects in a storage compartment on the passenger door, may be attributed to the passenger.

Thus, the vehicle-mounted terminal can determine the attribution of the object in the vehicle through the various modes or the combination of the various modes.

In some embodiments, the in-vehicle object attribution relationship may change, and the vehicle terminal may periodically perform in-vehicle object identification according to the time interval T1, so as to determine the object attribution.

For example, after the vehicle-mounted terminal establishes the attribution relation between the passenger a and the object 1 at the time point 1, the passenger a gives the object 1 to the passenger B, and the attribution of the object 1 changes. Then, at a time point 2 spaced from the time point 1 by a time interval T1, the vehicle-mounted terminal determines the attribution of the object again, and the attribution of the object 1 can be modified to establish the attribution relationship between the passenger B and the object 1. Therefore, the attribution of the object in the vehicle is guaranteed to accord with the actual situation, and the accuracy of the follow-up object leave-behind reminding is guaranteed.

In some embodiments, the vehicle may be a private car, a taxi, etc. and the person in the vehicle may change during the driving process, such as getting off the vehicle, getting on the vehicle, etc. Then, the in-vehicle terminal can perform in-vehicle object recognition once to determine whether the body tag of the vehicle body has changed or not even if the detection period has not been reached, in the case where the vehicle is in the start state after each determination of the opening and closing of the door (i.e., step S401 described above). If the human body label is increased, the vehicle-mounted terminal can determine the attribution of the newly added human body label and the corresponding object.

In some embodiments, the vehicle-mounted terminal may establish a communication connection with an electronic device (such as a mobile phone, a tablet, etc.) in the vehicle, and the vehicle-mounted terminal may obtain an object attribution result determined by the electronic device. Alternatively, the electronic device may be the driver's electronic device or the passenger's electronic device. The electronic device may determine the object attribution by one or more methods of the above examples, or the in-vehicle terminal and the electronic device may together determine the object attribution.

S403, the vehicle-mounted terminal determines that the number of the human body tags in the vehicle is reduced. If yes, go to step S404; if not, go to step S402.

In some embodiments, the in-vehicle terminal may capture an in-vehicle image after determining that the door is open and closed. And then, the vehicle-mounted terminal determines whether the number of the human body tags in the vehicle is reduced according to the image in the vehicle, namely, whether the person in the vehicle gets off the vehicle.

In some embodiments, the in-vehicle terminal determines whether the number of human body tags is reduced during the running of the vehicle. If the number of human body tags is reduced, it can be determined that there is a person getting off the vehicle, it is necessary to determine whether there is an object left in the vehicle by the getting off person (i.e., to perform step S404 described below). If the number of human body tags is not reduced, it may be determined that no person gets off the vehicle, and then the above-described step S402 may be returned, and the object attribution may be continuously determined at the time interval T1.

In some embodiments, as described in the above step S402, the vehicle-mounted terminal may determine the object attribution by photographing, and in this process, mark the area corresponding to the person in the vehicle to determine the body tag. Then, the vehicle-mounted terminal can determine the change of the number of the human body tags in the process of photographing and image analysis according to the time interval T1. Optionally, in order to avoid false detection of the algorithm caused by the shielding problem, the vehicle-mounted terminal may combine the multiple acquired images to analyze, determine that the number of the human body tags detected in the multiple images is reduced, and finally determine that the number of the human body tags in the vehicle is reduced, so as to trigger the following step S404. The number of images applied in the process of analyzing the plurality of images may be an empirical value or an experimental value, and the embodiment of the present application is not particularly limited. Optionally, the vehicle-mounted terminal may increase the image acquisition frequency within a preset time after the first detection of the decrease of the human body tags, so as to confirm whether the number of the human body tags in the vehicle is actually decreased.

The decrease in the number of human body tags in the vehicle indicates a decrease in the number of human body tags that have been marked by the vehicle-mounted terminal. For example, the number of the human body labels in the vehicle is 4, and one person gets off the vehicle in the subsequent midway and one person gets off the vehicle at the same time. Then, the in-vehicle terminal may determine that the number of in-vehicle human body tags is reduced by one, and newly increase the number of human body tags by one. In this process, the vehicle-mounted terminal needs to execute step S404 described below to determine whether the reduced body tags have corresponding legacy objects that need to be reminded.

S404, the vehicle-mounted terminal judges whether a left object exists. If yes, go to step S405; if not, go to step S402.

In some embodiments, in the case that the number of the in-vehicle body tags is reduced, the in-vehicle terminal determines whether there is a left-behind object in the vehicle according to the attribution of the object. If there is a left object, the following step S405 may be performed to perform a left object reminder. If there is no remaining object, the above-mentioned step S402 may be performed in return, and the object attribution continues to be determined, i.e. the number of human body tags is reduced at this time without performing a remaining object reminder.

The vehicle-mounted terminal determines that the reduced objects corresponding to the human body tags exist in the vehicle according to the attribution of the objects. For example, the passenger a and the object 1 have a home relationship. The vehicle-mounted terminal determines that the number of human body tags in the vehicle is reduced through the image in the vehicle, and the reduced human body tags are used for marking the area corresponding to the passenger A. And then, the vehicle-mounted terminal determines whether an object with a attribution relation with the human body label of the passenger A exists in the vehicle according to the image in the vehicle, and if the object exists, the vehicle-mounted terminal can determine that the left object exists in the vehicle. For example, the in-vehicle terminal determines that the object 1 is still in the vehicle, and may determine that a remaining object, that is, the object 1, is present in the vehicle.

S405, the vehicle-mounted terminal reminds according to the object carry-over reminding strategy.

In some embodiments, the object carry-over alert policy includes one or more alert manners, alert durations, alert times, and the like. Optionally, the reminding mode includes, for example, flashing a car light, whistling, displaying a reminding message on a display screen in the car, voice broadcasting in the car, reminding by personnel electronic equipment in the car, alarming and the like.

In some embodiments, the vehicle-mounted terminal may use different object leave strategies to carry out leave object reminding according to different object types. Alternatively, the in-vehicle objects may be classified into electronic devices (cell phones, tablets, wearable devices, etc.), living things (e.g., children, pets), and other off-body objects.

It should be noted that, the specific method for reminding the remaining object is described in detail in fig. 6 below, and will not be described here again.

Optionally, in some scenarios, the vehicle-mounted terminal detects that the vehicle is unlocked, may determine that the legacy item is taken away, and may end the reserved object alert.

In some embodiments, the vehicle-mounted terminal may establish a communication connection with an electronic device (e.g., a mobile phone, a tablet, etc.) in the vehicle, and the vehicle-mounted terminal may alert an operator of a problem with the object left in the vehicle via the electronic device. Alternatively, the electronic device may be the driver's electronic device or the passenger's electronic device.

In some examples, the electronic device may determine that there is a carry-over object within the vehicle, alert an in-vehicle adult of the carry-over problem by an audio module, motor, or the like of the electronic device. The method for determining that the vehicle has the remaining object and the alarm by the electronic device may refer to the method for determining that the vehicle has the remaining object and the alarm by the vehicle-mounted terminal in the embodiment of the present application, which is not described herein.

In other examples, the vehicle-mounted terminal may send a prompt instruction to the electronic device when determining that the object leaving prompt is needed, and the electronic device prompts the vehicle-mounted member of the object leaving problem through an audio module, a motor and the like of the electronic device according to the prompt instruction.

Fig. 5 is a schematic flow chart of another method for reminding an object in a vehicle of being left behind according to an embodiment of the present application. As shown in fig. 5, after step S405, step S501 may be included.

S501, the vehicle-mounted terminal determines whether the vehicle is unlocked. If the left object is unlocked, ending the reminding process of the left object; if not, the process returns to step S404.

In some embodiments, after the vehicle occupant receives the carry-over object alert, the vehicle may be returned to take the carry-over object. Therefore, the vehicle-mounted terminal detects the unlocking of the vehicle in the process of reminding according to the object carry-over strategy, and can determine that the passengers return to solve the object carry-over problem. Then the in-vehicle terminal may stop the legacy object alert this time. Or under the condition that the vehicle unlocking operation is not detected, the vehicle-mounted terminal can continuously remind according to the object leaving strategy, so that a flexible leaving object alarming mechanism is realized.

In some embodiments, as shown in fig. 5, in step S404, the vehicle-mounted terminal determines that no remaining object exists in the vehicle, and may directly end the remaining object detection process triggered by the reduced number of human body tags in the vehicle. And when the vehicle-mounted terminal waits for the next time that the vehicle-mounted terminal determines that the number of the human body labels in the vehicle is reduced again, starting a next legacy object detection flow.

Therefore, the vehicle-mounted terminal can determine the change of the human body tag in the vehicle according to the existing configuration (such as a camera and the like) in the vehicle, and whether the left-over object exists in the vehicle or not is determined in real time. Therefore, the vehicle-mounted terminal can prompt passengers in time that objects remain, and the influence of the objects remain on the passengers is reduced.

The following takes electronic equipment in an object in a car as a mobile phone as an example, and describes the object carry-over reminding process in detail.

Fig. 6 is a schematic flow chart of another method for reminding an object in a vehicle of being left behind according to an embodiment of the present application. As shown in fig. 6, according to the classification of the objects in the vehicle, the method can be classified into a mobile phone reminding process, a living matter reminding process and other off-body object reminding processes. The method comprises the following steps.

S601, the vehicle-mounted terminal determines whether a mobile phone is left in the vehicle. If yes, go to step S602; if not, go to step S607.

In some embodiments, the vehicle-mounted terminal determines that the in-vehicle legacy object exists in the vehicle by the method described in step S404 above, and may determine that the in-vehicle legacy object includes a mobile phone, then the mobile phone legacy alert step described in step S602-step S606 below may be performed. Or, the vehicle-mounted terminal determines that no mobile phone remains in the vehicle, and may execute step S607 to continuously determine whether other objects remain in the vehicle.

It should be noted that, the embodiment of the present application does not limit the order of the left-behind reminding of the different types of objects, that is, does not limit the execution order of step S601, step S607, and step S612. For example, as shown in fig. 6, the vehicle-mounted terminal may determine whether a mobile phone is left in the vehicle in step S601, determine whether a living object is left in the vehicle in step S607, and determine whether other off-body objects are left in the vehicle in step S612. For example, the vehicle-mounted terminal determines whether a mobile phone, a living object and other objects leaving the body in the vehicle at the same time, and reminds passengers of leaving the objects through an object leaving reminding strategy corresponding to the type of the left objects under the condition that the left objects exist in the vehicle. This will not be described further below.

In addition, according to the embodiment of the application, corresponding object carry-over reminding strategies are set according to classification modes of mobile phones, living things and other off-body objects. It can be understood that the vehicle-mounted terminal can set the corresponding object leave-behind reminding strategy according to other object classification modes. For example, the vehicle-mounted terminal divides the objects into living objects and non-living objects according to the types of the objects, and sets corresponding object carry-over reminding strategies.

S602, the vehicle-mounted terminal determines whether a mobile phone left-behind warning frequency threshold is reached. If yes, go to step S607; if not, step S603 is performed.

In some embodiments, a threshold number of mobile phone legacy alert times is preset in the vehicle-mounted terminal. And under the condition that the vehicle-mounted terminal determines that the in-vehicle left-behind object comprises the mobile phone, carrying out mobile phone left-behind alarm according to the mobile phone left-behind alarm frequency threshold.

If the vehicle-mounted terminal determines that the number of mobile phone left-behind alarms is equal to the threshold number of mobile phone left-behind alarms, it may be determined that the passenger does not notice the alarms or the passenger is inconvenient to return to take out the mobile phone, then the vehicle-mounted terminal may stop the mobile phone left-behind alarms (i.e. execute step S607).

If the number of mobile phone legacy alarms is less than the threshold number of mobile phone legacy alarms, the vehicle-mounted terminal may continue to alarm (i.e. execute step S603), and increment the recorded number of alarms by one.

It should be noted that, the threshold value of the number of times of mobile phone legacy alarms may not be preset in the vehicle-mounted terminal. The vehicle-mounted terminal can carry out mobile phone carry-over alarming according to the object carry-over alarming strategy all the time under the condition that the passengers do not confirm to stop alarming. That is, step S602 is an optional step.

S603, the vehicle-mounted terminal alarms according to the time T2.

In some embodiments, the vehicle-mounted terminal may perform the mobile phone legacy alert at the time T2 according to a preset alert manner when determining that the number of mobile phone legacy alerts is less than the threshold number of mobile phone legacy alerts.

For example, as described in the above step S405, the reminding mode includes, for example, flashing of a car light, whistling, displaying of a reminding message on an in-car display screen, in-car voice broadcasting, and the like.

For example, as shown in fig. 7, the vehicle-mounted terminal determines that a mobile phone is left in the vehicle, and prompts the driver that a passenger left object exists in the vehicle through the central control screen display interface 701, so that the driver can contact the passenger in time, and the mobile phone of the passenger is prevented from being lost.

Also exemplary, the vehicle-mounted terminal determines that a mobile phone is left in the vehicle, and a person corresponding to an area where a human body tag mark does not exist in the vehicle (such as a private car, after the vehicle-mounted terminal determines that a vehicle is flameout, a passenger possibly does not exist in the vehicle), and prompts the passenger getting off the vehicle in a manner of flashing and whistling through a car lamp, so that the mobile phone is left in the vehicle, and the passenger can find the left mobile phone in time.

S604, the vehicle-mounted terminal determines whether to establish communication connection with the legacy mobile phone. If yes, go to step S605; if not, go to step S606.

In some embodiments, the in-vehicle terminal may establish a communication connection with an in-vehicle passenger's electronic device (e.g., a cell phone, etc.). Then, the in-vehicle terminal may alert through the electronics of the occupant.

For example, after a passenger gets on a car, the mobile phone can be connected into a Wi-Fi local area network provided by the vehicle-mounted terminal. Alternatively, the vehicle-mounted terminal may establish a bluetooth connection with the mobile phone to play music or the like in the mobile phone. Or the vehicle-mounted terminal and the mobile phone establish communication connection through Ultra Wide Band (UWB) technology. Or the vehicle-mounted terminal and the mobile phone are connected in a wired mode.

Then, the in-vehicle terminal may determine whether a communication connection is established with the mobile phone in a case where it is determined that the in-vehicle legacy object includes the mobile phone. If a communication connection has been established, an alert message may be sent to the owner via the handset over the communication connection (i.e., step S605 is performed). If no communication connection is established, step S606 described below may be performed.

S605, the vehicle-mounted terminal sends alarm information to the wearable equipment which is in communication connection with the mobile phone through the mobile phone.

In some embodiments, the types of electronic devices owned by passengers are increasing, and the mobile phones of passengers generally establish communication connection with the wearable devices worn by the passengers, so that the wearable devices cannot be left behind under the condition that the mobile phones are left in the vehicle due to the fact that the wearable devices need to be worn on the bodies of the passengers. Therefore, the vehicle-mounted terminal can send indication information to the legacy mobile phone under the condition that the communication connection is established with the legacy mobile phone, wherein the indication information is used for indicating the mobile phone to send alarm information to the wearable device which is in communication connection with the mobile phone.

Then, correspondingly, after receiving the indication information, the mobile phone determines whether the wearable device connected with the mobile phone exists or not, and determines whether the wearable device connected with the mobile phone is in a communication range or not. The mobile phone can send alarm information to the wearable device under the condition that the wearable device exists in the communication range. After receiving the alarm information, the wearable device can display the alarm information and prompt passengers to confirm the alarm information in various modes such as vibration, lamplight flashing, audio reminding and the like.

Or after receiving the indication information, the mobile phone can feed back an alarm information sending failure signal to the vehicle-mounted terminal under the condition that the wearable equipment does not exist in the communication range. According to the signal, the vehicle-mounted terminal can determine that the mode of sending the alarm information through the mobile phone fails, so that the alarm information can be unnecessary to be sent to the mobile phone in the follow-up process.

Optionally, the warning information includes information such as a picture, position information, etc. of the left object, so that the passengers can confirm the left object conveniently.

Therefore, passengers can timely determine that the mobile phone is left in the car through the wearable equipment at the side, the passengers can conveniently and timely retrieve the left mobile phone, loss is avoided, and accordingly the use experience of the passengers is improved.

In some embodiments, after determining a human body tag having a home relationship with a legacy cell phone, the vehicle-mounted terminal determines that a wearable device of a passenger corresponding to the human body tag has established a connection, and that the connection between the wearable device and the wearable device is not currently broken (i.e., the wearable device leaves the vehicle with the passenger but is within a communicable range of the vehicle-mounted terminal in the vicinity of the vehicle). Then, the vehicle-mounted terminal can directly send alarm information to the wearable device, so that the problem of carrying a mobile phone in a vehicle is notified to passengers. That is, in the above-described step S604 and step S605, if the in-vehicle terminal determines that the communication connection has been established with the wearable device corresponding to the same human body tag of the legacy mobile phone, it may no longer be necessary to determine whether the communication connection is established with the legacy mobile phone or not, and it may no longer be necessary to send the alarm information to the wearable device via the mobile phone.

It should be noted that, the embodiment of the present application does not limit the execution sequence of the steps S602-S603 and the steps S604-S605. That is, the vehicle-mounted terminal may alarm according to the time T2 first, and then alarm through the legacy phone (i.e. step S602-step S603 is executed first, and then step S604-step S605 is executed). Alternatively, the vehicle-mounted terminal may alarm through the legacy phone first and then alarm according to the time T2 (i.e., step S604-step S605 are executed first and then step S602-step S603 are executed). Alternatively, the vehicle-mounted terminal may also alarm through the legacy phone during the alarm process according to the time T2 (i.e. execute steps S602-S603 and steps S604-S605 simultaneously).

In addition, step S604 and step S605 are optional steps, and the vehicle-mounted terminal may also directly alarm through a module (such as a car light, an audio module, etc.) configured by the vehicle-mounted terminal, without prompting through a mobile phone of a driver. Or, the vehicle-mounted terminal may directly alarm through the mobile phone without alarming through a module configured by the vehicle-mounted terminal itself (i.e. step S603 may also be an optional step) when determining that communication connection is established with the legacy mobile phone.

S606, the vehicle-mounted terminal determines whether the vehicle is unlocked. If the left object is unlocked, ending the reminding process of the left object; if not, the process returns to step S601.

Optionally, the content of step S606 may refer to the related content of step S501, which is not described herein.

S607, the vehicle-mounted terminal determines whether living things remain in the vehicle. If yes, go to step S608; if not, go to step S612.

In some embodiments, the vehicle-mounted terminal determines that the in-vehicle legacy object exists through the method described in the above step S404, and may determine that the in-vehicle legacy object includes a living thing (such as a child or a pet), then the living thing legacy alert step described in the following step S608 to step S611 may be performed. Alternatively, the in-vehicle terminal determines that no living thing remains in the vehicle, and may perform step S612 to determine whether other off-body objects remain in the vehicle.

S608, the vehicle-mounted terminal determines whether a false detection indication is received. If yes, go to step S612; if not, go to step S609.

In some embodiments, there may be a change in the object attribution of the living being as the living being is movable within the vehicle. Therefore, there is a possibility that false detection occurs in the detection of the living things left in the vehicle, and it is necessary for the passenger to confirm whether or not the living things left in the vehicle are false detected. For example, a person getting off takes a living thing belonging to the person and takes care of the person not getting off; alternatively, during the travel of the vehicle, the living being is in the vicinity of the person who is getting off, but the living being is not actually attributed to the person who is getting off.

If the vehicle-mounted terminal receives the false detection indication, the vehicle-mounted terminal can determine that the detected living things remain as false detection at the moment, and warning is not needed. If the in-vehicle terminal does not receive the false detection indication, step S612 may be executed to determine whether other objects remain in the vehicle.

Optionally, the vehicle-mounted terminal may instruct the passenger to confirm whether to perform false detection by sending an alarm message to the mobile phone corresponding to the body tag having the home relation with the legacy living matter in step S611 described below. The specific content can be seen from the related content described in step S611, and will not be described herein.

Alternatively, the vehicle-mounted terminal may also determine whether there is false detection of the remaining living thing in other manners. For example, as shown in fig. 7, the vehicle-mounted terminal displays a prompt message through the central control screen to prompt the passengers to confirm the possible legacy. After detecting the operation of clicking the control 71 by the passenger, the vehicle-mounted terminal can determine that a false detection indication is received, and stop the living thing left-over alarming flow.

The false detection indication may also be used to indicate that the occupant has confirmed that the object remains. For example, a living matter is left in the vehicle, and the vehicle-mounted terminal does not misdetect, but a person getting off the vehicle confirms that the living matter is delivered to other passengers in the vehicle for storage. Then, the vehicle-mounted terminal receives the confirmation instruction and can stop the living thing left-over alarming flow.

S609, the vehicle-mounted terminal alarms according to the time T3, and overtime alarms.

In some embodiments, the vehicle-mounted terminal carries out the living thing left-over alarm in the time of T3 according to a preset reminding mode. The life safety of the living things is possibly influenced by the living things, so that the vehicle-mounted terminal does not detect an operation of releasing the alarm of the living things after determining the alarm exceeding the time T3 (such as detecting unlocking of a vehicle), and damage to the living things can be reduced in a warning mode.

For example, as described in the above step S405, the reminding mode includes, for example, flashing of a car light, whistling, and the like.

S610, the vehicle-mounted terminal determines whether a person who leaves the living thing leaves a mobile phone. If yes, go to step S606; if not, step S611 is performed.

S611, the vehicle-mounted terminal sends alarm information to the mobile phone.

In some embodiments, in step S610 and step S611, the in-vehicle terminal may determine a human body tag having a home relation with the legacy living thing, and then determine whether a mobile phone having a home relation with the human body tag exists in the vehicle (i.e., determine whether a person who has a legacy living thing has a mobile phone).

If no mobile phone exists, the mobile phone is not left by the person leaving the living things, and the vehicle-mounted terminal can send alarm information to the mobile phone to prompt the person of the living things leaving problem (i.e. step S611 is performed after step S610). Optionally, as described in the above step S604, the vehicle-mounted terminal may establish a communication connection with the mobile phone of the person, and then, in the communicable range, the vehicle-mounted terminal may send an alarm message to the mobile phone.

Optionally, when the mobile phone has moved outside the vehicle along with the passenger but is within the communication range, the vehicle-mounted terminal sends alarm information to the mobile phone for indicating the mobile phone to display the alarm information, so that the passenger can directly confirm whether the living things remain in the vehicle through the mobile phone. Optionally, the mobile phone can prompt passengers to pay attention to the alarm information in time in various modes such as vibration, lamplight flickering and audio reminding. Optionally, the warning information includes information such as a picture, a video, position information and the like of the left object, so that the passengers can confirm the left object conveniently.

If a mobile phone exists, a person who indicates that a living thing remains also leaves the mobile phone, and after executing step S610, the vehicle-mounted terminal executes step S606 to determine whether the vehicle is unlocked.

In some embodiments, the warning information sent by the vehicle-mounted terminal to the mobile phone is also used for prompting a passenger to determine whether to perform false detection. Thereby avoiding the alarm timeout alarm in step S609 described above.

In other embodiments, the vehicle-mounted terminal determines a human body tag having a home relation with a legacy living object in the vehicle under the condition of determining the legacy living object. After that, the vehicle-mounted terminal determines that the mobile phone having the attribution relation with the human body tag is also left in the vehicle, and as the vehicle-mounted terminal determines that the mobile phone is left in the vehicle, the vehicle-mounted terminal can also send alarm information to the wearable equipment of the passengers through the mobile phone, so that the problem of leaving objects of the passengers is prompted. That is, after determining that the occupant who has left the living thing also left the cellular phone in step S610, if it is confirmed that the communication connection is established with the cellular phone, the vehicle-mounted terminal may also perform step S611.

It should be noted that, the embodiment of the present application does not limit the execution sequence of the step S609 and the step S610-the step S611. That is, the vehicle-mounted terminal may alarm according to the time T3, and then alarm through the mobile phone (i.e. execute step S609 first and then execute steps S610-S611). Alternatively, the vehicle-mounted terminal may alarm through the mobile phone first and then alarm according to the time T3 (i.e. step S610-step S611 are executed first and then step S609 is executed). Alternatively, the vehicle-mounted terminal may also alarm through the mobile phone during the process of alarming according to the time T3 (i.e. execute step S609 and step S610-step S611 simultaneously).

In addition, step S610 and step S611 are optional steps, and the vehicle-mounted terminal may also directly alarm through a module (such as a car light, an audio module, etc.) configured by the vehicle-mounted terminal itself, without alarming through a mobile phone of a driver. Or, the vehicle-mounted terminal may directly alarm through the mobile phone without alarming through a module configured by the vehicle-mounted terminal itself when determining that the communication connection is established with the mobile phone (i.e. step S609 may also be an optional step).

S612, the vehicle-mounted terminal determines whether other off-body objects remain in the vehicle. If yes, go to step S613; if not, ending the reminding process of the left object.

In some embodiments, the vehicle-mounted terminal determines that the in-vehicle left object exists by the method described in step S404 above, and may determine that the in-vehicle left object includes other away objects other than the mobile phone and the living matter, then the other away object left reminding step described in step S613-step S617 below may be performed. Or the vehicle-mounted terminal determines that other away objects are not left in the vehicle, and the reminding process of the left objects can be finished.

S613, the vehicle-mounted terminal determines whether a processing-free instruction is received. If yes, ending the reminding process of the left object; if not, go to step S614.

In some embodiments, some in-vehicle left-behind objects may be of less importance, with no urgent handling or handling required by the occupants. Then, the occupant may indicate that the legacy object detected by the in-vehicle terminal this time does not need to be processed. Then, the vehicle-mounted terminal can end the reminding process of the left object after receiving the indication of no need of processing. Alternatively, if the in-vehicle terminal does not receive the no-need-for-processing instruction, the following step S614 may be executed, and the legacy object reminding process may be started.

The confirmation instruction may be expressed without processing the instruction. After knowing the problem left by the vehicle occupant of his off-body object, a confirmation indication may be sent to the vehicle-mounted terminal to indicate that the vehicle occupant has confirmed the problem.

S614, the vehicle-mounted terminal determines whether the person leaving other away objects leaves the mobile phone. If yes, go to step S616; if not, go to step S615.

S615, the vehicle-mounted terminal sends alarm information to the mobile phone.

In some embodiments, in step S614 and step S615, the in-vehicle terminal may determine a human body tag having a home relation with the remaining other away object, and then determine whether a cellular phone having a home relation with the human body tag exists in the vehicle (i.e., determine whether a passenger who remains the other away object remains the cellular phone).

If no handset is present, indicating that no handset is left by the occupant leaving other objects away, the vehicle-mounted terminal may send an alarm message to the handset to prompt the occupant of the problem of leaving other objects away (i.e., step S615 is performed after step S614). Optionally, in step S604, the vehicle-mounted terminal and the mobile phone of the passenger can be connected in a communication manner, and then the vehicle-mounted terminal can send alarm information to the mobile phone within a communication range.

Optionally, when the mobile phone has moved outside the vehicle along with the occupant but is within a communication range, the vehicle-mounted terminal sends alarm information to the mobile phone, so as to instruct the mobile phone to display the alarm information, thereby facilitating the occupant to directly confirm whether other away objects remain in the vehicle or not and whether the remaining other away objects need to be processed through the mobile phone. Optionally, the mobile phone can prompt passengers to pay attention to the alarm information in time in various modes such as vibration, lamplight flickering and audio reminding. Optionally, the warning information includes information such as a picture, a video, position information and the like of the left object, so that the passengers can confirm the left object conveniently.

If a mobile phone exists, the mobile phone is left by the passenger who indicates that the living things remain, the vehicle-mounted terminal executes step S616 after executing step S614, and the vehicle-mounted terminal alarms.

In some embodiments, the warning information sent by the vehicle-mounted terminal to the mobile phone is also used for prompting a passenger to determine whether the away object needs to be processed. After the vehicle-mounted terminal sends the alarm information to the mobile phone, the above step S613 may be executed again to confirm whether the no-processing instruction is received.

In other embodiments, the vehicle-mounted terminal determines a human body tag having a home relation with the remaining other away object in the vehicle under the condition that the remaining other away object is determined. After that, the vehicle-mounted terminal determines that the mobile phone having the attribution relation with the human body tag is also left in the vehicle, and as the vehicle-mounted terminal determines that the mobile phone is left in the vehicle, the vehicle-mounted terminal can also send alarm information to the wearable equipment of the passengers through the mobile phone, so that the problem of leaving objects of the passengers is prompted. That is, after determining that the occupant who left other objects away also leaves the cellular phone in step S614, if it is confirmed that the communication connection is established with the cellular phone, the vehicle-mounted terminal may also execute step S615.

S616, the vehicle-mounted terminal determines whether the threshold value of the number of times of leaving alarms of other objects is reached. If yes, ending the reminding process of the left object; if not, go to step S617.

In some embodiments, a threshold value of the number of times of leaving alarms of other objects is preset in the vehicle-mounted terminal. And under the condition that the vehicle-mounted terminal determines that the in-vehicle leaving object comprises other leaving objects, carrying out other leaving object leaving alarms according to the threshold value of the leaving alarm times of the other leaving objects.

If the vehicle-mounted terminal determines that the number of other leaving object alarms is equal to the threshold number of other leaving object alarms, the vehicle-mounted terminal can determine that the vehicle occupant does not notice the alarms or the vehicle occupant is inconvenient to return to take out other leaving objects, and can stop other leaving object alarms, if the leaving object reminding process is finished.

If the vehicle-mounted terminal determines that the number of remaining alarms of other away objects is smaller than the threshold number of remaining alarms of other away objects, the vehicle-mounted terminal may continue to alarm (i.e. execute step S617), and add one to the recorded number of alarms.

It should be noted that, the threshold value of the number of times of leaving an alarm of other objects can be not preset in the vehicle-mounted terminal. Under the condition that the passengers do not confirm the stop alarm, the vehicle-mounted terminal can always carry out other leaving object alarm according to the object leaving reminding strategy. That is, step S616 is an optional step.

S617, the vehicle-mounted terminal alarms according to the time T4.

In some embodiments, the vehicle-mounted terminal may perform the other leaving object alert for T4 time according to the preset alert mode when determining that the number of leaving alert times of other leaving objects is less than the threshold number of leaving alert times of other leaving objects.

For example, as shown in fig. 7, the vehicle-mounted terminal determines that other objects left in the vehicle are left in the vehicle, and prompts the driver that the passengers leave in the vehicle through the display interface 701 of the central control screen, so that the driver can contact the passengers in time, and the passengers are prevented from losing other objects left in the vehicle.

Also exemplary, the vehicle-mounted terminal determines that other objects away from the vehicle are left in the vehicle, and personnel marked by human body labels do not exist in the vehicle (such as private cars, after the vehicle-mounted terminal determines that the vehicle is flameout, personnel possibly do not exist in the vehicle), and the personnel getting off the vehicle can be prompted by means of flashing car lights and whistling, and the other objects away from the vehicle are left in the vehicle, so that the personnel can conveniently and timely retrieve the left other objects away from the vehicle.

Thereafter, as shown in fig. 6, the vehicle-mounted terminal may execute step S606, and after determining that the vehicle is unlocked, the alarm process of leaving other away objects at this time may be ended.

It should be noted that, the embodiment of the present application does not limit the execution sequence of the steps S614-S615 and the steps S616-S617. That is, the vehicle-mounted terminal may alarm through the legacy phone first, and then alarm according to the time T4 (i.e., step S614-step S615 are executed first, and then step S616-step S617 are executed). Alternatively, the vehicle-mounted terminal may alarm according to the time T4, and then alarm through the mobile phone (i.e. execute step S616-step S617 first and then execute step S614-step S615). Alternatively, the vehicle-mounted terminal may also alarm according to the time T4 (i.e. execute steps S616-S617 and steps S614-S615 simultaneously) during the alarm process by the mobile phone.

In addition, step S614 and step S615 are optional steps, and the vehicle-mounted terminal may also directly alarm through a module (such as a car light, an audio module, etc.) configured by the vehicle-mounted terminal, without alarming through a mobile phone of a passenger. Or, the vehicle-mounted terminal may directly alarm through the mobile phone without the need of alarm through a module configured by the vehicle-mounted terminal itself (i.e. step S616 and step S617 may also be optional steps) when determining that the communication connection is established with the mobile phone.

Thus, the vehicle-mounted terminal is combined with the types of objects in different vehicles, and prompts the passengers of the problem of object carry-over in different reminding modes. Therefore, the problem of reminding passengers of leaving objects can be solved, a more accurate passenger reminding scheme is provided, and the alarm information can be accurately received by passengers.

In some scenarios, if non-child in-vehicle personnel are present in the vehicle, these in-vehicle personnel may find themselves and handle problems with left-behind objects. Therefore, before determining to detect the left-behind object, the vehicle-mounted terminal can firstly determine whether the vehicle-mounted personnel without children exist in the vehicle, and if the vehicle-mounted personnel exist, the left-behind object is not required to be detected, and the alarming process can be directly ended.

Fig. 8 is a schematic flow chart of another method for reminding an object in a vehicle of remaining in the vehicle. As shown in fig. 8, after the above step S403, step S801 may be included.

S801, the vehicle-mounted terminal determines whether a non-child vehicle-mounted person exists. If yes, ending the reminding process of the left object; if not, go to step S404.

In some embodiments, as described in step S402, the vehicle-mounted terminal divides the human body area corresponding to the person with age greater than the preset age by means of photographing and identifying, and marks the corresponding human body tag. Then, the person corresponding to the human body tag that the vehicle-mounted terminal can determine can be a non-child. After the vehicle-mounted terminal determines that the number of the human body tags in the vehicle is reduced, whether other human body tags exist in the vehicle or not can be determined. If other human body labels are also present in the vehicle, it can be determined that no children are present in the vehicle.

If the vehicle-mounted terminal determines that no children exist in the vehicle, the vehicle-mounted terminal can finish the reminding process of the left-behind object, namely, whether the left-behind object exists in the vehicle is not required to be determined. If the in-vehicle terminal determines that no non-child in-vehicle person is present in the vehicle, step S404 may be executed to perform the left-behind object detection.

Therefore, under the condition that the vehicle-mounted terminal determines that no children exist in the vehicle, the vehicle-mounted terminal can avoid carrying out the detection of the left-behind object, and can reduce the power consumption of the vehicle-mounted terminal for determining the left-behind object while ensuring the safety of the object in the vehicle.

In some scenarios, the in-vehicle terminal may also perform a carry-over object alert if it is determined that no child in-vehicle personnel are present in the vehicle. However, in this scenario, since the non-child in-vehicle personnel in the vehicle can autonomously pay attention to the living things, the in-vehicle terminal may not need to perform the remaining living things monitoring any more, thereby simplifying the in-vehicle remaining things monitoring flow.

Fig. 9 is a schematic flow chart of another method for reminding an object in a vehicle of remaining in the vehicle. As shown in fig. 9, the method includes the following steps.

S901, the vehicle-mounted terminal determines that a vehicle door is closed, and the vehicle is in a starting state.

S902, the vehicle-mounted terminal determines the attribution of the object.

Alternatively, the content of step S901 to step S902 may refer to the related content of step S401 to step S402 shown in fig. 4, which is not described herein.

S903, the vehicle-mounted terminal determines that the number of the human body tags in the vehicle is reduced, and the number of the remaining human body tags is greater than or equal to 1. If yes, go to step S904; if not, go to step S902.

In some embodiments, the vehicle-mounted terminal determines that the number of human body tags in the vehicle is reduced, for example, by image analysis or the like, and determines that the number of remaining human body tags in the vehicle is greater than or equal to 1. Then, it may be determined that there is a passenger getting off, but there is still at least one other person other than children in the car (wherein, as described above in step S402, the human body tag corresponds to a human body area corresponding to a person above a preset age). Then, the in-vehicle terminal may perform confirmation of the remaining object (i.e., perform step S904).

Or, in the process of determining the object attribution by the vehicle-mounted terminal according to the time interval T1, it is determined that the number of the human body tags in the vehicle is not reduced, and the object attribution can be continuously determined (i.e. the step S902 is executed again).

Optionally, the rest of the steps S903 may refer to the relevant contents of the step S403, which are not described herein.

S904, the vehicle-mounted terminal determines whether a mobile phone corresponding to the reduced human body label exists. If yes, go to step S905; if not, go to step S907.

In some embodiments, the in-vehicle terminal determines that the in-vehicle legacy object exists through the method described in step S404 above, and may determine that the in-vehicle legacy object includes a mobile phone corresponding to the reduced human body tag. Then, the in-vehicle terminal may perform a handset legacy alert procedure (i.e., perform step S905). Alternatively, the in-vehicle terminal determines that there is no legacy handset in the vehicle, and may continue to detect whether there are other legacy objects (i.e., perform step S907).

S905, the vehicle-mounted terminal determines whether a mobile phone false detection indication is received. If yes, go to step S907; if not, step S906 is performed.

In some embodiments, if the vehicle-mounted terminal receives the false detection indication, it may determine that the detected mobile phone remains as false detection, and no alarm is required, and it may determine whether other objects remain in the vehicle (i.e. step S907 is performed). If the vehicle-mounted terminal does not receive the false detection indication, step S906 may be executed to carry out mobile phone legacy alert.

Alternatively, as shown in fig. 6, the vehicle-mounted terminal may display the alarm information in various manners such as a display screen (e.g., a central control screen), a mobile phone, and the like. Then, the vehicle-mounted terminal responds to the operation of the passengers on the central control screen or responds to the indication sent by the mobile phone, and whether the false detection indication is received or not can be determined.

S906, the vehicle-mounted terminal alarms according to a preset alarm mode.

Optionally, the method for carrying over the warning by the mobile phone of the vehicle-mounted terminal may refer to the related content of step S602-step S606 shown in fig. 6, which is not described herein.

S907, the vehicle-mounted terminal determines whether other off-body objects corresponding to the reduced human body labels exist. If yes, go to step S908; if not, ending the reminding process of the left object.

In some embodiments, the in-vehicle terminal determines that the in-vehicle legacy object exists through the method described in step S404 above, and may determine that the in-vehicle legacy object includes other off-body objects corresponding to the reduced body tags. Then, the in-vehicle terminal may execute other off-body object carry-over alert process (i.e., execute step S908). Or the vehicle-mounted terminal determines that other leaving objects do not exist in the vehicle, and the leaving object reminding process can be ended.

S908, the vehicle-mounted terminal determines whether other off-body objects are received or not without processing instructions. If yes, ending the reminding process of the left object; if not, step S906 is performed.

In some embodiments, if the vehicle-mounted terminal receives the no-processing instruction, the vehicle-mounted terminal can determine that no processing of other detected off-body objects is needed and no warning is needed. If the in-vehicle terminal does not receive the no-processing instruction, step S906 may be executed to perform other leaving-object warning.

Alternatively, as shown in fig. 6, the vehicle-mounted terminal may display the alarm information in various manners such as a display screen (e.g., a central control screen), a mobile phone, and the like. Then, the in-vehicle terminal may determine whether the no-process instruction is received in response to an operation of the occupant on the center screen, or in response to an instruction sent by the mobile phone.

Optionally, the method for warning that other objects left on the vehicle may refer to the related content of step S613-step S617 shown in fig. 6, which is not described herein.

In some scenarios, the in-vehicle terminal may also determine whether there are legacy objects in the vehicle after the vehicle is turned off. That is, the in-vehicle terminal may not have to monitor the number of human body tags in the vehicle in real time, thereby reducing the power consumption of in-vehicle terminal monitoring.

For example, the in-vehicle terminal may determine that the object is home (i.e., perform step S401 and step S402 described above) after determining that the door is closed and the vehicle is in a start state. After that, the vehicle-mounted terminal determines that the vehicle is flameout and the door is closed, and then determines whether there is a left object in the vehicle according to the related contents as described in the above step S404. For example, the vehicle-mounted terminal collects images in the vehicle after the vehicle is flameout and the vehicle door is closed, and determines whether a left object exists in the vehicle according to the analysis result of the images in the vehicle. If the left object exists, the corresponding human body label (namely, the personnel of the left object is determined) can be determined according to the attribution of the object. And then, the vehicle-mounted terminal reminds according to the corresponding object carry-over reminding strategy.

Fig. 10 is a schematic flow chart of another method for reminding an object in a vehicle of remaining in the vehicle. As shown in fig. 10, the method can be applied to a vehicle-mounted terminal, a vehicle, and an electronic device (such as a mobile phone, a tablet, etc.) which establishes a communication connection with the vehicle. Taking the execution subject as an on-board terminal as an example, the method comprises the following steps.

S1001, determining the attribution of the object in the vehicle when the number of the personnel in the vehicle is at least one.

In some embodiments, the vehicle-mounted terminal may determine the attribution of the object in the vehicle according to a preset manner under the condition that at least one person exists in the vehicle.

For example, after the vehicle door is closed, the vehicle-mounted terminal can determine the number of personnel in the vehicle by photographing and the like, and can determine the attribution of the object under the condition that the personnel in the vehicle exist.

For another example, the in-vehicle terminal may determine that the object in the vehicle belongs to when it is determined that the vehicle is in the start state.

In some embodiments, the vehicle-mounted terminal collects an in-vehicle image, determines a human body region corresponding to an in-vehicle person and an object region corresponding to an in-vehicle object in the in-vehicle image, and determines a human body tag of the human body region. And then, the vehicle-mounted terminal establishes a attribution relation of the object area and the human body label corresponding to the human body area according to the distance between the object area and the human body area, wherein the attribution relation is used for representing attribution of the object corresponding to the object area.

Optionally, the vehicle-mounted terminal determines a euclidean distance between the average coordinate position of the object region and the average coordinate position of the human body region, and a pixel depth distance between the average pixel depth of the object region and the average pixel depth of the human body region. Then, a first human body region in the human body region nearest to the first object region among the object regions is determined according to the sum of the Euclidean distance and the pixel depth distance. The first object region is an object region corresponding to a first object belonging to a first person, and the first person region corresponds to the first person. The in-vehicle terminal may establish a first attribution relationship of the first object region and a first person tag of the first person region.

In an exemplary case, when the vehicle-mounted terminal determines that the number of persons in the vehicle is 1 or more, it captures an image in the vehicle, determines object areas corresponding to objects that do not belong to an inherent object in the vehicle (e.g., an object that already exists when no person is in the vehicle) through image analysis, and determines a human body area nearest to the object areas. Then, the in-vehicle terminal may establish a attribution relationship between the object corresponding to the object region and the person corresponding to the human body region closest to the object region. For example, the vehicle-mounted terminal identifies the first object, and according to the euclidean distance between the average coordinate position of the object region corresponding to the first object and the average coordinate position of each human body region and the pixel depth distance between the average pixel depth of the object region corresponding to the first object and the average pixel depth of each human body region, the first human body region closest to the object region corresponding to the first object can be determined, and then the first person to whom the first object belongs can be determined.

In other embodiments, the electronic device in the vehicle may be used as a peripheral device of the vehicle, to determine the attribution of the object in the vehicle, or to determine the attribution of the object in the vehicle together with the vehicle-mounted terminal.

Optionally, the rest of the steps S1001 may refer to the related contents described in the step S402, which are not described herein.

S1002, detecting that a first person in the personnel in the vehicle gets off the vehicle.

In some embodiments, the vehicle-mounted terminal monitors the number of human body tags in the vehicle, and when the number of human body tags is determined to be reduced, the vehicle occupant can be determined to get off the vehicle. Then, the vehicle-mounted terminal can determine that the first person corresponding to the reduced human body tags gets off according to the reduction of the number of the human body tags.

Optionally, the rest of the steps S1001 may refer to the related contents described in the step S403, which are not described herein.

S1003, responding to the getting-off of the first person, and alarming according to a preset object leaving reminding strategy under the condition that the object belonging to the first person is left in the car according to the object attribution.

In some embodiments, the preset object carry-over alert policy includes one or more of the following: reminding mode, reminding duration and reminding times; the reminding mode comprises one or more of the following: the car lamp blinks, the display screen in the car displays reminding information, the voice broadcast in the car and the reminding and alarming through the personnel electronic equipment in the car.

In some embodiments, in response to the first person getting off, the in-vehicle terminal determines that the first object attributed to the first person remains in the vehicle based on the object attribution. The vehicle-mounted terminal can determine the object type of the first object, and then alarm the carry-over of the first object according to a preset object carry-over reminding strategy corresponding to the object type. Wherein the object type includes any one of the following: electronic devices, living things, off-body objects other than electronic devices and living things (i.e., other off-body objects).

For example, in the case where the first object is an electronic device, the vehicle-mounted terminal alarms the carry-over of the first object according to a preset object carry-over reminding policy corresponding to the object type, including: under the condition that the first alarming times do not reach the first threshold value, the vehicle-mounted terminal alarms in one or more early warning modes of flashing of the vehicle lamp, whistling, display of a reminding message on the display screen in the vehicle and voice broadcasting in the vehicle according to the first time, and/or under the condition that communication connection with the first object is established, the vehicle-mounted terminal sends first alarming information to wearable equipment worn by a first person through the first object.

Optionally, in the case that the first object is an electronic device, the vehicle-mounted terminal alert method may refer to the related content of the mobile phone legacy alert procedure shown in fig. 6, which is not described herein.

Also exemplary, in the case that the first object is a living object, the vehicle-mounted terminal alarms the carry-over of the first object according to a preset object carry-over reminding policy corresponding to the object type, including: the vehicle-mounted terminal alarms in a warning mode of flashing or whistling of the vehicle lamp according to the second duration, and/or sends second warning information to the electronic equipment of the first person under the condition that the electronic equipment of the first person is not left in the vehicle; and, under the condition that the alarm release instruction is not received in excess of the second time, the vehicle-mounted terminal can directly alarm.

Optionally, in the case that the first object is a living object, the warning method of the vehicle-mounted terminal may refer to the related content of the living object leaving reminding procedure shown in fig. 6, which is not described herein.

Further exemplary, in the case that the first object is an off-body object other than the electronic device and the living object, the vehicle-mounted terminal alarms the remaining first object according to a preset object remaining reminding policy corresponding to the object type, including: and under the condition that the second alarming times do not reach the second threshold value, the vehicle-mounted terminal alarms in one or more early warning modes of flashing and whistling of the vehicle lamp, displaying of a reminding message on the display screen in the vehicle and voice broadcasting in the vehicle according to the third duration, and/or under the condition that the fact that the electronic equipment of the first person is not left in the vehicle is determined, the vehicle-mounted terminal sends the third alarming information to the electronic equipment of the first person.

Optionally, in the case that the first object is an off-body object other than the electronic device and the living object, the vehicle-mounted terminal alarm method may refer to the related content of the other off-body object leaving reminding procedure shown in fig. 6, which is not described herein.

In some embodiments, the vehicle terminal stops the alert after detecting the vehicle unlock or receiving the alert release indication.

Optionally, the rest of the step S1003 may refer to the related contents described in the above step S405, step S601 to step S617, which are not described herein.

Therefore, the vehicle-mounted terminal can determine whether the passengers leave objects in the vehicle according to the attribution of the objects under the condition that the passengers get off the vehicle. If the alighting personnel leave objects in the vehicle, the vehicle-mounted terminal can give an alarm according to a preset object leave reminding strategy. Thereby realize in time reminding personnel of getting off object carry-over, reduce the influence of object carry-over to personnel of getting off.

The method for reminding the in-car object of leaving behind in the embodiment of the application is described in detail above with reference to fig. 3 to 10. The vehicle-mounted terminal provided in the embodiment of the present application is described in detail below with reference to fig. 11.

In one possible design, fig. 11 is a schematic structural diagram of a vehicle-mounted terminal provided in an embodiment of the present application. As shown in fig. 11, the in-vehicle terminal 1100 may include: a transceiving unit 1101 and a processing unit 1102. The in-vehicle terminal 1100 may be used to implement the functions of the in-vehicle terminal involved in the above-described method embodiments.

Alternatively, the transceiver unit 1101 is configured to support the in-vehicle terminal 1100 to perform S405 in fig. 4; and/or for supporting the in-vehicle terminal 1100 to perform S603, S605, S608, S609, S611, S613, S615, and S617 in fig. 6; and/or for supporting the in-vehicle terminal 1100 to perform S905, S906, and S908 in fig. 9; and/or for supporting the in-vehicle terminal 1100 to execute S1003 in fig. 10.

Alternatively, the processing unit 1102 is configured to support the in-vehicle terminal 1100 to execute S401, S402, S403, and S404 in fig. 4; and/or for supporting the in-vehicle terminal 1100 to perform S501 in fig. 5; and/or for supporting the in-vehicle terminal 1100 to perform S601, S602, S604, S606, S607, S610, S612, S614, and S616 in fig. 6; and/or for supporting the in-vehicle terminal 1100 to perform S801 in fig. 8; and/or for supporting the in-vehicle terminal 1100 to perform S901, S902, S903, S904, and S907 in fig. 9; and/or for supporting the in-vehicle terminal 1100 to perform S1001 and S1002 in fig. 10.

The transceiver unit may include a receiving unit and a transmitting unit, may be implemented by a transceiver or a transceiver related circuit component, and may be a transceiver or a transceiver module. The operations and/or functions of each unit in the vehicle-mounted terminal 1100 are respectively for implementing the corresponding flow of the method for reminding the in-vehicle object of leaving behind in the vehicle in the above method embodiment, and all relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional unit, which is not repeated herein for brevity.

Alternatively, the in-vehicle terminal 1100 shown in fig. 11 may further include a storage unit (not shown in fig. 11) in which a program or instructions are stored. When the transceiver unit 1101 and the processing unit 1102 execute the program or instructions, the in-vehicle terminal 1100 shown in fig. 11 is enabled to execute the in-vehicle object leave-behind reminding method described in the above-described method embodiment.

The technical effects of the vehicle-mounted terminal 1100 shown in fig. 11 may refer to the technical effects of the method for reminding the in-vehicle object of leaving behind in the vehicle described in the above embodiment of the method, and will not be described herein.

In addition to the form of the vehicle-mounted terminal 1100, the technical solution provided in the present application may also be a functional unit or a chip in the vehicle-mounted terminal, or a device matched with the vehicle-mounted terminal for use.

The embodiment of the application also provides a chip system, which comprises: a processor coupled to a memory for storing programs or instructions which, when executed by the processor, cause the system-on-a-chip to implement the method of any of the method embodiments described above.

Alternatively, the processor in the system-on-chip may be one or more. The processor may be implemented in hardware or in software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, or the like. When implemented in software, the processor may be a general purpose processor, implemented by reading software code stored in a memory.

Alternatively, the memory in the system-on-chip may be one or more. The memory may be integrated with the processor or may be separate from the processor, and embodiments of the present application are not limited. For example, the memory may be a non-transitory processor, such as a ROM, which may be integrated on the same chip as the processor, or may be separately disposed on different chips, and the type of memory and the manner of disposing the memory and the processor in the embodiments of the present application are not specifically limited.

Illustratively, the chip system may be a field programmable gate array (field programmable gate array, FPGA), an application specific integrated chip (AP device plication specific integrated circuit, ASIC), a system on chip (SoC), a central processor (central processor unit, CPU), a network processor (network processor, NP), a digital signal processing circuit (digital signal processor, DSP), a microcontroller (micro controller unit, MCU), a programmable controller (programmable logic device, PLD) or other integrated chip.

It should be understood that the steps in the above-described method embodiments may be accomplished by integrated logic circuitry in hardware in a processor or instructions in the form of software. The steps of a method disclosed in connection with the embodiments of the present application may be embodied directly in a hardware processor or in a combination of hardware and software modules in a processor.

The embodiment of the application also provides a computer readable storage medium, in which a computer program is stored, when the computer program runs on a computer, the computer is caused to execute the related steps, so as to implement the method for reminding the in-vehicle object of the embodiment.

The embodiment of the application also provides a computer program product, when the computer program product runs on a computer, the computer is caused to execute the related steps so as to realize the method for reminding the in-vehicle object of the embodiment.

In addition, the embodiment of the application also provides a device. The apparatus may be a component or module in particular, and may comprise one or more processors and memory coupled. Wherein the memory is for storing a computer program. The computer program, when executed by one or more processors, causes the apparatus to perform the in-vehicle object anti-carry-over reminding method in the method embodiments described above.

Wherein an apparatus, a computer-readable storage medium, a computer program product, or a chip provided by embodiments of the present application are each configured to perform the corresponding method provided above. Therefore, the advantages achieved by the method can be referred to as the advantages in the corresponding method provided above, and will not be described herein.

The steps of a method or algorithm described in connection with the disclosure of the embodiments disclosed herein may be embodied in hardware, or may be embodied in software instructions executed by a processor. The software instructions may be comprised of corresponding software modules that may be stored in random access memory (random access memory, RAM), flash memory, read Only Memory (ROM), erasable programmable read only memory (erasable programmable ROM), electrically Erasable Programmable Read Only Memory (EEPROM), registers, hard disk, a removable disk, a compact disc read only memory (CD-ROM), or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an application specific integrated circuit (AP device plication specific integrated circuit, ASIC).

From the foregoing description of the embodiments, it will be apparent to those skilled in the art that the foregoing functional block divisions are merely illustrative for convenience and brevity of description. In practical application, the above functions can be allocated by different functional modules according to the need; i.e. the internal structure of the device is divided into different functional modules to perform all or part of the functions described above. The specific working processes of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which are not described herein.

In the several embodiments provided in this application, it should be understood that the disclosed methods may be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the modules or units is only one logic function division, and other division modes can be adopted when the modules or units are actually implemented; for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. In addition, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interface, module or unit indirect coupling or communication connection, which may be electrical, mechanical or other form.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

Computer readable storage media include, but are not limited to, any of the following: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An in-vehicle object anti-carry-over reminding method, which is characterized by comprising the following steps:

determining the attribution of the object in the vehicle under the condition that the number of the personnel in the vehicle is at least one;

Detecting that a first person in the in-vehicle person gets off the vehicle;

responding to the first personnel getting off, and alarming according to a preset object leaving reminding strategy under the condition that the object belonging to the first personnel remains in the car according to the object attribution.

2. The method of claim 1, wherein the determining the home of the in-vehicle object comprises:

collecting an in-vehicle image;

determining a human body area corresponding to the in-vehicle personnel and an object area corresponding to an in-vehicle object in the in-vehicle image, and determining a human body label of the human body area;

and establishing a attribution relation of the object area and the human body label corresponding to the human body area according to the distance between the object area and the human body area, wherein the attribution relation is used for representing attribution of the object corresponding to the object area.

3. The method according to claim 2, wherein the establishing a home relation of the body tag corresponding to the body region and the object region according to the distance between the body region and the body region includes:

determining a euclidean distance between the average coordinate position of the object region and the average coordinate position of the human body region, and a pixel depth distance between the average pixel depth of the object region and the average pixel depth of the human body region;

Determining a first human body region of the human body regions nearest to the first object region of the object regions according to the sum of the Euclidean distance and the pixel depth distance; wherein the first object region is an object region corresponding to a first object belonging to the first person, and the first person region corresponds to the first person;

a first attribution relationship of the first object region and a first person tag of the first person region is established.

4. A method according to claim 2 or 3, wherein said detecting that a first one of said in-vehicle personnel is getting off comprises:

and determining that the first person corresponding to the reduced human body labels gets off according to the reduction of the number of the human body labels.

5. The method of any one of claims 1-4, wherein the preset object carry-over alert policy comprises one or more of: reminding mode, reminding duration and reminding times; the reminding mode comprises one or more of the following: the car lamp blinks, the display screen in the car displays reminding information, the voice broadcast in the car and the reminding and alarming through the personnel electronic equipment in the car.

6. The method according to any one of claims 1-5, wherein in response to the first person getting off, according to the object attribution, in a case that it is determined that an object attributed to the first person remains in the vehicle, alerting according to a preset object leave alert policy, includes:

In response to the first person getting off, determining that a first object belonging to the first person remains in the vehicle according to the attribution of the object;

determining an object type of the first object; the object type includes any one of the following: electronic equipment, living things, off-body objects other than the electronic equipment and the living things;

and alarming the leaving of the first object according to a preset object leaving reminding strategy corresponding to the object type.

7. The method of claim 6, wherein, in the case that the first object is the electronic device, the alerting the first object of the carry-over according to the preset object carry-over alert policy corresponding to the object type comprises:

and (3) under the condition that the first alarming times do not reach the first threshold value, alarming is carried out according to one or more early warning modes of flashing of a car lamp, whistling, display of a reminding message on an in-car display screen and voice broadcasting in the car according to the first time, and/or under the condition that communication connection with the first object is established, the first alarming information is sent to wearable equipment worn by the first person through the first object.

8. The method of claim 6, wherein, in the case that the first object is the living thing, the alarming the leaving of the first object according to a preset leaving-of-object alarming policy corresponding to the object type comprises:

alarming in a warning mode of flashing or whistling of the car lamp according to the second duration, and/or sending second warning information to the electronic equipment of the first person under the condition that the electronic equipment of the first person is not left in the car is determined; and alarming when the alarm release instruction is not received beyond the second time period.

9. The method according to claim 6, wherein, in the case that the first object is the off-body object other than the electronic device and the living object, the alerting the first object of the carry-over according to the preset object carry-over alert policy corresponding to the object type includes:

and under the condition that the second alarming times do not reach the second threshold value, alarming by one or more early warning modes of flashing of a car lamp, whistling, display of a reminding message on an in-car display screen and in-car voice broadcasting according to a third duration, and/or under the condition that the fact that the electronic equipment of the first person is not left in the car is determined, sending third alarming information to the electronic equipment of the first person.

10. The method according to any one of claims 1-9, wherein the method further comprises:

and stopping alarming after detecting that the vehicle is unlocked or receiving the alarming release instruction.

11. A vehicle-mounted terminal, characterized by comprising: a processor, a camera and a memory, the memory and the camera being coupled to the processor, the memory being for storing computer program code, the computer program code comprising computer instructions which, when read from the memory by the processor, cause the vehicle terminal to perform the method of any of claims 1-10.

12. A vehicle, characterized by comprising: a processor, a camera and a memory, the memory and the camera being coupled to the processor, the memory being for storing computer program code, the computer program code comprising computer instructions which, when read from the memory by the processor, cause the vehicle to perform the method of any of claims 1-10.

13. An electronic device, comprising: a processor, a camera and a memory, the memory and the camera being coupled to the processor, the memory being for storing computer program code, the computer program code comprising computer instructions which, when read from the memory by the processor, cause the electronic device to perform the method of any of claims 1-10.

14. A computer readable storage medium, characterized in that the computer readable storage medium comprises a computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1-10.

15. A computer program product, characterized in that the computer program product, when run on a computer, causes the computer to perform the method according to any of claims 1-10.