CN108162903B - Method and device for monitoring a vehicle - Google Patents

Method and device for monitoring a vehicle Download PDF

Info

Publication number
CN108162903B
CN108162903B CN201711427692.8A CN201711427692A CN108162903B CN 108162903 B CN108162903 B CN 108162903B CN 201711427692 A CN201711427692 A CN 201711427692A CN 108162903 B CN108162903 B CN 108162903B
Authority
CN
China
Prior art keywords
vehicle
window
door
preset
voice recognition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711427692.8A
Other languages
Chinese (zh)
Other versions
CN108162903A (en
Inventor
王春丽
肖小城
薛斌
沙文瀚
刘琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chery New Energy Automobile Technology Co Ltd
Original Assignee
Chery New Energy Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chery New Energy Automobile Co Ltd filed Critical Chery New Energy Automobile Co Ltd
Priority to CN201711427692.8A priority Critical patent/CN108162903B/en
Publication of CN108162903A publication Critical patent/CN108162903A/en
Application granted granted Critical
Publication of CN108162903B publication Critical patent/CN108162903B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B60R16/0231Circuits relating to the driving or the functioning of the vehicle
    • B60R16/0232Circuits relating to the driving or the functioning of the vehicle for measuring vehicle parameters and indicating critical, abnormal or dangerous conditions

Abstract

The invention discloses a method and a device for monitoring a vehicle, and belongs to the technical field of vehicle safety. The method comprises the following steps: when the closing of the vehicle door and the vehicle window is detected, determining the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle; when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start running, starting a voice recognition function of the vehicle; through the voice recognition function, whether the distress signal exists in the vehicle is recognized based on a plurality of preset distress signals of the vehicle; when the voice recognition function recognizes that the distress signal exists in the vehicle, sending an opening request to a user terminal of a designated user; and receiving an instruction returned by the user terminal, and opening the vehicle door or the vehicle window of the vehicle. Because the vehicle-mounted terminal can automatically recognize the distress signal sent by the personnel in the vehicle, and the vehicle door or the vehicle window is opened by combining the distress signal and the indication instruction of the user terminal, so that the safety of monitoring the vehicle is improved.

Description

Method and device for monitoring a vehicle
Technical Field
The invention relates to the technical field of vehicle safety, in particular to a method and a device for monitoring a vehicle.
Background
Many users are easy to lock old people or children in the car by mistake when parking and locking. According to relevant experimental statistics, when the vehicle is parked outside a direct sun exposure room, the temperature in the vehicle can rise to 45 ℃ in 30 minutes; at the moment, if the person is locked in the vehicle by mistake, the person is very easy to be suffocated by heatstroke and even die; therefore, how to ensure the safety of the person who is locked in the vehicle by mistake becomes a problem which is more concerned by the technical personnel in the field.
Currently, when a user locks a vehicle, the user often checks whether other people exist in the first vehicle, and when no other people exist in the vehicle, the user triggers a vehicle locking instruction of the vehicle to close a vehicle door and a vehicle window, so that the vehicle is controlled to be in a vehicle locking state; however, the user may also carelessly and carelessly forget to check whether other people exist in the vehicle and directly trigger the vehicle locking instruction, so that other people are locked in the vehicle by mistake, which is very easy to cause a choking event in the vehicle. For example, a sleeping child, may be blocked in the vehicle by mistake, causing suffocation and even death. Therefore, a method for monitoring a vehicle is needed to ensure the safety of the people who are locked by mistake.
Disclosure of Invention
To solve the problems of the prior art, the present invention provides a method and apparatus for monitoring a vehicle. The technical scheme is as follows:
in a first aspect, a method of monitoring a vehicle is provided, the method comprising:
when closing of a vehicle door and a vehicle window is detected, determining closing time of the vehicle door and the vehicle window and an activation state of the vehicle, wherein the activation state is used for indicating that the vehicle starts running or does not start running;
when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start to run, starting a voice recognition function of the vehicle, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal;
identifying whether a distress signal exists in the vehicle based on a plurality of preset distress signals of the vehicle through the voice identification function;
when a distress signal exists in the vehicle through the voice recognition function, sending an opening request to a user terminal of a designated user, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window;
and receiving an instruction returned by the user terminal, and opening the vehicle door or the vehicle window of the vehicle.
In one possible design, the recognizing, by the voice recognition function, whether a distress signal exists in the vehicle based on a plurality of preset distress signals of the vehicle includes:
acquiring a plurality of preset distress signals from a designated storage space of the vehicle, acquiring a current voice signal in the vehicle, and determining the matching degree between the voice signal and each preset distress signal through the voice recognition function;
and when the matching degree of the voice signal and any one of the plurality of preset distress signals is greater than a preset threshold value, determining that the distress signal exists in the vehicle.
In one possible design, the method further includes:
when the vehicle does not have a distress signal within a second preset time after the voice recognition function is started, or when the voice recognition function of the vehicle is detected to be closed, stopping recognizing whether the distress signal exists in the vehicle or not;
when it is detected that the doors of the vehicle are opened and closed again, the step of determining the closing time periods of the doors and windows of the vehicle and the starting state of the vehicle is performed.
In one possible design, the method further includes:
when an instruction returned by the user terminal is not received within a third preset time after the opening request is sent to the user terminal, the opening request is repeatedly sent to the user terminal;
when the repetition times are greater than the preset times, starting an alarm of the vehicle so that the alarm gives an alarm;
and when the opening of the door or the window of the vehicle is detected, closing the alarm of the vehicle.
In one possible design, the turn-on request carries the distress signal and/or an environmental image; correspondingly, the method further comprises the following steps:
and shooting the internal environment of the vehicle through a camera of the vehicle to obtain an environment image of the vehicle.
In a second aspect, there is provided an apparatus for monitoring a vehicle, the apparatus comprising:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle when the closing of the vehicle door and the vehicle window is detected, and the starting state is used for indicating whether the vehicle starts to run or not;
the starting module is used for starting a voice recognition function of the vehicle when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle is not started to run, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal;
the recognition module is used for recognizing whether the distress signal exists in the vehicle or not based on a plurality of preset distress signals of the vehicle through the voice recognition function;
the sending module is used for sending an opening request to a user terminal of a designated user when the help signal in the vehicle is identified through the voice identification function, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window;
the opening module is further used for receiving an instruction returned by the user terminal and opening a vehicle door or a vehicle window of the vehicle.
In a possible design, the recognition module is further configured to obtain a plurality of preset distress signals from a designated storage space of the vehicle, obtain a current voice signal in the vehicle, and determine, through the voice recognition function, a matching degree between the voice signal and each preset distress signal; and when the matching degree of the voice signal and any one of the plurality of preset distress signals is greater than a preset threshold value, determining that the distress signal exists in the vehicle.
In one possible design, the apparatus further includes:
the stopping module is used for stopping recognizing whether the distress signal exists in the vehicle or not when the vehicle does not have the distress signal within a second preset time after the voice recognition function is started or when the fact that the voice recognition function of the vehicle is closed is detected;
the determining module is further used for determining the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle when the vehicle door of the vehicle is detected to be opened and closed again.
In one possible design, the apparatus further includes:
the repeating module is used for repeatedly sending the opening request to the user terminal when an indication instruction returned by the user terminal is not received within a third preset time after the opening request is sent to the user terminal; when the repetition times are greater than the preset times, starting an alarm of the vehicle so that the alarm gives an alarm;
and the closing module is used for closing the alarm of the vehicle when detecting that the door or the window of the vehicle is opened.
In one possible design, the turn-on request carries the distress signal and/or an environmental image; correspondingly, the device further comprises:
and the shooting module is used for shooting the internal environment of the vehicle through the camera of the vehicle to obtain the environment image of the vehicle.
In the embodiment of the invention, when the closing of the vehicle door and the vehicle window is detected, the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle are determined, wherein the starting state is used for indicating whether the vehicle starts to run or does not start to run; when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start to run, starting a voice recognition function of the vehicle, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal; through the voice recognition function, whether the distress signal exists in the vehicle is recognized based on a plurality of preset distress signals of the vehicle; when a distress signal exists in the vehicle through the voice recognition function, sending an opening request to a user terminal of a designated user, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window; and receiving an instruction returned by the user terminal, and opening the vehicle door or the vehicle window of the vehicle. Because the vehicle-mounted terminal can automatically identify the distress signal sent by the person in the vehicle, and open the vehicle door or the vehicle window by combining the distress signal and the indication instruction of the user terminal, the safety of the person in the vehicle locked by mistake is ensured, and the safety of monitoring the vehicle is improved.
Drawings
FIG. 1 is a flow chart of a method of monitoring a vehicle according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of monitoring a vehicle according to an embodiment of the present invention;
fig. 3 is a block diagram of an apparatus for monitoring a vehicle according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Fig. 1 is a method for monitoring a vehicle according to an embodiment of the present invention, where an execution subject of the method may be a vehicle-mounted terminal, as shown in fig. 1, and the method includes:
step 101: when closing of the vehicle door and the vehicle window is detected, determining the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle, wherein the starting state is used for indicating that the vehicle starts running or does not start running;
step 102: when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start to run, starting a voice recognition function of the vehicle, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal;
step 103: through the voice recognition function, whether the distress signal exists in the vehicle is recognized based on a plurality of preset distress signals of the vehicle;
step 104: when a distress signal exists in the vehicle through the voice recognition function, sending an opening request to a user terminal of a designated user, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window;
step 105: and receiving an instruction returned by the user terminal, and opening the vehicle door or the vehicle window of the vehicle.
In a possible design, the recognizing whether the distress signal exists in the vehicle based on a plurality of preset distress signals of the vehicle through the voice recognition function includes:
acquiring a plurality of preset distress signals from a designated storage space of the vehicle, acquiring a current voice signal in the vehicle, and determining the matching degree between the voice signal and each preset distress signal through the voice recognition function;
when the matching degree of the voice signal and any one of the plurality of preset distress signals is larger than a preset threshold value, determining that the distress signal exists in the vehicle.
In one possible design, the method further includes:
when the vehicle does not have the distress signal within a second preset time after the voice recognition function is started, or when the voice recognition function of the vehicle is detected to be closed, stopping recognizing whether the distress signal exists in the vehicle or not;
when it is detected that the doors of the vehicle are opened and closed again, the step of determining the closing time periods of the doors and windows of the vehicle and the starting state of the vehicle is performed.
In one possible design, the method further includes:
when an instruction returned by the user terminal is not received within a third preset time after the opening request is sent to the user terminal, the opening request is repeatedly sent to the user terminal;
when the repetition times are more than the preset times, starting an alarm of the vehicle so that the alarm gives an alarm;
and when the opening of the door or window of the vehicle is detected, closing the alarm of the vehicle.
In one possible design, the turn-on request carries the distress signal and/or an environmental image; correspondingly, the method further comprises the following steps:
and shooting the internal environment of the vehicle through a camera of the vehicle to obtain an environment image of the vehicle.
In the embodiment of the invention, when the closing of the vehicle door and the vehicle window is detected, the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle are determined, wherein the starting state is used for indicating whether the vehicle starts to run or does not start to run; when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start to run, starting a voice recognition function of the vehicle, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal; through the voice recognition function, whether the distress signal exists in the vehicle is recognized based on a plurality of preset distress signals of the vehicle; when a distress signal exists in the vehicle through the voice recognition function, sending an opening request to a user terminal of a designated user, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window; and receiving an instruction returned by the user terminal, and opening the vehicle door or the vehicle window of the vehicle. Because the vehicle-mounted terminal can automatically identify the distress signal sent by the person in the vehicle, and open the vehicle door or the vehicle window by combining the distress signal and the indication instruction of the user terminal, the safety of the person in the vehicle locked by mistake is ensured, and the safety of monitoring the vehicle is improved.
Fig. 2 is a method for monitoring a vehicle according to an embodiment of the present invention, where an execution subject of the method may be a vehicle-mounted terminal, as shown in fig. 2, and the method includes:
step 201: when it is detected that the doors and windows of the vehicle are closed, the in-vehicle terminal determines the closing time period of the doors and windows of the vehicle and the activation state of the vehicle.
In the embodiment of the invention, when a user needs to park and lock, the user can get off and close the vehicle door and the vehicle window, and at the moment, the user may carelessly lock other people in the vehicle by mistake. In the embodiment of the invention, the vehicle has an automatic monitoring function, and when a user closes the door and the window of the vehicle to park and lock, the vehicle can automatically monitor whether a person is mistakenly locked in the vehicle, so that the vehicle can be timely rescued when the person is mistakenly locked in the vehicle. However, when the user controls the vehicle to close the door window, the user may also control the vehicle to start running. Therefore, the vehicle-mounted terminal can judge whether the vehicle needs to be automatically monitored or not based on whether the vehicle is started within a certain time period or not.
In the step, when the vehicle-mounted terminal detects that the vehicle door and the vehicle window of the vehicle are closed, the vehicle-mounted terminal acquires the starting state of the vehicle, wherein the starting state is used for indicating the vehicle to start running or not to start running; and the vehicle-mounted terminal acquires the closing time length from the closing time of the vehicle door and the vehicle window to the current time.
The step of acquiring the starting state of the vehicle by the vehicle-mounted terminal may be: the vehicle-mounted terminal detects whether a driving starting instruction triggered by a user through triggering a one-key starting button is received within the current closing time, and when the vehicle-mounted terminal detects the driving starting instruction triggered by the user within the current closing time, the vehicle-mounted terminal determines that the starting state of the vehicle is driving starting; and when the vehicle-mounted terminal does not detect the starting running instruction within the current closing time length, determining that the starting state of the vehicle is not starting running.
Further, in order to improve the accuracy of detecting the starting state of the vehicle, the vehicle-mounted terminal may further perform a determination based on the current vehicle speed, and the step of acquiring the starting state of the vehicle by the vehicle-mounted terminal may be: the vehicle-mounted terminal detects whether a driving starting instruction triggered by a user is received within the current closing time length or not, and obtains the current speed of the vehicle. When the vehicle-mounted terminal receives a starting running instruction in the current closing time and the current vehicle speed is not less than the specified vehicle speed, determining the starting state of the vehicle as starting running; when the vehicle-mounted terminal receives a starting driving instruction in the current closing time period and the current vehicle speed is less than the specified vehicle speed, determining that the starting state of the vehicle is not starting driving; and when the vehicle-mounted terminal does not receive the starting driving instruction within the current closing time length and the current vehicle speed is less than the specified vehicle speed, determining that the starting state of the vehicle is not starting driving. The specified vehicle speed may be a vehicle speed at which the vehicle is stationary, that is, the specified vehicle speed may be 0 km/h.
Wherein, can install timing module in this vehicle, vehicle-mounted terminal can acquire closing duration through this timing module, and vehicle-mounted terminal acquires closing duration's step can be: when the vehicle-mounted terminal detects that the vehicle door and the vehicle window are closed, the vehicle-mounted terminal controls the timing module to start timing, acquires the timing duration corresponding to the current time from the timing module, and determines the timing duration as the closing duration of the vehicle door and the vehicle window.
The timing module may be a timer integrated in the vehicle-mounted terminal or a timing system with a timing function. The first preset duration may be set and changed based on user needs, which is not specifically limited in the embodiment of the present invention. For example, the first preset time period may be 3 minutes, 20 minutes, and the like.
In the embodiment of the invention, the vehicle can identify whether the distress signal exists in the vehicle through the voice recognition function, and the automatic monitoring of the vehicle is realized based on the hearing angle. The vehicle-mounted terminal can be used for carrying out voice recognition on the sound inside the vehicle through the voice recognition system, and can wake up the voice recognition system when the vehicle door and the vehicle window of the vehicle are closed in order to improve the efficiency of subsequent voice recognition.
Step 202: and when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start running, the vehicle-mounted terminal starts the voice recognition function of the vehicle.
In this step, the voice recognition function is a function of recognizing whether the voice signal is a distress signal; when the vehicle is used for closing the vehicle door and the vehicle window all the time within a first preset time length and the starting state indication indicates that the vehicle is not started to run, the vehicle is in a parking lock-falling state, and in order to avoid that a person is locked in the vehicle by mistake, the vehicle-mounted terminal determines that the vehicle needs to be automatically monitored. The vehicle-mounted terminal can realize a voice recognition function through the voice recognition system. The step of the vehicle-mounted terminal starting the voice recognition function of the vehicle can be as follows: the vehicle-mounted terminal sends a starting instruction to the voice recognition system, the starting instruction is used for indicating the voice recognition system to start executing the voice recognition function, and the voice recognition system receives the starting instruction and starts the voice recognition function according to the starting instruction. Specifically, after the voice recognition function is turned on, the vehicle-mounted terminal determines whether a distress signal exists in the vehicle through the subsequent step 203.
Step 203: the vehicle-mounted terminal identifies whether the distress signal exists in the vehicle or not through the voice identification function based on a plurality of preset distress signals of the vehicle.
The vehicle-mounted terminal can be preset and store a plurality of preset distress signals, wherein the preset distress signals are distress sounds emitted by people mistakenly locked in the vehicle; for example, the preset distress signal may be: "go away", "I want to get off", "I want to go out", "drive the door", "rescue" or cry of baby, etc. The embodiment of the present invention is not particularly limited thereto. The vehicle-mounted terminal can identify the voice signal in the current vehicle based on the plurality of preset distress signals. Specifically, this step can be realized by the following steps 2031-2032.
Step 2031: the vehicle-mounted terminal acquires a plurality of preset distress signals from the designated storage space of the vehicle, acquires the current voice signal in the vehicle, and determines the matching degree between the voice signal and each preset distress signal through the voice recognition function.
In this step, the designated storage space may be a storage space corresponding to the voice recognition system, and the vehicle-mounted terminal may store the plurality of preset distress signals in the space of the voice recognition system in advance, so that the vehicle-mounted terminal may directly perform automatic recognition through the voice recognition system.
Specifically, the steps may be: the vehicle-mounted terminal acquires a current voice signal through a voice recognition system, and acquires the plurality of preset distress signals and a preset recognition algorithm from the designated storage space; and determining the matching degree between each preset distress signal and the voice signal through a preset recognition algorithm.
The preset identification algorithm may be set and changed according to the user requirement, which is not specifically limited in the embodiment of the present invention. For example, the preset recognition algorithm may be: DTW (Dynamic Time Warping) algorithm.
Step 2032: when the matching degree of the voice signal and any one of the plurality of preset distress signals is larger than a preset threshold value, determining that the distress signal exists in the vehicle.
In this step, the vehicle-mounted terminal obtains the matching degree between the voice signal and each preset distress signal so as to obtain a plurality of matching degrees, and when any one of the matching degrees is greater than the preset threshold value, the voice signal sent by the person in the vehicle is matched with the preset distress signal. The vehicle-mounted terminal determines the voice signal as a distress signal, namely, the person who is locked by mistake and needs to be rescued exists in the vehicle. When any one of the matching degrees is not greater than the preset threshold value, it is indicated that the voice signal sent by the vehicle-mounted person is not matched with the preset distress signals, and the vehicle-mounted terminal does not make the voice signal a distress signal.
The preset threshold may be set and changed according to a user requirement, which is not specifically limited in the embodiment of the present invention. For example, the preset threshold may be 0.8, 0.5, etc.
It should be noted that, when the vehicle-mounted terminal identifies whether a distress signal exists in the vehicle, the vehicle-mounted terminal may collect the voice signal inside the vehicle once every preset time interval after the voice identification function of the vehicle is turned on, and identify whether the distress signal exists in the vehicle based on the voice signal collected each time. Wherein, the preset time interval may be 1 second, 5 seconds, etc.
In one possible design, after the vehicle-mounted terminal is turned on for identification for a period of time, the distress signal is not identified, the vehicle-mounted terminal can judge whether to continue identification or not based on the identified time length, and the identification is stopped under the condition that the identification is not needed, so that the power consumption of the vehicle is saved. The judging process may be: when the vehicle does not have the distress signal within a second preset time after the voice recognition function is started, or when the voice recognition function of the vehicle is detected to be closed, stopping recognizing whether the distress signal exists in the vehicle or not; when it is detected that the doors of the vehicle are opened and closed again, step 201 is performed.
The second preset time period may be set and changed according to a user requirement, which is not specifically limited in the embodiment of the present invention. For example, the second preset time period may be 2 hours, 3 hours, and the like.
Step 204: when the voice recognition function recognizes that the distress signal exists in the vehicle, the vehicle-mounted terminal sends an opening request to a user terminal of a designated user, and the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window.
The vehicle-mounted terminal can establish communication connection with the user terminal through the communication module, and when the help-seeking signal in the vehicle is identified through the voice recognition function, the vehicle-mounted terminal can send an opening request to the user terminal through the communication module. Wherein, the vehicle-mounted terminal may store the terminal identifier of the user terminal in the communication module in advance, and then this step may be: when the voice recognition function recognizes that the distress signal exists in the vehicle, the vehicle-mounted terminal acquires the terminal identification of the user terminal of the vehicle from the communication module, establishes communication connection with the user terminal corresponding to the terminal identification through the communication module, and sends an opening request to the terminal corresponding to the terminal identification through the communication connection. The user terminal receives the opening request sent by the vehicle-mounted terminal and displays the opening request to the user so that the user can know that someone in the vehicle is mistakenly locked in the vehicle when seeing the opening request.
The communication module may be a T-Box (Telematics Box) installed in the vehicle.
In one possible design, the turn-on request may also carry the distress signal and/or an environmental image; correspondingly, in this step, the vehicle-mounted terminal can also obtain the distress signal and/or the environment image, generate an opening request according to the distress signal and/or the environment image, and send the opening request to the user terminal of the specified user.
The environment image is an image of an internal environment of the vehicle, and the step of acquiring the environment image by the vehicle-mounted terminal may be: the vehicle-mounted terminal shoots the internal environment of the vehicle through the camera of the vehicle to obtain the environment image of the vehicle.
Correspondingly, the user terminal receives the opening request sent by the vehicle-mounted terminal, acquires the distress signal and/or the environmental image from the opening request, and displays the distress signal and/or the environmental image to the user, so that the distress signal and/or the environmental image sent by the person who is locked by mistake in the vehicle can be further acquired.
Further, the user terminal may also display an option button to the user, which may be used to instruct the user to select to open the doors or windows of the vehicle. When a user knows that someone is locked by mistake in the vehicle, the user can trigger the option button, and when the user terminal detects the option button triggered by the user, an indication instruction for opening a vehicle door or a vehicle window of the vehicle, which is selected by the user through the trigger option button, is obtained, and the indication instruction carries the vehicle door identifier and the vehicle window identifier selected by the user and returns the indication instruction to the vehicle-mounted terminal.
Step 205: and the vehicle-mounted terminal receives an instruction returned by the user terminal and opens the vehicle door or the vehicle window of the vehicle.
In the embodiment of the present invention, the instruction is an instruction for instructing to open a door or a window of the vehicle, and the vehicle-mounted terminal receives the instruction and sends the instruction to a BCM (Body Control Module) of the vehicle through a CAN bus. The BCM receives the instruction, acquires the identification of the vehicle door to be opened, and controls the opening of the vehicle door according to the instruction; or the BCM receives the instruction, acquires the window mark to be opened, and controls the window opening of the vehicle according to the instruction.
Of course, when the user determines that the user quickly returns to the vicinity of the vehicle and does not need to open the vehicle door or the vehicle window, or the user knows that the person mistakenly locked in the vehicle is a thief or other lawbreaker through the environment image or the distress signal, the user can also select not to open the vehicle door or the vehicle window, the indication instruction can also be used for indicating not to open the vehicle door or the vehicle window, when the indication instruction indicates that the vehicle door or the vehicle window is selected by the user and is not to be opened, the vehicle-mounted terminal receives the indication instruction, and the vehicle door or the vehicle window is not opened according to the indication instruction.
Step 206: when the indication instruction returned by the user terminal is not received within a third preset time after the opening request is sent to the user terminal, the vehicle-mounted terminal repeatedly sends the opening request to the user terminal, and when the repetition times are greater than the preset times, the vehicle-mounted terminal opens the alarm of the vehicle, so that the alarm gives an alarm.
In the embodiment of the present invention, a user may not pay attention to a user terminal in time, so as to miss an opening request received by the user terminal, at this time, in order to ensure safety of personnel in the vehicle, the vehicle-mounted terminal may determine a sending time length after sending the opening request to the user terminal, and repeatedly send the opening request when the sending time length exceeds a certain time length, specifically, when an instruction returned by the user terminal is not received within a third preset time length after sending the opening request to the user terminal, the step of repeatedly sending the opening request to the user terminal by the vehicle-mounted terminal may be: when the vehicle-mounted terminal sends a starting request to the user terminal, the vehicle-mounted terminal starts timing through the timing module, when the timing duration exceeds a third preset duration, the vehicle-mounted terminal sends the starting request to the user terminal again, timing is still carried out, and re-reading sending is carried out based on the timing duration.
However, when the user terminal does not have any feedback all the time, in order to ensure the safety of the vehicle personnel, the vehicle-mounted terminal can also adjust the rescue strategy for the vehicle personnel in real time according to the actual situation, and when the number of times is greater than the preset number of times, the vehicle-mounted terminal starts the alarm of the vehicle so that the alarm gives an alarm. So that other people around the vehicle can timely rescue people in the vehicle, and when the vehicle door or the vehicle window of the vehicle is detected to be opened, the vehicle-mounted terminal closes the alarm of the vehicle.
In the embodiment of the invention, when the closing of the vehicle door and the vehicle window is detected, the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle are determined, wherein the starting state is used for indicating whether the vehicle starts to run or does not start to run; when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start to run, starting a voice recognition function of the vehicle, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal; through the voice recognition function, whether the distress signal exists in the vehicle is recognized based on a plurality of preset distress signals of the vehicle; when a distress signal exists in the vehicle through the voice recognition function, sending an opening request to a user terminal of a designated user, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window; and receiving an instruction returned by the user terminal, and opening the vehicle door or the vehicle window of the vehicle. Because the vehicle-mounted terminal can automatically identify the distress signal sent by the person in the vehicle, and open the vehicle door or the vehicle window by combining the distress signal and the indication instruction of the user terminal, the safety of the person in the vehicle locked by mistake is ensured, and the safety of monitoring the vehicle is improved.
Fig. 3 is a block diagram of an apparatus for monitoring a vehicle according to an embodiment of the present invention, as shown in fig. 3, the apparatus includes:
the determining module 301 is configured to determine, when it is detected that the vehicle door and the vehicle window of the vehicle are closed, a closing time period of the vehicle door and the vehicle window of the vehicle and an activation state of the vehicle, where the activation state is used to indicate that the vehicle starts running or does not start running;
the starting module 302 is configured to start a voice recognition function of the vehicle when the closing duration is not less than a first preset duration and the starting state indicates that the vehicle is not started to run, where the voice recognition function is a function of recognizing whether a voice signal is a distress signal;
the recognition module 303 is configured to recognize whether a distress signal exists in the vehicle based on a plurality of preset distress signals of the vehicle through the voice recognition function;
a sending module 304, configured to send an opening request to a user terminal of a specified user when the voice recognition function recognizes that a distress signal exists in the vehicle, where the opening request is used to instruct the user terminal to feed back an instruction instructing the vehicle to open a door or a window of the vehicle;
the opening module 302 is further configured to receive an instruction returned by the user terminal, and open a door or a window of the vehicle.
In a possible design, the recognition module 303 is further configured to obtain a plurality of preset distress signals from a designated storage space of the vehicle, obtain a current voice signal in the vehicle, and determine, through the voice recognition function, a matching degree between the voice signal and each preset distress signal; when the matching degree of the voice signal and any one of the plurality of preset distress signals is larger than a preset threshold value, determining that the distress signal exists in the vehicle.
In one possible design, the apparatus further includes:
the stopping module is used for stopping recognizing whether the distress signal exists in the vehicle or not when the vehicle does not have the distress signal within a second preset time after the voice recognition function is started or when the fact that the voice recognition function of the vehicle is closed is detected;
the determining module 301 is further configured to determine a closing time period of the doors and windows of the vehicle and an activation state of the vehicle when it is detected that the doors of the vehicle are opened and closed again.
In one possible design, the apparatus further includes:
the repeating module is used for repeatedly sending the opening request to the user terminal when an indication instruction returned by the user terminal is not received within a third preset time length after the opening request is sent to the user terminal; when the repetition times are more than the preset times, starting an alarm of the vehicle so that the alarm gives an alarm;
and the closing module is used for closing the alarm of the vehicle when detecting that the door or the window of the vehicle is opened.
In one possible design, the turn-on request carries the distress signal and/or an environmental image; correspondingly, the device also comprises:
and the shooting module is used for shooting the internal environment of the vehicle through the camera of the vehicle to obtain the environment image of the vehicle.
In the embodiment of the invention, when the closing of the vehicle door and the vehicle window is detected, the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle are determined, wherein the starting state is used for indicating whether the vehicle starts to run or does not start to run; when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start to run, starting a voice recognition function of the vehicle, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal; through the voice recognition function, whether the distress signal exists in the vehicle is recognized based on a plurality of preset distress signals of the vehicle; when a distress signal exists in the vehicle through the voice recognition function, sending an opening request to a user terminal of a designated user, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window; and receiving an instruction returned by the user terminal, and opening the vehicle door or the vehicle window of the vehicle. Because the vehicle-mounted terminal can automatically identify the distress signal sent by the person in the vehicle, and open the vehicle door or the vehicle window by combining the distress signal and the indication instruction of the user terminal, the safety of the person in the vehicle locked by mistake is ensured, and the safety of monitoring the vehicle is improved.
It should be noted that: in the device for monitoring a vehicle according to the above embodiment, when the vehicle is monitored, only the division of the functional modules is illustrated, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the device for monitoring the vehicle and the method for monitoring the vehicle provided by the embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment and is not described again.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (6)

1. A method of monitoring a vehicle, the method comprising:
when closing of a vehicle door and a vehicle window is detected, determining closing time of the vehicle door and the vehicle window and an activation state of the vehicle, wherein the activation state is used for indicating that the vehicle starts running or does not start running;
when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle does not start to run, starting a voice recognition function of the vehicle, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal;
identifying whether a distress signal exists in the vehicle based on a plurality of preset distress signals of the vehicle through the voice identification function;
when a distress signal exists in the vehicle through the voice recognition function, sending an opening request to a user terminal of a designated user, wherein the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window, the opening request carries the distress signal and/or an environment image, the environment image of the vehicle is obtained by shooting the internal environment of the vehicle through a camera of the vehicle, and the environment image is used for displaying the environment in the vehicle and personnel in the vehicle;
receiving an instruction returned by the user terminal, wherein the instruction is used for instructing to open a vehicle door or a vehicle window of the vehicle, or the instruction is used for instructing not to open the vehicle door or the vehicle window of the vehicle, and the instruction carries a vehicle door identifier or a vehicle window identifier selected by a user;
acquiring the vehicle door mark or the vehicle door mark to be opened according to the indication instruction, and opening or not opening the vehicle door or the vehicle window of the vehicle according to the indication instruction;
when the vehicle does not have a distress signal within a second preset time after the voice recognition function is started, or when the voice recognition function of the vehicle is detected to be closed, stopping recognizing whether the distress signal exists in the vehicle, wherein the second preset time is longer than the first preset time;
when it is detected that the doors of the vehicle are opened and closed again, the step of determining the closing time periods of the doors and windows of the vehicle and the starting state of the vehicle is performed.
2. The method of claim 1, wherein said identifying, by the voice recognition function, whether a distress signal is present in the vehicle based on a plurality of preset distress signals of the vehicle comprises:
acquiring a plurality of preset distress signals from a designated storage space of the vehicle, acquiring a current voice signal in the vehicle, and determining the matching degree between the voice signal and each preset distress signal through the voice recognition function;
and when the matching degree of the voice signal and any one of the plurality of preset distress signals is greater than a preset threshold value, determining that the distress signal exists in the vehicle.
3. The method of claim 1, further comprising:
when an instruction returned by the user terminal is not received within a third preset time after the opening request is sent to the user terminal, the opening request is repeatedly sent to the user terminal;
when the repetition times are greater than the preset times, starting an alarm of the vehicle so that the alarm gives an alarm;
and when the opening of the door or the window of the vehicle is detected, closing the alarm of the vehicle.
4. An apparatus for monitoring a vehicle, the apparatus comprising:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle when the closing of the vehicle door and the vehicle window is detected, and the starting state is used for indicating whether the vehicle starts to run or not;
the starting module is used for starting a voice recognition function of the vehicle when the closing time length is not less than a first preset time length and the starting state indicates that the vehicle is not started to run, wherein the voice recognition function is a function of recognizing whether a voice signal is a distress signal;
the recognition module is used for recognizing whether the distress signal exists in the vehicle or not based on a plurality of preset distress signals of the vehicle through the voice recognition function;
the sending module is used for sending an opening request to a user terminal of a designated user when the help signal exists in the vehicle through the voice recognition function, the opening request is used for indicating the user terminal to feed back an indication instruction for indicating the vehicle to open a vehicle door or a vehicle window, the opening request carries the help signal and/or an environment image,
the shooting module is used for shooting the internal environment of the vehicle through a camera of the vehicle to obtain an environment image of the vehicle, and the environment image is used for displaying the environment in the vehicle and personnel in the vehicle;
the opening module is further configured to receive an instruction returned by the user terminal, where the instruction is used to instruct to open a door or a window of the vehicle, or the instruction is used to instruct not to open the door or the window of the vehicle, and the instruction carries a door identifier or a window identifier selected by a user; the vehicle door or window identification device is also used for acquiring the vehicle door or window identification to be opened according to the indication instruction, and opening or not opening the vehicle door or window according to the indication instruction;
the stopping module is used for stopping recognizing whether the distress signal exists in the vehicle or not when the vehicle does not have the distress signal within a second preset time after the voice recognition function is started or when the voice recognition function of the vehicle is detected to be closed, wherein the second preset time is longer than the first preset time;
the determining module is further used for determining the closing time length of the vehicle door and the vehicle window and the starting state of the vehicle when the vehicle door of the vehicle is detected to be opened and closed again.
5. The apparatus of claim 4,
the recognition module is further used for acquiring a plurality of preset distress signals from a designated storage space of the vehicle, acquiring a current voice signal in the vehicle, and determining the matching degree between the voice signal and each preset distress signal through the voice recognition function; and when the matching degree of the voice signal and any one of the plurality of preset distress signals is greater than a preset threshold value, determining that the distress signal exists in the vehicle.
6. The apparatus of claim 4, further comprising:
the repeating module is used for repeatedly sending the opening request to the user terminal when an indication instruction returned by the user terminal is not received within a third preset time after the opening request is sent to the user terminal; when the repetition times are greater than the preset times, starting an alarm of the vehicle so that the alarm gives an alarm;
and the closing module is used for closing the alarm of the vehicle when detecting that the door or the window of the vehicle is opened.
CN201711427692.8A 2017-12-26 2017-12-26 Method and device for monitoring a vehicle Active CN108162903B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711427692.8A CN108162903B (en) 2017-12-26 2017-12-26 Method and device for monitoring a vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711427692.8A CN108162903B (en) 2017-12-26 2017-12-26 Method and device for monitoring a vehicle

Publications (2)

Publication Number Publication Date
CN108162903A CN108162903A (en) 2018-06-15
CN108162903B true CN108162903B (en) 2020-08-04

Family

ID=62520669

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711427692.8A Active CN108162903B (en) 2017-12-26 2017-12-26 Method and device for monitoring a vehicle

Country Status (1)

Country Link
CN (1) CN108162903B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7115216B2 (en) * 2018-10-24 2022-08-09 トヨタ自動車株式会社 Information processing device and information processing method
CN110001566B (en) * 2019-03-25 2022-02-01 奇瑞汽车股份有限公司 In-vehicle life body protection method and device and computer readable storage medium
CN110962739A (en) * 2019-12-24 2020-04-07 江西麦克斯韦科技有限公司 Alarm system and alarm method for preventing passengers in vehicle from suffocating
CN114194134A (en) * 2020-09-02 2022-03-18 上海博汽智能科技有限公司 Vehicle-mounted detection system
CN114793334B (en) * 2022-06-21 2022-10-14 广州万协通信息技术有限公司 Rescue calling method, device, equipment and storage medium based on Internet of vehicles

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205034058U (en) * 2015-09-10 2016-02-17 清华大学苏州汽车研究院(相城) Infant alarm system in car that passes into silence
CN205336323U (en) * 2015-12-17 2016-06-22 北京汽车研究总院有限公司 A reminding device and car for preventing in life entity omission car
CN106427869A (en) * 2016-11-10 2017-02-22 北京小米移动软件有限公司 Vehicle control method and vehicle control device
CN106494342A (en) * 2016-10-26 2017-03-15 浙江吉利控股集团有限公司 A kind of child Liu Che safety systems and its method
CN206124970U (en) * 2016-10-18 2017-04-26 惠州经济职业技术学院 Detection and succour system in stranded car of children

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6922622B2 (en) * 1999-06-03 2005-07-26 Robert Bosch Corporation Hot vehicle safety system and methods of preventing passenger entrapment and heat suffocation
CN102521945A (en) * 2011-12-02 2012-06-27 无锡奥盛信息科技有限公司 Calling detection alarming method and device
CN105162962B (en) * 2015-08-05 2018-05-08 广东小天才科技有限公司 A kind of automatic calling for help method and terminal
CN205486640U (en) * 2015-12-29 2016-08-17 江苏罗思韦尔电气有限公司 Human detection alarm device in car
CN105774653A (en) * 2016-02-26 2016-07-20 奇瑞汽车股份有限公司 Vehicle safety monitoring system based on internet of vehicles

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205034058U (en) * 2015-09-10 2016-02-17 清华大学苏州汽车研究院(相城) Infant alarm system in car that passes into silence
CN205336323U (en) * 2015-12-17 2016-06-22 北京汽车研究总院有限公司 A reminding device and car for preventing in life entity omission car
CN206124970U (en) * 2016-10-18 2017-04-26 惠州经济职业技术学院 Detection and succour system in stranded car of children
CN106494342A (en) * 2016-10-26 2017-03-15 浙江吉利控股集团有限公司 A kind of child Liu Che safety systems and its method
CN106427869A (en) * 2016-11-10 2017-02-22 北京小米移动软件有限公司 Vehicle control method and vehicle control device

Also Published As

Publication number Publication date
CN108162903A (en) 2018-06-15

Similar Documents

Publication Publication Date Title
CN108162903B (en) Method and device for monitoring a vehicle
CN106627490B (en) The automobile trunk switching control system and method for identity-based identification and speech recognition
CN108263325A (en) A kind of interior omission life entity detecting system based on image processing techniques
CN110001566B (en) In-vehicle life body protection method and device and computer readable storage medium
CN104627124A (en) Automatic opening system and method of automotive rear gate
CN105279872A (en) Anti-theft monitoring device and monitoring system for entrance door
CN110430393B (en) Monitoring method and system
CN109555406B (en) Device and method for preventing children from being trapped in vehicle
CN106627457A (en) In-vehicle people staying detecting and warning system
CN108119003A (en) For enhancing the system and method for garage door opener remote control
CN205080681U (en) Register one's residence door electronic monitoring device
CN111599140A (en) Vehicle rear-row living body monitoring system and method
CN105788127A (en) Vehicle remote monitoring and pre-warning system and method thereof
CN109532665B (en) Anti-suffocation system for vehicle and method thereof
CN105150923A (en) Automobile riding child high temperature protection device started through door handle inside automobile
CN105225413A (en) A kind of automobile-used automatic alarm and salvage system
CN111038209A (en) Vehicle-mounted air conditioner starting method and device
Visconti et al. Innovative complete solution for health safety of children unintentionally forgotten in a car: a smart Arduino‐based system with user app for remote control
CN110816474A (en) Anti-theft system and method based on 360-degree look-around
CN105261149B (en) Prevent that child from passing into silence the device and method in automobile
CN114312648A (en) Vehicle interior dynamic target monitoring device, monitoring system and method
CN108573584A (en) Intelligent sound and monitoring system and method based on intelligent sound
JP2014170316A (en) Monitoring system
CN105599708B (en) Vehicle temperature control device
CN114463934A (en) Car locking detection alarm system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180531

Address after: 241000 Huajing South Road, Yijiang District, Wuhu, Anhui 226

Applicant after: New-energy automobile Technology Co., Ltd. of Cherry

Address before: 241006 Changchun Road, Wuhu economic and Technological Development Zone, Wuhu, Anhui, 8

Applicant before: Saic Chery Automobile Co., Ltd.

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 241000 no.226, South Huajin Road, Wuhu high tech Industrial Development Zone, Wuhu City, Anhui Province

Applicant after: Chery New Energy Automobile Co.,Ltd.

Address before: 241000 No. 226 Hua Jin South Road, Yijiang District, Anhui, Wuhu

Applicant before: CHERY NEW ENERGY AUTOMOBILE TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant