CN113990033A - Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles - Google Patents

Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles Download PDF

Info

Publication number
CN113990033A
CN113990033A CN202111060113.7A CN202111060113A CN113990033A CN 113990033 A CN113990033 A CN 113990033A CN 202111060113 A CN202111060113 A CN 202111060113A CN 113990033 A CN113990033 A CN 113990033A
Authority
CN
China
Prior art keywords
vehicle
driver
rescue
mounted terminal
traffic accident
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111060113.7A
Other languages
Chinese (zh)
Inventor
王浩业
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Rongcai Transportation Technology Research Institute Co ltd
Original Assignee
Nanjing Rongcai Transportation Technology Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Rongcai Transportation Technology Research Institute Co ltd filed Critical Nanjing Rongcai Transportation Technology Research Institute Co ltd
Priority to CN202111060113.7A priority Critical patent/CN113990033A/en
Publication of CN113990033A publication Critical patent/CN113990033A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/08Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/20Monitoring the location of vehicles belonging to a group, e.g. fleet of vehicles, countable or determined number of vehicles
    • G08G1/202Dispatching vehicles on the basis of a location, e.g. taxi dispatching
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00Speaker identification or verification
    • G10L17/22Interactive procedures; Man-machine interfaces
    • G10L17/24Interactive procedures; Man-machine interfaces the user being prompted to utter a password or a predefined phrase
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/27Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique
    • G10L25/30Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique using neural networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The invention discloses a vehicle traffic accident remote takeover rescue method and system based on a 5G internet of vehicles, wherein the method comprises the following steps: the 5G vehicle-mounted terminal in the vehicle automatically detects the running state of the vehicle; if the vehicle running state is abnormal, the 5G vehicle-mounted terminal detects the state of the driver once at preset time intervals; if the driver is in a coma state, the 5G vehicle-mounted terminal informs the rescue vehicle of providing vehicle rescue service; if the driver is in a waking state, the 5G vehicle-mounted terminal inquires whether the driver requires vehicle rescue service; and predicting a vehicle traffic accident frequent region by collecting the position information of the vehicle traffic accidents in the past year, and arranging a rescue vehicle in the vehicle traffic accident frequent region. Has the advantages that: the invention can accurately and flexibly know the specific injury of the driver in the vehicle, and the 5G vehicle-mounted terminal is intelligently communicated with the driver, thereby realizing the optimal solution of resource utilization.

Description

Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles
Technical Field
The invention relates to the field of traffic safety rescue, in particular to a vehicle traffic accident remote takeover rescue method and system based on a 5G internet of vehicles.
Background
The Internet of Vehicles (IoV) belongs to the Internet of Things (IoT) and is a huge interactive network formed by information such as vehicle position, speed and route. As the evolution of LTE, 5G has a delay of up to 1ms, has a higher bandwidth, supports a larger number of connections, and also supports a higher mobility speed.
The combination of 5G and Internet of vehicles technology will enhance the external communication capability of the vehicle. When a traffic accident happens to the vehicle, a driver is quite possibly unconscious, and the ability of seeking help to a third party and a traffic police when the traffic accident happens to the vehicle can be enhanced through the 5G vehicle networking technology.
A remote rescue method for vehicle traffic accidents in the prior art, such as Chinese patent No. CN103413411B, discloses an active rescue system for major traffic accidents based on the Internet of vehicles, which comprises a vehicle-mounted terminal, a monitoring center upper computer system, an emergency alarm terminal and a mobile internet, wherein the vehicle-mounted terminal activates an alarm program when the vehicle speed is greater than or equal to a certain set threshold value, continuously detects two variables of vehicle acceleration and speed zero-approaching time, triggers an alarm when the two variables both accord with the design threshold value, and sends out voice and buzzing sound alarm to draw attention of pedestrians and nearby residents so as to obtain short-distance rapid rescue. However, the system cannot accurately and flexibly know the specific injury of the driver in the vehicle, and further cannot achieve the optimal solution of resource utilization.
An effective solution to the problems in the related art has not been proposed yet.
Disclosure of Invention
Aiming at the problems in the related art, the invention provides a vehicle traffic accident remote takeover rescue method and system based on a 5G vehicle networking, so as to overcome the technical problems in the prior related art.
Therefore, the invention adopts the following specific technical scheme:
according to one aspect of the invention, a vehicle traffic accident remote takeover rescue method based on 5G internet of vehicles is provided, and the method comprises the following steps:
s1, automatically detecting the vehicle running state by the in-vehicle 5G vehicle-mounted terminal;
s2, if the vehicle running state is abnormal, the 5G vehicle-mounted terminal detects the state of the driver once at preset time intervals;
s3, if the driver is in a coma state, the 5G vehicle-mounted terminal informs the rescue vehicle to provide vehicle rescue service, and provides vehicle position information and personnel information to medical departments and traffic departments near the vehicle;
s4, if the driver is in a waking state, the 5G vehicle-mounted terminal inquires whether the driver requires the vehicle rescue service;
s5, forecasting the frequent area of the vehicle traffic accidents by collecting the position information of the vehicle traffic accidents in the past year, and arranging rescue vehicles in the frequent area of the vehicle traffic accidents.
Further, the step of automatically detecting the vehicle driving state by the in-vehicle 5G vehicle-mounted terminal in S1 further includes the following steps:
s11, connecting a triggering device in the 5G vehicle-mounted terminal with a vehicle airbag sensor, and arranging an acceleration sensor in the 5G vehicle-mounted terminal;
and S12, if the vehicle safety air bag sensor is started or the acceleration value measured by the acceleration sensor reaches or exceeds the design threshold value and the vehicle running speed is less than 5km/h, judging that the vehicle running state is abnormal.
Further, in S2, the 5G in-vehicle terminal detects the state of the driver through the high definition camera.
Further, the number of times the 5G in-vehicle terminal detects the state of the driver is set to at least five times in S2.
Further, the step of detecting the state of the driver by the 5G vehicle-mounted terminal in S2 further includes:
s21, acquiring a collecting picture of the vehicle driving seat through a high-definition camera, setting the first sampling as a first frame, and sampling at a time interval of T seconds as a current frame;
s22, dividing the collected picture into M regions, selecting the central lines of the M regions divided in the X direction or the central lines of the N regions divided in the Y direction as pixel points;
s23, comparing the pixel point of any central line of the current frame with the pixel point of the corresponding central line of the first frame to obtain the difference of the pixel points, if the difference is greater than a first threshold value, judging that the pixel point is different, and if the difference is greater than a second threshold value, judging that the current frame is different from the first frame;
s24, if the times of judging that the pixel points are different are larger than a third threshold value, judging that the current frame is different from the first frame;
and S25, if the current frame is different from the first frame, the driver is in a coma state, otherwise, the driver is in a wakeful state.
Further, in S4, if the driver is awake, the 5G in-vehicle terminal inquiring whether the driver requests the provision of the vehicle rescue service further includes:
s41, if the driver confirms to receive the vehicle rescue service, the 5G vehicle-mounted terminal informs the rescue vehicle of providing the vehicle rescue service;
and S42, if the driver does not accept the vehicle rescue service, the voice print password needs to be input into the 5G vehicle-mounted terminal.
Further, if the driver does not receive the vehicle rescue service in S42, the step of inputting the voiceprint password signal to the 5G vehicle-mounted terminal further includes:
s421, acquiring voice information of a driver, and removing background sound in the voice information to obtain voice of a person;
s422, acquiring a voiceprint password signal in the human voice, and converting the voiceprint password signal into a digital signal through an A/D converter;
s423, eliminating vocal cords and lip effects of the digital signals, passing the digital signals through a high-pass filter, and simultaneously performing discrete FFT (fast Fourier transform) on each frame of digital signals;
s424, inputting the digital signal into the RBF neural network recognition model, and distinguishing whether the digital signal is a voiceprint of the driver, if so, determining that the driver does not accept vehicle rescue service;
and the RBF neural network recognition model is trained and constructed by inputting voiceprints processed by voice of a passing driver into the RBF neural network model.
Further, the step of removing the background sound in the voice information to obtain the human voice in S421 further includes the following steps:
performing framing, windowing and time-frequency conversion on voice information of a driver to obtain an original mixed signal amplitude spectrum and an original mixed signal phase spectrum;
inputting the original mixed signal amplitude spectrum into a convolutional neural network to obtain a low-resolution characteristic diagram;
inputting the low-resolution feature map and the original mixed signal amplitude spectrum into a recurrent neural network to obtain a human voice predicted value and a background voice predicted value;
combining the human voice predicted value and the background voice predicted value with the phase spectrum of the original mixed signal, performing inverse Fourier transform to obtain a human voice signal and a background voice signal, and simultaneously removing the background voice signal.
Further, the predicting the area where the vehicle traffic accident is frequently generated by collecting the past year vehicle traffic accident location information in S5 further includes the following steps:
s51, collecting the traffic accident position information of the vehicles in the past year;
s52, training a GM grey prediction model through the position information of the traffic accident of the vehicle in the past year;
s53, predicting the vehicle traffic accident frequent region on any day through the GM grey prediction model, and arranging a rescue vehicle in the vehicle traffic accident frequent region on the same day.
According to another aspect of the present invention, there is provided a vehicle traffic accident remote takeover rescue system based on 5G internet of vehicles, the system comprising: the device comprises a vehicle running state detection module, a driver state detection module and a prediction module;
the vehicle running state detection module is used for automatically detecting the vehicle running state through a 5G vehicle-mounted terminal;
the driver state detection module is used for detecting the state of the driver once by the 5G vehicle-mounted terminal at preset time intervals if the driving state of the vehicle is abnormal, informing the rescue vehicle to provide vehicle rescue service if the driver is in a coma state, and providing vehicle position information and personnel information to medical departments and traffic departments nearby the vehicle, and inquiring whether the driver requires the vehicle rescue service by the 5G vehicle-mounted terminal if the driver is in a waking state;
the prediction module is used for collecting the position information of the traffic accidents of vehicles in the past year, predicting the frequent traffic accident areas of the vehicles and setting rescue vehicles in the frequent traffic accident areas of the vehicles.
The invention has the beneficial effects that: compared with the prior art, the vehicle traffic accident remote takeover rescue method and system based on the 5G internet of vehicles can automatically judge the state of the vehicle and the state of a driver, so that the intellectualization and automation level of remote takeover rescue is improved, and the labor cost can be reduced. And the state of the driver is detected, so that the specific injury of the driver in the vehicle can be accurately and flexibly known, and the 5G vehicle-mounted terminal is intelligently communicated with the driver, so that the optimal solution of resource utilization can be realized. Background sound in the voice information of the driver is removed, so that a voiceprint password signal of the driver can be accurately transmitted to the 5G vehicle-mounted terminal. By predicting the frequent area of the vehicle traffic accidents every day, the rescue efficiency of the vehicle traffic accidents can be improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a flowchart of a vehicle traffic accident remote takeover rescue method based on a 5G internet of vehicles according to an embodiment of the invention.
Detailed Description
For further explanation of the various embodiments, the drawings which form a part of the disclosure and which are incorporated in and constitute a part of this specification, illustrate embodiments and, together with the description, serve to explain the principles of operation of the embodiments, and to enable others of ordinary skill in the art to understand the various embodiments and advantages of the invention, and, by reference to these figures, reference is made to the accompanying drawings, which are not to scale and wherein like reference numerals generally refer to like elements.
According to the embodiment of the invention, a vehicle traffic accident remote takeover rescue method and system based on the 5G internet of vehicles are provided.
Referring now to the drawings and the detailed description, the invention is further illustrated, as shown in fig. 1, according to one aspect of the invention, there is provided a vehicle traffic accident remote takeover rescue method based on 5G car networking, the method comprising the following steps:
s1, automatically detecting the vehicle running state by the in-vehicle 5G vehicle-mounted terminal;
wherein, the step of automatically detecting the vehicle driving state by the in-vehicle 5G vehicle-mounted terminal in the vehicle in S1 further comprises the following steps:
s11, connecting a triggering device in the 5G vehicle-mounted terminal with a vehicle airbag sensor, and arranging an acceleration sensor in the 5G vehicle-mounted terminal;
and S12, if the vehicle airbag sensor is started or the acceleration value measured by the acceleration sensor reaches or exceeds a design threshold value and the vehicle running speed is less than 5km/h, judging that the vehicle running state is abnormal (when the vehicle running state is abnormal, starting an alarm in a 5G vehicle-mounted terminal for warning nearby passers-by and prompting the personnel to carry out personnel rescue in the future).
S2, if the vehicle running state is abnormal, the 5G vehicle-mounted terminal detects the state of the driver once at preset time intervals;
and in the step S2, the 5G vehicle-mounted terminal detects the state of the driver through the high-definition camera. The number of times that the 5G in-vehicle terminal detects the state of the driver is set to at least five times.
The 5G vehicle-mounted terminal in the S2 further comprises the following steps of:
s21, acquiring a collecting picture of the vehicle driving seat through a high-definition camera, setting the first sampling as a first frame, and sampling at a time interval of T seconds as a current frame;
s22, dividing the collected picture into M regions, selecting the central lines of the M regions divided in the X direction or the central lines of the N regions divided in the Y direction as pixel points;
s23, comparing the pixel point of any central line of the current frame with the pixel point of the corresponding central line of the first frame to obtain the difference of the pixel points, if the difference is greater than a first threshold value, judging that the pixel point is different, and if the difference is greater than a second threshold value, judging that the current frame is different from the first frame;
s24, if the times of judging that the pixel points are different are larger than a third threshold value, judging that the current frame is different from the first frame;
and S25, if the current frame is different from the first frame, the driver is in a coma state, otherwise, the driver is in a wakeful state.
S3, if the driver is in a coma state, the 5G vehicle-mounted terminal informs the rescue vehicle to provide vehicle rescue service, and provides vehicle position information and personnel information to medical departments and traffic departments near the vehicle;
s4, if the driver is in a waking state, the 5G vehicle-mounted terminal inquires whether the driver requires the vehicle rescue service;
wherein, if the driver is in the waking state in S4, the step of inquiring whether the driver requests the vehicle rescue service by the 5G in-vehicle terminal further comprises:
s41, if the driver confirms to receive the vehicle rescue service, the 5G vehicle-mounted terminal informs the rescue vehicle of providing the vehicle rescue service;
and S42, if the driver does not accept the vehicle rescue service, the voice print password needs to be input into the 5G vehicle-mounted terminal.
Wherein, if the driver does not accept the vehicle rescue service in S42, the step of inputting the voiceprint password signal to the 5G vehicle-mounted terminal further includes:
s421, acquiring voice information of a driver, and removing background sound in the voice information to obtain voice of a person;
s422, acquiring a voiceprint password signal in the human voice, and converting the voiceprint password signal into a digital signal through an A/D converter;
s423, eliminating vocal cords and lip effects of the digital signals, passing the digital signals through a high-pass filter, and simultaneously performing discrete FFT (fast Fourier transform) on each frame of digital signals;
s424, inputting the digital signal into the RBF neural network recognition model, and distinguishing whether the digital signal is a voiceprint of the driver, if so, determining that the driver does not accept vehicle rescue service;
and the RBF neural network recognition model is trained and constructed by inputting voiceprints processed by voice of a passing driver into the RBF neural network model.
In S421, the step of removing the background sound in the speech information to obtain the human speech further includes the following steps:
performing framing, windowing and time-frequency conversion on voice information of a driver to obtain an original mixed signal amplitude spectrum and an original mixed signal phase spectrum;
inputting the original mixed signal amplitude spectrum into a convolutional neural network to obtain a low-resolution characteristic diagram;
inputting the low-resolution feature map and the original mixed signal amplitude spectrum into a recurrent neural network to obtain a human voice predicted value and a background voice predicted value;
combining the human voice predicted value and the background voice predicted value with the phase spectrum of the original mixed signal, performing inverse Fourier transform to obtain a human voice signal and a background voice signal, and simultaneously removing the background voice signal.
S5, forecasting the frequent area of the vehicle traffic accidents by collecting the position information of the vehicle traffic accidents in the past year, and arranging rescue vehicles in the frequent area of the vehicle traffic accidents.
Wherein, the predicting the area where the vehicle traffic accident frequently occurs by collecting the past year vehicle traffic accident location information in S5 further comprises the steps of:
s51, collecting the traffic accident position information of the vehicles in the past year;
s52, training a GM grey prediction model through the position information of the traffic accident of the vehicle in the past year;
s53, predicting the vehicle traffic accident frequent region on any day through the GM grey prediction model, and arranging a rescue vehicle in the vehicle traffic accident frequent region on the same day.
According to another aspect of the present invention, there is provided a vehicle traffic accident remote takeover rescue system based on 5G internet of vehicles, the system comprising: the device comprises a vehicle running state detection module, a driver state detection module and a prediction module; the vehicle running state detection module is used for automatically detecting the vehicle running state through the 5G vehicle-mounted terminal; the driver state detection module is used for detecting the state of the driver once by the 5G vehicle-mounted terminal at preset time intervals if the driving state of the vehicle is abnormal, informing the rescue vehicle to provide vehicle rescue service if the driver is in a coma state, and providing vehicle position information and personnel information to medical departments and traffic departments nearby the vehicle, and inquiring whether the driver requires the vehicle rescue service by the 5G vehicle-mounted terminal if the driver is in a waking state; the prediction module is used for collecting the position information of the traffic accidents of vehicles in the past year, predicting the frequent traffic accident areas of the vehicles and setting rescue vehicles in the frequent traffic accident areas of the vehicles.
In conclusion, compared with the prior art, the vehicle traffic accident remote takeover rescue method and system based on the 5G internet of vehicles can automatically judge the state of the vehicle and the state of the driver, so that the intellectualization and automation level of remote takeover rescue is improved, and the labor cost can be reduced. And the state of the driver is detected, so that the specific injury of the driver in the vehicle can be accurately and flexibly known, and the 5G vehicle-mounted terminal is intelligently communicated with the driver, so that the optimal solution of resource utilization can be realized. Background sound in the voice information of the driver is removed, so that a voiceprint password signal of the driver can be accurately transmitted to the 5G vehicle-mounted terminal. By predicting the frequent area of the vehicle traffic accidents every day, the rescue efficiency of the vehicle traffic accidents can be improved.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (10)

1. Vehicle traffic accident remote taking-over rescue method based on 5G Internet of vehicles is characterized by comprising the following steps:
s1, automatically detecting the vehicle running state by the in-vehicle 5G vehicle-mounted terminal;
s2, if the vehicle running state is abnormal, the 5G vehicle-mounted terminal detects the state of the driver once at preset time intervals;
s3, if the driver is in a coma state, the 5G vehicle-mounted terminal informs the rescue vehicle to provide vehicle rescue service, and provides vehicle position information and personnel information to medical departments and traffic departments near the vehicle;
s4, if the driver is in a waking state, the 5G vehicle-mounted terminal inquires whether the driver requires the vehicle rescue service;
s5, forecasting the frequent area of the vehicle traffic accidents by collecting the position information of the vehicle traffic accidents in the past year, and arranging rescue vehicles in the frequent area of the vehicle traffic accidents.
2. The vehicle traffic accident remote takeover rescue method based on 5G internet of vehicles according to claim 1, wherein the step of automatically detecting the vehicle driving state by the in-vehicle 5G vehicle-mounted terminal in S1 further comprises the following steps:
s11, connecting a triggering device in the 5G vehicle-mounted terminal with a vehicle airbag sensor, and arranging an acceleration sensor in the 5G vehicle-mounted terminal;
and S12, if the vehicle safety air bag sensor is started or the acceleration value measured by the acceleration sensor reaches or exceeds the design threshold value and the vehicle running speed is less than 5km/h, judging that the vehicle running state is abnormal.
3. The vehicle traffic accident remote takeover rescue method based on the 5G internet of vehicles according to claim 1, wherein the 5G vehicle-mounted terminal in the S2 detects the state of the driver through a high-definition camera.
4. The vehicle traffic accident remote takeover rescue method based on the 5G internet of vehicles according to claim 3, characterized in that the number of times that the 5G vehicle-mounted terminal detects the state of the driver in S2 is set to be at least five times.
5. The vehicle traffic accident remote takeover rescue method based on the 5G internet of vehicles according to claim 5, wherein the detection of the state of the driver by the 5G vehicle-mounted terminal in S2 further comprises the following steps:
s21, acquiring a collecting picture of the vehicle driving seat through a high-definition camera, setting the first sampling as a first frame, and sampling at a time interval of T seconds as a current frame;
s22, dividing the collected picture into M regions, selecting the central lines of the M regions divided in the X direction or the central lines of the N regions divided in the Y direction as pixel points;
s23, comparing the pixel point of any central line of the current frame with the pixel point of the corresponding central line of the first frame to obtain the difference of the pixel points, if the difference is greater than a first threshold value, judging that the pixel point is different, and if the difference is greater than a second threshold value, judging that the current frame is different from the first frame;
s24, if the times of judging that the pixel points are different are larger than a third threshold value, judging that the current frame is different from the first frame;
and S25, if the current frame is different from the first frame, the driver is in a coma state, otherwise, the driver is in a wakeful state.
6. The vehicle traffic accident remote takeover rescue method based on 5G internet of vehicles according to claim 1, wherein if the driver is awake in S4, the 5G vehicle-mounted terminal inquiring whether the driver requires vehicle rescue services further comprises the following steps:
s41, if the driver confirms to receive the vehicle rescue service, the 5G vehicle-mounted terminal informs the rescue vehicle of providing the vehicle rescue service;
and S42, if the driver does not accept the vehicle rescue service, the voice print password needs to be input into the 5G vehicle-mounted terminal.
7. The vehicle traffic accident remote takeover rescue method based on 5G Internet of vehicles according to claim 6, wherein if the driver does not accept the vehicle rescue service in S42, the step of inputting the voiceprint password signal to the 5G vehicle-mounted terminal further comprises the following steps:
s421, acquiring voice information of a driver, and removing background sound in the voice information to obtain voice of a person;
s422, acquiring a voiceprint password signal in the human voice, and converting the voiceprint password signal into a digital signal through an A/D converter;
s423, eliminating vocal cords and lip effects of the digital signals, passing the digital signals through a high-pass filter, and simultaneously performing discrete FFT (fast Fourier transform) on each frame of digital signals;
s424, inputting the digital signal into the RBF neural network recognition model, and distinguishing whether the digital signal is a voiceprint of the driver, if so, determining that the driver does not accept vehicle rescue service;
and the RBF neural network recognition model is trained and constructed by inputting voiceprints processed by voice of a passing driver into the RBF neural network model.
8. The vehicle traffic accident remote takeover rescue method based on 5G internet of vehicles according to claim 7, wherein the step of eliminating the background sound in the voice information to obtain the human voice in S421 further comprises the steps of:
performing framing, windowing and time-frequency conversion on voice information of a driver to obtain an original mixed signal amplitude spectrum and an original mixed signal phase spectrum;
inputting the original mixed signal amplitude spectrum into a convolutional neural network to obtain a low-resolution characteristic diagram;
inputting the low-resolution feature map and the original mixed signal amplitude spectrum into a recurrent neural network to obtain a human voice predicted value and a background voice predicted value;
combining the human voice predicted value and the background voice predicted value with the phase spectrum of the original mixed signal, performing inverse Fourier transform to obtain a human voice signal and a background voice signal, and simultaneously removing the background voice signal.
9. The vehicle traffic accident remote takeover rescue method based on 5G internet of vehicles according to claim 1, wherein the step of predicting the frequent vehicle traffic accident area by collecting the past vehicle traffic accident location information in S5 further comprises the steps of:
s51, collecting the traffic accident position information of the vehicles in the past year;
s52, training a GM grey prediction model through the position information of the traffic accident of the vehicle in the past year;
s53, predicting the vehicle traffic accident frequent region on any day through the GM grey prediction model, and arranging a rescue vehicle in the vehicle traffic accident frequent region on the same day.
10. The vehicle traffic accident remote takeover rescue system based on the 5G Internet of vehicles is used for realizing the vehicle traffic accident remote takeover rescue method based on the 5G Internet of vehicles, which is characterized by comprising the following steps: the device comprises a vehicle running state detection module, a driver state detection module and a prediction module;
the vehicle running state detection module is used for automatically detecting the vehicle running state through a 5G vehicle-mounted terminal;
the driver state detection module is used for detecting the state of the driver once by the 5G vehicle-mounted terminal at preset time intervals if the driving state of the vehicle is abnormal, informing the rescue vehicle to provide vehicle rescue service if the driver is in a coma state, and providing vehicle position information and personnel information to medical departments and traffic departments nearby the vehicle, and inquiring whether the driver requires the vehicle rescue service by the 5G vehicle-mounted terminal if the driver is in a waking state;
the prediction module is used for collecting the position information of the traffic accidents of vehicles in the past year, predicting the frequent traffic accident areas of the vehicles and setting rescue vehicles in the frequent traffic accident areas of the vehicles.
CN202111060113.7A 2021-09-10 2021-09-10 Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles Pending CN113990033A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111060113.7A CN113990033A (en) 2021-09-10 2021-09-10 Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111060113.7A CN113990033A (en) 2021-09-10 2021-09-10 Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles

Publications (1)

Publication Number Publication Date
CN113990033A true CN113990033A (en) 2022-01-28

Family

ID=79735574

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111060113.7A Pending CN113990033A (en) 2021-09-10 2021-09-10 Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles

Country Status (1)

Country Link
CN (1) CN113990033A (en)

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1291320A (en) * 1998-01-15 2001-04-11 卡鲁斯·马格努斯有限公司 Method and device for detecting drowsiness and proventing a driver of motor vehicle from falling asleep
CN101035344A (en) * 2007-04-24 2007-09-12 中兴通讯股份有限公司 Motion detection method and system applied at the mobile monitoring terminal
CN101950355A (en) * 2010-09-08 2011-01-19 中国人民解放军国防科学技术大学 Method for detecting fatigue state of driver based on digital video
CN103413411A (en) * 2013-08-21 2013-11-27 苏州路车智能电子有限公司 Important traffic accident active rescuing system based on internet of vehicles
CN105321340A (en) * 2015-11-23 2016-02-10 上海汽车集团股份有限公司 Vehicle-road-communication-based rescue signal sending method, device and vehicle
WO2016165350A1 (en) * 2015-09-14 2016-10-20 中兴通讯股份有限公司 Accident reporting method and device, and mobile terminal
CN107067677A (en) * 2017-03-20 2017-08-18 广东翼卡车联网服务有限公司 One kind visualization safe rescue method and system
CN107798418A (en) * 2017-09-28 2018-03-13 东南大学 A kind of traffic accident frequency Forecasting Methodology based on traffic analysis cell
CN107818783A (en) * 2017-09-12 2018-03-20 普强信息技术(北京)有限公司 A kind of mutual method and device of man-machine multi-modal on-vehicle safety sexual intercourse based on vocal print technology
CN111439271A (en) * 2020-04-21 2020-07-24 上汽大众汽车有限公司 Auxiliary driving method and auxiliary driving equipment based on voice control
CN112078590A (en) * 2019-05-27 2020-12-15 郑州宇通客车股份有限公司 Driving behavior monitoring method and system
CN112201009A (en) * 2020-09-30 2021-01-08 宝能(西安)汽车研究院有限公司 Fatigue driving reminding method and system
CN212365179U (en) * 2020-04-30 2021-01-15 四川企易标信息科技有限公司 Traffic accident alarm system based on Internet of things
CN112259120A (en) * 2020-10-19 2021-01-22 成都明杰科技有限公司 Single-channel human voice and background voice separation method based on convolution cyclic neural network
CN112784695A (en) * 2020-12-31 2021-05-11 南京视察者智能科技有限公司 Driver abnormal state detection method based on image and voice recognition
CN113140093A (en) * 2021-04-26 2021-07-20 贵阳职业技术学院 Fatigue driving detection method based on AdaBoost algorithm
CN113345204A (en) * 2021-05-27 2021-09-03 云度新能源汽车有限公司 Vehicle-mounted remote fatigue awakening method and awakening system thereof

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1291320A (en) * 1998-01-15 2001-04-11 卡鲁斯·马格努斯有限公司 Method and device for detecting drowsiness and proventing a driver of motor vehicle from falling asleep
CN101035344A (en) * 2007-04-24 2007-09-12 中兴通讯股份有限公司 Motion detection method and system applied at the mobile monitoring terminal
CN101950355A (en) * 2010-09-08 2011-01-19 中国人民解放军国防科学技术大学 Method for detecting fatigue state of driver based on digital video
CN103413411A (en) * 2013-08-21 2013-11-27 苏州路车智能电子有限公司 Important traffic accident active rescuing system based on internet of vehicles
WO2016165350A1 (en) * 2015-09-14 2016-10-20 中兴通讯股份有限公司 Accident reporting method and device, and mobile terminal
CN106530686A (en) * 2015-09-14 2017-03-22 中兴通讯股份有限公司 Method and apparatus for reporting accident, and mobile terminal
CN105321340A (en) * 2015-11-23 2016-02-10 上海汽车集团股份有限公司 Vehicle-road-communication-based rescue signal sending method, device and vehicle
CN107067677A (en) * 2017-03-20 2017-08-18 广东翼卡车联网服务有限公司 One kind visualization safe rescue method and system
CN107818783A (en) * 2017-09-12 2018-03-20 普强信息技术(北京)有限公司 A kind of mutual method and device of man-machine multi-modal on-vehicle safety sexual intercourse based on vocal print technology
CN107798418A (en) * 2017-09-28 2018-03-13 东南大学 A kind of traffic accident frequency Forecasting Methodology based on traffic analysis cell
CN112078590A (en) * 2019-05-27 2020-12-15 郑州宇通客车股份有限公司 Driving behavior monitoring method and system
CN111439271A (en) * 2020-04-21 2020-07-24 上汽大众汽车有限公司 Auxiliary driving method and auxiliary driving equipment based on voice control
CN212365179U (en) * 2020-04-30 2021-01-15 四川企易标信息科技有限公司 Traffic accident alarm system based on Internet of things
CN112201009A (en) * 2020-09-30 2021-01-08 宝能(西安)汽车研究院有限公司 Fatigue driving reminding method and system
CN112259120A (en) * 2020-10-19 2021-01-22 成都明杰科技有限公司 Single-channel human voice and background voice separation method based on convolution cyclic neural network
CN112784695A (en) * 2020-12-31 2021-05-11 南京视察者智能科技有限公司 Driver abnormal state detection method based on image and voice recognition
CN113140093A (en) * 2021-04-26 2021-07-20 贵阳职业技术学院 Fatigue driving detection method based on AdaBoost algorithm
CN113345204A (en) * 2021-05-27 2021-09-03 云度新能源汽车有限公司 Vehicle-mounted remote fatigue awakening method and awakening system thereof

Similar Documents

Publication Publication Date Title
CN108428333B (en) Vehicle accident rescue equipment
CN111565250B (en) Intelligent vehicle-mounted telephone answering method and system and vehicle
US20170015242A1 (en) Method and system to warn of a vehicle moving in the wrong direction of travel
CN110366107A (en) Vehicle communication method and the device for using this method
CN104992571B (en) A kind of overspeed warning method and system based on mobile terminal
WO2022142571A1 (en) Prompt method and system for driving behavior of driver, and vehicle
CN110718058A (en) Active safety terminal-based expressway emergency lane occupation detection and disposal method
CN105761532A (en) Dynamic voice prompt method and vehicle system
JP2009075695A (en) Danger notification device and system
JP6075577B2 (en) Driving assistance device
CN108711202A (en) A kind of Traffic Accident Rescue System based on big data
CN209087142U (en) A kind of ring road inlet Emergency Vehicle Lane open system being driven out to highway
CN109743531B (en) Passenger alarm system and method for automatically driving train and vehicle-mounted alarm device
CN113096370A (en) Vehicle emergency rescue triggering method and device
JP2021182131A (en) Method, device and system, electronic device, computer readable storage medium and computer program for outputting information
US20220314988A1 (en) Vehicle speed control method, apparatus and device
CN109215354A (en) Signalized control road junction early warning system and method based on bus or train route collaboration
CN105761491A (en) Detection and early warning system for traffic accident
JP2001341644A (en) Operation control system
JP2002245588A6 (en) Emergency vehicle priority passage support system
CN113990033A (en) Vehicle traffic accident remote take-over rescue method and system based on 5G internet of vehicles
CN108449422A (en) A kind of automatic car-mounted terminal for reporting road accident
CN108769427A (en) A kind of method, apparatus of safe driving, storage medium and mobile unit
CN208572128U (en) A kind of car-mounted terminal reporting road accident automatically
CN206374652U (en) Intelligent bus automatic voice reminding control device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination