CN110580799A - taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system - Google Patents
taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system Download PDFInfo
- Publication number
- CN110580799A CN110580799A CN201910530614.3A CN201910530614A CN110580799A CN 110580799 A CN110580799 A CN 110580799A CN 201910530614 A CN201910530614 A CN 201910530614A CN 110580799 A CN110580799 A CN 110580799A
- Authority
- CN
- China
- Prior art keywords
- taxi
- module
- vehicle
- automatic
- alarm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/016—Personal emergency signalling and security systems
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
Abstract
The invention discloses an automatic pre-judging alarm system for taxi network appointment drivers and passengers, which comprises a taxi/network appointment vehicle enterprise management platform, an intelligent terminal and a vehicle-mounted camera, wherein the intelligent terminal and the vehicle-mounted camera are arranged on a taxi/network appointment vehicle, the intelligent terminal is provided with a navigation system, the vehicle-mounted camera is used for collecting limb actions and facial information of drivers and passengers, the vehicle-mounted camera and a multimedia module are respectively in wireless connection with the taxi/network appointment vehicle enterprise management platform, the system is used for transmitting collected language dialogue information, limb actions and facial information to a taxi/network appointment car-enterprise management platform, and the taxi/network appointment car-enterprise management platform compares and identifies the collected limb actions, facial information and language dialogue information, judges whether the speaking of drivers/passengers in the taxi is overstimulated, and gives voice broadcast warning or automatic dialing alarm respectively.
Description
Technical Field
The invention relates to the technical field of intelligent intervention of overstimulated behaviors of operators/passengers, in particular to an automatic pre-judging and alarming system for behaviors of taxi booking drivers and passengers in a taxi network.
Background
Along with the rapid development of national economy and the improvement of living standard of people, automobiles become important components in life of people, more and more people own and use the automobiles, and an automobile alarm can be installed in the automobile by a user in order to ensure personal and property safety of the user when the user drives the automobile.
At present, a plurality of automobile alarms are arranged in the market, and are too obvious because the automobile alarms are arranged in a vehicle, or the automobile alarms can be started only by pressing the hidden alarm button for a long time with hands or stepping on the hidden alarm button with feet, even some automobile alarms prompt an alarm through sound or light, and the installation positions and the starting modes of the alarms easily cause the alert of ruffians and harm the life safety of vehicle owners. Particularly, in the case of operating vehicles such as taxis and network appointments, drivers/passengers are in a relatively closed space environment moving at a high speed, and when an attempt is made to get out of track by the other party, it is difficult to effectively avoid the occurrence of collision and harm behaviors, and the drivers/passengers cannot track and arrest quickly in time after the collision and harm behaviors occur. The risk avoiding method adopted by the dripping line is that manual alarm modules are respectively arranged on App clients of a driver and a passenger, the method is passive, the passenger or the driver can call the dripping operator to intervene by manually clicking the corresponding alarm function, and the method has more limitations.
Disclosure of Invention
In order to solve the defects of the prior art, the invention provides an automatic pre-judging alarm system for taxi network taxi appointment drivers and passengers.
the technical scheme adopted by the invention for realizing the technical effects is as follows:
The utility model provides a taxi net car appointment driver and crew say automatic alarm system that prejudges, including set up intelligent terminal on taxi/net car appointment, with intelligent terminal wireless connection's taxi/net car appointment management platform, intelligent terminal is equipped with navigation, wherein, still includes:
The system comprises at least one vehicle-mounted camera, a plurality of sensors and a plurality of intelligent terminals, wherein the vehicle-mounted cameras are arranged in a taxi/online appointment car, are in communication connection with the intelligent terminals, and are used for acquiring limb actions and face information of drivers/passengers in the taxi and sending the information to the intelligent terminals;
the intelligent terminal is provided with a pre-judgment alarm module, a multimedia module, a wireless transceiving module and a dialing module, the vehicle-mounted camera and the multimedia module are respectively in wireless connection with the taxi/network appointment car enterprise management platform through the wireless transceiving module and are used for transmitting language dialogue information of drivers/passengers in the taxi, which is acquired by the multimedia module, and body actions and face information of the drivers/passengers in the taxi, which are acquired by the vehicle-mounted camera to the taxi/network appointment car enterprise management platform;
The taxi/online appointment vehicle-enterprise management platform is provided with a sample database and an identification pre-judging module, wherein the identification pre-judging module is respectively in communication connection with the intelligent terminal, the sample database and the pre-judging alarm module and is used for comparing and identifying the limb actions, the human face and the language dialogue information of the driver/passenger in the taxi uploaded by the intelligent terminal with the comparison sample in the sample database, judging whether the language of the driver/passenger in the taxi is over-excited or not and outputting the over-excited language identification result to the pre-judging alarm module;
The prejudgment alarm module is respectively in communication connection with the multimedia module and the dialing module, and carries out voice broadcast warning and automatic dialing alarm according to the classification of the over-language line recognition result.
Preferably, in the automatic pre-judging alarm system for taxi network taxi appointment drivers and passengers, the sample database comprises a body action behavior recognition database, a face recognition database and a language recognition database, and the body action behavior recognition database, the face recognition database and the language recognition database are all constructed by a deep learning model.
Preferably, in the above automatic pre-judging alarm system for taxi network taxi appointment drivers and passengers, the body motion recognition database stores an overexcited body motion comparison sample, the contrast sample of the over-excited limb actions comprises at least one frame of picture of the actions of a fist/palm of a driver/passenger, pulling, pinching a neck, throat locking, lewd, robbing a steering wheel and a hand-held cutter instrument, the face recognition database stores overexertion facial action contrast samples, the overexertion facial action contrast samples comprise at least one frame of picture that a driver/passenger has angry facial expression or obvious fear expression, the speech recognition database has stored therein overdriven language comparison samples, including a sample lexicon of offensive, suggestive, abusive, and alarm distress words.
Preferably, in the automatic pre-judging alarm system for taxi network appointment drivers and passengers, the vehicle-mounted cameras include a plurality of cameras which are distributed in the taxi in a concealed manner, each vehicle-mounted camera is connected with the communication interface on the taxi/network appointment car management platform through the wireless transceiver module, the communication interface is used for uploading limb actions, face and face information and language dialogue information of drivers and passengers in the taxi, which are respectively acquired by the vehicle-mounted cameras and the multimedia module, to the deep learning model and the recognition pre-judging module, and the deep learning model is connected with the sample database and is used for performing initial construction, medium-term supplement improvement and later-term update on corresponding comparison samples in the sample database.
Preferably, in the above automatic pre-judgment warning system for taxi network appointment drivers and passengers, a grading module is further disposed on the taxi/network appointment car enterprise management platform, the grading module is respectively in communication connection with the recognition pre-judgment module and the pre-judgment warning module, and is configured to grade an overstimulation line recognition result output by the recognition pre-judgment module, and the pre-judgment warning module issues a corresponding warning signal to the multimedia module or the dialing module according to the grading of the overstimulation line recognition result.
preferably, in the above automatic pre-judging alarm system for taxi network taxi appointment drivers and passengers, the over-language line recognition result is classified into three levels, namely a first level warning, a second level warning and a third level warning, wherein the first level warning corresponds to the over-language line recognition result when the driver/passenger generates speech noise, the second level warning corresponds to the over-language line recognition result when the driver/passenger has wriggling, robbing a steering wheel or performing an over-language action, and the third level warning corresponds to the over-language line recognition result when the driver/passenger has a tool holding instrument fighting or other life-threatening safety actions.
preferably, in the automatic pre-judging alarm system for taxi appointment drivers and passengers, when the first-level warning, the second-level warning and the third-level warning are triggered, the multimedia module plays corresponding preset warning voices to intervene, and after the third-level warning intervention is invalid, the dialing module initiates an automatic alarm to a dispatching place near a current navigation positioning point based on the navigation positioning information provided by the navigation system.
Preferably, in the automatic pre-judging alarm system for taxi appointment drivers and passengers, the dispatching points and communication information thereof near the current navigation positioning point are updated in the intelligent terminal by the navigation system in real time.
Preferably, in the above-mentioned automatic pre-judging alarm system for taxi network appointment drivers and passengers, the taxi/network appointment car enterprise management platform is further provided with an automatic calling module, an automatic dispatch module and an automatic settlement module, the automatic calling module, the automatic dispatch module and the automatic settlement module are respectively connected with the intelligent terminal, and the intelligent terminal is further connected with a vehicle-mounted taximeter.
Preferably, in the automatic pre-judgment alarm system for taxi network appointment drivers and passengers, the intelligent terminal further comprises an authentication information display screen for displaying the identity information of the driver authenticated on the taxi/network appointment vehicle enterprise management platform and the complaint reporting telephone, and the multimedia module comprises a display screen, a voice acquisition module and a loudspeaker.
The invention has the beneficial effects that: the automatic pre-judging alarm system for taxi network taxi appointment drivers and passengers can analyze whether the drivers and passengers have overstimulation behaviors according to the body actions, facial expressions and speech dialogue information among the drivers and passengers, can further identify whether the drivers and passengers have serious overstimulation behaviors such as tool holders, stick instruments and the like which harm life safety, respectively gives voice broadcasting alarm or automatic dialing alarm according to the grading of the overstimulation behavior identification results, and the automatic dialing alarm initiates automatic alarm to a dispatching site near the current navigation positioning point based on the navigation positioning information provided by the navigation system and sends the positioning of the current vehicle to a nearby dispatching site or a police station, so that the police can be rescued at the first time when the serious overstimulation behaviors occur. In addition, at the initial stage of the contradiction outbreak, the early stage contradiction intervention and solution are carried out on drivers/passengers by carrying out prejudgment through artificial intelligence recognition and broadcasting preset warning voice through the multimedia module when the overstimulation line recognition result is of the first stage and the second stage.
Drawings
FIG. 1 is a block diagram of an embodiment of the present invention;
FIG. 2 is a block diagram of an embodiment of the present invention;
FIG. 3 is a block diagram of a sample database according to an embodiment of the present invention;
Fig. 4 is a block diagram of another embodiment of the present invention.
Detailed Description
For a further understanding of the invention, reference is made to the following description taken in conjunction with the accompanying drawings and specific examples, in which:
in the description of the present invention, it is to be understood that the terms "upper", "lower", "front", "rear", "left", "right", "top", "bottom", "inner", "outer", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, are merely for convenience in describing the present invention and simplifying the description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention.
The first embodiment is as follows:
as shown in fig. 1 to fig. 3, an embodiment of the present invention provides an automatic pre-judging alarm system for taxi network appointment drivers and passengers, where the system includes an intelligent terminal disposed on a taxi/network appointment, and a taxi/network appointment management platform wirelessly connected to the intelligent terminal, where the intelligent terminal is provided with a navigation system. Wherein, as an improvement of the present invention, the system further comprises:
The number of the vehicle-mounted cameras is at least one, and the vehicle-mounted cameras are arranged in a taxi/network appointment car. The vehicle-mounted camera is in communication connection with the intelligent terminal and is used for collecting the body actions and the face information of drivers/passengers in the vehicle and sending the body actions and the face information to the intelligent terminal.
The intelligent terminal is provided with a pre-judgment alarm module, a multimedia module, a wireless transceiving module and a dialing module, the vehicle-mounted camera and the multimedia module are respectively in wireless connection with the taxi/network appointment car enterprise management platform through the wireless transceiving module, and language dialogue information of drivers/passengers in the taxi, acquired by the multimedia module, and body actions and face information of the drivers/passengers in the taxi, acquired by the vehicle-mounted camera are transmitted to the taxi/network appointment car enterprise management platform through the wireless transceiving module.
The taxi/network appointment vehicle enterprise management platform is provided with a sample database and an identification pre-judgment module, and the identification pre-judgment module is respectively in communication connection with the intelligent terminal, the sample database and the pre-judgment alarm module. The body action, the face and the language dialogue information of the driver/passenger in the automobile uploaded by the intelligent terminal are compared and identified with the comparison sample in the sample database through the identification pre-judging module, whether the language of the driver/passenger in the automobile is excessively excited or not is judged, and the excessively excited language identification result is output to the pre-judging alarm module.
The prejudgment alarm module is respectively in communication connection with the multimedia module and the dialing module, and carries out voice broadcast warning and automatic dialing alarm according to the classification of the over-language line recognition result.
Specifically, in a preferred embodiment of the present invention, the sample database includes a body motion behavior recognition database, a face recognition database, and a language recognition database, and the body motion behavior recognition database, the face recognition database, and the language recognition database are all constructed by a deep learning model. The limb action behavior identification database stores an over-excited limb action comparison sample, and the over-excited limb action comparison sample comprises at least one frame of picture of the action of a fist/palm of a passenger, a drawing, a neck pinching, a throat locking, a lewd, a steering wheel robbing and a hand-held cutter instrument. The face recognition database stores overexcited facial action comparison samples, and the overexcited facial action comparison samples comprise at least one frame of picture with angry facial expression or obvious fear expression of a driver/passenger. The linguistic identification database stores overstimulated linguistic comparison samples, which comprise a sample word bank composed of offensive words, suggestive words, abusive words and alarm distress words.
Specifically, in a preferred embodiment of the present invention, the vehicle-mounted cameras include a plurality of vehicle-mounted cameras, and the vehicle-mounted cameras are concealingly distributed in the vehicle, and each vehicle-mounted camera is connected to the communication interface on the management platform of the taxi/network appointment vehicle enterprise through the wireless transceiver module. The communication interface is used for uploading the body actions, the face and face information and the language dialogue information of drivers/passengers in the vehicle, which are respectively collected by the vehicle-mounted camera and the multimedia module, to the deep learning model and the recognition pre-judgment module. The deep learning model is connected with the sample database and is used for carrying out initial construction, medium-term supplement improvement and later-term update on corresponding comparison samples in the sample database. The recognition pre-judging module carries out machine comparison recognition on the uploaded limb actions, face and face information and language dialogue information of the drivers/passengers in the vehicle and corresponding comparison samples in the limb action recognition database, the face recognition database and the language recognition database. When the comparison identifies that the characters have the same characteristics, the lines are judged to be over-excited.
Specifically, in a preferred embodiment of the present invention, the taxi/network appointment management platform is further provided with a grading planning module, and the grading planning module is respectively in communication connection with the recognition pre-judging module and the pre-judging alarm module, and is configured to grade the overstimulation line recognition result output by the recognition pre-judging module. The prejudgment alarm module sends corresponding alarm signals to the multimedia module or the dialing module according to the grading of the over-language line recognition result. Specifically, the classification of the over-language line recognition result is divided into three levels, namely a first-level warning, a second-level warning and a third-level warning. The first warning corresponds to the result of the line of hyperexcitability recognition when the driver/passenger in the vehicle makes a verbal dispute, the second warning corresponds to the result of the line of hyperexcitability recognition when the driver/passenger in the vehicle has a wriggling, steering wheel robbing or lewd action, and the third warning corresponds to the result of the line of hyperexcitability recognition when the driver/passenger in the vehicle has a knife instrument fighting or other life-threatening safety action.
Specifically, when a first-level warning, a second-level warning and a third-level warning are triggered, the multimedia module plays corresponding preset warning voices to intervene, and after the third-level warning intervention is invalid, the dialing module sends an automatic alarm to a website which is located near a current navigation positioning point based on navigation positioning information provided by a navigation system. And the dispatching points and the communication information thereof near the current navigation positioning point are updated in the intelligent terminal by the navigation system in real time.
in the preferred embodiment of the invention, the vehicle-mounted camera is a micro noctilucent high-definition infrared camera, can adapt to the shooting environment at night, and has clear shooting picture and high recognition accuracy. The navigation system can be a Beidou navigation system or a GPS navigation system and can be accessed to the intelligent terminal.
specifically, in the embodiment of the invention, when the deep learning model is established, the vehicle-mounted camera is used for collecting facial images and body action image information of drivers/passengers in the vehicle, the multimedia module is used for collecting language dialogue information of the drivers/passengers in the vehicle, the images with the depth information are drawn after error compensation and filtering, and the body action features, the facial expression features and the language dialogue features in the images are identified through a machine learning algorithm. When the limb action characteristics are identified, the limb action parts in the picture can be segmented by an image segmentation technology, the mass center and the area of the limb action are extracted as characteristic vectors, and the pre-collected limb action pictures of drivers/drivers are trained by a convolutional neural network, so that an over-excited limb action comparison sample in a limb action behavior identification database is constructed. When facial expression features are identified, facial expression parts in the picture can be segmented through an image segmentation technology, the mass center and the area of the facial expression are extracted to serve as feature vectors, and the facial expression pictures of drivers/passengers collected in advance are trained through a convolutional neural network, so that overexcited facial action comparison samples in a face identification database are constructed. When the language dialogue characteristics are identified, offensive words, suggestive words, abusive words and alarm distress words in audio can be segmented by an audio segmentation technology, extracted as characteristic vectors, and the driver/passenger language dialogue which is acquired in advance is trained through a convolutional neural network, so that an overstimulated language comparison sample in a language identification database is constructed. The deep learning model is connected with the sample database and is used for carrying out initial construction, medium-term supplement improvement and later-term update on corresponding comparison samples in the sample database, so that a more accurate identification result can be obtained.
Specifically, in the embodiment of the invention, the intelligent terminal further comprises an authentication information display screen for displaying the identity information authenticated by the driver on the taxi/online appointment car enterprise management platform and the complaint reporting telephone, and the driver authentication information and the complaint reporting telephone of the current taxi/online appointment car can be provided for the passenger through the authentication information display screen, so that better and more secure riding experience is provided for the passenger. Further, the multimedia module comprises a display screen, a voice acquisition module and a loudspeaker, the display screen is a liquid crystal touch screen, the voice acquisition module is a miniature microphone and is used for acquiring voice conversations of drivers/passengers and uploading the voice conversations to the taxi/network taxi appointment management platform, and the loudspeaker is used for broadcasting preset warning voices and carrying out recommendation and intervention on the drivers/passengers who have conflicts so as to clear up the conflicts in an initial stage. When the conflict is judged to be upgraded to have the behavior endangering life safety, namely, the third-level warning is triggered, the driver/passenger can be deterred by broadcasting the preset warning voice through the loudspeaker, and serious personal injury caused by the fact that the situation is out of control is avoided. After intervention is invalid, the dialing module automatically contacts a nearby dispatching place or a police station network to carry out automatic voice alarm, so that a police can rapidly arrive in the field and get away in time.
Example two:
As shown in fig. 4, a second embodiment of the present invention provides an automatic pre-judging alarm system for taxi network appointment drivers and passengers, which further includes a vehicle-mounted taximeter connected to an intelligent terminal, and an automatic calling module, an automatic dispatching module and an automatic settlement module arranged on a taxi/network appointment management platform on the basis of the first embodiment. The automatic calling module, the automatic dispatching module and the automatic settlement module are respectively connected with the intelligent terminal and used for dispatching a passenger calling service order on a line to a taxi/online appointment equipped with the intelligent terminal and automatically carrying out service fee accounting and pushing according to planned driving paths of a boarding point and a alighting point. The online riding service settlement is carried out in real time through a vehicle-mounted taximeter connected with the intelligent terminal, and is generally suitable for taxis which also provide passenger carrying operation service online. Based on the system of the second embodiment, self-closed loop operation vehicle management can be formed, and the functions of calling, dispatching, pricing, settlement and automatic pre-judging and alarming when drivers and passengers speak are integrated.
in summary, the automatic pre-judging alarm system for taxi network taxi appointment drivers and passengers can analyze whether the drivers and passengers have overdriven behaviors according to the body actions, facial expressions and speech dialogue information among the drivers and passengers, can further identify whether the drivers and passengers have serious overdriven behaviors such as tool holders, stick devices and the like which harm life safety, respectively give voice broadcast warning or automatic dialing alarm according to the grading of the recognition results of the overdriven behaviors, and the automatic dialing alarm initiates automatic alarm to a dispatching site near the current navigation positioning point based on the navigation positioning information provided by the navigation system and sends the positioning of the current vehicle to a nearby dispatching site or police station, so that the police rescue can be obtained at the first time when the serious overdriven behaviors occur. In addition, at the initial stage of the contradiction outbreak, the early stage contradiction intervention and solution are carried out on drivers/passengers by carrying out prejudgment through artificial intelligence recognition and broadcasting preset warning voice through the multimedia module when the overstimulation line recognition result is of the first stage and the second stage.
the foregoing shows and describes the general principles, essential features, and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are merely illustrative of the principles of the invention, but that various changes and modifications may be made without departing from the spirit and scope of the invention, which is defined by the appended claims and their equivalents.
Claims (10)
1. The utility model provides a taxi net car appointment driver and crew say automatic alarm system that prejudges, including set up intelligent terminal on taxi/net car appointment, with intelligent terminal wireless connection's taxi/net car appointment management platform, intelligent terminal is equipped with navigation, its characterized in that still includes:
the system comprises at least one vehicle-mounted camera, a plurality of sensors and a plurality of intelligent terminals, wherein the vehicle-mounted cameras are arranged in a taxi/online appointment car, are in communication connection with the intelligent terminals, and are used for acquiring limb actions and face information of drivers/passengers in the taxi and sending the information to the intelligent terminals;
the intelligent terminal is provided with a pre-judgment alarm module, a multimedia module, a wireless transceiving module and a dialing module, the vehicle-mounted camera and the multimedia module are respectively in wireless connection with the taxi/network appointment car enterprise management platform through the wireless transceiving module and are used for transmitting language dialogue information of drivers/passengers in the taxi, which is acquired by the multimedia module, and body actions and face information of the drivers/passengers in the taxi, which are acquired by the vehicle-mounted camera to the taxi/network appointment car enterprise management platform;
The taxi/online appointment vehicle-enterprise management platform is provided with a sample database and an identification pre-judging module, wherein the identification pre-judging module is respectively in communication connection with the intelligent terminal, the sample database and the pre-judging alarm module and is used for comparing and identifying the limb actions, the human face and the language dialogue information of the driver/passenger in the taxi uploaded by the intelligent terminal with the comparison sample in the sample database, judging whether the language of the driver/passenger in the taxi is over-excited or not and outputting the over-excited language identification result to the pre-judging alarm module;
the prejudgment alarm module is respectively in communication connection with the multimedia module and the dialing module, and carries out voice broadcast warning and automatic dialing alarm according to the classification of the over-language line recognition result.
2. The automatic pre-judging alarm system for taxi network appointment drivers and passengers according to claim 1, wherein the sample database comprises a body action behavior recognition database, a face recognition database and a language recognition database, and the body action behavior recognition database, the face recognition database and the language recognition database are all constructed through a deep learning model.
3. The taxi network taxi appointment driver and passenger speech automatic pre-judgment alarm system according to claim 2, it is characterized in that the limb action behavior recognition database stores an overexcited limb action comparison sample, the contrast sample of the over-excited limb actions comprises at least one frame of picture of the actions of a fist/palm of a driver/passenger, pulling, pinching a neck, throat locking, lewd, robbing a steering wheel and a hand-held cutter instrument, the face recognition database stores overexertion facial action contrast samples, the overexertion facial action contrast samples comprise at least one frame of picture that a driver/passenger has angry facial expression or obvious fear expression, the speech recognition database has stored therein overdriven language comparison samples, including a sample lexicon of offensive, suggestive, abusive, and alarm distress words.
4. The system according to claim 3, wherein the plurality of vehicle-mounted cameras are distributed in the taxi concealably, each vehicle-mounted camera is connected with the communication interface on the management platform of the taxi/network car appointment, the communication interface is used for uploading the body actions, the face information and the language dialogue information of the drivers/passengers in the taxi, which are respectively collected by the vehicle-mounted cameras and the multimedia module, to the deep learning model and the recognition pre-judgment module, and the deep learning model is connected with the sample database and is used for performing initial construction, medium supplement improvement and later update on corresponding comparison samples in the sample database.
5. The automatic pre-judgment alarm system for taxi network appointment drivers and passengers according to claim 1, wherein a grading module is further arranged on the taxi/network appointment vehicle enterprise management platform, the grading module is respectively in communication connection with the recognition pre-judgment module and the pre-judgment alarm module and is used for grading the overdriving behavior recognition result output by the recognition pre-judgment module, and the pre-judgment alarm module issues a corresponding alarm signal to the multimedia module or the dialing module according to the grading of the overdriving behavior recognition result.
6. A taxi network booking driver/passenger automatic pre-judgement warning system as claimed in claim 5 wherein the over-language line recognition result is classified into three levels, first level warning, second level warning and third level warning respectively, wherein the first level warning corresponds to the over-language line recognition result when the driver/passenger has verbal contention, the second level warning corresponds to the over-language line recognition result when the driver/passenger has wriggling, robbing of a steering wheel or profanity, and the third level warning corresponds to the over-language line recognition result when the driver/passenger has a tool holding instrument fighting or other life threatening safety action.
7. the system of claim 6, wherein the multimedia module plays a corresponding preset warning voice to intervene when the first, second and third level warnings are triggered, and the dialing module initiates an automatic alarm to a dispatch office near a current navigation location point based on navigation location information provided by the navigation system after the intervention of the third level warning is invalid.
8. The system according to claim 7, wherein the dispatch points and their communication information near the current navigation location are updated in real time by the navigation system in the intelligent terminal.
9. The automatic pre-judging alarm system for taxi network appointment drivers and passengers according to claim 1, wherein an automatic calling module, an automatic dispatching module and an automatic settlement module are further arranged on the taxi/network appointment vehicle enterprise management platform, the automatic calling module, the automatic dispatching module and the automatic settlement module are respectively connected with the intelligent terminal, and the intelligent terminal is further connected with a vehicle-mounted taximeter.
10. The taxi network appointment driver and passenger speech automatic pre-judgment alarm system according to claim 1, wherein the intelligent terminal further comprises an authentication information display screen for displaying identity information authenticated by a driver on the taxi/network appointment vehicle enterprise management platform and a complaint reporting telephone, and the multimedia module comprises a display screen, a voice acquisition module and a loudspeaker.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910530614.3A CN110580799A (en) | 2019-06-19 | 2019-06-19 | taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910530614.3A CN110580799A (en) | 2019-06-19 | 2019-06-19 | taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110580799A true CN110580799A (en) | 2019-12-17 |
Family
ID=68811002
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910530614.3A Pending CN110580799A (en) | 2019-06-19 | 2019-06-19 | taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110580799A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111489522A (en) * | 2020-05-29 | 2020-08-04 | 北京百度网讯科技有限公司 | Method, device and system for outputting information |
| CN111814583A (en) * | 2020-06-17 | 2020-10-23 | 北京航天时代光电科技有限公司 | Information scanning system for information security |
| CN112634564A (en) * | 2020-12-30 | 2021-04-09 | 重庆赤木科技有限公司 | Community safety monitoring system |
| CN113593175A (en) * | 2021-06-15 | 2021-11-02 | 深圳市广和通无线股份有限公司 | Remote monitoring method, child watch, terminal device and storage medium |
| WO2022067504A1 (en) * | 2020-09-29 | 2022-04-07 | 华为技术有限公司 | Vehicle automatic emergency call method, and apparatus |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104123834A (en) * | 2014-06-27 | 2014-10-29 | 北京艾亿沃德电子有限公司 | Taxi calling management settlement system and method |
| US20170172520A1 (en) * | 2015-12-18 | 2017-06-22 | Microsoft Technology Licensing, Llc | Drowsiness onset detection |
| CN108961669A (en) * | 2018-07-19 | 2018-12-07 | 上海小蚁科技有限公司 | The safe early warning method and device, storage medium, server of net about vehicle |
| CN108986400A (en) * | 2018-09-03 | 2018-12-11 | 深圳市尼欧科技有限公司 | A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method |
| CN208314982U (en) * | 2018-07-05 | 2019-01-01 | 南京信息工程大学 | A kind of intelligent alarm system of taxi and net about vehicle |
-
2019
- 2019-06-19 CN CN201910530614.3A patent/CN110580799A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104123834A (en) * | 2014-06-27 | 2014-10-29 | 北京艾亿沃德电子有限公司 | Taxi calling management settlement system and method |
| US20170172520A1 (en) * | 2015-12-18 | 2017-06-22 | Microsoft Technology Licensing, Llc | Drowsiness onset detection |
| CN208314982U (en) * | 2018-07-05 | 2019-01-01 | 南京信息工程大学 | A kind of intelligent alarm system of taxi and net about vehicle |
| CN108961669A (en) * | 2018-07-19 | 2018-12-07 | 上海小蚁科技有限公司 | The safe early warning method and device, storage medium, server of net about vehicle |
| CN108986400A (en) * | 2018-09-03 | 2018-12-11 | 深圳市尼欧科技有限公司 | A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111489522A (en) * | 2020-05-29 | 2020-08-04 | 北京百度网讯科技有限公司 | Method, device and system for outputting information |
| CN111814583A (en) * | 2020-06-17 | 2020-10-23 | 北京航天时代光电科技有限公司 | Information scanning system for information security |
| WO2022067504A1 (en) * | 2020-09-29 | 2022-04-07 | 华为技术有限公司 | Vehicle automatic emergency call method, and apparatus |
| CN112634564A (en) * | 2020-12-30 | 2021-04-09 | 重庆赤木科技有限公司 | Community safety monitoring system |
| CN113593175A (en) * | 2021-06-15 | 2021-11-02 | 深圳市广和通无线股份有限公司 | Remote monitoring method, child watch, terminal device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110580799A (en) | taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system | |
| US11840176B2 (en) | Motor vehicle artificial intelligence expert system dangerous driving warning and control system and method | |
| US9290145B2 (en) | Detecting a transport emergency event and directly enabling emergency services | |
| CN102568056B (en) | The method of process vehicle crash data | |
| EP2093740B1 (en) | Driver condition estimating device, server, driver information collecting device and driver condition estimating system | |
| CN109823345B (en) | Safe driving system based on physiological information | |
| WO2013033686A2 (en) | Method and apparatus for social telematics | |
| CN108696817A (en) | Use the vehicular events monitoring and classification of situation information of vehicles | |
| CN112071309B (en) | Network appointment vehicle safety monitoring device and system | |
| JP7160454B2 (en) | Method, apparatus and system, electronic device, computer readable storage medium and computer program for outputting information | |
| CN112086098B (en) | Driver and passenger analysis method and device and computer readable storage medium | |
| CN110503949A (en) | Conversational system, the vehicle with conversational system and dialog process method | |
| CN110876047A (en) | Vehicle exterior projection method, device, equipment and storage medium | |
| CN110379443A (en) | Voice recognition device and sound identification method | |
| CN110443987A (en) | Police end alert acquisition methods and system based on driver and conductor's words and deeds early warning system | |
| CN111598641A (en) | Order risk verification method and system | |
| CN114360204A (en) | Block chain-based networked automobile information safety communication system | |
| CN113867527A (en) | Vehicle window control method and device, electronic equipment and storage medium | |
| US20230351894A1 (en) | Accident reporter | |
| CN115720555A (en) | Method and system for improving user alertness in an autonomous vehicle | |
| CN115909651A (en) | Method, device, equipment and storage medium for protecting personal safety in vehicle | |
| CN112193255A (en) | Human-computer interaction method, device, equipment and storage medium of vehicle-machine system | |
| CN113592262B (en) | Safety monitoring method and system for network appointment | |
| JP2018018184A (en) | Vehicle event discrimination device | |
| JP2024048853A (en) | Reporting system, reporting method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20191217 |