CN106004883B - The method and device that rule-breaking vehicle is reminded - Google Patents

The method and device that rule-breaking vehicle is reminded Download PDF

Info

Publication number
CN106004883B
CN106004883B CN201610350481.8A CN201610350481A CN106004883B CN 106004883 B CN106004883 B CN 106004883B CN 201610350481 A CN201610350481 A CN 201610350481A CN 106004883 B CN106004883 B CN 106004883B
Authority
CN
China
Prior art keywords
vehicle
target information
rule
image
breaking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610350481.8A
Other languages
Chinese (zh)
Other versions
CN106004883A (en
Inventor
陈志军
杨松
张旭华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201610350481.8A priority Critical patent/CN106004883B/en
Publication of CN106004883A publication Critical patent/CN106004883A/en
Application granted granted Critical
Publication of CN106004883B publication Critical patent/CN106004883B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/60Traffic rules, e.g. speed limits or right of way

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)

Abstract

The disclosure is directed to the method and devices that rule-breaking vehicle is reminded.This method comprises: obtaining the image of vehicle-periphery;Described image is identified, identifies target information relevant to the vehicle driving;Obtain the current state information of the vehicle;Determine the vehicle currently whether in violation of rules and regulations according to the current state information of the target information and the vehicle;When the rule-breaking vehicle, issues and remind to driver.The technical solution can automatic identification rule-breaking vehicle, and issue remind to driver in time, therefore is it is possible to prevente effectively from dangerous caused by being travelled in driving conditions because of violation.

Description

The method and device that rule-breaking vehicle is reminded
Technical field
This disclosure relates to the method and device that Internet technical field more particularly to rule-breaking vehicle are reminded.
Background technique
With the raising of automobile popularity rate, more and more car owners drive to go on a journey, and this requires everybody civilization to drive, and do one The driver of a qualification.Car owner travels in violation of rules and regulations sometimes when driving, for example makes a dash across the red light, frequent change lane, exceeds regulation speed Traveling, simultaneously lamp etc. is not played in road, these behaviors have plenty of the intentional violation of car owner, is sometimes that car owner forgets oneself in violation of rules and regulations, not Deliberately in violation of rules and regulations.
Summary of the invention
The embodiment of the present disclosure provides the method and device that rule-breaking vehicle is reminded.The technical solution is as follows:
According to the first aspect of the embodiments of the present disclosure, a kind of method that rule-breaking vehicle is reminded is provided, comprising:
Obtain the image of vehicle-periphery;
Described image is identified, identifies target information relevant to the vehicle driving;
Obtain the current state information of the vehicle;
Determine the vehicle currently whether in violation of rules and regulations according to the current state information of the target information and the vehicle;
When the rule-breaking vehicle, issues and remind to driver.
In one embodiment, the method may also include that
Collect sample corresponding with the type of the target information;
The detection model of target information is detected according to the sample training;
It is described that described image is identified, identify target information relevant to the vehicle driving, comprising:
Described image is passed into the detection model, is determined by the detection model relevant to the vehicle driving Target information.
In one embodiment, the method may also include that
Preset unlawful practice;
The current state information according to the target information and the vehicle determine the vehicle currently whether in violation of rules and regulations, Include:
It is matched according to the current state information of the target information and the vehicle with pre-set unlawful practice;
Upon a match, the rule-breaking vehicle is determined;
When mismatching, determine the vehicle not in violation of rules and regulations.
In one embodiment, the unlawful practice may include one or more in following behavior: violate road traffic Signal lamp is current, does not slow down by regulation, stops, overtakes other vehicles, avoids pedestrian, drives over the speed limit, occupies Emergency Vehicle Lane traveling, public in high speed Road reversing, reverse driving are travelled lower than the minimum speed per hour of regulation, are violated prohibitory sign, are forbidden graticule instruction traveling.
In one embodiment, described when the rule-breaking vehicle, it issues and reminds to driver, it may include:
When the rule-breaking vehicle, to unlawful practice described in driver's voice broadcast.
In one embodiment, the image for obtaining vehicle-periphery, it may include:
Vehicle-periphery is shot, the image of the vehicle-periphery is obtained.
In one embodiment, the current state information of the vehicle, it may include one or more in following information:
Travel speed, position and the steering angle of the vehicle.
In one embodiment, the target information relevant to the vehicle driving may include one in following information It is or multinomial: speed limitation board, traffic lights, pedestrian, non-motor vehicle, barrier, road turning mark, traffic lane line.
According to the second aspect of an embodiment of the present disclosure, a kind of device that rule-breaking vehicle is reminded is provided, comprising:
First obtains module, for obtaining the image of vehicle-periphery;
Identification module identifies target information relevant to the vehicle driving for identifying to described image;
Second obtains module, for obtaining the current state information of the vehicle;
Determining module, for determining that the vehicle is current according to the current state information of the target information and the vehicle Whether in violation of rules and regulations;
Reminding module, for issuing and reminding to driver when the rule-breaking vehicle.
In one embodiment, described device may also include that
Collection module, for collecting sample corresponding with the type of the target information;
Training module, for detecting the detection model of target information according to the sample training;
The identification module, comprising:
First determines that submodule is determined for described image to be passed to the detection model by the detection model Target information relevant to the vehicle driving.
In one embodiment, described device may also include that
Setup module, for presetting unlawful practice;
The determining module, comprising:
Matched sub-block, for being disobeyed according to the current state information of the target information and the vehicle with pre-set Rule behavior is matched;
Second determines submodule, for upon a match, determining the rule-breaking vehicle;
Third determines submodule, for determining the vehicle not in violation of rules and regulations when mismatching.
In one embodiment, the unlawful practice may include one or more in following behavior: violate road traffic Signal lamp is current, does not slow down by regulation, stops, overtakes other vehicles, avoids pedestrian, drives over the speed limit, occupies Emergency Vehicle Lane traveling, public in high speed Road reversing, reverse driving are travelled lower than the minimum speed per hour of regulation, are violated prohibitory sign, are forbidden graticule instruction traveling.
In one embodiment, the reminding module, it may include:
Submodule is reminded, is used for when the rule-breaking vehicle, to unlawful practice described in driver's voice broadcast.
In one embodiment, described first module is obtained, it may include:
Acquisition submodule obtains the image of the vehicle-periphery for shooting to vehicle-periphery.
In one embodiment, the current state information of the vehicle, it may include one or more in following information:
Travel speed, position and the steering angle of the vehicle.
In one embodiment, the target information relevant to the vehicle driving may include one in following information It is or multinomial: speed limitation board, traffic lights, pedestrian, non-motor vehicle, barrier, road turning mark, traffic lane line.
According to the third aspect of an embodiment of the present disclosure, a kind of device that rule-breaking vehicle is reminded is provided, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Obtain the image of vehicle-periphery;
Described image is identified, identifies target information relevant to the vehicle driving;
Obtain the current state information of the vehicle;
Determine the vehicle currently whether in violation of rules and regulations according to the current state information of the target information and the vehicle;
When the rule-breaking vehicle, issues and remind to driver.
The technical scheme provided by this disclosed embodiment can include the following benefits:
In one embodiment, the image for obtaining vehicle-periphery, identifies image, identifies and vehicle driving Relevant target information obtains the current state information of vehicle, determines vehicle according to the current state information of target information and vehicle It is current whether in violation of rules and regulations, when rule-breaking vehicle, issue and remind to driver.Due to can automatic identification rule-breaking vehicle, and in time It issues and reminds to driver, therefore, it is possible to prevente effectively from dangerous caused by being travelled in driving conditions because of violation.
In another embodiment, it by collecting sample corresponding with the type of target information, is established and is instructed according to sample Practice model, and image is passed into detection model, target information relevant to vehicle driving is determined by detection model, so as to With it is quick, accurately determine target information.
In another embodiment, preset unlawful practice, and by the current state information of target information and vehicle with Pre-set unlawful practice is matched, and upon a match, determines rule-breaking vehicle, when mismatching, determines vehicle not in violation of rules and regulations, from And can take timely measure, avoid dangerous generation.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is the flow chart for the method that rule-breaking vehicle shown according to an exemplary embodiment is reminded.
Fig. 2 is the flow chart for the method that another rule-breaking vehicle shown according to an exemplary embodiment is reminded.
Fig. 3 is the flow chart for the method that another rule-breaking vehicle shown according to an exemplary embodiment is reminded.
Fig. 4 is the flow chart for the method reminded according to the rule-breaking vehicle shown in an exemplary embodiment one.
Fig. 5 is the block diagram for the device that rule-breaking vehicle shown according to an exemplary embodiment is reminded.
Fig. 6 is the block diagram for the device that another rule-breaking vehicle shown according to an exemplary embodiment is reminded.
Fig. 7 is the block diagram for the device that another rule-breaking vehicle shown according to an exemplary embodiment is reminded.
Fig. 8 is the block diagram of the device shown according to an exemplary embodiment reminded suitable for rule-breaking vehicle.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
Fig. 1 is the flow chart for the method that a kind of rule-breaking vehicle shown according to an exemplary embodiment is reminded, and is used for vehicle, As shown in Figure 1, this approach includes the following steps S101-S105:
In step s101, the image of vehicle-periphery is obtained.
In one embodiment, it can be shot by environment of the vehicle-mounted camera to vehicle periphery, obtain vehicle week The photo in collarette border, due to the vehicle most of the time be under steam, vehicle-mounted camera is preferably high speed dynamic camera Head is capable of the image of shooting clear when vehicle travels.One camera can be installed in the car, it can also be before vehicle Portion, rear portion, each installation camera in left and right, to realize that 360 degree shoot without dead angle.Photo of the camera except shooting vehicle-periphery Outside, the video that can also shoot vehicle-periphery, to the processing of video as the processing mode to photo.
In step s 102, image is identified, identifies target information relevant to vehicle driving.
After vehicle-mounted camera shoots the image of vehicle-periphery, image is sent to pattern recognition device, pattern-recognition Device carries out pattern-recognition to image.In one embodiment, target information relevant to vehicle driving may include following information In it is one or more: speed limitation board, traffic lights, pedestrian, non-motor vehicle, barrier, road turning mark, lane markings Line.In addition to this it is possible to be any information relevant to vehicle driving, such as the driving information of forward and backward side's vehicle.
In addition to through image recognition target information relevant to vehicle driving, sensor detection and vehicle can also be utilized Relevant target information is travelled, for example, whether have barrier using around sensor detected vehicle, using being mounted on windshield On sensor identify traffic lane line.
In step s 103, the current state information of vehicle is obtained.
In one embodiment, the current state information of vehicle, it may include one or more in following information: vehicle Travel speed, position and steering angle.Using location technology, vehicle is positioned, obtains the position of vehicle.Direction can be passed through The angle of disk or vehicle wheel rotation determines the steering angle of vehicle.
In step S104, determine vehicle currently whether in violation of rules and regulations according to the current state information of target information and vehicle.
For example, the target information identified is front crossroad red light, the current state information of vehicle is and this The distance of crossroad is less than 100 meters, and speed is greater than 40km/h, and car owner is not slowed down, and can determine that vehicle occurs to disobey at this time Rule behavior.For another example, car owner identifies that vehicle periphery has the mark that no parking in curb parking, then can determine that vehicle is disobeyed Rule.
In step s105, it when rule-breaking vehicle, issues and reminds to driver.
Prompting can be voice reminder, be also possible to predetermined indicator light flashing lamp alerting pattern.
In one embodiment, it is following steps A that step S105 is implementable:
Step A, when rule-breaking vehicle, to driver's voice broadcast unlawful practice.
To driver's voice broadcast unlawful practice, driver can be made intuitively to understand unlawful practice, it is timely convenient for driver It takes measures, avoids dangerous driving.
The above method of the embodiment of the present disclosure obtains the image of vehicle-periphery, identifies to image, identify with The relevant target information of vehicle driving, obtains the current state information of vehicle, is believed according to target information and the current state of vehicle It ceases and determines that whether in violation of rules and regulations vehicle currently, when rule-breaking vehicle, issues to driver and remind.Due to can automatic identification vehicle disobey Rule, and issue remind to driver in time, therefore, it is possible to prevente effectively from dangerous caused by being travelled in driving conditions because of violation.
In one embodiment, before step S102, as shown in Fig. 2, the above method can also include the steps of S106- S107:
In step s 106, sample corresponding with the type of target information is collected.
The type of target information such as can be pedestrian, traffic signal sign, road sign, vehicle etc., collect multiple rows People, traffic signal sign, road sign, vehicle sample, using these samples as training set, training detection model.
In step s 107, the detection model of target information is detected according to sample training.
Can use classification and Detection algorithm such as CNN (convolutional neural networks algorithm), adaboost (a kind of iterative algorithm), Svm (support vector machines), training can detect the model of target information from image.
At this point, step S102 may be implemented as step S1021:
In step S1021, image is passed into detection model, mesh relevant to vehicle driving is determined by detection model Mark information.
Training can detect the model of target information from image.Camera captured image is passed into trained mould Type, detection model identify the information such as the pedestrian contained in image, vehicle, road sign or traffic signals.
Specific detection method for example may is that image (new samples) is passed into detection model after, reached in new samples Afterwards, feature is extracted, determines that the feature vector of new samples indicates, is determined in training set with the new samples apart from nearest (most like) K sample determines new samples generic according to K sample generic.
In the present embodiment, by collection sample corresponding with the type of target information, training pattern is established according to sample, And image is passed into detection model, target information relevant to vehicle driving is determined by detection model, so as to it is accurate, Quickly determine target information.
In one embodiment, as shown in figure 3, the above method can also include the steps of S108 before step S104:
In step S108, unlawful practice is preset.
Vehicle is being judged whether before violation, is needed that unlawful practice is first arranged in system, is determined which behavior is with this Violation.In one embodiment, unlawful practice can be violation road traffic signal lamp and pass through, do not slow down by regulation, stop, Overtake other vehicles, avoid pedestrian, drive over the speed limit, occupy Emergency Vehicle Lane traveling, on a highway reversing, reverse driving, lower than provide most Low speed per hour traveling violates prohibitory sign, forbids the behaviors such as graticule instruction traveling.Specifically unlawful practice for example can be rush it is red Lamp, solid line lane change, no-parking zone parking etc. behaviors.
At this point, step S104 may be implemented as step S1041-S1043:
In step S1041, according to the current state information of target information and vehicle and pre-set unlawful practice into Row matching.
In step S1042, upon a match, rule-breaking vehicle is determined.
In step S1043, when mismatching, determine vehicle not in violation of rules and regulations.
In the present embodiment, preset unlawful practice, and by the current state information of target information and vehicle with set in advance The unlawful practice set is matched, and upon a match, determines rule-breaking vehicle, when mismatching, determines vehicle not in violation of rules and regulations, so as to It takes timely measure, avoids dangerous generation.
In one embodiment, it is following steps B that step S101 is implementable:
Step B, shoots vehicle-periphery, obtains the image of vehicle-periphery.
The above-mentioned technical proposal of embodiment of the present disclosure offer is provided below with specific embodiment.
Embodiment one
The method that embodiment one is reminded using the rule-breaking vehicle that the embodiment of the present disclosure provides, is used in vehicle, such as Fig. 4 institute Show, vehicle is followed by following operation:
In step S401, vehicle collects sample corresponding with the type of target information.
In step S402, vehicle detects the detection model of target information according to sample training.
In step S403, vehicle presets unlawful practice.
In step s 404, vehicle obtains the image of vehicle-periphery.
In step S405, image is passed to detection model by vehicle, is determined by detection model related to vehicle driving Target information.
In step S406, vehicle obtains the current state information of vehicle.
In step S 407, vehicle is according to the current state information of target information and vehicle and pre-set unlawful practice It is matched.
In step S408, upon a match, vehicle determines rule-breaking vehicle, when mismatching, determines vehicle not in violation of rules and regulations.
In step S409, when rule-breaking vehicle, vehicle is issued to driver and is reminded.
Embodiment one is determined and vehicle by detection model by presetting unlawful practice and establish detection model Whether in violation of rules and regulations the relevant target information of traveling, determine vehicle by pre-set unlawful practice, and in rule-breaking vehicle, to Driver, which issues, to be reminded, dangerous caused by travelling in driving conditions because of violation so as to effectively avoid.
Following is embodiment of the present disclosure, can be used for executing embodiments of the present disclosure.
Fig. 5 is the block diagram that a kind of rule-breaking vehicle shown according to an exemplary embodiment is reminded, which can be by soft Part, hardware or both are implemented in combination with as some or all of of electronic equipment.As shown in figure 5, the rule-breaking vehicle is reminded Device include:
First obtains module 51, is configured as obtaining the image of vehicle-periphery.
In one embodiment, it can be shot by environment of the vehicle-mounted camera to vehicle periphery, obtain vehicle week The photo in collarette border, due to the vehicle most of the time be under steam, vehicle-mounted camera is preferably high speed dynamic camera Head is capable of the image of shooting clear when vehicle travels.One camera can be installed in the car, it can also be before vehicle Portion, rear portion, each installation camera in left and right, to realize that 360 degree shoot without dead angle.Image of the camera except shooting vehicle-periphery Outside, the video that can also shoot vehicle-periphery, to the processing of video as the processing mode to image.
Identification module 52 is configured as identifying image, identifies target information relevant to vehicle driving.
Second obtains module 53, is configured as obtaining the current state information of vehicle.
Determining module 54 is configured as determining that the vehicle is currently according to the current state information of target information and vehicle No violation.
Reminding module 55 is configured as when rule-breaking vehicle, is issued and is reminded to driver.
Alerting pattern can be voice reminder, be also possible to predetermined indicator light flashing lamp alerting pattern.
After vehicle-mounted camera shoots the image of vehicle-periphery, image is sent to pattern recognition device, pattern-recognition Device carries out pattern-recognition to image.In one embodiment, target information relevant to vehicle driving may include following information In it is one or more: speed limitation board, traffic lights, pedestrian, non-motor vehicle, barrier, road turning mark, lane markings Line.In addition to this it is possible to be any information relevant to vehicle driving, such as the driving information of forward and backward side's vehicle.
In addition to through image recognition target information relevant to vehicle driving, sensor detection and vehicle can also be utilized Travel relevant target information, for example, using whether have barrier around sensor detected vehicle, using being mounted on windshield On sensor identify traffic lane line.
The above-mentioned apparatus of the embodiment of the present disclosure obtains the image of vehicle-periphery, identifies to image, identify with The relevant target information of vehicle driving, obtains the current state information of vehicle, is believed according to target information and the current state of vehicle It ceases and determines that whether in violation of rules and regulations vehicle currently, when rule-breaking vehicle, issues to driver and remind.Due to can automatic identification vehicle disobey Rule, and issue remind to driver in time, therefore, it is possible to prevente effectively from dangerous caused by being travelled in driving conditions because of violation.
In one embodiment, the current state information of vehicle, it may include one or more in following information: vehicle Travel speed, position and steering angle.Using location technology, vehicle is positioned, obtains the position of vehicle.Direction can be passed through The angle of disk or vehicle wheel rotation determines the steering angle of vehicle.
In one embodiment, as shown in fig. 6, above-mentioned apparatus may also include that
Collection module 56 is configured as collecting sample corresponding with the type of target information.
The type of target information such as can be pedestrian, traffic signal sign, road sign, vehicle etc., collect multiple rows People, traffic signal sign, road sign, vehicle sample, using these samples as training set, training detection model.
Training module 57 is configured as detecting the detection model of target information according to sample training.
Can use classification and Detection algorithm such as CNN (convolutional neural networks algorithm), adaboost (a kind of iterative algorithm), Svm (support vector machines), training detection model.
Identification module 52, comprising:
First determines submodule, is configured as image passing to detection model, be determined and vehicle row by detection model Sail relevant target information.
Training can detect the model of target information from image.Camera captured image is passed into trained mould Type, detection model identify the information such as the pedestrian contained in image, vehicle, road sign or traffic signals.
Specific detection method for example may is that image (new samples) is passed into detection model after, reached in new samples Afterwards, feature is extracted, determines that the feature vector of new samples indicates, is determined in training set with the new samples apart from nearest (most like) K sample determines new samples generic according to K sample generic.
In the present embodiment, by collection sample corresponding with the type of target information, training pattern is established according to sample, And image is passed into detection model, target information relevant to vehicle driving is determined by detection model, so as to quickly, Accurately determine target information.
In one embodiment, as shown in fig. 7, above-mentioned apparatus may also include that
Setup module 58 is configured as presetting unlawful practice.
Vehicle is being judged whether before violation, is needed that unlawful practice is first arranged in system, is determined which behavior is with this Violation.In one embodiment, unlawful practice can be violation road traffic signal lamp and pass through, do not slow down by regulation, stop, Overtake other vehicles, avoid pedestrian, drive over the speed limit, occupy Emergency Vehicle Lane traveling, on a highway reversing, reverse driving, lower than provide most Low speed per hour traveling violates prohibitory sign, forbids the behaviors such as graticule instruction traveling.Specifically unlawful practice for example can be rush it is red Lamp, solid line lane change, no-parking zone parking etc. behaviors.
Determining module 54, comprising:
Matched sub-block is configured as according to the current state information of target information and vehicle and pre-set violation row To be matched.
Second determines submodule, for upon a match, determining rule-breaking vehicle.
Third determines submodule, for determining vehicle not in violation of rules and regulations when mismatching.
In the present embodiment, preset unlawful practice, and by the current state information of target information and vehicle with set in advance The unlawful practice set is matched, and upon a match, determines rule-breaking vehicle, when mismatching, determines vehicle not in violation of rules and regulations, so as to It takes timely measure, avoids dangerous generation.
In one embodiment, unlawful practice may include one or more in following behavior: violate road traffic signal Lamp is current, does not slow down by regulation, stops, overtakes other vehicles, avoids pedestrian, drives over the speed limit, occupies Emergency Vehicle Lane traveling, on a highway Reversing, reverse driving are travelled lower than the minimum speed per hour of regulation, are violated prohibitory sign, are forbidden graticule instruction traveling.
In one embodiment, reminding module 55, it may include:
Submodule is reminded, is configured as when rule-breaking vehicle, to driver's voice broadcast unlawful practice.
In one embodiment, first module 51 is obtained, it may include:
Acquisition submodule is configured as shooting vehicle-periphery, obtains the image of the vehicle-periphery.
In one embodiment, the current state information of the vehicle, it may include one or more in following information:
Travel speed, position and the steering angle of vehicle.
In one embodiment, target information relevant to vehicle driving may include one or more in following information: Speed limitation board, traffic lights, pedestrian, non-motor vehicle, barrier, road turning mark, traffic lane line.
The embodiment of the present disclosure also provides a kind of device that rule-breaking vehicle is reminded, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Obtain the image of vehicle-periphery;
Described image is identified, identifies target information relevant to the vehicle driving;
Obtain the current state information of the vehicle;
Determine the vehicle currently whether in violation of rules and regulations according to the current state information of the target information and the vehicle;
When the rule-breaking vehicle, issues and remind to driver.
Above-mentioned processor is also configured to:
Collect sample corresponding with the type of the target information;
The detection model of target information is detected according to the sample training;
Described image is passed into the detection model, is determined by the detection model relevant to the vehicle driving Target information.
Above-mentioned processor is also configured to:
Preset unlawful practice;
It is matched according to the current state information of the target information and the vehicle with pre-set unlawful practice;
Upon a match, the rule-breaking vehicle is determined;
When mismatching, determine the vehicle not in violation of rules and regulations.
Above-mentioned processor is also configured to:
The unlawful practice may include one or more in following behavior: violating road traffic signal lamp and passes through, does not press Regulation slows down, stops, overtakes other vehicles, avoids pedestrian, drives over the speed limit, occupies Emergency Vehicle Lane traveling, reversing, reverse row on a highway It sails, lower than minimum speed per hour traveling is provided, violates prohibitory sign, forbids graticule instruction traveling.
Above-mentioned processor is also configured to:
When the rule-breaking vehicle, to unlawful practice described in driver's voice broadcast.
Above-mentioned processor is also configured to:
Vehicle-periphery is shot, the image of the vehicle-periphery is obtained.
Above-mentioned processor is also configured to:
The current state information of the vehicle, it may include one or more in following information:
Travel speed, position and the steering angle of the vehicle.
Above-mentioned processor is also configured to:
The target information relevant to the vehicle driving may include one or more in following information: speed limitation board, Traffic lights, pedestrian, non-motor vehicle, barrier, road turning mark, traffic lane line.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method Embodiment in be described in detail, no detailed explanation will be given here.
Fig. 8 is a kind of block diagram of device reminded for rule-breaking vehicle shown according to an exemplary embodiment, the device Suitable for terminal device.For example, device 1200 can be mobile phone, and computer, digital broadcasting terminal, messaging device, Game console, tablet device, Medical Devices, body-building equipment, personal digital assistant etc..
Device 1200 may include following one or more components: processing component 1202, memory 1204, power supply module 1206, multimedia component 1208, audio component 1210, the interface 1212 of input/output (I/O), sensor module 1214, and Communication component 1216.
The integrated operation of the usual control device 1200 of processing component 1202, such as with display, telephone call, data communication, Camera operation and record operate associated operation.Processing component 1202 may include one or more processors 1220 to execute Instruction, to perform all or part of the steps of the methods described above.In addition, processing component 1202 may include one or more moulds Block, convenient for the interaction between processing component 1202 and other assemblies.For example, processing component 1202 may include multi-media module, To facilitate the interaction between multimedia component 1208 and processing component 1202.
Memory 1204 is configured as storing various types of data to support the operation in device 1200.These data Example includes the instruction of any application or method for operating on device 1200, contact data, telephone book data, Message, picture, video etc..Memory 1204 can by any kind of volatibility or non-volatile memory device or they Combination is realized, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), it is erasable can Program read-only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory Reservoir, disk or CD.
Power supply module 1206 provides electric power for the various assemblies of device 1200.Power supply module 1206 may include power management System, one or more power supplys and other with for device 1200 generate, manage, and distribute the associated component of electric power.
Multimedia component 1208 includes the screen of one output interface of offer between described device 1200 and user.? In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel, Screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes that one or more touch passes Sensor is to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or sliding is dynamic The boundary of work, but also detect duration and pressure associated with the touch or slide operation.In some embodiments, more Media component 1208 includes a front camera and/or rear camera.When device 1200 is in operation mode, as shot mould When formula or video mode, front camera and/or rear camera can receive external multi-medium data.Each preposition camera shooting Head and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio component 1210 is configured as output and/or input audio signal.For example, audio component 1210 includes a wheat Gram wind (MIC), when device 1200 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone quilt It is configured to receive external audio signal.The received audio signal can be further stored in memory 1204 or via communication Component 1216 is sent.In some embodiments, audio component 1210 further includes a loudspeaker, is used for output audio signal.
I/O interface 1212 provides interface, above-mentioned peripheral interface module between processing component 1202 and peripheral interface module It can be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and Locking press button.
Sensor module 1214 includes one or more sensors, and the state for providing various aspects for device 1200 is commented Estimate.For example, sensor module 1214 can detecte the state that opens/closes of device 1200, the relative positioning of component, such as institute The display and keypad that component is device 1200 are stated, sensor module 1214 can be with detection device 1200 or device 1,200 1 The position change of a component, the existence or non-existence that user contacts with device 1200,1200 orientation of device or acceleration/deceleration and dress Set 1200 temperature change.Sensor module 1214 may include proximity sensor, be configured in not any physics It is detected the presence of nearby objects when contact.Sensor module 1214 can also include optical sensor, as CMOS or ccd image are sensed Device, for being used in imaging applications.In some embodiments, which can also include acceleration sensing Device, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 1216 is configured to facilitate the communication of wired or wireless way between device 1200 and other equipment.Dress The wireless network based on communication standard, such as WiFi can be accessed by setting 1200,2G or 3G or their combination.It is exemplary at one In embodiment, communication component 1216 receives broadcast singal or broadcast correlation from external broadcasting management system via broadcast channel Information.In one exemplary embodiment, the communication component 1216 further includes near-field communication (NFC) module, to promote short distance Communication.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module (UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, device 1200 can be by one or more application specific integrated circuit (ASIC), number Signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for executing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided It such as include the memory 1204 of instruction, above-metioned instruction can be executed by the processor 1220 of device 1200 to complete the above method.Example Such as, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD-ROM, tape, soft Disk and optical data storage devices etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by the processing of device 1200 When device executes, so that device 1200 is able to carry out the method that above-mentioned rule-breaking vehicle is reminded, which comprises
Obtain the image of vehicle-periphery;
Described image is identified, identifies target information relevant to the vehicle driving;
Obtain the current state information of the vehicle;
Determine the vehicle currently whether in violation of rules and regulations according to the current state information of the target information and the vehicle;
When the rule-breaking vehicle, issues and remind to driver.
In one embodiment, the method may also include that
Collect sample corresponding with the type of the target information;
The detection model of target information is detected according to the sample training;
It is described that described image is identified, identify target information relevant to the vehicle driving, comprising:
Described image is passed into the detection model, is determined by the detection model relevant to the vehicle driving Target information.
In one embodiment, the method may also include that
Preset unlawful practice;
The current state information according to the target information and the vehicle determine the vehicle currently whether in violation of rules and regulations, Include:
It is matched according to the current state information of the target information and the vehicle with pre-set unlawful practice;
Upon a match, the rule-breaking vehicle is determined;
When mismatching, determine the vehicle not in violation of rules and regulations.
In one embodiment, the unlawful practice may include one or more in following behavior: violate road traffic Signal lamp is current, does not slow down by regulation, stops, overtakes other vehicles, avoids pedestrian, drives over the speed limit, occupies Emergency Vehicle Lane traveling, public in high speed Road reversing, reverse driving are travelled lower than the minimum speed per hour of regulation, are violated prohibitory sign, are forbidden graticule instruction traveling.
In one embodiment, described when the rule-breaking vehicle, it issues and reminds to driver, it may include:
When the rule-breaking vehicle, to unlawful practice described in driver's voice broadcast.
In one embodiment, the image for obtaining vehicle-periphery, it may include:
Vehicle-periphery is shot, the image of the vehicle-periphery is obtained.
In one embodiment, the current state information of the vehicle, it may include one or more in following information:
Travel speed, position and the steering angle of the vehicle.
In one embodiment, the target information relevant to the vehicle driving may include one in following information It is or multinomial: speed limitation board, traffic lights, pedestrian, non-motor vehicle, barrier, road turning mark, traffic lane line.
Those skilled in the art will readily occur to its of the disclosure after considering specification and practicing disclosure disclosed herein Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.

Claims (14)

1. a kind of method that rule-breaking vehicle is reminded characterized by comprising
Obtain the image of vehicle-periphery;
Described image is identified, identifies target information relevant to the vehicle driving;
Obtain the current state information of the vehicle;
Determine the vehicle currently whether in violation of rules and regulations according to the current state information of the target information and the vehicle;
When the rule-breaking vehicle, issues and remind to driver;
The target information relevant to the vehicle driving includes one or more in following information: speed limitation board, traffic letter Signal lamp, pedestrian, non-motor vehicle, barrier, road turning mark;
The method also includes:
Collect sample corresponding with the type of the target information;
The detection model of target information is detected according to the sample training;
It is described that described image is identified, identify target information relevant to the vehicle driving, comprising:
Described image is passed into the detection model, target relevant to the vehicle driving is determined by the detection model Information.
2. the method as described in claim 1, which is characterized in that the method also includes:
Preset unlawful practice;
The current state information according to the target information and the vehicle determines that whether in violation of rules and regulations the vehicle currently, wraps It includes:
It is matched according to the current state information of the target information and the vehicle with pre-set unlawful practice;
Upon a match, the rule-breaking vehicle is determined;
When mismatching, determine the vehicle not in violation of rules and regulations.
3. method according to claim 2, which is characterized in that the unlawful practice includes one or more in following behavior : it violates road traffic signal lamp and passes through, do not slow down by regulation, stop, overtake other vehicles, avoid pedestrian, drive over the speed limit, occupy emergency car Road traveling, on a highway reversing, reverse driving, lower than minimum speed per hour traveling is provided, violation prohibitory sign forbids graticule to refer to Show traveling.
4. the method as described in claim 1, which is characterized in that it is described when the rule-breaking vehicle, it issues and reminds to driver, Include:
When the rule-breaking vehicle, to unlawful practice described in driver's voice broadcast.
5. the method as described in claim 1, which is characterized in that the image for obtaining vehicle-periphery, comprising:
Vehicle-periphery is shot, the image of the vehicle-periphery is obtained.
6. the method as described in claim 1, which is characterized in that in the current state information of the vehicle, including following information It is one or more:
Travel speed, position and the steering angle of the vehicle.
7. the device that a kind of rule-breaking vehicle is reminded characterized by comprising
First obtains module, for obtaining the image of vehicle-periphery;
Identification module identifies target information relevant to the vehicle driving for identifying to described image, it is described with The relevant target information of the vehicle driving includes one or more in following information: speed limitation board, traffic lights, pedestrian, Non-motor vehicle, barrier, road turning mark;
Second obtains module, for obtaining the current state information of the vehicle;
Determining module, for according to the current state information of the target information and the vehicle determine the vehicle currently whether In violation of rules and regulations;
Reminding module, for issuing and reminding to driver when the rule-breaking vehicle;
Described device further include:
Collection module, for collecting sample corresponding with the type of the target information;
Training module, for detecting the detection model of target information according to the sample training;
The identification module, comprising:
First determines submodule, for described image to be passed to the detection model, is determined by the detection model and institute State the relevant target information of vehicle driving.
8. device as claimed in claim 7, which is characterized in that described device further include:
Setup module, for presetting unlawful practice;
The determining module, comprising:
Matched sub-block, for according to the current state information of the target information and the vehicle and pre-set violation row To be matched;
Second determines submodule, for upon a match, determining the rule-breaking vehicle;
Third determines submodule, for determining the vehicle not in violation of rules and regulations when mismatching.
9. device as claimed in claim 8, which is characterized in that the unlawful practice includes one or more in following behavior : it violates road traffic signal lamp and passes through, do not slow down by regulation, stop, overtake other vehicles, avoid pedestrian, drive over the speed limit, occupy emergency car Road traveling, on a highway reversing, reverse driving, lower than minimum speed per hour traveling is provided, violation prohibitory sign forbids graticule to refer to Show traveling.
10. device as claimed in claim 7, which is characterized in that the reminding module, comprising:
Submodule is reminded, is used for when the rule-breaking vehicle, to unlawful practice described in driver's voice broadcast.
11. device as claimed in claim 7, which is characterized in that described first obtains module, comprising:
Acquisition submodule obtains the image of the vehicle-periphery for shooting to vehicle-periphery.
12. device as claimed in claim 7, which is characterized in that in the current state information of the vehicle, including following information It is one or more:
Travel speed, position and the steering angle of the vehicle.
13. the device that a kind of rule-breaking vehicle is reminded characterized by comprising
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Obtain the image of vehicle-periphery;
Described image is identified, identifies target information relevant to the vehicle driving;
Obtain the current state information of the vehicle;
Determine the vehicle currently whether in violation of rules and regulations according to the current state information of the target information and the vehicle;
When the rule-breaking vehicle, issues and remind to driver;
The target information relevant to the vehicle driving includes one or more in following information: speed limitation board, traffic letter Signal lamp, pedestrian, non-motor vehicle, barrier, road turning mark;
Collect sample corresponding with the type of the target information;
The detection model of target information is detected according to the sample training;
It is described that described image is identified, identify target information relevant to the vehicle driving, comprising:
Described image is passed into the detection model, target relevant to the vehicle driving is determined by the detection model Information.
14. a kind of computer readable storage medium, is stored thereon with computer instruction, which is characterized in that the instruction is by processor The step of the claims 1-6 any one the method is realized when execution.
CN201610350481.8A 2016-05-24 2016-05-24 The method and device that rule-breaking vehicle is reminded Active CN106004883B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610350481.8A CN106004883B (en) 2016-05-24 2016-05-24 The method and device that rule-breaking vehicle is reminded

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610350481.8A CN106004883B (en) 2016-05-24 2016-05-24 The method and device that rule-breaking vehicle is reminded

Publications (2)

Publication Number Publication Date
CN106004883A CN106004883A (en) 2016-10-12
CN106004883B true CN106004883B (en) 2018-12-11

Family

ID=57093170

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610350481.8A Active CN106004883B (en) 2016-05-24 2016-05-24 The method and device that rule-breaking vehicle is reminded

Country Status (1)

Country Link
CN (1) CN106004883B (en)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108268874A (en) * 2016-12-30 2018-07-10 环达电脑(上海)有限公司 Driving system for prompting and its method
KR102388148B1 (en) * 2017-05-17 2022-04-19 현대자동차주식회사 Methof and system for providing driving guidance
CN107463907B (en) * 2017-08-08 2021-06-25 东软集团股份有限公司 Vehicle collision detection method and device, electronic equipment and vehicle
CN107978168A (en) * 2017-11-21 2018-05-01 风度(常州)汽车研发院有限公司 Driving monitoring method, device and monitoring device
CN108447305B (en) * 2018-04-21 2020-09-04 上海交通大学 Pre-warning method and pre-warning system for courier pedestrian
CN110455302B (en) * 2018-05-08 2023-10-20 奥迪股份公司 Navigation system control method, device, computer equipment and storage medium
CN108765945A (en) * 2018-05-31 2018-11-06 深圳市元征科技股份有限公司 A kind of vehicle peccancy recognition methods and system
CN110717365B (en) * 2018-07-13 2022-05-31 杭州海康威视数字技术股份有限公司 Method and device for obtaining picture
CN109034313A (en) * 2018-08-09 2018-12-18 刘丽 Parking stall use state detection method, system, reflective tape and anticollision strip
CN110871810A (en) * 2018-08-21 2020-03-10 上海博泰悦臻网络技术服务有限公司 Vehicle, vehicle equipment and driving information prompting method based on driving mode
CN109549297A (en) * 2018-11-30 2019-04-02 努比亚技术有限公司 Assisting automobile driver method, Intelligent bracelet and storage medium based on Intelligent bracelet
CN111361666A (en) * 2018-12-24 2020-07-03 中移(杭州)信息技术有限公司 Method and equipment for automatically reminding vehicle motion state
CN109671286A (en) * 2018-12-26 2019-04-23 东软睿驰汽车技术(沈阳)有限公司 A kind for the treatment of method and apparatus of road information and Traffic Information
CN110189524B (en) * 2019-06-19 2021-07-30 刘先进 Active violation identification method and system and electronic equipment
CN111857116B (en) * 2019-07-26 2024-09-06 北京骑胜科技有限公司 Vehicle reverse driving control method and device, electronic equipment and storage medium
CN110335484B (en) * 2019-08-08 2021-03-12 北京小马慧行科技有限公司 Method and device for controlling vehicle to run
CN110615001B (en) * 2019-09-27 2021-04-27 汉纳森(厦门)数据股份有限公司 Driving safety reminding method, device and medium based on CAN data
CN113380021B (en) * 2020-03-10 2023-10-10 深圳市丰驰顺行信息技术有限公司 Vehicle state detection method, device, server and computer readable storage medium
CN111653095A (en) * 2020-05-29 2020-09-11 北京瑞华赢科技发展有限公司 System and method for identifying operation violation of public transport vehicle
CN114379574B (en) * 2020-10-20 2023-10-31 沃尔沃汽车公司 Object reminding device, system and method for vehicle
CN112664648A (en) * 2020-12-24 2021-04-16 长安大学 Method for preventing illegal backing at highway intersection and auxiliary safety system
CN113370997A (en) * 2021-08-11 2021-09-10 北京赛目科技有限公司 Control method and device for automatic driving of vehicle, electronic equipment and storage medium
CN113997940B (en) * 2021-12-20 2022-12-16 镁佳(北京)科技有限公司 Driving behavior monitoring method and device
CN115019400B (en) * 2022-07-19 2023-03-03 北京拙河科技有限公司 Illegal behavior detection method and device
CN114954480B (en) * 2022-07-28 2022-11-22 江西五十铃汽车有限公司 Safe driving early warning method and system, readable storage medium and vehicle
CN116153080A (en) * 2023-04-17 2023-05-23 创意信息技术股份有限公司 Method, device, equipment and storage medium for detecting vehicle illegal running

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103116748A (en) * 2013-03-11 2013-05-22 清华大学 Method and system for identifying illegal driving behavior based on road signs
CN104978861A (en) * 2015-06-17 2015-10-14 小米科技有限责任公司 Vehicle identification method and vehicle identification device
CN105405306A (en) * 2015-12-24 2016-03-16 小米科技有限责任公司 Vehicle alarm method and device
CN105438184A (en) * 2015-12-22 2016-03-30 上海卓易科技股份有限公司 Vehicle and method and system for recognizing traffic signs to assist in driving

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104331703A (en) * 2013-07-22 2015-02-04 博世汽车部件(苏州)有限公司 Method of monitoring vehicle running state and automobile navigation equipment for implementing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103116748A (en) * 2013-03-11 2013-05-22 清华大学 Method and system for identifying illegal driving behavior based on road signs
CN104978861A (en) * 2015-06-17 2015-10-14 小米科技有限责任公司 Vehicle identification method and vehicle identification device
CN105438184A (en) * 2015-12-22 2016-03-30 上海卓易科技股份有限公司 Vehicle and method and system for recognizing traffic signs to assist in driving
CN105405306A (en) * 2015-12-24 2016-03-16 小米科技有限责任公司 Vehicle alarm method and device

Also Published As

Publication number Publication date
CN106004883A (en) 2016-10-12

Similar Documents

Publication Publication Date Title
CN106004883B (en) The method and device that rule-breaking vehicle is reminded
US20210365696A1 (en) Vehicle Intelligent Driving Control Method and Device and Storage Medium
RU2656933C2 (en) Method and device for early warning during meeting at curves
CN105469102A (en) Vehicle driving information recording method and vehicle driving information recording device
US9319860B2 (en) Mobile terminal that determine whether the user is walking while watching the mobile terminal
CN106781471B (en) Traffic condition determines method and device
CN108734967B (en) Method, device and system for monitoring illegal vehicle
CN108235780A (en) For transmitting the system and method for message to vehicle
JP6613623B2 (en) On-vehicle device, operation mode control system, and operation mode control method
CN104537837B (en) Method, device and system for determining traffic routes
CN105405306A (en) Vehicle alarm method and device
CN106650603A (en) Vehicle surrounding monitoring method, apparatus and the vehicle
CN104978861A (en) Vehicle identification method and vehicle identification device
CN109017554A (en) Travel based reminding method, device and computer readable storage medium
EP3309711B1 (en) Vehicle alert apparatus and operating method thereof
CN108765945A (en) A kind of vehicle peccancy recognition methods and system
CN106960602A (en) Carry out driving method, mobile unit and the device of early warning in vehicle travel process
JP2020024580A (en) Driving evaluation device and on-vehicle device
CN104239847B (en) Driving warning method and electronic device for vehicle
CN106741542A (en) Control method for vehicle and device
CN114620072A (en) Vehicle control method, device, storage medium, electronic device and vehicle
CN112818839A (en) Method, device, equipment and medium for identifying violation behaviors of driver
CN114332821A (en) Decision information acquisition method, device, terminal and storage medium
CN106870180A (en) The method for closing and device of automatic start-stop function
CN110221887A (en) Methods of exhibiting, the apparatus and system of driving behavior assessment information

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant