CN108369645A - Taxi operation monitoring method, device, storage medium and system - Google Patents
Taxi operation monitoring method, device, storage medium and system Download PDFInfo
- Publication number
- CN108369645A CN108369645A CN201880000144.3A CN201880000144A CN108369645A CN 108369645 A CN108369645 A CN 108369645A CN 201880000144 A CN201880000144 A CN 201880000144A CN 108369645 A CN108369645 A CN 108369645A
- Authority
- CN
- China
- Prior art keywords
- passenger
- image
- image data
- information
- taxi operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000012544 monitoring process Methods 0.000 title claims abstract description 22
- 230000006399 behavior Effects 0.000 claims abstract description 23
- 230000006378 damage Effects 0.000 claims abstract description 14
- 208000027418 Wounds and injury Diseases 0.000 claims abstract description 13
- 208000014674 injury Diseases 0.000 claims abstract description 13
- 238000000605 extraction Methods 0.000 claims abstract description 10
- 230000001133 acceleration Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 9
- 230000001815 facial effect Effects 0.000 claims description 9
- 230000002123 temporal effect Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 5
- 238000013135 deep learning Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 231100001261 hazardous Toxicity 0.000 description 3
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/40—Business processes related to the transportation industry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1365—Matching; Classification
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Accounting & Taxation (AREA)
- Human Computer Interaction (AREA)
- Marketing (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Entrepreneurship & Innovation (AREA)
- Game Theory and Decision Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Primary Health Care (AREA)
- Tourism & Hospitality (AREA)
- Traffic Control Systems (AREA)
- Alarm Systems (AREA)
Abstract
The embodiment of the application provides a taxi operation monitoring method, which comprises the following steps: carrying out feature extraction on the acquired in-vehicle image data to obtain passenger image feature information; and comparing the passenger image characteristic information with first standard characteristic information, and generating an alarm signal if the similarity of the comparison result reaches a first preset threshold value. The scheme further discloses a taxi operation monitoring system, electronic equipment and a storage medium. According to the technical scheme, the image characteristic information of passengers in the car is analyzed, so that the statistics of the getting-on and getting-off frequency of the passengers in the operation process is realized, and whether car-sharing behaviors occur or not is determined; by comparing the image characteristic information of the passenger in the taxi with the standard characteristic information, whether the passenger has personal injury to the driver or carries suspicious people or not in the operation process is determined, so that the safety of the driver in the taxi operation process is monitored in real time, and the taxi operation safety is improved.
Description
Technical field
The present invention relates to public transport monitoring operation field, it is related to a kind of taxi operation monitoring method, electronic equipment, deposits
Storage media and system.
Background technology
Taxi belongs to a kind of public transport mode, and following abnormal conditions are likely to occur in taxi operation：Driver is leading
More people's share-cars, fugitive convict ride (convict or suspect ride), passenger's hazardous act (hold knife/rifle coerce driver or other
Passenger).These abnormal conditions can give society, taxi operation side, taxi driver etc. to cause damages, and needs are supervised.But
It is current main or rely on manpower to supervise, such as supervise share-car behavior by municipal administration, multiplied to differentiate by taxi driver
The legitimacy etc. of visitor, supervision efficiency is low, effect is poor.
Invention content
One of to solve above-mentioned technical problem, this application provides a kind of taxi operation monitoring method, this method is available
It is supervised in the operation of the public transport such as such as taxi.
According to the first aspect of the embodiment of the present application, a kind of taxi operation monitoring method is provided, including：To acquisition
Obtained interior image data carries out feature extraction, obtains passenger image characteristic information；By the passenger image characteristic information with
First standard feature information is compared, if the similarity of comparison result reaches the first predetermined threshold value, generates alarm signal.
According to the second aspect of the embodiment of the present application, a kind of electronic equipment is additionally provided, the electronic equipment includes：It deposits
Reservoir, one or more processors；Memory is connected with processor by communication bus；Processor is configured as executing memory
In instruction；The instruction for executing each step in method as described above is stored in the storage medium.
In terms of according to the third of the embodiment of the present application, a kind of computer readable storage medium is additionally provided, is stored thereon
There is computer program, which is characterized in that the step of program realizes method as described above when being executed by processor.
According to the 4th of the embodiment of the present application the aspect, a kind of taxi operation monitoring system is additionally provided, including：Image
Collecting device, for carrying out image data acquiring to the human body of passenger inside the vehicle and/or face, obtain passenger inside the vehicle's image data and
The image data acquiring time；With electronic equipment as described above.
Herein described technical solution is by the way that passenger inside the vehicle's image feature information to be compared with standard feature information, really
Whether fixed operation occurs that driver is caused the behavior of personal injury or multiplied to have transported a suspect in the process, in real time to taxi
The safety of driver is monitored during operation, improves taxi operation safety.
Herein described technical solution by during taxi operation handling capacity of passengers and passenger getting on/off information carry out
Statistics can carry out rational allocation and management to the whole operation of taxi on this basis.
Herein described technical solution by time of coincidence that different passengers are stopped in the car to passenger's share-car situation into
Row judges, to reinforce dominating the management and control of more people's share-car behaviors to driver.
Description of the drawings
Fig. 1 is the schematic diagram of taxi operation monitoring method described in this programme；
Fig. 2 is the schematic diagram judged share-car situation described in this programme；
Fig. 3 is the schematic diagram of passenger inside the vehicle's image acquisition region described in this programme.
Drawing reference numeral
1, camera, 2, taxi.
Specific implementation mode
In order to make technical solution in the embodiment of the present application and advantage be more clearly understood, below in conjunction with attached drawing to the application
Exemplary embodiment be described in more detail, it is clear that described embodiment be only the application a part implement
Example, rather than the exhaustion of all embodiments.It should be noted that in the absence of conflict, the embodiment in the application and reality
The feature applied in example can be combined with each other.
The core ideas of this programme is multiple images collecting device by being arranged on taxi in real time to passenger inside the vehicle
Human body and/or face carry out image data acquiring, and to image data carry out feature extraction, obtain passenger image feature letter
Breath；Based on passenger image characteristic information, judges whether to occur to cause the behavior of personal injury, share-car behavior to driver or have can
Situations such as doubtful personnel ride, to reinforce the supervision to taxi operation.
Embodiment one
As shown in Figure 1, this example provides a kind of taxi operation monitoring method based on cloud server, this method
Step includes：
Interior image data is acquired, the acquisition time of passenger inside the vehicle's image data and image data is obtained；
Feature extraction is carried out to the interior image data collected, obtains passenger image characteristic information；
The passenger image characteristic information is compared with the first standard feature information, if the similarity of comparison result reaches
To the first predetermined threshold value, then alarm signal is generated；
Wherein, the first standard feature information includes：Characteristics of human body and/or the face of personal injury behavior are caused to driver
Portion's feature.The passenger image characteristic information includes characteristics of human body and/or face feature information.
In this example, interior image can be acquired by image capture device, from the interior image collected
The characteristic information of human body, face that passenger is detected in data is as passenger image characteristic information.It can be with for the extraction of feature
It is realized using the methods of the Face datection of human body target detection, view-based access control model based on deep learning.For example, Face datection can be with
Using based on the cascade method of binary picture feature combination multi-categorizer, human testing may be used based on human body contour outline or depth
The method of the crucial point location of degree study.In the present solution, facial feature extraction can also be gone out together when characteristics of human body extracts
Come, forms the assemblage characteristic of characteristics of human body and facial characteristics.
In this example, it is compared with the first standard feature information using passenger image characteristic information, to judge to hire out
During vehicle operation, the security situation of driver or the dangerous situation for carrying passenger.Wherein, the first standard feature information includes：It is right
Driver causes characteristics of human body and/or facial characteristics of personal injury behavior etc.；Cause the human body of personal injury behavior special driver
Sign can be the characteristics of human body that passenger holds the hazardous acts such as knife, armed or hand-held other dangerous material；Facial characteristics can be fugitive
The facial characteristics of the dangerous persons such as convict.
In this example, for passenger image characteristic information is compared with the first standard feature information, comparison result
Similarity reaches the first predetermined threshold value, then the step of generating alarm signal, can by image classification based on deep learning or
The method of target detection holds passenger to realize the image feature information of the hazardous acts such as knife, armed or hand-held other dangerous material
Matching identification；Or, by human body based on deep learning or face identification method come identify human body or the corresponding people's name of face,
Whether it is some dangerous person in chartered runaway convict library.Pass through the result of matching identification, it is determined whether generate alarm signal
Number；Remote equipment can monitor alarm signal in real time, if detecting alarm signal, alarm at once in remote port.Due to practical figure
The characteristic information of picture may will be a certain deviation with standard feature information, therefore, in order to improve alert capability and to the peace of driver
Quan Xing can be disposed at 70% to 90% when the first predetermined threshold value is arranged, as long as similarity reaches this threshold value
Alarm signal is sent out, is further confirmed that again by remote worker after alarm, to improve the alert capability of system and right
The safety of driver.The setting of predetermined threshold value can be adjusted according to actual conditions, be not limited only to the above-mentioned reality provided
Example.In the present solution, the comparison for passenger image characteristic information and the first standard feature information, can select according to actual demand
Individually characteristics of human body and facial characteristics are compared to characteristics of human body, individually to facial characteristics or simultaneously, to improve detection
Accuracy and detection efficiency.
In the present solution, causing image capture device that can not collect passenger in the car in order to avoid passenger moves in the car
The problem of image, when having passenger in the car, the car image data needs to include the image of passenger, therefore, as the passenger
When position changes, then Image Acquisition is carried out to passenger inside the vehicle by the way of tracking；Specifically：To being examined in former frame picture
Human body, the face measured can the case where tracking the change in location of this human body, face in the current frame, including disappear from picture
It is realized in method by target following.Namely based on previous moment target position, transported by target between adjacent time point
Dynamic continuity and correlation quickly detects target in the position at current time.
In this example, it is also based on number of the acquisition time to passenger getting on/off of interior image data and image data
It is counted, obtains passenger carrying capacity data and the corresponding temporal information of getting on or off the bus of passenger.Specifically, being schemed in the car with first appearing
As the image feature information of a certain passenger in data is as the second standard feature information；
It is spaced to schedule, the image feature information of the interior passenger is compared with the second standard feature information
It is right, if the similarity of comparison result is less than the second predetermined threshold value, confirm the operation for completing the passenger, passenger carrying capacity adds 1, and remembers
Record the corresponding information of getting on or off the bus of the passenger；
It repeats the above steps, records the passenger carrying capacity data and the corresponding information of getting on or off the bus of passenger in the predetermined service time.
Wherein, can also be based on the thought of serious forgiveness for the setting of the second predetermined threshold value, it can be by the second predetermined threshold value
Setting is 10% to 20%, as long as similarity can confirm the operation for completing the passenger less than this threshold value.For predetermined threshold value
Setting can be adjusted according to actual conditions, be not limited only to the above-mentioned example provided.
In this example, for number of getting on or off the bus statistics can based in previous image human body/Face datection, human body/
Face tracking as a result, counting someone stop starting and ending time on certain vehicle.Wherein, different people is expressed as P1, P2,
P3...；The whole story time that everyone i is stopped in vehicle is ti0、ti1；In addition it can count everyone, residing for each moment
GPS position information.These statistical informations can be stored in person-time statistic information base, can be periodically transmitted to high in the clouds and be used for
Backup and evidence obtaining.
In this example, as shown in Fig. 2, being also based on human body/Face datection in previous image, human body/face tracking
As a result, count someone stop starting and ending time on certain vehicle, and further share-car behavior is identified, for two
A above, having time overlaps, the people that the whole story time is different, it is believed that is share-car suspicion.For example, two people P in upper figure3And P4,
There are coincidence and whole story time point difference (t in their time30<t40<t31<t41), so P3And P4It is likely to share-car.Separately
Outside, the geographical location information that GPS is provided can also be used as a factor for differentiating share-car, for example, if the above behavior is happened at ground
Iron station, bus station near railway station, are then determined as the probability higher of share-car.
In this example, personal injury behavior, suspicious figure or share-car behavior are caused to driver when detecting, then send out alarm
Signal, while behavior type and image information are sent to high in the clouds together, high in the clouds is alarmed according to alarm signal, for taxi public affairs
The departments such as department, police decision uses.
Herein described technical solution is by the way that passenger inside the vehicle's image feature information to be compared with standard feature information, really
Whether fixed operation occurs that driver is caused the behavior of personal injury or multiplied to have transported a suspect in the process, in real time to taxi
The safety of driver is monitored during operation, improves taxi operation safety.
Herein described technical solution by during taxi operation handling capacity of passengers and passenger getting on/off information carry out
Statistics can carry out rational allocation and management to the whole operation of taxi on this basis.
Herein described technical solution by time of coincidence that different passengers are stopped in the car to passenger's share-car situation into
Row judges, to reinforce dominating the management and control of more people's share-car behaviors to driver.
Embodiment 2
This example discloses a kind of electronic equipment, which is characterized in that the electronic equipment includes：Memory, one or more
A processor；Memory is connected with processor by communication bus；Processor is configured as executing the instruction in memory；It is described
The instruction for executing each step in method described in embodiment 1 is stored in storage medium.
Herein described technical solution is by the way that passenger inside the vehicle's image feature information to be compared with standard feature information, really
Whether fixed operation occurs that driver is caused the behavior of personal injury or multiplied to have transported a suspect in the process, in real time to taxi
The safety of driver is monitored during operation, improves taxi operation safety.
Herein described technical solution by during taxi operation handling capacity of passengers and passenger getting on/off information carry out
Statistics can carry out rational allocation and management to the whole operation of taxi on this basis.
Herein described technical solution by time of coincidence that different passengers are stopped in the car to passenger's share-car situation into
Row judges, to reinforce dominating the management and control of more people's share-car behaviors to driver.
Embodiment 3
This example discloses a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that should
The step of method as described in example 1 above is realized when program is executed by processor.
Herein described technical solution is by the way that passenger inside the vehicle's image feature information to be compared with standard feature information, really
Whether fixed operation occurs that driver is caused the behavior of personal injury or multiplied to have transported a suspect in the process, in real time to taxi
The safety of driver is monitored during operation, improves taxi operation safety.
Herein described technical solution by during taxi operation handling capacity of passengers and passenger getting on/off information carry out
Statistics can carry out rational allocation and management to the whole operation of taxi on this basis.
Herein described technical solution by time of coincidence that different passengers are stopped in the car to passenger's share-car situation into
Row judges, to reinforce dominating the management and control of more people's share-car behaviors to driver.
Embodiment 4
This example discloses a kind of taxi operation monitoring system based on cloud server, which includes that setting is going out
Multiple images collecting device in hiring a car and electronic equipment as described in Example 2.Using multiple images collecting device to car
Image is acquired, and obtains the acquisition time of interior image data and image data；Using electronic equipment to collecting
Image data carries out feature extraction, and the passenger image characteristic information that extraction obtains is compared with the first standard feature information,
If the similarity of comparison result reaches the first predetermined threshold value, alarm signal is generated.Wherein, the first standard feature information includes：
The image feature information and/or facial image features information of personal injury behavior are caused to driver.By by passenger inside the vehicle's image
Characteristic information is compared with standard feature information, determines whether operation occurs causing driver the behavior of personal injury in the process
Or multiply and transported a suspect, to be monitored in real time to the safety of driver during taxi operation, improve taxi fortune
Battalion's safety.In this example, image capture device can be separately positioned on the front end at front and rear row seat, and specific installation position can root
It is adjusted according to image acquisition region.Preferably, it is arranged and is not arranging among seat on the vehicle body frame of oblique upper.In this example,
The microprocessor of built-in recognizer may be used in computing unit, and it is integrated with interior other equipment or is separately provided in the car
Some region, specific location can according to interior physical device arrange situation and adjust.
In this example, described image collecting device can follow the change in location of passenger inside the vehicle, to vehicle in a manner of tracking
Interior passenger carries out Image Acquisition, and avoiding passenger and moving in the car causes image capture device that can not collect passenger in the car
The problem of image.
In this example, the taxi operation monitoring system is further provided with storage unit, and the storage unit can
Storage collects all data and the first standard feature information in image data, computing unit implementation procedure.When high in the clouds needs
It wants all data during operation are uploaded to high in the clouds at any time when called data.
In this example, the taxi operation monitoring system is further provided with network module, which can pass through net
Network module obtains the first standard feature information that high in the clouds provides or other high in the clouds are transmitted to the communication information of the system；It can also lead to
It crosses network module and all data in the image data collected and/or computing unit implementation procedure is sent to cloud service
Device.
In this example, the taxi operation monitoring system is further provided with locating module and/or acceleration detection mould
Block.Locating module is used for the location information of real-time collection vehicle, and the electronic equipment is based on the location information and is carried out to vehicle
Positioning in real time.Acceleration detection module is used for the acceleration information of real-time collection vehicle, and the electronic equipment is based on the acceleration
Degree information determines the transport condition of vehicle.In this example, the locating module can select GPS or IMU sensors.The acceleration
Degree detection module can select acceleration transducer.
As shown in figure 3, taxi operation monitoring system described in this example includes camera 2, sensor, such as 2 institute of embodiment
Electronic equipment, storage unit and the network module composition stated.Wherein, camera is responsible for shooting interior picture, usually, it is contemplated that
The front row for covering taxi 1 needs two synchronous wide viewing angle cameras with heel row；GPS/IMU etc. may be used in sensor,
It can be used for providing geographical location information (such as so-and-so bus station, so-and-so subway station, so-and-so railway station etc.), IMU sensors
It can also be used to judge the transport condition (such as stopping, acceleration, deceleration etc.) of taxi 1；The electronic equipment is for executing
1 the method step of embodiment；Storage unit is responsible for storing suspect/convict's feature database, person-time statistic information base etc.；Network mould
Block, which is responsible for communicating with first end, obtains suspect/convict's characteristic, push person-time statistical data etc..There is corresponding software and hardware in high in the clouds
Module is docked with mobile unit.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, the application can be used in one or more wherein include computer usable program code computer
The computer program production implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The application is with reference to method, the flow of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
Instruct the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine so that the instruction executed by computer or the processor of other programmable data processing devices is generated for real
The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that instruction generation stored in the computer readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device so that count
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, in computer or
The instruction executed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
It these are only the embodiment of the present invention, be not intended to restrict the invention, it is all in the spirit and principles in the present invention
Within, any modification, equivalent substitution, improvement and etc. done, be all contained in apply pending scope of the presently claimed invention it
It is interior.
Claims (12)
1. a kind of taxi operation detection method, which is characterized in that the step of this method includes：
Feature extraction is carried out to the interior image data collected, obtains passenger image characteristic information；
The passenger image characteristic information is compared with the first standard feature information, if the similarity of comparison result reaches
One predetermined threshold value, then generate alarm signal；
Wherein, the first standard feature information includes：Cause the characteristics of human body of personal injury behavior and/or face special driver
Sign；The passenger image characteristic information includes：Characteristics of human body and/or facial characteristics.
2. taxi operation monitoring method according to claim 1, which is characterized in that the described pair of interior figure collected
Include before the step of carrying out feature extraction as data, obtain passenger image characteristic information：
Interior image is acquired, the acquisition time of interior image data and image data is obtained.
3. taxi operation monitoring method according to claim 2, which is characterized in that car has passenger, which is characterized in that
The car image data includes the image of the passenger, and when the passenger position changes, then use tracking acquires institute
State passenger image.
4. taxi operation monitoring method according to claim 3, which is characterized in that the step of this method further wraps
It includes：
Acquisition time based on interior image data and image data counts the number of passenger getting on/off, obtains carrying number
Measure data and the corresponding temporal information of getting on or off the bus of passenger.
5. taxi operation monitoring method according to claim 4, which is characterized in that it is described based on interior image data and
The acquisition time of image data counts the number of passenger getting on/off, obtains passenger carrying capacity data and passenger is corresponding up and down
The step of vehicle temporal information includes：
The image feature information of a certain passenger in image data in the car is first appeared as the second standard feature information；
It is spaced to schedule, the image feature information of the interior passenger is compared with the second standard feature information, if
The similarity of comparison result is less than the second predetermined threshold value, then confirms that the operation for completing the passenger, passenger carrying capacity add 1, and recording should
The corresponding information of getting on or off the bus of passenger；
It repeats the above steps, records the passenger carrying capacity data and the corresponding temporal information of getting on or off the bus of passenger in the predetermined service time.
6. taxi operation monitoring method according to claim 5, which is characterized in that it is described based on interior image data and
The acquisition time of image data counts the number of passenger getting on/off, obtains passenger carrying capacity data and passenger is corresponding up and down
The step of vehicle temporal information further includes：
Acquisition time based on interior image data and image data compares the time of coincidence that different passengers stop in the car, if
The time of coincidence is less than the predetermined time, then generates share-car alarm signal.
7. taxi operation monitoring method according to claim 1, which is characterized in that the step of this method further wraps
It includes：
The location information and/or running state information of current vehicle are acquired.
8. a kind of electronic equipment, which is characterized in that the electronic equipment includes：Memory, one or more processors；Memory
It is connected by communication bus with processor；Processor is configured as executing the instruction in memory；It is deposited in the storage medium
Contain the instruction that each step in 1 to 7 any one the method is required for perform claim.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor
The step of any one of claim 1 to 7 the method is realized when row.
10. a kind of taxi operation monitors system, which is characterized in that the system includes：
Image capture device, for being acquired to interior image, when obtaining the acquisition of interior image data and image data
Between；
Electronic equipment as claimed in claim 8.
11. taxi operation according to claim 10 monitors system, which is characterized in that described image collecting device can
The change in location for following passenger inside the vehicle carries out Image Acquisition in a manner of tracking to passenger inside the vehicle.
12. the taxi operation according to claim 10 or 11 monitors system, which is characterized in that the system is further wrapped
It includes：
Locating module, be used for real-time collection vehicle location information, the electronic equipment be based on the location information to vehicle into
Row positioning in real time；And/or
Acceleration detection module, is used for the acceleration information of real-time collection vehicle, and the electronic equipment is believed based on the acceleration
Breath determines the transport condition of vehicle.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2018/075840 WO2019153193A1 (en) | 2018-02-08 | 2018-02-08 | Taxi operation monitoring method, device, storage medium, and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108369645A true CN108369645A (en) | 2018-08-03 |
Family
ID=63012587
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201880000144.3A Pending CN108369645A (en) | 2018-02-08 | 2018-02-08 | Taxi operation monitoring method, device, storage medium and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108369645A (en) |
| WO (1) | WO2019153193A1 (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109326120A (en) * | 2018-12-21 | 2019-02-12 | 深圳友浩车联网股份有限公司 | A kind of airport intelligent taxi dispatching method |
| CN109598190A (en) * | 2018-10-23 | 2019-04-09 | 深圳壹账通智能科技有限公司 | Method, apparatus, computer equipment and storage medium for action recognition |
| CN110197150A (en) * | 2019-05-27 | 2019-09-03 | 大陆投资(中国)有限公司 | Trip method of servicing, apparatus and system |
| CN110378189A (en) * | 2019-04-22 | 2019-10-25 | 北京旷视科技有限公司 | A kind of monitoring method for arranging, device, terminal and storage medium |
| CN110958566A (en) * | 2018-09-26 | 2020-04-03 | 上海飞田通信股份有限公司 | Positioning, recognizing and carrying passenger receiving system and control method thereof |
| CN111079474A (en) * | 2018-10-19 | 2020-04-28 | 上海商汤智能科技有限公司 | Passenger state analysis method and device, vehicle, electronic device, and storage medium |
| CN111428545A (en) * | 2019-01-10 | 2020-07-17 | 北京嘀嘀无限科技发展有限公司 | Behavior judgment method and device and electronic equipment |
| CN111461368A (en) * | 2019-01-21 | 2020-07-28 | 北京嘀嘀无限科技发展有限公司 | Abnormal order processing method, device, equipment and computer readable storage medium |
| WO2020151339A1 (en) * | 2019-01-24 | 2020-07-30 | 平安科技（深圳）有限公司 | Abnormality processing method and apparatus based on unmanned vehicle, and related devices |
| CN111738158A (en) * | 2020-06-23 | 2020-10-02 | 上海商汤临港智能科技有限公司 | Control method and device for vehicle, electronic device and storage medium |
| CN112208475A (en) * | 2019-07-09 | 2021-01-12 | 奥迪股份公司 | Safety protection system for vehicle occupants, vehicle and corresponding method and medium |
| CN112291677A (en) * | 2020-08-13 | 2021-01-29 | 惠州市德赛西威汽车电子股份有限公司 | Self-adaptive sound field adjusting method, system and storage medium |
| CN112906515A (en) * | 2021-02-03 | 2021-06-04 | 珠海研果科技有限公司 | In-vehicle abnormal behavior identification method and system, electronic device and storage medium |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11206375B2 (en) * | 2018-03-28 | 2021-12-21 | Gal Zuckerman | Analyzing past events by utilizing imagery data captured by a plurality of on-road vehicles |
| CN111178231B (en) * | 2019-12-26 | 2023-07-18 | 航天信息股份有限公司 | Object monitoring method and device |
| CN111666441A (en) * | 2020-04-24 | 2020-09-15 | 北京旷视科技有限公司 | Method, device and electronic system for determining personnel identity type |
| CN111860466A (en) * | 2020-08-17 | 2020-10-30 | 东风畅行科技股份有限公司 | Safety communication acquisition system and method based on travel scene |
| CN111953789A (en) * | 2020-08-17 | 2020-11-17 | 广西云森科技有限公司 | Voice recognition-based network car booking abnormal driving environment monitoring system and method |
| CN112929827B (en) * | 2021-01-20 | 2022-09-16 | 深圳市航通北斗信息技术有限公司 | Method, device and medium for monitoring discharge of construction waste |
| CN113139858B (en) * | 2021-05-17 | 2024-07-26 | 中国第一汽车股份有限公司 | Method for identifying passengers by vehicle, vehicle and storage medium |
| CN113538846A (en) * | 2021-07-13 | 2021-10-22 | 北京国基科技股份有限公司 | Port machine driver operation abnormal behavior analysis alarm method and system |
| CN113592599B (en) * | 2021-08-02 | 2024-05-31 | 湖南蓝眼科技发展有限公司 | Taxi sharing method based on positioning information, electronic equipment and readable storage medium |
| CN114463933A (en) * | 2022-01-24 | 2022-05-10 | 重庆数宜信信用管理有限公司 | Monitoring system and method based on face recognition |
| CN115709684A (en) * | 2022-10-26 | 2023-02-24 | 重庆长安汽车股份有限公司 | Real-time monitoring system for operation safety of commercial vehicle |
| CN115743019B (en) * | 2022-11-17 | 2024-09-13 | 中国第一汽车股份有限公司 | Vehicle control method and device, vehicle, storage medium and electronic device |
| CN116166710B (en) * | 2022-11-17 | 2024-01-12 | 北京白龙马云行科技有限公司 | Duration processing method and device, electronic equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104217539A (en) * | 2014-09-28 | 2014-12-17 | 江阴延利汽车饰件股份有限公司 | Real-time monitoring platform for taxi personnel |
| CN104217537A (en) * | 2014-09-01 | 2014-12-17 | 南通北城科技创业管理有限公司 | Taxi safety system |
| CN104243927A (en) * | 2014-09-27 | 2014-12-24 | 江阴延利汽车饰件股份有限公司 | Security robot control platform with automatic suspect recognizing function |
| CN105292052A (en) * | 2015-11-12 | 2016-02-03 | 福州大学 | Automatic monitoring and alarming system for vehicle traffic safety |
| CN106170826A (en) * | 2016-06-03 | 2016-11-30 | 深圳市锐明技术股份有限公司 | The monitoring method and system of cab-getter's number |
| CN106599813A (en) * | 2016-12-05 | 2017-04-26 | 中兴智能视觉大数据技术（湖北）有限公司 | Railway security check and security protection management system based on face recognition |
| CN106709470A (en) * | 2017-01-04 | 2017-05-24 | 西南交通大学 | Human face identification-based train on-way ticket check method |
| CN206363345U (en) * | 2017-01-13 | 2017-07-28 | 山西正方人和科技有限公司 | A kind of vehicle-mounted vocal print and face recognition device |
| CN107085720A (en) * | 2017-06-06 | 2017-08-22 | 信利光电股份有限公司 | A kind of vehicle-mounted alarm system and method |
| CN107240289A (en) * | 2017-07-24 | 2017-10-10 | 济南博图信息技术有限公司 | A kind of bus routes optimum management method and system |
-
2018
- 2018-02-08 WO PCT/CN2018/075840 patent/WO2019153193A1/en active Application Filing
- 2018-02-08 CN CN201880000144.3A patent/CN108369645A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104217537A (en) * | 2014-09-01 | 2014-12-17 | 南通北城科技创业管理有限公司 | Taxi safety system |
| CN104243927A (en) * | 2014-09-27 | 2014-12-24 | 江阴延利汽车饰件股份有限公司 | Security robot control platform with automatic suspect recognizing function |
| CN104217539A (en) * | 2014-09-28 | 2014-12-17 | 江阴延利汽车饰件股份有限公司 | Real-time monitoring platform for taxi personnel |
| CN105292052A (en) * | 2015-11-12 | 2016-02-03 | 福州大学 | Automatic monitoring and alarming system for vehicle traffic safety |
| CN106170826A (en) * | 2016-06-03 | 2016-11-30 | 深圳市锐明技术股份有限公司 | The monitoring method and system of cab-getter's number |
| CN106599813A (en) * | 2016-12-05 | 2017-04-26 | 中兴智能视觉大数据技术（湖北）有限公司 | Railway security check and security protection management system based on face recognition |
| CN106709470A (en) * | 2017-01-04 | 2017-05-24 | 西南交通大学 | Human face identification-based train on-way ticket check method |
| CN206363345U (en) * | 2017-01-13 | 2017-07-28 | 山西正方人和科技有限公司 | A kind of vehicle-mounted vocal print and face recognition device |
| CN107085720A (en) * | 2017-06-06 | 2017-08-22 | 信利光电股份有限公司 | A kind of vehicle-mounted alarm system and method |
| CN107240289A (en) * | 2017-07-24 | 2017-10-10 | 济南博图信息技术有限公司 | A kind of bus routes optimum management method and system |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110958566A (en) * | 2018-09-26 | 2020-04-03 | 上海飞田通信股份有限公司 | Positioning, recognizing and carrying passenger receiving system and control method thereof |
| CN110958566B (en) * | 2018-09-26 | 2021-05-28 | 上海飞田通信股份有限公司 | Positioning, recognizing and carrying passenger receiving system and control method thereof |
| CN111079474A (en) * | 2018-10-19 | 2020-04-28 | 上海商汤智能科技有限公司 | Passenger state analysis method and device, vehicle, electronic device, and storage medium |
| CN109598190A (en) * | 2018-10-23 | 2019-04-09 | 深圳壹账通智能科技有限公司 | Method, apparatus, computer equipment and storage medium for action recognition |
| CN109326120B (en) * | 2018-12-21 | 2021-04-09 | 深圳友浩车联网股份有限公司 | Intelligent taxi dispatching method for airport |
| CN109326120A (en) * | 2018-12-21 | 2019-02-12 | 深圳友浩车联网股份有限公司 | A kind of airport intelligent taxi dispatching method |
| CN111428545A (en) * | 2019-01-10 | 2020-07-17 | 北京嘀嘀无限科技发展有限公司 | Behavior judgment method and device and electronic equipment |
| CN111461368A (en) * | 2019-01-21 | 2020-07-28 | 北京嘀嘀无限科技发展有限公司 | Abnormal order processing method, device, equipment and computer readable storage medium |
| CN111461368B (en) * | 2019-01-21 | 2024-01-09 | 北京嘀嘀无限科技发展有限公司 | Abnormal order processing method, device, equipment and computer readable storage medium |
| WO2020151339A1 (en) * | 2019-01-24 | 2020-07-30 | 平安科技（深圳）有限公司 | Abnormality processing method and apparatus based on unmanned vehicle, and related devices |
| CN110378189A (en) * | 2019-04-22 | 2019-10-25 | 北京旷视科技有限公司 | A kind of monitoring method for arranging, device, terminal and storage medium |
| CN110197150A (en) * | 2019-05-27 | 2019-09-03 | 大陆投资(中国)有限公司 | Trip method of servicing, apparatus and system |
| CN112208475A (en) * | 2019-07-09 | 2021-01-12 | 奥迪股份公司 | Safety protection system for vehicle occupants, vehicle and corresponding method and medium |
| CN111738158A (en) * | 2020-06-23 | 2020-10-02 | 上海商汤临港智能科技有限公司 | Control method and device for vehicle, electronic device and storage medium |
| CN112291677A (en) * | 2020-08-13 | 2021-01-29 | 惠州市德赛西威汽车电子股份有限公司 | Self-adaptive sound field adjusting method, system and storage medium |
| CN112906515A (en) * | 2021-02-03 | 2021-06-04 | 珠海研果科技有限公司 | In-vehicle abnormal behavior identification method and system, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019153193A1 (en) | 2019-08-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108369645A (en) | Taxi operation monitoring method, device, storage medium and system | |
| EP3965082B1 (en) | Vehicle monitoring system and vehicle monitoring method | |
| US20220092881A1 (en) | Method and apparatus for behavior analysis, electronic apparatus, storage medium, and computer program | |
| TWI459332B (en) | Method and system for integrating multiple camera images to track vehicle | |
| CN103714631B (en) | ATM cash dispenser intelligent monitor system based on recognition of face | |
| CN113033293A (en) | Access & exit management equipment, system and method | |
| US11900701B2 (en) | Left object detection device and left object detection method | |
| CN108583592A (en) | A kind of subway service on buses or trains job information acquisition intelligent detecting method | |
| CN108423003A (en) | A kind of driving safety monitoring method and system | |
| CN106529401A (en) | Vehicle anti-tracking method, vehicle anti-tracking device and vehicle anti-tracking system | |
| KR102043922B1 (en) | A cctv divided management system and method it | |
| CN109919066B (en) | Method and device for detecting density abnormality of passengers in rail transit carriage | |
| CN108710827A (en) | A kind of micro- police service inspection in community and information automatic analysis system and method | |
| CN103700220A (en) | Fatigue driving monitoring device | |
| CN111785008A (en) | Logistics monitoring management method and device based on GPS and Beidou positioning and computer readable storage medium | |
| CN105957352B (en) | Parking offense detection method and device | |
| CN106448063A (en) | Traffic safety supervision method, device and system | |
| CN112380892A (en) | Image identification method, device, equipment and medium | |
| CN109800656B (en) | Positioning method and related product | |
| CN110809137A (en) | Campus safety trampling prevention monitoring system and method | |
| GB2604495A (en) | Smart electric vehicle charging system and method for situational monitoring and alerting | |
| CN109308802A (en) | Abnormal vehicles management method and device | |
| CN116168457A (en) | Subway security check and ticket selling security check integrated checking system and method | |
| CN213424011U (en) | Monitoring system for passenger identification of tour inspection channel | |
| CN115297138A (en) | Vehicle management method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210209 Address after: 201111 2nd floor, building 2, no.1508, Kunyang Road, Minhang District, Shanghai Applicant after: Dalu Robot Co.,Ltd. Address before: 518000 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Applicant before: Shenzhen Qianhaida Yunyun Intelligent Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| CB02 | Change of applicant information |
Address after: 201111 Building 8, No. 207, Zhongqing Road, Minhang District, Shanghai Applicant after: Dayu robot Co.,Ltd. Address before: 201111 2nd floor, building 2, no.1508, Kunyang Road, Minhang District, Shanghai Applicant before: Dalu Robot Co.,Ltd. |
|
| CB02 | Change of applicant information |