CN113055823B - Method and device for managing shared bicycle based on road side parking - Google Patents
Method and device for managing shared bicycle based on road side parking Download PDFInfo
- Publication number
- CN113055823B CN113055823B CN202110353139.4A CN202110353139A CN113055823B CN 113055823 B CN113055823 B CN 113055823B CN 202110353139 A CN202110353139 A CN 202110353139A CN 113055823 B CN113055823 B CN 113055823B
- Authority
- CN
- China
- Prior art keywords
- shared bicycle
- parking
- video frame
- frame image
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/021—Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/029—Location-based management or tracking services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
Abstract
The embodiment of the invention provides a method and a device for managing shared bicycle based on road side parking, wherein the method comprises the following steps: acquiring video information of an area to be detected in real time, and enhancing and processing each video frame image in the video information; determining a shared bicycle in each video frame image after enhancement processing by a preset algorithm, and riding a pedestrian of the shared bicycle; analyzing the relative positions of the shared bicycle and the riding person of the shared bicycle in each video frame image, and determining whether the shared bicycle is illegally parked; if the person is illegally parked, detecting each video frame image through the preset algorithm, and determining the portrait information of the illegally parked shared bicycle riding person; and generating the illegal parking information of the illegal parked shared bicycle based on the parking information and the portrait information of the illegal parked shared bicycle riding person. The invention can efficiently identify the information of the shared bicycle and the riding person, and greatly improves the accuracy of judging the illegally parked shared bicycle.
Description
Technical Field
The invention relates to the technical field of intelligent transportation, in particular to a method and a device for managing shared bicycle based on roadside parking.
Background
The sharing bicycle is used as a new transportation travel mode, so that great convenience is brought to life of people, but the phenomenon that the sharing bicycle occupies a road in disorder, stops in disorder and influences urban capacity frequently occurs when the sharing bicycle brings great convenience to citizens, so that urban parking resources and urban order management become more difficult. In the prior art, on one hand, some sharing bicycle enterprises propose to use technologies such as electronic fence, GPS (Global Positioning System ), bluetooth and the like to solve the problem of random parking; on the other hand, the problem of random parking is solved by prescribing the pre-construction space of each rights and places along the road and opening the shared bicycle according to local conditions so as to increase the supply of shared bicycle parking resources. However, the accuracy of the positioning of the electronic fence satellite is limited by many factors, and the common positioning is usually realized by technologies such as Bluetooth, if the area of a parking spot is hundreds of square meters and the accuracy is not high, the accurate positioning cannot be realized, the situation that a user arrives at a designated parking area easily occurs, but the parking cannot be realized due to the fact that the positioning is not accurate enough, and thus, the vehicle is out of park is caused. For mechanical lock vehicles on the market, the electronic fence has no restraining force; because GPS signals generally have errors, the GPS signals are few meters and more than tens of meters, accurate positioning cannot be realized, and particularly in a shielded environment, positioning errors of the shared bicycle are easy to cause, so that judgment on whether the shared bicycle is out of stop is affected.
Therefore, how to realize efficient management of the shared bicycle is a great difficulty to be solved.
Disclosure of Invention
The embodiment of the invention provides a method and a device for managing shared bicycles based on roadside parking, which realize the accurate identification and determination of illegal parking of the shared bicycles.
In one aspect, an embodiment of the present invention provides a method for managing a shared bicycle based on roadside parking, including:
acquiring video information of an area to be detected in real time, and enhancing and processing each video frame image in the video information;
determining a shared bicycle in each video frame image after enhancement processing by a preset algorithm, and riding a pedestrian of the shared bicycle;
analyzing the relative positions of the shared bicycle and the riding person of the shared bicycle in each video frame image, and determining whether the shared bicycle is illegally parked or not according to the relative positions;
if the person is illegally parked, detecting each video frame image through the preset algorithm, and determining the portrait information of the illegally parked shared bicycle riding person;
and generating the illegal parking information of the illegal parked shared bicycle based on the parking information and the portrait information of the illegal parked shared bicycle riding person.
Further, the to-be-detected area comprises a to-be-detected area of a road side vehicle berth and a to-be-detected area of a scheduled shared bicycle parking.
Further, the analyzing the relative positions of the shared bicycle and the shared bicycle rider in each video frame image, and determining whether the shared bicycle is illegally parked according to the relative positions includes:
analyzing whether the relative positions of the shared bicycle and the shared bicycle rider in each video frame image exceed a preset threshold value;
if the video frame images exceed the preset video frame images, determining that the riding of the shared bicycle rider is stopped based on an image recognition algorithm, and analyzing parking information of the shared bicycle in each video frame image;
determining whether the shared bicycle is illegally parked according to the parking information;
the parking information comprises at least one of identification information of a parking position or an area, longitude and latitude of the parking position, a parking lot name and parking occurrence time.
Further, the determining whether the shared bicycle is illegally parked according to the parking information includes:
according to the parking information, determining the parking time of the shared bicycle based on each video frame image after enhancement processing;
judging whether the parking time of the shared bicycle is smaller than a preset time threshold value or not;
if yes, determining that the shared bicycle is a temporary parking shared bicycle;
if not, determining whether the shared bicycle is illegally parked.
Further, the determining whether the shared bicycle is parked illegally includes:
when the area to be detected is the area to be detected of the road side vehicle berth, determining that the shared bicycle is illegally parked;
and when the area to be detected is the area to be detected of the preset shared bicycle parking, analyzing the parking angle of the shared bicycle in the image coordinates of each video frame image, and if the parking angle exceeds a preset angle threshold value, determining that the shared bicycle is illegally parked.
Further, the detecting each video frame image through the predetermined algorithm, determining the portrait information of the illicitly parked shared bicycle riding person, includes:
extracting a network model according to preset characteristics, and determining characteristics of the illicitly parked shared bicycle riders in each video frame image;
calculating the feature distance in each video frame image according to the features;
and sequencing the characteristic distances in each video frame image, and determining the portrait information of the illegal parked shared bicycle riding person from each video frame image.
Further, the network model is extracted according to the predetermined characteristics, and the characteristics of the illicitly parked shared bicycle rider in each video frame image are determined, including:
detecting a position rectangular frame of a shared bicycle rider which is illegally parked in each video frame image through a preset feature extraction network model;
based on the position rectangular frame, dividing each video frame image according to the pixel probability of the illicitly parked shared bicycle rider in each video frame image;
performing background replacement on each video frame image after segmentation to obtain the image of the illegal parked shared bicycle riding person;
and detecting skeleton key points and postures of the riders in the illegally parked shared bicycle rider images, and determining characteristics of the illegally parked shared bicycle riders in each video frame image.
In another aspect, an embodiment of the present invention provides a device for managing a shared bicycle based on roadside parking, including:
the enhancement processing module is used for acquiring video information of the region to be detected in real time and enhancing and processing each video frame image in the video information;
the determining module is used for determining the shared bicycle and the riding person of the shared bicycle in each video frame image after the enhancement processing through a preset algorithm;
the analysis and determination module is used for analyzing the relative positions of the shared bicycle and the shared bicycle rider in each video frame image and determining whether the shared bicycle is illegally parked according to the relative positions;
the detection and module is used for detecting each video frame image through the preset algorithm if the vehicle is illegally parked, and determining the portrait information of the shared bicycle riding person which is illegally parked;
and the generation module is used for generating the illegal parking information of the illegal parked shared bicycle based on the parking information and the portrait information of the illegal parked shared bicycle riding person.
Further, the to-be-detected area comprises a to-be-detected area of a road side vehicle berth and a to-be-detected area of a scheduled shared bicycle parking.
Further, the analysis and determination module includes:
a first analysis unit for analyzing whether the relative position of the shared bicycle and the shared bicycle rider in each video frame image exceeds a predetermined threshold;
the second analysis unit is used for determining that the shared bicycle riders stop riding based on an image recognition algorithm if the shared bicycle riders exceed the shared bicycle riders, and analyzing parking information of the shared bicycle in each video frame image;
the first determining unit is used for determining whether the shared bicycle is illegally parked according to the parking information;
the parking information comprises at least one of identification information of a parking position or an area, longitude and latitude of the parking position, a parking lot name and parking occurrence time.
Further, the first determining unit includes:
the first determining subunit is used for determining the parking time of the shared bicycle based on each video frame image after the enhancement processing according to the parking information;
a judging subunit, configured to judge whether a parking time of the shared bicycle is less than a predetermined time threshold;
the second determining subunit is used for determining that the shared bicycle is a temporary parking shared bicycle if the shared bicycle is the temporary parking shared bicycle;
and the third determination subunit is used for determining whether the shared bicycle is illegally parked or not if not.
Further, the third determination subunit is specifically configured to
When the area to be detected is the area to be detected of the road side vehicle berth, determining that the shared bicycle is illegally parked;
and when the area to be detected is the area to be detected of the preset shared bicycle parking, analyzing the parking angle of the shared bicycle in the image coordinates of each video frame image, and if the parking angle exceeds a preset angle threshold value, determining that the shared bicycle is illegally parked.
Further, the detection and module includes:
the second determining unit is used for extracting a network model according to the preset characteristics and determining the characteristics of the illicitly parked shared bicycle riders in the video frame images;
a calculating unit, configured to calculate a feature distance in each video frame image according to the feature;
and the sequencing unit is used for sequencing the feature distances in each video frame image and determining the portrait information of the illegally parked shared bicycle riding person from each video frame image.
Further, the second determining unit is specifically configured to
Detecting a position rectangular frame of a shared bicycle rider which is illegally parked in each video frame image through a preset feature extraction network model;
based on the position rectangular frame, dividing each video frame image according to the pixel probability of the illicitly parked shared bicycle rider in each video frame image;
performing background replacement on each video frame image after segmentation to obtain the image of the illegal parked shared bicycle riding person;
and detecting skeleton key points and postures of the riders in the illegally parked shared bicycle rider images, and determining characteristics of the illegally parked shared bicycle riders in each video frame image.
The technical scheme has the following beneficial effects: according to the invention, the video information of the area to be detected is obtained through the monitoring camera parked at the road side, so that the multiplexing of the monitoring camera at the road side is realized, the equipment cost is greatly reduced, the video information of the area to be detected can be timely obtained, and necessary precondition guarantee is provided for the follow-up rapid determination of the portrait information of the illegal parked shared bicycle riding person; by detecting the obtained video information of the region to be detected, the portrait information of the illegal parked shared bicycle riding person can be accurately and rapidly determined, and necessary preconditions are provided for the follow-up generation of the illegal parked shared bicycle information; the method and the system can efficiently identify the information of the shared bicycle and the riding person, greatly improve the accuracy of judging the illegal parking of the shared bicycle, and further, can play a good role in warning and guiding the riding person of the shared bicycle.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for managing shared bicycle based on roadside parking in an embodiment of the invention;
fig. 2 is a schematic diagram of an apparatus for managing a shared bicycle based on roadside parking according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The technical scheme provided by the embodiment of the invention has the following beneficial effects: the application example aims at acquiring the video information of the area to be detected through the monitoring camera parked at the road side, so that the multiplexing of the monitoring camera at the road side is realized, the equipment cost is greatly reduced, the video information of the area to be detected can be acquired in time, and necessary precondition guarantee is provided for the follow-up rapid determination of the portrait information of the illegal parked shared bicycle riding person; by detecting the obtained video information of the region to be detected, the portrait information of the illegal parked shared bicycle riding person can be accurately and rapidly determined, and necessary preconditions are provided for the follow-up generation of the illegal parked shared bicycle information; the method and the system can efficiently identify the information of the shared bicycle and the riding person, greatly improve the accuracy of judging the illegal parking of the shared bicycle, and further, can play a good role in warning and guiding the riding person of the shared bicycle.
The following describes the above technical solution of the embodiment of the present invention in detail with reference to an application example:
in one possible implementation manner, the road side sharing bicycle management system comprises a plurality of monitoring cameras, a master controller and a memory; the monitoring camera is used for collecting panoramic images corresponding to the vehicle berth management area; the master controller is used for controlling the snapshot of the monitoring camera, sharing the services of nonstandard parking of the bicycle, detection of illegal parking events and the like; and the memory is used for storing the snap shot image of the monitoring camera. Firstly, acquiring video information of a region to be detected in real time, wherein the region to be detected comprises a region to be detected of a road side vehicle berth and a region to be detected of a preset shared bicycle parking; then each video frame image in the video information is enhanced and processed, and a sharing bicycle and a riding Person of the sharing bicycle in each video frame image after the enhancement processing are determined through a preset algorithm, such as ReID (Person Re-Identification for short, reID, pedestrian Re-Identification); determining whether the shared bicycle is illegally parked or not by analyzing the relative positions of the shared bicycle and the bicycle rider in each video frame image; if the person is illegally parked, detecting each video frame image through a preset algorithm, and determining the portrait information of the illegally parked shared bicycle riding person; and generating the illegal parking information of the illegal parked shared bicycle based on the parking information and the portrait information of the illegal parked shared bicycle riding person.
Those skilled in the art will appreciate that Person re-identification (Person re-identification), also known as pedestrian re-identification, is a technique that uses computer vision techniques to determine whether a particular pedestrian is present in an image or video sequence. Widely recognized as a sub-problem of image retrieval. Given a monitored pedestrian image, the pedestrian image is retrieved across devices. The method aims to make up for the visual limitation of a fixed camera and can be combined with pedestrian detection/pedestrian tracking technology. In the embodiment of the present invention, a specific algorithm will be described as an example, but this is not a limitation.
In one possible implementation, step 103 analyzes a relative position of the shared bicycle and the shared bicycle rider in each video frame image, and determines whether the shared bicycle is illegally parked according to the relative position, including: analyzing whether the relative positions of the shared bicycle and the shared bicycle rider in each video frame image exceed a preset threshold value; if the video frame images exceed the preset video frame images, determining that the riding of the shared bicycle rider is stopped based on an image recognition algorithm, and analyzing parking information of the shared bicycle in each video frame image; and determining whether the shared bicycle is illegally parked according to the parking information.
The parking information comprises at least one of identification information of a parking position or an area, longitude and latitude of the parking position, a parking lot name and parking occurrence time.
For example, in a road side sharing bicycle management system, video information of a region to be detected is acquired in real time, and each video frame image in the video information is enhanced and processed; determining a shared bicycle and a riding person of the shared bicycle in each video frame image after the enhancement processing through a preset algorithm; then, analyzing the relative positions of the shared bicycle and the shared bicycle riding person in each video frame image, for example, analyzing the longitude and latitude position information of the shared bicycle and the shared bicycle riding person in each video frame image through a preset algorithm, judging whether the relative positions of the shared bicycle and the shared bicycle riding person in each video frame image exceed a preset threshold according to the longitude and latitude position information, if yes, determining that the shared bicycle riding person stops riding based on an image recognition algorithm, and analyzing parking information of the shared bicycle in each video frame image, such as identification information of parking positions or areas, the longitude and latitude of the parking positions, the names of parking lots, the parking occurrence time, the vehicle body color of the shared bicycle and the like; and determining whether the shared bicycle is illegally parked according to the parking information.
According to the method and the device for determining the parking conditions of the shared bicycle, the riding stopping behavior of the shared bicycle rider can be accurately determined, meanwhile, parking information of the shared bicycle can be accurately identified, and therefore necessary preconditions are provided for the follow-up determination of whether the shared bicycle is parked illegally.
In one possible implementation manner, the step of determining whether the shared bicycle is illegally parked according to the parking information includes: according to the parking information, determining the parking time of the shared bicycle based on each video frame image after enhancement processing; judging whether the parking time of the shared bicycle is smaller than a preset time threshold value or not; if yes, determining that the shared bicycle is a temporary parking shared bicycle; if not, determining whether the shared bicycle is illegally parked.
Wherein the determining whether the shared bicycle is parked illegally comprises: when the area to be detected is the area to be detected of the road side vehicle berth, determining that the shared bicycle is illegally parked; and when the area to be detected is the area to be detected of the preset shared bicycle parking, analyzing the parking angle of the shared bicycle in the image coordinates of each video frame image, and if the parking angle exceeds a preset angle threshold value, determining that the shared bicycle is illegally parked.
For example, in the road side shared bicycle management system, the riding of the shared bicycle rider is determined to stop based on the image recognition algorithm, after the parking information of the shared bicycle in each video frame image is analyzed, the parking time of the shared bicycle in each video frame image after the enhancement processing can be determined according to the parking information, and then the parking time of the shared bicycle is determined; then, judging whether the parking time of the shared bicycle is smaller than a preset time threshold value, such as 5 minutes, if so, determining that the shared bicycle is a temporary parking shared bicycle; if not, identifying the type of the area to be detected, and determining that the shared bicycle is illegally parked when the area to be detected is the area to be detected of the parking space of the road side vehicle; and when the area to be detected is the area to be detected for parking the preset shared bicycle, analyzing the parking angle of the shared bicycle in the image coordinates in each video frame image, and if the parking angle exceeds a preset angle threshold value, determining that the shared bicycle is illegally parked.
Through the embodiment, the situation that the temporarily parked shared bicycle is confirmed to be illegally parked is avoided, and the illegally parked shared bicycle can be confirmed according to the parking angle of the shared bicycle when the shared bicycle is parked in the appointed area, so that the situation that illegal parking is missed due to the fact that the shared bicycle is illegally parked in the appointed area is avoided.
In one possible implementation, step 104 detects each video frame image through the predetermined algorithm, and determines the portrait information of the illicitly parked shared bicycle rider, including: extracting a network model according to preset characteristics, and determining characteristics of the illicitly parked shared bicycle riders in each video frame image; calculating the feature distance in each video frame image according to the features; and sequencing the characteristic distances in each video frame image, and determining the portrait information of the illegal parked shared bicycle riding person from each video frame image.
For example, in the road side shared bicycle management system, after determining that the shared bicycle is illegally parked, extracting a network model according to a predetermined feature, and determining features of the illegally parked shared bicycle rider in each video frame image, such as features of clothing, posture, hairstyle, gesture, accessories and the like of the shared bicycle rider; according to the characteristics, determining a first hit rate picture, and calculating the characteristic distance in each video frame image; and sequencing the characteristic distances in each video frame image to obtain an average precision value, and then determining the portrait information of the illicitly parked shared bicycle rider from each video frame image according to the average precision value, wherein the portrait information comprises the front face information of the portrait.
In one possible implementation manner, the network model is extracted according to a predetermined feature, and the feature of the illicitly parked shared bicycle rider in each video frame image is determined, including: detecting a position rectangular frame of a shared bicycle rider which is illegally parked in each video frame image through a preset feature extraction network model; based on the position rectangular frame, dividing each video frame image according to the pixel probability of the illicitly parked shared bicycle rider in each video frame image; performing background replacement on each video frame image after segmentation to obtain the image of the illegal parked shared bicycle riding person; and detecting skeleton key points and postures of the riders in the illegally parked shared bicycle rider images, and determining characteristics of the illegally parked shared bicycle riders in each video frame image.
For example, in the above example in a road side shared bicycle management system, a predetermined feature extraction network model is pre-trained; after determining that the shared bicycle is illegally parked, detecting a rectangular frame of the position of the shared bicycle rider which is illegally parked in each video frame image through a preset feature extraction network model; then, based on the position rectangular frame, according to the pixel probability of the illegal parked shared bicycle riding person in each video frame image, dividing each video frame image according to the preset divided portrait pixel probability aiming at the illegal parked shared bicycle riding person to obtain the picture of the illegal parked shared bicycle riding person in each video frame image; then, background replacement is carried out on each video frame image after segmentation, and the image of the illegal parked shared bicycle riding person is obtained; and detecting skeleton key points and postures of the riders in the illegally parked shared bicycle riding pedestrian images, and determining characteristics of the illegally parked shared bicycle riding pedestrians in each video frame image, wherein a plurality of key points of a human body, such as heads, shoulders, palms and soles, are generally identified, and skeleton key points are detected and the postures are identified in the task of pedestrian posture identification so as to realize skeleton key point detection and posture identification.
In one possible implementation manner, in the road side shared bicycle management system, the method further comprises sending illegal parking information of the generated illegal parked shared bicycle to a cloud server; specifically, the master controller is used for sending the illegal parking information of the shared bicycle which generates the illegal parking to the cloud platform. And then, the illegal parking information of the illegal parked shared bicycle is sent to a shared bicycle manufacturer through the cloud platform, so that the shared bicycle manufacturer reasonably processes riders of the illegal parked shared bicycle according to the illegal parking information and performs relevant guidance on a user so as to realize effective management of parking of the shared bicycle.
The embodiment of the invention provides a device for managing shared bicycles based on road side parking, which can realize the method embodiment provided above, and specific function implementation is shown in the method embodiment and is not repeated herein.
It should be understood that the specific order or hierarchy of steps in the processes disclosed are examples of exemplary approaches. Based on design preferences, it is understood that the specific order or hierarchy of steps in the processes may be rearranged without departing from the scope of the present disclosure. The accompanying method claims present elements of the various steps in a sample order, and are not meant to be limited to the specific order or hierarchy presented.
In the foregoing detailed description, various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments of the subject matter require more features than are expressly recited in each claim. Rather, as the following claims reflect, invention lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate preferred embodiment of this invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. As will be apparent to those skilled in the art; various modifications to these embodiments will be readily apparent, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description includes examples of one or more embodiments. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the aforementioned embodiments, but one of ordinary skill in the art may recognize that many further combinations and permutations of various embodiments are possible. Accordingly, the embodiments described herein are intended to embrace all such alterations, modifications and variations that fall within the scope of the appended claims. Furthermore, as used in the specification or claims, the term "comprising" is intended to be inclusive in a manner similar to the term "comprising," as interpreted when employed as a transitional word in a claim. Furthermore, any use of the term "or" in the specification of the claims is intended to mean "non-exclusive or".
Those of skill in the art will further appreciate that the various illustrative logical blocks (illustrative logical block), units, and steps described in connection with the embodiments of the invention may be implemented by electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components (illustrative components), elements, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design requirements of the overall system. Those skilled in the art may implement the described functionality in varying ways for each particular application, but such implementation is not to be understood as beyond the scope of the embodiments of the present invention.
The various illustrative logical blocks or units described in the embodiments of the invention may be implemented or performed with a general purpose processor, a digital signal processor, an Application Specific Integrated Circuit (ASIC), a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described. A general purpose processor may be a microprocessor, but in the alternative, the general purpose processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other similar configuration.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. In an example, a storage medium may be coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC, which may reside in a user terminal. In the alternative, the processor and the storage medium may reside as distinct components in a user terminal.
In one or more exemplary designs, the above-described functions of embodiments of the present invention may be implemented in hardware, software, firmware, or any combination of the three. If implemented in software, the functions may be stored on a computer-readable medium or transmitted as one or more instructions or code on the computer-readable medium. Computer readable media includes both computer storage media and communication media that facilitate transfer of computer programs from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, such computer-readable media may include, but is not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to carry or store program code in the form of instructions or data structures and other data structures that may be read by a general or special purpose computer, or a general or special purpose processor. Further, any connection is properly termed a computer-readable medium, e.g., if the software is transmitted from a website, server, or other remote source via a coaxial cable, fiber optic cable, twisted pair, digital Subscriber Line (DSL), or wireless such as infrared, radio, and microwave, and is also included in the definition of computer-readable medium. The disks (disks) and disks (disks) include compact disks, laser disks, optical disks, DVDs, floppy disks, and blu-ray discs where disks usually reproduce data magnetically, while disks usually reproduce data optically with lasers. Combinations of the above may also be included within the computer-readable media.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (10)
1. A method for managing shared bicycles based on roadside parking, comprising:
acquiring video information of an area to be detected in real time, and enhancing and processing each video frame image in the video information;
determining a shared bicycle in each video frame image after enhancement processing by a preset algorithm, and riding a pedestrian of the shared bicycle;
analyzing whether the relative positions of the shared bicycle and the shared bicycle rider in each video frame image exceed a preset threshold value;
if the video frame images exceed the preset video frame images, determining that the riding of the shared bicycle rider is stopped based on an image recognition algorithm, and analyzing parking information of the shared bicycle in each video frame image;
determining whether the shared bicycle is illegally parked according to the parking information;
the parking information comprises at least one of identification information of a parking place or area, longitude and latitude of the parking place, a parking lot name and parking occurrence time;
if the vehicle is illegally parked, extracting a network model according to preset characteristics, and determining characteristics of the shared bicycle rider illegally parked in each video frame image;
calculating the feature distance in each video frame image according to the features;
sequencing the feature distances in each video frame image, and determining the portrait information of the illegal parked shared bicycle riding person from each video frame image;
and generating the illegal parking information of the illegal parked shared bicycle based on the parking information and the portrait information of the illegal parked shared bicycle riding person.
2. The method of claim 1, wherein the area to be detected comprises an area to be detected of a roadside vehicle berth and an area to be detected of a predetermined shared bicycle park.
3. The method of claim 1, wherein the determining whether the shared bicycle is parked illegally based on the parking information comprises:
according to the parking information, determining the parking time of the shared bicycle based on each video frame image after enhancement processing;
judging whether the parking time of the shared bicycle is smaller than a preset time threshold value or not;
if yes, determining that the shared bicycle is a temporary parking shared bicycle;
if not, determining whether the shared bicycle is illegally parked.
4. The method of claim 3, wherein the determining whether the shared bicycle is parked illegally comprises:
when the area to be detected is the area to be detected of the road side vehicle berth, determining that the shared bicycle is illegally parked;
and when the area to be detected is the area to be detected of the preset shared bicycle parking, analyzing the parking angle of the shared bicycle in the image coordinates of each video frame image, and if the parking angle exceeds a preset angle threshold value, determining that the shared bicycle is illegally parked.
5. The method of claim 1, wherein the determining features of the offending parked shared bicycle rider in each video frame image based on the predetermined feature extraction network model comprises:
detecting a position rectangular frame of a shared bicycle rider which is illegally parked in each video frame image through a preset feature extraction network model;
based on the position rectangular frame, dividing each video frame image according to the pixel probability of the illicitly parked shared bicycle rider in each video frame image;
performing background replacement on each video frame image after segmentation to obtain the image of the illegal parked shared bicycle riding person;
and detecting skeleton key points and postures of the riders in the illegally parked shared bicycle rider images, and determining characteristics of the illegally parked shared bicycle riders in each video frame image.
6. An apparatus for managing shared bicycles based on roadside parking, comprising:
the enhancement processing module is used for acquiring video information of the region to be detected in real time and enhancing and processing each video frame image in the video information;
the determining module is used for determining the shared bicycle and the riding person of the shared bicycle in each video frame image after the enhancement processing through a preset algorithm;
the analysis and determination module comprises a first analysis unit, a second analysis unit and a first determination unit; the first analysis unit is used for analyzing whether the relative positions of the shared bicycle and the shared bicycle riding person in each video frame image exceed a preset threshold value, the second analysis unit is used for determining that the shared bicycle riding person stops riding based on an image recognition algorithm if the relative positions of the shared bicycle and the shared bicycle riding person exceed the preset threshold value, analyzing parking information of the shared bicycle in each video frame image, and the first determination unit is used for determining whether the shared bicycle is illegally parked according to the parking information; the parking information comprises at least one of identification information of parking positions or areas, longitude and latitude of the parking positions, parking lot names and parking occurrence time;
the detection and module comprises a second determination unit, a calculation unit and a sequencing unit; the second determining unit is used for extracting a network model according to preset characteristics if the vehicle is illegally parked, determining characteristics of the shared bicycle riding person which is illegally parked in each video frame image, the calculating unit is used for calculating characteristic distances in each video frame image according to the characteristics, and the ordering unit is used for ordering the characteristic distances in each video frame image, and determining portrait information of the shared bicycle riding person which is illegally parked from each video frame image;
and the generation module is used for generating the illegal parking information of the illegal parked shared bicycle based on the parking information and the portrait information of the illegal parked shared bicycle riding person.
7. The apparatus of claim 6, wherein the area to be detected comprises an area to be detected of a roadside vehicle berth and an area to be detected of a predetermined shared bicycle park.
8. The apparatus according to claim 6, wherein the first determining unit includes:
the first determining subunit is used for determining the parking time of the shared bicycle based on each video frame image after the enhancement processing according to the parking information;
a judging subunit, configured to judge whether a parking time of the shared bicycle is less than a predetermined time threshold;
the second determining subunit is used for determining that the shared bicycle is a temporary parking shared bicycle if the shared bicycle is the temporary parking shared bicycle;
and the third determination subunit is used for determining whether the shared bicycle is illegally parked or not if not.
9. The apparatus according to claim 8, wherein the third determination subunit is specifically configured to
When the area to be detected is the area to be detected of the road side vehicle berth, determining that the shared bicycle is illegally parked;
and when the area to be detected is the area to be detected of the preset shared bicycle parking, analyzing the parking angle of the shared bicycle in the image coordinates of each video frame image, and if the parking angle exceeds a preset angle threshold value, determining that the shared bicycle is illegally parked.
10. The apparatus according to claim 6, wherein the second determining unit is specifically configured to
Detecting a position rectangular frame of a shared bicycle rider which is illegally parked in each video frame image through a preset feature extraction network model;
based on the position rectangular frame, dividing each video frame image according to the pixel probability of the illicitly parked shared bicycle rider in each video frame image;
performing background replacement on each video frame image after segmentation to obtain the image of the illegal parked shared bicycle riding person;
and detecting skeleton key points and postures of the riders in the illegally parked shared bicycle rider images, and determining characteristics of the illegally parked shared bicycle riders in each video frame image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110353139.4A CN113055823B (en) | 2021-04-01 | 2021-04-01 | Method and device for managing shared bicycle based on road side parking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110353139.4A CN113055823B (en) | 2021-04-01 | 2021-04-01 | Method and device for managing shared bicycle based on road side parking |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113055823A CN113055823A (en) | 2021-06-29 |
| CN113055823B true CN113055823B (en) | 2023-07-11 |
Family
ID=76517346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110353139.4A Active CN113055823B (en) | 2021-04-01 | 2021-04-01 | Method and device for managing shared bicycle based on road side parking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113055823B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113947945B (en) * | 2021-09-02 | 2023-01-17 | 北京百度网讯科技有限公司 | Vehicle driving alarm method and device, electronic equipment and readable storage medium |
| CN114863087B (en) * | 2022-07-07 | 2022-09-20 | 锐创软件技术(启东)有限公司 | Shared bicycle user quality evaluation method and device based on artificial intelligence |
| CN116665140A (en) * | 2023-03-08 | 2023-08-29 | 深圳市旗扬特种装备技术工程有限公司 | Method, device, equipment and storage medium for detecting shared single vehicle-mounted human behavior |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111339994A (en) * | 2019-12-31 | 2020-06-26 | 智慧互通科技有限公司 | Method and device for judging temporary illegal parking |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109003340A (en) * | 2017-05-31 | 2018-12-14 | 李刚 | Bicycle parking management method and its system |
| CN111223289B (en) * | 2018-11-27 | 2021-04-27 | 杭州海康威视数字技术股份有限公司 | Method and system for snapshot of illegal parking event of shared vehicle and storage medium |
| CN209486891U (en) * | 2019-03-28 | 2019-10-11 | 武汉大学 | Shared bicycle, which is disobeyed, stops detection system |
| CN111444845B (en) * | 2020-03-26 | 2023-05-12 | 江苏集萃华科智能装备科技有限公司 | Non-motor vehicle illegal stop recognition method, device and system |
| CN111784444A (en) * | 2020-06-09 | 2020-10-16 | 深圳市金溢科技股份有限公司 | Shared bicycle management method and system |
| CN112163544B (en) * | 2020-10-12 | 2024-02-20 | 北京易华录信息技术股份有限公司 | Method and system for judging random placement of non-motor vehicles |
| CN112419733B (en) * | 2020-10-16 | 2023-05-05 | 杭州智行星科技有限公司 | Detection method, device, equipment and storage medium for user nonstandard parking |
-
2021
- 2021-04-01 CN CN202110353139.4A patent/CN113055823B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111339994A (en) * | 2019-12-31 | 2020-06-26 | 智慧互通科技有限公司 | Method and device for judging temporary illegal parking |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113055823A (en) | 2021-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113055823B (en) | Method and device for managing shared bicycle based on road side parking | |
| US9483944B2 (en) | Prediction of free parking spaces in a parking area | |
| JP7218535B2 (en) | Traffic violation vehicle identification system and server | |
| CN109345829B (en) | Unmanned vehicle monitoring method, device, equipment and storage medium | |
| CN110491168B (en) | Method and device for detecting vehicle parking state based on wheel landing position | |
| WO2021223418A1 (en) | Parking detection method and apparatus employing visual difference | |
| US11734783B2 (en) | System and method for detecting on-street parking violations | |
| AU2021254525A1 (en) | On-demand artificial intelligence and roadway stewardship system | |
| US10984275B1 (en) | Determining location coordinates of a vehicle based on license plate metadata and video analytics | |
| CN112185098B (en) | Shared bicycle monitoring method and system based on city monitoring video | |
| CN112820137B (en) | Parking lot management method and device | |
| CN112424793A (en) | Object identification method, object identification device and electronic equipment | |
| CN113160575A (en) | Traffic violation detection method and system for non-motor vehicles and drivers | |
| CN111369801B (en) | Vehicle identification method, device, equipment and storage medium | |
| JP2023516502A (en) | Systems and methods for image-based location determination and parking monitoring | |
| CN111259868A (en) | Convolutional neural network-based method, system and medium for detecting vehicles in reverse driving | |
| CN112766222B (en) | Method and device for assisting in identifying vehicle behavior based on berth line | |
| CN111951601B (en) | Method and device for identifying parking positions of distribution vehicles | |
| CN112183206B (en) | Traffic participant positioning method and system based on road side monocular camera | |
| CN110880205B (en) | Parking charging method and device | |
| US20200250970A1 (en) | Information processing apparatus, information processing method and program | |
| CN114693722B (en) | Vehicle driving behavior detection method, detection device and detection equipment | |
| CN114463976B (en) | Vehicle behavior state determination method and system based on 3D vehicle track | |
| CN113781792B (en) | Parking detection system, method and related equipment | |
| CN115861916A (en) | Abnormal parking behavior detection method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |