CN117520979A - Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof - Google Patents

Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof Download PDF

Info

Publication number
CN117520979A
CN117520979A CN202311455563.5A CN202311455563A CN117520979A CN 117520979 A CN117520979 A CN 117520979A CN 202311455563 A CN202311455563 A CN 202311455563A CN 117520979 A CN117520979 A CN 117520979A
Authority
CN
China
Prior art keywords
data
information
wagon balance
balance measuring
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202311455563.5A
Other languages
Chinese (zh)
Other versions
CN117520979B (en
Inventor
肖利君
王磊
蔡兵
肖友军
侯白艳
吴智慧
刘佳佳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changsha Cloud Soft Information Technology Co ltd
Original Assignee
Changsha Cloud Soft Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changsha Cloud Soft Information Technology Co ltd filed Critical Changsha Cloud Soft Information Technology Co ltd
Priority to CN202311455563.5A priority Critical patent/CN117520979B/en
Priority claimed from CN202311455563.5A external-priority patent/CN117520979B/en
Publication of CN117520979A publication Critical patent/CN117520979A/en
Application granted granted Critical
Publication of CN117520979B publication Critical patent/CN117520979B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/243Classification techniques relating to the number of classes
    • G06F18/2433Single-class perspective, e.g. one-against-all classification; Novelty detection; Outlier detection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G19/00Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/02Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups for weighing wheeled or rolling bodies, e.g. vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G23/00Auxiliary devices for weighing apparatus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10009Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves
    • G06K7/10366Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves the interrogation device being adapted for miscellaneous applications
    • G06K7/10415Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves the interrogation device being adapted for miscellaneous applications the interrogation device being fixed in its position, such as an access control device for reading wireless access cards, or a wireless ATM
    • G06K7/10425Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves the interrogation device being adapted for miscellaneous applications the interrogation device being fixed in its position, such as an access control device for reading wireless access cards, or a wireless ATM the interrogation device being arranged for interrogation of record carriers passing by the interrogation device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/625License plates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Toxicology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computational Linguistics (AREA)
  • Electromagnetism (AREA)
  • Biophysics (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses a wagon balance measuring device based on OCR (optical character recognition) and a using method thereof, and relates to the technical field of wagon balance measuring devices. According to the invention, by installing the data training module, the functions of establishing and optimizing the recognition model of the vehicle detected by the entering wagon balance measuring equipment are realized, and the recognition efficiency and recognition speed of the vehicle on the construction site are improved.

Description

Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof
Technical Field
The invention relates to the technical field of wagon balance measuring equipment, in particular to wagon balance measuring equipment based on OCR (optical character recognition) and a using method thereof.
Background
Wagon balance is a modern weight measurement device that utilizes a variety of intelligent technologies including: the vision sensor, the weight sensor, the data processing technology and the computer system are used for measuring the weight of materials and cargoes in the fields of logistics, construction, agriculture, construction sites and the like.
However, the existing wagon balance measuring equipment cannot conduct rapid model identification aiming at a vehicle, so that the existing wagon balance measuring equipment cannot achieve automatic identification of vehicle license plate information, abnormal interception of the vehicle, rapid and accurate weighing of goods and generation of corresponding data reports, and the problems of low use safety, low weighing precision, waste of manpower and material resources and incapability of achieving real-time monitoring and follow-up query, tracking and analysis of the wagon balance measuring equipment are caused.
Therefore, the invention provides a wagon balance measuring device based on OCR (optical character recognition) and a using method thereof, and aims to solve the problems of low use safety, low weighing precision, waste of manpower and material resources and incapability of realizing real-time monitoring and follow-up query tracking analysis in the prior art, and improve the intelligent degree and the automatic management level of the wagon balance measuring device.
1. Patent document CN110689271B discloses an intelligent weighing comprehensive management platform and management method for the internet of things, and the above patent realizes, but the above patent cannot realize the functions of establishing and optimizing an identification model of a vehicle detected by a wagon balance measuring device.
2. Patent document CN115328008B discloses an unmanned dispatch data processing device for refuse transfer station vehicles, which realizes, but the above patent cannot realize the information recognition and detection function for detecting vehicles entering the wagon balance measuring device.
3. Patent document CN112008500B discloses a wagon balance scale mounting apparatus and method, which realizes the above-mentioned patent, but the above-mentioned patent cannot realize an information processing function for detecting data of a vehicle entering a wagon balance measuring apparatus at a construction site.
4. Patent document CN112559566B discloses a method, device, equipment and storage medium for monitoring compliance based on wagon balance, which implement the above-mentioned patent, but the above-mentioned patent cannot implement a response function to an abnormal condition occurring when the wagon balance measuring equipment detects.
In summary, the above-mentioned patent cannot realize the functions of establishing and optimizing the recognition model of the vehicle detected by the entering wagon balance measuring device, recognizing and detecting the information of the vehicle detected by the entering wagon balance measuring device, processing the information of the detection data of the vehicle entering the wagon balance measuring device on the site and responding to the abnormal condition occurring when the wagon balance measuring device is detected, which results in low information acquisition efficiency, low recognition accuracy and recognition speed, low use safety, short service life, low data visualization degree and lack of basis for information tracking analysis of the wagon balance measuring device;
therefore, the application provides the site vehicle wagon balance measuring equipment based on the recognition technology, which can realize the functions of establishing and optimizing the recognition model of the vehicle detected by the entering wagon balance measuring equipment, recognizing and detecting the information of the vehicle detected by the entering wagon balance measuring equipment, processing the information of the detection data of the site vehicle entering the wagon balance measuring equipment and responding to the abnormal condition when the wagon balance measuring equipment is detected.
Disclosure of Invention
The invention aims to provide a wagon balance measuring device based on OCR (optical character recognition) and a using method thereof, which are used for solving the technical problems that in the background art, the recognition model establishment and optimization function of a vehicle detected by an entering wagon balance measuring device, the information recognition and detection function of the vehicle detected by the entering wagon balance measuring device, the information processing function of the detection data of the wagon balance measuring device detected by a construction site vehicle and the response function of abnormal conditions during the detection of the wagon balance measuring device cannot be realized, so that the wagon balance measuring device has low information acquisition efficiency, low recognition precision and recognition speed, low use safety, short service life, low data visualization degree and lack of information tracking analysis.
In order to achieve the above purpose, the present invention provides the following technical solutions: the wagon balance measuring equipment based on OCR recognition comprises a wagon balance measuring equipment main body, a data training module, a recognition detection module, a data processing module and a user management module, wherein the data training module is used for training and configuring a vehicle recognition model, a real-time and rapid target detection model is built, the recognition detection module is used for recognizing license plate information and finishing data information detection of a construction site vehicle, the data processing module is used for carrying out integrated calculation on data information collected by the recognition detection module and carrying out normalization processing on the data, and the user management module is used for carrying out data feedback and management response on the data normalized by the data processing module.
Preferably, the data training module includes: the system comprises a data set training chip, a data model training fine-tuning unit and a deployment identification unit;
the data set training chip is embedded at the bottom of the inner wall of the wagon balance measuring equipment main body, collects and stores construction site vehicle information, driver information and cargo information in the chip, and establishes data into a database for real-time updating and optimizing;
the data training fine tuning unit utilizes database information established by the data set chip to construct a data set containing vehicle images and response labels, utilizes the data set to cooperate with a wagon balance measuring equipment management system to establish a deep learning R-CNN model based on a convolutional neural network for model optimization iteration, and rapidly retrieves the model for corresponding vehicle identification during the vehicle identification of a construction site;
the deployment identification unit embeds the R-CNN model into the wagon balance measuring equipment management system, processes image data in real time, and performs identification confirmation and safety feedback on the information data processed by the data processing module.
Preferably, the identification detection module includes: the system comprises a camera module, optical character recognition OCR software and a load cell sensor;
the camera module is arranged on the front surface of the outer wall of the wagon balance measuring equipment main body, takes a license plate photo, a vehicle photo and a cargo photo before a construction site vehicle enters the wagon balance measuring equipment, and transmits image information of the license plate photo, the vehicle photo and the cargo photo to the data processing module;
the optical character recognition OCR software is installed in a software library in the wagon balance measuring equipment management system, and the optical character recognition OCR software calls license plate photos shot by the camera module, automatically recognizes license plate number characters and uploads license plate number information to the data processing module;
the load cell sensor is arranged at the top of the outer wall of the wagon balance measuring equipment main body, and is used for detecting the weight of vehicles and cargoes and uploading the weight information to the data processing module.
Preferably, the data processing module includes: the system comprises a data integration unit, a data calculation unit and an information feedback unit;
the data integration unit performs data integration classification on license plate photos, vehicle photos, cargo photo image information, license plate numbers and weight information transmitted by the camera module, the optical character recognition OCR software and the load cell sensor, and transmits the integrated and classified data to the data calculation unit;
the data calculation unit processes the license plate photo, the vehicle photo, the cargo photo image information, the license plate number and the weight information and database information in the data collection chip in real time by utilizing an R-CNN model in the deployment identification unit, compares cargo information, compares driver information and cargo weight information, marks abnormal data after the comparison is completed, and transmits all abnormal data to the information feedback unit;
after the information feedback unit receives the abnormal data, the abnormal data are classified and defined into abnormal safety grades, and the abnormal safety grades are divided into: and uploading the abnormal security level signals to a user management module in the wagon balance measuring equipment management system.
Preferably, the user management module includes: the system comprises an alarm response unit, a report output unit and a data storage unit;
the alarm response unit is connected with the wagon balance measuring equipment access control system and the buzzer alarm through signal lines, and controls the wagon balance measuring equipment access control system to be closed, sends out a buzzer alarm and links a user management interface to inform management personnel of processing abnormal conditions after receiving the abnormal security level signal;
the report output unit is used for outputting the data information processed by the data calculation unit in a visual form;
the data storage unit is used for uploading the visual report output by the report output unit to a cloud database of the wagon balance measuring equipment management system for storage, so that management personnel can timely search, view, track and analyze historical data.
Preferably, after the information feedback unit receives the abnormal data, the information feedback unit classifies the abnormal data and defines an abnormal security level, and the abnormal security level is classified into: primary anomalies, secondary anomalies, and tertiary anomalies;
first-order anomaly: the license plate number identified by the OCR software is a strange number;
second-level anomalies: the difference exists among the vehicle image data processed in real time by the R-CNN model, the comparison cargo information and the database information established by the data set chip corresponding to the comparison driver information and the license plate number;
three-level abnormality: the weight of goods detected by the load cell sensor exceeds the standard weight information in the database established by the data set chip.
Preferably, the alarm response unit receives the abnormal security level signal, and then makes the following response measures and sends out corresponding signal instructions:
first order exception response: the alarm response unit sends a signal instruction to close the access control system of the wagon balance measuring equipment;
second-order exception response: the alarm unit sends out a signal instruction to link the user management system to send out a warning alarm to inform a manager to manually supplement, correct and input difference information in a database in the data collection chip;
three-level abnormal response: the alarm response unit sends out a signal instruction to start the buzzer to send out a jerky buzzer to inform a driver to immediately drive out of the measuring area of the wagon balance measuring equipment.
Preferably, the data training fine tuning unit continuously learns the difference information manually supplemented, corrected and input by a manager by using the deep learning R-CNN model established by the data set, continuously optimizes the identification range and speed of the R-CNN model, and when the vehicle with the abnormal information enters the wagon balance measuring equipment area again, the R-CNN model utilizes a new database to optimize and identify, thereby completing successful identification release.
Preferably, the method for using the wagon balance measurement apparatus includes the steps of:
s1, firstly, before a vehicle enters a wagon balance measuring device measuring area, a camera module shoots a license plate photo, a vehicle photo and a cargo photo before the vehicle enters the wagon balance measuring device, and transmits image information of the license plate photo, the vehicle photo and the cargo photo to a data processing module;
s2, performing OCR software on the license plate photo by using OCR software for recognizing the license plate number, and performing information comparison on the license plate photo, the vehicle photo and the cargo photo and a database in a data set training chip by using an R-CNN deep learning model by using a data calculation unit;
s3, detecting the weight of the cargoes of the vehicle by using the load cell sensor, and transmitting detection data to the data processing module to compare the data and perform abnormal feedback;
and S4, finally, the information feedback unit transmits the information corresponding to the vehicle and the goods to the user management unit to make abnormal corresponding measures and generate a visual data report.
Preferably, the using method further comprises the following steps:
s11, the data integration unit performs data integration classification on license plate photos, vehicle photos, cargo photo image information, license plate numbers and weight information, marks abnormal data after the data calculation unit compares the abnormal data, and transmits all abnormal data to the information feedback unit;
s21, after abnormal information appears, the data training fine-tuning unit continues to learn the difference information manually supplemented, corrected and input by a manager by using the deep learning R-CNN model established by the data set, and redeploys the R-CNN model through the deployment identification unit so as to continuously perform optimization iteration;
s31, after the load cell sensor detects the weight of the cargoes of the vehicle, transmitting data to the data processing module for comparing and recording weight information;
and S41, after the visual report is generated, uploading the visual report to a cloud database of the wagon balance measuring equipment management system by the data storage unit for storage.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the invention, the data training module is designed, so that the functions of establishing and optimizing the recognition model of the vehicle detected by the entering wagon balance measuring equipment are realized, and the recognition precision and recognition speed of the vehicle on the construction site are improved;
2. according to the invention, the identification detection module is designed, so that the information identification and detection functions of detecting vehicles entering the wagon balance measuring equipment are realized, and the information acquisition efficiency and the wagon balance detection automation degree are improved;
3. according to the invention, the data processing module is designed, so that the information processing and comparison functions of the detection data of the site vehicle entering the wagon balance measuring equipment are realized, the safety compliance of the wagon balance measuring equipment is improved, and the closed-loop effect of abnormal data processing is improved;
4. the invention realizes the response function to the abnormal condition occurring when the wagon balance measuring equipment is detected by designing the user management module, improves the use safety of the wagon balance measuring equipment, prolongs the service life of the wagon balance measuring equipment, and provides the visual and information tracking analysis basis of the detection data.
Drawings
FIG. 1 is a schematic view of a wagon balance measurement apparatus of the present invention;
FIG. 2 is a schematic diagram of a data training module according to the present invention;
FIG. 3 is a schematic diagram of an identification detection module according to the present invention;
FIG. 4 is a schematic diagram of a data processing module according to the present invention;
fig. 5 is a schematic diagram of a subscriber management module according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper", "lower", "inner", "outer", "front", "rear", "both ends", "one end", "the other end", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific direction, be configured and operated in the specific direction, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "provided," "connected," and the like are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
Example 1
Referring to fig. 1-5, an embodiment of the present invention is provided: the wagon balance measuring equipment based on OCR recognition comprises a wagon balance measuring equipment main body, a data training module, a recognition detection module, a data processing module and a user management module, wherein the data training module is used for training and configuring a vehicle recognition model to construct a real-time and rapid target detection model, the recognition detection module is used for recognizing license plate information and finishing data information detection of a construction site vehicle, the data processing module is used for carrying out integration calculation on data information acquired by the recognition detection module and carrying out normalization processing on the data, and the user management module is used for carrying out data feedback and management response on the data normalized by the data processing module;
further, firstly, before a site vehicle enters a wagon balance measuring equipment detection area, a recognition detection module carries out vehicle recognition on the vehicle, wherein the vehicle comprises license plate information, load information, cargo information and driver information, the license plate number is quickly recognized by utilizing an R-CNN model in a data training module, then, a data processing module integrates and normalizes the information, safety compliance comparison is carried out on the information and data preset in the data training module, and if an abnormal condition occurs, the data processing module sends an abnormal signal to activate a user management module to respond to the abnormal condition in time; if no abnormal condition occurs, the data processing module transmits the vehicle information and the cargo weight information detected by the identification detection module to the user management module to output a visual data report and store the visual data report in the wagon balance measuring equipment management system for subsequent data analysis and tracking of management personnel.
Example 2
Referring to fig. 1 and 2, an embodiment of the present invention is provided: a wagon balance measurement device based on OCR recognition and a method of using the same, the data training module comprising: the system comprises a data set training chip, a data model training fine-tuning unit and a deployment identification unit;
the data set training chip is embedded at the bottom of the inner wall of the wagon balance measuring equipment main body, collects and stores construction site vehicle information, driver information and cargo information in the chip, and establishes data into a database for real-time updating and optimizing;
the data training fine tuning unit utilizes database information established by the data set chip to construct a data set containing vehicle images and response labels, utilizes the data set to cooperate with a wagon balance measuring equipment management system to establish a deep learning R-CNN model based on a convolutional neural network for model optimization iteration, and rapidly retrieves the model for corresponding vehicle identification during the vehicle identification of a construction site;
the deployment identification unit embeds the R-CNN model into a wagon balance measuring equipment management system, processes image data in real time, and performs identification confirmation and safety feedback on the information data processed by the data processing module;
further, the deployment identification unit embeds the R-CNN model in a wagon balance measuring equipment management system, and before a vehicle enters wagon balance measuring equipment, the R-CNN model is quickly identified for collected vehicle information, and model coverage comparison is carried out by utilizing preset information and collected information stored in a chip, so that the information coincidence degree is judged; after abnormal information appears, the information of the complement is subjected to differential model training after being processed by a manager, and the R-CNN recognition model is continuously optimized and iterated, so that the efficient and accurate recognition of the vehicle is ensured.
Example 3
Referring to fig. 1 and 3, an embodiment of the present invention is provided: a wagon balance measurement apparatus based on OCR recognition and a method of using the same, the recognition detection module comprising: the system comprises a camera module, optical character recognition OCR software and a load cell sensor;
the camera module is arranged on the front surface of the outer wall of the wagon balance measuring equipment main body, takes a license plate photo, a vehicle photo and a cargo photo before a construction site vehicle enters the wagon balance measuring equipment, and transmits image information of the license plate photo, the vehicle photo and the cargo photo to the data processing module;
the optical character recognition OCR software is installed in a software library in the wagon balance measuring equipment management system, and the optical character recognition OCR software calls license plate photos shot by the camera module, automatically recognizes license plate number characters and uploads license plate number information to the data processing module;
the load cell sensor is arranged at the top of the outer wall of the wagon balance measuring equipment main body, and is used for detecting the weight of the vehicle and the goods and uploading the weight information to the data processing module;
further, the camera module is responsible for collecting photographing information of the vehicle before entering the wagon balance measuring equipment detection area, the optical character recognition OCR software is used for quickly detecting and identifying the optical characters of the number of the vehicle with the license plate information collected by the camera module, the camera module and the optical character recognition OCR software are used for transmitting the collected license plate photos, vehicle photos and cargo photo image information to the data processing module for data processing and model application identification, and the load cell sensor is responsible for detecting the weight of the vehicle safely entering the wagon balance measuring equipment.
Example 4
Referring to fig. 1 and 4, an embodiment of the present invention is provided: a wagon balance measurement apparatus based on OCR recognition and a method of using the same, the data processing module comprising: the system comprises a data integration unit, a data calculation unit and an information feedback unit;
the data integration unit performs data integration classification on license plate photos, vehicle photos, cargo photo image information, license plate numbers and weight information transmitted by the camera module, the optical character recognition OCR software and the load cell sensor, and transmits the integrated and classified data to the data calculation unit;
the data calculation unit processes the license plate photo, the vehicle photo, the cargo photo image information, the license plate number and the weight information and database information in the data collection chip in real time by utilizing an R-CNN model in the deployment identification unit, compares cargo information, compares driver information and cargo weight information, marks abnormal data after the comparison is completed, and transmits all abnormal data to the information feedback unit;
after the information feedback unit receives the abnormal data, the abnormal data are classified and defined into abnormal safety grades, and the abnormal safety grades are divided into: the first-level abnormality, the second-level abnormality and the third-level abnormality, and uploading an abnormal security level signal to a user management module in the wagon balance measuring equipment management system;
further, the data integration unit performs real-time processing comparison on collected license plate photos, vehicle photos, cargo photo image information, license plate numbers and weight information and database information in the data collection chip by utilizing an R-CNN model in the deployment identification unit, judges whether abnormal information exists, when the abnormal information appears, sends the abnormal information labeling processing to the information feedback unit, the information feedback unit classifies the abnormal information and defines an abnormal grade, and then the information feedback unit transmits the abnormal information to an abnormal processing measure responded by a user management system to finish the management of vehicles entering the wagon balance measuring equipment.
Example 5
Referring to fig. 1 and 5, an embodiment of the present invention is provided: a wagon balance measurement apparatus based on OCR recognition and a method of using the same, the user management module comprising: the system comprises an alarm response unit, a report output unit and a data storage unit;
the alarm response unit is connected with the wagon balance measuring equipment access control system and the buzzer alarm through signal lines, and controls the wagon balance measuring equipment access control system to be closed, sends out a buzzer alarm and links a user management interface to inform management personnel of processing abnormal conditions after receiving the abnormal security level signal;
the report output unit is used for outputting the data information processed by the data calculation unit in a visual form;
the data storage unit is used for uploading the visual report output by the report output unit to a cloud database of the wagon balance measuring equipment management system for storage, so that management personnel can timely search, view, track and analyze historical data;
further, when the alarm response unit receives the abnormal condition signal, the alarm response unit makes a targeted response to the abnormal level, controls the access control system to close and send out a buzzing alarm, informs a user management system if necessary, prompts a manager to manually add decision processing, carries out information complement and management according to the abnormal information, optimizes the deep learning R-CNN model, improves the recognition efficiency and accuracy, and after the data processing module finishes processing the data, the report output unit carries out visual report output according to the normalized information collected by the data processing module, and stores the report in a cloud database of the wagon balance measuring equipment management system through the data storage unit, so that the manager can track and analyze in time.
The method comprises the following steps that firstly, before a site vehicle enters a wagon balance measuring equipment detection area, a recognition detection module carries out vehicle recognition on the vehicle, wherein the vehicle comprises license plate information, load information, cargo information and driver information, the license plate number is quickly recognized by utilizing an R-CNN model in a data training module, then, a data processing module integrates and normalizes the information, safety compliance comparison is carried out on the information and data preset in the data training module, and if an abnormal condition occurs, the data processing module sends an abnormal signal to activate a user management module to respond to the abnormal condition in time; if no abnormal condition occurs, the data processing module transmits the vehicle information and the cargo weight information detected by the identification detection module to the user management module to output a visual data report and store the visual data report in the wagon balance measuring equipment management system for subsequent data analysis and tracking of management personnel.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.

Claims (10)

1. Wagon balance measurement equipment based on OCR discernment, its characterized in that: the system comprises a wagon balance measuring equipment main body, a data training module, an identification detection module, a data processing module and a user management module, wherein the data training module is used for training and configuring a vehicle identification model, a real-time and rapid target detection model is built, the identification detection module is used for identifying license plate information and finishing data information detection of a construction site vehicle, the data processing module is used for integrating and calculating data information acquired by the identification detection module and normalizing the data, and the user management module is used for carrying out data feedback and management response on the data normalized by the data processing module.
2. A wagon balance measuring apparatus based on OCR recognition according to claim 1, wherein: the data training module comprises: the system comprises a data set training chip, a data model training fine-tuning unit and a deployment identification unit;
the data set training chip is embedded at the bottom of the inner wall of the wagon balance measuring equipment main body, collects and stores construction site vehicle information, driver information and cargo information in the chip, and establishes data into a database for real-time updating and optimizing;
the data training fine tuning unit utilizes database information established by the data set chip to construct a data set containing vehicle images and response labels, utilizes the data set to cooperate with a wagon balance measuring equipment management system to establish a deep learning R-CNN model based on a convolutional neural network for model optimization iteration, and rapidly retrieves the model for corresponding vehicle identification during the vehicle identification of a construction site;
the deployment identification unit embeds the R-CNN model into the wagon balance measuring equipment management system, processes image data in real time, and performs identification confirmation and safety feedback on the information data processed by the data processing module.
3. A wagon balance measuring apparatus based on OCR recognition according to claim 1, wherein: the identification detection module comprises: the system comprises a camera module, optical character recognition OCR software and a load cell sensor;
the camera module is arranged on the front surface of the outer wall of the wagon balance measuring equipment main body, takes a license plate photo, a vehicle photo and a cargo photo before a construction site vehicle enters the wagon balance measuring equipment, and transmits image information of the license plate photo, the vehicle photo and the cargo photo to the data processing module;
the optical character recognition OCR software is installed in a software library in the wagon balance measuring equipment management system, and the optical character recognition OCR software calls license plate photos shot by the camera module, automatically recognizes license plate number characters and uploads license plate number information to the data processing module;
the load cell sensor is arranged at the top of the outer wall of the wagon balance measuring equipment main body, and is used for detecting the weight of vehicles and cargoes and uploading the weight information to the data processing module.
4. A wagon balance measuring apparatus based on OCR recognition according to claim 1, wherein: the data processing module comprises: the system comprises a data integration unit, a data calculation unit and an information feedback unit;
the data integration unit performs data integration classification on license plate photos, vehicle photos, cargo photo image information, license plate numbers and weight information transmitted by the camera module, the optical character recognition OCR software and the load cell sensor, and transmits the integrated and classified data to the data calculation unit;
the data calculation unit processes the license plate photo, the vehicle photo, the cargo photo image information, the license plate number and the weight information and database information in the data collection chip in real time by utilizing an R-CNN model in the deployment identification unit, compares cargo information, compares driver information and cargo weight information, marks abnormal data after the comparison is completed, and transmits all abnormal data to the information feedback unit;
after the information feedback unit receives the abnormal data, the abnormal data are classified and defined into abnormal safety grades, and the abnormal safety grades are divided into: and uploading the abnormal security level signals to a user management module in the wagon balance measuring equipment management system.
5. A wagon balance measuring apparatus based on OCR recognition according to claim 1, wherein: the user management module includes: the system comprises an alarm response unit, a report output unit and a data storage unit;
the alarm response unit is connected with the wagon balance measuring equipment access control system and the buzzer alarm through signal lines, and controls the wagon balance measuring equipment access control system to be closed, sends out a buzzer alarm and links a user management interface to inform management personnel of processing abnormal conditions after receiving the abnormal security level signal;
the report output unit is used for outputting the data information processed by the data calculation unit in a visual form;
the data storage unit is used for uploading the visual report output by the report output unit to a cloud database of the wagon balance measuring equipment management system for storage, so that management personnel can timely search, view, track and analyze historical data.
6. A wagon balance measuring apparatus based on OCR recognition according to claim 4, wherein: the information feedback unit classifies the abnormal data and defines abnormal security levels after receiving the abnormal data, and the abnormal security levels are divided into: primary anomalies, secondary anomalies, and tertiary anomalies;
first-order anomaly: the license plate number identified by the OCR software is a strange number;
second-level anomalies: the difference exists among the vehicle image data processed in real time by the R-CNN model, the comparison cargo information and the database information established by the data set chip corresponding to the comparison driver information and the license plate number;
three-level abnormality: the weight of goods detected by the load cell sensor exceeds the standard weight information in the database established by the data set chip.
7. A wagon balance measuring apparatus based on OCR recognition according to claim 5, wherein: the alarm response unit receives the abnormal security level signal, then makes the following response measures and sends out corresponding signal instructions:
first order exception response: the alarm response unit sends a signal instruction to close the access control system of the wagon balance measuring equipment;
second-order exception response: the alarm unit sends out a signal instruction to link the user management system to send out a warning alarm to inform a manager to manually supplement, correct and input difference information in a database in the data collection chip;
three-level abnormal response: the alarm response unit sends out a signal instruction to start the buzzer to send out a jerky buzzer to inform a driver to immediately drive out of the measuring area of the wagon balance measuring equipment.
8. A wagon balance measuring apparatus based on OCR recognition according to claim 2, wherein: the data training fine-tuning unit continuously learns difference information manually supplemented, corrected and input by a manager by using a deep learning R-CNN model established by a data set, continuously optimizes the identification range and speed of the R-CNN model, and when a vehicle with abnormal information enters a wagon balance measuring equipment area again, the R-CNN model utilizes a new database to optimize and identify, thereby completing successful identification release.
9. The method for using the wagon balance measurement apparatus based on OCR recognition according to any one of claims 1 to 8, wherein: the using method of the wagon balance measuring equipment comprises the following steps:
s1, firstly, before a vehicle enters a wagon balance measuring device measuring area, a camera module shoots a license plate photo, a vehicle photo and a cargo photo before the vehicle enters the wagon balance measuring device, and transmits image information of the license plate photo, the vehicle photo and the cargo photo to a data processing module;
s2, performing OCR software on the license plate photo by using OCR software for recognizing the license plate number, and performing information comparison on the license plate photo, the vehicle photo and the cargo photo and a database in a data set training chip by using an R-CNN deep learning model by using a data calculation unit;
s3, detecting the weight of the cargoes of the vehicle by using the load cell sensor, and transmitting detection data to the data processing module to compare the data and perform abnormal feedback;
and S4, finally, the information feedback unit transmits the information corresponding to the vehicle and the goods to the user management unit to make abnormal corresponding measures and generate a visual data report.
10. The method for using a wagon balance measuring apparatus based on OCR recognition according to claim 9, wherein: the using method further comprises the following steps:
s11, the data integration unit performs data integration classification on license plate photos, vehicle photos, cargo photo image information, license plate numbers and weight information, marks abnormal data after the data calculation unit compares the abnormal data, and transmits all abnormal data to the information feedback unit;
s21, after abnormal information appears, the data training fine-tuning unit continues to learn the difference information manually supplemented, corrected and input by a manager by using the deep learning R-CNN model established by the data set, and redeploys the R-CNN model through the deployment identification unit so as to continuously perform optimization iteration;
s31, after the load cell sensor detects the weight of the cargoes of the vehicle, transmitting data to the data processing module for comparing and recording weight information;
and S41, after the visual report is generated, uploading the visual report to a cloud database of the wagon balance measuring equipment management system by the data storage unit for storage.
CN202311455563.5A 2023-11-03 Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof Active CN117520979B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311455563.5A CN117520979B (en) 2023-11-03 Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311455563.5A CN117520979B (en) 2023-11-03 Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof

Publications (2)

Publication Number Publication Date
CN117520979A true CN117520979A (en) 2024-02-06
CN117520979B CN117520979B (en) 2024-05-31

Family

ID=

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102243729A (en) * 2010-05-12 2011-11-16 上海宝康电子控制工程有限公司 Delivery management system and method of goods and materials based on license plate information recognition
CN202562616U (en) * 2012-05-25 2012-11-28 浙江川山甲物资供应链有限公司 Remote loadometer data transmission system based on Internet of Things
CN207663474U (en) * 2017-12-28 2018-07-27 上海新增鼎数据科技有限公司 A kind of factory position warehouse mistake proofing is with detection and alarm system
CN108844606A (en) * 2018-07-02 2018-11-20 芜湖市联网汇通电子科技有限公司 A kind of logistics van weighing management system and its management method
CN109214658A (en) * 2018-08-14 2019-01-15 安徽新网讯科技发展有限公司 A kind of dynamic weighing weighbridge and weighbridge management system
CN109670458A (en) * 2018-12-21 2019-04-23 北京市商汤科技开发有限公司 A kind of licence plate recognition method and device
CN109870222A (en) * 2019-04-10 2019-06-11 深圳中物智建科技有限公司 A kind of unattended weight bridge weighing system with omnibearing stereo identification function
CN110231078A (en) * 2019-06-14 2019-09-13 广州瀚昇智能科技有限公司 A kind of intelligent weighing weighbridge management method and system
KR102131603B1 (en) * 2019-12-16 2020-07-08 이수행 automated system for measure of weight
CN112067102A (en) * 2020-08-05 2020-12-11 广东科达计量科技有限公司 Intelligent metering supervision platform
CN112488595A (en) * 2020-12-28 2021-03-12 苏州奥乐思智能科技有限公司 Wisdom building site system
CN212931612U (en) * 2020-08-25 2021-04-09 四川公路桥梁建设集团有限公司 Weighbridge management system suitable for building site material transportation
CN114170591A (en) * 2021-11-17 2022-03-11 中投视讯文化传媒(上海)有限公司 Intelligent parking solution method and system based on Saas mode
CN114353921A (en) * 2021-11-25 2022-04-15 中煤电气有限公司 Unattended system of loadometer room and application method thereof
KR102425437B1 (en) * 2021-10-13 2022-07-27 (주)유디엔에스 Weigh-In-Motion having function of automatic loads identification
CN114973211A (en) * 2022-03-25 2022-08-30 深圳市商汤科技有限公司 Object identification method, device, equipment and storage medium
CN115588249A (en) * 2022-09-08 2023-01-10 中建八局科技建设有限公司 Automatic in-out management system and method thereof
KR20230009598A (en) * 2021-07-09 2023-01-17 주식회사 현대케피코 Vehicle license plate recognition and counterfeit determination method and system in which the method is performed
CN115860602A (en) * 2022-11-24 2023-03-28 中国公路工程咨询集团有限公司 Logistics station vehicle carrying management method and weighing field device
CN116007723A (en) * 2023-01-05 2023-04-25 山东黄金冶炼有限公司 Unattended wagon balance control method and control system
CN116129416A (en) * 2023-01-31 2023-05-16 广东海洋大学 AI algorithm-based vehicle management system with double systems and double modes
WO2023109099A1 (en) * 2021-12-15 2023-06-22 重庆邮电大学 Charging load probability prediction system and method based on non-intrusive detection
CN116772987A (en) * 2023-07-25 2023-09-19 蓝思系统集成有限公司 Method, device, system and storage medium for detecting wagon balance
CN116863573A (en) * 2023-07-13 2023-10-10 北京红山信息科技研究院有限公司 GPGPU (graphics processing Unit) road management system with image recognition function

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102243729A (en) * 2010-05-12 2011-11-16 上海宝康电子控制工程有限公司 Delivery management system and method of goods and materials based on license plate information recognition
CN202562616U (en) * 2012-05-25 2012-11-28 浙江川山甲物资供应链有限公司 Remote loadometer data transmission system based on Internet of Things
CN207663474U (en) * 2017-12-28 2018-07-27 上海新增鼎数据科技有限公司 A kind of factory position warehouse mistake proofing is with detection and alarm system
CN108844606A (en) * 2018-07-02 2018-11-20 芜湖市联网汇通电子科技有限公司 A kind of logistics van weighing management system and its management method
CN109214658A (en) * 2018-08-14 2019-01-15 安徽新网讯科技发展有限公司 A kind of dynamic weighing weighbridge and weighbridge management system
CN109670458A (en) * 2018-12-21 2019-04-23 北京市商汤科技开发有限公司 A kind of licence plate recognition method and device
CN109870222A (en) * 2019-04-10 2019-06-11 深圳中物智建科技有限公司 A kind of unattended weight bridge weighing system with omnibearing stereo identification function
CN110231078A (en) * 2019-06-14 2019-09-13 广州瀚昇智能科技有限公司 A kind of intelligent weighing weighbridge management method and system
KR102131603B1 (en) * 2019-12-16 2020-07-08 이수행 automated system for measure of weight
CN112067102A (en) * 2020-08-05 2020-12-11 广东科达计量科技有限公司 Intelligent metering supervision platform
CN212931612U (en) * 2020-08-25 2021-04-09 四川公路桥梁建设集团有限公司 Weighbridge management system suitable for building site material transportation
CN112488595A (en) * 2020-12-28 2021-03-12 苏州奥乐思智能科技有限公司 Wisdom building site system
KR20230009598A (en) * 2021-07-09 2023-01-17 주식회사 현대케피코 Vehicle license plate recognition and counterfeit determination method and system in which the method is performed
KR102425437B1 (en) * 2021-10-13 2022-07-27 (주)유디엔에스 Weigh-In-Motion having function of automatic loads identification
CN114170591A (en) * 2021-11-17 2022-03-11 中投视讯文化传媒(上海)有限公司 Intelligent parking solution method and system based on Saas mode
CN114353921A (en) * 2021-11-25 2022-04-15 中煤电气有限公司 Unattended system of loadometer room and application method thereof
WO2023109099A1 (en) * 2021-12-15 2023-06-22 重庆邮电大学 Charging load probability prediction system and method based on non-intrusive detection
CN114973211A (en) * 2022-03-25 2022-08-30 深圳市商汤科技有限公司 Object identification method, device, equipment and storage medium
CN115588249A (en) * 2022-09-08 2023-01-10 中建八局科技建设有限公司 Automatic in-out management system and method thereof
CN115860602A (en) * 2022-11-24 2023-03-28 中国公路工程咨询集团有限公司 Logistics station vehicle carrying management method and weighing field device
CN116007723A (en) * 2023-01-05 2023-04-25 山东黄金冶炼有限公司 Unattended wagon balance control method and control system
CN116129416A (en) * 2023-01-31 2023-05-16 广东海洋大学 AI algorithm-based vehicle management system with double systems and double modes
CN116863573A (en) * 2023-07-13 2023-10-10 北京红山信息科技研究院有限公司 GPGPU (graphics processing Unit) road management system with image recognition function
CN116772987A (en) * 2023-07-25 2023-09-19 蓝思系统集成有限公司 Method, device, system and storage medium for detecting wagon balance

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SICHANGI M. SYDNEY: "Automation of Number Plate and Weight Scale Readings at a Cane Factory Weighbridge through Image and Character Recognition Techniques", 《IJCSSE》, vol. 7, no. 3, 31 March 2018 (2018-03-31), pages 52 - 59 *
杨波 等: "煤矿视频联动地磅称重智能识别管理系统", 工矿自动化, no. 01, 31 December 2018 (2018-12-31), pages 39 - 43 *

Similar Documents

Publication Publication Date Title
CN103246265B (en) Electromechanical equipment detection maintaining method
CN111486893A (en) Bridge structure health monitoring and early warning system and early warning method
CN109809149B (en) Fault early warning system and method for industrial production equipment
CN109803127A (en) Urban safety building site monitoring system and method based on big data and technology of Internet of things
CN109117526B (en) Data recording and analyzing system applicable to maintenance guide of mechanical system equipment
CN115395646B (en) Intelligent operation and maintenance system of digital twin traction substation
CN212933544U (en) On-site operation safety identification system based on edge calculation
CN115527364B (en) Traffic accident tracing method and system based on radar data fusion
CN112381958A (en) ETC portal system state online monitoring method and system
CN114966422A (en) Real-time monitoring and early warning system based on power battery parameters
CN117520979B (en) Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof
CN114170704A (en) Digital intelligent vehicle monitoring system
CN113657624A (en) Intelligent operation and maintenance management platform for terminal of Internet of things
CN116777227A (en) Hierarchical supervision method and system for enterprise safety production risk
CN117520979A (en) Wagon balance measuring equipment based on OCR (optical character recognition) and application method thereof
CN116679653A (en) Intelligent acquisition system for industrial equipment data
CN114435172B (en) Automatically-managed intelligent charging pile and intelligent charging method for new energy automobile
CN114266483B (en) Dangerous waste monitoring system based on Internet of things
CN113888866B (en) Road vehicle management system with multistage early warning function
CN205091571U (en) Intelligence management system that weighs based on internet transmission
CN113313913A (en) Automobile safety early warning system and weighting early warning method
CN112819988A (en) Unmanned aerial vehicle power station intelligent inspection method and system based on 5G and network side server
CN111126326A (en) Crane counterweight automatic identification system and method based on image identification technology
CN114372500A (en) Intelligent factory control system based on big data
CN114078227B (en) Intelligent AI recognition alarm system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant