CN109684322A - A kind of data processing system and method checked for automatic maritime affairs - Google Patents
A kind of data processing system and method checked for automatic maritime affairs Download PDFInfo
- Publication number
- CN109684322A CN109684322A CN201811601257.7A CN201811601257A CN109684322A CN 109684322 A CN109684322 A CN 109684322A CN 201811601257 A CN201811601257 A CN 201811601257A CN 109684322 A CN109684322 A CN 109684322A
- Authority
- CN
- China
- Prior art keywords
- data
- analysis
- shipping bill
- module
- subsystem
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/083—Shipping
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Economics (AREA)
- Quality & Reliability (AREA)
- Entrepreneurship & Innovation (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Development Economics (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The data processing system and method that the invention discloses a kind of to check for automatic maritime affairs, it is acquired including data and cleans subsystem, for obtaining original manifest data, original manifest data are cleaned and converted and are transferred to the shipping bill data after cleaning, conversion and check analyzing subsystem；It checks analyzing subsystem, according to reference data, data integrity and/or analysis of the accuracy is carried out to the shipping bill data after cleaning, conversion；Automatically it checks subsystem, is checked according to analysis data generation as a result, judging to be identified abnormal data whether comprising abnormal data in shipping bill data, track and dispose；Statistical analysis subsystem, to result and abnormal data progress real-time statistic analysis is checked, generates analysis report using OLAP multidimensional analysis method；Parameter configuration module, for distributing user permission, the execution journal of audit record stage task and user's usage log；External interface module, is docked for realizing with external data or platform.
Description
Technical field
The present invention relates to the technical field of harbour charging administration system, especially a kind of data checked for automatic maritime affairs
Processing system and method.
Background technique
Currently, China's port construction fee collecting mode mainly includes two kinds: one is maritime administrative agencies directly to impose port
Mouth cost of erection, another kind is the beneficiary's units such as shipping agency, haulier, port operator to withhold port construction
Take.
Current collection system be mainly withhold based on collection management system, maritime personnel need by daily inspection,
A variety of ways of check such as special project inspection, special project inspection are checked the collection links of set-fee to obtain set-fee data, this
Sample there is two problems:
1, due to needing, a large amount of personnel carry out checking the working strength for having aggravated maritime administrative agency and efficiency is lower；
2, during inspection, the data that maritime personnel obtains are also not accurate enough.
Summary of the invention
The object of the invention is in order to solve above-mentioned problems of the prior art, propose it is a kind of using third party into
Export declaration information data is analyzed with reference data, so as to obtain being used for automatically for the accurate data of inspection in real time
The data processing system and method that maritime affairs are checked.
In order to achieve the above object, the technical solution adopted by the present invention are as follows:
A kind of data processing system checked for automatic maritime affairs, including data acquire and clean subsystem, check analysis
Subsystem checks subsystem, statistical analysis subsystem, parameter configuration module and external interface module automatically, in which:
With cleaning subsystem for obtaining original manifest data, the original manifest data that will acquire carry out clear for data acquisition
It washes, convert, and the shipping bill data after cleaning, conversion are transferred to and check analyzing subsystem；
Check that analyzing subsystem according to the reference data in reference database, carries out the shipping bill data after cleaning, conversion
Data integrity and/or analysis of the accuracy；
Automatically check subsystem for checked according to analysis data generation as a result, and judge in the shipping bill data whether
Comprising abnormal data, and abnormal data is identified, track and is disposed；
Statistical analysis subsystem is using OLAP multidimensional analysis method to checking that result and abnormal data carry out real-time statistics point
Analysis, and generate analysis report；
Parameter configuration module is used for distributing user permission, and the execution journal of audit record stage task and user's usage log；
External interface module is docked for realizing with external data or platform.
A kind of data processing method checked for automatic maritime affairs, comprising:
Original manifest data are acquired, cleaned and converted；
According to the reference data in reference database to cleaning, conversion after shipping bill data carry out data integrity and/or
Analysis of the accuracy；
Checked according to analysis data generation as a result, and judge in the shipping bill data whether to include abnormal data,
And abnormal data is identified, track and is disposed；
Using OLAP multidimensional analysis method to checking that result and abnormal data carry out real-time statistic analysis, and generate analysis report
It accuses.
Present invention obtains following the utility model has the advantages that
The present invention passes through setting data and acquires and clean subsystem, check analyzing subsystem, check subsystem, statistics automatically
With analyzing subsystem, parameter configuration module and external interface module, data and third party's comparison information number after acquiring, cleaning
It is compared according to the foreign trade data in library, beneficiary's unit's routine work data in maritime affairs comparison information database with reference data
Analysis, can effectively examine the accuracy of beneficiary's unit's reported data；Furthermore with OLAP multidimensional analysis method to shipping bill number
According to for statistical analysis, more human costs are not needed, to improve supervisory efficiency while also reduce cost.
Detailed description of the invention
The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
Fig. 1 is a kind of modular structure of one embodiment of data processing system checked for automatic maritime affairs of the invention
Schematic diagram；
Fig. 2 is the structural schematic diagram of one embodiment of external interface module of the invention；
Fig. 3 is a kind of process signal of one embodiment of data processing method checked for automatic maritime affairs of the invention
Figure；
Fig. 4 A-4C be of the invention data acquisition, cleaning process one embodiment flow diagram.
Specific embodiment
It is described below for the open present invention so that those skilled in the art can be realized the present invention.It is excellent in being described below
Embodiment is selected to be only used as illustrating, it may occur to persons skilled in the art that other obvious deformations.It defines in the following description
Basic principle of the invention can be applied to other embodiments, deformation scheme, improvement project, equivalent program and do not carry on the back
Other technologies scheme from the spirit and scope of the present invention.
It is understood that term " one " is interpreted as " at least one " or " one or more ", i.e., in one embodiment,
The quantity of one element can be one, and in a further embodiment, the quantity of the element can be it is multiple, term " one " is no
It can be interpreted as the limitation to quantity.
Term used herein is only used for describing the purpose of various embodiments and is not intended to limit.As used herein,
Singular is intended to also include plural form, makes an exception unless the context clearly dictates.Will further be understood that term " includes " and/or
" having " specifies depositing for the feature, number, step, operation, component, element or combinations thereof when being used in this specification
, and it is not excluded for the presence or additional of one or more of the other feature, number, step, operation, component, element or its group.
A kind of reality of data processing system for maritime affairs auditing management website of the invention is illustrated below in conjunction with attached drawing
Apply mode.
One, a kind of data processing system checked for automatic maritime affairs
The data processing system system checked for automatic maritime affairs includes one or more databases, here to of the invention
Each database involved in one embodiment of data processing system is illustrated, which includes:
A, third party's comparison information database, for storing the ship inlet and outlet report through over cleaning, customs's unit of conversion
Close the outlet foreign trade data of information and shipping agency；
B, maritime affairs comparison information database, for store through over cleaning, conversion from the port construction dues administration of collection
Beneficiary's unit's routine work data of system (i.e. payment system)；
C, maritime affairs check inspection database, are to check inspection process and result, generation to maritime administration worker for storing
Unit is received to abnormal treatment process related data；
D, beneficiary's unit's database is the basic relevant information for storing beneficiary's unit, such as organization, registered place
Location, legal person, unit qualification, telephone number etc.；
E, parameter configuration data library is for storing including organization information, user information, system actor, system resource, being
The contents such as system menu, while further including the data such as system log management, data dictionary, attachment table.
Fig. 1 is a kind of modular structure of one embodiment of data processing system checked for automatic maritime affairs of the invention
Schematic diagram, referring to Figure 1, in this implementation, which includes data acquisition and cleaning subsystem, checks analysis subsystem
System checks subsystem, statistical analysis subsystem, parameter configuration module and external interface module automatically, in which:
With cleaning subsystem for obtaining original manifest data, the original manifest that will acquire is cleaned, is turned for data acquisition
It changes, and the shipping bill data after cleaning, conversion is transferred to and check analyzing subsystem, third party's comparison information database and maritime affairs ratio
To information database；The original manifest data check the original cabin of inspection database from beneficiary's unit's database and maritime affairs
Forms data；Specifically, can carry out cleaning and passing through smoothing processing to incompleteness, mistake, duplicate original manifest data, add up to
Original manifest data are converted in processing, extensive processing, normalization processing etc.；
It checks the analyzing subsystem reference data total according to reference database, the shipping bill data after cleaning, conversion is carried out
Data integrity and/or analysis of the accuracy；
Automatically check subsystem for checked according to analysis data generation as a result, and judge in the shipping bill data whether
Comprising abnormal data, and abnormal data is identified, tracks and abnormal data is sent to statistical analysis subsystem disposition；
Statistical analysis subsystem is using OLAP (that is: online analysis and processing) multidimensional analysis method to checking result and abnormal number
According to progress real-time statistic analysis, and generate analysis report；
Parameter configuration module is used for distributing user permission, and the execution journal of audit record stage task and user's usage log；
External interface module is docked for realizing with external data or platform.Two, the explanation of subsystems
Below by the structure and/or the course of work of subsystems or module to the data processing system in the present embodiment
It is illustrated.
1, data acquisition and cleaning subsystem
Data acquisition and cleaning subsystem in the present embodiment include that source data obtains module and data cleansing conversion module,
Wherein:
The source data obtains module for acquiring original manifest data, and the original manifest data are transferred to data
Clean conversion module；The original manifest data source checks inspection database, the generation in beneficiary's unit's database and maritime affairs
It receives in unit data library and stores to carry out the marine vessel data for levying on the behalf the port construction dues collection management system of work；It is described
Maritime affairs, which are checked, to be stored the ship inlet and outlet declaration information audited through customs and is declared by shipping agency in inspection database
The outlet foreign trade data (i.e. " third party's shipping bill data ") of acquisition；
Above-mentioned original manifest data are cleaned, are converted by the data cleansing conversion module；And it will be after cleaning, conversion
The storage of shipping bill data is to checking in analyzing subsystem, third party's comparison information database and maritime affairs comparison information database.
Specifically, source data obtains, module can be timed to third party's shipping bill data interface module and the maritime affairs port expense of building is checked
The data source of management database (i.e. third party's comparison information database and maritime affairs comparison information database) is inquired after to obtain
Take original manifest data；
In the present embodiment, according to different database interfaces, data acquisition and the process of cleaning can be divided into following sections:
(1) it is acquired first 7 days by calling third party's shipping bill data interface module during idle time daily using timer
Third party's original manifest data；
(2) collected third party's original manifest data are cleaned, convert acquisition third by data cleansing conversion module
Third party's shipping bill data are transmitted and are stored and check that analyzing subsystem, the maritime affairs port expense of building check database by shelter forms data,
And shipping bill disposition state is set as " 0 "；
(3) it reads the maritime affairs port expense of building and checks that all shipping bill disposition states are the shipping bill data of " 0 " in database；
(4) maritime affairs ship is called by incoming ship IMO (that is: ship name code), ship flight number, inlet and outlet label etc.
Marine vessel data are stored to maritime affairs port to obtain marine vessel data and build expense auditing management website database by oceangoing ship data interface module
In, and shipping bill cargo and container data interface module called by ship code with obtain the corresponding bill of lading data of shipping bill and
Container data by the bill of lading data and container data cleaning, is converted and is saved to maritime affairs port and build expense auditing management website database,
It is 1 that shipping bill, which is arranged, to dispose state；
Wherein, before obtaining marine vessel data and obtaining bill of lading data and container data, can first judge whether
There are marine vessel data or bill of lading data and container datas: if the data are not present, further judging current time
Whether it is greater than prefixed time interval with the time interval of electronic bill of lading creation time, if the time interval is greater than between preset time
Every, then by the shipping bill data markers be abnormal data, and by shipping bill disposition state be set as " 8 ", if the time interval be less than or
Equal to prefixed time interval, then it represents that the shipping bill data are normal data, and it is constant that shipping bill disposes state.
(5) it reads maritime affairs port and builds the shipping bill data that all disposition states in expense auditing management website database are " 1 "；
(6) third party's shipping bill cargo and container data interface module are called, third party's cargo sum aggregate is judged whether there is
Packaging data；
Third party's cargo and container data if it exists then clean, convert and store third party's cargo and packaging
Case data to maritime affairs port is built in expense auditing management website database, and shipping bill disposition state is set as " 2 "；
Third party's cargo and container data if it does not exist, then judge between current time and the time for creating the shipping bill
Every whether being greater than prefixed time interval, if more than prefixed time interval, then show that there is no third party's containers, by the shipping bill number
" 8 " are set as according to labeled as abnormal data, and by shipping bill setting state；If being less than or equal to time interval, show the shipping bill
Data are normal, and it is constant that state is arranged in shipping bill.
In the present embodiment, which be can be set to 90 days, it is to be understood that the preset interval is not limited to
This, may be arranged as other durations.
2, analyzing subsystem is checked
In the present embodiment check analyzing subsystem for import levy and manage data, and to expropriation and management data carry out consistency divide
Analysis, specifically, the subsystem includes:
Data analysis module, for according to the reference data in the reference database to it is described cleaning, conversion after cabin
Forms data carries out data integrity and/or analysis of the accuracy, obtains analysis result；Shipping bill data point after will cleaning, converting
It (that is: was not audited through customs's unit and the third of shipping agency with the foreign trade data in third party's comparison information database
Shelter forms data), beneficiary's unit's routine work data in maritime affairs comparison information database are compared；
In the present embodiment, can to shipping bill data carry out Data integrality analysis, such as judge in maritime system with customs
Whether comprising each verification item to judge whether data are complete in system, the verification item can be shipping bill quantity and container
Quantity；Data accuracy analysis can also be carried out to shipping bill data, such as retrieval " flight number number ", " ship IMO can be passed through
(that is: ship code) ", " container character " etc. lock unique container, then carry out according to reference data by digital ratio pair, with
Ensure that each container information is accurate；
Analysis result checks module, for showing the analysis as a result, when the analysis result for checking analyzing subsystem exists
When abnormal, it can be shown by general rise of prices of the stocks and other securities and/or information alert is checked to remind user to carry out abnormal results.
3, subsystem is checked automatically
Check that subsystem includes: automatically in the present embodiment
Module is checked, for determining according to the analysis data whether comprising abnormal data in the shipping bill data, to exception
Data are marked, and generate and check result with abnormal marking；Show the analysis after above-mentioned comparison as a result, simultaneously to user
Determine whether for the analysis result after comparing to be classified as according to the instruction of user and check exception item and be marked, generates final check
Core result；
Module is disposed, for tracking and disposing the abnormal data；Exception is checked described in the modification update of beneficiary's unit
, and updated result is fed back into user, the tracking to exception item rectification situation is completed for user.
4, subsystem is statisticallyd analyze
Statistical analysis subsystem in the present embodiment is mainly used for checking that data count, specifically, the subsystem
Include:
Statistical module, can be according to levying on the behalf organization, type of service, time range etc. to local overall shipping bill, linchpin
In area overall container sum, be completed check the shipping bill of inspection, be completed check inspection container number, discovery check
Inspection problem shipping bill and/or discovery check that inspection problem container number etc. carries out statistics and obtains statistical result, and according to described
The frequency that statistical result occurs is ranked up；Specifically, can according to the error reason of the exception item of the discovery during checking,
The options such as type of service simultaneously select the time-consuming range of certain sign (for example, it may be 3 years or 5 years), to the data processing system
It is middle mark the data for being carry out per year, the read group total in season or month, and be ranked up from big to small by occurrence frequency
Display；
Analysis module, can be according to levying on the behalf organization, type of service and the time-consuming range of sign etc. to checking reason and use
OLAP multidimensional analysis method carries out clustering, and generates analysis report.
5, parameter configuration module
Parameter configuration module in the present embodiment includes:
System configuration module, for setting and storing multiple configuration items, the configuration item includes: maritime administrative agency letter
Breath, collecting agency information and user information etc.；Specifically, the system management module can with external platform (such as maritime affairs 4A authenticate
System, it may be assumed that unified security manages platform) docking, the unified management of organization, user, role is realized by external platform, and mention
For unification user, unified certification, unified rights, uniform operational platform, unified menu, unified Integrated Management Platform, the parameter configuration
Module can be directly using the organization of external platform unified plan, user, character data；
Log management module executes time and implementing result and the operation history of user for audit record stage task；
Specifically, the log management module is for being managed the usage log of the execution journal and user of checking monitor task；Its
In check that the execution journal of monitor task is mainly used for execution time and the implementing result of audit record stage task, the execution time and
Implementing result is to check the significant data source of result；User's usage log is mainly used for record user and uses the automatic maritime affairs
The operation history for the data processing system checked, the operation history are the important evidences audited to user behavior.
6, external interface module
External interface module in the present embodiment includes:
Business interface module, for realizing the wired or wireless interconnection of import and export of goods data；
Door interface module, for docking with external platform to realize integrated combination, to realize that user is integrated, role set
Integrated, single-sign-on and Pending tasks etc. at, mechanism；
Wherein, the business interface module one or more of comprises the following modules:
Marine vessel data interface module, for obtaining marine vessel data, including incoming vessel data and Diesel engine
Data；
Shipping bill cargo and container data interface module obtain the corresponding bill of lading data of shipping bill for example, by shipping bill keyword
And container data；
Third party's shipping bill data interface module, the customs entry for obtaining beneficiary's unit forecast that shipping bill data and outlet are clear
Clean shipping bill data；
Third party's shipping bill cargo and container data interface module, for example, by shipping bill keyword for obtaining third party's goods
Object and container data；
Remarks interface module is checked and write off, for obtaining to the abnormal data generated after shipping bill data analysis；
Abnormal data interface module is checked, for obtaining and inquiring the abnormal data, specifically, the interface module is used for
Obtain the customs entry forecast shipping bill data and outlet cleaning shipping bill data of beneficiary's unit.
Three, a kind of data processing method checked for automatic maritime affairs
Fig. 3 is a kind of process signal of one embodiment of data processing method checked for automatic maritime affairs of the invention
Figure, Fig. 4 A-4C be of the invention data acquisition, cleaning process one embodiment flow diagram；Referring to Fig. 3 and Fig. 4 A-
4C, the data processing method of the present embodiment, including the following steps:
Step 100: original manifest data are acquired, cleaned and converted；
Step 200: it is complete that data being carried out to the shipping bill data after cleaning, conversion according to the reference data in reference database
Property and/or analysis of the accuracy；
Step 300: checked according to analysis data generation as a result, and whether judging in the shipping bill data comprising different
Regular data, and abnormal data is identified, track and is disposed；
Step 400: using OLAP multidimensional analysis method to checking that result and abnormal data carry out real-time statistic analysis, and it is raw
At analysis report.Wherein, step 100 includes following sub-step:
Step 110: calling third party's shipping bill data interface module to acquire third party's original manifest data；
Step 120: third party's original manifest data being cleaned, converted and stored, shipping bill disposition state is set
For " 0 "；
Step 130: reading third party's shipping bill data that all disposition states are " 0 "；
Step 140: calling marine vessel data interface module, judge whether there is marine vessel data；
Step 141: marine vessel data if it exists then call shipping bill cargo and container data interface module to obtain shipping bill
Corresponding bill of lading data and container data, and the bill of lading data and container data are cleaned, convert and store, it is arranged at shipping bill
Setting state is " 1 "；
Step 142: the shipping bill data markers are then abnormal data and dispose shipping bill by marine vessel data if it does not exist
State is set as " 8 "；
Step 150: reading the shipping bill data that all disposition states are " 1 "；
Step 160: calling third party's shipping bill cargo and container data interface module, judge whether there is third party's cargo
And container data；
Step 161: third party's cargo and container data if it exists then clean, convert and store third party's goods
Object and container data, and shipping bill disposition state is set as " 2 "；
Step 162: the shipping bill data markers are then abnormal number by third party's cargo and container data if it does not exist
According to, and " 8 " are set by shipping bill setting state.
The workflow of the data processing method checked for automatic maritime affairs and above-mentioned data processing system in the present embodiment
Journey is roughly the same, explanation that details are not described herein.
The present invention is in terms of software architecture, using the three-decker based on JavaEE platform, applies frame in conjunction with large enterprise
Frame and component are realized.Its front end page is the interface between application program and user, is mainly used for showing information to user, and
The input and output control of user's operation is provided；Application layer is mainly responsible for the transmission and conversion of user data；Business Logic is then
The essential core content of this module, the processing including various businesses logical process；Data access layer, which is mainly responsible for, saves data
Into database, persistence operation is carried out to data；It is comprehensive in such a way that OWB and SQL are combined in terms of data processing
The two advantage quickly establishes ETL data processing engineering, in addition the flexibility characteristics of SQL, be greatly improved ETL development rate and
Efficiency.
The beneficial effects of the present invention are:
The present invention passes through setting data and acquires and clean subsystem, check analyzing subsystem, check subsystem, statistics automatically
With analyzing subsystem, parameter configuration module and external interface module, data and third party's comparison information number after acquiring, cleaning
It is compared according to the foreign trade data in library, beneficiary's unit's routine work data in maritime affairs comparison information database with reference data
Analysis, can effectively examine the accuracy of beneficiary's unit's reported data；Furthermore with OLAP multidimensional analysis method to shipping bill number
According to for statistical analysis, more human costs are not needed, to improve supervisory efficiency while also reduce cost.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example " or " some to show
The description of example " etc. means that particular features, structures, materials, or characteristics described in conjunction with this embodiment or example are contained in the present invention
At least one embodiment or example in.In the present specification, schematic expression of the above terms are not required to be directed to
Identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in any one or more realities
Applying can be combined in any suitable manner in example or example.In addition, without conflicting with each other, those skilled in the art can incite somebody to action
The feature of different embodiments or examples and different embodiments or examples described in this specification is combined.It needs
Illustrate, the present invention the flow chart and block diagram in the drawings show the system of multiple embodiments according to the present invention, method and
The architecture, function and operation in the cards of acquisition machine program product.In this regard, each side in flowchart or block diagram
Frame can represent a part of a module, section or code, and a part of the module, section or code includes one
Or multiple executable instructions for implementing the specified logical function.It should also be noted that in some implementations as replacements, side
The function of being marked in frame can also occur in a different order than that indicated in the drawings.For example, two continuous boxes are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong
The dedicated hardware based system of defined function or movement is executed to realize, or can be referred to specialized hardware and acquisition machine
The combination of order is realized.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.The apparatus embodiments described above are merely exemplary, for example, the division of the unit,
Only a kind of logical function partition, there may be another division manner in actual implementation, in another example, multiple units or components can
To combine or be desirably integrated into another system, or some features can be ignored or not executed.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.If the function
It is realized in the form of SFU software functional unit and when sold or used as an independent product, can store readable in an acquisition machine
It takes in storage medium.Based on this understanding, technical solution of the present invention substantially in other words contributes to the prior art
Part or the part of the technical solution can be embodied in the form of software products, which is stored in one
In a storage medium, including some instructions are used so that acquisition machine machine (it can be personal acquisition machine, server, or
Net machine etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.And storage medium above-mentioned includes:
USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random
Access Memory), the various media that can store program code such as magnetic or disk.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme should all cover within the scope of the claims and the description of the invention.
Claims (10)
1. a kind of data processing system checked for automatic maritime affairs, which is characterized in that including data acquire with clean subsystem,
It checks analyzing subsystem, check subsystem, statistical analysis subsystem, parameter configuration module and external interface module automatically, in which:
With cleaning subsystem for obtaining original manifest data, the original manifest data that will acquire are cleaned, are turned for data acquisition
It changes, and the shipping bill data after cleaning, conversion is transferred to and check analyzing subsystem；
Check that analyzing subsystem according to the reference data in reference database, carries out data to the shipping bill data after cleaning, conversion
Integrality and/or analysis of the accuracy；
Automatically check subsystem for checked according to analysis data generation as a result, and judge in the shipping bill data whether include
Abnormal data, and abnormal data is identified, track and is disposed；
Statistical analysis subsystem using OLAP multidimensional analysis method to checking that result and abnormal data carry out real-time statistic analysis, and
Generate analysis report；
Parameter configuration module is used for distributing user permission, and the execution journal of audit record stage task and user's usage log；
External interface module is docked for realizing with external data or platform.
2. data processing system according to claim 1, which is characterized in that the data are acquired includes with cleaning subsystem
Source data obtains module and data cleansing conversion module, in which:
Source data obtains module and is transferred to data cleansing conversion for acquiring original manifest data, and by the original manifest data
Module；
The original manifest data are cleaned, are converted by the data cleansing conversion module, and will be cleaned, the shipping bill after conversion
Data transimission and storage is to checking analyzing subsystem.
3. data processing system according to claim 1, which is characterized in that described to check that analyzing subsystem includes:
Data analysis module, for according to the reference data in the reference database to it is described cleaning, conversion after shipping bill number
According to data integrity and/or analysis of the accuracy is carried out, analysis result is obtained；
Analysis result checks module, for showing the analysis result.
4. data processing system according to claim 1, which is characterized in that check that subsystem includes: automatically
Module is checked, for determining according to the analysis data whether comprising abnormal data in the shipping bill data, to abnormal data
It is marked, and generates and check result with abnormal marking；
Module is disposed, for tracking and disposing the abnormal data.
5. data processing system according to claim 1, which is characterized in that the statistical analysis subsystem includes:
Statistical module, for local overall shipping bill, local overall container sum, be completed and check the cabin of inspection
It is single, be completed the container number, discovery for checking inspection check inspection problem shipping bill and/or discovery check inspection problem packaging
Case number is counted and is sorted；
Analysis module using OLAP multidimensional analysis method to checking that result and abnormal data carry out clustering, and generates analysis
Report.
6. data processing system according to claim 1, which is characterized in that the parameter configuration module includes:
System configuration module, for setting and storing multiple configuration items, the configuration item includes maritime administrative agency information, withholds
Organization information and user information；
Log management module executes time and implementing result and the operation history of user for audit record stage task.
7. system according to claim 1, which is characterized in that the external interface module includes:
Business interface module, for realizing the wired or wireless interconnection with external business data；
Door interface module, for being docked with external platform to realize integrated combination.
8. system according to claim 7, which is characterized in that the business interface module comprise the following modules in one
Or it is multiple:
Marine vessel data interface module, for obtaining marine vessel data, including incoming vessel data and Diesel engine data；
Shipping bill cargo and container data interface module, for obtaining the corresponding bill of lading data of shipping bill and container data；
Third party's shipping bill data interface module, the customs entry for obtaining beneficiary's unit forecast shipping bill data and outlet cleaning cabin
Forms data；
Third party's shipping bill cargo and container data interface module, for obtaining third party's cargo and container data；
Remarks interface module is checked and write off, for obtaining to the abnormal data generated after shipping bill data analysis；
Abnormal data interface module is checked, for obtaining and inquiring the abnormal data；
Shipping bill data interface module is reacquired, for obtaining shipping bill data again.
9. a kind of data processing method checked for automatic maritime affairs characterized by comprising
Original manifest data are acquired, cleaned and converted；
According to the reference data in reference database to the shipping bill data progress data integrity after cleaning, conversion and/or accurately
Property analysis；
Checked according to analysis data generation as a result, and judge in the shipping bill data whether to include abnormal data, and it is right
Abnormal data is identified, tracks and disposes；
Using OLAP multidimensional analysis method to checking that result and abnormal data carry out real-time statistic analysis, and generate analysis report.
10. data processing method according to claim 9, which is characterized in that be acquired, clean to original manifest data
Include: with conversion
Call third party's shipping bill data interface module to acquire original manifest data；
The original manifest data are cleaned, converted and stored, shipping bill disposition state is set as " 0 "；
Read the shipping bill data that all disposition states are " 0 "；
Marine vessel data interface module is called, marine vessel data are judged whether there is；Marine vessel data if it exists are then adjusted
The corresponding bill of lading data of shipping bill and container data are obtained with shipping bill cargo and container data interface module, and cleans, convert
With the storage bill of lading data and container data, it is " 1 " that setting shipping bill, which disposes state,；Marine vessel data if it does not exist then will
The shipping bill data markers are abnormal data and shipping bill disposition state are set as " 8 "；
Read the shipping bill data that all disposition states are " 1 "；
Third party's shipping bill cargo and container data interface module are called, third party's cargo and container number are judged whether there is
According to；Third party's cargo and container data if it exists then clean, convert and store third party's cargo and container number
According to, and shipping bill disposition state is set as " 2 "；Third party's cargo and container data if it does not exist, then by the shipping bill data markers
For abnormal data, and " 8 " are set by shipping bill setting state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811601257.7A CN109684322B (en) | 2018-12-26 | 2018-12-26 | Data processing system and method for automatic maritime affair auditing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811601257.7A CN109684322B (en) | 2018-12-26 | 2018-12-26 | Data processing system and method for automatic maritime affair auditing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109684322A true CN109684322A (en) | 2019-04-26 |
| CN109684322B CN109684322B (en) | 2021-01-22 |
Family
ID=66189645
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811601257.7A Active CN109684322B (en) | 2018-12-26 | 2018-12-26 | Data processing system and method for automatic maritime affair auditing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109684322B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111061732A (en) * | 2019-12-05 | 2020-04-24 | 深圳迅策科技有限公司 | Report generation method based on big data processing |
| CN111309717A (en) * | 2020-01-23 | 2020-06-19 | 普信恒业科技发展（北京）有限公司 | Auditing method and system |
| CN111429068A (en) * | 2020-03-31 | 2020-07-17 | 天津市商务局(天津市人民政府口岸服务办公室) | Data supervision method, device and system |
| CN115658795A (en) * | 2022-12-12 | 2023-01-31 | 交通运输部水运科学研究所 | Maritime service data index management method and system supporting multi-scene evaluation |
| CN115982665A (en) * | 2023-03-21 | 2023-04-18 | 北京东华博泰科技有限公司 | Quality abnormity auditing method and system for water turbine measurement data |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6094651A (en) * | 1997-08-22 | 2000-07-25 | International Business Machines Corporation | Discovery-driven exploration of OLAP data cubes |
| CN101110863A (en) * | 2007-08-16 | 2008-01-23 | 南京联创科技股份有限公司 | Analyzing method for value-added service general settlement |
| CN101894319A (en) * | 2010-06-28 | 2010-11-24 | 中国烟草总公司湖南省公司 | Tobacco enterprise data quality management system and method |
| CN104915793A (en) * | 2015-06-30 | 2015-09-16 | 北京西塔网络科技股份有限公司 | Public information intelligent analysis platform based on big data analysis and mining |
| CN106056292A (en) * | 2016-06-03 | 2016-10-26 | 武汉铁锚焊接材料股份有限公司 | Business operation intelligent decision support system and method thereof |
| CN107230017A (en) * | 2017-05-26 | 2017-10-03 | 安徽皖通科技股份有限公司 | A kind of Highway and Waterway construction and transport market Credit Information Services system |
| CN107256443A (en) * | 2017-04-18 | 2017-10-17 | 国网信通亿力科技有限责任公司 | Line loss real-time computing technique based on business and data integration |
| CN107423390A (en) * | 2017-07-21 | 2017-12-01 | 上海德拓信息技术股份有限公司 | A kind of real time data synchronization algorithm based on inside OLTP OLAP mixed relationship type Database Systems |
| US20180027413A1 (en) * | 2016-06-02 | 2018-01-25 | Duo Security, Inc. | Method for automatic possession-factor authentication |
| CN108470228A (en) * | 2017-02-22 | 2018-08-31 | 国网能源研究院 | Financial data auditing method and audit system |
| CN108564254A (en) * | 2018-03-15 | 2018-09-21 | 国网四川省电力公司绵阳供电公司 | Controller switching equipment status visualization platform based on big data |
-
2018
- 2018-12-26 CN CN201811601257.7A patent/CN109684322B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6094651A (en) * | 1997-08-22 | 2000-07-25 | International Business Machines Corporation | Discovery-driven exploration of OLAP data cubes |
| CN101110863A (en) * | 2007-08-16 | 2008-01-23 | 南京联创科技股份有限公司 | Analyzing method for value-added service general settlement |
| CN101894319A (en) * | 2010-06-28 | 2010-11-24 | 中国烟草总公司湖南省公司 | Tobacco enterprise data quality management system and method |
| CN104915793A (en) * | 2015-06-30 | 2015-09-16 | 北京西塔网络科技股份有限公司 | Public information intelligent analysis platform based on big data analysis and mining |
| US20180027413A1 (en) * | 2016-06-02 | 2018-01-25 | Duo Security, Inc. | Method for automatic possession-factor authentication |
| CN106056292A (en) * | 2016-06-03 | 2016-10-26 | 武汉铁锚焊接材料股份有限公司 | Business operation intelligent decision support system and method thereof |
| CN108470228A (en) * | 2017-02-22 | 2018-08-31 | 国网能源研究院 | Financial data auditing method and audit system |
| CN107256443A (en) * | 2017-04-18 | 2017-10-17 | 国网信通亿力科技有限责任公司 | Line loss real-time computing technique based on business and data integration |
| CN107230017A (en) * | 2017-05-26 | 2017-10-03 | 安徽皖通科技股份有限公司 | A kind of Highway and Waterway construction and transport market Credit Information Services system |
| CN107423390A (en) * | 2017-07-21 | 2017-12-01 | 上海德拓信息技术股份有限公司 | A kind of real time data synchronization algorithm based on inside OLTP OLAP mixed relationship type Database Systems |
| CN108564254A (en) * | 2018-03-15 | 2018-09-21 | 国网四川省电力公司绵阳供电公司 | Controller switching equipment status visualization platform based on big data |
Non-Patent Citations (1)
| Title |
|---|
| 钟华杰等: "关于港口建设费低值货物征管的思考", 《中国水运》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111061732A (en) * | 2019-12-05 | 2020-04-24 | 深圳迅策科技有限公司 | Report generation method based on big data processing |
| CN111309717A (en) * | 2020-01-23 | 2020-06-19 | 普信恒业科技发展（北京）有限公司 | Auditing method and system |
| CN111429068A (en) * | 2020-03-31 | 2020-07-17 | 天津市商务局(天津市人民政府口岸服务办公室) | Data supervision method, device and system |
| CN111429068B (en) * | 2020-03-31 | 2021-04-23 | 天津市商务局(天津市人民政府口岸服务办公室) | Data supervision method, device and system |
| CN115658795A (en) * | 2022-12-12 | 2023-01-31 | 交通运输部水运科学研究所 | Maritime service data index management method and system supporting multi-scene evaluation |
| CN115982665A (en) * | 2023-03-21 | 2023-04-18 | 北京东华博泰科技有限公司 | Quality abnormity auditing method and system for water turbine measurement data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109684322B (en) | 2021-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109684322A (en) | A kind of data processing system and method checked for automatic maritime affairs | |
| CN109508825A (en) | Employee's image method for prewarning risk and relevant apparatus | |
| CN111984709A (en) | Visual big data middle station-resource calling and algorithm | |
| Neagoe et al. | Using discrete-event simulation to compare congestion management initiatives at a port terminal | |
| Zuting et al. | A synchronized strategy to minimize vehicle dispatching time: a real example of steel industry | |
| Sumito et al. | Influence of internal audit and internal control system on quality of the financial statement | |
| Bognár et al. | Multi-Method Risk Assessment Process for Sustainable Business—A compliance research Follow-up Case Study | |
| Yuliana et al. | Re-engineering and Technology Development on Reference Sample of Business Process (Case Study on Health Laboratory Service Company) | |
| Efimova et al. | Elimination of losses in information services based on approaches of IT-service management | |
| Son | Simulation-based manufacturing accounting for modern management | |
| CN109242431A (en) | A kind of enterprise management method and its system based on data system | |
| Wang et al. | Towards a reference model for knowledge driven data provision processes | |
| Xiong et al. | Detecting Data Flow Errors Across Processes in Business Process Collaboration | |
| Fitharti et al. | The Impact of Downtime Against Service Performance System Indonesia National Single Window (INSW) | |
| RU174580U1 (en) | AUTOMATED SYSTEM OF RATIONALIZATION WORK (ACTIVITY) | |
| Elefterie et al. | Intelligent strategies as a support for business process auditing-research directions | |
| RU174643U1 (en) | AUTOMATED SYSTEM OF MONITORING OF RATIONALIZATION WORK (ACTIVITY) | |
| Munawar | Extract Transform Loading (ETL) Based Data Quality for Data Warehouse Development | |
| Priantari et al. | Designing statistical data processing system platform based on SOA | |
| RU174649U1 (en) | AUTOMATED SYSTEM OF CONTROL OF RATIONALIZATION WORK (ACTIVITY) | |
| Falgenti et al. | The design of production modules of ERP systems based on requirements engineering for Electronic Manufacturing Services company | |
| Zhang et al. | Study on the construction of the pricing parameter model of aero engine digital control system test | |
| RU174572U1 (en) | AUTOMATED INFORMATION AND SEARCH SYSTEM OF RATIONALIZATION WORKS (OFFERS) | |
| Hoai | Factors affecting managerial accounting of production and business costs in coal mining enterprises in Vietnam | |
| Fauth et al. | Ontology for building permit authorities (OBPA) for advanced building permit processes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |