CN106953717A - A kind of efficient coding/decoding method of watercraft AIS data high-volume and system - Google Patents
A kind of efficient coding/decoding method of watercraft AIS data high-volume and system Download PDFInfo
- Publication number
- CN106953717A CN106953717A CN201710287895.5A CN201710287895A CN106953717A CN 106953717 A CN106953717 A CN 106953717A CN 201710287895 A CN201710287895 A CN 201710287895A CN 106953717 A CN106953717 A CN 106953717A
- Authority
- CN
- China
- Prior art keywords
- message
- binary
- ais
- decoding
- messages
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
- H04L1/0045—Arrangements at the receiver end
- H04L1/0047—Decoding adapted to other signal detection operation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
- G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
- G01S19/13—Receivers
- G01S19/24—Acquisition or tracking or demodulation of signals transmitted by the system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/38—Concurrent instruction execution, e.g. pipeline, look ahead
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/18578—Satellite systems for providing broadband data service to individual earth stations
- H04B7/18586—Arrangements for data transporting, e.g. for an end to end data transport or check
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
- H04L1/0045—Arrangements at the receiver end
- H04L1/0047—Decoding adapted to other signal detection operation
- H04L1/005—Iterative decoding, including iteration between signal detection and decoding operation
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Theoretical Computer Science (AREA)
- Astronomy & Astrophysics (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Computer And Data Communications (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of efficient coding/decoding method of watercraft AIS data high-volume and system, the system includes the satellite or several bank base receiving stations, network, AIS packet storages server, decoding effort station and result storage server for collecting AIS messages.AIS messages are aggregated into AIS packet storage servers by network, and decoding effort station is carried out after efficient parallel decoding；Result is stored in result storage server.This method reads message file there is provided message filter filtering function using internal memory mapping mode, classification transcoding is carried out to message and then the parallel decoding based on multi-core CPU computer is carried out working.In system work, in addition to the screening of a plurality of infomational message and a plurality of two steps of infomational message binary system transcoding serially operation, the all parallel operations of other decoding steps, improve cpu busy percentage and improve IO speed, the present invention makes the decoding of high-volume AIS data make full use of the computation capability of computer multi-core CPU, reaches higher decoding efficiency.
Description
Technical field
Used and watercraft AIS data decoding technique field, spy the present invention relates to the concurrent computing of computer multi-core CPU
It is not related to a kind of watercraft AIS data high-volume efficiently coding/decoding method and system.
Background technology
Ship automatic identification system (Automatic Identification System, abbreviation AIS system) is set by bank base
Apply (base station) and ship-borne equipment is collectively constituted, be a kind of new collection network technology, modern communications technology, computer technology, electricity
Digital navaid and equipment that sub-information Display Technique is integrated.
Ship automatic identification system (AIS) is formed by the radio recognition equipment development of naval vessel aircraft, coordinates global positioning system
(GPS) by the Ship dynamic situation information combination such as ship longitude and latitude, speed of the ship in metres per second, rate of changing course and course name of vessel, catchword, drinking water and
The ship such as dangerous cargo static data is broadcasted from very high frequency(VHF) (VHF) channel to Its Adjacent Waters ship and base station, make neighbouring ship and
Base station can grasp the dynamic static information of all ships in sea nearby in time, be able to coordination of conversing mutually at once, take necessary avoidance
Action, has very great help to safety of ship.
The ship of all kinds of installation AIS equipments in the whole world has more than 390,000, the ship of every normal operation all constantly to
Outer issue AIS data, can produce hundred million AIS data daily.Utilization to watercraft AIS data can not only realize maritime affairs pipe
The functions such as reason, can also provide course line transport power, port service capability evaluation etc. a series of for harbour, shipping company, loglstics enterprise etc.
Economic report.
AIS system message data follow ITU-R and M.1371 encoded with IEC61162 standards, and it is using printable
Ascii character code is transmitted and preserved, and long message can be divided into a plurality of sentence to be transmitted.
As shown in figure 1, AIS messages are made up of multiple domains, each domain can be a string of significant characters or NUL, each
With ", " for separator between domain.First domain "！ABVDM " be address field, by sentence starting character ($ or！) and 5 letter compositions,
It is mainly used to represent the type of sentence.Domain " x1 " represents the message total (1-9) that message is decomposed, and domain " x2 " represents the sequence of this message
Number (1-9), domain " x3 " represents continuous meassage mark (0-9), and domain " a " represents AIS channel numbers, and domain " N " represents the ID of type of message
Code, " SSSS ... SSS " represent to meet ITU-R M.1371 defined RI radio intelligences, the BIT numbers of domain " M " expression filling, domain in domain
" HH " represents check information.
It is common AIS message datas shown in Fig. 2, wherein last 2 data, which is a long message, is divided into 2 messages
The result of transmission." x1 " domain of 1st article of message is that 2, " x2 " domain is 1 to show that this article of information is divided into 2 articles of messages altogether, and this is the 1st
Bar；" x1 " domain of 2nd article of message is that 2, " x2 " domain is 2 to show that this article of information is divided into 2 articles of messages altogether, and this is that the 2nd article of message is same
When be also this information the last item message, to keep original order during the decoding of such message data.
General message data decoding process is to decode one by one sequentially in time, but in the AIS data in face of magnanimity,
The speed of this method very can not slowly meet and be actually needed, if the parallel operation decoding directly on multi-core CPU computer
Program, it is impossible to ensure that the long message decoding order being divided meets the requirements, and then decoding data mistake can be caused.Therefore, such as
What it is accurate according to standard magnanimity AIS data are carried out high-volume efficiently decoding just become one it is important the problem of.
The content of the invention
It is an object of the invention to provide a kind of watercraft AIS data high-volume efficiently coding/decoding method and system, this method and it is
System provides the function of screening and conversion AIS messages, several in optional 27 kinds of AIS messages during decoding, can make full use of meter
The computation capability of calculation machine multi-core CPU, reaches higher decoding efficiency.
The invention provides a kind of efficient coding/decoding method of watercraft AIS data high-volume, it is comprised the steps of：
The AIS messages retained in internal memory are screened, binary system transcoding and binary decoded；
By screening, by message according to a plurality of infomational message and infobit message classification：
For a plurality of infomational message, the information of many strip messages in a plurality of infomational message is serially filtered out, it is serial to carry out
Binary system transcoding；For infobit message, the information of infobit message is filtered out parallel, it is parallel to carry out binary system transcoding；
Processing is circulated to all messages of retention, until the screening of all messages and binary system transcoding are fully completed；
The binary system transcoding result of all messages is collected, binary decoded is carried out parallel, until binary decoded
Task is fully completed.
Preferably, the AIS messages in internal memory, are to map read in internal memory by the whole file of object message and obtain by internal memory
Arrive, make the order of object message row constant.
Preferably, before screening, first to the AIS messages in internal memory be filtrated to get the message of retention；Packet filtering
When, first generate object message character string；Each type of message of retention will be needed in object message character string, it is corresponding with one
Ascii character is represented；
The ID codes for representing its type of message are extracted to each AIS messages in internal memory again, can be with object message word by ID codes
The AIS messages that any one ascii character matches in symbol string are deposited in internal memory；Can not be with object message character string by ID codes
The AIS packet loss of middle ascii character matching.
Preferably, screening and binary system transcoding process are：
For the message each retained in internal memory, message total domain " x1 " domain of the message is first read, if " x1 " domain numerical value
Equal to 1, the message is infobit message, and the message directly is added into wall scroll message information set C；
If message total domain " x1 " domain numerical value is more than 1, the message is a plurality of infomational message, then basis should " x1 " domain
Numerical value extracts all sub- messages of this message, and all sub- messages of this message are converted into corresponding binary system respectively believes
Breath, is spliced in order, and the binary message message for splicing completion is added into binary message set B；
After the binary message for all messages retained in internal memory is converted, message information set judgement is carried out：If
Set C is sky, and set B is directly gathered into output as a result；If set C is not sky, parallel task is set up by set C
Infobit message is converted into corresponding binary message and obtains set A, merges binary message set A and binary message collection
B is closed, the result after merging is gathered into output as a result.
Preferably, binary system transcoding is to carry out character one by one to message information to extract, and is converted into string of binary characters；If turning
The string of binary characters changed is discontented 6, then mends 0 until filling 6 as splicing result in left side；If the binary-coded character of conversion
String is full 6, then directly as splicing result, then carries out the processing of successive character；Circulation is carried out until the processing completion of all characters,
Filler and time of fusion stamp information are supplemented splicing result.
Preferably, before binary system transcoding, all messages are verified, if verification by if extraction time stab information and
Filler information.
Preferably, after the binary system transcoding result for obtaining all messages, parallel iteration carries out binary decoded：First according to solution
Code work station CPU physical core calculation sets up the parallel binary decoding task of respective numbers, then by the binary system of all messages
Transcoding result is grouped and distributes to each binary decoded task, and each binary decoded task is carried out parallel, collects decoding knot
Really；Circulation is carried out, until all binary decoded tasks of distribution are fully completed.
Preferably, each binary decoded task process is：A binary message to be decoded is read, this is extracted and two enters
Preceding 6 place value of information processed, according to the processing function that the selection of 6 place values matches before the binary message, by two beyond first 6
Binary data sends into respective handling function, carries out function decoding, obtains decoded result.
Preferably, after the binary system transcoding result for obtaining all messages, according to decoding effort station CPU physical core calculation,
Set up the parallel binary decoding task of respective numbers, by the binary system transcoding result of all messages be grouped and distribute to each two
System decoding task, carries out parallel binary decoded process.
Preferably, the process of any one binary decoded task is：A binary message to be decoded is read, is extracted
Preceding 6 place value of the binary message, according to the processing function that the selection of 6 place values matches before the binary message, by preceding 6 place value
Binary data feeding respective handling function in addition, carries out function decoding, collects decoded result；Circulation is carried out until decoding is appointed
Business is fully completed.
Preferably, after the completion of all tasks of the binary decoded of any one message file, in the first memory simultaneously
Row preserves decoded result, while reading next message file in second memory.
Code system is efficiently solved present invention also offers a kind of watercraft AIS data high-volume, it is included：
Watercraft AIS message is collected by satellite or several bank base receiving stations, satellite or An Ji receiving stations；
The AIS messages that AIS storage servers, satellite or An Ji receiving stations collect, AIS packet storages are aggregated into by network
Server is stored；
Decoding effort station, decoding effort station is connected with AIS storage servers, and decoding effort station uses one kind described above
The efficient coding/decoding method of watercraft AIS data high-volume, is handled the AIS messages of storage；
AIS decoded result storage servers, are stored to the final decoded result that decoding effort station is obtained.
Compared with prior art, present invention has the advantages that：(1) it reads memory file using EMS memory mappings method, can
Reading speed is improved, more can guarantee that the AIS data messages row order for reading in decoding effort station internal memory keeps constant；(2) provide
The function of message is screened, the computation capability of computer multi-core CPU can be made full use of, according to correct standard to magnanimity AIS numbers
According to being decoded and higher decoding efficiency can be reached.
Brief description of the drawings
Fig. 1 AIS message format schematic diagrames；
AIS data message sequence diagrams common Fig. 2；
The AIS message datas of Fig. 3 solution code systems obtain, decode, preserve schematic diagram；
Fig. 4 parallel decoding overall work pattern diagrams；
The single message file decoding schematic flow sheets of Fig. 5；
Fig. 6 packet filtering schematic flow sheets；
Fig. 7 message filters and binary system transcoding schematic flow sheet；
Fig. 8 wall scroll message Binary Conversion schematic flow sheets；
Fig. 9 parallel binaries decoding task performs schematic flow sheet.
Embodiment
The invention provides a kind of efficient coding/decoding method of watercraft AIS data high-volume and system, to become apparent from the present invention
It is understandable, the present invention is described in further detail with embodiment below in conjunction with the accompanying drawings.
A kind of watercraft AIS data that the present invention is provided high-volume efficiently coding/decoding method and system, as shown in figure 3, satellite or
Several bank base receiving stations of person are collected into AIS messages and pass through the network storage to AIS storage servers, the report of AIS storage servers
Text is sent to decoding effort station and decoded.Efficiently coding/decoding method is first to a kind of watercraft AIS data high-volume that the present invention is provided
The message file that decoding effort station is received is read, is then decoded, finally preserves decoded result.Due to message file decoding
Process is time-consuming longer, and computer CPU occupancy ratio is higher, therefore using the overall work pattern of parallel decoding.
Fig. 4 is the overall work pattern diagram of parallel decoding, using EMS memory mappings method, first reads data file 1, so
Decoding data file 1 and parallel decoding afterwards.It is parallel to preserve under decoding data and reading after the completion of the decoding of previous file data
One file, to improve cpu busy percentage.Decoded result file is stored in different storage servers from data file to be decoded
On, to improve IO speed.
Because AIS messages file that size is 2GB or so is still than larger, then reading file can be carried using EMS memory mappings method
High reading speed.The mapping of whole file is directly set up in internal memory mapping when reading file, to ensure to read in decoding effort station internal memory
AIS messages row order keep constant.
Fig. 5 is single message file decoding schematic flow sheet, and single message file decoding process step is reading message, solution
Code and preservation decoded result.It is that object message file is read in into internal memory using EMS memory mappings method to read message process.Work as target
Message file is read in after system work station internal memory, starts decoding process.
Before screening, packet filtering is first carried out.Packet filtering is to obtain needs by generating object message character string
Type of message, and each type of message is represented with an ascii character during generation object message character string.After packet filtering,
Start message filter, all messages retained, message is classified by a plurality of infomational message and the class of infobit message two.
For a plurality of infomational message, the information of a plurality of message in object message is serially filtered out, serial task 1 is resettled
Carry out serial binary transcoding and merge message；And for infobit message, wall scroll message in object message is filtered out parallel
Information, resettles parallel task 2 and carries out binary system transcoding.All a plurality of infomational message and infobit messages in object message
Screening and transcoding process circulate and carry out according to above-mentioned steps, until the screening for all messages retained and binary system transcoding are appointed
Business is fully completed, and obtains final binary system transcoding result.
The binary system transcoding result of all messages is collected, parallel decoding task is set up and carries out message binary system solution
Code, until binary decoded task is fully completed.
After the completion of all tasks of binary decoded, set up parallel task and preserve result, while reading next message text
Part；A upper decoding file result is saved in memory, and new decoding effort proceeds, and circulation is carried out, until obtaining final
Watercraft AIS message decoded result file.
Except the screening of a plurality of message information and binary system in the data decoding process of single AIS messages file described in Fig. 5
Two steps of transcoding are serially run, and remaining decoding step is run parallel.
Fig. 6 is packet filtering schematic flow sheet, the efficient coding/decoding method of a kind of watercraft AIS data high-volume that the present invention is provided
In order to obtain retaining message, packet filtering is first carried out, i.e., the type of message that only decoding needs generates object message character string；Report
After text filtering, then carry out message filter.
Each type of message is represented with an ascii character, for example, need this seven kinds of decoding 1,2,3,5,18,19,24
Message information, that is, ignore other type message information, the target string Type_str of generation is " 1235BCH ", message and word
Accord with the table of comparisons as shown in table 1 below.
The type of message of table 1 and character reference table
| Type of message | Correspondence character | Type of message | Correspondence character | Type of message | Correspondence character |
| 1 | 1 | 10 | : | 19 | C |
| 2 | 2 | 11 | ； | 20 | D |
| 3 | 3 | 12 | < | 21 | E |
| 4 | 4 | 13 | = | 22 | F |
| 5 | 5 | 14 | > | 23 | G |
| 6 | 6 | 15 | 24 | H | |
| 7 | 7 | 16 | @ | 25 | I |
| 8 | 8 | 17 | A | 26 | J |
| 9 | 9 | 18 | B | 27 | K |
Generate after target string, the ID codes of the type of message in message are extracted by reading AIS messages, and (ID codes are shown in figure
In message format definition shown in 1 " N ").Extract after ID codes, judge to whether there is the ID codes in target string；If in the presence of that is,
This message is desirable, then retains message；If being not present, i.e., this message is unwanted, then dropping packets；To all reports
Text, which is circulated, to be handled, until all filtration duties are fully completed.
All messages of retention are obtained by packet filtering, according still further to a plurality of infomational message and the class of infobit message two
Screened, binary system transcoding is carried out after message filter.
Fig. 7 is message filter and binary system transcoding schematic flow sheet, takes a retention message, and the message for first reading message is total
Number field " x1 " domain, if " x1 " domain numerical value is equal to 1, the message is infobit message, and the message is added into wall scroll message information
Set C；If message total domain " x1 " domain numerical value is more than 1, the message is a plurality of infomational message, and this is extracted according to " x1 " thresholding
All sub- messages of this message are converted into corresponding binary message by all sub- messages in message respectively, in order according to
It is secondary to be spliced, the binary message message that splicing is completed is obtained, binary message set B is added.Message is retained for every to press
Circulate and carry out according to above-mentioned steps, until the task that all messages retained are converted into binary information is fully completed.
If set C is sky, set B is directly gathered into output as a result；If set C is not sky, parallel task is set up
Message in set C is converted into corresponding binary message, results set A is obtained.Finally by binary message set A and two
Binary information set B merges, and the result after merging is exported as final result set, so as to complete the sieve of all messages retained
Choosing and binary system transcoding task.
Fig. 8 is wall scroll message Binary Conversion schematic flow sheet, it is necessary to first to institute during every message progress Binary Conversion
The message for having retention is verified, and is passed through as verified, extraction time stamp information and filler information (information position such as Fig. 1
It is shown), then binary system transcoding processing is carried out to message.
, it is necessary to extract character one by one to message information during binary system transcoding, the ASCII character for extracting character is subtracted 48, if
As a result 8 are then subtracted again more than 40, reconvert is into string of binary characters.If the string of binary characters result of conversion is discontented 6, on a left side
0 is mended until filling 6 as splicing result in side；If the string of binary characters of conversion is full 6, directly as splicing result, then enter
The processing of row successive character.Each character is circulated according to above-mentioned steps to be carried out, until the processing of all characters is completed.Finally will splicing
As a result supplement filler and time of fusion stamp information, obtain final Binary Conversion information.
After all message binary system transcoding results for completing retention, parallel iteration carries out binary decoded, and Fig. 9 is parallel two
System decoding task performs schematic flow sheet.Parallel decoding task, task are set up according to decoding effort station CPU physical core calculation
Physical core calculation of the number equal to decoding effort station CPU；Then binary system transcoding result is grouped according to number of tasks and distributes each
Task, each task starts parallel decoding work, collects decoded result；Circulation is carried out, until all binary decodeds of distribution
Task is fully completed.Each the process of binary decoded task is：Each binary decoded task process is：One is read to wait to solve
The binary message of code, extracts preceding 6 place value of the binary message, is matched according to 6 place values selection before the binary message
Processing function, by beyond first 6 binary data send into respective handling function, carry out function decoding, obtain decoded result.
Wherein defined form of the decoding functions according to ITU-R M.1371 with IEC61162 is decoded.
After the decoding task of any one message file all terminates, the parallel preservation for carrying out decoding data and next text
The read work of part.All AIS messages files are circulated according to above-mentioned decoding process and carried out, and finally give watercraft AIS message solution
Code destination file.
A kind of efficient coding/decoding method of watercraft AIS data high-volume and system provided based on the present invention, the following provides AIS
Message data decoding test preferred exemplary.It is DELL WORKSTATION T7810 to test decoding effort station, and test data is AIS
65 East China Sea marine site watercraft AIS message data files during in the January, 2010 in March, 2010 that base station is collected, each
File averagely has 24180435 row AIS messages, and details see the table below 2.
The test of table 2 East China Sea marine site watercraft AIS data file information
The average test result of all test datas is as shown in table 3 below, 485469.4 rows of average reading per second AIS to be decoded
Message, 22300.67 row AIS messages of average decoding per second, 271780.8 row decoded results of average preservation per second.
The efficient coding/decoding method of the AIS data of table 3 high-volume and system test result
| Average reading per second | Average decoding per second | Average preservation decoded result per second |
| 485469.4 rows | 22300.67 rows | 271780.8 rows |
In decoding process, the row of average filtration 4650478.16 per second, per second averagely to screen 2973562.81 rows, message is per second
The average row of Binary Conversion 50662.74, the message average row of binary decoded 40729.9 per second, as shown in table 4.
4 key step operating efficiency average test results of the decoding process of table 4
| Average filtration per second | Average screening per second | Average conversion binary per second | Average binary decoded per second |
| 4650478.16 rows | 2973562.81 rows | 50662.74 rows | 40729.9 rows |
All test datas count each step process efficiency highest situation such as institute of table 5 in units of individual data file
Show, it is No. 44 files to read data most fast file, reading speed is 1188609.446 row per second；Completely decode fastest
Be No. 44 files, decoding speed is 32933.00488 row per second；It is No. 18 files, guarantor per second to preserve decoded result most fast
Deposit 1353476.695 rows；It is No. 54 files that filtering packets are most fast, the row of filtering packets 15596112.87 per second；Screen message most
Fast is No. 29 files, the row of screening 10753319.68 per second；Message conversion binary most fast file is No. 49, conversion per second
105492.1184 rows；Binary decoded is most No. 28 files soon, the row of decoding 60873.48984 per second.
Each job step average treatment efficiency highest statistics of the individual data file of table 5
| Affiliated file | Project | Data processing speed (lines per second) |
| 44 | It is most fast to read file | 1188609.446 |
| 44 | Most fast decoding message | 32933.00488 |
| 18 | It is most fast to preserve decoded result | 1353476.695 |
| 54 | Most fast filtering packets | 15596112.87 |
| 29 | Most fast screening message | 10753319.68 |
| 49 | Most fast message conversion binary | 105492.1184 |
| 28 | Most fast binary decoded | 60873.48984 |
Although present disclosure is discussed in detail by above preferred embodiment, but it should be appreciated that above-mentioned
Description is not considered as limitation of the present invention.After those skilled in the art have read the above, for the present invention's
A variety of modifications and substitutions all will be apparent.Therefore, protection scope of the present invention should be limited to the appended claims.
Claims (10)
1. a kind of efficient coding/decoding method of watercraft AIS data high-volume, it is characterised in that it is comprised the steps of：
The AIS messages retained in internal memory are screened, binary system transcoding and binary decoded；
By screening, by the message according to a plurality of infomational message and infobit message classification：
For a plurality of infomational message, the information of many strip messages in a plurality of infomational message is serially filtered out, it is serial to carry out
Binary system transcoding；For infobit message, the information of the infobit message is filtered out parallel, and the parallel binary system that carries out turns
Code；Processing is circulated to all messages of retention, until the screening of all messages and binary system transcoding are fully completed；
The binary system transcoding result of all messages is collected, binary decoded is carried out parallel, until binary decoded task
It is fully completed.
2. a kind of efficient coding/decoding method of watercraft AIS data high-volume according to claim 1, it is characterised in that in internal memory
AIS messages, be obtained from being mapped by internal memory the whole file of object message reading in internal memory, to make the suitable of object message row
Sequence is constant.
3. a kind of efficient coding/decoding method of watercraft AIS data high-volume according to claim 1 or 2, it is characterised in that in sieve
Before choosing, first to the AIS messages in internal memory be filtrated to get the message of retention；
During packet filtering, object message character string is first generated；Each message of retention will be needed in the object message character string
Type, is represented with a corresponding ascii character；
The ID codes for representing its type of message are extracted to each AIS messages in internal memory again, can be with object message character string by ID codes
In the AIS messages that match of any one ascii character be deposited in internal memory；By ID codes can not with object message character string
The AIS packet loss of ascii character matching.
4. a kind of efficient coding/decoding method of watercraft AIS data high-volume according to claim 1, it is characterised in that the sieve
Choosing and binary system transcoding process are：
For the message each retained in internal memory, message total domain " x1 " domain of the message is first read, if " x1 " domain numerical value is equal to
1, the message is infobit message, and the message directly is added into wall scroll message information set C；
If message total domain " x1 " domain numerical value is more than 1, the message is a plurality of infomational message, then basis should " x1 " domain numerical value
All sub- messages of this message are extracted, all sub- messages of this message are converted into corresponding binary message respectively, pressed
Order is spliced, and the binary message message for splicing completion is added into binary message set B；
After the binary message for all messages retained in internal memory is converted, message information set judgement is carried out：If set C
For sky, set B is directly gathered into output as a result；If set C is not sky, parallel task is set up by the wall scroll in set C
Infomational message is converted into corresponding binary message and obtains set A, merges binary message set A and binary message set B,
Result after merging is gathered into output as a result.
5. a kind of efficient coding/decoding method of watercraft AIS data high-volume according to claim 4, it is characterised in that described two
System transcoding is to carry out character one by one to message information to extract, and is converted into string of binary characters；If the string of binary characters of conversion
It is discontented 6, then 0 is mended until filling 6 as splicing result in left side；If the string of binary characters of conversion is full 6, directly make
For splicing result, then carry out the processing of successive character；Circulation until the processing of all characters is completed, splicing result supplement is filled out
Fill position and time of fusion stamp information.
6. the efficient coding/decoding method of a kind of watercraft AIS data high-volume according to claim 1 or 4, it is characterised in that two
Before system transcoding, all messages are verified, if verification, extraction time stabs information and filler information if.
7. a kind of efficient coding/decoding method of watercraft AIS data high-volume according to claim 4, it is characterised in that obtain institute
Have after the binary system transcoding result of message, parallel iteration carries out binary decoded：First according to decoding effort station CPU physical core
Number sets up the parallel binary decoding task of respective numbers, then the binary system transcoding result of all messages is grouped and distributed to each
Individual binary decoded task, carries out each binary decoded task, collects decoded result parallel；Circulation is carried out, until distribution
All binary decoded tasks are fully completed.
8. a kind of efficient coding/decoding method of watercraft AIS data high-volume according to claim 7, it is characterised in that described every
Individual binary decoded task process is：A binary message to be decoded is read, preceding 6 place value of the binary message is extracted,
According to the processing function that the selection of 6 place values matches before the binary message, the binary data beyond first 6 is sent into corresponding
Function is handled, function decoding is carried out, obtains decoded result.
9. the efficient coding/decoding method of a kind of watercraft AIS data high-volume according to claim 1 or 7, it is characterised in that any
It is parallel in the first memory to preserve decoded result after the completion of all tasks of the binary decoded of one message file, simultaneously
Next message file is read in second memory.
10. a kind of watercraft AIS data high-volume efficiently solves code system, it is characterised in that it is included：
Watercraft AIS message is collected by satellite or several bank base receiving stations, satellite or the An Ji receiving station；
AIS storage servers, the AIS messages that satellite or the An Ji receiving station collects, the AIS messages are aggregated into by network
Storage server is stored；
Decoding effort station, the decoding effort station is connected with AIS storage servers, and decoding effort station uses such as claim 1 ~ 8
The efficient coding/decoding method of watercraft AIS data high-volume described in any one, is handled the AIS messages of storage；
AIS decoded result storage servers, are stored to the final decoded result that the decoding effort station is obtained.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710287895.5A CN106953717B (en) | 2017-04-27 | 2017-04-27 | Method and system for efficiently decoding AIS (automatic identification System) data of ships in large batch |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710287895.5A CN106953717B (en) | 2017-04-27 | 2017-04-27 | Method and system for efficiently decoding AIS (automatic identification System) data of ships in large batch |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106953717A true CN106953717A (en) | 2017-07-14 |
| CN106953717B CN106953717B (en) | 2020-01-07 |
Family
ID=59476893
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710287895.5A Active CN106953717B (en) | 2017-04-27 | 2017-04-27 | Method and system for efficiently decoding AIS (automatic identification System) data of ships in large batch |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106953717B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110138416A (en) * | 2019-04-11 | 2019-08-16 | 上海卫星工程研究所 | The spaceborne wired multi-channel detection probabilistic testing method of AIS ship oceangoing ship |
| CN110392117A (en) * | 2019-08-06 | 2019-10-29 | 重庆大学 | A kind of method of multi-source AIS data deduplication fusion |
| CN113610347A (en) * | 2021-07-05 | 2021-11-05 | 上海海事大学 | Ship shipping market transport capacity assessment method |
| CN114285914A (en) * | 2021-10-19 | 2022-04-05 | 南方电网数字电网研究院有限公司 | Video data processing system, method and device based on electric power safety |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101584216A (en) * | 2006-12-27 | 2009-11-18 | 英特尔公司 | Methods and apparatus to decode and encode video information |
| CN103279462A (en) * | 2013-05-28 | 2013-09-04 | 浙江大学 | Data coding/ decoding method suitable for Bei Dou short message civil agreement |
| CN104486619A (en) * | 2009-10-23 | 2015-04-01 | 三星电子株式会社 | Method and apparatus for decoding video according to individual parsing or decoding in data unit level, and method and apparatus for encoding video for individual parsing or decoding in data unit level |
| CN104796156A (en) * | 2014-01-20 | 2015-07-22 | 联想(北京)有限公司 | LDPC (low density parity check) decoder and LDPC decoding method |
-
2017
- 2017-04-27 CN CN201710287895.5A patent/CN106953717B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101584216A (en) * | 2006-12-27 | 2009-11-18 | 英特尔公司 | Methods and apparatus to decode and encode video information |
| CN104486619A (en) * | 2009-10-23 | 2015-04-01 | 三星电子株式会社 | Method and apparatus for decoding video according to individual parsing or decoding in data unit level, and method and apparatus for encoding video for individual parsing or decoding in data unit level |
| CN103279462A (en) * | 2013-05-28 | 2013-09-04 | 浙江大学 | Data coding/ decoding method suitable for Bei Dou short message civil agreement |
| CN104796156A (en) * | 2014-01-20 | 2015-07-22 | 联想(北京)有限公司 | LDPC (low density parity check) decoder and LDPC decoding method |
Non-Patent Citations (1)
| Title |
|---|
| 莫红飞，张勇: ""AIS 数据解码分析"", 《计算机光盘软件与应用》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110138416A (en) * | 2019-04-11 | 2019-08-16 | 上海卫星工程研究所 | The spaceborne wired multi-channel detection probabilistic testing method of AIS ship oceangoing ship |
| CN110392117A (en) * | 2019-08-06 | 2019-10-29 | 重庆大学 | A kind of method of multi-source AIS data deduplication fusion |
| CN110392117B (en) * | 2019-08-06 | 2021-09-14 | 重庆大学 | Multi-source AIS data deduplication and fusion method |
| CN113610347A (en) * | 2021-07-05 | 2021-11-05 | 上海海事大学 | Ship shipping market transport capacity assessment method |
| CN113610347B (en) * | 2021-07-05 | 2024-04-05 | 上海海事大学 | Ship shipping market capacity assessment method |
| CN114285914A (en) * | 2021-10-19 | 2022-04-05 | 南方电网数字电网研究院有限公司 | Video data processing system, method and device based on electric power safety |
| CN114285914B (en) * | 2021-10-19 | 2023-10-20 | 南方电网数字电网研究院有限公司 | Video data processing system, method and device based on power safety |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106953717B (en) | 2020-01-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106953717A (en) | A kind of efficient coding/decoding method of watercraft AIS data high-volume and system | |
| Wich et al. | Distribution and conservation status of the orang-utan (Pongo spp.) on Borneo and Sumatra: how many remain? | |
| CN107241276A (en) | A kind of unified receiving handling method of many star telemetries | |
| CN103400173A (en) | Generating method and reading method of two-dimensional code containing private information | |
| CN101645069A (en) | Regular expression storage compacting method in multi-mode matching | |
| CN102592160A (en) | Character two-dimension code encoding and decoding method for short message | |
| CN111107107B (en) | Network behavior detection method and device, computer equipment and storage medium | |
| CN105447277A (en) | Isomorph identification method for complex-hinge-containing kinematic chains based on topological characteristic loop codes | |
| CN106971254A (en) | A kind of service monitoring system and method | |
| CN105657677A (en) | Short message sending method, short message gateway and service platform | |
| CN108055071B (en) | Cooperative protection method and device for data network and optical transmission network | |
| Charłampowicz | Maritime container terminal service quality in the face of COVID-19 outbreak | |
| CN105450359A (en) | Methods for sending and receiving user-defined binary structured protocol data | |
| CN107944525A (en) | A kind of method and system of the expansion Quick Response Code capacity based on data segmentation | |
| CN105808361A (en) | Parallel data processing method and system | |
| CN103902951B (en) | Electronic tag and the converting system and method for Logistic Unit bar code | |
| CN114996260B (en) | Method and device for cleaning AIS data, terminal equipment and storage medium | |
| CN109712181B (en) | Method for extracting open-circuit key area on integrated circuit layout line network | |
| CN110110805A (en) | A kind of dynamic two-dimension code recognition methods and equipment based on machine learning | |
| CN106533958B (en) | Data consistency checking method for heterogeneous system of cross-network isolation device | |
| CN102265266A (en) | Method and apparatus for coding data address | |
| CN115620325A (en) | Table structure restoration method and device, electronic equipment and storage medium | |
| Goldsman et al. | Simulation of transportation logistics | |
| CN103220274A (en) | Operator network outlet network message pattern matching method and system | |
| Zhang et al. | Efficient data hiding with histogram-preserving property |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |