CN114817328A - Water area data processing method, device and system - Google Patents

Water area data processing method, device and system Download PDF

Info

Publication number
CN114817328A
CN114817328A CN202210468481.3A CN202210468481A CN114817328A CN 114817328 A CN114817328 A CN 114817328A CN 202210468481 A CN202210468481 A CN 202210468481A CN 114817328 A CN114817328 A CN 114817328A
Authority
CN
China
Prior art keywords
data
longitude
ship
latitude
target user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210468481.3A
Other languages
Chinese (zh)
Inventor
徐运海
李春孝
朱浩文
高炜鑫
郑博洪
吴刘青
楼信谊
王飞
丁凤洋
李德鹏
朱浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Teligen Communication Technology Co ltd
Original Assignee
Guangzhou Teligen Communication Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Teligen Communication Technology Co ltd filed Critical Guangzhou Teligen Communication Technology Co ltd
Priority to CN202210468481.3A priority Critical patent/CN114817328A/en
Publication of CN114817328A publication Critical patent/CN114817328A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/90335Query processing
    • G06F16/90344Query processing by using string matching techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/906Clustering; Classification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses a water area data processing method, a device and a system, wherein the method comprises the following steps: acquiring a first identification code of a target user and a first longitude and latitude data set with a time sequence from operator data; in the information acquisition equipment, acquiring a second identification code of a target user and a second longitude and latitude point data set with a time sequence; based on the incidence relation between the first identification code and the second identification code, correcting the first longitude and latitude point data set by adopting a second longitude and latitude point data set to obtain a third longitude and latitude point data set; carrying out grid coding calculation on the third longitude and latitude point data set to obtain first grid data; acquiring second grid data of each ship in a preset channel basin range; and matching the first grid data in the second grid data of all ships, determining ship data in the water area data corresponding to the target user, reducing the error of water area data processing, improving the precision of water area data processing, and meeting the requirement of water area data processing.

Description

Water area data processing method, device and system
Technical Field
The invention relates to the technical field of water area safety control, in particular to a water area data processing method, device and system.
Background
In the channel field of complicacy, the waters area is broad, boats and ships track point and on-board personnel track point jump scope are wide, the orbit data of formation is discontinuous, especially in the waters environment, when the track point of the identification code based on the mobile terminal (like the cell-phone) that on-board personnel carried is as personnel track point, the condition that drifts on a large scale can appear in the identification code, the orbit that leads to forming appears discontinuously, the unsmooth condition, lead to when the waters data processing to above-mentioned boats and ships data and personnel data, can produce very big error, data processing's effect is very unsatisfactory, be difficult to satisfy the requirement of managing waters data.
Disclosure of Invention
The invention provides a water area data processing method, a water area data processing device and a water area data processing system, which can reduce the error of water area data processing and improve the precision of water area data processing so as to meet the requirement of water area data management.
The water area data processing method provided by the invention comprises the following steps:
acquiring a first identification code of a target user and a first longitude and latitude data set with a time sequence from operator data;
in the information acquisition equipment, acquiring a second identification code of the target user and a second longitude and latitude point data set with a time sequence;
based on the incidence relation between the first identification code and the second identification code, correcting the first longitude and latitude point data set by adopting a second longitude and latitude point data set to obtain a third longitude and latitude point data set;
carrying out grid coding calculation on the third longitude and latitude point data set to obtain first grid data;
acquiring second grid data of each ship in a preset channel basin range;
and matching the first grid data in the second grid data of all ships, and determining ship data in the water area data corresponding to the target user.
Optionally, the obtaining, in the operator data, the first identification code of the target user and the first longitude-latitude data set with time sequence includes:
screening out target operator data in the preset channel basin range from the operator data;
acquiring the equipment identification code and longitude and latitude data of the mobile terminal carried by each user in a preset time period from the target operator data;
judging whether the ratio of the number of longitude and latitude points falling into the range of a preset channel basin to the total number of longitude and latitude points in the longitude and latitude point data meets the preset ratio requirement, if so, identifying the user corresponding to the equipment identification code as a target user;
and acquiring a first identification code of the target user and a first longitude point data set with a time sequence.
Optionally, the performing, based on the association relationship between the first identification code and the second identification code, a correction operation on the first longitude and latitude point data set by using a second longitude and latitude point data set to obtain a third longitude and latitude point data set includes:
based on the incidence relation between the first identification code and the second identification code, correcting the first longitude and latitude point data set by adopting a second longitude and latitude point data set to obtain a fourth longitude and latitude point data set;
and performing outlier rejection operation on the fourth longitude and latitude point data set according to the running speed and the running distance of the ship to obtain a third longitude and latitude point data set.
Optionally, the performing outlier rejection operation on the fourth longitude and latitude point data set according to the running speed and the running distance of the ship to obtain a third longitude and latitude point data set includes:
performing outlier rejection operation on the fourth longitude and latitude point data set according to the running speed and the running distance of the ship to obtain a fifth longitude and latitude point data set;
and performing point supplementing operation on the missing longitude and latitude points in the fifth longitude and latitude point data set according to the running time and the running distance of the ship to obtain a third longitude and latitude point data set.
Optionally, the matching the first grid data in the second grid data of all ships to determine the target ship to which the target user belongs includes:
respectively carrying out grid collision operation on the first grid data of each target user and the second grid data of all ships, and determining a ship with the same grid tendency as the target user;
calculating the track similarity of the target user and each inclined ship;
and comparing the track similarity with a preset similarity threshold, and determining ship data in the water area data corresponding to the target user according to a comparison result.
Optionally, the method further comprises:
associating the second identification code of the target user, the number of the information acquisition equipment and the acquisition time to obtain an association relation pair;
and carrying out cluster analysis on the incidence relation pairs of all the target users to determine the peer personnel data of each target user.
Optionally, the method further comprises:
when a specified user is determined from the data acquired by the information acquisition equipment, generating first abnormal alarm information;
and when the specified user enters the first specified position area, generating second abnormal alarm information.
Optionally, the method further comprises:
and generating third abnormal warning information when the ship is in a second appointed position area.
The present invention also provides a water area data processing apparatus, comprising:
the first acquisition module is used for acquiring a first identification code of a target user and a first longitude and latitude data set with a time sequence from operator data;
the second acquisition module is used for acquiring a second identification code of the target user and a second longitude and latitude point data set with a time sequence in the information acquisition equipment;
the correction module is used for performing correction operation on the first longitude and latitude point data set by adopting a second longitude and latitude point data set based on the incidence relation between the first identification code and the second identification code to obtain a third longitude and latitude point data set;
the calculation module is used for carrying out grid coding calculation on the third longitude and latitude point data set to obtain first grid data;
the third acquisition module is used for acquiring second grid data of each ship in the preset channel basin range;
and the matching module is used for matching the first grid data in the second grid data of all ships and determining ship data in the water area data corresponding to the target user.
The invention also provides a water area data processing system, which comprises the device as described above, and further comprises:
the information acquisition equipment is used for acquiring a second identification code of the target user and a second longitude and latitude point data set with a time sequence;
the boundary equipment is used for synchronizing all data accessed into the system after safety boundary ferrying is carried out on all data;
the ship information statistics module is used for counting ship information in a preset channel flow domain according to the accessed AIS data;
the alarm module is used for releasing abnormal alarm information when an abnormal event is monitored;
the display module is used for displaying the advancing state information of the ship in real time;
a personnel data query module for responding the received query instruction and querying the target user data and the ship data corresponding to the target user in the water area data
According to the technical scheme, the invention has the following advantages:
according to the method and the device, the second identification code of the target user and the second longitude and latitude data set with time sequence are obtained from the information acquisition equipment, then the second longitude and latitude data set is adopted to carry out correction operation on the first longitude and latitude data based on the incidence relation between the first identification code and the second identification code, and the third longitude and latitude data set is obtained, so that the reliability of the longitude and latitude data of the target user is greatly improved, data errors caused by overlarge track point jumping range and discontinuous and unsmooth track of complex personnel due to a water area environment are reduced, and the accuracy of water area data processing is improved. And then, calculating the grid codes of the third longitude and latitude point data set to obtain first grid data, matching the first grid data in the second grid data of all ships, and determining ship data in the water area data corresponding to the target user, so that ship-associated personnel on each ship can be accurately determined. The invention integrally reduces the errors of the personnel track data and the ship track data in the water area data, greatly improves the precision and the processing efficiency of the water area data processing, and meets the management requirement of the water area data.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a flowchart illustrating steps of a method for processing water area data according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a water area data processing method according to a second embodiment of the present invention;
fig. 3 is a block diagram of a water area data processing apparatus according to a third embodiment of the present invention;
fig. 4 is a block diagram of a water area data processing system according to a fourth embodiment of the present invention.
Detailed Description
In view of this, embodiments of the present invention provide a method, an apparatus, and a system for processing water area data, which reduce errors in processing water area data, improve accuracy of processing water area data, and meet requirements of processing water area data.
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Before the implementation of the present invention, in order to implement the processing and management of water area data, the water area data is previously accessed into the system, and in order to ensure the security of system data, measures such as network encryption are generally performed on a system platform.
Specifically, the data access process includes: (1) and accessing AIS data from the ship communication network, forming a corresponding data file, and synchronizing the data file to the system in a database synchronization mode through the safe ferry of the boundary equipment.
(2) The method comprises the steps of transmitting user information data acquired by information acquisition equipment back to an information database, and synchronizing the data in the information database to a system in a database synchronization mode through safety boundary ferry, wherein the data in the information database comprise user information, information acquisition equipment numbers and the incidence relation between the information acquisition equipment numbers and the user information, and the user information data comprise international mobile subscriber identification codes (IMSIs) of mobile terminals carried by users, longitude and latitude point data of the IMSIs and the like. The information acquisition equipment is provided with equipment for providing network service for personnel on the ship and having an information acquisition function, and can be understood that the information acquisition equipment can be formed by connecting various single-function equipment, and when a mobile terminal carried by a target user is connected with the information acquisition equipment, the information acquisition equipment records the access time and position and disconnection time and position of the mobile terminal carried by the target user.
(3) User data are acquired from an operator base station, and are synchronized to a system in a database synchronization mode through safety boundary ferry, wherein the user data comprise an equipment identification code IMEI of a mobile terminal carried by a user and longitude and latitude data of the IMEI. It can be understood that the system will perform corresponding data cleaning on the accessed data and complement the missing data information.
It should be noted that the present invention is applied to the field of social public security management and control, and is implemented under the permission of a corresponding security management department (such as a public security department), and the above information acquisition or the obtained operator data are obtained legally.
The first embodiment is as follows:
referring to fig. 1, fig. 1 is a water area data processing method according to an embodiment of the present invention, including:
step 101, acquiring a first identification code of a target user and a first longitude and latitude data set with a time sequence from operator data.
It should be noted that the target user is a user staying within the preset channel basin range for a long time. In the step, the first identification code of the target user is the equipment identification code IMEI of the mobile terminal carried by the target user, longitude and latitude point data of the equipment identification code IMEI of the mobile terminal carried by the target user is obtained, the longitude and latitude point data is not null, and the longitude and latitude point data is sequenced according to the time sequence to obtain a first longitude and latitude point data set with a time sequence.
And 102, acquiring a second identification code of the target user and a second longitude and latitude point data set with a time sequence in the information acquisition equipment.
It should be noted that the second identification code information is an IMSI number, and the second longitude and latitude point data set is a longitude and latitude point data set with a time sequence of the IMSI number. The information acquisition equipment acquires the IMSI code of the mobile terminal carried by each target user and the longitude and latitude data set of the IMSI code with time sequence.
And 103, based on the association relationship between the first identification code and the second identification code, correcting the first longitude and latitude point data set by adopting the second longitude and latitude point data set to obtain a third longitude and latitude point data set.
In this embodiment, the longitude and latitude point data of the IMSI is combined to correct the first longitude and latitude point data set of the IMEI, so that the accuracy of the track of the target user is further improved, and the track points of the target user are smoother and more continuous.
And 104, carrying out grid coding calculation on the third longitude and latitude point data set to obtain first grid data.
It should be noted that, the longitude and latitude point data in the third longitude and latitude point data set are subjected to geographic grid coding to obtain the first grid data including time, geographic environment and position, so that the first grid data has the properties of time dimension and space dimension, and the position of the target user can be better fed back.
And 105, acquiring second grid data of each ship in the preset channel basin range.
In this embodiment, the preset channel watershed range may be selected according to actual situations, and may be a complete channel watershed, such as a Yangtze river watershed, or a part of the channel watershed, such as an upstream area of the Yangtze river watershed, or the like. In this embodiment, the longitude and latitude point data of each ship at different times within the preset channel basin range is screened out from the accessed AIS data, and then the grid codes of the longitude and latitude point data of each ship are respectively calculated to obtain the second grid data of each ship. In the present embodiment, the second mesh data covers both the time dimension and the space dimension. Wherein the length of the grid may be a six-level grid.
Further, the AIS data records a ship ID of each ship, the ship ID being a unique identification code of the ship, and information for identifying the ship is available by the ship ID. Therefore, when historical grid data of a certain ship needs to be inquired, inquiry can be carried out by inputting the ship ID into the system.
And 106, matching the first grid data in the second grid data of all ships, and determining ship data in the water area data corresponding to the target user.
In this embodiment, the first grid data of each target user and the second grid data of all ships are subjected to grid collision, and according to a collision result, ship data in the water area data corresponding to the target user is determined.
Specifically, the number of the same grids between the first grid data and the second grid data is determined according to a collision result, ship data corresponding to a target user is screened out from all ship data in the water area data based on the size quantity relation of the number of the same grids, then, the track similarity of the target user and each ship in the ship data is calculated, the target ship to which the target user belongs is determined according to the track similarity and a preset similarity threshold value, and personnel on the ship are accurately determined, so that the management of the ship and the personnel on the ship is realized, the processing precision and the processing efficiency of the water area data are improved, and the management requirement on the water area data is met.
It can be understood that the longitude and latitude point data of the target user at different moments are recorded in the first grid data, the longitude and latitude point data are sorted and deduplicated according to the time sequence, the track of the target user can be obtained, and the track determination method of the ship is similar.
In the embodiment of the invention, the second identification code of the target user and the second longitude and latitude point data set with time sequence are acquired from the information acquisition equipment, and then the second longitude and latitude point data set is adopted to carry out correction operation on the first longitude and latitude point data based on the incidence relation between the first identification code and the second identification code to obtain the third longitude and latitude point data set, so that the reliability of the longitude and latitude point data of the target user is greatly improved, the data errors caused by overlarge track point jumping range and discontinuous and unsmooth track of complex personnel due to the water area environment are reduced, and the accuracy of water area data processing is improved. And then, calculating the grid codes of the third longitude and latitude point data set to obtain first grid data, matching the first grid data in the second grid data of all ships, and determining ship data in the water area data corresponding to the target user, so that ship-associated personnel on each ship can be accurately determined. The embodiment integrally reduces errors of the trajectory data of the personnel and the trajectory data of the ship in the water area data, greatly improves the precision and the processing efficiency of the water area data processing, and meets the management requirement of the water area data.
Example two:
referring to fig. 2, fig. 2 is a water area data processing method according to a second embodiment of the present invention, including:
step 201, in the operator data, a first identification code of a target user and a first longitude and latitude data set with a time sequence are obtained.
It should be noted that, in the case that step 210 is consistent with step 101, step 201 includes the following sub-steps:
s21: and screening target operator data in a preset channel basin range from the operator data.
It should be noted that, in this embodiment, because the operator data accessed in the system may be data of one city or data of a certain area in the city, the data is relatively complicated and the data size is relatively large, and in order to reduce consumption of analysis resources, this step is to screen out target operator data within a preset channel basin range from the accessed operator data.
Specifically, because the drive test data can have relevance with the base station data, the target operator data in the preset channel basin range can be screened out from the operator data by adopting the drive test data acquired by the drive test equipment near the preset channel basin, so that the operator data are preliminarily filtered, the waste of computing resources is reduced, and the processing efficiency of the water area data is further improved.
S22: and acquiring the equipment identification code and longitude and latitude data of the mobile terminal carried by each user in a preset time period from the target operator data.
In this embodiment, the equipment identification code IMEI of the mobile terminal carried by each user and the longitude and latitude data of the equipment identification code IMEI are acquired, where the preset time period may be determined according to actual conditions, and in this embodiment, the preset time period is one day.
S23: and judging whether the proportion of the number of the longitude and latitude points falling into the range of the preset channel basin to the total number of the longitude and latitude points meets the preset proportion requirement or not in the longitude and latitude point data, and if so, identifying the user corresponding to the equipment identification code as the target user.
It should be noted that in reality there is a special case: the IMEI is a device identification code which is used for identifying the IMEI in the water area, and the IMEI is a device identification code which is used for identifying the IMEI in the water area, wherein the IMEI is a device identification code which is used for identifying the IMEI in the water area, and the IMEI is a device identification code which is used for identifying the IMEI in the water area.
In order to avoid the error problem caused by the special condition, in the longitude and latitude point data of each user collected in one day, screening the users by judging whether the proportion of the number of the longitude and latitude points falling into the range of the preset channel basin to the total number of the longitude and latitude points meets the preset proportion requirement, and when the proportion of the number of the longitude and latitude points falling into the range of the preset channel basin to the total number of the longitude and latitude points does not meet the preset proportion requirement, showing that most of the longitude and latitude point data of the user are not in the range of the preset channel basin, namely, the special condition occurs.
It should be noted that, the applicant summarizes through actual data sampling and experiments that when the preset time period is one day, the preset proportion requirement is 70%, and the obtained data accuracy of the target user is higher, that is, the error of the water area data is smaller, so that the precision of water area data processing is greatly improved.
S24: the method comprises the steps of obtaining a first identification code of a target user and a first longitude point data set with a time sequence.
It should be noted that step 101 may be referred to as S24, and details are not repeated here.
Step 202, in the information acquisition device, a second identification code of the target user and a second longitude and latitude point data set with a time sequence are obtained.
It should be noted that step 202 may refer to step 102, and is not described herein again.
And 203, based on the association relationship between the first identification code and the second identification code, correcting the first longitude and latitude point data set by using the second longitude and latitude point data set to obtain a fourth longitude and latitude point data set.
It should be noted that the association relationship between the first identification code and the second identification code may be calculated and analyzed in advance, the association relationship is stored in the database, and the association relationship is called from the database when in use, so that the first identification code may be determined based on the second identification code data of the target user, and the first longitude and latitude point data set of the first identification code is corrected based on the second longitude and latitude point data set of the second identification code, so as to obtain the fourth longitude and latitude point data set.
In this embodiment, the longitude and latitude point data of the IMSI is combined to correct the first longitude and latitude point data set of the IMEI, so that the accuracy of the track of the target user is further improved, and the track points of the target user are smoother and more continuous.
And 204, performing outlier rejection operation on the fourth longitude and latitude point data set according to the running speed and the running distance of the ship to obtain a fifth longitude and latitude point data set.
In this embodiment, data cleaning needs to be performed on the fourth longitude and latitude point data set obtained after the correction operation is completed, and abnormal data is eliminated, so that a more accurate fifth longitude and latitude point data set is obtained. And eliminating longitude and latitude points which do not meet the requirements of the running speed and the running distance in the fifth longitude and latitude point data set by combining the running speed and the running distance of the ship.
It can be understood that the moving speed and the moving distance of the target user can be calculated according to the longitude and latitude point data at different moments, if the target user is located on a ship, the moving speed and the moving distance should meet the requirement of the running speed and the running distance of the ship, and based on the requirement, abnormal data in the second longitude and latitude point data set can be cleared, so that the accuracy of the track of the target user is further improved.
The driving speed requirement and the driving distance requirement of the ship can be obtained by sampling and calculating based on AIS data of the ship. Speed threshold range of travel speed requirement: 20-35km/h, threshold range required by driving distance: greater than or equal to 10 km.
And when the moving speed of the longitude and latitude point of the target user is calculated to be less than 20km/h or more than 35km/h, the longitude and latitude point is indicated as an outlier. And when the moving distance of the longitude and latitude point of the target user is calculated to be less than 10km, the longitude and latitude point is indicated as an outlier. More accurate longitude and latitude point data are obtained by eliminating longitude and latitude points which do not accord with the requirements of the running speed and the running distance.
And step 205, performing point supplementing operation on the missing longitude and latitude points in the fifth longitude and latitude point data set according to the running time and the running distance of the ship to obtain a third longitude and latitude point data set.
In this embodiment, a point supplementing operation is performed on the missing longitude and latitude points in the fifth longitude and latitude point data set according to the travel time and the travel distance of the ship to obtain a third longitude and latitude point data set, so that the reliability of the longitude and latitude point data of the target user is further improved.
In this embodiment, after the correction operation, the outlier rejection operation, and the point-supplementing operation are performed, the reliability of the longitude and latitude point data of the target user is greatly improved, so that the accuracy of determining the ship data corresponding to the target user is further improved, and the accuracy of processing the water area data is improved.
And step 206, carrying out grid coding calculation on the third longitude and latitude point data set to obtain first grid data.
Step 104 can be referred to in this step, and is not described herein again.
Step 207, acquiring second grid data of each ship within the preset channel basin range.
It should be noted that, the step 105 may be referred to in this step, and details are not repeated here.
And step 208, matching the first grid data in the second grid data of all ships, and determining ship data in the water area data corresponding to the target user.
It should be noted that step 208 includes the following sub-steps:
s31: and respectively carrying out grid collision operation on the first grid data of each target user and the second grid data of all ships, and determining the ships with the same grid tendency as the target users.
In this embodiment, after the grid collision operation is performed, the number of the first grid data and the second grid data having the same grid is determined, that is, the number of the target users and the number of the ships having the same grid can be determined, all the ships are sorted according to the descending order based on the number of the same grid, then the ships with the preset number are selected as the inclined ships, and the inclined ships are respectively associated with the target users. The preset number can be determined according to actual needs, and in this embodiment, the preset number is the first 10, for example, the target user a associates the inclined ship 1, the inclined ship 2, … …, and the inclined ship 10. The target user A is associated with the inclined ship 1 as a relation pair a, the target user A is associated with the inclined ship 1 as a relation pair b, and so on.
S32: and calculating the track similarity of the target user and each inclined ship.
In this embodiment, the track relationship between the target user and each inclined ship is calculated, and referring to the foregoing example, the track similarity between the relationship pair a, the track similarity between the relationship pair b, and the like are calculated.
S33: and comparing the track similarity with a preset similarity threshold, and determining ship data in the water area data corresponding to the target user according to the comparison result.
In this embodiment, the track similarity and a preset similarity threshold are obtained through comparison and calculation, if the track similarity is greater than or equal to the preset similarity threshold, the relationship pair is retained, then the track similarities of each group of relationship pairs are compared, and the inclined ship in the relationship pair with the highest similarity is selected as the target ship to which the target user belongs, that is, the ship data corresponding to the target user is determined. Referring to the example of the previous step, if the track similarity of the relationship pair a and the track similarity of the relationship pair b are both greater than the preset similarity threshold, the relationship pair a and the relationship pair b are retained, then the track similarity between the relationship pair a and the relationship pair b is compared, and if the track similarity of the relationship pair a is greater than the relationship pair b, the target ship is an inclined ship 1, that is, the ship on which the target user a sits is a ship 1, and the target user a is a ship-associated person of the ship 1.
The water area data processing method provided by the embodiment of the invention further comprises the following steps:
step 209, associating the second identification code of the target user, the information acquisition equipment and the acquisition time to obtain an association relationship pair; the information acquisition equipment is used for acquiring the second identification code.
It should be noted that, in this step, the IMSI number and the number of the information acquisition device are associated to form a relationship pair of time-information acquisition device number-IMSI number. Specifically, IMSI code data collected by the same information collection device at the same time in the information database are correlated to form a time-information collection device number-IMSI code relationship pair.
And step 210, performing cluster analysis on the incidence relation pairs of all the target users to determine the peer personnel data of each target user.
And performing merging and clustering analysis on all the relation pairs of time-information acquisition equipment number-IMSI code, determining the association relation between the IMSI code and the IMSI code, namely determining an IMSI code data set acquired by the same information acquisition equipment at the same time through a clustering result, determining a common moving track between a target user and the target user by analyzing and comparing longitude and latitude point data corresponding to each IMSI code in the IMSI code data set, and determining the peer personnel data of the target user based on the common moving track. It is to be understood that the peer of the target user is not limited to 1 person.
Further, based on this embodiment, the ship data corresponding to the target user obtained in the foregoing step may be further verified, for example, it is obtained through step 208 that the target user a and the target user B are both in the target ship C, and then the target user a and the target user B are mutually the same-person (the target user B is the same-person of the target user a, and the target user a is the same-person of the target user B), on this basis, if the target user B exists in the same-person of the target user a calculated in step 210, it is proved that the determination result that the target user a and the target user B are both in the target ship C obtained in step 209 is relatively accurate, and if the target user B does not exist, it is indicated that the calculation and the matching are required again.
In the embodiment, the second identification code of the target user, the information acquisition equipment and the acquisition time are associated to obtain an association relationship pair, all the association relationship pairs are subjected to cluster analysis to determine the peer personnel data of the target user, and the ship data corresponding to the target user is further verified based on the peer personnel data of the target user, so that the processing precision of the water area data is greatly improved.
Further, the water area data processing method provided by the invention further comprises the following steps:
after determining the peer personnel of the target user, generating a target user and peer personnel relation table.
It should be noted that, in this embodiment, data management and user query are facilitated through the target user and peer personnel relationship table. As a further improvement, after the fellow staff corresponding to the target user is determined, the specific staff may be matched based on the association relationship between the second identification code IMSI of the fellow staff and the equipment identification code IMEI in combination with the corresponding real-name data, and the specific staff list is recorded in the database for the security management and control department to query.
Further, the water area data processing method provided by the invention further comprises the following steps:
and after target ships corresponding to all target users are determined, generating a relation table of the ships and ship-associated personnel.
It should be noted that after determining the ship-associated person, a relation table containing ship information and the ship-associated person is automatically generated, and in the process of query, ship information such as a ship ID or a ship MMSI code, which can represent the identity of a ship, is input, that is, a list of the ship-associated person corresponding to the ship can be output.
It should be noted that the ship-to-ship personnel relationship table is partitioned according to the day, and the data of the ship and the ship-to-ship personnel counted every day are stored in different partitions according to different time. And then performing calculation analysis on the daily incremental data of the ship and the ship-associated personnel, and storing the analysis result in the subareas according to time to form a result daily table. As a further improvement, the data of the result calendar are subjected to aggregation cumulative statistics according to preset conditions, different index dimensions such as daily statistics or counting times are formed, and the reliability of the data is further improved.
Further, another embodiment of the present invention provides a method for processing water area data, further including:
when a specified user is determined from data collected by the information collecting device, first abnormal warning information is generated.
It should be noted that the embodiment of the present invention may be applied to the field of social public security, where the designated user may be a user that is focused by a security management and control department (such as a public security department), and when it is determined that IMSI code data corresponding to the designated user exists in data acquired by the information acquisition device, first abnormal alarm information is generated, and then the alarm information is pushed to a corresponding management department in time.
And when the appointed user enters the first appointed position area, generating second abnormal alarm information.
It should be noted that the position of the designated user is determined according to the longitude and latitude point data of the designated user, whether the position of the designated user is the first designated position is judged, and if yes, the first abnormal warning information is generated.
In this embodiment, the first designated location includes an anchor area and a preset channel area.
And generating third abnormal warning information when the ship is in the second appointed position area.
In the present embodiment, in order to better manage the ship, when it is determined that the ship is located in the second designated position area, the third warning information is generated and displayed in time. The second designated position may be designated by a security manager, and in this embodiment, the second designated position includes a preset channel area and a no-stop area. Specifically, the third unusual warning information is generated when it is determined that the ship enters the preset channel area or when it is determined that the ship stops to the no-stop area.
Further, when the ship is judged to have abnormal stopping behavior, fourth abnormal alarm information is generated.
It should be noted that, in this embodiment, the longitude and latitude point data of the traveling track of the ship is counted and updated in real time, and when it is monitored that the longitude and latitude point data of the ship does not conform to the longitude and latitude point data of the preset track, it is indicated that the ship has an abnormal stopping behavior, and fourth abnormal warning information is generated.
In the embodiment of the invention, the second identification code of the target user and the second longitude and latitude data set with time sequence are acquired from the information acquisition equipment, then the second longitude and latitude data set is adopted to carry out correction operation on the first longitude and latitude data based on the incidence relation of the first identification code and the second identification code to obtain the fourth longitude and latitude data set, so that the reliability of the longitude and latitude data of the target user is greatly improved, data errors caused by complicated water area environment, overlarge personnel track point jumping range and discontinuous and unsmooth track are reduced, the precision of water area data processing is improved, then the departure point removing operation and the point supplementing operation are carried out on the fourth longitude and latitude data set in combination with the driving characteristics of a ship, the longitude and latitude data of the target user are further improved, the track points of the target user are obtained subsequently more complete and smooth, and the third longitude and latitude data set obtained at the moment can well, And accurately feeding back the real position change condition of the target user in the navigation field, then calculating the grid code of the third longitude and latitude point data set to obtain first grid data, matching the first grid data in the second grid data of all the ships, determining ship data of the target user in the corresponding water area data, and accurately determining ship-associated personnel data on each ship based on the ship data. The method and the device greatly improve the accuracy of determining ship-associated personnel on the whole, improve the processing precision and the processing efficiency of water area data processing, reduce errors of personnel track data and ship track data in the water area data, reduce the error condition of the ship-associated personnel in the field of determining complex navigation channels, and achieve the technical effect of accurately determining the ship-associated personnel. Moreover, multiple tests of the applicant prove that the accuracy of the personnel along with the ship can reach more than 95%.
Example three:
referring to fig. 3, fig. 3 is a water area data processing apparatus according to a fourth embodiment of the present invention, including:
a first obtaining module 301, configured to obtain, in operator data, a first identification code of a target user and a first longitude and latitude data set with a time sequence;
a second obtaining module 302, configured to obtain, in the information acquisition device, a second identification code of the target user and a second longitude and latitude point data set with a time sequence;
the correcting module 303 is configured to perform a correcting operation on the first longitude and latitude point data set by using the second longitude and latitude point data set based on the association relationship between the first identification code and the second identification code to obtain a third longitude and latitude point data set;
a calculating module 304, configured to perform mesh coding calculation on the third longitude and latitude point data set to obtain first mesh data;
a third obtaining module 305, configured to obtain second grid data of each ship located in a preset channel basin range;
and the matching module 306 is configured to match the first grid data in the second grid data of all the ships, and determine ship data in the water area data corresponding to the target user.
Referring to fig. 4, fig. 4 is a water area data processing system according to a fourth embodiment of the present invention, which includes the water area data processing apparatus as described above, and the system further includes:
and the information acquisition device 401 is configured to acquire a second identification code of the target user and a second longitude and latitude data set with a time sequence.
And the boundary device 402 is configured to synchronize all data in the system after performing security boundary ferry on all data in the access system.
It should be noted that the border device 402 performs security border ferry on all data of the access system, where all data includes: the basic data comprises AIS data, data in an information database and operator base station data.
And a ship information statistics module 403, configured to count ship information located in a preset channel flow domain according to the accessed AIS data.
It should be noted that the ship information includes latest ship advance state information, ship-associated personnel data, ship track data, ship berthing position data, ship type, ship MMSI code, first occurrence time, last occurrence time, and the like. And then, constructing a ship file according to the ship information, and when the ship file is established, establishing the ship file in a 'one ship one file' mode. And after ship information generated every day in a preset channel basin is counted, merging the ship information with historical ship information, and then storing merged ship information data into a business system database.
And an alarm module 404, configured to issue an abnormal alarm message when an abnormal event is detected.
It should be noted that the alarm module 404 is configured to generate first abnormal alarm information when a specified user is determined from the data collected by the information collection device 401, generate second abnormal alarm information when the specified user enters a first specified location area, and generate third abnormal alarm information when the ship is in a second specified location area. And the system is also used for generating fourth abnormal alarm information when judging that the ship has abnormal stopping behavior.
And the display module 405 is used for displaying the advancing state information of the ship in real time.
It should be noted that the display module 405 is configured to perform classification statistics according to different ship types, perform real-time statistics and display a ship track and a latest position within a preset channel range, and dynamically display a ship advancing condition.
The display module 405 is further configured to perform individual statistics on ship conditions in the special area, where the ship conditions include ship stop conditions and stop information; the special area includes an anchor area, wherein data of the anchor area is pre-configured.
The display module 405 is further configured to retrieve track data of the ship according to the ship identification code MMSI and a preset time range to perform visual display. For example, historical track data of a ship may be displayed and dynamically displayed on a map.
And the personnel data query module 406 is configured to respond to the received query instruction and query the target user data in the water area data and the ship data corresponding to the target user.
It should be noted that the personnel data query module 406 is configured to, when receiving a query instruction of a security manager, analyze the query instruction, and invoke data corresponding to the query instruction to perform visual display.
Wherein, the personnel data query module 406 includes:
the first query module is used for responding to a query instruction, querying and displaying ship data corresponding to the target user, querying ship data corresponding to the target user every day based on the ship data corresponding to the target user, and displaying a ship track in the ship data and a moving track of the target user on a map according to the ship data corresponding to the target user every day.
Specifically, the first query module is configured to, when receiving one or more of a query instruction including an equipment identification code IMEI of a target user, a ship identification code MMIS, and a preset time range, invoke target user data within the preset time range and ship data corresponding to the target user to perform visual display, where the visual display mode may be displayable in forms such as a table, a map display, and the like. The target user data comprises longitude and latitude data. The ship data includes ship ID, MMIS information, and the like. The preset time range may be one day or one month, and the like, and may be determined according to actual needs.
In the visual display result, the accumulated ship data, the ship track data and the personnel track data corresponding to the equipment identification code IMEI of the target user can be checked.
And the second query module is used for calling out target data successfully matched with the query information from the information database for visual display according to the received query information. The query information comprises one or more items of equipment identification code IMEI, mobile subscriber identification code IMSI, information acquisition equipment number and preset time range.
It should be noted that, in the second query module, the corresponding target data may be queried in the information database through the equipment identification code IMEI, the mobile subscriber identification code IMSI, the information acquisition equipment number, and the key information in the preset time range. For example, when query information is received as the equipment identification code IMEI, data matching is performed in the information database, if the same equipment identification code IMEI is matched, the equipment identification code is shown to be in a preset channel flow domain, at this time, keywords in a preset time range can be continuously added, and the time when the equipment identification code appears can be queried. Therefore, in the embodiment, the appearance condition of the user identification code in the preset channel flow domain can be determined through the keyword query.
And the third query module is used for querying the peer personnel data of the target user according to the target user information.
It should be noted that, the third query module queries the peer personnel data of the target user according to the received target user information (such as the IMEI code or the IMSI code), so as to obtain the relationship table between the target user and the peer personnel.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A method of processing water area data, the method comprising:
acquiring a first identification code of a target user and a first longitude and latitude data set with a time sequence from operator data;
in the information acquisition equipment, acquiring a second identification code of the target user and a second longitude and latitude point data set with a time sequence;
based on the incidence relation between the first identification code and the second identification code, correcting the first longitude and latitude point data set by adopting a second longitude and latitude point data set to obtain a third longitude and latitude point data set;
carrying out grid coding calculation on the third longitude and latitude point data set to obtain first grid data;
acquiring second grid data of each ship in a preset channel basin range;
and matching the first grid data in the second grid data of all ships, and determining ship data in the water area data corresponding to the target user.
2. The water area data processing method of claim 1, wherein the obtaining of the first identification code of the target user and the first longitude data set with time sequence in the operator data comprises:
screening out target operator data in the preset channel basin range from the operator data;
acquiring the equipment identification code and longitude and latitude data of the mobile terminal carried by each user in a preset time period from the target operator data;
judging whether the ratio of the number of longitude and latitude points falling into the range of a preset channel basin to the total number of longitude and latitude points in the longitude and latitude point data meets the preset ratio requirement, if so, identifying the user corresponding to the equipment identification code as a target user;
and acquiring a first identification code of the target user and a first longitude point data set with a time sequence.
3. The water area data processing method of claim 2, wherein the correcting operation of the first longitude and latitude data set by using a second longitude and latitude data set based on the association relationship between the first identification code and the second identification code to obtain a third longitude and latitude data set comprises:
based on the incidence relation between the first identification code and the second identification code, correcting the first longitude and latitude point data set by adopting a second longitude and latitude point data set to obtain a fourth longitude and latitude point data set;
and performing outlier rejection operation on the fourth longitude and latitude point data set according to the running speed and the running distance of the ship to obtain a third longitude and latitude point data set.
4. The method for processing water area data according to claim 3, wherein the step of performing outlier rejection on the fourth longitude and latitude data set according to the traveling speed and the traveling distance of the ship to obtain a third longitude and latitude data set comprises:
performing outlier rejection operation on the fourth longitude and latitude point data set according to the running speed and the running distance of the ship to obtain a fifth longitude and latitude point data set;
and performing point supplementing operation on the missing longitude and latitude points in the fifth longitude and latitude point data set according to the running time and the running distance of the ship to obtain a third longitude and latitude point data set.
5. The method of claim 4, wherein the matching of the first grid data with the second grid data of all vessels to determine the target vessel to which the target user belongs comprises:
respectively carrying out grid collision operation on the first grid data of each target user and the second grid data of all ships, and determining a ship with the same grid tendency as the target user;
calculating the track similarity of the target user and each inclined ship;
and comparing the track similarity with a preset similarity threshold, and determining ship data in the water area data corresponding to the target user according to the comparison result.
6. The method of processing water area data of claim 1, further comprising:
associating the second identification code of the target user, the number of the information acquisition equipment and the acquisition time to obtain an association relation pair;
and carrying out cluster analysis on the incidence relation pairs of all the target users to determine the peer personnel data of each target user.
7. The method of processing water area data of claim 1, further comprising:
generating first abnormal warning information when a specified user is determined from the data acquired by the information acquisition device;
and when the specified user enters the first specified position area, generating second abnormal alarm information.
8. The method of processing water area data of claim 1, further comprising:
and generating third abnormal warning information when the ship is in a second appointed position area.
9. A water area data processing apparatus, comprising:
the first acquisition module is used for acquiring a first identification code of a target user and a first longitude and latitude data set with a time sequence from operator data;
the second acquisition module is used for acquiring a second identification code of the target user and a second longitude and latitude point data set with a time sequence in the information acquisition equipment;
the correction module is used for performing correction operation on the first longitude and latitude point data set by adopting a second longitude and latitude point data set based on the incidence relation between the first identification code and the second identification code to obtain a third longitude and latitude point data set;
the calculation module is used for carrying out grid coding calculation on the third longitude and latitude point data set to obtain first grid data;
the third acquisition module is used for acquiring second grid data of each ship in the preset channel basin range;
and the matching module is used for matching the first grid data in the second grid data of all ships and determining ship data in the water area data corresponding to the target user.
10. A water area data processing system comprising the apparatus of claim 9, the system further comprising:
the information acquisition equipment is used for acquiring a second identification code of the target user and a second longitude and latitude point data set with a time sequence;
the boundary equipment is used for synchronizing all data accessed into the system after safety boundary ferrying is carried out on all data;
the ship information statistics module is used for counting ship information in a preset channel flow domain according to the accessed AIS data;
the alarm module is used for releasing abnormal alarm information when an abnormal event is monitored;
the display module is used for displaying the advancing state information of the ship in real time;
and the personnel data query module is used for responding to the received query instruction and querying the target user data and the ship data corresponding to the target user in the water area data.
CN202210468481.3A 2022-04-29 2022-04-29 Water area data processing method, device and system Pending CN114817328A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210468481.3A CN114817328A (en) 2022-04-29 2022-04-29 Water area data processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210468481.3A CN114817328A (en) 2022-04-29 2022-04-29 Water area data processing method, device and system

Publications (1)

Publication Number Publication Date
CN114817328A true CN114817328A (en) 2022-07-29

Family

ID=82510210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210468481.3A Pending CN114817328A (en) 2022-04-29 2022-04-29 Water area data processing method, device and system

Country Status (1)

Country Link
CN (1) CN114817328A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117542004A (en) * 2024-01-10 2024-02-09 杰创智能科技股份有限公司 Offshore man-ship fitting method, device, equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117542004A (en) * 2024-01-10 2024-02-09 杰创智能科技股份有限公司 Offshore man-ship fitting method, device, equipment and storage medium
CN117542004B (en) * 2024-01-10 2024-04-30 杰创智能科技股份有限公司 Offshore man-ship fitting method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
Wang et al. A novel approach for generating routable road maps from vehicle GPS traces
EP3163466B1 (en) Trajectory data inquiry method and apparatus
Chen et al. Constructing and comparing user mobility profiles for location-based services
CN110647563B (en) Data processing method, device and equipment thereof
CN105824840B (en) A kind of method and device for area label management
Sun et al. Real time anomalous trajectory detection and analysis
EP4035435A1 (en) System and method for processing vehicle event data for journey analysis
JP2022520594A (en) A system for finding the itinerary of a vehicle
WO2015170289A1 (en) Method and system for vehicular traffic prediction
CN111160867A (en) Large-scale regional parking lot big data analysis system
Feng et al. Analysis of bike sharing system by clustering: the Vélib’case
CN105160871A (en) Highway passenger vehicle temporary get-on/off recognition method
CN115034600A (en) Early warning method and system for geological disaster monitoring
CN106202126B (en) A kind of data analysing method and device for logistics monitoring
US20120218150A1 (en) Management server, population information calculation management server, non-populated area management method, and population information calculation method
CN111738558B (en) Visualization method, device, equipment and storage medium for behavior risk identification
Elias et al. SOMOBIL–improving public transport planning through mobile phone data analysis
CN114817328A (en) Water area data processing method, device and system
CN103488525A (en) Determination of user preference relevant to scene
CN112925899B (en) Ordering model establishment method, case clue recommendation method, device and medium
Nishi et al. Hourly pedestrian population trends estimation using location data from smartphones dealing with temporal and spatial sparsity
CN112566025B (en) Bus passenger flow source destination identification method and device, electronic equipment and storage medium
CN106921687B (en) Information pushing method, server and terminal
Axer Estimating Traffic Signal States by Exploiting Sparse Low-Frequency Floating Car Data
CN113409018B (en) People stream density determining method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination