CN112765495B - Data processing system for acquiring target position - Google Patents
Data processing system for acquiring target position Download PDFInfo
- Publication number
- CN112765495B CN112765495B CN202110115421.9A CN202110115421A CN112765495B CN 112765495 B CN112765495 B CN 112765495B CN 202110115421 A CN202110115421 A CN 202110115421A CN 112765495 B CN112765495 B CN 112765495B
- Authority
- CN
- China
- Prior art keywords
- information
- wifi
- wifi information
- database
- time period
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
- G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Position Fixing By Use Of Radio Waves (AREA)
Abstract
The invention relates to a data processing system for acquiring a target position, which comprises a first database, a second database, a third database, a processor and a memory for storing a computer program, wherein when the computer program is executed by the processor, the data processing system realizes the following steps: step S1, acquiring a first device id of the target app installed in a first time period from a first database, and constructing a first intermediate data table; step S2, acquiring first wifi information connected with a first device id in a first time period from a second database; step S3, acquiring a second device id connected with the first wifi information in a first time period from a second database, and constructing a second intermediate data table; step S4, traversing the first intermediate data table and the second intermediate data table, and acquiring the number of the second device ids and the number of the first device ids connected with the first wifi information in a first time period; and step S5, determining the target position information. The invention reduces the calculation amount of processing mass data and improves the efficiency and accuracy of obtaining the target position.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a data processing system for acquiring a target position.
Background
With the continuous development of science and technology and information technology, intelligent terminal devices such as mobile phones play an important role in the life of people, and a plurality of different types of apps are usually installed on the intelligent terminal devices. Generally, the same app is distributed on line, and does not aggregate in the same location area, and if a certain app aggregates in the same location area, the location area is most likely to be a target location to be tracked.
With the advent of the big data era, app related data of the intelligent terminal device is increased explosively, so that when a target position is obtained based on the app related data, massive data stored in a database generally needs to be analyzed, the calculated amount is huge, the processing efficiency is low, the processing efficiency is limited by the calculated amount, the data can only be analyzed based on less dimensional device data, and the accuracy of obtaining the target position cannot be guaranteed. Therefore, how to process the mass data, reduce the calculation amount for processing the mass data, and improve the efficiency of acquiring the target position becomes an urgent technical problem to be solved.
Disclosure of Invention
The invention aims to provide a data processing system for acquiring a target position, which reduces the calculated amount of processing mass data and improves the efficiency and accuracy of acquiring the target position.
A first aspect of the present invention provides a data processing system for obtaining a target location, including a first database, a second database, a third database, a processor, and a memory storing a computer program, wherein fields in the first database include a device id, app list information, and time information, fields in the second database include a device id, wifi information of a device connection, and time information, and the third database is configured to store feature information obtained from the first database or the second database, and when the computer program is executed by the processor, the following steps are implemented:
step S1, based on a preset target app name and a preset first time period, obtaining all first device ids for installing the target app in the first time period from the first database, constructing a first device id list as a first intermediate data table, and storing the first device id list in the third database;
step S2, acquiring first wifi information which is connected with each first device id in a first time period from the second database based on all the first device ids and the first time period;
step S3, based on each first wifi information and the first time period, obtaining all second device ids connected with each first wifi information in the first time period from the second database, constructing a second device id list corresponding to each first wifi information, constructing a second intermediate data table by using the first wifi information and the second device id list as fields, and storing the second intermediate data table in the third database;
step S4, traversing the first intermediate data table and the second intermediate data table, and acquiring the number of second device ids and the number of first device ids connected with each first wifi information in the first time period;
step S5, determining target wifi information based on the number of second device ids and the number of first device ids connected in the first time period of all the first wifi information, and taking wifi position information corresponding to the target wifi information as target position information.
Compared with the prior art, the invention has obvious advantages and beneficial effects. By the technical scheme, the data processing system for acquiring the target position can achieve considerable technical progress and practicability, has wide industrial utilization value and at least has the following advantages:
according to the method, the intermediate data table is constructed based on the mass database to obtain the third database with a smaller data volume, calculation is carried out based on the online app related data in the third database, and the target wifi information is determined, so that the target position information is further determined, the calculated amount of mass data processing in the target position obtaining process is reduced, and the efficiency and accuracy of obtaining the target position are improved.
The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly understood, the present invention may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present invention more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
FIG. 1 is a schematic diagram of a data processing system for obtaining a target location according to an embodiment of the present invention;
fig. 2 is a data processing flow chart for acquiring a target location according to an embodiment of the present invention.
Detailed Description
To further illustrate the technical means and effects of the present invention adopted to achieve the predetermined objects, the following detailed description will be given with reference to the accompanying drawings and preferred embodiments of a data processing system for acquiring a target position and its effects.
An embodiment of the present invention provides a data processing system for acquiring a target location, as shown in fig. 1, including a first database, a second database, a third database, a processor, and a memory storing a computer program, where a field in the first database includes a device id, app list information, and time information, and it can be understood that the time information in the first database is a time when a device reports an app list. The fields of the second database include device id, wifi information and time information of device connection, and it can be understood that the time information in the second database is the time when the device reports the wifi information of connection. The third database is configured to store feature information obtained from the first database or the second database, and when the computer program is executed by the processor, as shown in fig. 2, the following steps are implemented:
step S1, based on a preset target app name and a preset first time period, obtaining all first device ids for installing the target app in the first time period from the first database, constructing a first device id list as a first intermediate data table, and storing the first device id list in the third database;
the first time period may be set according to specific processing requirements, and may be set to 1 month, 3 months, or the like, for example. The target app refers to an app of a target location when aggregation occurs in the same location area, and it is understood that the aggregation degree of the specific determination may be set according to a specific application scenario and a processing requirement.
Step S2, acquiring first wifi information which is connected with each first device id in a first time period from the second database based on all the first device ids and the first time period;
step S3, based on each first wifi information and the first time period, obtaining all second device ids connected with each first wifi information in the first time period from the second database, constructing a second device id list corresponding to each first wifi information, constructing a second intermediate data table by using the first wifi information and the second device id list as fields, and storing the second intermediate data table in the third database;
it can be understood that the device corresponding to the second device id may or may not have the target app installed, and thus, the second device id is composed of the first device id and the non-first device id.
Step S4, traversing the first intermediate data table and the second intermediate data table, and acquiring the number of second device ids and the number of first device ids connected with each first wifi information in the first time period;
step S5, determining target wifi information based on the number of second device ids and the number of first device ids connected in the first time period of all the first wifi information, and taking wifi position information corresponding to the target wifi information as target position information.
According to the embodiment of the invention, the intermediate data table is constructed based on the mass database to obtain the third database with smaller data volume, calculation is carried out based on the online app related data in the third database, and the target wifi information is determined, so that the offline target position information is further determined, the calculated amount of mass data processing in the target position obtaining process is reduced, and the efficiency and accuracy of obtaining the target position are improved.
According to the invention, the system can be physically implemented as one server, or as a server group comprising a plurality of servers; the device is a mobile terminal and can be physically implemented as a smart phone, PAD, or other mobile device capable of installing an application (e.g., APP). Those skilled in the art will appreciate that the model, specification, etc. of the server and the mobile terminal do not affect the scope of the present invention.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. A process may be terminated when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
As an embodiment, the wifi information is wifi information that the connection times exceed a preset connection time threshold for the corresponding device id in a preset second time period, namely the device is always connected with wifi, so that the calculation amount in the data processing process can be greatly reduced, and the calculation accuracy is improved. The wifi information comprises a wifi name, wifi mac information and wifi position information, the wifi name can be repeated, the wifi mac can also correspond to a plurality of different wifi names, but a set of wifi name information and wifi mac information can be used as a unique identifier, and therefore the combination of the wifi name and the wifi mac information forms the unique identifier of the wifi information in the second database. The wifi position information refers to the geographical position information of the position where the wifi is located.
As an embodiment, in the step S2, the obtaining wifi information that each of the first device ids is connected to during the first time period from the second database is partially noisy, so that partial noise can be filtered, the calculation amount of subsequent data processing can be reduced, and the accuracy of data processing can be improved, and specifically, the obtaining wifi information that each of the first device ids is connected to during the first time period from the second database based on all the first device ids and the first time period includes:
step S21, based on all the first device ids and the first time period, acquiring all wifi information connected by each first device id in the first time period from the second database;
all wifi information which is obtained from the second database and connected to each first device id in the first time period can be stored in the third database as the third intermediate data table, and the wifi information list can also be directly stored in the cache, so that the step S22 can be called directly.
Step S22, obtaining the number of second device ids connected with all wifi information connected with each first device id in the first time period, and determining wifi information more than preset M as first wifi information, wherein M is a positive integer greater than or equal to 2.
The second device id refers to the id of all devices connected with wifi information in the first time period, the second device id comprises a first device id with target app and a device id without the target app, and the id of the total amount devices connected in the first time period is used for filtering all wifi information acquired in the first time period from the second database and connected with the first device id, so that the first wifi information is obtained. The value of M is specifically set according to parameters such as accuracy of obtaining the target position, for example, the value of M may be 2.
Due to the fact that the amount of the wifi information data is huge and the wifi information data is directly stored in the database, the calculation amount of the subsequent process of retrieving and obtaining the data is large, the efficiency of obtaining the data is low, and therefore the wifi information can be stored in a subarea mode. As an embodiment, the second database includes a plurality of second data tables having fields including device id, wifi information of device connection, and time information, each of the second data tables corresponds to a unique data table id and a unique geographic area, and wifi location information in the wifi information stored in each second data table belongs to the geographic area corresponding to the second data table, so that the wifi information data is stored in a partitioned manner. In step S3, the obtaining, from the second database, all second device ids connected to each first wifi information in the first time period based on each first wifi information and the first time period includes:
step S31, determining a geographical location area to which the wifi device belongs based on wifi location information corresponding to each first wifi information, and determining a corresponding second data table id based on the geographical location area to which the wifi device belongs;
step S32, based on each wifi information, the first time period and the corresponding second data table id, obtaining all device ids connected to each wifi information in the first time period from the corresponding second data table as all second device ids connected to each wifi information.
By storing the wifi information in a regional mode and determining the corresponding second data table id in the geographical position region where the wifi position information can be directly based on the first wifi information when the second device id connected with the first wifi information is obtained based on the first wifi information, the corresponding data are directly searched and obtained in the second data table, the calculation amount of obtaining the second device id connected with the first wifi information is reduced, the data obtaining efficiency is improved, and therefore the target position obtaining efficiency is improved.
As an example, the step S4 includes:
step S41, traversing the second intermediate data table, and acquiring the number of second device ids and a second device id list of each first wifi information connected in the first time period;
step S42, matching the second device id list of each first wifi information with the first intermediate data table, and obtaining the number of the first device ids included in each second device id list.
As an embodiment, in the step S5, the determining the target wifi information based on the number of the second device ids and the number of the first device ids that all the first wifi information is connected in the first time period includes:
step S51, acquiring the ratio of the number of first device ids connected to each first wifi information in the first time period to the number of second device ids as a characteristic ratio;
the number of first device ids connected in the first time period is the number of device ids installed with the target app, and the number of second device ids connected in the first time period is the number of all device ids connected in the first time period, namely the number of full device ids. The characteristic ratio may reflect a ratio of the number of devices in which the target app is installed to the number of full devices in the devices connected in the first time period for each piece of first wifi information.
Step S52, judging whether the corresponding characteristic ratio of each first wifi information exceeds a preset ratio threshold, if so, determining the first wifi information as second wifi information, and executing step S53 or step S54;
the preset proportion threshold value is specifically set according to the installation amount distribution of the target app, the prediction result of the target position and the like. For example, the ratio threshold may be set to 50%, and by setting the ratio threshold, a part of non-target wifi can be further removed, so that the subsequent calculation amount is reduced, and the accuracy of the target position acquisition result is improved.
Step S53, judging whether the number of first device ids connected in the first time period of each second wifi information exceeds a preset number threshold, and if so, determining the second wifi information as the target wifi information;
the preset number threshold may be specifically set according to parameters such as a total installation amount of the target app, a target app installation number distribution, and target location determination accuracy.
And S54, arranging all the second wifi information according to the corresponding characteristic ratio in a descending order, and determining the first N preset wifi information as the target wifi information.
The value of N is specifically set according to parameters such as target position determination accuracy, and may be set to 5, for example.
In order to further improve the accuracy of target wifi determination and thus improve the accuracy of target location determination, as an embodiment, before using wifi location information corresponding to the target wifi information as target location information in step S5, the method further includes step S50, and the step of filtering the target wifi information specifically includes:
step S501, performing word segmentation processing on each target wifi information to obtain a corresponding feature word list, matching the feature word list with a preset target feature word bank, and filtering the target wifi information if the target feature words in the target feature word bank do not exist in the feature word list;
alternatively, the first and second electrodes may be,
and S502, acquiring wifi position information corresponding to each target wifi information, matching the wifi position information with a preset target position area, and filtering the target wifi information if the target wifi information does not belong to the target position area.
Although the present invention has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (7)
1. A data processing system for acquiring a target location,
comprising a first database, a second database, a third database, a processor and a memory storing a computer program, wherein fields in the first database comprise device id, app list information and time information, fields of the second database comprise device id, wifi information of device connection and time information, the third database is used for storing feature information obtained from the first database or the second database, when the computer program is executed by the processor, the following steps are implemented:
step S1, based on a preset target app name and a preset first time period, obtaining all first device ids for installing the target app in the first time period from the first database, constructing a first device id list as a first intermediate data table, and storing the first device id list in the third database;
step S2, acquiring first wifi information which is connected with each first device id in a first time period from the second database based on all the first device ids and the first time period;
step S3, based on each first wifi information and the first time period, obtaining all second device ids connected with each first wifi information in the first time period from the second database, constructing a second device id list corresponding to each first wifi information, constructing a second intermediate data table by using the first wifi information and the second device id list as fields, and storing the second intermediate data table in the third database;
step S4, traversing the first intermediate data table and the second intermediate data table, and acquiring the number of second device ids and the number of first device ids connected with each first wifi information in the first time period;
step S5, determining target wifi information based on the number of second device ids and the number of first device ids connected in the first time period by all the first wifi information, and taking wifi position information corresponding to the target wifi information as target position information;
the step S5 includes:
step S51, acquiring the ratio of the number of first device ids connected to each first wifi information in the first time period to the number of second device ids as a characteristic ratio;
step S52, judging whether the corresponding characteristic ratio of each first wifi information exceeds a preset ratio threshold, if so, determining the first wifi information as second wifi information, and executing step S53 or step S54;
step S53, judging whether the number of first device ids connected in the first time period of each second wifi information exceeds a preset number threshold, and if so, determining the second wifi information as the target wifi information;
and S54, arranging all the second wifi information according to the corresponding characteristic ratio in a descending order, and determining the first N preset wifi information as the target wifi information.
2. The system of claim 1,
the wifi information is the wifi information of which the connection times exceed a preset connection time threshold value in a preset second time period for the corresponding equipment id, the wifi information comprises a wifi name, wifi mac information and wifi position information, and the combination of the wifi name and the wifi mac information forms the unique identification of the wifi information in the second database.
3. The system of claim 1,
in step S2, the obtaining, from the second database, first wifi information that is connected to each first device id in the first time period based on all the first device ids and the first time period includes:
step S21, based on all the first device ids and the first time period, acquiring all wifi information connected by each first device id in the first time period from the second database;
step S22, obtaining the number of second device ids connected with all wifi information connected with each first device id in the first time period, and determining wifi information more than preset M as first wifi information, wherein M is a positive integer greater than or equal to 2.
4. The system of claim 3,
and the value of M is 2.
5. The system of claim 1,
the second database includes a plurality of second data tables having fields including device ids, wifi information and time information, each of the second data tables corresponds to a unique data table id and a unique geographic area, wifi location information in the wifi information stored in each second data table all belongs to the geographic area corresponding to the second data table, in step S3, the second database is obtained from the second database within a first time period based on each first wifi information and the first time period, and all the second device ids connected to each first wifi information include:
step S31, determining a geographical location area to which the wifi device belongs based on wifi location information corresponding to each first wifi information, and determining a corresponding second data table id based on the geographical location area to which the wifi device belongs;
step S32, based on each wifi information, the first time period and the corresponding second data table id, obtaining all device ids connected to each wifi information in the first time period from the corresponding second data table as all second device ids connected to each wifi information.
6. The system of claim 1,
the step S4 includes:
step S41, traversing the second intermediate data table, and acquiring the number of second device ids and a second device id list of each first wifi information connected in the first time period;
step S42, matching the second device id list of each first wifi information with the first intermediate data table, and obtaining the number of the first device ids included in each second device id list.
7. The system of claim 1,
in step S5, before the wifi location information corresponding to the target wifi information is used as the target location information, the method further includes step S50, filtering the target wifi information, and specifically includes:
step S501, performing word segmentation processing on each target wifi information to obtain a corresponding feature word list, matching the feature word list with a preset target feature word bank, and filtering the target wifi information if the target feature words in the target feature word bank do not exist in the feature word list;
alternatively, the first and second electrodes may be,
and S502, acquiring wifi position information corresponding to each target wifi information, matching the wifi position information with a preset target position area, and filtering the target wifi information if the target wifi information does not belong to the target position area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110115421.9A CN112765495B (en) | 2021-01-28 | 2021-01-28 | Data processing system for acquiring target position |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110115421.9A CN112765495B (en) | 2021-01-28 | 2021-01-28 | Data processing system for acquiring target position |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112765495A CN112765495A (en) | 2021-05-07 |
| CN112765495B true CN112765495B (en) | 2022-04-15 |
Family
ID=75706310
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110115421.9A Active CN112765495B (en) | 2021-01-28 | 2021-01-28 | Data processing system for acquiring target position |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112765495B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113486055B (en) * | 2021-06-30 | 2023-09-08 | 杭州云深科技有限公司 | Data processing system for determining public wifi category |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1748370A1 (en) * | 2005-07-27 | 2007-01-31 | Rafael-Armament Development Authority Ltd. | Real-time geographic information system and method |
| CN111586585A (en) * | 2020-05-07 | 2020-08-25 | 悠尼客(上海)企业管理有限公司 | Position fingerprint positioning method based on Wifi |
| CN112101024A (en) * | 2020-11-12 | 2020-12-18 | 北京云真信科技有限公司 | Target object identification system based on app information |
-
2021
- 2021-01-28 CN CN202110115421.9A patent/CN112765495B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1748370A1 (en) * | 2005-07-27 | 2007-01-31 | Rafael-Armament Development Authority Ltd. | Real-time geographic information system and method |
| CN111586585A (en) * | 2020-05-07 | 2020-08-25 | 悠尼客(上海)企业管理有限公司 | Position fingerprint positioning method based on Wifi |
| CN112101024A (en) * | 2020-11-12 | 2020-12-18 | 北京云真信科技有限公司 | Target object identification system based on app information |
Non-Patent Citations (1)
| Title |
|---|
| 基于无线通信的高精度室内人员定位系统在博物馆信息化建设中的应用;邢更力等;《计算机测量与控制》;20191225(第12期);第172-176、182页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112765495A (en) | 2021-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107547633B (en) | User constant standing point processing method and device and storage medium | |
| WO2021103626A1 (en) | Method and apparatus for generating user geographical portrait, computer device, and storage medium | |
| EP3425530A1 (en) | Target location search method and apparatus | |
| CN112765473A (en) | Data processing system for acquiring target associated equipment | |
| CN112765495B (en) | Data processing system for acquiring target position | |
| CN111385370B (en) | ID allocation method, device, storage medium and ID allocation system | |
| CN111258798A (en) | Fault positioning method and device for monitoring data, computer equipment and storage medium | |
| CN116126901A (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN110084476B (en) | Case adjustment method, device, computer equipment and storage medium | |
| CN111291234A (en) | Account risk probability assessment method, device and system and storage medium | |
| CN112395301B (en) | Mobile device association degree determination method, electronic device and medium | |
| CN110851758A (en) | Webpage visitor number statistical method and device | |
| CN111506682A (en) | Map data processing method, data query device and electronic equipment | |
| CN112888010A (en) | Target wifi early warning system based on wifi connected device group information | |
| CN115190587A (en) | WIFI position determination method and device, electronic equipment and storage medium | |
| CN104866535A (en) | Compression method and device of number segment records | |
| CN115129752A (en) | Data caching method, data processing method, system, equipment and storage medium | |
| CN114168595A (en) | Data analysis method and device | |
| CN108763498B (en) | User identity identification method and device, electronic equipment and readable storage medium | |
| CN112468546A (en) | Account position determining method, account position determining device, server and storage medium | |
| CN111131393A (en) | User activity data statistical method, electronic device and storage medium | |
| CN114238258B (en) | Database data processing method, device, computer equipment and storage medium | |
| CN115454354B (en) | Data processing method, system, electronic device and storage medium | |
| CN111782596B (en) | Radio monitoring data processing method based on high-performance hybrid computing | |
| CN112612415B (en) | Data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |