CN112463862B - Data acquisition method and device based on configuration permission - Google Patents

Data acquisition method and device based on configuration permission Download PDF

Info

Publication number
CN112463862B
CN112463862B CN202011223514.5A CN202011223514A CN112463862B CN 112463862 B CN112463862 B CN 112463862B CN 202011223514 A CN202011223514 A CN 202011223514A CN 112463862 B CN112463862 B CN 112463862B
Authority
CN
China
Prior art keywords
data field
server
data
sdk
identification variable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011223514.5A
Other languages
Chinese (zh)
Other versions
CN112463862A (en
Inventor
罗伟东
李博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Hexun Huagu Information Technology Co ltd
Original Assignee
Shenzhen Hexun Huagu Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Hexun Huagu Information Technology Co ltd filed Critical Shenzhen Hexun Huagu Information Technology Co ltd
Priority to CN202011223514.5A priority Critical patent/CN112463862B/en
Publication of CN112463862A publication Critical patent/CN112463862A/en
Application granted granted Critical
Publication of CN112463862B publication Critical patent/CN112463862B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/258—Data format conversion from or to a database
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/275—Synchronous replication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/141—Setup of application sessions

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application discloses a data acquisition method and device based on configuration permission, wherein the method comprises the following steps: the SDK establishes a long connection with a server; the SDK acquires a first data field and a second data field, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field; the SDK reports the first data field and the second data field according to the data format of the server, and adds a first identification variable in a request body of a reporting interface; if the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server, the SDK receives synchronous configuration change information sent by the server, and the configuration change information is the second identification variable; the SDK updates the first data field and the second data field according to the configuration change information, and sends update result information to the server; the SDK acquires the updated first data field and the updated second data field; and the SDK reports the updated first data field and the updated second data field according to the data format of the server.

Description

Data acquisition method and device based on configuration permission
Technical Field
The application relates to the technical field of big data, in particular to a data acquisition method and device based on configuration permission.
Background
The rapid development of the internet brings society into an information age with highly developed and published data, and the data plays an extremely important role in enterprise management, government decision-making, social dynamic analysis and the like. A large amount of users visit each day on certain service platforms, so that a large amount of visit log data are generated, such as browsing of an e-commerce system, a series of processes of shopping cart adding, order placing, payment and the like can acquire related data such as visit paths, visit time and the like of the users through buried points; and for example, the intelligent wearable device collects data such as blood pressure, pulse and heart rate of the user in real time and reports the data to the cloud in real time. By collecting the log information and then analyzing the data, a plurality of service values can be obtained, and potential values in the log data of the corresponding service platform can be mined.
The internet data acquisition technology based on the big data platform is to collect log data for offline and online real-time analysis, and the current data acquisition strategy is to acquire according to set target data, but with the gradual perfection of data management security regulations, the limitation of data acquisition is more and more strict, and if sensitive data exists in the acquired target data, an application program cannot normally run.
Disclosure of Invention
The application provides a data acquisition method and device based on configuration rights, which are used for flexibly acquiring data through the open rights of mobile equipment.
The first aspect of the application provides a data acquisition method based on configuration rights, comprising the following steps:
A software development kit (Software Development Kit, SDK) establishes a long connection with a server;
the SDK acquires a first data field and a second data field, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field;
The SDK reports the first data field and the second data field according to the data format of the server, and adds a first identification variable in a request body of a reporting interface;
If the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server, the SDK receives synchronous configuration change information sent by the server, wherein the configuration change information is the second identification variable;
the SDK updates the first data field and the second data field according to the configuration change information, and sends update result information to the server;
the SDK acquires the updated first data field and the updated second data field;
And the SDK reports the updated first data field and the updated second data field according to the data format of the server.
Optionally, after the SDK reports the first data field and the second data field according to the data format of the server and adds the first identifier variable in the request body of the reporting interface, if the first identifier variable in the request body is inconsistent with the second identifier variable of the storage medium in the server, before the SDK receives the synchronization configuration change information sent by the server, the method further includes:
and if the first identification change in the request body is consistent with the second identification variable of the storage medium in the server, reporting the first data field and the second data field to the server by the SDK according to preset time.
Optionally, the SDK reports the updated first data field and the updated second data field according to a data format of the server, including;
And the SDK reports the first data field and the second data field to the server according to preset time.
Optionally, if some data in the second data field is not successful, reporting null data.
The second aspect of the application provides a data acquisition method based on configuration rights, comprising the following steps:
the server establishes a long connection with the SDK;
The server receives a report request sent by the SDK;
The server judges whether a first identification variable in a request body in a reporting interface of the SDK is consistent with a second identification variable in a storage medium or not;
If not, synchronous configuration change information is sent to the SDK, wherein the configuration change information is the second identification variable;
If yes, the reported data are stored in the target file.
Optionally, the storing the reported data in the target file includes:
the server arranges the target data into a table form;
the server writes the table into a file at a specified position;
Or alternatively, the first and second heat exchangers may be,
The server writes the table into Kafka.
Optionally, the server writes the table into a file at a specified location, including:
the server stores the table into a default file, wherein the path, the file name and the upper limit of the file size of the default file are all default settings;
Or alternatively, the first and second heat exchangers may be,
The server stores the table into a specified file, wherein the path, the file name and the upper limit of the file size of the specified file are all set by a user;
the server compresses the file through script timing.
Optionally, the server can match the reporting interfaces of the SDKs of different applications.
A third aspect of the embodiment of the present application provides a data acquisition device based on configuration rights, including:
The first connection unit is used for establishing long connection between the SDK and the server;
The first acquisition unit is used for acquiring a first data field and a second data field by the SDK, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field;
The first reporting unit is used for reporting the first data field and the second data field according to the data format of the server by the SDK and adding a first identification variable into a request body of a reporting interface;
The first receiving unit is used for receiving synchronous configuration change information sent by the server when a first identification variable in the request body is inconsistent with a second identification variable of a storage medium in the server, wherein the configuration change information is the second identification variable;
a configuration unit, configured to update the first data field and the second data field according to the configuration change information by using the SDK, and send update result information to the server;
The second acquisition unit is used for acquiring the updated first data field and the updated second data field by the SDK;
And the second reporting unit is used for reporting the updated first data field and the updated second data field according to the data format of the server by the SDK.
Optionally, the apparatus further includes:
and the third reporting unit is used for reporting the first data field and the second data field to the server according to preset time by the SDK when the first identification change in the request body is consistent with the second identification variable of the storage medium in the server.
Optionally, the second reporting unit includes:
And the timing module is used for reporting the first data field and the second data field to the server according to preset time by the SDK.
A fourth aspect of the present application provides a data acquisition device based on configuration rights, including:
the second connection unit is used for establishing long connection between the server and the SDK;
the second receiving unit is used for receiving the report request sent by the SDK by the server;
the judging unit is used for judging whether the first identification variable in the request body in the reporting interface of the SDK is consistent with the second identification variable in the storage medium or not by the server;
A sending configuration unit, configured to send synchronous configuration change information to the SDK when the judging unit is no, where the configuration change information is the second identification variable;
and the storage unit is used for storing the reported data into the target file when the judgment unit is yes.
Optionally, the storage unit includes:
the sorting module is used for sorting the target data into a form of a table by the server;
The first storage module is used for writing the table into a file at a specified position by the server;
and the second storage module is used for writing the table into the Kafka by the server.
Optionally, the first storage module includes:
The first storage submodule is used for storing the table into a default file by the server, and the path, the file name and the upper limit of the file size of the default file are all default settings;
the second storage submodule is used for storing the table into a specified file by the server, and the path, the file name and the upper limit of the file size of the specified file are all set by a user;
And the compression sub-module is used for compressing the file at regular time by the server through the script.
A fifth aspect of an embodiment of the present application provides a data acquisition device based on configuration rights, including:
The device comprises a processor, a memory, an input/output unit and a bus;
the processor is connected with the memory, the input/output unit and the bus;
the processor specifically performs the following operations:
the SDK establishes a long connection with a server;
the SDK acquires a first data field and a second data field, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field;
The SDK reports the first data field and the second data field according to the data format of the server, and adds a first identification variable in a request body of a reporting interface;
If the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server, the SDK receives synchronous configuration change information sent by the server, wherein the configuration change information is the second identification variable;
the SDK updates the first data field and the second data field according to the configuration change information, and sends update result information to the server;
the SDK acquires the updated first data field and the updated second data field;
And the SDK reports the updated first data field and the updated second data field according to the data format of the server.
According to the technical scheme, the data fields to be acquired are divided into the first data fields and the second data fields, wherein the first data fields are necessary fields for default acquisition and meet the acquisition conditions in the safety regulations of the application program, the second data fields are acquired according to the open authority of the mobile equipment, and when some data which cannot be acquired are met, null data are returned to the server, so that the collapse of the application program is not caused, and the running stability of the application program in the data acquisition process is improved.
Drawings
FIG. 1 is a flow chart of an embodiment of a data acquisition method based on configuration rights in the present application;
FIG. 2 is a flow chart of another embodiment of a data acquisition method based on configuration rights in the present application;
FIG. 3 is a flowchart of another embodiment of a data acquisition method based on configuration rights in the present application;
FIG. 4 is a flowchart of another embodiment of a data acquisition method based on configuration rights in the present application;
FIG. 5 is a flowchart of another embodiment of a data acquisition method based on configuration rights in the present application;
FIG. 6 is a schematic structural diagram of an embodiment of a data acquisition device based on configuration rights in the present application;
FIG. 7 is a schematic structural diagram of another embodiment of a data acquisition device based on configuration rights in the present application;
Fig. 8 is a schematic structural diagram of another embodiment of a data acquisition device based on configuration rights in the present application.
Detailed Description
The embodiment of the application provides a data acquisition method and device based on configuration permission, which are used for flexibly acquiring data through the open permission of mobile equipment.
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Referring to fig. 1, an embodiment of a data collection method based on configuration rights in the present application includes:
101. The SDK establishes a long connection with a server;
When the server needs to collect corresponding data for a certain application program, the server establishes long connection with a corresponding SDK, a plurality of data packets can be continuously transmitted on the current connection, and when the transmitted data reach a specified size, the transmission is ended.
102. The SDK acquires a first data field and a second data field, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field;
The SDK is preset with data fields to be collected, the data fields are identifiers of the data, the first data fields are pushing necessary fields, the second data fields contain more data fields, and the collection process is carried out according to the opening authority of the mobile terminal and the instruction of the server.
103. The SDK reports the first data field and the second data field according to the data format of the server, and adds a first identification variable in a request body of a reporting interface;
The server receives the data reported by the SDK and passes through the data interface, so that the data is reported according to the data format of the server when the SDK reports the data, and a first identification variable is added in a request body reported by the SDK and used for representing the acquired second data field.
104. If the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server, the SDK receives synchronous configuration change information sent by the server, wherein the configuration change information is the second identification variable;
After the SDK sends the request, if the server receives the request and judges that the first identification variable in the request body is inconsistent with the second identification variable in the storage medium in the server, the server sends a second identification variable value SDK, so that the SDK changes the acquired second data field according to the synchronous configuration information.
105. The SDK updates the first data field and the second data field according to the configuration change information, and sends update result information to the server;
After the SDK updates the data field to be acquired according to the configuration change information, the SDK sends an updated result to the server, and if the configuration is unsuccessful, the server sends the configuration change information again until the configuration is successful and then the next step is executed.
106. The SDK acquires the updated first data field and the updated second data field;
after the configuration in step 105 is successful, the SDK performs data collection on the running application program according to the collected data field.
107. And the SDK reports the updated first data field and the updated second data field according to the data format of the server.
When the SDK transmits data with the server, the reported data needs to be converted according to the data format requirement of the server.
In this embodiment, data in the application program is acquired according to the data field acquired by user definition, and the acquired data is flexibly transformed according to the open authority of the mobile terminal, so that the data can be acquired according to the authority set by the user, which not only meets the requirement of network data security, but also avoids the situation that the application program collapses when private data is acquired.
In the following, referring to fig. 2, another embodiment of the data collection method based on configuration rights in the present application includes:
201. The SDK establishes a long connection with a server;
202. the SDK acquires a first data field and a second data field, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field;
203. The SDK reports the first data field and the second data field according to the data format of the server, and adds a first identification variable in a request body of a reporting interface;
steps 201 to 203 in this embodiment are similar to steps 101 to 103 in the previous embodiment, and will not be repeated here.
204. If the first identification change in the request body is consistent with the second identification variable of the storage medium in the server, the SDK reports the first data field and the second data field to the server according to preset time;
After the SDK sends the request, if the server receives the request, judging whether the first identification variable in the request body is consistent with the second identification variable in the storage medium in the server, if so, returning a message for confirming that the request can be sent, and reporting the data content acquired according to the data field to the server according to the preset time by the SDK.
205. If the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server, the SDK receives synchronous configuration change information sent by the server, wherein the configuration change information is the second identification variable;
206. The SDK updates the first data field and the second data field according to the configuration change information, and sends update result information to the server;
207. the SDK acquires the updated first data field and the updated second data field;
208. And the SDK reports the updated first data field and the updated second data field according to the data format of the server and the preset time.
Steps 205 to 208 in this embodiment are similar to steps 104 to 107 in the previous embodiment, and will not be repeated here.
The above embodiments describe the SDK side in detail in the configuration authority-based data collection method, and the server side method will be described in detail below.
Referring to fig. 3, another embodiment of a data collection method based on configuration rights in the present application includes:
301. The server establishes a long connection with the SDK;
the server acquires relevant data in the application program of the mobile terminal, the server establishes long connection with the SDK integrated in the application program, data transmission is carried out in the connection, and a plurality of connections are established for data transmission before the application program is closed.
302. The server receives a report request sent by the SDK;
the server receives an instruction of requesting transmission sent by the SDK, and judges whether a first identification variable in a reporting interface is consistent with a second identification variable in a storage medium in the server, wherein the first identification variable represents data configuration information of the mobile terminal, and the second identification variable represents data information to be acquired by the server.
303. The server judges whether a first identification variable in a request body in a report interface of the SDK is consistent with a second identification variable in a storage medium, if not, the step 304 is executed, and if so, the step 305 is executed;
The server compares the first identification variable with the second identification variable, and when the first identification variable is consistent with the second identification variable, the information to be obtained by the server is consistent with the open authority of the mobile terminal to the data, so that a definite transfer message is sent to the SDK, then step 305 is executed, otherwise step 304 is executed.
304. Sending synchronous configuration change information to the SDK, wherein the configuration change information is the second identification variable;
and the server sends the second data field information to be acquired, which is reset after judgment, to the SDK, so that the SDK updates and covers the local second data field information according to the information.
305. The server arranges the target data into a table form;
Because the data directly sent by the SDK is not classified by arrangement, in order to be used efficiently, the server needs to arrange the target data into a form of a table, so that later data storage and analysis are convenient.
306. The server stores the table into a default file, wherein the path, the file name and the upper limit of the file size of the default file are all default settings;
The server may sort the data in the form of table in the file at the corresponding location in step 305, and the data may be stored according to a default storage path, that is, a default manner of the file name and the upper limit of the file size, or may customize the file storage path, that is, the file name, the file size, the file path, and the like, according to the user's settings.
It should be noted that, in addition to storing data in a corresponding file, the present application also provides a data storage form for writing data into Kafka, which is not specifically limited herein.
307. The server compresses the file through script timing.
After determining the storage position of the data, the server compresses the file according to the preset time, and when the file reaches the upper limit of the set file size, the data needs to be stored in a new file.
Referring to fig. 4, another embodiment of the data collection method based on configuration rights in the present application includes:
401. Establishing long connection;
402. collecting content information of the first data field and the second data field;
403. Reporting the first data field and the second data field according to the data format of the server, and adding a first identification variable in a request body of a reporting interface;
404. When the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server;
405. transmitting synchronous configuration change information;
406. updating the first data field and the second data field according to the configuration change information;
407. sending updated result information;
408. Sending a determination message;
409. collecting content information of the updated first data field and the updated second data field;
410. reporting the updated content information of the first data field and the second data field according to the data format of the server and the preset time;
411. the server arranges the target data into a table form;
412. the server compresses the file through script timing.
The above embodiment is described below for the case where the server determines that the first identifier variable and the second identifier variable in the request body are inconsistent, referring to fig. 5, another embodiment of the data collection method based on the configuration permission in the present application includes:
501. Establishing long connection;
502. collecting content information of the first data field and the second data field;
503. Reporting the first data field and the second data field according to the data format of the server, and adding a first identification variable in a request body of a reporting interface;
504. when the first identification variable in the request body is consistent with the second identification variable of the storage medium in the server;
505. Transmitting the determination information;
506. Collecting content information of the first data field and the second data field;
507. reporting the content information of the first data field and the second data field according to the data format of the server and the preset time;
508. the server arranges the target data into a table form;
509. The server compresses the file through script timing.
The method in the above embodiment may refer to the corresponding process in the foregoing method embodiment, and will not be described herein.
Referring to fig. 6, an embodiment of a data acquisition device based on configuration rights in the present application includes:
a first connection unit 601, configured to establish a long connection between the SDK and the server;
a first collection unit 602, configured to collect a first data field and a second data field by using the SDK, where the first data field is a push necessary field, and the second data field is a push unnecessary field;
A first reporting unit 603, configured to report the first data field and the second data field by using the SDK according to a data format of the server, and add a first identifier variable to a request body of a reporting interface;
A first receiving unit 604, configured to, when a first identification variable in the request body is inconsistent with a second identification variable of a storage medium in the server, receive synchronous configuration change information sent by the server, where the configuration change information is the second identification variable;
A configuration unit 605, configured to update the first data field and the second data field according to the configuration change information, and send update result information to the server;
A second acquisition unit 606, configured to acquire the updated first data field and the second data field by using the SDK;
A second reporting unit 607, configured to report the updated first data field and the second data field according to the data format of the server by using the SDK.
And a third reporting unit 608, configured to report, when the first identifier change in the request body is consistent with the second identifier variable of the storage medium in the server, the first data field and the second data field to the server according to a preset time by using the SDK.
The second reporting unit 607 in this embodiment includes:
And the first timing module is used for reporting the first data field and the second data field to the server according to preset time by the SDK.
The third reporting unit 608 in this embodiment includes:
and the second timing module is used for reporting the updated first data field and the updated second data field to the server according to preset time by the SDK.
Referring to fig. 7, another embodiment of a data acquisition device based on configuration rights in the present application includes:
A second connection unit 701, configured to establish a long connection between the server and the SDK;
A second receiving unit 702, configured to receive, by the server, a report request sent by the SDK;
A judging unit 703, configured to judge, by the server, whether a first identifier variable in a request body in a reporting interface of the SDK is consistent with a second identifier variable in a storage medium;
A sending configuration unit 704, configured to send synchronous configuration change information to the SDK when the judging unit is no, where the configuration change information is the second identification variable;
And a storage unit 705, configured to store the reported data in the target file when the determination unit is yes.
The storage unit 705 in this embodiment includes:
a sorting module 7051, configured to sort the target data into a form of a table by the server;
A first storage module 7052, configured to write the table into a file in a specified location by the server;
a second storage module 7053, configured to write the table into Kafka by using the server.
The first storage module 7052 in this embodiment includes:
A first storage sub-module 70521, configured to store, by the server, the table into a default file, where a path, a file name, and an upper limit of a file size of the default file are all default settings;
A second saving sub-module 70522, configured to save the table to a specified file by using the server, where a path, a file name, and an upper limit of a file size of the specified file are all set by a user;
a compression sub-module 70523, configured to compress the file at regular time by using a script.
Referring to fig. 8, another embodiment of a data acquisition device based on configuration rights in the present application includes:
a processor 801, a memory 802, an input/output unit 803, and a bus 804;
The processor 801 is connected to the memory 802, the input/output unit 803, and the bus 804;
the processor 801 specifically performs the following operations:
the SDK establishes a long connection with a server;
the SDK acquires a first data field and a second data field, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field;
The SDK reports the first data field and the second data field according to the data format of the server, and adds a first identification variable in a request body of a reporting interface;
If the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server, the SDK receives synchronous configuration change information sent by the server, wherein the configuration change information is the second identification variable;
the SDK updates the first data field and the second data field according to the configuration change information, and sends update result information to the server;
the SDK acquires the updated first data field and the updated second data field;
And the SDK reports the updated first data field and the updated second data field according to the data format of the server.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the apparatus and units described above may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again.
In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random-access memory (RAM, random access memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Claims (4)

1. The data acquisition method based on the configuration permission is characterized by comprising the following steps of:
the SDK establishes a long connection with a server;
the SDK acquires a first data field and a second data field, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field; the first data field is a necessary field for default acquisition and meets the acquisition conditions in the application program security regulations, and the second data field is acquired according to the open authority of the mobile equipment;
The SDK reports the first data field and the second data field according to the data format of the server, and adds a first identification variable in a request body of a reporting interface;
if the first identification variable in the request body is inconsistent with the second identification variable of the storage medium in the server, the SDK receives synchronous configuration change information sent by the server, wherein the configuration change information is the second identification variable; the SDK reports the first data field and the second data field according to the data format of the server, after adding a first identification variable in a request body of a reporting interface, if the first identification variable in the request body is inconsistent with a second identification variable of a storage medium in the server, before the SDK receives the synchronous configuration change information sent by the server, the method further comprises: if the first identification change in the request body is consistent with the second identification variable of the storage medium in the server, the SDK reports the first data field and the second data field to the server according to preset time;
the SDK updates the first data field and the second data field according to the configuration change information, and sends update result information to the server;
the SDK acquires the updated first data field and the updated second data field;
And the SDK reports the updated first data field and the updated second data field according to the data format of the server.
2. The method of claim 1, wherein the SDK reports the updated first data field and second data field in accordance with a data format of the server, comprising;
And the SDK reports the first data field and the second data field to the server according to preset time.
3. A method according to claim 1 or 2, characterized in that if some data in the second data field collected is unsuccessful, null data is reported.
4. A data acquisition device based on configuration rights, characterized in that the device is applied to a data acquisition method comprising the configuration rights according to any one of claims 1 to 3, comprising:
The first connection unit is used for establishing long connection between the SDK and the server;
The first acquisition unit is used for acquiring a first data field and a second data field by the SDK, wherein the first data field is a push necessary field, and the second data field is a push unnecessary field;
The first reporting unit is used for reporting the first data field and the second data field according to the data format of the server by the SDK and adding a first identification variable into a request body of a reporting interface;
The first receiving unit is used for receiving synchronous configuration change information sent by the server when a first identification variable in the request body is inconsistent with a second identification variable of a storage medium in the server, wherein the configuration change information is the second identification variable;
a configuration unit, configured to update the first data field and the second data field according to the configuration change information by using the SDK, and send update result information to the server;
The second acquisition unit is used for acquiring the updated first data field and the updated second data field by the SDK;
And the second reporting unit is used for reporting the updated first data field and the updated second data field according to the data format of the server by the SDK.
CN202011223514.5A 2020-11-05 2020-11-05 Data acquisition method and device based on configuration permission Active CN112463862B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011223514.5A CN112463862B (en) 2020-11-05 2020-11-05 Data acquisition method and device based on configuration permission

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011223514.5A CN112463862B (en) 2020-11-05 2020-11-05 Data acquisition method and device based on configuration permission

Publications (2)

Publication Number Publication Date
CN112463862A CN112463862A (en) 2021-03-09
CN112463862B true CN112463862B (en) 2024-05-17

Family

ID=74825085

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011223514.5A Active CN112463862B (en) 2020-11-05 2020-11-05 Data acquisition method and device based on configuration permission

Country Status (1)

Country Link
CN (1) CN112463862B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107943594A (en) * 2016-10-13 2018-04-20 北京京东尚科信息技术有限公司 Data capture method and device
CN110019270A (en) * 2017-12-20 2019-07-16 腾讯科技（深圳）有限公司 Information updating method and its device, terminal, server, readable storage medium storing program for executing
CN110334076A (en) * 2019-05-31 2019-10-15 广州虎牙信息科技有限公司 Data processing method, system, server and device
CN110502515A (en) * 2019-08-15 2019-11-26 中国平安财产保险股份有限公司 Collecting method, device, equipment and computer readable storage medium
CN110515679A (en) * 2019-08-28 2019-11-29 北京思维造物信息科技股份有限公司 Collecting method, device, equipment and storage medium
CN111090268A (en) * 2020-03-24 2020-05-01 上海飞旗网络技术股份有限公司 Data acquisition method and device based on thread division and data acquisition equipment
CN111752916A (en) * 2019-12-30 2020-10-09 北京沃东天骏信息技术有限公司 Data acquisition method and device, computer readable storage medium and electronic equipment
CN111782727A (en) * 2020-06-28 2020-10-16 平安医疗健康管理股份有限公司 Data processing method and device based on machine learning

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8296358B2 (en) * 2009-05-14 2012-10-23 Hewlett-Packard Development Company, L.P. Method and system for journaling data updates in a distributed file system
CN108684205B (en) * 2017-02-02 2021-10-15 谷歌有限责任公司 Method and system for processing digital components
US10803104B2 (en) * 2017-11-01 2020-10-13 Pearson Education, Inc. Digital credential field mapping
US10885018B2 (en) * 2018-05-07 2021-01-05 Microsoft Technology Licensing, Llc Containerization for elastic and scalable databases

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107943594A (en) * 2016-10-13 2018-04-20 北京京东尚科信息技术有限公司 Data capture method and device
CN110019270A (en) * 2017-12-20 2019-07-16 腾讯科技（深圳）有限公司 Information updating method and its device, terminal, server, readable storage medium storing program for executing
CN110334076A (en) * 2019-05-31 2019-10-15 广州虎牙信息科技有限公司 Data processing method, system, server and device
CN110502515A (en) * 2019-08-15 2019-11-26 中国平安财产保险股份有限公司 Collecting method, device, equipment and computer readable storage medium
CN110515679A (en) * 2019-08-28 2019-11-29 北京思维造物信息科技股份有限公司 Collecting method, device, equipment and storage medium
CN111752916A (en) * 2019-12-30 2020-10-09 北京沃东天骏信息技术有限公司 Data acquisition method and device, computer readable storage medium and electronic equipment
CN111090268A (en) * 2020-03-24 2020-05-01 上海飞旗网络技术股份有限公司 Data acquisition method and device based on thread division and data acquisition equipment
CN111782727A (en) * 2020-06-28 2020-10-16 平安医疗健康管理股份有限公司 Data processing method and device based on machine learning

Also Published As

Publication number Publication date
CN112463862A (en) 2021-03-09

Similar Documents

Publication Publication Date Title
CN108875757B (en) Information auditing method, server and system
CN101073071A (en) Interferring server state in a stateless communication protocol
CN110932918B (en) Log data acquisition method and device and storage medium
CN108509326A (en) A kind of service state statistical method and system based on nginx daily records
CN112506925A (en) Data retrieval system and method based on block chain
CN106992940B (en) Message processing method, device, system and terminal
CN105871585A (en) Terminal association method and device
CN112463863A (en) Cloud platform data acquisition method and device
CN113676533A (en) Transmission channel determination method and system based on data compression of Internet of things
CN112463862B (en) Data acquisition method and device based on configuration permission
CN107545039B (en) Keyword index acquisition method and device, computer equipment and storage medium
CN111125226B (en) Configuration data acquisition method and device
CN111488386A (en) Data query method and device
CN110647448A (en) Mobile application operation log data real-time analysis method, server and system
CN112860456B (en) Log processing method and device
CN110740153A (en) monitoring data acquisition method, system and device
CN114817256A (en) Quick unified storage system of thing networking
CN109685662A (en) Investment data processing method, device, computer equipment and its storage medium
CN109996089B (en) Method and system for processing operation log and streaming media server
CN111063340A (en) Service processing method and device of terminal, terminal and computer readable storage medium
CN110597854A (en) Data classification method based on FE industrial internet and related products
CN210804423U (en) Website information acquisition and release platform system
CN115038089B (en) Multi-terminal data monitoring and collecting method based on information extraction
CN113141366B (en) Message submitting method and device, storage medium and electronic equipment
CN113268363B (en) Global capability-based call tracking method, device, server and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant