CN115296905B - Data acquisition and analysis method and system based on mobile terminal - Google Patents
Data acquisition and analysis method and system based on mobile terminal Download PDFInfo
- Publication number
- CN115296905B CN115296905B CN202210931583.4A CN202210931583A CN115296905B CN 115296905 B CN115296905 B CN 115296905B CN 202210931583 A CN202210931583 A CN 202210931583A CN 115296905 B CN115296905 B CN 115296905B
- Authority
- CN
- China
- Prior art keywords
- data
- index
- transmission
- mobile terminal
- acquiring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 57
- 230000005540 biological transmission Effects 0.000 claims abstract description 196
- 238000012544 monitoring process Methods 0.000 claims abstract description 122
- 238000000034 method Methods 0.000 claims abstract description 43
- 238000013523 data management Methods 0.000 claims abstract description 42
- 208000032370 Secondary transmission Diseases 0.000 claims abstract description 26
- 238000012545 processing Methods 0.000 claims description 40
- 230000032683 aging Effects 0.000 claims description 28
- 238000004891 communication Methods 0.000 claims description 16
- 238000004422 calculation algorithm Methods 0.000 claims description 7
- 239000011159 matrix material Substances 0.000 claims description 7
- 230000003993 interaction Effects 0.000 claims description 6
- 238000012549 training Methods 0.000 claims description 6
- 230000003213 activating effect Effects 0.000 claims description 5
- 238000012300 Sequence Analysis Methods 0.000 claims description 4
- 230000002159 abnormal effect Effects 0.000 abstract description 6
- 238000001514 detection method Methods 0.000 abstract description 4
- 230000000694 effects Effects 0.000 abstract description 4
- 230000008569 process Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000009897 systematic effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000004141 dimensional analysis Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000004451 qualitative analysis Methods 0.000 description 1
- 238000004445 quantitative analysis Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a data acquisition and analysis method and system based on a mobile terminal, and relates to the field of mobile data acquisition, wherein the method comprises the following steps: connecting a background data management system and a mobile terminal data acquisition device to acquire an initial transmission data set and a data transmission channel; transmitting the initial transmission data set to the background data management system according to the data transmission channel; outputting a data monitoring result according to the embedded data monitoring model in the background data management system; generating the secondary data acquisition instruction and acquiring a secondary transmission data set according to the data monitoring result; and updating the initial transmission data set according to the secondary transmission data set. The technical problems of abnormal data transmission and poor integrity caused by the lack of high-performance detection capability of data are solved, an intelligent data monitoring mode is adopted, the data transmission quality is improved, and the technical effects of safety and reliability of the transmitted data are ensured.
Description
Technical Field
The invention relates to the field of mobile terminal data acquisition, in particular to a mobile terminal-based data acquisition analysis method and system.
Background
The data acquisition analysis is a mode of combining software and hardware to acquire and record related data, and then analyzing the data to acquire various information. The application scenes of data acquisition and analysis are wide, different application scenes need to realize different functions, and along with continuous rising of network transaction, network payment and network banking, the transmission mode scenes of data are diversified, so that the data acquired by the mobile terminal data are easy to tamper, and the safety and quality of the data after the data transmission are poor.
At present, in the process of data acquisition and transmission, due to the fact that data lack of high-performance detection capability, data transmission is abnormal, and the technical problem of safety consideration is lacking.
Disclosure of Invention
Aiming at the defects in the prior art, the application solves the technical problems of abnormal data transmission and lack of safety consideration caused by lack of high-performance detection capability of data in the process of data acquisition and transmission by providing the data acquisition and analysis method and the system based on the mobile terminal.
In a first aspect of the present invention, there is provided a data acquisition and analysis method based on a mobile terminal, the method being applied to a data acquisition and analysis system of the mobile terminal, the system being communicatively connected to a background data management system and a data acquisition device of the mobile terminal, the method comprising: acquiring an initial transmission data set according to the mobile terminal data acquisition device; connecting the background data management system with the mobile terminal data acquisition device, analyzing a channel for data transmission, and obtaining a data transmission channel; transmitting the initial transmission data set to the background data management system according to the data transmission channel, wherein a data monitoring model is embedded in the background data management system; according to the data monitoring model embedded in the background data management system, performing multi-index monitoring on the initial transmission data set, and outputting a data monitoring result; judging whether to activate a secondary data acquisition instruction according to the data monitoring result; if the secondary data acquisition instruction is activated, the secondary data acquisition instruction is sent to the mobile terminal data acquisition device, and a secondary transmission data set is acquired; and updating the initial transmission data set according to the secondary transmission data set.
In a second aspect of the present invention, there is provided a system of a data acquisition and analysis method based on a mobile terminal, the system being communicatively connected to a background data management system and a mobile terminal data acquisition device, the system comprising: the mobile terminal data acquisition module is used for acquiring an initial transmission data set according to the mobile terminal data acquisition device; the data channel analysis module is used for connecting the background data management system and the mobile terminal data acquisition device, analyzing a channel for data transmission and acquiring a data transmission channel; the data channel transmission module is used for transmitting the initial transmission data set to the background data management system according to the data transmission channel, wherein a data monitoring model is embedded in the background data management system; the data monitoring analysis module is used for carrying out multi-index monitoring on the initial transmission data set according to the data monitoring model embedded in the background data management system and outputting a data monitoring result; the data acquisition judging module is used for judging whether to activate the secondary data acquisition instruction according to the data monitoring result; the secondary data acquisition module is used for sending the secondary data acquisition instruction to the mobile terminal data acquisition device to acquire a secondary transmission data set if the secondary data acquisition instruction is activated; and the data updating processing module is used for updating the initial transmission data set according to the secondary transmission data set.
In a third aspect of the invention, an electronic device is provided. At least one processor of the electronic device; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect of the invention.
In a fourth aspect of the invention, there is provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of the first aspect of the invention.
The data acquisition and analysis method and system based on the mobile terminal provided by the application have the following technical effects:
The background data management system and the mobile terminal data acquisition device are in communication connection, an initial transmission data set acquired by the mobile terminal data acquisition device is acquired, the initial transmission data set is input into the background management platform according to the connection relation, multi-index monitoring is carried out on the initial transmission data set according to a data monitoring model embedded in the background management platform, a data monitoring result is output, data which cannot be monitored is acquired according to the data monitoring result, a secondary data acquisition instruction is generated by the data which cannot be monitored, the mobile terminal data acquisition device is enabled to acquire secondary data according to the secondary data acquisition instruction, a secondary transmission data set is acquired, and the secondary transmission data set is further used for updating the initial transmission data set, so that the reliability and the accuracy of transmission of the mobile terminal acquisition device are ensured, and the technical effects of improving the data transmission quality and ensuring the safety and the reliability of transmission data are achieved.
The foregoing description is only an overview of the present application, and is intended to be implemented in accordance with the teachings of the present application in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present application more readily apparent.
Drawings
Other features, objects and advantages of the present invention will become more apparent upon reading of the detailed description of non-limiting embodiments, made with reference to the accompanying drawings in which:
fig. 1 is a flow chart of a data acquisition and analysis method based on a mobile terminal according to an embodiment of the application;
Fig. 2 is a schematic flow chart of data monitoring analysis of a data acquisition and analysis method based on a mobile terminal according to an embodiment of the application;
Fig. 3 is a schematic flow chart of secondary transmission parallel analysis of a data acquisition and analysis method based on a mobile terminal according to an embodiment of the application;
fig. 4 is a schematic structural diagram of a system based on a data acquisition and analysis method of a mobile terminal according to an embodiment of the present application;
FIG. 5 is a block diagram of an exemplary electronic device capable of implementing embodiments of the application;
Reference numerals illustrate: the mobile terminal comprises a mobile terminal data acquisition module 11, a data channel analysis module 12, a data channel transmission module 13, a data monitoring and analysis module 14, a data acquisition and judgment module 15, a secondary data acquisition module 16, a data update processing module 17, 500, a CPU,502, a ROM,503, a RAM,504, an I/O interface, 506, an input unit, 507, 508, a storage unit and 509, wherein the electronic device is a communication unit.
Example embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be apparent that the described embodiments are only some embodiments of the present application and not all embodiments of the present application, and it should be understood that the present application is not limited by the example embodiments described herein.
Detailed Description
Example 1
As shown in fig. 1, an embodiment of the present application provides a data acquisition and analysis method based on a mobile terminal, where the method is applied to a data acquisition and analysis system of the mobile terminal, and the system is communicatively connected with a background data management system and a data acquisition device of the mobile terminal, and the method includes:
Step S100: acquiring an initial transmission data set according to the mobile terminal data acquisition device;
The mobile terminal refers to a computer device used in the mobile, because of the problem of lower network communication security of the mobile terminal, the situation that the quality of data received by a receiver is poor after the data is easily transmitted in the process of data acquisition and transmission of the mobile terminal is solved, at present, the process of data acquisition of the mobile terminal does not form a complete and systematic self-checking analysis system, and the abnormal condition of the data transmission is gradually increased due to the continuous development of network communication, wherein the data acquisition analysis is a mode of combining software and hardware to acquire and record related data and then analyzing the data to acquire various information. Along with the diversity of data transmission modes, the data acquired by the mobile terminal is easy to be tampered, and the safety and quality of the data after data transmission are poor, so that a data acquisition and analysis method based on the mobile terminal is proposed, systematic monitoring and model analysis can be carried out on the data acquired by the mobile terminal, and the reliability and accuracy of the data are ensured.
The mobile terminal data acquisition device is any movable data acquisition device, such as a mobile phone, a notebook computer, a tablet personal computer, a POS machine and even a vehicle-mounted computer. It should be understood that, based on the multi-finger mobile phone or the smart mobile phone and the tablet computer with various application functions in detail during the use in a scene, the initial transmission data set is generated according to the fact that the mobile terminal data acquisition device is used for acquiring corresponding requirement data, wherein the initial transmission data set is a basic data set to be analyzed, and is convenient for later data analysis.
Step S200: connecting the background data management system with the mobile terminal data acquisition device, analyzing a channel for data transmission, and obtaining a data transmission channel;
step S300: transmitting the initial transmission data set to the background data management system according to the data transmission channel, wherein a data monitoring model is embedded in the background data management system;
specifically, the background data management system is a system with computing resources and management information, and is in communication connection with the mobile terminal data acquisition device, so that the initial transmission data set is transmitted to the background data management system for subsequent data monitoring analysis, wherein a data monitoring model is embedded in the background data management system, comprehensive index analysis of data can be achieved, and reliability of mobile terminal data acquisition is guaranteed.
Further, as shown in fig. 3, the steps of the embodiment of the present application further include S800:
step S810: acquiring transmission sample data by collecting a data transmission time sequence sample of the data transmission channel;
Step S820: performing transmission delay time sequence analysis according to the transmission sample data to obtain a transmission delay index;
step S830: acquiring a data aging index of the data monitoring model;
Step S840: and judging whether to activate the parallel processing instruction or not by comparing the transmission delay index with the data aging index, and acquiring the secondary transmission data set according to the secondary data acquisition instruction if the parallel processing instruction is not activated.
Further, step S840 of the embodiment of the present application further includes:
Step S841: if the parallel processing instruction is activated, acquiring an index difference value of the transmission delay index and the data aging index;
step S842: according to the index difference value, the initial transmission data set is subjected to phase division to generate a plurality of transmission phases;
step S843: and carrying out data monitoring by the plurality of transmission stages to realize data parallel transmission processing.
Specifically, based on the network connection relationship between the background data management system and the mobile terminal data acquisition device, a transmission channel for data transmission is determined, channel environment analysis is performed, and since the data transmission channel affects the transmission quality of the initial transmission data set, in order to ensure the accuracy of subsequent further analysis, the data transmission channel is acquired to perform subsequent processing, and errors caused to the result of data monitoring analysis due to the influence of the data transmission channel are prevented.
Further, the data timeliness index output from the data monitoring result is called, wherein, because the data timeliness index is the effective degree of the identification data in time, for example, the data change frequency and the data update information of the data source are calculated, the data transmission has delay, so that the error of timeliness exists in the data acquired secondarily, and the error needs to be further reduced, and the process is as follows:
And further determining the transmission time corresponding to the data capacity by carrying out time sequence recording on the data transmission channel, and further obtaining the transmission delay index, wherein the transmission delay index is obtained by calculating according to the corresponding relation between the data capacity and the transmission time, and the inverse proportion coefficient is used for outputting the transmission delay index. Further, comparing the calculated transmission delay index with the data aging index of the data, when the transmission delay index is smaller than the data aging index, not activating the parallel processing instruction, when the transmission delay index is larger than or equal to the data aging index, activating the parallel processing instruction, processing according to the parallel processing instruction, namely, dividing the initial data set according to the index difference value of the transmission delay index and the data aging index, and transmitting the initial data set to a background data management system in sequence in a plurality of transmission stages, wherein each stage corresponds to a data monitoring result, and parallel processing of a plurality of stages corresponds to a plurality of channels is realized, so that on the basis of improving the data transmission integrity, the reliability and the transmission efficiency of the data are improved.
Step S400: according to the data monitoring model embedded in the background data management system, performing multi-index monitoring on the initial transmission data set, and outputting a data monitoring result;
Further, as shown in fig. 2, step S400 of the embodiment of the present application further includes:
step S410: acquiring data source information of the initial transmission data set;
step S420: acquiring a data timeliness index, a data integrity index and a data stability index according to the data source information;
Step S430: performing model training by taking the data timeliness index, the data integrity index and the data stability index as three-dimensional modeling indexes to obtain the data monitoring model, and outputting timeliness index, integrity index and stability index according to the data monitoring model;
Step S440: and outputting the data monitoring result according to the ageing index, the integrity index and the stability index.
Specifically, after the background data management system receives the initial transmission data set, further effective data monitoring of multiple indexes is needed to be performed on the initial transmission data set, and a data monitoring process is mainly implemented by the data monitoring model, wherein the data monitoring model is obtained through multi-index training, and in order to ensure pertinence of the data monitoring model, corresponding adaptive index analysis is needed to be performed according to a data source of the initial transmission data set, wherein the data source information is information for identifying the data source of the initial transmission data set, such as an object for collecting data, a type of data and a relationship of data, so that validity and pertinence of the data monitoring model are ensured.
It should be understood that, the data monitoring model is configured to perform data monitoring, and is capable of identifying a quality level of data, so as to determine a timeliness index, a data integrity index and a data stability index respectively, where the data timeliness index is an effective degree of identifying data in time, for example, calculated by data change frequency and data update information of a data source, and the data integrity index is an effective degree of identifying data in receiving integrity, for example, calculated by data size; the data stability index is the data stability of the identification data during data acquisition, for example, the data stability index is calculated through the duty ratio of abnormal data in the data or the floating degree generated by the data. And then, respectively taking the timeliness index, the data integrity index and the data stability index as three-dimensional analysis indexes, establishing a three-dimensional model to generate the data monitoring model, specifically analyzing the data input in real time according to the data monitoring model, and outputting the corresponding timeliness index, the integrity index and the stability index, thereby outputting the timeliness index, the integrity index and the stability index as the data monitoring result and ensuring the accuracy and the comprehensiveness of the data calculation result.
Further, step S430 of the embodiment of the present application further includes:
step S431: acquiring a data security level by analyzing the data security of the initial transmission data set;
step S432: when the data security level is greater than a preset data security level, activating the data security monitoring model, wherein data interaction is performed between the data security monitoring model and the data monitoring model;
Step S433: and acquiring a transmission security index through grade analysis of a channel encryption algorithm in the data transmission channel.
Further, step S440 of the embodiment of the present application further includes:
step S441: after the data security monitoring model is activated, inputting the transmission security index into the data monitoring model;
Step S442: carrying out standardization processing on the transmission safety index, the aging index, the integrity index and the stability index, constructing an AHP matrix according to an index set after the standardization processing, and outputting configuration weights according to the AHP matrix;
Step S443: and acquiring the data monitoring result according to the configuration weight.
Specifically, since the analysis of the data monitoring result is implemented by further analysis on the data after receiving the transmission, in order to reduce the error of the output result of the data monitoring model, that is, improve the accuracy of the output result of the data monitoring model, the safety analysis is performed on the transmission channel through which the data passes, so as to correct the output data monitoring result.
In detail, the security analysis is performed on the transmission channel through which the data passes, when the security of the data transmission channel is higher, the data transmitted at present is not easy to be attacked by the outside, and when the security of the data transmission channel is lower, the data transmitted at present is easy to be attacked, tampered, copied and the like by the outside, so that the data error of the input source in the input model is further analyzed on the data transmission channel. The data security monitoring method comprises the steps that the data self needs to be analyzed in a security level, when the data security requirement is high, further security monitoring of the data is met, and therefore, the other model connected with the background management system, namely the data security monitoring model, is activated, the analysis process of the data security monitoring model is mainly based on the complexity and the level of an encryption algorithm in a data transmission channel, the further analysis is carried out, and the transmission security index of the data transmission channel for transmitting the initial transmission data set is determined.
Further, after the data security monitoring model is activated, the data security monitoring model is connected with the data monitoring model, and there is a data interaction relationship, so that the transmission security index is used as an index of newly added constraint adjustment, the data monitoring result is adjusted, and the adjustment process is as follows:
And after the transmission safety index is added, the transmission safety index, the aging index, the integrity index and the stability index are formed, and standardized processing is carried out for the calculated data of the transmission safety index, the aging index, the integrity index and the stability index are in a unified reference standard. The analytic hierarchy Process (ANALYTIC HIERARCHY Process, AHP) is a systematic and hierarchical analytic method combining qualitative and quantitative analysis, the construction of an AHP matrix is completed to carry out analytic hierarchy and determination of information entropy value, finally, an output result passing consistency test is output, the output result is configured weight, the configured weight comprises a weight a corresponding to a transmission safety index, a weight b corresponding to an aging index, a weight c corresponding to a complete index and a weight d corresponding to a stability index, weight calculation is carried out according to a, b, c, d and the corresponding transmission safety index, the aging index, the complete index and the stability index, and the data monitoring result is output.
Step S500: judging whether to activate a secondary data acquisition instruction according to the data monitoring result;
Step S600: if the secondary data acquisition instruction is activated, the secondary data acquisition instruction is sent to the mobile terminal data acquisition device, and a secondary transmission data set is acquired;
step S700: and updating the initial transmission data set according to the secondary transmission data set.
Specifically, if the initial transmission data sets are monitored to pass, that is, the secondary data acquisition instruction is not activated, the transmitted initial transmission data sets are classified according to the data monitoring result, including a data set which is monitored to pass and a data set which is monitored to not pass, that is, the secondary data acquisition instruction is activated, an index which is determined to need secondary acquisition according to the data set which is monitored to not pass is added to the corresponding instruction, the instruction is transmitted to the mobile terminal data acquisition device, and the secondary transmission data set is acquired, wherein the secondary transmission data set is based on the corresponding data which is monitored to not pass through the supplementary acquisition, so that the initial transmission data set is updated according to the secondary transmission data set, and the validity and the integrity of the acquired data of the mobile terminal are ensured. The intelligent monitoring system solves the technical problems that data transmission is abnormal and safety consideration is lacking due to the fact that data lacks high-performance detection capability in the process of data acquisition and transmission, intelligent monitoring based on mobile terminal data is adopted, data transmission quality is improved, and safety and reliability of transmitted data are guaranteed.
In combination with the above embodiment, the present invention has the following beneficial effects:
The background data management system and the mobile terminal data acquisition device are in communication connection, an initial transmission data set acquired by the mobile terminal data acquisition device is acquired, the initial transmission data set is input into the background management platform according to the connection relation, multi-index monitoring is carried out on the initial transmission data set according to a data monitoring model embedded in the background management platform, a data monitoring result is output, data which cannot be monitored is acquired according to the data monitoring result, a secondary data acquisition instruction is generated by the data which cannot be monitored, the mobile terminal data acquisition device is enabled to acquire secondary data according to the secondary data acquisition instruction, a secondary transmission data set is acquired, and the secondary transmission data set is further used for updating the initial transmission data set, so that the reliability and the accuracy of transmission of the mobile terminal acquisition device are ensured, and the technical effects of improving the data transmission quality and ensuring the safety and the reliability of transmission data are achieved.
The method comprises the steps of dividing the initial data set according to the index difference value of the transmission delay index and the data aging index, sequentially transmitting the initial data set to a background data management system in a plurality of transmission stages, wherein each stage corresponds to a data monitoring result, and realizing parallel processing of the plurality of stages corresponding to a plurality of channels, so that the reliability and the transmission efficiency of data are improved on the basis of improving the data transmission integrity.
Example two
Based on the same inventive concept as the data acquisition and analysis method based on the mobile terminal in the foregoing embodiment, the present invention further provides a system of the data acquisition and analysis method based on the mobile terminal, as shown in fig. 4, where the system includes:
the mobile terminal data acquisition module 11 is used for acquiring an initial transmission data set according to the mobile terminal data acquisition device;
The data channel analysis module 12 is used for connecting the background data management system and the mobile terminal data acquisition device, analyzing a channel for data transmission and acquiring a data transmission channel;
A data channel transmission module 13, configured to transmit the initial transmission data set to the background data management system according to the data transmission channel, where the background data management system embeds a data monitoring model;
The data monitoring and analyzing module 14 is configured to perform multi-index monitoring on the initial transmission data set according to the data monitoring model embedded in the background data management system, and output a data monitoring result;
the data acquisition judging module 15 is used for judging whether to activate the secondary data acquisition instruction according to the data monitoring result;
the secondary data acquisition module 16 is configured to send the secondary data acquisition instruction to the mobile terminal data acquisition device to obtain a secondary transmission data set if the secondary data acquisition instruction is activated;
And the data updating processing module 17 is used for updating the initial transmission data set according to the secondary transmission data set.
Further, the system further comprises:
a data source acquisition unit, configured to acquire data source information of the initial transmission data set;
The data index analysis unit is used for acquiring a data timeliness index, a data integrity index and a data stability index according to the data source information;
The monitoring model training unit is used for carrying out model training by taking the data timeliness index, the data integrity index and the data stability index as three-dimensional modeling indexes to obtain the data monitoring model, and outputting the timeliness index, the integrity index and the stability index according to the data monitoring model;
And the monitoring result output unit is used for outputting the data monitoring result according to the ageing index, the integrity index and the stability index.
Further, the system further comprises:
the data security analysis unit is used for obtaining the data security level by analyzing the data security of the initial transmission data set;
The data safety judging unit is used for activating the data safety monitoring model when the data safety level is greater than a preset data safety level, wherein the data safety monitoring model and the data monitoring model are in data interaction;
and the encryption algorithm analysis unit is used for obtaining the transmission security index through the channel encryption algorithm grade analysis in the data transmission channel.
Further, the system further comprises:
the safety index transmission unit is used for inputting the transmission safety index into the data monitoring model after the data safety monitoring model is activated;
The weight configuration analysis unit is used for carrying out standardized processing on the transmission safety index, the aging index, the integrity index and the stability index, constructing an AHP matrix according to an index set after the standardized processing, and outputting configuration weights according to the AHP matrix;
And the weight calculation output unit is used for acquiring the data monitoring result according to the configuration weight.
Further, the system further comprises:
The time sequence sample acquisition unit is used for acquiring transmission sample data by carrying out data transmission time sequence sample acquisition on the data transmission channel;
the transmission delay analysis unit is used for carrying out transmission delay time sequence analysis according to the transmission sample data to obtain a transmission delay index;
The data aging analysis unit is used for acquiring the data aging index of the data monitoring model;
and the parallel processing judging unit is used for judging whether to activate the parallel processing instruction by comparing the transmission delay index with the data aging index, and acquiring the secondary transmission data set according to the secondary data acquisition instruction if the parallel processing instruction is not activated.
Further, the system further comprises:
the exponent difference calculation unit is used for acquiring an exponent difference value of the transmission delay exponent and the data aging exponent if the parallel processing instruction is activated;
The data phase dividing unit is used for dividing the initial transmission data set into phases according to the index difference value to generate a plurality of transmission phases;
And the parallel transmission processing unit is used for monitoring the data in the plurality of transmission stages to realize the parallel transmission processing of the data.
According to an embodiment of the present invention, the present invention also provides an electronic device and a readable storage medium.
Fig. 5 shows a schematic block diagram of an electronic device that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
The device 500 comprises a computing unit 501 that may perform various suitable actions and processes in accordance with a computer program stored in a Read Only Memory (ROM) 502 or loaded from a storage unit 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data required for the operation of the device 500 can also be stored. The computing unit 501, ROM 502, and RAM503 are connected to each other by a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
Various components in the device 500 are connected to the I/O interface 505, including: an input unit 506 such as a keyboard, a mouse, etc.; an output unit 507 such as various types of displays, speakers, and the like; a storage unit 508 such as a magnetic disk, an optical disk, or the like; and a communication unit 509 such as a network card, modem, wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 501 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 501 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 501 performs the respective methods and processes described above, for example, the methods S100 to S700. For example, in some embodiments, methods S100-S700 may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 500 via the ROM 502 and/or the communication unit 509. When the computer program is loaded into RAM 503 and executed by computing unit 501, one or more steps of methods S100-S700 described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform the methods S100-S700 by any other suitable means (e.g. by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present invention may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
Those of ordinary skill in the art will appreciate that the various illustrative apparatus and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. The above embodiments are merely specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present invention, and the changes and substitutions are intended to be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (7)
1. The data acquisition and analysis method based on the mobile terminal is characterized in that the method is applied to a data acquisition and analysis system of the mobile terminal, and the system is in communication connection with a background data management system and a data acquisition device of the mobile terminal, and the method comprises the following steps:
acquiring an initial transmission data set according to the mobile terminal data acquisition device;
connecting the background data management system with the mobile terminal data acquisition device, analyzing a channel for data transmission, and obtaining a data transmission channel;
Transmitting the initial transmission data set to the background data management system according to the data transmission channel, wherein a data monitoring model is embedded in the background data management system;
according to the data monitoring model embedded in the background data management system, performing multi-index monitoring on the initial transmission data set, and outputting a data monitoring result;
Judging whether to activate a secondary data acquisition instruction according to the data monitoring result;
If the secondary data acquisition instruction is activated, the secondary data acquisition instruction is sent to the mobile terminal data acquisition device, and a secondary transmission data set is acquired;
updating the initial transmission data set according to the secondary transmission data set;
The method further comprises the steps of:
acquiring data source information of the initial transmission data set;
acquiring a data timeliness index, a data integrity index and a data stability index according to the data source information;
Performing model training by taking the data timeliness index, the data integrity index and the data stability index as three-dimensional modeling indexes to obtain the data monitoring model, and outputting timeliness index, integrity index and stability index according to the data monitoring model;
Outputting the data monitoring result according to the ageing index, the integrity index and the stability index;
The method further comprises the steps of:
acquiring transmission sample data by collecting a data transmission time sequence sample of the data transmission channel;
performing transmission delay time sequence analysis according to the transmission sample data to obtain a transmission delay index;
acquiring a data aging index of the data monitoring model;
and judging whether to activate the parallel processing instruction or not by comparing the transmission delay index with the data aging index, and acquiring the secondary transmission data set according to the secondary data acquisition instruction if the parallel processing instruction is not activated.
2. The method of claim 1, wherein the background data management system further comprises a data security monitoring model, the method further comprising:
Acquiring a data security level by analyzing the data security of the initial transmission data set;
When the data security level is greater than a preset data security level, activating the data security monitoring model, wherein data interaction is performed between the data security monitoring model and the data monitoring model;
and acquiring a transmission security index through grade analysis of a channel encryption algorithm in the data transmission channel.
3. The method of claim 2, wherein the method further comprises:
after the data security monitoring model is activated, inputting the transmission security index into the data monitoring model;
carrying out standardization processing on the transmission safety index, the aging index, the integrity index and the stability index, constructing an AHP matrix according to an index set after the standardization processing, and outputting configuration weights according to the AHP matrix;
And acquiring the data monitoring result according to the configuration weight.
4. The method of claim 1, wherein the method further comprises:
if the parallel processing instruction is activated, acquiring an index difference value of the transmission delay index and the data aging index;
according to the index difference value, the initial transmission data set is subjected to phase division to generate a plurality of transmission phases;
and carrying out data monitoring by the plurality of transmission stages to realize data parallel transmission processing.
5. A system for a mobile terminal-based data acquisition and analysis method, the system being in communication connection with a background data management system and a mobile terminal data acquisition device, the system comprising:
the mobile terminal data acquisition module is used for acquiring an initial transmission data set according to the mobile terminal data acquisition device;
The data channel analysis module is used for connecting the background data management system and the mobile terminal data acquisition device, analyzing a channel for data transmission and acquiring a data transmission channel;
The data channel transmission module is used for transmitting the initial transmission data set to the background data management system according to the data transmission channel, wherein a data monitoring model is embedded in the background data management system;
The data monitoring analysis module is used for carrying out multi-index monitoring on the initial transmission data set according to the data monitoring model embedded in the background data management system and outputting a data monitoring result;
The data acquisition judging module is used for judging whether to activate the secondary data acquisition instruction according to the data monitoring result;
the secondary data acquisition module is used for sending the secondary data acquisition instruction to the mobile terminal data acquisition device to acquire a secondary transmission data set if the secondary data acquisition instruction is activated;
The data updating processing module is used for updating the initial transmission data set according to the secondary transmission data set;
The data monitoring and analyzing module is further used for:
acquiring data source information of the initial transmission data set;
acquiring a data timeliness index, a data integrity index and a data stability index according to the data source information;
Performing model training by taking the data timeliness index, the data integrity index and the data stability index as three-dimensional modeling indexes to obtain the data monitoring model, and outputting timeliness index, integrity index and stability index according to the data monitoring model;
Outputting the data monitoring result according to the ageing index, the integrity index and the stability index;
the secondary data acquisition module is further used for:
acquiring transmission sample data by collecting a data transmission time sequence sample of the data transmission channel;
performing transmission delay time sequence analysis according to the transmission sample data to obtain a transmission delay index;
acquiring a data aging index of the data monitoring model;
and judging whether to activate the parallel processing instruction or not by comparing the transmission delay index with the data aging index, and acquiring the secondary transmission data set according to the secondary data acquisition instruction if the parallel processing instruction is not activated.
6. An electronic device comprising at least one processor; and
A memory communicatively coupled to the at least one processor; it is characterized in that the method comprises the steps of,
The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-4.
7. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210931583.4A CN115296905B (en) | 2022-08-04 | 2022-08-04 | Data acquisition and analysis method and system based on mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210931583.4A CN115296905B (en) | 2022-08-04 | 2022-08-04 | Data acquisition and analysis method and system based on mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115296905A CN115296905A (en) | 2022-11-04 |
| CN115296905B true CN115296905B (en) | 2024-06-04 |
Family
ID=83825865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210931583.4A Active CN115296905B (en) | 2022-08-04 | 2022-08-04 | Data acquisition and analysis method and system based on mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115296905B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115453254B (en) * | 2022-11-11 | 2023-05-02 | 浙江万胜智能科技股份有限公司 | Power quality monitoring method and system based on special transformer acquisition terminal |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104638764A (en) * | 2015-01-22 | 2015-05-20 | 国家电网公司 | Intelligent state diagnosis and overhauling system for power distribution network equipment |
| CN107302450A (en) * | 2017-06-13 | 2017-10-27 | 国网冀北电力有限公司信息通信分公司 | A kind of data acquisition session variation and device |
| CN110782048A (en) * | 2019-10-25 | 2020-02-11 | 贵州电网有限责任公司 | Power distribution equipment state evaluation and maintenance suggestion system |
| CN111143334A (en) * | 2019-11-13 | 2020-05-12 | 深圳市华傲数据技术有限公司 | Data quality closed-loop control method |
| CN112506903A (en) * | 2020-12-02 | 2021-03-16 | 苏州龙石信息科技有限公司 | Data quality representation method using sample line |
| CN113434448A (en) * | 2021-06-09 | 2021-09-24 | 湖州市吴兴区数字经济技术研究院 | Digital economic data acquisition system and method based on 5G communication |
| CN113806430A (en) * | 2021-06-07 | 2021-12-17 | 广发银行股份有限公司 | Multifunctional data management platform |
| CN113836187A (en) * | 2020-06-08 | 2021-12-24 | 腾讯科技（深圳）有限公司 | Data processing method, device, server and computer readable storage medium |
| CN114298863A (en) * | 2022-03-11 | 2022-04-08 | 浙江万胜智能科技股份有限公司 | Data acquisition method and system of intelligent meter reading terminal |
| CN114331761A (en) * | 2022-03-15 | 2022-04-12 | 浙江万胜智能科技股份有限公司 | Equipment parameter analysis and adjustment method and system for special transformer acquisition terminal |
-
2022
- 2022-08-04 CN CN202210931583.4A patent/CN115296905B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104638764A (en) * | 2015-01-22 | 2015-05-20 | 国家电网公司 | Intelligent state diagnosis and overhauling system for power distribution network equipment |
| CN107302450A (en) * | 2017-06-13 | 2017-10-27 | 国网冀北电力有限公司信息通信分公司 | A kind of data acquisition session variation and device |
| CN110782048A (en) * | 2019-10-25 | 2020-02-11 | 贵州电网有限责任公司 | Power distribution equipment state evaluation and maintenance suggestion system |
| CN111143334A (en) * | 2019-11-13 | 2020-05-12 | 深圳市华傲数据技术有限公司 | Data quality closed-loop control method |
| CN113836187A (en) * | 2020-06-08 | 2021-12-24 | 腾讯科技（深圳）有限公司 | Data processing method, device, server and computer readable storage medium |
| CN112506903A (en) * | 2020-12-02 | 2021-03-16 | 苏州龙石信息科技有限公司 | Data quality representation method using sample line |
| CN113806430A (en) * | 2021-06-07 | 2021-12-17 | 广发银行股份有限公司 | Multifunctional data management platform |
| CN113434448A (en) * | 2021-06-09 | 2021-09-24 | 湖州市吴兴区数字经济技术研究院 | Digital economic data acquisition system and method based on 5G communication |
| CN114298863A (en) * | 2022-03-11 | 2022-04-08 | 浙江万胜智能科技股份有限公司 | Data acquisition method and system of intelligent meter reading terminal |
| CN114331761A (en) * | 2022-03-15 | 2022-04-12 | 浙江万胜智能科技股份有限公司 | Equipment parameter analysis and adjustment method and system for special transformer acquisition terminal |
Non-Patent Citations (3)
| Title |
|---|
| 基于主成分分析法和层次分析法的手持抄表掌机采集数据性能评估;王建楠;梁捷;梁志坚;;广西电力;20180228(第01期);全文 * |
| 大数据质量测度模型构建;莫祖英;;情报理论与实践;20180330(第03期);全文 * |
| 电网线损数据质量治理技术研究;姚劲松;辛永;黄文思;陆鑫;陈婧;霍成军;;工业仪表与自动化装置;20180415(第02期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115296905A (en) | 2022-11-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115296905B (en) | Data acquisition and analysis method and system based on mobile terminal | |
| CN117474091A (en) | Knowledge graph construction method, device, equipment and storage medium | |
| CN115328621B (en) | Transaction processing method, device, equipment and storage medium based on block chain | |
| CN113452700B (en) | Method, device, equipment and storage medium for processing safety information | |
| CN112379967B (en) | Simulator detection method, device, equipment and medium | |
| CN115408297A (en) | Test method, device, equipment and medium | |
| CN115203158A (en) | Data comparison method, device, equipment and storage medium | |
| CN114091909A (en) | Collaborative development method, system, device and electronic equipment | |
| CN113807391A (en) | Task model training method and device, electronic equipment and storage medium | |
| CN114546799A (en) | Point burying log checking method and device, electronic equipment, storage medium and product | |
| CN113760675A (en) | Load prediction method and apparatus, electronic device, and computer-readable storage medium | |
| CN110647519B (en) | Method and device for predicting missing attribute value in test sample | |
| CN114580543B (en) | Model training method, interaction log analysis method, device, equipment and medium | |
| CN115422555B (en) | Back door program detection method and device, electronic equipment and storage medium | |
| CN114791996B (en) | Information processing method, device, system, electronic equipment and storage medium | |
| CN116208910A (en) | Region determination method, device, equipment and storage medium | |
| CN116258576A (en) | Abnormal transaction identification method, device, equipment, storage medium and product | |
| CN116305324A (en) | Host safety protection method, device, equipment and storage medium | |
| CN115964279A (en) | Test method, test device, electronic equipment and storage medium | |
| CN116932033A (en) | Component packaging method and device, electronic equipment and storage medium | |
| CN118134590A (en) | Information transmission method, device, equipment and storage medium | |
| CN114898060A (en) | Method, apparatus, device, medium and product for processing data | |
| CN117331924A (en) | Data model matching degree checking method, device, equipment and storage medium | |
| CN114647578A (en) | System test method, device, equipment and storage medium | |
| CN114064002A (en) | Software development kit generation method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |