CN112069431B - Method and system for realizing intelligent and non-inductive data acquisition - Google Patents
Method and system for realizing intelligent and non-inductive data acquisition Download PDFInfo
- Publication number
- CN112069431B CN112069431B CN202011276776.8A CN202011276776A CN112069431B CN 112069431 B CN112069431 B CN 112069431B CN 202011276776 A CN202011276776 A CN 202011276776A CN 112069431 B CN112069431 B CN 112069431B
- Authority
- CN
- China
- Prior art keywords
- data
- type conversion
- state
- data acquisition
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 27
- 230000001939 inductive effect Effects 0.000 title claims description 21
- 238000006243 chemical reaction Methods 0.000 claims abstract description 162
- 230000001960 triggered effect Effects 0.000 claims abstract description 35
- 238000013524 data verification Methods 0.000 claims abstract description 32
- 238000013480 data collection Methods 0.000 claims abstract description 20
- 238000012545 processing Methods 0.000 claims description 71
- 230000002159 abnormal effect Effects 0.000 claims description 37
- 238000012544 monitoring process Methods 0.000 claims description 15
- 238000012795 verification Methods 0.000 claims description 11
- 230000004913 activation Effects 0.000 claims description 10
- 238000013500 data storage Methods 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 2
- 238000007726 management method Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Tourism & Hospitality (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Primary Health Care (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Human Resources & Organizations (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
When a target office page of an administration service application system is opened, when a client monitors that a functional identification object is triggered, whether a data acquisition trigger object is triggered is continuously monitored, and when the data acquisition trigger object is triggered, sensorless data are acquired from the current target office page according to data acquisition items and are sent to a server; the server side sends the collected data to the big data platform according to the data elements bound by the data collection items and stores the collected data in the corresponding data elements, so that the data of the government affair service application system can be collected without sensing, other government affair service application systems can be used without carrying out data type conversion again, the data sharing use is facilitated, and the problem of data verification vulnerability existing in intelligent data collection without sensing is effectively solved while system resources are prevented from being occupied.
Description
Technical Field
The invention relates to the technical field of government affair information management, in particular to a method and a system for realizing intelligent and non-inductive data acquisition.
Background
Along with the development of information technology, the electronization and informatization of government affairs work becomes the need of government to efficiently manage social affairs, so that the efficiency of government affair processing is greatly improved, and along with the continuous deepening of the informatization degree of government affairs, various government affair application systems are brought into operation, but the existing different government affair application systems are often isolated from each other to form an information isolated island, so that the cost of information maintenance is greatly increased, when business data sharing is carried out among different government affair application systems, only business data of respective application systems can be updated, when workers carry out official affair processing on the government affair service application systems working by the workers, business data needs to be re-entered, the efficiency of affair handling is low, how to conveniently collect data of the government affair service application systems so that the data can be used by other application systems again is a problem in the industry, the prior art also discloses a method and a device for page data collection (patent application publication No. CN 107491488A), the following scheme is adopted in the prior art: traversing all controls in a page, and setting a monitor for the click event of each control; adding a data acquisition code into each monitor; and when a click event is monitored, calling the data acquisition code in the monitor to acquire data of the control. According to the embodiment, automatic data acquisition of all the controls in the page is realized by traversing all the controls in the page and setting the monitor for the click event of the controls, but the data acquired in the prior art cannot be shared and used by other government affair service application systems at once, and can be used only by being imported into other government affair service application systems after data type conversion is carried out again, so that the data sharing is not facilitated.
Disclosure of Invention
The invention aims to solve the technical problem of providing a method and a system for realizing intelligent and non-inductive data acquisition, which can acquire data of a government affair service application system in a non-inductive manner, facilitate data sharing and use, effectively solve the problem of data verification vulnerability in the non-inductive data acquisition and simultaneously avoid system resource occupation.
In order to solve the technical problems, the invention adopts the following technical scheme:
a method for realizing intelligent and non-inductive data acquisition is used for acquiring data in a government affair service application system and comprises the following steps:
pre-establishing all function points under a uniform resource locator of a target office page of a government affair service application system, and configuring each function identification object, a data acquisition trigger object and a data acquisition item of the function points;
presetting a control security domain of a target office page of a government affair service application system, wherein the control security domain comprises office page operation security control and data type conversion security control, the data type conversion state comprises an activation state and an abnormal state, and the office page operation state comprises a working state and an idle state;
binding the data acquisition item with data metadata information of a big data platform;
when the government affair service application system target office page is opened, the client acquires function identification objects, data acquisition trigger objects and data acquisition items of all function points under the uniform resource locator of the government affair service application system target office page;
the client monitors function identification objects and data acquisition trigger objects of all function points under the uniform resource locator of the government affair service application system target office page;
when the client monitors that the functional identification object is triggered, the client continues to monitor whether the data acquisition trigger object is triggered, and when the data acquisition trigger object is triggered, data are acquired from the current target office page in a non-inductive manner according to the data acquisition item;
the method comprises the steps that a client detects a data type conversion state in a control security domain, if the data type conversion state is detected to be an activated state, and an office page operation state is an idle state, the client performs data type conversion on collected data, if the data type conversion is successful, the converted data are sent to a server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, data are collected from a current target office page again according to data collection items, the data type conversion is performed, and then the data are sent to the server;
if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the office page is operated to be an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time;
and after receiving the data, the server sends the acquired data to the big data platform according to the data elements bound by the data acquisition items and stores the acquired data in the corresponding data elements.
In addition, the system for realizing intelligent and non-inductive data acquisition is used for acquiring data in a government affair service application system and comprises the following components:
the system comprises a function point establishing and processing module, a function point establishing and processing module and a function point setting and processing module, wherein the function point establishing and processing module is used for pre-establishing all function points under a uniform resource locator of a target office page of a government affair service application system and configuring each function identification object, data acquisition triggering object and data acquisition item of the function points;
the control security domain setting and processing module is used for presetting a control security domain of a target office page of a government affair service application system, wherein the control security domain comprises office page operation and data type conversion, the data type conversion state comprises an activation state and an abnormal state, and the office page operation state comprises a working state and an idle state;
the binding processing module is used for binding the data acquisition items with data metadata information of the big data platform;
the acquiring and processing module is used for acquiring function identification objects, data acquisition triggering objects and data acquisition items of all function points under the uniform resource locator of the government affair service application system target office page by the client when the government affair service application system target office page is opened;
the monitoring processing module is used for monitoring the function identification objects and the data acquisition triggering objects of all the function points under the uniform resource locator of the government affair service application system target office page by the client;
the data acquisition processing module is used for continuously monitoring whether the data acquisition triggering object is triggered or not when the client monitors that the functional identification object is triggered, and noninductive data acquisition is carried out from the current target handling part page according to the data acquisition item when the data acquisition triggering object is triggered;
the data conversion processing module is used for detecting a data type conversion state in the control security domain by the client, if the data type conversion state is detected to be an activated state and the operation state of the office page is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, and the data is acquired from the current target office page again according to the data acquisition item, is subjected to data type conversion and then is sent to the server;
if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the office page is operated to be an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time;
and the data storage processing module is used for sending the acquired data to the big data platform to be stored in the corresponding data element according to the data element bound by the data acquisition item after the server receives the data.
The invention has the following beneficial effects:
in the method and the system for realizing intelligent and non-inductive data acquisition, all function points under the uniform resource locator of the target office page of the government affair service application system are pre-established, and all function identification objects, data acquisition trigger objects and data acquisition items of the function points are configured; binding the data acquisition item with data metadata information of a big data platform; when the client monitors that the data acquisition triggering object is triggered, noninductive data are acquired from the current target handling part page according to the data acquisition items and are sent to the server; the server side sends the acquired data to the big data platform according to the data elements bound by the data acquisition items and stores the data to the corresponding data elements, namely the data of the government affair service application system can be acquired without sensing;
in addition, the client needs to convert the acquired data into the data of the preset type and send the data to the server, but the problem of data verification vulnerability exists in the prior art, namely, if the client is attacked by a network, an attacker puts distorted data into the acquired data, and when the acquired data is converted into the data type, the acquired data is abnormal due to inconsistency of the acquired data and the distorted data type, so that normal office page operation is influenced, namely, if the data verification is not carried out before the data type conversion, the abnormity is caused, the normal office page operation is influenced, namely, the prior art has data verification vulnerability, and if the acquired data is verified each time, the system resources are greatly occupied, in the invention, a control security domain of the target office page of the government affair service application system is preset, wherein the control security domain comprises the office page operation and the data type conversion, the data type conversion state comprises an activation state and an abnormal state, and the office page operation state comprises a working state and an idle state; after data are collected from the current target office page in a non-inductive way; the method comprises the steps that a client detects a data type conversion state in a control security domain, if the data type conversion state is detected to be an activated state, and an office page operation state is an idle state, the client performs data type conversion on collected data, if the data type conversion is successful, the converted data are sent to a server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, data are collected from a current target office page again according to data collection items, the data type conversion is performed, and then the data are sent to the server; if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the office page is operated to be an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time; therefore, the invention firstly sets the control security domain of the target office page, places the security control of the office page operation and the security control of the data type conversion in the same control security domain, in which control is performed based on the same security policy rules, in which control security domain, performing data type conversion according to different states of the data type conversion operation and the office page operation, can effectively solve the problem of data verification leak, avoid the influence on the page operation of the office file when the data type conversion is abnormal, meanwhile, the data verification is carried out on the collected data only when the data type conversion state in the security domain is controlled to be abnormal, the method and the device can avoid system resources occupied by data verification of the acquired data each time, so that the problem of data verification vulnerability can be effectively solved, and the system resources can be prevented from being occupied.
Drawings
FIG. 1 is a flowchart of a first embodiment of a method for implementing intelligent and non-inductive data collection according to the present invention;
FIG. 2 is a control security domain of a target office page of a government affairs service application system set in the method for realizing intelligent and non-inductive data acquisition
FIG. 3 is a flowchart illustrating a second embodiment of a method for implementing intelligent and non-inductive data collection according to the present invention;
FIG. 4 is a schematic diagram of an embodiment of binding of a data collection item in the business department unified business platform of FIG. 3 with a data element of a big data platform;
FIG. 5 is a flowchart illustrating a method for implementing intelligent and non-inductive data collection according to a third embodiment of the present invention;
FIG. 6 is a schematic diagram of an embodiment of data collection item binding with data elements of a big data platform in the civil system of FIG. 5;
FIG. 7 is a block diagram of an embodiment of a system for implementing intelligent and non-inductive data collection according to the present invention;
fig. 8 is a block diagram of an embodiment of the acquisition processing module of fig. 7.
Detailed Description
Referring to fig. 1, the figure is a flowchart of a first specific embodiment of a method for implementing intelligent non-inductive data acquisition of the present invention, and the method of the present embodiment mainly includes the following steps:
step S101, pre-establishing all function points under a uniform resource locator of a target office page of a government affair service application system, configuring each function identification object, a data acquisition triggering object and a data acquisition item of the function points, and when the function points are specifically implemented, establishing corresponding function points according to specific services of different government affair service application systems, for example, the function points of a marital registration application system can comprise user login, marital reservation registration male information input, female information input and the like, and are not specifically limited, and the data acquisition triggering object can be, for example, various form submission information operation buttons, such as a submission button for male information input or a submission button for female information input, and is also not specifically limited;
it should be noted that there are various data items in a form, not all data items need to be collected, and in this embodiment, data collection items need to be configured, for example, there are various data in a male information input form, and only a few data items need to be collected, for example, only names, identification numbers, addresses, and phones need to be collected, and only names, identification numbers, addresses, and phones need to be configured when configuring data collection items, which is not described herein again;
in addition, the security domains are restricted units executing the same security policy rule, and a group of servers may be a security domain, and a process or an application may also be a security domain, in this embodiment, in step S102, referring to fig. 2, a control security domain of a target office page of the government affairs service application system is preset, where the control security domain includes security control of office page operation and security control of data type conversion, the data type conversion state includes an active state and an abnormal state, the office page operation state includes a working state and an idle state, and in a specific implementation, the data type conversion state may further include other states, which are not specifically limited herein, and the office page operation state may also include other states, which are also not specifically limited herein, in this embodiment, by first setting a control security domain, the control is carried out in the control security domain based on the same security policy rule, the security control of the office page operation and the security control of the data type conversion are controlled in the same control security domain, so that the conflict between the two can be avoided, namely, the exception of the data type conversion cannot influence the office page operation, the exception of the office page operation cannot influence the data type conversion, the problem of data verification leak can be effectively solved, and the influence on the office page operation when the data type conversion is abnormal is avoided;
step S103, binding the data acquisition item with data element information of a big data platform, wherein in the concrete implementation, the big data platform stores data according to the data element, the data element can be various attributes corresponding to a user, such as attribute information of a telephone, an address, a contact person and the like, in the embodiment, the configuration data acquisition item is bound with the data element of the big data platform, such as the data acquisition item is a name, the data element bound with the big data platform is also a name, the data acquisition item is an identity card number, the data element bound with the big data platform is also an identity card number, the data acquisition item is a telephone, the data element bound with the big data platform is also a telephone, and the description is omitted;
step S104, when the government affair service application system target office page is opened, the client acquires the function identification objects, the data acquisition trigger objects and the data acquisition items of all the function points under the uniform resource locator of the government affair service application system target office page, and the following modes can be adopted during specific implementation:
the client sends a uniform resource locator of a target office page of a government affair service application system to the server;
the server side returns the function identification objects, the data acquisition triggering objects and the data acquisition items of all the function points under the uniform resource locator to the client side;
step S105, the client monitors the function identification objects and the data acquisition trigger objects of all function points under the uniform resource locator of the target office page of the government affair service application system, during specific implementation, the client monitors the function identification objects firstly, and continues to monitor the data acquisition trigger objects after monitoring the function identification objects, such as a form submission button of the target office page;
step S106, when the client monitors that the functional identification object is triggered, whether the data acquisition triggering object is triggered or not is continuously monitored, and when the data acquisition triggering object is triggered, data are acquired from the current target office page in a non-inductive manner according to the data acquisition items;
step S107, the client detects a data type conversion state in the control security domain, if the data type conversion state is detected to be an activated state and the office page operation state is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, data is acquired from the current target office page again according to the data acquisition item, the data is converted and then sent to the server;
if the data type conversion state is detected to be an abnormal state, the client performs data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the office page is operated to be an idle state, the client performs data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not performed before the acquired data is subjected to data type conversion next time;
step S108, after receiving the data, the server sends the acquired data to the big data platform according to the data elements bound by the data acquisition items and stores the acquired data to the corresponding data elements, during specific implementation, for example, if the acquired data is a name, the acquired name data is stored to the name data elements of the big data platform, and if the acquired data is an identity card number, the acquired identity card number data is stored to the identity card number data elements of the big data platform, which is not described again;
and step S109, the server side obtains the storage result information returned by the big data platform and records the data acquisition log.
It should be noted that, in the method of this embodiment, the client is a browser plug-in installed in a browser used by a government affair service application system worker, and in addition, the service end in this embodiment is a data engine corresponding to the client, and the data engine can manage each client to perform use case management, function point management, and the like, which is not described herein again.
Referring to fig. 3, which is a flowchart of a second specific embodiment of the method for implementing intelligent and non-sensitive data acquisition according to the present invention, the government affairs service application system of the present embodiment is a business department unified service platform, and the target office page is an external trade operator registration office page of the business department unified service platform, specifically, the method of the present embodiment mainly includes the following steps:
step S201, pre-establishing function points of a registration item page of an external trade operator, configuring a function identification object of the function points as a 'recording and record table management' field which is highlighted above the page, configuring a data acquisition triggering object as a 'save' button, and configuring data acquisition items as item information of 'operator Chinese name', 'operator English name', 'business address' and 'contact telephone';
in step S202, a control security domain of the external trade operator registration event handling page is preset, where the control security domain includes security control of the external trade operator registration event handling page operation and security control of data type conversion, the data type conversion state includes an activation state and an abnormal state, and the handling page operation state includes a working state and an idle state;
step S203, binding the data acquisition items with data element information of the big data platform, namely binding the 'operator Chinese name', 'operator English name', 'business address', 'contact telephone' with data elements of the 'operator Chinese name', 'operator English name', 'business address', 'contact telephone' of the big data platform, as shown in FIG. 4, for example binding the 'operator Chinese name' with data elements which are numbered as 'DT 0005', coded as 'JYZWMC' and named as 'operator Chinese name' in the big data platform in specific implementation;
step S204, when the page of the business department unified service platform is opened, the client acquires a function identification object, a data acquisition triggering object and a data acquisition item of an external trade operator registration office page under the page;
step S205, the client monitors the function identification object 'recording record table management' of the external trade operator registration page;
step S206, when the field of 'recording record table management' appears in the page, whether a 'save' button of a data acquisition triggering object is clicked or not is monitored continuously, and when the 'save' button is monitored to be clicked by a user, data such as 'operator Chinese name', 'operator English name', 'business address', 'contact telephone' of a data acquisition item on the page are acquired;
step S207, the client detects a data type conversion state in a control security domain of an item handling page of an external trade operator, if the data type conversion state is detected to be an activated state, and the operating state of the item handling page is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, and the data is acquired from the item handling page of the current item handling of the external trade operator again according to the data acquisition items and then is sent to the server after the data conversion;
if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the external trade operator registration item handling page is operated to be an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time;
step S208, the client sends the converted data to the server; after receiving the data, the server sends the collected data to the big data platform according to the data elements bound to the data collection items and stores the collected data in corresponding data elements, for example, the traditional name "Shengzhou city stream sink" of the management person who makes the file is stored in the data element with the number "DT 0005" of the big data platform.
Referring to fig. 5, which is a flowchart of a third specific embodiment of the method for implementing intelligent and non-sensitive data acquisition of the present invention, the government affairs service application system of the present embodiment is a civil administration system, and the target office page is an elderly preferential treatment certificate office page of the civil administration system, and the present embodiment includes the following steps:
step S301, pre-establishing a function point of an elderly preferential treatment certificate transaction item page, configuring a function identification object of the function point as a field of 'elderly preferential treatment certificate transaction' awakened above the page, configuring a data acquisition triggering object as an 'addressee' button, and configuring data acquisition items as item information of 'name', 'identity card', 'month of birth', 'home address';
in step S302, a control security domain of the senior citizen preferential treatment item handling page is preset, where the control security domain includes security control of senior citizen preferential treatment item handling page operation and security control of data type conversion, the data type conversion state includes an activation state and an abnormal state, and the item handling page operation state includes a working state and an idle state;
step S303, binding the data collection item with data metadata information of the big data platform, as shown in fig. 6, for example, binding "home address" with data metadata of the big data platform, which is numbered "DT 0008", encoded "JTDZ", and named "home address";
step S304, when the page of the civil administration system is opened, the client acquires a function identification object, a data acquisition triggering object and a data acquisition item of the page for handling the senior citizen preferential treatment certificate under the page;
step S305, the client monitors a function identification object 'senior citizen medical advice handling' of the senior citizen medical advice handling page;
step S306, when the field of 'treatment of senior citizens preferential treatment' appears in the page, whether an 'addressee' button of a data acquisition triggering object is clicked or not is monitored continuously, and when the 'addressee' button is monitored to be clicked by a user, data of data acquisition items 'name', 'ID card', 'month of birth', 'home address' on the page are acquired;
step S307, the client detects a data type conversion state in a control security domain of the senior citizen preferential treatment event handling page, if the data type conversion state is detected to be an activated state and the operating state of the handling page is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, and the data is acquired from the current senior citizen preferential treatment event handling page again according to the data acquisition items and then is sent to the server after the data conversion;
if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the senior citizen prefers to deal with the event handling page to operate into an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time;
step S308, the client sends the converted data to the server, and after the server receives the data, the server sends the acquired data to the big data platform according to the data elements bound by the data acquisition items and stores the acquired data into corresponding data elements, for example, the family address ' Shancun 888 number of Shanzhou pavilion in Shengzhou city in Zhejiang province ' of Shandong province ' of the office is stored into the data element with the number of ' DT0008 ' on the big data platform.
Referring to fig. 7, the figure is a block diagram of a specific embodiment of the system for implementing intelligent non-inductive data acquisition of the present invention, and the system of the present embodiment mainly includes the following modules: a function point establishing processing module 101, a control security domain setting processing module 102, a binding processing module 103, an acquiring processing module 104, a monitoring processing module 105, a data collecting processing module 106, a data converting processing module 107, a data saving processing module 108 and a record processing module 109, wherein
A function point establishing processing module 101, in this embodiment, the function point establishing processing module 101 is mainly used for establishing all function points under a uniform resource locator of a target office page of a government affair service application system in advance, and configuring each function identification object, data acquisition trigger object and data acquisition item of the function point;
a control security domain setting and processing module 102, in this embodiment, the control security domain setting and processing module 102 is mainly used to preset a control security domain of a target office page of a government affair service application system, where the control security domain includes office page operation and data type conversion, the data type conversion state includes an activation state and an abnormal state, and the office page operation state includes a working state and an idle state;
a binding processing module 103, in this embodiment, the binding processing module 103 is mainly used for binding the data acquisition item with data metadata information of the big data platform;
the obtaining processing module 104, in this embodiment, the obtaining processing module 104 is mainly used for obtaining, by the client, the function identifier objects, the data acquisition trigger objects, and the data acquisition items of all the function points under the uniform resource locator of the government affair service application system target page when the government affair service application system target page is opened, and in specific implementation, referring to fig. 8, as a specific embodiment, the obtaining processing module 104 specifically includes:
the request module 1041 is mainly used for the client to send the uniform resource locator of the government affair service application system target office page to the server;
the response module 1042 is mainly used for the server to return the function identification objects, the data acquisition trigger objects and the data acquisition items of all the function points under the uniform resource locator to the client;
the monitoring processing module 105, in this embodiment, the monitoring processing module 105 is mainly used for the client to monitor the function identifier objects and the data acquisition trigger objects of all the function points under the uniform resource locator of the target office page of the government affair service application system, and when the monitoring processing module 105 is specifically implemented, the monitoring processing module 105 may monitor in the following manner:
the client monitors the function identification object first, and continues to monitor the data acquisition trigger object after monitoring the function identification object, such as a form submission button of a target office page, which is not described herein again;
a data acquisition processing module 106, in this embodiment, the data acquisition processing module 106 is mainly configured to, when the client monitors that the functional identification object is triggered, continue to monitor whether the data acquisition trigger object is triggered, and when the data acquisition trigger object is triggered, acquire data from the current target office page in a non-sensing manner according to the data acquisition item and send the data to the server;
a data conversion processing module 107, in this embodiment, the data conversion processing module 107 is mainly used for the client to detect a data type conversion state in the control security domain, if the data type conversion state is detected to be an active state, and an office page operation state is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed to an abnormal state, and the data is acquired from a current target office page again according to the data acquisition item, and then the data is converted and sent to the server;
if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the office page is operated to be an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time;
a data saving processing module 108, in this embodiment, the data saving processing module 108 is mainly used for the server to send the collected data to the big data platform according to the data elements bound to the data collection item and store the data in the corresponding data elements;
the record processing module 109, in this embodiment, the record processing module 109 is mainly used for recording a data acquisition log after the server obtains the storage result information returned by the big data platform.
Similarly, the client in the system of this embodiment is a browser plug-in installed in a browser used by a government affair service application system worker, and in addition, the service end in this embodiment is a data engine corresponding to the client, and the data engine can manage each client to perform use case management, function point management, and the like, which is not described herein again.
The following description is made with a specific embodiment in which a government affair service application system is used as a business department unified service platform, and a target office page is an external trade operator registration affair office page of the business department unified service platform, specifically, in this embodiment, the function point establishing processing module 101 establishes in advance a function point of the external trade operator registration affair office page, a function identification object of the function point is configured as an "entry docket management" field which is highlighted above the page, a data acquisition trigger object is configured as a "save" button, and data acquisition items are event information such as an "operator Chinese name", "operator english name", "business address", "contact phone", and the like;
the control security domain setting and processing module 102 is configured to pre-set a control security domain of a transaction handling page registered by an external trade operator, where the control security domain includes security control of a transaction handling page operation of the external trade operator and security control of data type conversion, the data type conversion state includes an activation state and an abnormal state, and the transaction page operation state includes a working state and an idle state;
the binding processing module 103 binds the data collection items with the data metadata information of the big data platform, for example, binds the "operator Chinese name" with the data metadata which is numbered as "DT 0005", encoded as "JYZWMC" and named as "operator Chinese name" in the big data platform;
when the page of the business department unified service platform is opened, the acquisition processing module 104 acquires a function identification object, a data acquisition triggering object and a data acquisition item of an external trade operator registration page under the page;
the monitoring processing module 105 monitors the function identification object "entry docket management" of the external trade operator registration page; when the field of 'recording record table management' appears in the page, whether a 'save' button of a data acquisition triggering object is clicked or not is monitored continuously, and when the 'save' button is monitored to be clicked by a user, the data acquisition processing module 106 acquires data of data acquisition items 'operator Chinese name', 'operator English name', 'business address', 'contact telephone' and the like on the page;
the data conversion processing module 107 detects a data type conversion state in the control security domain of the external trade operator registration event handling page, if the data type conversion state is detected to be an activated state and the handling page operation state is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, and the data is acquired from the current external trade operator registration event handling page again according to the data acquisition items and then is sent to the server after the data conversion;
if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the external trade operator registration item handling page is operated to be an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time;
the data storage processing module 108 sends the converted data to the server, and after receiving the data, the server sends the acquired data to the big data platform according to the data elements bound to the data acquisition items and stores the acquired data to corresponding data elements, for example, the data element with the number "DT 0005" is stored in the big data platform by the name "stream people living in china" of the operator handling the parts.
The following description is made by taking a government affair service application system as a civil administration system, and taking a target handling page as an old-person preferential treatment certificate handling item handling page of the civil administration system, specifically, the function point establishing module 101 of the embodiment establishes a function point of the old-person preferential treatment certificate handling item page of the civil administration system in advance, a function identification object of the function point is configured as an awakening "old-person preferential treatment" field above the page, a data acquisition triggering object is configured as an "addressee" button, and data acquisition items are item information such as "name", "identity card", "birth year and month", "home address", and the like;
the control security domain setting and processing module 102 presets a control security domain of an senior citizen preferential treatment transaction page, wherein the control security domain comprises security control of senior citizen preferential treatment transaction page operation and security control of data type conversion, the data type conversion state comprises an activation state and an abnormal state, and the transaction page operation state comprises a working state and an idle state;
the binding processing module 103 binds the data acquisition items with data metadata information of the big data platform, for example, binds "home address" with data metadata with the serial number "DT 0008", the code "JTDZ", and the name "home address" in the big data platform;
when the senior preferential treatment certificate handling item page of the civil administration system is opened, the acquisition processing module 104 acquires a function identification object, a data acquisition triggering object and a data acquisition item of the senior preferential treatment certificate handling item page below the page;
the monitoring processing module 105 monitors a function identification object 'senior citizen medical advice handling' of the senior citizen medical advice handling page; when a field of 'treatment of senior citizens preferential treatment' appears in a page, whether an 'addressee' button of a data acquisition triggering object is clicked or not is monitored continuously, and when the fact that a user clicks the 'addressee' button is monitored, data such as a 'name', 'identity card', 'month of birth', 'home address' of a data acquisition item on the page are acquired;
the data conversion processing module 107 detects a data type conversion state in the senior citizen preferential treatment certificate transaction page control security domain, if the data type conversion state is detected to be an activated state and the office page operation state is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, and the data is acquired from the current transaction office page registration item of the external trade operator again according to the data acquisition item and then is sent to the server after the data conversion;
if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is changed into an activated state after the verification is passed, and when the external trade operator registration item handling page is operated to be an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and the data verification is not carried out before the data type conversion is carried out on the acquired data next time;
the data storage processing module 108 sends the converted data to the server, and after receiving the data, the server sends the acquired data to the big data platform according to the data elements bound to the data acquisition items and stores the data into corresponding data elements, for example, the home address "zhejiang province, shengzhou, shangzhou pavilion village 888" is stored into the data element with the big data platform number "DT 0008".
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (10)
1. A method for realizing intelligent and non-inductive data acquisition is used for acquiring data in a government affair service application system, and is characterized by comprising the following steps:
pre-establishing all function points under a uniform resource locator of a target office page of a government affair service application system, and configuring each function identification object, a data acquisition trigger object and a data acquisition item of the function points; binding the data acquisition item with data metadata information of a big data platform;
presetting a control security domain of a target office page of a government affair service application system, wherein the control security domain comprises office page operation security control and data type conversion security control, a data type conversion state for the data type conversion security control comprises an activation state and an abnormal state, and an office page operation state for the office page operation security control comprises a working state and an idle state;
when the client monitors that the data acquisition triggering object is triggered, noninductive data acquisition is carried out from the current target office page according to the data acquisition item;
the method comprises the steps that a client detects a data type conversion state in a control security domain, if the data type conversion state is detected to be an activated state, and an office page operation state is an idle state, the client performs data type conversion on collected data, if the data type conversion is successful, the converted data are sent to a server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, data are collected from a current target office page again according to data collection items, the data type conversion is performed, and then the data are sent to the server; if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is triggered to be changed into an activated state after the verification is passed, when the operation state of the office page is an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and data verification is not carried out before the data type conversion is carried out on the acquired data next time;
and after receiving the data, the server sends the acquired data to the big data platform according to the data elements bound by the data acquisition items and stores the acquired data in the corresponding data elements.
2. The method of claim 1, further comprising:
when the government affair service application system target office page is opened, the client acquires function identification objects, data acquisition trigger objects and data acquisition items of all function points under the uniform resource locator of the government affair service application system target office page;
the client monitors function identification objects and data acquisition trigger objects of all function points under the uniform resource locator of the government affair service application system target office page;
when the client side monitors that the functional identification object is triggered, whether the data acquisition trigger object is triggered or not is continuously monitored.
3. The method of claim 1, further comprising:
and the server side obtains the storage result information returned by the big data platform and records the data acquisition log.
4. The method according to claim 2, wherein the step of obtaining, by the client, the function identification object, the data collection trigger object, and the data collection item of all the function points under the uniform resource locator of the government affairs service application page specifically comprises:
the client sends a uniform resource locator of a target office page of a government affair service application system to the server;
and the server returns the function identification objects, the data acquisition trigger objects and the data acquisition items of all the function points under the uniform resource locator to the client.
5. The method of claim 1, wherein the client is a browser plug-in installed in a browser used by a government services application staff.
6. A system for realizing intelligent and non-inductive data acquisition is used for acquiring data in a government affair service application system and is characterized by comprising:
the system comprises a function point establishing and processing module, a function point establishing and processing module and a function point setting and processing module, wherein the function point establishing and processing module is used for pre-establishing all function points under a uniform resource locator of a target office page of a government affair service application system and configuring each function identification object, data acquisition triggering object and data acquisition item of the function points;
the control security domain setting and processing module is used for presetting a control security domain of a target office page of a government affair service application system, wherein the control security domain comprises office page operation security control and data type conversion security control, the data type conversion state for the data type conversion security control comprises an activation state and an abnormal state, and the office page operation state for the office page operation security control comprises a working state and an idle state;
the binding processing module is used for binding the data acquisition items with data metadata information of the big data platform;
the data acquisition processing module is used for noninductive data acquisition from the current target office page according to the data acquisition items when the client monitors that the data acquisition trigger object is triggered;
the data conversion processing module is used for detecting a data type conversion state in the control security domain by the client, if the data type conversion state is detected to be an activated state and the operation state of the office page is an idle state, the client performs data type conversion on the acquired data, if the data type conversion is successful, the converted data is sent to the server, if the data type conversion is failed, the data type conversion state is triggered to be changed into an abnormal state, and the data is acquired from the current target office page again according to the data acquisition item, is subjected to data type conversion and then is sent to the server; if the data type conversion state is detected to be an abnormal state, the client firstly carries out data verification on the acquired data, the data type conversion state is triggered to be changed into an activated state after the verification is passed, when the operation state of the office page is an idle state, the client carries out data type conversion on the acquired data and then sends the converted data to the server, and data verification is not carried out before the data type conversion is carried out on the acquired data next time;
and the data storage processing module is used for sending the acquired data to the big data platform to be stored in the corresponding data element according to the data element bound by the data acquisition item after the server receives the data.
7. The system of claim 6, further comprising:
the acquiring and processing module is used for acquiring function identification objects, data acquisition triggering objects and data acquisition items of all function points under the uniform resource locator of the government affair service application system target office page by the client when the government affair service application system target office page is opened;
and the monitoring processing module is used for monitoring the function identification objects and the data acquisition trigger objects of all the function points under the uniform resource locator of the government affair service application system target page by the client, and continuously monitoring whether the data acquisition trigger objects are triggered or not when the function identification objects are triggered.
8. The system of claim 6, further comprising:
and the record processing module is used for recording the data acquisition log after the server side obtains the storage result information returned by the big data platform.
9. The system of claim 7, wherein the acquisition processing module specifically comprises:
the request module is used for sending the uniform resource locator of the government affair service application system target office page to the server by the client;
and the response module is used for returning the function identification objects, the data acquisition trigger objects and the data acquisition items of all the function points under the uniform resource locator to the client by the server.
10. The system of claim 6, wherein the client is a browser plug-in installed in a browser used by a government services application staff.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011276776.8A CN112069431B (en) | 2020-11-16 | 2020-11-16 | Method and system for realizing intelligent and non-inductive data acquisition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011276776.8A CN112069431B (en) | 2020-11-16 | 2020-11-16 | Method and system for realizing intelligent and non-inductive data acquisition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112069431A CN112069431A (en) | 2020-12-11 |
| CN112069431B true CN112069431B (en) | 2021-02-02 |
Family
ID=73655578
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011276776.8A Active CN112069431B (en) | 2020-11-16 | 2020-11-16 | Method and system for realizing intelligent and non-inductive data acquisition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112069431B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112308542B (en) * | 2020-12-31 | 2021-03-23 | 浙江非线数联科技股份有限公司 | Method and system for realizing intelligent and non-inductive data input |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101908178A (en) * | 2010-08-13 | 2010-12-08 | 广州联奕信息科技有限公司 | Middleware applied to data switching and data switching method |
| CN108616584A (en) * | 2018-04-19 | 2018-10-02 | 华南师范大学 | A kind of wisdom classroom collecting method and system based on xAPI |
-
2020
- 2020-11-16 CN CN202011276776.8A patent/CN112069431B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112069431A (en) | 2020-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Greenwald | NSA collecting phone records of millions of Verizon customers daily | |
| CN104954322B (en) | A kind of binding processing method of account, apparatus and system | |
| US8145717B2 (en) | System and method for providing presence age information in a unified communication system | |
| WO2016033835A1 (en) | Personal account information security management system and method based on biological characteristic information verification | |
| US20110135073A1 (en) | Methods to improve fraud detection on conference calling systems by detection of conference moderator password utilization from a non-authorized device | |
| US20030070076A1 (en) | System and method for providing personal information about criminal offenders to a plurality of law enforcement agencies | |
| CN102638617A (en) | Active response system based on intrusion detection for Android mobile phones | |
| CN104573611A (en) | Distributed face recognition trunking system | |
| CN104618579A (en) | Mobile terminal and touch calling method thereof | |
| CN107872440B (en) | Identity authentication method, device and system | |
| CN104539721A (en) | Managing method, device and terminal for contact person information | |
| WO2018219007A1 (en) | User login method, electronic device and storage medium in data query system | |
| CN112069431B (en) | Method and system for realizing intelligent and non-inductive data acquisition | |
| CN106940643A (en) | Logical APP systems between the police and the people | |
| US8145184B2 (en) | Protected data capture | |
| CN112308542B (en) | Method and system for realizing intelligent and non-inductive data input | |
| CN108494749B (en) | Method, device and equipment for disabling IP address and computer readable storage medium | |
| JP4856691B2 (en) | Failure information providing system, failure information providing method, and failure information providing program | |
| CN112509277A (en) | Rental house monitoring method, device, equipment and storage medium | |
| JP6212864B2 (en) | Key management system, method and program | |
| US11216900B1 (en) | Investigation systems and methods employing positioning information from non-resident devices used for communications with controlled-environment facility residents | |
| US11843841B2 (en) | Information interaction method and apparatus, and storage medium | |
| KR101380041B1 (en) | Automatic login system and method that use portable terminal | |
| WO2015085940A1 (en) | Mobile terminal antitheft method and client | |
| CN112579996A (en) | Temporary authorization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 335, new financial building, No. 136, Gen TA Xi Road, Taozhu street, Zhuji City, Shaoxing City, Zhejiang Province, 310012 Applicant after: Zhejiang non line Digital Technology Co.,Ltd. Address before: 310012 20 / F, Furun building, 16 Xiangyun Road, Taozhu street, Zhuji City, Shaoxing City, Zhejiang Province Applicant before: ZHEJIANG FAST LINE TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |