CN113344731B - Automatic collection and integration system and method for randomly reporting scattered data - Google Patents

Abstract

The invention relates to an automatic collection and integration system for random reporting scattered data, which is characterized in that: the system comprises a WeChat group, a WeChat automatic processing module, an information reporting and format specification, file setting and program control on an external network computer, a file transfer generating module and a network switching, fusing and application module. The automatic collection and integration method comprises the following steps: establishing a micro-letter group, reporting data, an external network computer program, network switching and an internal network computer program. The method is suitable for changing the original manual random scattered telephone reporting data into the scene of automatic collection and integration, has the advantages of practicality, economy and convenience of basic units, enables first-line personnel to be better and more willing to use, and reduces the burden of basic groups.

Description

Automatic collection and integration system and method for randomly reporting scattered data

Technical Field

The invention relates to a computer and WeChat, in particular to an automatic collection and integration system and a method for randomly reporting scattered data.

Background

In the traditional power grid dispatching system, after a regional dispatcher at night takes over the work, all power plants, substations and operators on duty of large users (hereinafter referred to as 'plant stations') managed by the regional dispatcher at night randomly and successively send related data to dispatching by telephone, the operators on duty receive the data by telephone and then manually record the data on a table, and hundreds of random scattered telephones are required to be continued until 0: and can be ended after about 30 minutes. And finally, the dispatcher inputs the collected data into the webpage of the reporting system one by one through a series of operations. The work is continued from the first half of the day to the early morning, and is very hard and very prone to careless mistakes and mistakes when a person sleeps deeply.

Along with the continuous improvement of the automation level of power grid dispatching, a considerable part of data can be inquired and acquired from application systems such as an energy management system, an electric quantity charging system, a user electricity consumption information acquisition system and the like at present, but a part of data is not acquired in each application system, and the data still needs to be reported by operators on duty of each station through telephones. The traditional method for randomly reporting and receiving scattered data by telephone has severely limited the improvement of the automation level of power grid dispatching, and the invention aims to solve the bottleneck problem.

Disclosure of Invention

The technical problems to be solved by the invention are as follows: the method of broadcasting data by telephone of the station is changed into micro-message broadcasting, a dispatching terminal logs in micro-message on an external network computer, and the RPA program is used for automatically interacting, judging and feeding back with each station micro-message group, collecting and integrating the reported data, and the data are coded by a variable key, stored in ciphertext and transmitted in plain text.

One of the solutions of the present invention for solving the technical problems is: an automatic collection and integration system for randomly reporting scattered data, which is characterized in that: the system comprises a WeChat group, a WeChat automatic processing module, an information reporting and format specification, file setting and program control on an external network computer, a transfer file generating module, a network switching and fusing and application module:

The WeChat group is to create a WeChat group containing the operator on duty of the reported data for each station in the dispatching WeChat application, and is used for reporting the data to be reported in the WeChat group according to the required format.

The automatic WeChat processing module is a Windows version WeChat application which is monitored and controlled by an RPA program at a dispatching end and is operated on an external network computer, and is used for automatically interacting, judging and feeding back with WeChat groups of each plant and station, collecting and integrating reported data, including program preparation and initialization, information monitoring and collecting, unread information group name data generating, data reading and storing and ciphertext coding, and is a program for monitoring new information sent from each plant and station group in real time on the external network computer, and reading, judging, storing or replying the new information.

The information reporting and format specification comprises the requirements of time, information format and data unit of reporting data, and is used for specifying the requirements of micro-letter groups, group members of reporting data of each station user, time, information format and data unit of reporting data in the groups and the like.

The file setting and program control on the external network computer is to set a folder on the hard disk of the external network computer, wherein the folder comprises a setting file, a data file and a transmission file, a flow file and a control panel are set in the RPA program folder, three files are monitored, collected and transmitted, the files are used for setting and storing the number, group name and running state of data reporting units, the files of data reported by each data reporting unit stored in the running process of the program are automatically generated, the data files of plain text are transmitted between the network computers adopting physical isolation measures, and the file setting and the program control are set through the control panel.

The transfer file generation module is a subroutine for converting WPS files in xlsx format of ciphertext into text-storing files in Dat format.

The network switch comprises a KVM switch and a data transmission U disk, and is used for fast transmission of data between two or more network computers taking physical isolation measures.

The fusion and application module is composed of a ciphertext decoding subprogram and a data fusion and application subprogram which run on an internal network computer and is used for fusing a complete data file with data files respectively acquired from an EMS system, an electric energy acquisition system and a user electricity consumption information acquisition system to obtain complete running data of regional power grid dispatching and provide complete data source support for regional power grid dispatching analysis and report forms.

Further, the information reporting and format specification specifically includes the following items:

the method comprises the steps that a WeChat group taking a station name as a group name is respectively established on a scheduling WeChat application, the WeChat group comprises all operators on duty reporting data of the station, and each data reporting operator cannot modify the group name, but is allowed to modify remarks; the names and the number of the micro-letter groups are unified with the content of the setting file, data to be reported are reported in the micro-letter groups by data reporting personnel every day according to the set time, and the reported data must contain a date key word, which is a unique information identification code when the micro-letter automatic processing module collects the data;

Secondly, the data information reporting format requires line entry, names and data are separated by colon, and the colon does not separate Chinese and English and is omitted; the first row is a data date, the date is 8 digits, the first 4 digits are the year of the male element, the 5 th and 6 th digits are months, the 7 th and 8 th digits are days, and if the month and the days are less than 10, 0 is supplemented on ten digits; reporting data in kilowatt-hour unit;

according to the method, in the WeChat automatic processing module, a plurality of fault-tolerant formats are set for the information identification code, the possible date and time formats, the bar, the inclined bar connectors and the like in the reported information are enumerated one by one, fault-tolerant correction is carried out, and when the information cannot be identified, the WeChat automatic processing module simulates the WeChat sending process to automatically reply the information to the group so as to enable the information to be retransmitted, so that the integrity of data is ensured.

Further, the file setting and program control on the external network computer is to set a folder on the hard disk of the external network computer, which comprises a setting file, a data file and a transfer file, and set a flow file and a control panel in the RPA program folder, and three files of monitoring, collecting and data transfer:

(1) Setting file

The set file is a group name set file of the data reporting unit, is a WPS file in xlsx format, and is used for setting and storing the number, group name and running state of the data reporting unit; the serial number is used for determining the storage position of the data reported by the unit in the data file, the running state has two choices of running and suspending, and when the user is in the suspending state, the program automatically skips the unit when running;

(2) Data file

The data file is an xlsx WPS file, is automatically generated in the process of program operation and stores data reported by each data reporting unit, and is provided with opening permission protection for the sake of data security, and the stored data is encoded ciphertext;

(3) Delivering files

The transfer file is a Txt file in dat format, and is a plain text file which is automatically generated from the complete data file through a program and is used for transmitting data between network computers taking physical isolation measures; the text file stores a Json character string converted from a two-dimensional array, wherein the data is a coded ciphertext;

(4) Control panel

The control panel is a user interaction setting interface program module, and by running the program module, a user can conveniently set information such as a WeChat. Exe installation path, a work directory, a monitoring frequency, a USB flash disk character, a USB flash disk password, a USB flash disk data storage area, date change time, timing automatic running time, a storage area of the user in a setting file, whether data is plaintext or ciphertext, and the like; after the information is input or modified through the control panel, the information is stored in a text file named Config. Cfg in the form of a dictionary Json character string so as to be called at any time in the running process of the program, and the method is a means for adapting the program to the personalized setting parameters of different users; meanwhile, a text file named ybhRec is also arranged in the RPA program folder, and a data dictionary of the reported user name and the interruption time when the monitoring program is temporarily interrupted is stored.

Further, the WeChat automatic processing module includes program preparation and initialization, information monitoring and collection, unread information group name number group generation, data reading and storage and ciphertext coding, and is used for monitoring new information sent from each station user group in real time, and reading, judging, storing or replying the new information, and the WeChat automatic processing module includes the following subprogram:

preparing and initializing a program:

(1) initializing variables: the program starts to define each related variable and array, and reads the stored information in Config.Cfg and ybhRec.Rec files as the initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) placing the WeChat window in an active state: prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state;

Monitoring and collection of information: the method comprises the steps of periodically and circularly detecting unread information, decoding the information which is successfully subjected to trial reading, encoding by a cipher code subprogram, storing, and simultaneously outputting the factory and family data which is successfully read in the cycle, a factory and family group name set which is successfully read up to the moment and other factory and family not yet reported data to a view output window, and automatically replying the information which is failed in trial reading, checking and reporting again;

generating unread information group names: automatically searching unread information and sending the unread information into a well-defined array of station family group names;

reading and storing data: searching each piece of information in a dialogue box one by one for the group names of the unread information group name array, acquiring the last text containing the information mark, cutting the character string, storing the obtained character string in a data file after the key coding, and simultaneously, recording the plant station group names into a reported user set;

encoding ciphertext: obtaining a coding key through the operation of a time function and the setting in the control panel, converting the captured data into ASCII codes, superposing the converted ASCII codes and the key to generate ciphertext codes, storing the ciphertext codes in a data file in a background color, and hiding a WPS editing column; the data file is converted into a two-dimensional array by reading the worksheet region command, then the two-dimensional array is converted into a Json character string, and then the Json character string is written into the transfer file, so that the plain text ciphertext transfer file is generated.

Furthermore, the network switch comprises a KVM switch and a data transmission U disk, the KVM switch is used for connecting the two network computers together, the transmission file is copied into the internal network computer in a mode of isolating an internal network from an external network through the internal network U disk, and in order to ensure data safety, the transmission file adopts a plain text ciphertext file.

Further, the fusion and application module is composed of a ciphertext decoding subprogram and a data fusion and application subprogram which run on an internal network computer:

the ciphertext decoding subprogram comprises: the transfer file is decoded on an internal network computer, and the decoding process is the inverse process of the encoding process, namely, firstly reading the transfer file to Json character string variables, and then converting the transfer file into objects to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS table file through a writing area command, thereby obtaining a complete decoding data file;

the data fusion and application subroutines: after decoding, the transfer file obtains a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively collected from the EMS system, the electric energy collection system and the user electricity consumption collection system to obtain complete operation data of regional power grid dispatching, so that complete data source support is provided for regional power grid dispatching analysis and report forms.

The second scheme for solving the technical problem is as follows: an automatic collection and integration method for randomly reporting scattered data is characterized by comprising the following steps: the method comprises the steps of establishing a micro-message group, reporting data, operating an external network computer program, switching a network and operating an internal network computer program, and specifically comprises the following steps:

1) Establishing a WeChat group and reporting data

Creating a micro-letter group containing the operator of the reported data for each plant station in the dispatching micro-letter application, and reporting the data to be reported in the micro-letter group according to a required format by the operator of the reported data;

2) External network computer program operation

The external network computer program operation includes:

preparing and initializing a program;

periodically and circularly detecting unread information;

generating an unread message group name array;

performing information trial reading;

encoding and storing ciphertext;

the method comprises the steps that (1) the whole read information is completely read or the artificial termination is performed;

generating a transfer file;

3) Network switching

Connecting two network computers together by using a KVM switch, copying the transmission file into the internal network computer in an internal network and external network isolation mode by using an internal network U disk;

4) Internal network computer program operation

The internal network computer program operation includes:

Decoding a transmission file;

2, fusing data;

and (3) data application.

Further, the step 2) of running the external network computer program specifically includes:

program preparation and initialization

Timing cycle detection of unread information

Setting a large cycle timing cycle to detect unread information, wherein the cycle interval time is set by the detection frequency in the control panel, and the detection is carried out once every interval set time;

generating unread message group name number group

Automatically searching unread information and sending the unread information into a well-defined array of station family group names;

fourth step of information trial reading

The unread information of the cyclic detection is subjected to trial reading, the information of the trial reading success is read and then is transmitted to a ciphertext coding subprogram, meanwhile, the data of the station family which is successfully read in the cyclic reading at the present time, the station family group name set which is successfully read so far and the station family which are not yet reported data are output to a view output window, and the information of the trial reading failure is automatically returned to be checked and then reported again;

ciphertext encoding and storing

Reading the information successfully tested and reading, then transmitting the information to a ciphertext coding subprogram, and storing the information after coding by the ciphertext coding subprogram;

full read of unread information or artificial termination of the sixth step

Completely reading unread information detected by circulation or manually stopping reading the information according to the need;

signaling file generation

Storing the ciphertext code in a data file in a background color and hiding the WPS editing column; the data file is converted into a two-dimensional array by reading the worksheet region command, then the two-dimensional array is converted into a Json character string, and then the Json character string is written into the transfer file, so that the plain text ciphertext transfer file is generated.

Further, the step of preparing and initializing the program is as follows:

(1) initializing variables: the program starts to define each related variable and array, and reads the stored information in Config.Cfg and ybhRec.Rec files as the initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) Placing the WeChat window in an active state: and prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state.

Further, the step 2) the internal network computer program running includes:

method and system for decoding a file

Decoding a transfer file on an internal network computer, firstly reading the transfer file to a Json character string variable, and then converting the transfer file into an object to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS file through a writing area command, thereby obtaining a complete decoding data file;

data fusion of (C)

The transmitted file is decoded to obtain a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system;

data application

And merging the decoded complete WPS-format data file with the WPS-format data files respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system to obtain regional power grid dispatching complete operation data, thereby providing complete data source support for regional power grid dispatching analysis and report forms.

The beneficial effects of the invention are as follows:

(1) The night shift dispatcher can averagely reduce the number of calls received for 60 times per day;

(2) Average daily reduction of 200 more records of data;

(3) The psychological pressure of night shift dispatchers is relieved;

(4) The accuracy of the data is improved;

(5) The dispatching office automation level and the working efficiency are improved.

The invention is suitable for changing the original manual random scattered telephone reporting data into the automatic collecting and integrating scene, has practicality, economy and convenience of basic units, and has the advantages of better and more willing use for first-line staff and burden reduction for basic groups.

Drawings

FIG. 1 is a block diagram of an automated collection and integration system for random reporting of sporadic data in accordance with the present invention;

FIG. 2 is a block diagram of an external network computer architecture for an automated collection and integration system for random reporting of sporadic data in accordance with the present invention;

FIG. 3 is a block diagram of a WeChat automatic processing module of the automatic collection and integration system for randomly reporting scattered data;

FIG. 4 is a flow chart of the method for automatically collecting and integrating scattered data for random reporting according to the present invention.

Detailed Description

The invention will be further described with reference to the drawings and examples.

Referring to fig. 1 to fig. 4, embodiment 1, an automatic collection and integration system for random reporting of scattered data in this embodiment includes a micro-message group, a micro-message automatic processing module, an information reporting and format specification, a file setting and program control on an external network computer, a transfer file generating module, a network switching and fusion and application module:

the WeChat group is to create a WeChat group containing the operator on duty of the reported data for each station in the dispatching WeChat application, and is used for reporting the data to be reported in the WeChat group according to the required format.

The WeChat automatic processing module monitors and controls Windows version WeChat application running on an external network computer by utilizing an RPA program at a dispatching end, and is used for automatically interacting, judging and feeding back with WeChat groups of each plant station, and collecting and integrating reported data. The method comprises program preparation and initialization, information monitoring and collection, unread information group name data generation, data reading and storage and ciphertext coding, and is a program for monitoring new information sent from each station user group in real time on an external network computer, and reading, judging, storing or replying the new information.

The information reporting and format specification comprises the requirements of time, information format and data unit of reporting data, and is used for specifying the requirements of micro-letter groups, group members of reporting data of each station user, time, information format and data unit of reporting data in the groups and the like.

The file setting and program control on the external network computer is to set a folder on the hard disk of the external network computer, which comprises a setting file, a data file and a transmission file, a flow file and a control panel are set in the RPA program folder, three files are monitored, collected and transmitted, the files are used for setting and storing the number, group name and running state of data reporting units, automatically generating the file of data reported by each data reporting unit stored in the running process of the program, transmitting the data file of a plain text between the network computers adopting physical isolation measures, and setting the file setting and the program control through the control panel.

The transfer file generation module is a subroutine for converting WPS files in xlsx format of ciphertext into text-storing files in Dat format.

The network switch comprises a KVM switch and a data transmission U disk, and is used for fast transmission of data between two or more network computers taking physical isolation measures.

The fusion and application module is composed of a ciphertext decoding subprogram and a data fusion and application subprogram which run on an internal network computer and is used for fusing a complete data file with data files respectively acquired from an EMS system, an electric energy acquisition system and a user electricity consumption information acquisition system to obtain complete running data of regional power grid dispatching and provide complete data source support for regional power grid dispatching analysis and report forms.

The information reporting and format specification specifically comprises the following items:

the method comprises the steps that a WeChat group taking a station name as a group name is respectively established on a scheduling WeChat application, the WeChat group comprises all operators on duty reporting data of the station, and each data reporting operator cannot modify the group name, but is allowed to modify remarks; the names and the number of the micro-letter groups are unified with the content of the setting file, data to be reported are reported in the micro-letter groups by data reporting personnel every day according to the set time, and the reported data must contain a date key word, which is a unique information identification code when the micro-letter automatic processing module collects the data;

secondly, the data information reporting format requires line entry, names and data are separated by colon, and the colon does not separate Chinese and English and is omitted; the first row is a data date, the date is 8 digits, the first 4 digits are the year of the male element, the 5 th and 6 th digits are months, the 7 th and 8 th digits are days, and if the month and the days are less than 10, 0 is supplemented on ten digits; reporting data in kilowatt-hour unit;

for example, if the electricity of day 1 and 8 of year 2021 is 1688888 kwh, the sending information should be:

date: 20210108

Electric quantity: 1688888

If the user only reports one electric quantity data, the method can be simplified as

20210108：1688888

8-day machine-side electric quantity of 12 months in 2020 of a certain power plant: 22166 kilowatt-hour, network power: 22156 kilowatt-hours, max: 988 kw, minimum: 886 kw, load factor: 93.4%, the transmitted information should be:

date: 20201208

And the machine end: 22166

And (3) surfing the net: 22156

Maximum: 988

Minimum: 886

Load factor: 93.4

In the WeChat automatic processing module, up to 20 fault-tolerant formats are set for the information identification code, and date long and short formats, bars, inclined bar connectors and the like possibly appearing in the reported information are enumerated one by one and fault-tolerant correction is carried out. Such as: for the "20201208" this "date" information identification, the program can be automatically identified whether the presenter writes in the form 2020128, 2020-12-08, 2020-12-8, 2020/12/08, 2020/12/8, etc. When the data cannot be identified, the WeChat automatic processing module simulates the WeChat sending process to automatically reply information to the group for retransmission so as to ensure the integrity of the data.

The file setting and program control on the external network computer is to set a folder on the hard disk of the external network computer, the name of the folder is determined by a 'working directory' in a control panel, the folder comprises setting files xlsx, data files xlsx and transfer files dat, and a flow file and three task files of the control panel, monitoring collection and data transfer are set in an RPA program folder.

(1) Setting file

The set file is a group name set file of the data reporting unit, is a WPS file in xlsx format, and is used for setting and storing the number, group name and running state of the data reporting unit; the serial number is used for determining the storage position of the data reported by the unit in the data file, the running state has two choices of running and suspending, and when the user is in the suspending state, the program automatically skips the unit when running;

(2) Data file

The data file is an xlsx WPS file, is automatically generated in the process of program operation and stores data reported by each data reporting unit, and is provided with opening permission protection for the sake of data security, and the stored data is encoded ciphertext;

(3) Delivering files

The transfer file is a Txt file in dat format, and is a plain text file which is automatically generated from the complete data file through a program and is used for transmitting data between network computers taking physical isolation measures; the text file stores a Json character string converted from a two-dimensional array, wherein the data is a coded ciphertext;

(4) Control panel

The control panel is a user interaction setting interface program module, and by running the program module, a user can conveniently set information such as a WeChat. Exe installation path, a work directory, a monitoring frequency, a USB flash disk character, a USB flash disk password, a USB flash disk data storage area, date change time, timing automatic running time, a storage area of the user in a setting file, whether data is plaintext or ciphertext, and the like; after the information is input or modified through the control panel, the information is stored in a text file named Config. Cfg in the form of a dictionary Json character string so as to be called at any time in the running process of the program, and the method is a means for adapting the program to the personalized setting parameters of different users; meanwhile, a text file named ybhRec is also arranged in the RPA program folder, and a data dictionary of the reported user name and the interruption time when the monitoring program is temporarily interrupted is stored.

The WeChat automatic processing module comprises program preparation and initialization, information monitoring and collection, unread information group name number group generation, data reading and storage and ciphertext coding, and is used for monitoring new information sent from each station user group in real time and reading, judging, storing or replying the new information, and comprises the following subprograms:

preparing and initializing a program:

(1) initializing variables: the program starts to define each related variable and array, and reads the stored information in Config.Cfg and ybhRec.Rec files as the initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) placing the WeChat window in an active state: prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state;

Monitoring and collection of information: a large loop is set, the unread information is detected by a timing loop, the unread information is detected once every 1 or 2 minutes (the interval minutes are determined by the set value of the detection frequency in the control panel), and the unread information group name number group generation subprogram and the data reading and storing subprogram are sequentially arranged in the loop. The former subprogram is constructed into a plurality of groups by circularly checking the group names with the red circle numbers in the WeChat chat list window, and the latter subprogram sequentially searches the unread information group names in the search column of the WeChat window and performs trial reading, interpretation or reply on the latest unread information in the dialogue window. Before the circulation is finished, reading the information which is successfully read, encoding the information by a password encoding subprogram, storing the information, outputting the data of the station which is successfully read in the circulation, the station group name set which is successfully read so far and the station which are not yet reported the data to a view output window, and automatically replying the information which is failed to be read, checking the information and reporting the information again;

generating unread information group names: the subroutine can automatically search unread information in the chat list of the computer WeChat window, and send the unread information into the defined array of the factory station family group names and income; the implementation method comprises the following steps: the element texts of the first 15 records (Idx attribute=0 to 14) in the chat list displayed on the screen are sequentially read in reverse order with a loop sentence and a "get text" command. Searching the positions of occurrence of the substrings of 0:00 to 23:59 expressed by regular expressions in the element text, if the positions of occurrence are not 1, indicating that unread information exists in the group, and if the positions of occurrence are 1, adding a substring of 0\t (t is a tab) in front of the variable of the element text string; the "\r\n" in the text character string of the replacement element is "\t"; cutting the replaced element text character strings by using't', so as to obtain 15 chat list arrays; searching and testing whether the 3 rd element in the chat list array exists in the plant station group array or not by using a regular expression; if not, the plant-station user group judgment variable is marked as false by using an abnormal capture command; finally, constructing the 3 rd element in the chat list array with the 1 st element not equal to 0 and the plant station user group judgment variable being true as an unread information group name array;

Reading and storing data: the subroutine can search the names of the station groups in the attribute parameter array one by using a circulating command in the search column of the computer micro-message window, so that the recent dialogue information of the station groups is obtained in the dialogue window. The attribute parameter of the subroutine is an unread group name array. The program obtains 20 compatible formats of the information mark of the date of the data to be captured according to the date change time in the control panel, the command of judging whether the text exists in the target is used for searching each piece of information in the dialog box one by one for the group name of the unread information group name array, if the 20 formats of the information mark of the date are not searched, the program simulates the micro-message sending process to reply the information which cannot be automatically identified to the group, and the information which is retransmitted after the verification is requested to be retransmitted, otherwise, the program continues to process;

the last text containing the date information mark in the double-click window is removed by a click text command, so that the target text is in a full-selection state; copying the target text to the clipboard by using a command of a simulation key Ctrl+C, and assigning the target text to a target character string variable by using a command of acquiring the clipboard text; next, performing a series of processing on the obtained target character string variables, including error-tolerant operations of replacing punctuations such as Chinese colon, semicolon, comma, pause number and the like in the target character string variables with English colon, replacing blank spaces, bars and slashes with blank characters, replacing letter o with number 0, replacing letter l with number 1 and the like; cutting the processed target character string by using a line-changing character "\n", then using an English colon ". Cutting the character string cut by using the line-changing character, then encoding the obtained character string by using a key to construct a target array, finally writing the array into a scattered data worksheet in an opened data file workbook by using a line-writing command, wherein the number of writing position lines is the same as the number of unit numbers of the station family group in a set file, thereby finishing data reading and storing, and simultaneously writing the name of the station family group into a reported family set;

Encoding ciphertext: in the process of reporting data grabbing to each station user, the data monitoring and collecting program firstly codes the grabbed data through a secret key, then codes the grabbed data into a data file, and finally converts the data file into a transfer file.

The specific process is as follows:

firstly, acquiring year, month and day data of a data grabbing moment through a time function, and obtaining a determined coding key after the year, month and day data and date change time set in a control panel are operated through an encryption polynomial; converting the captured data into ASCII codes, and then superposing the converted ASCII codes and the secret key to generate ciphertext codes; storing the ciphertext code in a data file in a background color and hiding the WPS editing column; the data file is converted into a two-dimensional array through a command of reading the worksheet region, the two-dimensional array is converted into a Json character string, and the Json character string is written into a transfer file, so that a plain text ciphertext transfer file is generated, and the transfer file dat can be copied into an intranet computer through an intranet USB flash disk.

The network switch comprises a KVM switch and a data transmission USB flash disk, and the internal and external network computers are physically isolated according to the requirements of data security policies of national network companies. In order to realize that a user uses a set of keyboard, mouse and display to access and operate two computers of an internal network and an external network, the two network computers are connected together by a KVM switch, so that the two computers of the internal network and the external network share the same set of keyboard, mouse, display and intranet USB flash disk. The scattered data monitoring and collecting program runs on the external network computer. In order to ensure data security, the data files working on the external network computer are provided with authority protection and stored by ciphertext. In order to avoid virus transmission, a plain text ciphertext file is adopted as a transmission file for transmitting data to an intranet computer. The operation that the external network copies into the U disk and the U disk considers the internal network is completed by a program calling a 'file copy' subroutine by one key.

The fusion and application module is composed of a ciphertext decoding subprogram and a data fusion and application subprogram which run on an internal network computer:

the ciphertext decoding subprogram comprises: the transfer file is decoded on an internal network computer, and the process decoding is the inverse process of the encoding process, namely, firstly reading the transfer file to Json character string variables, and then converting the transfer file into objects to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS file through a writing area command, thereby obtaining a complete decoding data file;

the data fusion and application subroutines: after decoding, the transfer file obtains a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively collected from the EMS system, the electric energy collection system and the user electricity consumption collection system to obtain complete operation data of regional power grid dispatching, so that complete data source support is provided for regional power grid dispatching analysis and report forms.

The embodiment is used for the automatic collection and integration method of random reporting scattered data, which comprises the following specific steps of establishing a micro-letter group, reporting data, operating an external network computer program, switching the network and operating an internal network computer program:

1) Establishing a WeChat group and reporting data

Creating a micro-letter group containing the operator of the reported data for each plant station in the dispatching micro-letter application, and reporting the data to be reported in the micro-letter group according to a required format by the operator of the reported data;

2) External network computer program operation

The external network computer program operation includes:

preparing and initializing a program;

periodically and circularly detecting unread information;

generating an unread message group name array;

performing information trial reading;

encoding and storing ciphertext;

the method comprises the steps that (1) the whole read information is completely read or the artificial termination is performed;

generating a transfer file;

3) Network switching

Connecting two network computers together by using a KVM switch, copying the transmission file into the internal network computer in an internal network and external network isolation mode by using an internal network U disk;

4) Internal network computer program operation

The internal network computer program operation includes:

decoding a transmission file;

2, fusing data;

and (3) data application.

Further, the step 2) of running the external network computer program specifically includes:

program preparation and initialization

Timing cycle detection of unread information

Setting a large cycle timing cycle to detect unread information, wherein the cycle interval time is set by the detection frequency in the control panel, and the detection is carried out once every interval set time;

Generating unread message group name number group

Automatically searching unread information and sending the unread information into a well-defined array of station family group names;

fourth step of information trial reading

The unread information of the cyclic detection is subjected to trial reading, the information of the trial reading success is read and then is transmitted to a ciphertext coding subprogram, meanwhile, the data of the station family which is successfully read in the cyclic reading at the present time, the station family group name set which is successfully read so far and the station family which are not yet reported data are output to a view output window, and the information of the trial reading failure is automatically returned to be checked and then reported again;

ciphertext encoding and storing

Reading the information successfully tested and reading, then transmitting the information to a ciphertext coding subprogram, and storing the information after coding by the ciphertext coding subprogram;

(6) Complete reading of unread information or artificial termination

Completely reading unread information detected by circulation or manually stopping reading the information according to the need;

signaling file generation

Storing the ciphertext code in a data file in a background color and hiding the WPS editing column; the data file is converted into a two-dimensional array by reading the worksheet region command, then the two-dimensional array is converted into a Json character string, and then the Json character string is written into the transfer file, so that the plain text ciphertext transfer file is generated.

The preparation and initialization of the program are specifically as follows:

(1) initializing variables: the program starts to define each related variable and array, and reads the stored information in Config.Cfg and ybhRec.Rec files as the initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) placing the WeChat window in an active state: and prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state.

Said step 2) said internal network computer program operation includes:

method and system for decoding a file

Decoding a transfer file on an internal network computer, firstly reading the transfer file to a Json character string variable, and then converting the transfer file into an object to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS file through a writing area command, thereby obtaining a complete decoding data file;

Data fusion of (C)

The transmitted file is decoded to obtain a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system;

data application

And merging the decoded complete WPS-format data file with the WPS-format data files respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system to obtain regional power grid dispatching complete operation data, thereby providing complete data source support for regional power grid dispatching analysis and report forms.

The invention is not limited to the specific embodiments, but simple copies and modifications which do not undergo inventive work are intended to fall within the scope of the invention as claimed by the skilled person.

Claims (2)

1. An automatic collection and integration system for randomly reporting scattered data, which is characterized in that: the system comprises a WeChat group, a WeChat automatic processing module, an information reporting and format specification, file setting and program control on an external network computer, a transfer file generating module, a network switching and fusing and application module:

The WeChat group is to create a WeChat group containing the reporting data attendant for each station in the dispatching WeChat application, and is used for reporting the data to be reported in the WeChat group according to the required format;

the automatic WeChat processing module is a Windows version WeChat application which is monitored and controlled by an RPA program at a dispatching end and is operated on an external network computer, and is used for automatically interacting, judging and feeding back with WeChat groups of each plant station, collecting and integrating reported data, including program preparation and initialization, information monitoring and collecting, unread information group name number group generation, data reading and storing and ciphertext coding, and is a program for monitoring new information sent from each plant station group in real time on the external network computer and reading, judging, storing or replying the new information, and comprises the following subprograms:

preparing and initializing a program:

(1) initializing variables: the program starts to define each related variable and array, and reads the stored information in Config.Cfg and ybhRec.Rec files as the initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) Adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) placing the WeChat window in an active state: prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state;

monitoring and collection of information: the method comprises the steps of periodically and circularly detecting unread information, decoding the information which is successfully subjected to trial reading, encoding by a cipher code subprogram, storing, and simultaneously outputting the factory and family data which is successfully read in the cycle, a factory and family group name set which is successfully read so far and also other factory and family not yet reported data to a view output window, and automatically replying the information which is failed to be subjected to trial reading to enable the information to be checked and then reported again;

generating unread information group names: automatically searching unread information and sending the unread information into a well-defined array of station family group names;

reading and storing data: searching each piece of information in a dialogue box one by one for the group names of the unread information group name array, acquiring the last text containing the information mark, cutting the character string, storing the obtained character string in a data file after the key coding, and simultaneously, recording the plant station group names into a reported user set;

Encoding ciphertext: obtaining a coding key through the operation of a time function and the setting in the control panel, converting the captured data into ASCII codes, superposing the converted ASCII codes and the key to generate ciphertext codes, storing the ciphertext codes in a data file in a background color, and hiding a WPS editing column; converting the data file into a two-dimensional array by reading the worksheet region command, converting the two-dimensional array into a Json character string, and writing the Json character string into a transfer file, thereby generating a plain text ciphertext transfer file;

the information reporting and format specification comprises requirements of time, information format and data unit of reporting data, is used for specifying micro-message groups, group members of each station and user reporting data and time, information format and data unit of reporting data in the groups, and specifically comprises the following items:

the method comprises the steps that a WeChat group taking a station name as a group name is respectively established on a scheduling WeChat application, the WeChat group comprises all operators on duty reporting data of the station, and each data reporting operator cannot modify the group name, but is allowed to modify remarks; the names and the number of the micro-letter groups are unified with the content of the setting file, data to be reported are reported in the micro-letter groups by data reporting personnel every day according to the set time, and the reported data must contain a date key word, which is a unique information identification code when the micro-letter automatic processing module collects the data;

Secondly, the data information reporting format requires line entry, names and data are separated by colon, and the colon does not separate Chinese and English and is omitted; the first row is a data date, the date is 8 digits, the first 4 digits are the year of the male element, the 5 th and 6 th digits are months, the 7 th and 8 th digits are days, and if the month and the days are less than 10, 0 is supplemented on ten digits; reporting data in kilowatt-hour unit;

thirdly, in the automatic WeChat processing module, a plurality of fault-tolerant formats are set for the information identification code, the possible date and time formats, the bar and the diagonal connector in the reported information are enumerated one by one, fault-tolerant correction is carried out, and when the information cannot be identified, the automatic WeChat processing module simulates the WeChat sending process to automatically reply the information to the group and resend the information, so that the integrity of the data is ensured;

the file setting and program control on the external network computer is to set a folder on a hard disk of the external network computer, which comprises a setting file, a data file and a transmission file, a process file and a control panel are set in the RPA program folder, three files are monitored, collected and transmitted, the files are used for setting and storing the number, group name and running state of data reporting units, automatically generating the file of data reported by each data reporting unit stored in the running process of the program, transmitting the data file of a plain text between the network computers adopting physical isolation measures, and setting the file setting and the program control through the control panel, wherein:

(1) Setting file

The set file is a group name set file of the data reporting unit, is a WPS file in xlsx format, and is used for setting and storing the number, group name and running state of the data reporting unit; the serial number is used for determining the storage position of the data reported by the unit in the data file, the running state has two choices of running and suspending, and when the user is in the suspending state, the program automatically skips the unit when running;

(2) Data file

The data file is an xlsx WPS file, is automatically generated in the process of program operation and stores data reported by each data reporting unit, and is provided with opening permission protection for the sake of data security, and the stored data is encoded ciphertext;

(3) Delivering files

The transfer file is a Txt file in dat format, and is a plain text file which is automatically generated from the complete data file through a program and is used for transmitting data between network computers taking physical isolation measures; the text file stores a Json character string converted from a two-dimensional array, wherein the data is a coded ciphertext;

(4) Control panel

The control panel is a user interaction setting interface program module, and by running the program module, a user can conveniently set a WeChat. Exe installation path, a working directory, a monitoring frequency, a USB flash disk character, a USB flash disk password, a USB flash disk data storage area, date change time, timing automatic running time, a storage area of the user in a setting file and whether data is plaintext or ciphertext storage and transmission; after the information is input or modified through the control panel, the information is stored in a text file named Config. Cfg in the form of a dictionary Json character string so as to be called at any time in the running process of the program, and the method is a means for adapting the program to the personalized setting parameters of different users; meanwhile, a text file named ybhRec is also arranged in the RPA program folder, and a data dictionary of the reported user name and interruption time when the monitoring program is temporarily interrupted is stored;

The transfer file generation module is a subprogram used for converting the WPS file in the xlsx format of the ciphertext into a plain text file in the Dat format;

the network switch comprises a KVM switch and a data transmission U disk, wherein the KVM switch is used for connecting two network computers together, a transmission file is copied into an internal network computer in an internal network and external network isolation mode through the internal network U disk, and in order to ensure data safety, the transmission file adopts a plain text ciphertext file and is used for quickly transmitting data between two or more network computers adopting physical isolation measures;

the fusion and application module is composed of a ciphertext decoding subprogram and a data fusion and application subprogram which run on an internal network computer, and is used for fusing a complete data file with data files respectively acquired from an EMS system, an electric energy acquisition system and a user electricity consumption information acquisition system to obtain complete running data of regional power grid dispatching and provide complete data source support for regional power grid dispatching analysis and report forms, wherein:

the ciphertext decoding subprogram comprises: the transfer file is decoded on an internal network computer, and the decoding process is the inverse process of the encoding process, namely, firstly reading the transfer file to Json character string variables, and then converting the transfer file into objects to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS table file through a writing area command, thereby obtaining a complete decoding data file;

The data fusion and application subroutines: after decoding, the transfer file obtains a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively collected from the EMS system, the electric energy collection system and the user electricity consumption collection system to obtain complete operation data of regional power grid dispatching, so that complete data source support is provided for regional power grid dispatching analysis and report forms.

2. An automatic collection and integration method for randomly reporting scattered data is characterized by comprising the following steps: the method comprises the steps of establishing a micro-message group, reporting data, operating an external network computer program, switching a network and operating an internal network computer program, and specifically comprises the following steps:

1) Establishing a WeChat group and reporting data

Creating a micro-letter group containing the operator of the reported data for each plant station in the dispatching micro-letter application, and reporting the data to be reported in the micro-letter group according to a required format by the operator of the reported data;

2) External network computer program operation

The external network computer program operation includes:

program preparation and initialization

(1) Initializing variables: the program starts to define all relevant variables and arrays, and reads the stored information in Config. Cfg and ybhRec. Rec files to be used as an initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) Starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) placing the WeChat window in an active state: prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state;

timing cycle detection of unread information

Setting a large cycle timing cycle to detect unread information, wherein the cycle interval time is set by the detection frequency in the control panel, and the detection is carried out once every interval set time;

generating unread message group name number group

Automatically searching unread information and sending the unread information into a well-defined array of station family group names;

fourth step of information trial reading

The unread information of the cyclic detection is subjected to trial reading, the information of the trial reading success is read and then is transmitted to a ciphertext coding subprogram, meanwhile, the data of the station family which is successfully read in the cyclic reading at the present time, the station family group name set which is successfully read so far and the station family which are not yet reported data are output to a view output window, and the information of the trial reading failure is automatically returned to be checked and then reported again;

Ciphertext encoding and storing

Reading the information successfully tested and reading, then transmitting the information to a ciphertext coding subprogram, and storing the information after coding by the ciphertext coding subprogram;

full read of unread information or artificial termination of the sixth step

Completely reading unread information detected by circulation or manually stopping reading the information according to the need;

signaling file generation

Storing the ciphertext code in a data file in a background color and hiding the WPS editing column; converting the data file into a two-dimensional array by reading the worksheet region command, converting the two-dimensional array into a Json character string, and writing the Json character string into a transfer file, thereby generating a plain text ciphertext transfer file;

3) Network switching

Connecting two network computers together by using a KVM switch, copying the transmission file into the internal network computer in an internal network and external network isolation mode by using an internal network U disk;

4) Internal network computer program operation

The internal network computer program operation includes:

method and system for decoding a file

Decoding a transfer file on an internal network computer, firstly reading the transfer file to a Json character string variable, and then converting the transfer file into an object to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS file through a writing area command, thereby obtaining a complete decoding data file;

Data fusion of (C)

The transmitted file is decoded to obtain a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system;

data application

And merging the decoded complete WPS-format data file with the WPS-format data files respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system to obtain regional power grid dispatching complete operation data, thereby providing complete data source support for regional power grid dispatching analysis and report forms.