CN111460260A - Data processing system, method and medium for multi-type data - Google Patents

Data processing system, method and medium for multi-type data Download PDF

Info

Publication number
CN111460260A
CN111460260A CN202010245556.2A CN202010245556A CN111460260A CN 111460260 A CN111460260 A CN 111460260A CN 202010245556 A CN202010245556 A CN 202010245556A CN 111460260 A CN111460260 A CN 111460260A
Authority
CN
China
Prior art keywords
data
database
processing
historical
indexes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010245556.2A
Other languages
Chinese (zh)
Inventor
张庆全
徐瑜蔓
章希
陈靖琪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Zhizhi Intelligent Technology Co ltd
Original Assignee
Shanghai Zhizhi Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Zhizhi Intelligent Technology Co ltd filed Critical Shanghai Zhizhi Intelligent Technology Co ltd
Priority to CN202010245556.2A priority Critical patent/CN111460260A/en
Publication of CN111460260A publication Critical patent/CN111460260A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06393Score-carding, benchmarking or key performance indicator [KPI] analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Human Resources & Organizations (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Administration (AREA)
  • Development Economics (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Game Theory and Decision Science (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a data processing system, a method and a medium for multi-type data, comprising the following steps: acquiring web data and historical data of an object, storing the web data and the historical data in a subarea mode, and conducting classified export; acquiring data exported by a data integration storage server from a plurality of aspects respectively; importing data in a sub-database into an index quantitative processing database, carrying out standardized processing according to preset refinement indexes, importing the data into an AHP analysis processing system, giving weights through the AHP analysis processing system, importing the data into an ESG scoring system, carrying out operation through a preset formula, multiplying the initial processing data by the corresponding weights and summing up to obtain multiple index scores respectively; and sequencing the total scores of the multiple index scores, and calculating according to a preset proportion to obtain a final processing result. The method and the system solve the requirements of evaluation and comparison of multi-type data among different objects and solve the problem that the existing rating system cannot be directly applied.

Description

Data processing system, method and medium for multi-type data
Technical Field
The invention relates to the field of data processing, in particular to a data processing system, a method and a medium for multi-type data, and particularly relates to an ESG responsibility investment rating system, a method and a medium suitable for a scientific and invasive board.
Background
ESG, namely environmental, Social and corporate governance (environmental, Social responsiveness, corporation, Governance), comprises three aspects of information disclosure, evaluation rating and investment guide, is the basis of Social Responsibility investment, and is an important component of a green financial system. From the evaluation content, the environmental factors comprise advocating an environment-friendly economic development mode, paying attention to environmental protection, recycling resource utilization, reducing the innovative technical application of natural resources and the like; social factors include employee welfare and customer satisfaction, personal rights and labor standards, data protection and privacy, enterprise value view, social responsibility, and the like; corporate governance includes regulatory business management, strict internal control, independent external audit and supervision, anti-corruption and commercial bribery, adherence to stockholder policies, equity treating stockholders, and the like. The ESG evaluation system provides effective investment reference for investors in overseas mature markets such as the United states.
Because the time of the Chinese capital market is shorter than that of the mature market, the Chinese economic structure is also in the transformation and upgrading process, and the direct standard of maturity of the overseas market does not meet the current actual situation of China. From an objective point of view, on the one hand, the chinese capital market has incomplete, delayed, or even completely missing information related to ESG core factors. On the other hand, due to the influence of market maturity, the China marketing company is still insufficient in the aspect of overall financial data governance, and more adjustment spaces exist in related transaction, income confirmation, fixed asset depreciation, reputation value reduction and other accounting processes. Therefore, compared with the relatively perfect and unified capital market information system abroad, the Chinese market is not suitable for directly applying the foreign ESG rating system.
Patent document CN110472884A discloses an ESG index monitoring method, apparatus, terminal device and storage medium, where the ESG index monitoring method includes: acquiring alternative data and processing the alternative data to determine a knowledge graph; extracting an ESG event from the alternative data, and scoring an ESG index of the ESG event by combining the knowledge graph; and outputting early warning information to a relation party of the ESG event according to a grading result of grading the ESG indexes. The defects of the patent are that: firstly, the ESG security system only plays a certain warning role when an enterprise possibly has ESG crisis, but cannot provide investment analysis and transverse comparison information for vast investors; secondly, the most important one of them is that the ESG evaluation system abroad is directly applied to domestic enterprises, so that the final evaluation result is not objective and accurate.
Disclosure of Invention
In view of the deficiencies in the prior art, it is an object of the present invention to provide a data processing system, method and medium for multi-type data.
The invention provides a data processing system of multi-type data, comprising:
the information acquisition server: acquiring web data of an object from a network and historical data of the object from a historical database, and storing the web data and the historical data into an information database;
the data integration storage server: carrying out partition storage and classified export on the data in the information database;
a sub-database: the system comprises a plurality of databases, a data integration storage server and a data integration storage server, wherein the databases respectively acquire data exported by the data integration storage server from different aspects;
a core data processing server: importing data in the sub-database into an index quantization processing database, and carrying out standardization processing according to preset refinement indexes to obtain standardized data; acquiring an AHP importance matrix through a dynamic subjective and objective index analysis system, importing standardized data into an AHP analysis processing system, and giving weight through the AHP analysis processing system to acquire initial processing data; importing the initial processing data into a scoring system, calculating through a preset formula, multiplying the initial processing data by corresponding weights and summing up to respectively obtain multiple index scores; and sequencing the total scores of the multiple index scores, and calculating according to a preset proportion to obtain a final processing result.
Preferably, the information collecting server includes:
the method comprises the steps of obtaining web data of an object by crawling and analyzing network resources, obtaining historical data of the object by calling a historical database, and obtaining additional data of the object by the obtained manual entry data;
and the acquired web data, historical data and additional data are subjected to data cleaning and then stored in the information database.
Preferably, the classification derivation of the data by the data integration storage server comprises: and establishing an index and cache mechanism.
Preferably, the system further comprises a data visualization unit, wherein the data visualization unit comprises a terminal device and displays the final rating corresponding to the object.
Preferably, the plurality of databases comprises: the environment database, the social responsibility database and the company management database are used for respectively acquiring data exported by the data integration storage server from the three aspects of environment, social responsibility and company management;
the plurality of indicators include: three indexes of environment E, social responsibility S and company governance G are provided, and a plurality of layers of sub-indexes are set under the three indexes;
and the data visualization unit displays a final processing result corresponding to the object and comprehensive ratings of the industry and the large plate to which the object belongs.
The invention provides a data processing method of multi-type data, which comprises the following steps:
s1: acquiring web data of an object from a network and historical data of the object from a historical database, and storing the web data and the historical data into an information database;
s2: carrying out partition storage and classified export on the data in the information database;
s3: obtaining, by a plurality of databases, derived data from different aspects, respectively;
s4: importing the data of the three aspects into an index quantization processing database, and carrying out standardization processing according to preset refinement indexes to obtain standardized data; acquiring an AHP importance matrix through a dynamic subjective and objective index analysis system, importing standardized data into an AHP analysis processing system, and giving weight through the AHP analysis processing system to acquire initial processing data; importing the initial processing data into a scoring system, calculating through a preset formula, multiplying the initial processing data by corresponding weights and summing up to respectively obtain multiple index scores; and sequencing the total scores of the multiple index scores, and calculating according to a preset proportion to obtain a final processing result.
Preferably, the step S1 includes:
the method comprises the steps of obtaining web data of an object by crawling and analyzing network resources, obtaining historical data of the object by calling an ESG database, and obtaining supplementary data of the object by obtaining manual input data;
and the acquired web data, historical data and additional data are subjected to data cleaning and then stored in the information database.
Preferably, the step S2 of deriving the classification of the data includes: and establishing an index and cache mechanism.
Preferably, the plurality of databases comprises: the environment database, the social responsibility database and the company management database are used for respectively acquiring data exported by the data integration storage server from the three aspects of environment, social responsibility and company management;
the plurality of indicators include: the method comprises three indexes of environment E, social responsibility S and company governance G, and a plurality of layers of sub-indexes are set under the three indexes.
According to the present invention, there is provided a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of a data processing method for multi-type data.
Compared with the prior art, the invention has the following beneficial effects:
1. according to the method, reasonable weight is given by the core data processing server automatic standardized processing and AHP analysis processing system, the requirement of evaluation comparison of multiple types of data among different objects is met, and the problem that the existing rating system cannot be directly applied is solved.
2. The problem of single and deficient data source is solved through the web data, the historical database and the manual input mode, and the reliability and the accuracy of analysis are improved.
3. By adopting mechanisms of partition storage, index establishment, cache and the like, the applicability and the calling performance of data are enhanced, and the problems that the data are complicated and are not suitable for a system are solved.
4. The data processing efficiency is improved by optimizing the data acquisition and processing links. The problems of data lag and slow updating at present are solved.
5. By the definite weight of a scoring system and data quantification, the problems of various data types and data processing deficiency are solved.
Through further improvement, the invention can be applied to an ESG evaluation system, solves the problem of investment decision aiming at financial performance and the like singly, enables the ESG evaluation system to be more objectively and accurately applied to Chinese scientific and creative board enterprises, and provides investment decision comparison reference for investors.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a schematic diagram of the system of the present invention;
FIG. 2 is a diagram illustrating weight processing of secondary metrics according to an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating weight processing of three-level indicators according to an embodiment of the present invention;
fig. 4 is a diagram illustrating a rating result in the embodiment of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
Example 1
As shown in fig. 1, the present invention provides an ESG liability investment rating system, which includes: the system comprises an information acquisition server, a data integration and storage server, a sub-database, a core data processing server and a data visualization unit.
The information acquisition server acquires web data of an object to be rated by crawling and analyzing network resources through Python, calls the Zhizhi whole ESG database through sqoop, acquires historical data of the object to be rated, and acquires additional data of the object to be rated through acquired manual input data. And cleaning the acquired web data, historical data and additional data and storing the web data, the historical data and the additional data into an information database.
The data integration storage server stores the data in the information database in a partitioning mode, and establishes an index and cache mechanism and/or establishes a hive table to classify and export the data.
The sub-database comprises an environment database, a social responsibility database and a company management database, and data exported by the data integration storage server are respectively acquired from the three aspects of environment, social responsibility and company management.
The core data processing server leads data in the sub-databases into an index quantization processing database, and carries out standardization processing according to preset refinement indexes to obtain standardized data; importing the standardized data into an AHP analysis processing system, and giving weight through the AHP analysis processing system to obtain initial rating data; importing the initial rating data into an ESG scoring system, calculating through a preset formula, multiplying the initial rating data by corresponding weights and summing up to obtain scores of three indexes of E, S and G respectively, and setting a plurality of layers of sub-indexes under the three indexes; and sequencing the total scores of the indexes E, S and G, and calculating according to a preset proportion to obtain the final rating.
The data visualization unit comprises terminal equipment and displays the final rating corresponding to the object to be rated and the comprehensive rating of the industry and the large plate to which the object to be rated belongs.
From the aspect of collected data, the coverage range of various types of data is wide, and the data are updated in real time along with the latest event; in addition, on the premise of ensuring reasonable indexes, the data sources select public data as much as possible, and the data sources are more prone to be obtained from big events and public data, so that the timeliness of investment evaluation decision making and the accuracy of evaluation results are ensured. For example, this embodiment collects some enterprise-related data under the situation of pneumonia epidemic caused by this new coronavirus: data (web data) such as latest donated materials of enterprises are crawled through python, and the historical data are acquired by combining with a Zhizhi whole ESG database (historical database) so as to be comprehensively evaluated, and then the data processing of the next step is carried out. In addition, real-time update data such as a rework rate in company management requires continuous information import and update in the system.
An index and cache mechanism is established in the data integration storage server, and a Hive table can be established to classify and export the data. Each Hive table has a corresponding directory in Hive to store data, e.g., a table fgl, whose path in HDFS (Hadoop distributed File System) is:/corporation Governance/fgl, where corporation Governance is the directory of the data warehouse specified by $ { Hive.
Example 2
On the basis of embodiment 1, the present invention also provides an ESG liability investment rating method, including the steps of:
step 1: the method for importing the collected original data into the information database after cleaning comprises the following steps:
step 1.1: crawling network resource analysis information through python to obtain web data of the scientific plate company; calling historical data through the Zhi full ESG database, and inputting data through manual supplementary recording.
Step 1.2: and cleaning the acquired information and then importing the information into an information database.
Step 2: integrating and storing data, specifically comprising:
step 2.1: and storing the information in the information database in a partitioned mode, and classifying and exporting the information by establishing an index and cache mechanism.
And step 3: the data are classified and exported in three aspects of sub-database E (environment), S (social responsibility) and G (company governance).
And 4, step 4: grading by using data in the sub-database, specifically comprising:
step 4.1: and importing the data in each sub-database into an index quantization processing database.
Step 4.2: and (4) periodically updating the index importance matrix through a dynamic main index analysis system and an objective index analysis system, and inputting the updated index importance matrix into the step 4.3AHP analysis processing system.
Step 4.3: and carrying out automatic standardization treatment according to the designed refinement index in advance to finish the primary scoring. Each detailed index is set based on reference foreign indexes, and the two-level and three-level indexes of the ESG applicable to the invention are provided by combining the characteristics of the scientific plate and Chinese enterprises. The method is characterized in that the influence of insufficient information disclosure of Chinese enterprises on scoring can be relatively reduced, and the index selection is more suitable for the enterprise of the scientific and creative board.
Step 4.4: and (4) importing the standardized data into an AHP analysis processing system, and automatically giving a certain weight through the AHP analysis processing system to perform initial rating.
Step 4.5: importing initial rating data into an ESG scoring system:
step 4.6: and automatically calculating by a formula set in advance, multiplying the initial scores of the secondary indexes by corresponding weights and summing up to obtain scores of the indexes E, S and G respectively.
Step 4.7: and sequencing the ESG total scores obtained by each company, and calculating and processing according to a set proportion to obtain a final rating, wherein the higher the total score is, the higher the company rating is.
Step 4.8: and importing the final rating result into an ESG database.
And 5: and carrying out visualization processing on the final rating result through a terminal. Or issuing an ESG science wound board investment index or issuing an ESG science wound board stock investment score.
In this embodiment, the ESG evaluation system selects the index by combining the actual situation of china, extracts the ESG events in the alternative data, and establishes a pairwise importance degree type matrix by an AHP analysis method to derive the weight occupied by each index. And combining the scores of all the indexes and the analysis weight to finally obtain the ESG score. Taking the secondary indexes of an environmental concern (Environment) layer as an example, 13 indexes of green alternative resource use, environmental pollution penalty times, Environment protection conditions of a money raising project, pollutant emission of company production and operation, environmental index disclosure degree, green purchasing, Environment protection investment, energy conservation and emission reduction measures, employee Environment protection awareness, factory green design/planning, Environment protection propaganda degree, resource utilization and recovery and production project Environment protection degree are selected, and a multi-level sub-index is refined under each index to quantitatively score.
Indexes are set according to Chinese national conditions and the actual conditions of a scientific plate, for example, green purchasing refers to that enterprises consider whether raw materials, products and services are low-carbon and energy-saving, and consider purchasing behaviors expressed by the environment of suppliers; because the domestic environment supervision requirement is lower than that of foreign countries, the possibility of missing of enterprise environment index disclosed data is high, and the environment index disclosure degree is used as a completion index, so that the evaluation is more complete; as the scientific and invasive board enterprises are concentrated in the industries of electrical equipment, components, special machinery, semiconductors and communication equipment, and the sub-indexes of pollutant emission indexes are produced and operated by companies, the electromagnetic radiation influence is taken into consideration, so that the evaluation system has the characteristics of the scientific and invasive board.
The basic idea of the AHP analytic hierarchy process is as follows: and calculating the synthetic weight of each layer of element to the system target, and performing total sequencing to determine the importance degree of each element at the bottommost layer in the hierarchical structure diagram in the total target. And considering corresponding decisions according to the analysis and calculation results. In the invention, taking the E index as an example, the importance of each factor of the hierarchy is ranked according to the comparison of the importance of the two-level indexes. The comparison is achieved by establishing a matrix of all secondary indices in pairwise comparisons. The matrix is specifically scaled as follows: 1 indicates that two elements have the same importance for a certain attribute; 3 denotes a comparison of two elements, one element being slightly more important than the other; 5 represents a comparison of two elements, one element being significantly more important than the other; 7 represents a comparison of two elements, one element being much more important than the other; 9 denotes a comparison of two elements, one element being extremely important than the other; 2,4,6,8 represent scales where a compromise between the two criteria mentioned above is required. The importance degree of the index in the judgment matrix is determined by repeated research according to data, expert opinions and experience of system analysts. Then, a random consistency ratio of the matrix is calculated, and when the ratio is less than 0.1, the judgment matrix is considered to have acceptable consistency. Finally, the weights of the secondary indices are derived from the matrix and are listed as shown in FIG. 2. The invention also carries out similar weighting processing on the ESG three-level indexes, and the indexes are difficult to be listed completely, and are listed as shown in figure 3 only by way of example.
By scoring each ESG factor, weighting and scoring are carried out after the industry and the influence time factors are considered, and finally the ESG score of a company is obtained. The total classification into 7 ratings according to the ESG scores specifically includes: AAA, AA, A, BBB, BB, B, CCC, rating scale as shown in FIG. 4.
Example 3
The present invention also provides a computer readable storage medium storing a computer program which, when executed by a processor, performs the steps of the above-described ESG liability investment rating method.
Those skilled in the art will appreciate that, in addition to implementing the system and its various devices, modules, units provided by the present invention as pure computer readable program code, the system and its various devices, modules, units provided by the present invention can be fully implemented by logically programming method steps in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system and various devices, modules and units thereof provided by the invention can be regarded as a hardware component, and the devices, modules and units included in the system for realizing various functions can also be regarded as structures in the hardware component; means, modules, units for performing the various functions may also be regarded as structures within both software modules and hardware components for performing the method.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.

Claims (10)

1. A data processing system for multiple types of data, comprising:
the information acquisition server: acquiring web data of an object from a network and historical data of the object from a historical database, and storing the web data and the historical data into an information database;
the data integration storage server: carrying out partition storage and classified export on the data in the information database;
a sub-database: the system comprises a plurality of databases, a data integration storage server and a data integration storage server, wherein the databases respectively acquire data exported by the data integration storage server from different aspects;
a core data processing server: importing data in the sub-database into an index quantization processing database, and carrying out standardization processing according to preset refinement indexes to obtain standardized data; importing the standardized data into an AHP analysis processing system, and giving weight to the AHP analysis processing system to obtain initial processing data; importing the initial processing data into a scoring system, calculating through a preset formula, multiplying the initial processing data by corresponding weights and summing up to respectively obtain multiple index scores; and sequencing the total scores of the multiple index scores, and calculating according to a preset proportion to obtain a final processing result.
2. The data processing system of multi-type data according to claim 1, wherein said information collecting server comprises:
the method comprises the steps of obtaining web data of an object by crawling and analyzing network resources, obtaining historical data of the object by calling a historical database, and obtaining additional data of the object by the obtained manual entry data;
and the acquired web data, historical data and additional data are subjected to data cleaning and then stored in the information database.
3. The data processing system of multi-type data of claim 1, wherein the classification derivation of the data by the data consolidation storage server comprises: and establishing an index and cache mechanism.
4. The data processing system of multi-type data of claim 1, further comprising a data visualization unit, the data visualization unit comprising a terminal device, displaying the final rating corresponding to the object.
5. The data processing system for multi-type data of claim 4, wherein said plurality of databases comprises: the environment database, the social responsibility database and the company management database are used for respectively acquiring data exported by the data integration storage server from the three aspects of environment, social responsibility and company management;
the plurality of indicators include: three indexes of environment E, social responsibility S and company governance G are provided, and a plurality of layers of sub-indexes are set under the three indexes;
and the data visualization unit displays a final processing result corresponding to the object and comprehensive ratings of the industry and the large plate to which the object belongs.
6. A data processing method of multi-type data is characterized by comprising the following steps:
s1: acquiring web data of an object from a network and historical data of the object from a historical database, and storing the web data and the historical data into an information database;
s2: carrying out partition storage and classified export on the data in the information database;
s3: obtaining, by a plurality of databases, derived data from different aspects, respectively;
s4: importing the data of the three aspects into an index quantization processing database, and carrying out standardization processing according to preset refinement indexes to obtain standardized data; importing the standardized data into an AHP analysis processing system, and giving weight to the AHP analysis processing system to obtain initial processing data; importing the initial processing data into a scoring system, calculating through a preset formula, multiplying the initial processing data by corresponding weights and summing up to respectively obtain multiple index scores; and sequencing the total scores of the multiple index scores, and calculating according to a preset proportion to obtain a final processing result.
7. The method for processing data of multiple types of data according to claim 6, wherein said step S1 includes:
the method comprises the steps of obtaining web data of an object by crawling and analyzing network resources, obtaining historical data of the object by calling an ESG database, and obtaining supplementary data of the object by obtaining manual input data;
and the acquired web data, historical data and additional data are subjected to data cleaning and then stored in the information database.
8. The method for processing data of multiple types of data according to claim 6, wherein said step S2 of deriving classification of data comprises: and establishing an index and cache mechanism.
9. The method of data processing of multiple types of data according to claim 6, wherein said plurality of databases comprises: the environment database, the social responsibility database and the company management database are used for respectively acquiring data exported by the data integration storage server from the three aspects of environment, social responsibility and company management;
the plurality of indicators include: the method comprises three indexes of environment E, social responsibility S and company governance G, and a plurality of layers of sub-indexes are set under the three indexes.
10. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the data processing method for multi-type data according to any one of claims 6 to 9.
CN202010245556.2A 2020-03-31 2020-03-31 Data processing system, method and medium for multi-type data Pending CN111460260A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010245556.2A CN111460260A (en) 2020-03-31 2020-03-31 Data processing system, method and medium for multi-type data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010245556.2A CN111460260A (en) 2020-03-31 2020-03-31 Data processing system, method and medium for multi-type data

Publications (1)

Publication Number Publication Date
CN111460260A true CN111460260A (en) 2020-07-28

Family

ID=71682363

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010245556.2A Pending CN111460260A (en) 2020-03-31 2020-03-31 Data processing system, method and medium for multi-type data

Country Status (1)

Country Link
CN (1) CN111460260A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112612908A (en) * 2021-01-05 2021-04-06 上海云扣科技发展有限公司 Natural resource knowledge graph construction method and device, server and readable memory
CN113570281A (en) * 2021-08-20 2021-10-29 瑞格人工智能科技有限公司 ESG index compiling method

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105787262A (en) * 2016-02-20 2016-07-20 成都中医药大学 Traditional Chinese medicine clinical digital evaluation system and evaluation method thereof on basis of big data analysis
CN106504015A (en) * 2016-10-17 2017-03-15 鞍钢集团矿业有限公司 A kind of field supplier of enterprise of combination BP neural network recommends method
CN106952047A (en) * 2017-03-24 2017-07-14 北京中电普华信息技术有限公司 A kind of data processing method and device for electric grid investment benefit
CN107437151A (en) * 2017-08-08 2017-12-05 惠国征信服务股份有限公司 Enterprise credit risk method
CN110046984A (en) * 2019-03-01 2019-07-23 安徽省优质采科技发展有限责任公司 Enterprise credit risk system and evaluation method
CN110210873A (en) * 2019-05-16 2019-09-06 贵州电力交易中心有限责任公司 A kind of electricity market main market players marketization trading activity credit assessment method
CN110472884A (en) * 2019-08-20 2019-11-19 深圳前海微众银行股份有限公司 ESG index monitoring method, device, terminal device and storage medium
CN110532296A (en) * 2019-07-23 2019-12-03 安徽迪科数金科技有限公司 A kind of citizen's credit score assessment system based on the open data of government
CN110532357A (en) * 2019-09-04 2019-12-03 深圳前海微众银行股份有限公司 Generation method, device, equipment and the readable storage medium storing program for executing of ESG score-system
CN110705855A (en) * 2019-09-23 2020-01-17 清华苏州环境创新研究院 Enterprise environment portrait evaluation method and system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105787262A (en) * 2016-02-20 2016-07-20 成都中医药大学 Traditional Chinese medicine clinical digital evaluation system and evaluation method thereof on basis of big data analysis
CN106504015A (en) * 2016-10-17 2017-03-15 鞍钢集团矿业有限公司 A kind of field supplier of enterprise of combination BP neural network recommends method
CN106952047A (en) * 2017-03-24 2017-07-14 北京中电普华信息技术有限公司 A kind of data processing method and device for electric grid investment benefit
CN107437151A (en) * 2017-08-08 2017-12-05 惠国征信服务股份有限公司 Enterprise credit risk method
CN110046984A (en) * 2019-03-01 2019-07-23 安徽省优质采科技发展有限责任公司 Enterprise credit risk system and evaluation method
CN110210873A (en) * 2019-05-16 2019-09-06 贵州电力交易中心有限责任公司 A kind of electricity market main market players marketization trading activity credit assessment method
CN110532296A (en) * 2019-07-23 2019-12-03 安徽迪科数金科技有限公司 A kind of citizen's credit score assessment system based on the open data of government
CN110472884A (en) * 2019-08-20 2019-11-19 深圳前海微众银行股份有限公司 ESG index monitoring method, device, terminal device and storage medium
CN110532357A (en) * 2019-09-04 2019-12-03 深圳前海微众银行股份有限公司 Generation method, device, equipment and the readable storage medium storing program for executing of ESG score-system
CN110705855A (en) * 2019-09-23 2020-01-17 清华苏州环境创新研究院 Enterprise environment portrait evaluation method and system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
袁家海;郭宇;: "中国大型发电上市公司ESG评价体系开发与分值研究", 中国环境管理, no. 05 *
马骏: "国际绿色金融发展与案例研究", 中国金融出版社, pages: 248 - 258 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112612908A (en) * 2021-01-05 2021-04-06 上海云扣科技发展有限公司 Natural resource knowledge graph construction method and device, server and readable memory
CN113570281A (en) * 2021-08-20 2021-10-29 瑞格人工智能科技有限公司 ESG index compiling method

Similar Documents

Publication Publication Date Title
Wu et al. An integrated decision-making model for sustainable photovoltaic module supplier selection based on combined weight and cumulative prospect theory
CN103679373B (en) Produce the full chain budgetary data processing system and method for capital construction standard costs system
CA2916454A1 (en) Distribution transformer heavy loading and overloading mid-term and short-term pre-warning analytics model
Jiang et al. Sustainability efficiency assessment of listed companies in China: a super-efficiency SBM-DEA model considering undesirable output
CN108280541A (en) Customer service strategies formulating method, device based on random forest and decision tree
CN107563627A (en) Workshop MES management methods and system based on bar codes technique
CN111291076A (en) Abnormal water use monitoring and alarming system based on big data and construction method thereof
CN105868373A (en) Method and device for processing key data of power service information system
CN111460260A (en) Data processing system, method and medium for multi-type data
Liu et al. A systematic procurement supply chain optimization technique based on industrial internet of things and application
CN115358522A (en) Enterprise online monitoring system and method
CN106779280B (en) Decision-making determination method and system for secondary equipment major repair and technical modification
Lei et al. Research on the impact of logistics technology progress on employment structure based on DEA-malmquist method
Han Intelligent data management system and performance joint blockchain model for commercial bank management accounting
CN109949101B (en) Big data concept-based cigarette material cost analysis method
CN115905319B (en) Automatic identification method and system for abnormal electricity fees of massive users
CN116308494A (en) Supply chain demand prediction method
CN114254806A (en) Power distribution network heavy overload early warning method and device, computer equipment and storage medium
Madrakhimova et al. DIRECTIONS TO INCREASE RESOURCE SAVING IN TEXTILE ENTERPRISES OF UZBEKISTAN
CN114971696A (en) Quotation method based on electricity consumption and flow information uploading system
CN111369083A (en) Evaluation method and system for investment benefits of power grid project
Li et al. Research on investment demand forecast of power grid based on grey system theory
Yevtukhov et al. Reserves for improving the efficiency of thermal power stations: external on-site energy examination
Zhao et al. Exploring big data applications for public resource transaction
Zhu et al. Efficiency Evaluation of Electric Power Industry Based on DEA Model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination