WO2022247288A1 - 基于计算机系统的核心期刊量化评价系统和方法 - Google Patents

基于计算机系统的核心期刊量化评价系统和方法 Download PDF

Info

Publication number
WO2022247288A1
WO2022247288A1 PCT/CN2021/144039 CN2021144039W WO2022247288A1 WO 2022247288 A1 WO2022247288 A1 WO 2022247288A1 CN 2021144039 W CN2021144039 W CN 2021144039W WO 2022247288 A1 WO2022247288 A1 WO 2022247288A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
subsystem
standard
evaluation
periodicals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/144039
Other languages
English (en)
French (fr)
Inventor
黄晨
徐海燕
韩松涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University
Original Assignee
Zhejiang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University filed Critical Zhejiang University
Publication of WO2022247288A1 publication Critical patent/WO2022247288A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35—Clustering; Classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/38—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06395—Quality analysis or management

Definitions

  • the invention relates to the fields of computer technology, Bibliometrics and subject evaluation, in particular to a system and method for quantitative evaluation of core periodicals based on a computer system.
  • the current academic journal evaluation system is almost all based on citation data, and the mainstream academic journal evaluation method is based on the citation analysis of the WOS database (Web of Science) created by Garfield.
  • the WOS database is divided into three sub-databases, namely SCI (Science Citation Index), SSCI (Social Science Citation Index), and A&HCI (Arts and Humanities Citation Index).
  • SCI Science Citation Index
  • SSCI Social Science Citation Index
  • A&HCI Arts and Humanities Citation Index
  • JCR Journal Citation Report
  • the evaluation of core journals in the JCR report mainly uses the "impact factor" (Impact factor, abbreviated as IF) method.
  • JCR only involves the two sub-databases of SCI and SSCI, that is, there are citation reports for sci-tech journals and social science journals, but for arts and humanities journals (A&HCI sub-database), WOS database does not provide journal citation reports.
  • A&HCI sub-database arts and humanities journals
  • journal citations in the A&HCI sub-library (arts and humanities) in the WOS database, but the number of citations is very small, almost negligible compared with science and social sciences. Therefore, the builders of the WOS database did not finally provide journal citation reports, indicating that they understand the uniqueness of the field of arts and humanities, such as the originality of the results in the field of arts and humanities, not necessarily based on other results, etc. It is inappropriate to evaluate its journals by citations, which means that the method of evaluating journals by citations is flawed, and the citation evaluation method is not suitable for journals in the field of arts and humanities.
  • the technical problem to be solved by the present invention is to provide a computer system-based core periodical quantitative evaluation system and method, to change the traditional periodical evaluation method based on WOS database citation data, to avoid subjective interference, to use Scientifically evaluate the quality of literature.
  • the present invention proposes a quantitative evaluation system for core periodicals based on a computer system, including a basic database, a subject classification subsystem, a standard subsystem, and an evaluation subsystem, wherein:
  • the basic database is used to construct all subject information databases, and the basic database includes academic information data including papers and periodicals;
  • the subject classification subsystem is used to classify the periodicals in the basic database according to different subjects to achieve the goal of subject alignment;
  • the standard subsystem is used as a standard body to evaluate academic quality; according to the subject ranking and evaluation results, the collection of papers from excellent academic institutions of the evaluation index within a certain period of time is included in the standard subsystem;
  • the evaluation subsystem is used to calculate the academic quality of each periodical belonging to the subject; by inputting subject information, calculating the paper hit rate of each periodical corresponding to the subject in the standard subsystem, and obtaining the quality evaluation index of the periodical.
  • the basic database includes a complete collection of papers, a complete collection of periodicals, a classification list, a list of subjects, and a complete collection of academic institutions.
  • the quality evaluation index of the journal is obtained by weighted calculation of the absolute number of papers published by the standard subsystem and the proportion of papers published by the corresponding journal within a certain period of time.
  • the weighted calculation method is as follows:
  • the subject classification subsystem is based on the preset subject classification standard, if the input subject information is the same as the subject in the preset subject classification standard, it will remain unchanged; if the input subject information is consistent with the Subjects in the preset subject classification standards are different, and subject mapping is carried out by subjective and/or objective methods.
  • the subjective method is that library science taxonomy experts analyze the extension and connotation of different disciplines and perform discipline mapping.
  • the objective method is the setting of subject periodicals by subject experts of different institutions, or comprehensive analysis of subject periodicals set by different institutions in different systems, and determine the proportion of the same periodicals according to the proportion of the same periodicals included. relationship between.
  • the preset subject classification standard is the subject classification standard of the Ministry of Education.
  • the excellent academic institutions of the standard subsystem are a certain number of top-ranking academic institutions selected from the preset subject classification standards.
  • the construction method of the standard subsystem is:
  • the calculation method of the paper hit rate in the standard subsystem is:
  • the subject list includes at least any one of humanities, social sciences, and sciences.
  • the selection and evaluation results of the set of subject periodicals are arranged in descending order according to the comprehensive quantitative evaluation value.
  • the present invention also discloses a computer system-based quantitative evaluation method for core periodicals, including the following steps:
  • the basic database includes a complete collection of papers, a complete collection of periodicals, a classification list, a list of subjects, and a complete collection of academic institutions.
  • the quality evaluation index of the journal is obtained by weighted calculation of the absolute number of papers published by the standard subsystem and the proportion of papers published by the corresponding journal within a certain period of time.
  • the certain period mentioned above refers to the period of time for the quantitative evaluation of journals, which can be selected according to needs, usually a certain number of years, such as 5 years, 10 years.
  • the weighted calculation method is as follows:
  • the subject classification is based on the preset subject classification standard, if the input subject information is the same as the subject in the preset subject classification standard, it will remain unchanged; if the input subject information is consistent with the preset
  • the subjects in the subject classification standard are different, and subject mapping is carried out by subjective and/or objective methods to achieve the goal of subject alignment.
  • the subjective method is that library science taxonomy experts analyze the extension and connotation of different disciplines and perform discipline mapping.
  • the objective method is the setting of subject journals by subject experts of different institutions, or comprehensive analysis of subject periodicals set by different institutions on subjects of different systems, and determine the proportion of the same periodicals according to the proportion of the same periodicals included. relationship between.
  • the preset subject classification standard is the subject classification standard of the Ministry of Education.
  • the excellent academic institutions of the standard subsystem are a certain number of top-ranking academic institutions selected from the preset subject classification standards.
  • the certain number can be set according to needs, for example, it can be the top 5, top 10, top 20 academic institutions and so on.
  • the construction method of the standard subsystem is:
  • the calculation of the paper hit rate includes the following steps:
  • the subject list includes at least any one of humanities, social sciences, and sciences.
  • the selection and evaluation results of the set of subject periodicals are arranged in descending order according to the comprehensive quantitative evaluation value.
  • the present invention provides a brand-new journal evaluation system and method capable of evaluating journals of all disciplines, to solve two major problems existing in the prior art for journal evaluation, and finally achieve two main innovation points:
  • One is to propose a core journal evaluation method that is not based on citations, and enrich the core journal evaluation theoretical system.
  • journal evaluation is flawless from the perspective of evaluating journals in different disciplines, that is, it is applicable to the evaluation of journals in any discipline, so as to solve the problem that there are no core journal evaluation standards for journals in the field of arts and humanities among foreign language journals.
  • the "computer system-based quantitative evaluation system for core periodicals" proposed by the present invention is a system with the above two innovations. Dilute the number of accepted papers and citation rate, and do not use SCI and ESI related indicators as the requirements for direct judgment.
  • the beneficial effect of the present invention is: the subject evaluation and quantification system, by examining the publication period of scholars with excellent evaluation indicators, uses the excellent academic institutions of the evaluation indicators to indirectly evaluate the academic performance of scholar. Academic output, due to the use of big data analysis and post-evaluation mechanism, is measured by big data instead of being limited to the measurement of one person, one paper, which can effectively reduce the disadvantages of fraud and ranking.
  • the system judges through the submission behavior of data analysis professionals, rather than through questionnaires and interviews. It can effectively avoid subjective interference, change the traditional evaluation system based on SCI citations, and effectively improve the evaluation and quantification level of subject literature quality.
  • Fig. 1 is a functional block diagram of the core periodical quantitative evaluation system described in the embodiment of the present invention.
  • Fig. 2 is a flow chart of the method for quantitative evaluation of the core periodicals described in the embodiment of the present invention.
  • Fig. 3 is a flowchart of the construction of the subject alignment subsystem according to the embodiment of the present invention.
  • Fig. 4 is a flow chart of building a collection of academic institutions with excellent evaluations in a certain subject according to the embodiment of the present invention.
  • Fig. 5 is a flow chart of building a subject standard subsystem according to the embodiment of the present invention.
  • Fig. 6 is a flow chart of calculating the paper hit rate of a subject standard subsystem according to an embodiment of the present invention.
  • Fig. 7(a) to Fig. 7(c) are illustrations of the system work of periodical evaluation according to the embodiment of the present invention.
  • first and second are only for descriptive purposes, and cannot be understood as indicating or implying their relative importance Or implicitly indicate the number of technical features indicated. Therefore, technical features defined as “first” and “second” may explicitly or implicitly include at least one of these features.
  • technical solutions of the various embodiments can be combined with each other, but it must be based on the realization of those skilled in the art.
  • the embodiment of the present invention starts with building an effective academic circle, and conducts statistical analysis on the distribution of academic papers in the academic circle, so as to identify high-level journals and papers to complete quantitative evaluation.
  • the present invention provides a computer system-based quantitative evaluation system and method for core periodicals, which is a brand-new evaluation system for core periodicals using big data to build a database system. All relevant content, that is, does not depend on citations, and redefines various parameters of core journal evaluation.
  • the main technical ideas of the present invention are:
  • a journal is essentially an academic forum.
  • Periodical groups in the same field constitute several special editions of the forum.
  • Each special edition will form its own group of scholars.
  • the scholar group is both readers and authors, and they will automatically choose And gathering, high-quality special editions will naturally gather high-quality scholars, that is, first-class academic circles.
  • the present invention uses the identification of scholar groups as a parameter for evaluating the quality of periodicals.
  • the core periodical quantitative evaluation system described in the embodiment of the present invention includes a basic database, a subject classification subsystem, a standard subsystem, and an evaluation subsystem, wherein:
  • the basic database is used to construct all subject information databases, including academic information data including papers and periodicals;
  • the subject classification subsystem is used to classify the periodicals in the basic database according to different subjects to achieve the goal of subject alignment;
  • the standard subsystem is used as a standard body to evaluate academic quality; according to the subject ranking and evaluation results, the collection of papers from excellent academic institutions of the evaluation index within a certain period of time is included in the standard subsystem;
  • the evaluation subsystem is used to calculate the academic quality of each periodical belonging to the subject; by inputting subject information, calculating the paper hit rate of each periodical corresponding to the subject in the standard subsystem, and obtaining the quality evaluation index of the periodical.
  • the basic database includes a complete collection of papers, a complete collection of periodicals, a classification list, a list of subjects, and a complete collection of academic institutions.
  • the quantitative evaluation value of the subject periodicals is obtained by the weighted calculation of the absolute number of articles published by the standard subsystem papers and the proportion of articles published by the corresponding periodicals within a certain period of time.
  • the weighted calculation method is as follows:
  • comprehensive quantitative evaluation value 0.45*J+0.55*r.
  • the selection and evaluation results of the collection of subject periodicals are arranged in descending order according to the comprehensive quantitative evaluation value.
  • data of 5 years is generally used, but the period of time can be changed according to the characteristics of the discipline.
  • the absolute number of first-class papers published (J) and the relative number of published papers (r) are two indicators to be used, but their weights 0.45 and 0.55 are variable, and the use of 0.45 and 0.55 in this application is through
  • the weight can be adjusted.
  • the subject classification subsystem is based on the preset subject classification standard, if the input subject information is the same as the subject in the preset subject classification standard, it remains unchanged; if the input Subject information is different from the subjects in the preset subject classification standards, and subject mapping is performed using subjective and objective methods to achieve the goal of subject alignment. Both subjective and objective methods are usually used in combination.
  • the subjective method is that library science taxonomy experts analyze the extension and connotation of different disciplines and perform discipline mapping.
  • the objective method is the setting of subject periodicals by subject experts of different institutions, or comprehensive analysis of subject periodicals set by different institutions in different systems, and determine the proportion of the same periodicals according to the proportion of the same periodicals included. relationship between.
  • the subject classification subsystem is to solve the problem of merging calculations between subjects.
  • the specific algorithm refers to the algorithm for merging similar subjects to achieve subject classification.
  • common clustering algorithms include K-MEANS algorithm, K-MEDOIDS algorithm, CLARANS algorithm, BIRCH algorithm, CURE algorithm and so on.
  • the present invention mainly uses the clustering and discrete method (K-Means) to merge subjects according to the repetition rate of the same periodicals contained in different subjects.
  • K-Means clustering and discrete method
  • the K-Means algorithm formula is:
  • x is the mean vector of cluster Ci.
  • E represents the closeness of the samples in the cluster around the cluster mean vector, and the smaller the E value, the higher the similarity of the samples in the cluster.
  • a higher degree of similarity means that related disciplines have similarity, and the result of the algorithm is a combination of disciplines.
  • the preset subject classification standard is the subject classification standard of the Ministry of Education.
  • the excellent academic institutions of the standard subsystem are a certain number of top-ranked academic institutions selected from the preset subject classification standards.
  • the excellent academic institution of the subject evaluation index is constructed based on the subject ranking as the basis of the dynamic measurement evaluation method.
  • S ac represents the complete collection of subjects
  • P ac represents the complete collection of papers
  • J ac represents the complete works of periodicals
  • MAX Indicates the maximum value of a subject defined when the subject rank exceeds C qr ;
  • Rank(u i ,S,Y) represents the ranking of the academic institution (u i ) in the subject (S) in the year (Y).
  • one of the standard subsystem construction methods may be:
  • the calculation method of the paper hit rate in the subject standard subsystem is:
  • the present invention also discloses a computer system-based quantitative evaluation method for core periodicals, including the following steps:
  • the basic database includes a complete collection of papers, a complete collection of periodicals, a classification list, a list of subjects, and a complete collection of academic institutions.
  • the quality evaluation index of the journal is obtained by weighted calculation of the absolute number of papers published by the standard subsystem and the proportion of papers published by the corresponding journal within a certain period of time.
  • the weighted calculation method is as follows:
  • the subject classification is based on the preset subject classification standard, if the input subject information is the same as the subject in the preset subject classification standard, it remains unchanged; if the input subject The information is different from the disciplines in the preset discipline classification standards.
  • Subjective and objective methods are used to map the disciplines to achieve the goal of discipline alignment. The subjective and objective methods are usually used comprehensively.
  • the subjective method is that library science taxonomy experts analyze the extension and connotation of different disciplines and perform discipline mapping.
  • the objective method is the setting of subject journals by subject experts of different institutions, or comprehensive analysis of subject periodicals set by different institutions on subjects of different systems, and determine the proportion of the same periodicals according to the proportion of the same periodicals included. relationship between.
  • the preset subject classification standard is the subject classification standard of the Ministry of Education.
  • the excellent academic institutions of the standard subsystem are a certain number of top-ranked academic institutions selected from the preset subject classification standards.
  • the calculation of the paper hit rate includes the following steps:
  • the subject list includes at least any one of humanities, social sciences, and sciences.
  • the selection and evaluation results of the set of subject periodicals are arranged in descending order according to the comprehensive quantitative evaluation value.
  • the ESI Subject Ranking is established by Thomson Science and Technology Information Group on the basis of collecting and analyzing the academic literature collected by ISI Web of Science (SCI) and the references cited by it, aiming at mathematics, physics, chemistry, medicine, Agronomy and other 22 professional fields are ranked.
  • Quacquarelli Symonds (QS for short), a British international education market consulting company, releases the "QS World University Rankings by Subject” every year in 48 subject areas, evaluating world-class universities from four dimensions: academic reputation, employer evaluation, paper citations and h-index. ranking.
  • the QS ranking is used as the value basis; of course, USNews, soft Subjects, Ministry of Education subject evaluation rankings, etc.
  • Each first-level subject of the Ministry of Education will correspond to multiple WOS journal classifications. Due to the differences between WOS classification, QS classification and the Ministry of Education’s subject classification, individual subjects are grouped into subject categories or evaluated separately for second-level subjects. It should be noted that some disciplines that are classified as humanities by the Ministry of Education are classified as social sciences in WOS, and vice versa. For example, folklore, WOS belongs to the humanities, and the discipline of the Ministry of Education belongs to the category of social science and law. Another example is that there is journalism and communication under the category of literature in the Ministry of Education, and there is a category of communication in WOS, which belongs to social sciences.
  • journal selection function As CoreJournal_Select(S,Y)
  • C_f Indicates that among academic journals, the journals hit by C_f first-class academic papers are the core journals;
  • C_t indicates that the former C_t of academic journals is selected as the core journal
  • C_p indicates that the top C_p% of academic journals are selected as core journals
  • sub_qs (if sub ⁇ SUBwos, fwq(sub), (if sub ⁇ SUBes, feq(sub), sub))
  • fwq(sub) represents the conversion from wos subject alignment to QS subject
  • feq(sub) represents the conversion from the subject of the Ministry of Education to the subject of QS.
  • Figure 7(a) to 7(c) it is an operation example of the periodical evaluation system of the embodiment of the present invention.
  • Figure 7(a) shows the initial interface of the evaluation system, and you can see the list of various subjects.
  • Figure 7(b) shows the subject/category mapping table. Users can select the classification table corresponding to a certain subject according to the actual situation. After selection, the displayed result is shown in Figure 7(c).
  • the data set is statistically analyzed, and the distribution of papers published in various disciplines and the list of important journals are obtained.
  • the following takes the humanities as an example to illustrate the specific implementation process of the present invention. It should be noted that the method of the present invention is applicable to any discipline. There are no language restrictions for periodicals of various disciplines.
  • the catalog can be regarded as the evaluation results of journals by subject experts, among which 27 of the top 30 journals set as top, A+, and A are in the SSCI economics catalog.
  • the core journal results obtained by the impact factor evaluation method are compared with the results obtained by the core journal quantitative system described in this example, using three evaluation methods ( Subject expert periodical grading, core periodical quantification system, impact factor method) to sort the periodicals, the list is as follows Table 3.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • Educational Administration (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • General Engineering & Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Marketing (AREA)
  • Databases & Information Systems (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Library & Information Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Probability & Statistics with Applications (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种基于计算机系统的核心期刊量化评价系统和方法,该评价系统具体包括:基础数据库、学科分类子系统、标准子系统和评价子系统;基础数据库包括论文、期刊在内的学术信息数据;学科分类子系统,用于将基础数据库中的期刊根据不同的学科进行分类,达到学科对齐的目标;标准子系统,作为标准体用于评价学术质量,将一定时期内的该评价指标优秀学术机构的论文集合纳入标准子系统;评价子系统,用于计算该学科所属各期刊的学术质量;通过输入学科信息,计算该学科对应的各期刊在标准子系统中的论文命中率,得出该期刊的质量评价指标。该方法可以规避主观干扰,改变以SCI引文为基础的评价体系,有效提升学科文献质量的评价量化水平。

Description

基于计算机系统的核心期刊量化评价系统和方法 技术领域
本发明涉及计算机技术及文献计量学、学科评价领域,特别涉及一种基于计算机系统的核心期刊量化评价系统和方法。
背景技术
目前的学术期刊评价体系几乎都是以引文数据作为依据,主流的学术期刊测评方法是基于Garfield创立的WOS数据库(Web of Science)的引文分析。WOS数据库分为三个子库,分别是SCI(科学引文索引)、SSCI(社会科学引文索引)、A&HCI(艺术与人文引文索引)。对于期刊的引文排序评价,WOS数据库提供了JCR(期刊引用报告),并且每年发布一次,来对WOS数据库收入的期刊进行排序,从而确定核心期刊。JCR报告中对核心期刊的评价主要用“影响因子”(Impact factor,缩写IF)的方法。“影响因子”的定义为:当年影响因子等于某一年对上两年期刊的所有引用总次数除以前两年期刊发表论文的总数。用公式表示IF=A/B(A=某一年对前两年该期刊的引用总次数;B=前两年该期刊的发文总数)。
JCR只涉及SCI和SSCI两个子库,即对科技期刊和社科期刊有引文报告,而对于艺术与人文领域期刊(A&HCI子库),WOS数据库没有提供期刊引文报告。现有技术对于期刊评价存在两问题:
一是以“影响因子”为主要方式的引文评价方式,其评价不是普适于所有学科的,艺术与人文学科无法用“影响因子”的方式来评价。
WOS数据库中的A&HCI子库(艺术与人文领域)中是有的期刊引用情况的,但引用数量非常少,较科学和社会科学领域来说,几乎可忽略不计。所以WOS数据库建设者没有最终提供期刊引用报告,说明他们了解艺术与人文领域因其学科的独特性,如艺术与人文领域成果具有独创性,不一定是建立在其他成果的基础上的等原因,用引文来对其期刊进行评价是不妥当的,也就是说用引文对期刊进行评价的方法是有缺陷的,引文评价方法不适用于艺术与人文学科领域的期刊。
二是就外文期刊来说,艺术与人文领域的核心期刊评价是缺失的。
因为对于外文期刊的唯一核心期刊评价方式是“影响因子”的评价方式,而该方式不能用于艺术与人文学科,所以艺术与人文学科的外文期刊没有相应的核心期刊评价方法。
目前,没有一种不依赖于引文且能够对所有的学科期刊进行评价的核心期刊评价方法。
发明内容
基于现有技术存在的不足,本发明所要解决的技术问题是提供一种基于计算机系统的核心期刊量化评价系统和方法,改变传统以WOS数据库引文数据为依据的期刊评价方式,规 避主观干扰,使用科学方式评价文献质量。
本发明提出一种基于计算机系统的核心期刊量化评价系统,包括基础数据库、学科分类子系统、标准子系统、以及评价子系统,其中:
所述的基础数据库,用于构建所有的学科信息数据库,所述的基础数据库包括论文、期刊在内的学术信息数据;
所述的学科分类子系统,用于将基础数据库中的期刊根据不同的学科进行分类,达到学科对齐的目标;
所述的标准子系统,作为标准体用于评价学术质量;根据学科排名与评估成果,将一定时期内的该评价指标优秀学术机构的论文集合纳入标准子系统;
所述的评价子系统,用于计算该学科所属各期刊的学术质量;通过输入学科信息,计算该学科对应的各期刊在标准子系统中的论文命中率,得出该期刊的质量评价指标。
作为优选,所述的基础数据库包括论文全集、期刊全集、分类列表、学科列表、学术机构全集。
作为优选,所述期刊的质量评价指标由标准子系统论文的发文绝对数量和对应期刊在一定时期内的发文比例按加权运算获得。
作为优选,所述加权运算方法如下:
(1)设定期刊发文总数(K):即该期刊在命中数值相对应的时间段内的发文总数;
(2)标准子系统的发文总数(J):即该期刊在相应时间段内标准子系统命中的绝对数
量;
(3)折算的TOP高校发文量(r):
Figure PCTCN2021144039-appb-000001
是指K的平均值
(4)以上两个指标先标准化后归一化,再加权相加,经过多次不同权重运算,最终权
重定为w 1和w 2,即:综合量化评价值=w 1*J+w 2*r。
作为优选,所述学科分类子系统是以预设学科分类标准为依据,若输入的学科信息与所述预设学科分类标准中的学科相同,则保持不变;若输入的学科信息与所述预设学科分类标准中的学科不同,用主观和/或客观两种方法对进行学科映射。
作为优选,所述主观的方法是图书馆学分类专家对不同学科的外延内涵进行分析,进行学科映射工作。
作为优选,所述客观的方法是不同机构学科专家对学科期刊的设定,或者不同机构对不同体系学科设定的本学科期刊进行综合分析,根据所包含相同期刊的比例等内容来确定学科之间的关系。
作为优选,所述预设学科分类标准为教育部学科分类标准。
作为优选,所述标准子系统的优秀学术机构为预设学科分类标准中选择排名居前的一定数量的学术机构。
作为优选,所述标准子系统的构建方式为:
(1)输入学科对应的该项评价指标排名靠前的学术机构集合;
(2)从学科对应的基础数据库中任意选取一篇论文,判断其作者机构是否在所述评价指标排名靠前的学术机构集合中,若是,则将该论文加入标准子系统;若否,则将该论文从论文全集中移除;
(3)遍历基础数据库中学科对应的论文全集之后,输出该学科对应的标准子系统。
作为优选,所述标准子系统中的论文命中率计算方式为:
(1)输入学科对应的标准子系统;
(2)基础数据库中预设学科对应的学科期刊集合中所有期刊的命中率为0;
(3)从学科对应的学科期刊集合中任意选取一本期刊,并从标准子系统中任意选取一篇论文,判断该论文是否发表在所选期刊中,若是,则将该期刊的命中率加1,并将该论文从标准子系统中移除;若否,则直接将该论文从标准子系统中移除;
(4)遍历学科对应的标准子系统之后,将对应期刊从基础数据库中移除;
(5)遍历学科对应的基础数据库之后,输出该学科对应的标准子系统的论文命中率。
作为优选,所述学科列表至少包括人文学科、社科学科、科学学科中的任意一种学科。
作为优选,所述学科期刊集合的遴选评价结果按照综合量化评价值进行降序排列。
另外,本发明还公开了一种基于计算机系统的核心期刊量化评价方法,包括以下步骤:
(1)构建基础数据库,包括论文、期刊在内的学术信息数据;
(2)将基础数据库中的期刊根据不同的学科进行分类,达到学科对齐的目标;
(3)根据学科排名与评估成果,将一定时期内该评价指标优秀的学术机构的论文集合纳入标准子系统,作为标准体用于评价学术质量;
(4)通过输入学科信息,计算该学科对应的各期刊在标准子系统中的论文命中率,得出该期刊的质量评价指标。
作为优选,所述的基础数据库包括论文全集、期刊全集、分类列表、学科列表、学术机构全集。
作为优选,所述期刊的质量评价指标由标准子系统论文的发文绝对数量和对应期刊在一定时期内的发文比例按加权运算获得。所述的一定时期是指期刊量化评价的时间区间,可以根据需要选择,通常选定若干年,例如5年,10年。
作为优选,所述加权运算方法如下:
(1)设定期刊发文总数(K):即该期刊在命中数值相对应的时间段内的发文总数;
(2)标准子系统的发文总数(J):即该期刊在相应时间段内标准子系统命中的绝对数量;
(3)折算的TOP高校发文量(r):
Figure PCTCN2021144039-appb-000002
是指K的平均值;
(4)以上两个指标先标准化后归一化,再加权相加,经过多次不同权重运算,最终权重定为w 1和w 2,即:综合量化评价值=w 1*J+w 2*r。
作为优选,所述学科分类是以预设学科分类标准为依据,若输入的学科信息与所述预设学科分类标准中的学科相同,则保持不变;若输入的学科信息与所述预设学科分类标准中的学科不同,用主观和/或客观两种方法对进行学科映射,达到学科对齐的目标。
作为优选,所述主观的方法是图书馆学分类专家对不同学科的外延内涵进行分析,进行学科映射工作。
作为优选,所述客观的方法是不同机构学科专家对学科期刊的设定,或者不同机构对不同体系学科设定的该学科期刊进行综合分析,根据所包含相同期刊的比例等内容来确定学科之间的关系。
作为优选,所述预设学科分类标准为教育部学科分类标准。
作为优选,所述标准子系统的优秀学术机构为预设学科分类标准中选择排名居前的一定数量的学术机构。所述的一定数量可以根据需要设定,例如,可以是排名居前的前5,前10,前20个学术机构等。
作为优选,所述标准子系统的构建方式为:
(1)输入学科对应的该项评价指标排名靠前的学术机构集合;
(2)从学科对应的基础数据库中任意选取一篇论文,判断其作者机构是否在所述评价指标排名靠前的学术机构集合中,若是,则将该论文加入标准子系统;若否,则将该论文从论文全集中移除;
(3)遍历基础数据库中学科对应的论文全集之后,输出该学科对应的标准子系统。
作为优选,所述论文命中率的计算包括以下步骤:
(1)输入学科对应的标准子系统;
(2)基础数据库中预设学科对应的学科期刊集合中所有期刊的命中率为0;
(3)从学科对应的学科期刊集合中任意选取一本期刊,并从标准子系统中任意选取一篇论文,判断该论文是否发表在所选期刊中,若是,则将该期刊的命中率加1,并将该论文从标准子系统中移除;若否,则直接将该论文从标准子系统中移除;
(4)遍历学科对应的标准子系统之后,将对应期刊从基础数据库中移除;
(5)遍历学科对应的基础数据库之后,输出该学科对应的标准子系统的论文命中率。
作为优选,所述学科列表至少包括人文学科、社科学科、科学学科中的任意一种学科。
作为优选,所述学科期刊集合的遴选评价结果按照综合量化评价值进行降序排列。
本发明提供了一种全新的,能对所有学科期刊进行评价的期刊评价系统和方法,来解决现有技术对于期刊评价存在的两大问题,最终达到两个主要的创新点:
一是提出一种不基于引文的核心期刊评价方式,丰富核心期刊评价理论体系。
二是这种期刊评价方式从评价不同学科期刊角度来说是无缺陷的,即适用于任何学科领域的期刊评价,从而解决外文期刊中艺术与人文学科领域期刊没有核心期刊评价标准的问题。
本发明提出的“基于计算机系统的核心期刊量化评价系统”即是具有上述两个创新点的系统。淡化论文收录数和引用率,不将SCI、ESI相关指标作为直接判断依据的要求。
综上所述,与现有技术相比,本发明的有益效果是:所述学科评价量化的系统,通过考察待评价指标优秀的学者发文区间,利用该评价指标优秀学术机构以间接评价学者的学术产出,由于采用大数据分析和后评价机制,以大数据为计量而不局限于一人一文的计量,能够有效减少造假和刷榜的弊病。该系统通过数据分析学者的投稿行为来进行评判,而不是通过问卷、访谈形式,可以有效规避主观干扰,改变传统的以SCI引文为基础的评价体系,有效提升学科文献质量的评价量化水平。
附图说明
为了更清楚地说明本发明实施例的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍。
图1为本发明实施例所述核心期刊量化评价系统的原理框图。
图2为本发明实施例所述核心期刊量化评价的方法流程图。
图3是本发明实施例所述学科对齐子系统的构建流程图。
图4是本发明实施例所述某学科评价优秀的学术机构集合构建流程图。
图5是本发明实施例所述某学科标准子系统构建流程图。
图6是本发明实施例所述某学科标准子系统论文命中率的计算流程图。
图7(a)至图7(c)是本发明实施例所述期刊评价的系统工作图例。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述。显然,所描述的实施例仅仅是本发明的一部分实施例,而不是全部的实施例。基于以下实施例,本领域普通技术人员在无需作出创造性劳动的前提下所获得的其他实施例,均属本发明的保护范围。
若本发明实施例中有涉及“第一”、“第二”等描述,则该“第一”、“第二”的描述仅用于描述目的,而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的技术特征可以明示或者隐含地包括至少一个该特征。此外,各个实施例之间的技术方案可以相互结合,但必须是以本领域普通技术人员能够实现为基础。
评价学者的学术成果目前主要依赖于发文期刊,评价期刊则依赖基于引文分析的评测,离开引文分析几乎无法构建有效的评价尺度。人文社科类的评价有别于理工学科流行的引文 分析法,人文学者在发文量和引用量上都很难进行计量比较,Web of Science也不提供人文学者的被引数据,学界对于人文学者普遍缺乏有效的计量分析手段。同行评议理论上是最佳的学术评价手段,其核心在于圈内人的学术价值评估。但是如何界定高质量学术圈,如何保证同行评议的客观,由于人的社会属性使得其中的干扰因素无法有效排除,这一方法一直无法广泛应用。鉴于此,本发明的实施例拟从构建有效的学术圈入手,对学术圈的学术论文分布进行统计分析,从而识别高水平期刊与论文,以完成量化评价。
为实现上述目的,本发明提供了一种基于计算机系统的核心期刊量化评价系统及方法,这是一种全新的利用大数据构建数据库系统进行的核心期刊评价系统,该评价系统完全摒弃了与引文相关的全部内容,也就是不依赖于引文,重新定义了核心期刊评价的各种参数,本发明的主要技术思路为:
从期刊的角度,期刊本质上是一个学术论坛,同一个领域的期刊群构成了论坛的若干个专题版,每个专题版都会形成自己的学者群,学者群既是读者也是作者,他们会自动选择和集聚,高质量的专题版自然会集聚高质量的学者群,也就是一流的学术圈。基于以上技术思路,本发明通过辨别学者群作为评价期刊质量的参数。
从学术机构的角度,学术机构是最主要区分的学者群的方式。同一学术机构中的学者会形成共同的“学术价值观”,即对学术期刊的共同评价标准,并用向某一批期刊投稿行为来实践他们的“学术价值观”。也就是本发明所述的“学者学术行为”,包含但不限于学者撰写论文、投稿、并在期刊中发表论文的行为。一流学术机构的学者群其学术行为指向的期刊群就是核心期刊。数个一流学术机构组成某个学科的“一流学术圏”,通过在大数据中发现每个学科的一流学术圈的“学者学术行为”,就能找到不同学科的核心期刊。“学者学术行为”可以作为评价期刊质量的参数。
如图1所示,本发明实施例所述核心期刊量化评价系统包括基础数据库、学科分类子系统、标准子系统、以及评价子系统,其中:
所述的基础数据库,用于构建所有的学科信息数据库,包括论文、期刊在内的学术信息数据;
所述的学科分类子系统,用于将基础数据库中的期刊根据不同的学科进行分类,达到学科对齐的目标;
所述的标准子系统,作为标准体用于评价学术质量;根据学科排名与评估成果,将一定时期内的该评价指标优秀学术机构的论文集合纳入标准子系统;
所述的评价子系统,用于计算该学科所属各期刊的学术质量;通过输入学科信息,计算该学科对应的各期刊在标准子系统中的论文命中率,得出该期刊的质量评价指标。
作为优选,所述的基础数据库包括论文全集、期刊全集、分类列表、学科列表、学术机构全集。
作为优选,对于学科期刊的量化评价值由标准子系统论文的发文绝对数量和对应期刊 在一定时期内的发文比例按加权运算获得。
作为优选,所述加权运算方法如下:
(1)设定期刊发文总数(K):即该期刊在命中数值相对应的时间段内的发文总数;
(2)标准子系统的发文总数(J):即该期刊在相应时间段内标准子系统命中的绝对数量;
(3)折算的TOP高校发文量(r):
Figure PCTCN2021144039-appb-000003
是指K的平均值
(4)以上两个指标先标准化后归一化,再加权相加,经过多次不同权重运算,最终权
重定为w 1和w 2,即:综合量化评价值=w 1*J+w 2*r。
本实施例中,根据学科大小、学科发文情况等不同学科的特征,经过数据计算,权重w 1和w 2定为0.45和0.55,即:综合量化评价值=0.45*J+0.55*r。所述学科期刊集合的遴选评价结果按照综合量化评价值进行降序排列。上述第一步中“相对应的时间段内”,一般使用5年的数据,但该年限可以根据学科的特征而变动。上述第四步中,使用一流论文绝对发文总数(J)与相对发文(r)是两个确定使用的指标,但其权重0.45与0.55是可变动的,本申请书中使用0.45与0.55是通过数据计算后,得出的阶段性较为合理的结果,针对不同学科的特征,该权重是可以调整的。
作为优选,如图3所示,所述学科分类子系统是以预设学科分类标准为依据,若输入的学科信息与所述预设学科分类标准中的学科相同,则保持不变;若输入的学科信息与所述预设学科分类标准中的学科不同,用主观和客观两种方法对进行学科映射,达到学科对齐的目标。主客观两种方式通常是综合使用的。
作为优选,所述主观的方法是图书馆学分类专家对不同学科的外延内涵进行分析,进行学科映射工作。
作为优选,所述客观的方法是不同机构学科专家对学科期刊的设定,或者不同机构对不同体系学科设定的本学科期刊进行综合分析,根据所包含相同期刊的比例等内容来确定学科之间的关系。
对于期刊的学科分类问题,不是简单地使用学科名录里的学科,而是根据特定算法将比较相近的学科进行合并计算,其目的是避免人为地将相近的学科拆分成多个学科。原理主要是因为学科与学科之间会有相关性高或低的关系,这导致了有些学者会在相近学科的期刊上发表其研究方向上的研究成果。如果对相近学科进行合并更有利于将一流学术圈与学科的对应。学科分类子系统就是解决学科之间合并计算的问题,所述的特定算法是指将比较相近的学科进行合并计算、从而实现学科分类的算法,例如,本领域的技术人员可以采用计算机聚类算法等各种算法实现不同学科的分类,常见的聚类算法有K-MEANS算法、K-MEDOIDS算法、CLARANS算法、BIRCH算法、CURE算法等等。
本发明主要根据不同学科包含有相同期刊的重复率,并用聚类离散的方法(K-Means) 来进行学科之间的合并。K-Means的算法公式为:
对样本集D={x1,x2,…,xm},(本发明中D为包含有期刊群的学科。)K-Means算法就是针对聚类划分C={C1,C2,…,Ck}最小化平方误差:(C(Categories)为自定义的聚类数量,本发明中的算法设定为“3、4、5”,用不同的聚类数量计算出不同属性的学科合并的可能性。)
K-Means算法公式为:
Figure PCTCN2021144039-appb-000004
其中:
Figure PCTCN2021144039-appb-000005
其中x是簇Ci的均值向量。
E代表簇内样本围绕簇均值向量的紧密程度,E值越小簇内样本的相似度越高。相似度越高的意义就是指相关的学科具有相似度,算法结果为学科合并。
作为优选,所述预设学科分类标准为教育部学科分类标准。
作为优选,如图4所示,所述标准子系统的优秀学术机构为预设学科分类标准中选择排名居前的一定数量的学术机构。
所述学科评价指标优秀学术机构是基于学科排名构建的作为动态计量评价方法的基础。首先定义学术圈评价全集为U ac:
U ac={S ac,U nac,P ac,J ac}
其中:
S ac代表学科全集;
U nac代表学术机构全集;
P ac代表论文全集;
J ac代表期刊全集;
另外,定义常数如下:
C qr:表示只针对学科排名前C qr的学术机构;
MAX:表示当学科排名超过C qr时所定义的学科最大值;
C:表示学科排名前C的学术机构定义为一流学术机构;本实施例后续验证取为10。
此外,定义学科学术圈相关集合如下:
(a)学术机构集合U(S,Y):表示在年Y学科S的所有学科排名前C的院校集合。
Figure PCTCN2021144039-appb-000006
Rank(u i,S,Y)表示学术机构(u i)在学科(S)在年(Y)的排名。
(b)论文集合P(S,Y):表示在年Y学科S的所有学科排名前C的院校发表的所有论文集合。
Figure PCTCN2021144039-appb-000007
其中,
Figure PCTCN2021144039-appb-000008
表示学术机构(U)在学科(S)在(Y)年发表的所有论文集合;P sub表示P ac全集中所有S学科的论文,search_p(U,p i,Y)为True表示Y年U学术机构发表了一篇论文p i。
作为优选,如图5所示,所述标准子系统构建方式之一可以是:
(1)输入学科对应的该项评价指标排名靠前的学术机构集合;
(2)从学科对应的基础数据库中任意选取一篇论文,判断其作者机构是否在所述评价指标排名靠前的学术机构集合中,若是,则将该论文加入标准子系统;若否,则将该论文从论文全集中移除;
(3)遍历基础数据库中学科对应的论文全集之后,输出该学科对应的标准子系统。
期刊集合J(S,Y):表示该年度Y某学科S的排名前C的学术机构发表的所有论文所在的期刊集合
Figure PCTCN2021144039-appb-000009
其中,
Figure PCTCN2021144039-appb-000010
表示论文p i所在的期刊j,search_j(p,j,Y)为True表示Y年论文p i发表在期刊j上。
于是得出,基于学科排名,Y年的一流学科学术圈Uac_f:
Figure PCTCN2021144039-appb-000011
基于上述定义与函数,可以得到一个学科期刊的可靠评价尺度。由于是利用学者的投稿行为来进行评判,而不是通过问卷、访谈形式,可以有效规避人情和盲点的主观干扰。
上述定义与推演的出发点是学科排名,并由此确定常数C以及C qr的取值。
作为优选,如图6所示,所述学科标准子系统中论文命中率计算方式为:
(1)输入学科对应的标准子系统;
(2)基础数据库中预设学科对应的学科期刊集合中所有期刊的命中率为0;
(3)从学科对应的学科期刊集合中任意选取一本期刊,并从标准子系统中任意选取一篇论文,判断该论文是否发表在所选期刊中,若是,则将该期刊的命中率加1,并将该论文从标准子系统中移除;若否,则直接将该论文从标准子系统中移除;
(4)遍历学科对应的标准子系统之后,将对应期刊从基础数据库中移除;
(5)遍历学科对应的基础数据库之后,输出该学科对应的标准子系统的论文命中率。
如图2所示,本发明还公开了一种基于计算机系统的核心期刊量化评价方法,包括以下步骤:
(1)构建基础数据库,包括论文、期刊在内的学术信息数据;
(2)将基础数据库中的期刊根据不同的学科进行分类,达到学科对齐的目标;
(3)根据学科排名与评估成果,将一定时期内该评价指标优秀的学术机构的论文集合纳入标准子系统,作为标准体用于评价学术质量;
(4)通过输入学科信息,计算该学科对应的各期刊在标准子系统中的论文命中率,得出该期刊的质量评价指标。
作为优选,所述的基础数据库包括论文全集、期刊全集、分类列表、学科列表、学术机构全集。
作为优选,所述期刊的质量评价指标由标准子系统论文的发文绝对数量和对应期刊在一定时期内的发文比例按加权运算获得。
作为优选,所述加权运算方法如下:
(1)设定期刊发文总数(K):即该期刊在命中数值相对应的时间段内的发文总数;
(2)标准子系统的发文总数(J):即该期刊在相应时间段内标准子系统命中的绝对数量;
(3)折算的TOP高校发文量(r):
Figure PCTCN2021144039-appb-000012
是指K的平均值
(4)以上两个指标先标准化后归一化,再加权相加,经过多次不同权重运算,最终权重定为w 1和w 2,即:综合量化评价值=w 1*J+w 2*r。
作为优选,如图3所示,所述学科分类是以预设学科分类标准为依据,若输入的学科信息与所述预设学科分类标准中的学科相同,则保持不变;若输入的学科信息与所述预设学科分类标准中的学科不同,用主观和客观两种方法对进行学科映射,达到学科对齐的目标,主客观两种方式通常是综合使用的。
作为优选,所述主观的方法是图书馆学分类专家对不同学科的外延内涵进行分析,进行学科映射工作。
作为优选,所述客观的方法是不同机构学科专家对学科期刊的设定,或者不同机构对不同体系学科设定的该学科期刊进行综合分析,根据所包含相同期刊的比例等内容来确定学科之间的关系。
作为优选,所述预设学科分类标准为教育部学科分类标准。
作为优选,如图4所示,所述标准子系统的优秀学术机构为预设学科分类标准中选择排名居前的一定数量的学术机构。
作为优选,如图5所示,所述标准子系统的构建方法为:
(1)输入学科对应的该项评价指标排名靠前的学术机构集合;
(2)从学科对应的基础数据库中任意选取一篇论文,判断其作者机构是否在所述评价指标排名靠前的学术机构集合中,若是,则将该论文加入标准子系统;若否,则将该论文从论文全集中移除;
(3)遍历基础数据库中学科对应的论文全集之后,输出该学科对应的标准子系统。
作为优选,如图6所示,所述论文命中率的计算包括以下步骤:
(1)输入学科对应的标准子系统;
(2)基础数据库中预设学科对应的学科期刊集合中所有期刊的命中率为0;
(3)从学科对应的学科期刊集合中任意选取一本期刊,并从标准子系统中任意选取一篇论文,判断该论文是否发表在所选期刊中,若是,则将该期刊的命中率加1,并将该论文从标准子系统中移除;若否,则直接将该论文从标准子系统中移除;
(4)遍历学科对应的标准子系统之后,将对应期刊从基础数据库中移除;
(5)遍历学科对应的基础数据库之后,输出该学科对应的标准子系统的论文命中率。
作为优选,所述学科列表至少包括人文学科、社科学科、科学学科中的任意一种学科。
作为优选,所述学科期刊集合的遴选评价结果按照综合量化评价值进行降序排列。
另外,ESI学科排名是汤姆森科技信息集团在汇集和分析ISI Web of Science(SCI)所收录的学术文献及其所引用的参考文献的基础上建立起来的,针对数学、物理、化学、医学、农学等22个专业领域进行排名。而英国国际教育市场咨询公司Quacquarelli Symonds(简称QS)每年发布的《QS世界大学学科排名》在48个学科领域,从学术声誉、雇主评价、论文引文和h指数四个维度对世界一流大学进行排名。考虑到QS的学科划分与我国的学科分类,尤其是人文社科具有更好的对应性,本实施例中,对于学术圈Uac_f,以QS排名作为取值依据;当然,也可以采取USNews、软科、教育部学科评估排名等。
国内的学科分类有国标《学科分类与代码》(GB/T 13745-2009)和教育部学科分类,国外如WOS和爱思唯尔都有各自的学科分类。由于每个分类体系的思路和目标不同导致对学科划分的差异,相同的学科名称其概念内涵不尽同,不同名称的学科其内涵却有可能一致。本实施例中,将教育部学科、QS学科与WOS分类进行一致性分析,建立“学科映射表”,从而使得三个体系的分类可以有相互比较,乃至转换的可能。
每个教育部一级学科会对应多个WOS的期刊分类,个别学科由于WOS分类、QS分类与教育部学科分类的差异性,归总到学科门类或对二级学科进行单独评价。需要特别说明的是,部分教育部归属于人文的学科在WOS中归属于社科,相反的也有。比如民俗学,WOS归属人文,教育部学科归属社科法学门类。又如教育部文学门类下有新闻传播学,而在WOS有传播学一类,归属于社科。虽然在A&HCI期刊列表中,有传播学一类,并有17种期刊,但在SSCI的传播学一类中有88种期刊,所以对于WOS来说,传播学主要归属于社科。上 述17种期刊只有4种与88种期刊相重,并且这17种期刊第二分类大多为语言或语言学。所以,如前所述,对期刊的分类主要依据第一分类,但也会参考其他分类来确定期刊的归属。
另外发现,国内外对于人文学科的界定具有相当的一致性。即教育部人文一级学科(即哲学、文学、历史、艺术四个学科门类下的一级学科)与QS人文学科分类及WOS对A&HCI中期刊分类有较高的一致性,同时,社科学科(即经济学、法学、教育学、管理学四个学科门类)部分学科与QS学科分类及WOS对SSCI中期刊分类也有较高的一致性。
关于期刊的评价与遴选,定义期刊遴选函数为CoreJournal_Select(S,Y)
定义常数:
C_f:表示学术期刊中被C_f篇一流学科论文命中的期刊为核心期刊;
C_t:表示选择学术期刊的前C_t为核心期刊;
C_p:表示选择学术期刊的前C_p%为核心期刊;
则有学科sub_qs:
sub_qs=(if sub∈SUBwos,fwq(sub),(if sub∈SUBes,feq(sub),sub))
Ip=|P(sub_qs,year)|;
Ij=|J(sub_qs,year)|;
While j=1 to Ij
rj=0;
While i=1 to Ip
If search_j(Pi,Jj,Y)=True,(Jj,rj++)
SORT(j,r)by r Descending
于是有核心期刊集合:CoreJournal(S,Y)
Select j while r≥C_f or the first C_t or first C_p%to Set of CoreJournal(S,Y)    (5)
其中:
fwq(sub)代表由wos学科对齐转化为QS学科;
feq(sub)代表从教育部学科转化为QS学科。
根据上述定义,以2019年SSCI、A&HCI所收入的5220种期刊为研究对象。其中,人文学科期刊以A&HCI2019年收录的1834种期刊作为基础期刊。社科期刊根据2019年发布的JCR2018,SSCI的4781种期刊有58个类目,由于一种期刊会分入到多个类目里,去重后实际有3386种期刊。以上期刊在2014-2018五年间共发表论文50余万篇,对这些论文的元数据进行结构化并完成学科映射,形成本实施例评价分析的数据集。
如图7(a)至7(c)所示,为本发明实施例的期刊评价系统操作实例,在图7(a)显示了该评价系统的初始界面,可以看到各学科的列表。在图7(b)中显示了学科/分类映射表,用户可以根据实际情况选择某一学科对应的分类表,选取后显示结果如图7(c)所示。
应用上述方法,对数据集进行统计分析,获得了各学科的论文发表分布与重要期刊列表,以下以人文学科为例,就本发明的具体实施过程进行说明。需要说明的是,本发明的方 法适用于任何学科。各种学科期刊的语种不限。
实施例一:
以人文学科入手进行数据处理和分析。QS人文学科共有九个类目:Philosophy(哲学)、Theology,Divinity&Religious Studies(神学与宗教研究)、Classics&Ancient History(古典文学与古代史)、English Language&Literature(英语与文学)、Modern Languages(现代语言)、Archaeology(考古学)、History(历史)、Performing Arts(表演艺术)、Art&Design(艺术与设计)。取常数C为10,即每个学科的排名前十,共有九十个高校,去重后为45所大学。
对45所大学在2014-2018年的五年内在A&HCI中所发的论文进行统计,共计59745篇论文,其中56150篇发表在A&HCI 2019收录的1834种人文期刊中的1696种上,占比约为92.5%。对上述九个学科的期刊进行统计和分布分析,数据整理如表1。
Figure PCTCN2021144039-appb-000013
(表1)人文学科期刊发文统计
*现代语言、英语与文学期刊很难区分,故联合排名。QS学科排名两个学科排名前十有八所大学相同,现代语言第九名为The University of Tokyo(语言文学共发文42篇)、第十名为Peking University(语言文学共发文51篇),考虑到保持十个学术机构数据统计口径的一致性,且上述发文数据较小,故未统计入上表数据中。
**艺术两个学科排名前十高校均只有七所高校有发文。
综合来看,前25%期刊的平均发文占到一流大学学科发文量的75%左右,其分布符合统计学特征,也证明了本实施例的假设和评价的有效性。
实施例二:
QS社科学科一共17个,分别为:经济学和计量经济学Economics&Econometrics、统 计学与运筹学Statistics&Operational Research、法学Law、政治与国际关系学Politics&International Studies、社会学Sociology、人类学Anthropology、教育和培训Education&Training、心理学Psychology、体育相关科目Sports-related Subjects、语言学Linguistics、传播与媒体研究Communication&Media Studies、工商管理Business&Management Studies、会计与金融Accounting and Finance、旅游管理Hospitality&Leisure Management、社会政策和行政学Social Policy&Administration、发展学Development Studies、图书馆与信息管理Library&Information Management。对其中14个SSCI有对应分类的期刊进行了评价,14个学科排名前10共有140个学术机构,去重后有发文的学术机构为66所,共发表551416篇SSCI论文,其中451248篇发表在2019公布的JCR2018的4781种SSCI期刊的4698种上,发文覆盖率达98.26%。对14个学科期刊发文统计结果如下表2。
Figure PCTCN2021144039-appb-000014
(表2)社科期刊发文统计
从统计数据看,TOP10高校在前25%期刊的发文占比没有人文学科集中度高,但是其集中趋势仍然是明显的。
实施例三:
在上述发文期刊分布研究的基础之上,以一个具体学科做数据分析。
经济学(Economic),教育部学科代码为02经济学。QS2019经济学和计量经济学Economics&Econometrics排名前十学术机构为:Harvard University、Massachusetts Institute of  Technology(MIT)、Stanford University、University of California,Berkeley(UCB)、University of Chicago、The London School of Economics and Political Science、Princeton University、Yale University、University of Oxford。这些学术机构在总计363种期刊中共发文9652篇。选取前25%,即91种期刊,排名前十的大学发文7005篇,占总数的72.58%。(见表2)
浙江大学经济学院发布的《浙江大学经济院国际术期刊分类目录(2020年版)》,目录中的期刊分为顶级(5种)、A+(14种)、A(11种)、B(54种含中刊)。该目录可以看作是学科专家对期刊的评价结果,其中设定为顶级、A+、A的前30种期刊有27种期刊在SSCI经济学目录中。一项针对诺贝尔经济学奖的发文期刊统计的研究(刘永涛《诺贝尔经济学奖获得者文献计量特征研究》(硕士学位论文,浙江大学2011))显示,2001-2010年诺贝尔经济学奖得主主要发文的经济学期刊有8种,其中6种在浙江大学经济学院的顶级和A+期刊中,这个结果可证明浙江大学经济学院发布的《浙江大学经济院国际术期刊分类目录(2020年版)》是较为客观的由学科专家得出的核心期刊列表。
以上述浙江大学经济学院的学科专家评价的结果作为基准,分别用影响因子评价方法得出的核心期刊结果和本实施例所述核心期刊量化系统得出的结果进行比较,用三种评价方式(学科专家期刊定级、核心期刊量化系统、影响因子法)对期刊进行排序,列表如下表3。
Figure PCTCN2021144039-appb-000015
Figure PCTCN2021144039-appb-000016
(表3)经济学期刊遴选评价对照表
从学科专家认定的顶级5种期刊来看,本实施例所述一流学科法得出的排名为1、2、3、5、12,而影响因子得出的排名为1、5、14、20、25,可见核心期刊量化系统的排名与学科专家的同行评议结果更为接近,将上述三种评价方式的对照结果进行总结比较,其结果见表4。
学科专家期刊定级范围 核心期刊量化系统命中数 影响因子法命中数
顶级期刊:5种 4 2
顶级与A+类期刊:19种 11 6
顶级、A+、A类期刊:30种 18 10
(表4)评价方法比较
从表4结果看,如果以学科专家对经济学期刊的定级作为基准,影响因子评价存在较 大偏差,本实施例的数据统计与评价结果证明,核心期刊量化系统在社科领域比当前的引文评价方法具有明显的优势和可行性。
以上所述仅为本发明的优选实施例,并非因此限制本发明的保护范围,凡是在本发明的构思下,利用本发明说明书及附图内容所作的等效结构变换,或直接/间接地运用在其他相关的技术领域,均应包括在本发明的专利保护范围之内。

Claims (10)

  1. 一种基于计算机系统的核心期刊量化评价系统,其特征在于,包括基础数据库、学科分类子系统、标准子系统、以及评价子系统,其中:
    所述的基础数据库,用于构建所有的学科信息数据库,所述的基础数据库包括论文、期刊在内的学术信息数据;
    所述的学科分类子系统,用于将基础数据库中的期刊根据不同的学科进行分类,达到学科对齐的目标;
    所述的标准子系统,作为标准体用于评价学术质量;根据学科排名与评估成果,将一定时期内的该评价指标优秀学术机构的论文集合纳入标准子系统;
    所述的评价子系统,用于计算该学科所属各期刊的学术质量;通过输入学科信息,计算该学科对应的各期刊在标准子系统中的论文命中率,得出该期刊的质量评价指标。
  2. 根据权利要求1所述的核心期刊量化评价系统,其特征在于,所述的基础数据库包括论文全集、期刊全集、分类列表、学科列表、学术机构全集。
  3. 根据权利要求1所述的核心期刊量化评价系统,其特征在于,所述期刊的质量评价指标由标准子系统论文的发文绝对数量和对应期刊在特定时期内的发文比例按加权运算获得。
  4. 根据权利要求3所述的核心期刊量化评价系统,其特征在于,所述加权运算方法如下:
    (1)设定期刊发文总数(K):即该期刊在命中数值相对应的时间段内的发文总数;
    (2)标准子系统的发文总数(J):即该期刊在相应时间段内标准子系统命中的绝对数量;
    (3)折算的TOP高校发文量(r):
    Figure PCTCN2021144039-appb-100001
    是指K的平均值;
    (4)以上两个指标先标准化后归一化,再加权相加,经过多次不同权重运算,最终权重定为w 1和w 2,即:综合量化评价值=w 1*J+w 2*r。
  5. 根据权利要求1所述的核心期刊量化评价系统,其特征在于,所述学科分类子系统是以预设学科分类标准为依据,若输入的学科信息与所述预设学科分类标准中的学科相同,则保持不变;若输入的学科信息与所述预设学科分类标准中的学科不同,用主观和/或客观两种方法对进行学科映射,达到学科对齐的目标。
  6. 根据权利要求5所述的核心期刊量化评价系统,其特征在于,所述预设学科分类标准为教育部学科分类标准。
  7. 根据权利要求1所述的核心期刊量化评价系统,其特征在于,所述标准子系统的优秀 学术机构为预设学科分类标准中选择排名居前的一定数量的学术机构。
  8. 根据权利要求1所述的核心期刊量化评价系统,其特征在于,所述标准子系统的构建方式为:
    (1)输入学科对应的该项评价指标排名靠前的学术机构集合;
    (2)从学科对应的基础数据库中任意选取一篇论文,判断其作者机构是否在所述评价指标排名靠前的学术机构集合中,若是,则将该论文加入标准子系统;若否,则将该论文从论文全集中移除;
    (3)遍历基础数据库中学科对应的论文全集之后,输出该学科对应的标准子系统。
  9. 根据权利要求1所述的核心期刊量化评价系统,其特征在于,所述评价子系统中的论文命中率计算方式为:
    (1)输入学科对应的标准子系统;
    (2)基础数据库中预设学科对应的学科期刊集合中所有期刊的命中率为0;
    (3)从学科对应的学科期刊集合中任意选取一本期刊,并从标准子系统中任意选取一篇论文,判断该论文是否发表在所选期刊中,若是,则将该期刊的命中率加1,并将该论文从标准子系统定义常数中移除;若否,则直接将该论文从标准子系统中移除;
    (4)遍历学科对应的标准子系统之后,将对应期刊从基础数据库中移除;
    (5)遍历学科对应的基础数据库之后,输出该学科对应的标准子系统的论文命中率。
  10. 一种基于计算机系统的核心期刊量化评价方法,其特征在于,包括以下步骤:
    (1)构建基础数据库,包括论文、期刊在内的学术信息数据;
    (2)将基础数据库中的期刊根据不同的学科进行分类,达到学科对齐的目标;
    (3)根据学科排名与评估成果,将一定时期内该评价指标优秀的学术机构的论文集合纳入标准子系统,作为标准体用于评价学术质量;
    (4)通过输入学科信息,计算该学科对应的各期刊在标准子系统中的论文命中率,得出该期刊的质量评价指标。
PCT/CN2021/144039 2020-06-17 2021-12-31 基于计算机系统的核心期刊量化评价系统和方法 Ceased WO2022247288A1 (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN202010555924 2020-06-17
CN202110563766.0 2021-05-24
CN202110563766.0A CN112989070B (zh) 2020-06-17 2021-05-24 基于计算机系统的核心期刊量化评价系统和方法

Publications (1)

Publication Number Publication Date
WO2022247288A1 true WO2022247288A1 (zh) 2022-12-01

Family

ID=76337131

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/144039 Ceased WO2022247288A1 (zh) 2020-06-17 2021-12-31 基于计算机系统的核心期刊量化评价系统和方法

Country Status (2)

Country Link
CN (1) CN112989070B (zh)
WO (1) WO2022247288A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112989070B (zh) * 2020-06-17 2022-07-19 浙江大学 基于计算机系统的核心期刊量化评价系统和方法
CN113837240A (zh) * 2021-09-03 2021-12-24 南京昆虫软件有限公司 一种针对教育部的分类系统和分类方法
CN115841269B (zh) * 2022-11-23 2025-09-09 国网山东省电力公司电力科学研究院 一种基于多维指标分析的期刊动态评价方法
CN117421428B (zh) * 2023-10-31 2024-05-17 中国人民解放军海军大连舰艇学院 基于完整期刊库的论文发表诚信评估分析方法及系统
CN117972119B (zh) * 2024-04-01 2024-11-29 北京仁和汇智信息技术有限公司 一种期刊计量的方法、装置、电子设备及存储介质
CN120086388B (zh) * 2025-02-24 2025-11-11 南京昆虫软件有限公司 针对教育部学科分类的学术期刊多功能处理方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150193520A1 (en) * 2014-01-09 2015-07-09 National Research Foundation Of Korea System and method for evaluating journal
CN109359824A (zh) * 2018-09-25 2019-02-19 浙江理工大学 一种学科的学术水平的评价方法
CN109685330A (zh) * 2018-12-05 2019-04-26 浙江理工大学 一种期刊学术影响力的评估和预测方法
CN110705821A (zh) * 2019-08-23 2020-01-17 上海科技发展有限公司 基于多评价维度的热点学科预测方法、装置、终端、及介质
CN112989070A (zh) * 2020-06-17 2021-06-18 浙江大学 基于计算机系统的核心期刊量化评价系统和方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105978743A (zh) * 2016-07-25 2016-09-28 广东科学技术职业学院 一种基于高阶聚集系数的期刊评价方法
CN106875088A (zh) * 2017-01-03 2017-06-20 中国科学院科技政策与管理科学研究所 基于期刊编委指数的科研机构学术影响力评价方法与系统
CN107832412B (zh) * 2017-11-06 2020-06-30 浙江工业大学 一种基于文献引用关系的刊物聚类方法
CN109858827A (zh) * 2019-02-21 2019-06-07 上海软科教育信息咨询有限公司 学科水平的可视化比较方法、系统、电子终端及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150193520A1 (en) * 2014-01-09 2015-07-09 National Research Foundation Of Korea System and method for evaluating journal
CN109359824A (zh) * 2018-09-25 2019-02-19 浙江理工大学 一种学科的学术水平的评价方法
CN109685330A (zh) * 2018-12-05 2019-04-26 浙江理工大学 一种期刊学术影响力的评估和预测方法
CN110705821A (zh) * 2019-08-23 2020-01-17 上海科技发展有限公司 基于多评价维度的热点学科预测方法、装置、终端、及介质
CN112989070A (zh) * 2020-06-17 2021-06-18 浙江大学 基于计算机系统的核心期刊量化评价系统和方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LI MING, KE QING, SHI JIN, ZHU TINGTING: "An Empirical Study of Academic Journal Author Institution Index AAI Ranking-Chinese Higher Education Journals as Example", XINAN MINZU DAXUE XUEBAO, ZIRAN KEXUEBAN, no. 9, 31 December 2019 (2019-12-31), pages 236 - 240, XP093008755, ISSN: 1004-3926 *
SHAO SONG, ET AL.: "Influence of Journal Subject Classification on Journal Evaluation", SCIENCE-TECHNOLOGY & PUBLICATION, no. 3, 31 December 2017 (2017-12-31), pages 119 - 125, XP093008758, DOI: 10.16510/j.cnki.kjycb.2017.03.028 *

Also Published As

Publication number Publication date
CN112989070B (zh) 2022-07-19
CN112989070A (zh) 2021-06-18

Similar Documents

Publication Publication Date Title
CN112989070B (zh) 基于计算机系统的核心期刊量化评价系统和方法
CN111125453B (zh) 基于子图同构的社交网络中意见领袖角色识别方法及存储介质
CN112561598A (zh) 基于客户画像的客户流失预测及挽回方法和系统
Patra et al. Efficiency of Indian Banks–private versus public sector banks: A two-stage analysis
US20160350294A1 (en) Method and system for peer detection
Rahman et al. Financial development and shadow economy: a bibliometric analysis using the Scopus database (1985–2021)
Chang et al. Establishing decision tree-based short-term default credit risk assessment models
US9400826B2 (en) Method and system for aggregate content modeling
CN107239892A (zh) 基于大数据的区域人才供需平衡量化分析方法
CN106250438A (zh) 基于随机游走模型的零引用文章推荐方法及系统
Ramos et al. Primary education evaluation in Brazil using big data and cluster analysis
CN115841269B (zh) 一种基于多维指标分析的期刊动态评价方法
Memić et al. Performance analysis and benchmarking of commercial banks operating in Bosnia and Herzegovina: A DEA approach
CN116644184B (zh) 基于数据聚类的人力资源信息管理系统
Grinäv The disadvantages of using scientometric indicators in the digital age
CN115994271A (zh) 心理测评量表的推荐方法
Xie et al. Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information
Rahal et al. The rating dilemma of academic management journals: Attuning the perceptions of peer rating
CN109992592B (zh) 基于校园消费卡流水数据的高校贫困生识别方法
Bacci et al. Insights from the co-authorship network of the Italian academic statisticians
Rijal Mapping the landscape of sharia economics: A bibliometric analysis
CN116450757A (zh) 数据资产的评价指标的确定方法及装置、设备及存储介质
Mitsuzuka et al. Analysis of CSR activities affecting corporate value using machine learning
CN113313470B (zh) 一种基于大数据的就业类型评估方法及系统
Zhang et al. Research on borrower's credit classification of P2P network loan based on LightGBM algorithm

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21942851

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21942851

Country of ref document: EP

Kind code of ref document: A1