CN106228294A - A kind of search engine evaluation system and management - Google Patents

A kind of search engine evaluation system and management Download PDF

Info

Publication number
CN106228294A
CN106228294A CN201610566293.9A CN201610566293A CN106228294A CN 106228294 A CN106228294 A CN 106228294A CN 201610566293 A CN201610566293 A CN 201610566293A CN 106228294 A CN106228294 A CN 106228294A
Authority
CN
China
Prior art keywords
task
module
test
mark
monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610566293.9A
Other languages
Chinese (zh)
Inventor
方明
叶剑鸣
刘贵全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Bi Song Data Technology Co Ltd
Original Assignee
Hefei Bi Song Data Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Bi Song Data Technology Co Ltd filed Critical Hefei Bi Song Data Technology Co Ltd
Priority to CN201610566293.9A priority Critical patent/CN106228294A/en
Publication of CN106228294A publication Critical patent/CN106228294A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • Development Economics (AREA)
  • Educational Administration (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Quality & Reliability (AREA)
  • General Business, Economics & Management (AREA)
  • Operations Research (AREA)
  • Marketing (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a kind of search engine evaluation system and management, derive, including by test and management module, handling module, parsing module, Mola data base, task cutting module, MySql data base, evaluation module, task distribution module, task pool, answer monitoring module and result, the search engine evaluation system that module forms, also include search engine evaluation system administration.The present invention, improve network trading evaluation, examination process and result and the verity of study condition inspection, the generation of the phenomenon that prevents cheating, screen quantity and the difficulty of control task in time, control transaction estimator, take an examination and learn the progress of personnel, the estimator that prevents from concluding the business is repeated several times evaluations, take an examination and study personnel get exercise question more, and malice is robbed and inscribed phenomenon and happen occasionally, it is ensured that the quality evaluated, take an examination and learn.

Description

A kind of search engine evaluation system and management
Technical field
The present invention relates to search engine evaluation technical field, particularly relate to a kind of search engine evaluation system and management.
Background technology
Along with the development of internet, transaction that people are engaged on network, take an examination and learn to get more and more, to friendship Easy result or learning state evaluation examination & verification differ, and due to Network Management Dept. specification, task issues personnel or answer personnel, to net The screening and assessment of network answer manages the most accordingly, easily occurs that cheating lamp situation occurs, in order to Logistics networks transaction evaluation, The verity taken an examination and learn and efficiency, propose a kind of search engine evaluation system and management.
Summary of the invention
The invention aims to solve shortcoming present in prior art, and a kind of search engine evaluation system proposed System and management.
To achieve these goals, present invention employs following technical scheme:
A kind of search engine evaluation system, it is characterised in that: include by test and management module, handling module, parsing module, Mola Data base, task cutting module, MySql data base, evaluation module, task distribution module, task pool, answer monitoring module and knot Phenolphthalein go out module composition search engine evaluation system, described test and management module respectively with handling module, MySql data base and Task cutting module connect, described handling module is connected with MySql data base and parsing module respectively, described parsing module and Mola data base connects, and described MySql data base monitors with task cutting module, task distribution module, task pool, answer respectively Module, evaluation module and result derive module and connect, and described task pool connects with task distribution module and answer monitoring module respectively Connect;Described test and management module issues the establishment test of personnel for receiving task, and creates the content of the title of test, test Exercise question in (usually query, url, text etc.), the number to the requirement that can do test person, taken one's test, each test bag Quantity and the relevant information etc. that captures, described handling module is for capturing required web data, including going out of capturing Mouthful, the content of crawl, the configuration of crawl, whether resolving, described parsing module is beaten for embedding some in the webpage captured Subitem, described Mola data base is for storing the webpage captured, and whole test is cut into establishment by described task cutting module The parcel arranged during test, and input test exercise question, described evaluation module does, for monitoring mass-rent personnel, the effect inscribed, and prevents from making Fraud personnel, described task distribution module can select suitable mass-rent answer personnel according to the requirement creating test person, and will survey Examination question mesh sends to the task pool of answer people, and described task pool gets task after login for mass-rent answer personnel, described Answer monitoring module does, for real-time preservation, the result inscribed, and described result derives module and is used for deriving the result of test, described Information, test exercise question and the result of test that MySql data base sends for storing test and management module.
A kind of search engine evaluation system administration, it is characterised in that: include that S1 creates test and test and management, S2 capture net Page and crawl statistics, S3 task cutting and task distribution, S4 assessment and accuracy rate calculating, the preservation of S5 annotation results, S6 mass-rent people Member's grade controls and S7 fallibility topic feedback, the steps include:
S1, task publisher insert the information having to fill out in front end page, as above described in surface function demand, then click on guarantor Deposit, after background program validation task publisher's authority, checking fill substance are the most legal, necessary information write data will be tested In storehouse.The task publisher of returning to can check the test information configuration page, if task publisher confirms errorless can click on Back into the test and management page, if task publisher needs to revise test information, then click on amendment button and enter amendment page Face modify test relevant information, if test the most issued, then some information cannot be revised, can only revise and issue appoint Information unrelated after business.Click on after having revised and preserve, preserve the configuration information of test.
S2, one test creates successfully after, the task of first having to carry out be exactly crawl test in all pages, one All url in individual test choose out from query table, through splicing, url and query_id is packaged into json string and sends Giving and capture service providing end, after waiting that the service of crawl captures, can adjust back assessment system, notice which exercise question of assessment system is Through capturing, which does not capture, and assessment system can send mail to test publisher, tests publisher's login system, as Fruit thinks that the effect captured can accept, and enters task launch phase, if it is considered to it is unacceptable to capture result, can click on Heavily grabbing, failed url with the query_id Reseal of all of crawl can be become json string to be sent to capture service by assessment system End is provided.Crawl service end is allowed to capture;The monitoring of webpage capture, is the measurement to grasping system service performance, is assessment The guarantee of system, webpage capture monitoring module postbacks weekly and send a weekly, captures the sum of webpage, success in adding up one week The information such as rate, average crawl time.
S3, captured after, system can calling task cutting module, task cutting module can select all crawls successful These exercise questions are broken up and are monitored exercise question and mix by exercise question, and then from data base, task is cut by read test publisher The configuration divided, is cut into fritter by all of task.Mass-rent evaluator only gets the task of a parcel in task pool every time, Continuing to claim the task of other parcels after completing, same mass-rent evaluator can only claim same parcel task once.Treat institute After having parcel task all to regain, system counts final result by the script that task publisher provides.
S4, during task cutting, if selected for insert monitoring mode, can after being cut into little task bag with The machine transplanting of rice enters some monitoring exercise questions, and monitoring exercise question accounts for the 10% of parcel number of tasks from monitoring exam pool, the quantity of monitoring exercise question.Crowd After bag mark person marks the submission of parcel exercise question, system can be run accuracy rate and check program, calculates mass-rent mark person in parcel Monitoring exercise question and the difference of monitoring exercise question mark answer, calculate what this was marked by mass-rent mark person by calculating concordance rate Mark quality, the accuracy rate of mark can record in the table that mark people associates with parcel;Automatically monitoring refers to need not artificial inserting Enter to monitor answer, by assessing whole mass-rent mark persons, the mark of parcel exercise question is assessed what parcel was marked by each mark people Quality.Submit to mark answer all can run assessment script in mark number more than mass-rent mark person when of general, assessment every time The purpose of script is that the mark quality of people and the exercise question of parcel assessing all participations this time parcel mark finally adds up answer The degree of reliability.Answer to the ropy people of mark, takes the strategy deleted, the exercise question that the degree of reliability is low can be beamed back task Pond marks again, and assessment script also can produce the accuracy of each mark person after running, this accuracy also can be recorded In the table that mark people associates with parcel.
S5, when receiving the preservation request of front end, carry out basic authority and judge, if be authorized user, authorized user I.e. who has permission and can mark marking mass-rent appraiser, answer provides personnel, if it is not, return and point out illegal Authorized user, if it is, continue to preserve.If marking result is modified by user, first have to remove before user Marking record, if providing the data of the mark people of model answer, also to delete the marking result before this assessment exercise question, Make mark answer standardization.
S6, outsourcing service provider being divided into senior middle school's just 3 grades, monitoring personnel can set multiple or less grade, system According to the accuracy rate allocation level in an outsourcing reviewer upper cycle, promotion and demotion limit: without lifting across level, i.e. when a certain grade Under the task Average Accuracy that completes be much higher than or less than when closing on grade head, only do the upgrade or downgrade closing on title, accurate Really rate calculates: calculates a cycle accuracy rate after often completing certain task amount, is used for adjusting evaluator's title.
After S7, outsourcing logging in system by user, if having ever done monitor task (with whole correct options) last week, then The exercise question of mistake of giving a mark in seeing with checking monitoring task Monday weekly to Wednesday, then can not check after Wednesday, Thursday is extremely On Sunday, the most do not add up the most wrong topic last week, even if wrong topic, do not shown.
Preferably, described task distribution module has carried out further optimization, exceedes more than half by mark concordance rate Exercise question is regained, and be not published to task pool.
Beneficial effects of the present invention: by search engine evaluation system and the management of design, improve network trading and comment Valency, examination process and result and the verity of study condition inspection, the generation of the phenomenon that prevents cheating, screen control task in time Quantity and difficulty, control transaction estimator, take an examination and learn the progress of personnel, the estimator that prevents from concluding the business be repeated several times evaluation, Examination and study personnel get exercise question more, and malice is robbed topic phenomenon and happened occasionally, it is ensured that the quality evaluated, take an examination and learn.
Accompanying drawing explanation
Fig. 1 is a kind of search engine evaluation system of proposing of the present invention and the structural representation of management.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Describe, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole embodiments wholely.
With reference to Fig. 1, a kind of search engine evaluation system, it is characterised in that: include by test and management module, handling module, Parsing module, Mola data base, task cutting module, MySql data base, evaluation module, task distribution module, task pool, answer Topic monitoring module and result derive module composition search engine evaluation system, described test and management module respectively with capture mould Block, MySql data base and task cutting module connect, and described handling module is connected with MySql data base and parsing module respectively, Described parsing module is connected with Mola data base, described MySql data base respectively with task cutting module, task distribution module, Task pool, answer monitoring module, evaluation module and result derive module and connect, described task pool respectively with task distribution module and Answer monitoring module connects;Described test and management module issues the establishment test of personnel for receiving task, and creates test Title, the content (usually query, url, text etc.) of test, the number to the requirement that can do test person, taken one's test, Each quantity testing exercise question in bag and the relevant information etc. captured, described handling module is for capturing required webpage Whether data, including the outlet captured, the content of crawl, the configuration of crawl, resolve, and described parsing module is for capturing Embedding some marking items in webpage, described Mola data base is for storing the webpage captured, and described task cutting module is by whole Individual test is cut into the parcel arranged when creating test, and input test exercise question, and described evaluation module is used for monitoring mass-rent personnel Doing the effect inscribed, prevent cheating personnel, and described task distribution module can select suitable mass-rent according to the requirement creating test person Answer personnel, and test exercise question is sent to the task pool of answer people, described task distribution module has been carried out further Optimizing, mark concordance rate is exceeded exercise question more than half and regains, be not published to task pool, described task pool is answered for mass-rent Topic personnel get task after login, and described answer monitoring module does, for real-time preservation, the result inscribed, and described result derives Module is for deriving the result of test, and described MySql data base is for storing the information of test and management module transmission, test exercise question Result with test.
A kind of search engine evaluation system administration, it is characterised in that: include that S1 creates test and test and management, S2 capture net Page and crawl statistics, S3 task cutting and task distribution, S4 assessment and accuracy rate calculating, the preservation of S5 annotation results, S6 mass-rent people Member's grade controls and S7 fallibility topic feedback, the steps include:
S1, task publisher insert the information having to fill out in front end page, as above described in surface function demand, then click on guarantor Deposit, after background program validation task publisher's authority, checking fill substance are the most legal, necessary information write data will be tested In storehouse.The task publisher of returning to can check the test information configuration page, if task publisher confirms errorless can click on Back into the test and management page, if task publisher needs to revise test information, then click on amendment button and enter amendment page Face modify test relevant information, if test the most issued, then some information cannot be revised, can only revise and issue appoint Information unrelated after business.Click on after having revised and preserve, preserve the configuration information of test.
S2, one test creates successfully after, the task of first having to carry out be exactly crawl test in all pages, one All url in individual test choose out from query table, through splicing, url and query_id is packaged into json string and sends Giving and capture service providing end, after waiting that the service of crawl captures, can adjust back assessment system, notice which exercise question of assessment system is Through capturing, which does not capture, and assessment system can send mail to test publisher, tests publisher's login system, as Fruit thinks that the effect captured can accept, and enters task launch phase, if it is considered to it is unacceptable to capture result, can click on Heavily grabbing, failed url with the query_id Reseal of all of crawl can be become json string to be sent to capture service by assessment system End is provided.Crawl service end is allowed to capture;The monitoring of webpage capture, is the measurement to grasping system service performance, is assessment The guarantee of system, webpage capture monitoring module postbacks weekly and send a weekly, captures the sum of webpage, success in adding up one week The information such as rate, average crawl time.
S3, captured after, system can calling task cutting module, task cutting module can select all crawls successful These exercise questions are broken up and are monitored exercise question and mix by exercise question, and then from data base, task is cut by read test publisher The configuration divided, is cut into fritter by all of task.Mass-rent evaluator only gets the task of a parcel in task pool every time, Continuing to claim the task of other parcels after completing, same mass-rent evaluator can only claim same parcel task once.Treat institute After having parcel task all to regain, system counts final result by the script that task publisher provides.
S4, during task cutting, if selected for inserting the mode of monitoring, can after being cut into little task bag Some monitoring exercise questions of radom insertion, monitoring exercise question accounts for the 10% of parcel number of tasks from monitoring exam pool, the quantity of monitoring exercise question.? After mass-rent mark person marks the submission of parcel exercise question, system can be run accuracy rate and check program, calculates mass-rent mark person in parcel Monitoring exercise question and monitoring exercise question mark answer difference, by calculate concordance rate calculate mass-rent mark person to this mark Mark quality, the accuracy rate of mark can record in the mark table that associates with parcel of people;Automatically monitoring refers to need not manually Insert monitoring answer, the mark of parcel exercise question is assessed each mark people to parcel mark by assessing whole mass-rent mark persons Quality.Submit to mark answer all can run assessment script in mark number more than mass-rent mark person when of general every time, comment The purpose estimating script is that the mark quality of people and the exercise question of parcel assessing all participations this time parcel mark is finally added up and answered The degree of reliability of case.Answer to the ropy people of mark, takes the strategy deleted, can beam back the exercise question that the degree of reliability is low and appoint Business pond marks again, and assessment script also can produce the accuracy of each mark person after running, this accuracy also can be remembered Record in the table that mark people associates with parcel.
S5, when receiving the preservation request of front end, carry out basic authority and judge, if be authorized user, authorized user I.e. who has permission and can mark marking mass-rent appraiser, answer provides personnel, if it is not, return and point out illegal Authorized user, if it is, continue to preserve.If marking result is modified by user, first have to remove before user Marking record, if providing the data of the mark people of model answer, also to delete the marking result before this assessment exercise question, Make mark answer standardization.
S6, outsourcing service provider being divided into senior middle school's just 3 grades, monitoring personnel can set multiple or less grade, system According to the accuracy rate allocation level in an outsourcing reviewer upper cycle, promotion and demotion limit: without lifting across level, i.e. when a certain grade Under the task Average Accuracy that completes be much higher than or less than when closing on grade head, only do the upgrade or downgrade closing on title, accurate Really rate calculates: calculates a cycle accuracy rate after often completing certain task amount, is used for adjusting evaluator's title.
After S7, outsourcing logging in system by user, if having ever done monitor task (with whole correct options) last week, then exist Seeing Monday weekly to Wednesday with the exercise question of mistake of giving a mark in checking monitoring task, then can not check after Wednesday, Thursday is to week Day, the most do not add up the most wrong topic last week, even if wrong topic, do not shown.
In the present invention, by search engine evaluation system and the management of design, improve network trading evaluation, took an examination Journey and result and the verity of study condition inspection, the generation of the phenomenon that prevents cheating, in time screening control task quantity and Difficulty, controls transaction estimator, takes an examination and learn the progress of personnel, and the estimator that prevents from concluding the business is repeated several times evaluation, takes an examination and learn Habit personnel get exercise question more, and malice is robbed topic phenomenon and happened occasionally, it is ensured that the quality evaluated, take an examination and learn.
The above, the only present invention preferably detailed description of the invention, but protection scope of the present invention is not limited thereto, Any those familiar with the art in the technical scope that the invention discloses, according to technical scheme and Inventive concept equivalent or change in addition, all should contain within protection scope of the present invention.

Claims (3)

1. a search engine evaluation system, it is characterised in that: include by test and management module, handling module, parsing module, Mola data base, task cutting module, MySql data base, evaluation module, task distribution module, task pool, answer monitoring module With result derive module composition search engine evaluation system, described test and management module respectively with handling module, MySql data Storehouse and task cutting module connect, and described handling module is connected with MySql data base and parsing module respectively, described parsing module Being connected with Mola data base, described MySql data base supervises with task cutting module, task distribution module, task pool, answer respectively Control module, evaluation module and result derive module and connect, described task pool respectively with task distribution module and answer monitoring module Connect;Described test and management module for receive task issue personnel establishment test, and create the title of test, test interior Hold in (usually query, url, text etc.), the number to the requirement that can do test person, taken one's test, each test bag and inscribe Purpose quantity and the relevant information etc. captured, described handling module is for capturing required web data, including capture Whether outlet, the content of crawl, the configuration of crawl, resolve, and described parsing module is for embedding in the webpage captured Marking item, described Mola data base is for storing the webpage captured, and whole test is cut into wound by described task cutting module The parcel arranged when building test, and input test exercise question, described evaluation module does, for monitoring mass-rent personnel, the effect inscribed, prevents Cheating personnel, described task distribution module can select suitable mass-rent answer personnel according to the requirement creating test person, and will Test exercise question sends to the task pool of answer people, and described task pool gets task, institute after login for mass-rent answer personnel Stating answer monitoring module and do the result inscribed for real-time preservation, described result derives module for deriving the result of test, institute State information, test exercise question and the result of test that MySql data base sends for storing test and management module.
2. a search engine evaluation system administration, it is characterised in that: include that S1 creates test and test and management, S2 capture webpage Statistics, S3 task cutting and task are distributed, S4 assesses and accuracy rate calculates, S5 annotation results preserves, S6 mass-rent personnel with capturing Grade controls and S7 fallibility topic feedback, the steps include:
S1, task publisher insert the information having to fill out in front end page, as above described in surface function demand, then click on guarantor Deposit, after background program validation task publisher's authority, checking fill substance are the most legal, necessary information write data will be tested In storehouse;The task publisher of returning to can check the test information configuration page, if task publisher confirms errorless can click on Back into the test and management page, if task publisher needs to revise test information, then click on amendment button and enter amendment page Face modify test relevant information, if test the most issued, then some information cannot be revised, can only revise and issue appoint Information unrelated after business;Click on after having revised and preserve, preserve the configuration information of test;S2, one test create successfully after, The task of first having to carry out is exactly to capture all pages in test, and all url in a test are chosen from query table Out, through splicing, url and query_id is packaged into json string and is sent to capture service providing end, wait that crawl service is grabbed After taking, can adjust back assessment system, notice has captured which exercise question of assessment system, and which does not capture, assessment system System can send mail to test publisher, tests publisher's login system, if it is considered to the effect captured can accept, enters Task launch phase, if it is considered to it is unacceptable to capture result, can click on and heavily grab, and assessment system can capture all of unsuccessfully Url with query_id Reseal become json string be sent to capture service providing end;Crawl service end is allowed to capture;Webpage The monitoring captured, is the measurement to grasping system service performance, is the guarantee of assessment system, and webpage capture monitoring module often surrounds Send a weekly, in adding up one week, capture the information such as the sum of webpage, success rate, average crawl time;S3, capture After, system meeting calling task cutting module, task cutting module can select the successful exercise question of all crawls, be broken up by these exercise questions Mixing with monitoring exercise question, the then read test publisher configuration to task cutting from data base, by all of Business is cut into fritter;Mass-rent evaluator only gets the task of a parcel in task pool every time, continues to claim other after completing The task of parcel, same mass-rent evaluator can only claim same parcel task once;After all parcel tasks are all regained, System counts final result by the script that task publisher provides;S4, during task cutting, if select Insert the mode of monitoring, can after be cut into little task bag some monitoring exercise questions of radom insertion, monitoring exercise question is inscribed from monitoring Storehouse, the quantity of monitoring exercise question accounts for the 10% of parcel number of tasks;After mass-rent mark person marks the submission of parcel exercise question, system can be run Accuracy rate checks program, calculates the mass-rent mark person difference to the monitoring exercise question in parcel with monitoring exercise question mark answer, passes through Calculate concordance rate calculate the mark quality that this is marked by mass-rent mark person, the accuracy rate of mark can record mark people and In the table of parcel association;Automatically monitoring refers to need not manually insert monitoring answer, by assessing whole mass-rent mark persons to little The mark of bag exercise question assesses the quality that parcel is marked by each mark people;In the number of mark more than mass-rent mark when of general Person submits to mark answer can run assessment script every time, and the purpose of assessment script is to assess all participations this time parcel mark The mark quality of people and the exercise question of parcel finally add up the degree of reliability of answer;Answer to the ropy people of mark, takes The strategy deleted, can beam back task pool to the exercise question that the degree of reliability is low and again mark, and assessment script also can produce after running The accuracy of each mark person, this accuracy also can be recorded in the table that mark people associates with parcel;S5, receive before During the preservation request of end, carrying out basic authority and judge, if be authorized user, authorized user i.e. has permission whom to mark and beats Focus bag appraiser, answer provide personnel, if it is not, return and point out illegal authorized user, if it is, continue Preserve;If marking result is modified by user, first have to remove user's marking record in the past, if providing mark The data of the mark people of quasi-answer, also to delete the marking result before this assessment exercise question, make mark answer standardization;S6、 Outsourcing service provider is divided into senior middle school's just 3 grades, and monitoring personnel can set multiple or less grade, and system is evaluated and tested according to outsourcing The accuracy rate allocation level in personnel's upper cycle, promotion and demotion limit: without lifting across level, i.e. when completing under a certain grade of task Average Accuracy is much higher than or less than when closing on grade head, only does the upgrade or downgrade closing on title, and accuracy rate calculates: the completeest Calculate a cycle accuracy rate after becoming certain task amount, be used for adjusting evaluator's title;After S7, outsourcing logging in system by user, If having ever done monitor task (with whole correct options) last week, then see in Monday weekly to Wednesday and appoint with checking monitoring The exercise question of mistake of giving a mark in business, then can not check after Wednesday, Thursday, to Sunday, does not the most add up the most wrong topic last week, even if Wrong topic, is not shown.
A kind of search engine evaluation system the most according to claim 1 and 2 and management, it is characterised in that described task Distribution module has carried out further optimization, mark concordance rate is exceeded exercise question more than half and regains, be not published to task Pond.
CN201610566293.9A 2016-07-18 2016-07-18 A kind of search engine evaluation system and management Pending CN106228294A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610566293.9A CN106228294A (en) 2016-07-18 2016-07-18 A kind of search engine evaluation system and management

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610566293.9A CN106228294A (en) 2016-07-18 2016-07-18 A kind of search engine evaluation system and management

Publications (1)

Publication Number Publication Date
CN106228294A true CN106228294A (en) 2016-12-14

Family

ID=57530894

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610566293.9A Pending CN106228294A (en) 2016-07-18 2016-07-18 A kind of search engine evaluation system and management

Country Status (1)

Country Link
CN (1) CN106228294A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108154306A (en) * 2017-12-28 2018-06-12 百度在线网络技术(北京)有限公司 Task processing method, device, equipment and the computer readable storage medium of crowdsourcing model
CN108197202A (en) * 2017-12-28 2018-06-22 百度在线网络技术(北京)有限公司 Data verification method, device, server and the storage medium of crowdsourcing task
CN109753596A (en) * 2018-12-29 2019-05-14 中国科学院计算技术研究所 Information source management and configuration method and system for the acquisition of large scale network data
CN109784637A (en) * 2018-12-13 2019-05-21 华为终端有限公司 Method and apparatus applied to the analysis of processing platform data
CN109902903A (en) * 2017-12-11 2019-06-18 华东师范大学 A kind of crowdsourcing execution method and crowdsourcing system based on wechat
CN109978333A (en) * 2019-02-26 2019-07-05 湖南大学 Based on community discovery and the independent worker's selection method for linking prediction in crowdsourcing system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324620A (en) * 2012-03-20 2013-09-25 北京百度网讯科技有限公司 Method and device for rectifying marking results

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324620A (en) * 2012-03-20 2013-09-25 北京百度网讯科技有限公司 Method and device for rectifying marking results

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吕舜: "基于人工标注的搜索引擎评估方法与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109902903A (en) * 2017-12-11 2019-06-18 华东师范大学 A kind of crowdsourcing execution method and crowdsourcing system based on wechat
CN108154306A (en) * 2017-12-28 2018-06-12 百度在线网络技术(北京)有限公司 Task processing method, device, equipment and the computer readable storage medium of crowdsourcing model
CN108197202A (en) * 2017-12-28 2018-06-22 百度在线网络技术(北京)有限公司 Data verification method, device, server and the storage medium of crowdsourcing task
CN108197202B (en) * 2017-12-28 2021-12-24 百度在线网络技术(北京)有限公司 Data verification method and device for crowdsourcing task, server and storage medium
CN109784637A (en) * 2018-12-13 2019-05-21 华为终端有限公司 Method and apparatus applied to the analysis of processing platform data
CN109753596A (en) * 2018-12-29 2019-05-14 中国科学院计算技术研究所 Information source management and configuration method and system for the acquisition of large scale network data
CN109978333A (en) * 2019-02-26 2019-07-05 湖南大学 Based on community discovery and the independent worker's selection method for linking prediction in crowdsourcing system

Similar Documents

Publication Publication Date Title
CN106228294A (en) A kind of search engine evaluation system and management
Tucker et al. Safety in the c-suite: How chief executive officers influence organizational safety climate and employee injuries.
Kunc et al. Managerial decision making and firm performance under a resource‐based paradigm
Wang et al. Assimilation of agile practices in use
Hockings Evaluating Effectiveness: A framework for assessing management effectiveness of protected areas
Wolfe et al. A comparison of two approaches to training visual analysis of AB graphs
Shiu et al. The moderating effects of national age stereotyping on the relationships between job satisfaction and its determinants: A study of older workers across 26 countries
CN109508825A (en) Employee's image method for prewarning risk and relevant apparatus
Igaki et al. Quantitative assessment with using ticket driven development for teaching scrum framework
Donelan et al. Factors influencing quality decision‐making: regulatory and pharmaceutical industry perspectives
Bathke et al. Using serious games to facilitate collaborative water management planning under climate extremes
CN104281523B (en) A kind of demand Testability Analysis method and system
Srinivasan et al. Agile teams as complex adaptive systems (CAS)
Lu et al. Why process improvement training fails
CN107357737A (en) A kind of search engine evaluation system and management
Cavaglia et al. Devolving skills: The case of the apprenticeship grant for employers
Orooji et al. Peer assessment and self-assessment in social learning environments through a new crowd-sourced mechanism
Little Negotiated management strategies for bovine tuberculosis: enhancing risk mitigation in Michigan and the UK
Dunford et al. A view of Systems Practice: Enabling quality in design
Egas Requirements elicitation, which method in which situation?
Hajifathalian et al. “Oops” Simulation: Cost–Benefits Trade-Off Analysis of Reliable Planning for Construction Activities
Okwachi et al. Effect of managerial practices on the implementation of strategic plans by SMEs in Nairobi, Kenya
Hatsu et al. A framework for assessing the socio-economic impact of e-governance projects in developing countries
Wong et al. From monitoring to learning: A conceptual framework
Pienkowski Comprehensive Lean Manufacturing Maturity Model

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161214

RJ01 Rejection of invention patent application after publication