TW201027359A - System and method for evaluating simulation of examination result - Google Patents

System and method for evaluating simulation of examination result Download PDF

Info

Publication number
TW201027359A
TW201027359A TW98100433A TW98100433A TW201027359A TW 201027359 A TW201027359 A TW 201027359A TW 98100433 A TW98100433 A TW 98100433A TW 98100433 A TW98100433 A TW 98100433A TW 201027359 A TW201027359 A TW 201027359A
Authority
TW
Taiwan
Prior art keywords
test
virtual
question
questions
answer
Prior art date
Application number
TW98100433A
Other languages
Chinese (zh)
Other versions
TWI397824B (en
Inventor
Chih-Liang Hsu
Chia-Tzu Hsu
bing-yang Yu
Jian-Ting Lin
Original Assignee
Newttech Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Newttech Network Technology Co Ltd filed Critical Newttech Network Technology Co Ltd
Priority to TW98100433A priority Critical patent/TWI397824B/en
Publication of TW201027359A publication Critical patent/TW201027359A/en
Application granted granted Critical
Publication of TWI397824B publication Critical patent/TWI397824B/en

Links

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

This invention discloses a system for evaluating simulation of an examination result, which comprises an examination question library module, a question formulation module, a simulated examination result module, and an evaluation module. The question formulation module formulates at least one piece test paper according to the examination question library module. The simulated examination result module uses the test paper to calculate the score of a set of virtual examinees. The evaluation module compares the score of a user taking the examination of the test paper with the scores of the set of virtual examinees so as to evaluate the learning result of the user.

Description

201027359 六、發明說明: 【發明所屬之技術領域】 本發明是有關於一種測驗系統,且特別是有關於一種可評 估使用者學習成果之測驗結果模擬評估之系統與方法。 【先前技術】 按,在現行台灣的考試制度下,大致分為二種考試類型,即 一為考试及格即頒發證書,如高、普考、專業證照考試等等·另 一則為依照考生分數排名來限額錄取。以高中和^學之聯合招生 為例,都是依照考生的相關考試(高中招生為國民中學學生基本學 ❹力測驗、大學招生為學科能力測驗和指定科目考試)分數來將所右 的考生進行分數排名,分數愈高排名愈前面者,則其志^學= 校系分發的優先順序也愈前面。 對於這種大型的聯合招生考試,考生們在考前常常會進行許 多模擬測驗,以模擬大考時可能會碰到的命題類型以及考試氣 氛,並針對這些模擬測驗的成績進行分析,以評估可能會被哪些 學校或校系所錄取。一般的測驗成绩分析大多是以固定的方式^ 進行,比如說張三模擬測驗成績總分為450分,就將其當作具有 去年大考總分為450分的實力,再進行可能錄取學校的評估。然, φ模擬測驗的試題難易度有高有低,較簡單時,所有考生測驗^數 將會較高;較困難時,所有考生測驗分數將會較低。故直接用模 擬測驗成绩作為基準來比對去年或其他年度的聯合招生考試成 绩,再進行可能錄取學校評估是無法較準確的來評估考生真正的 分數排名,將會與實際的所有考生分數排名有著極大的差距。 此外,每年的模擬測驗次數是非常多的,這對於命題老師來 說,在模擬測驗試題與題型不得與歷年完全相似的情沉下,又要 考慮到模擬測驗试題必須具有合理的設計’不得偏重某一類的題 型,故命題老師常深感壓力。 、 如上所述,如何讓考生進行模擬測驗後,能夠較準確的來評 估其真正的分數排名,實為一具有實用性之思考方向。 201027359 【發明内容】 之功201027359 VI. Description of the Invention: [Technical Field of the Invention] The present invention relates to a test system, and more particularly to a system and method for evaluating a test result of a user's learning outcome. [Previous technology] According to the current Taiwanese examination system, it is roughly divided into two types of examinations, that is, one is a certificate for passing the examination, such as a high, a general examination, a professional certification exam, etc. The other is ranked according to the candidate's score. To limit admission. Taking the joint enrollment of high school and ^xue as an example, all candidates are selected according to the relevant examinations of the candidates (high school enrollment is the national high school students' basic scholastic test, university enrollment is the subject ability test and the specified subject test). In the score ranking, the higher the score is, the higher the ranking is, and the higher the score is, the better the priority of the distribution of the school is. For this large joint enrollment exam, candidates often conduct a number of mock tests before the exam to simulate the types of propositions and exam atmospheres that may be encountered during the exam, and analyze the scores of these mock quizzes to assess possible Which schools or schools are accepted. The general test score analysis is mostly carried out in a fixed way ^, for example, the total score of the three test scores is 450 points, which is regarded as the strength of 450 points in the last year's college entrance examination, and then the evaluation of possible admission schools . However, the difficulty of the φ simulation test is high or low. When it is simple, all candidates will have higher test scores; when it is more difficult, all candidates will have lower test scores. Therefore, using the simulated test scores as a benchmark to compare the results of the joint enrollment test for last year or other years, and then the possible admission of the school assessment is not accurate enough to assess the true scores of the candidates, and will have the actual scores of all candidates. Great gap. In addition, the number of simulated tests per year is very large. For proposition teachers, in the case of simulated test questions and questions that must not be completely similar to the calendar year, it is necessary to consider that the mock test questions must have a reasonable design. Do not focus on a certain type of question type, so the proposition teacher is often deeply pressured. As mentioned above, how to allow candidates to conduct a simulation test can accurately assess their true score rankings, which is a practical direction of thinking. 201027359 [Summary content]

絲盥i?明ϊ另τ目的,即在於提供-種測驗結果模擬評估之系 統與方法,藉以達到自動峡喊輕命題老師壓力之功效者。 如ίί體iff明之内容,在此提出—種測驗結果模擬評 1 ifΐ ’驗題庫模組、—命題模組以及一模擬測 ?=、=成。該測驗題庫模組係蒐集一具有答題反應統計 拔f題組f該摘組之正確答案;該命賴_根據該測驗題庫 模組而組合丨至少—⑽卷;賴_驗結果模_湘該至少 一份試卷,計算一組虛擬受測者成績。 # 本發明之另一實施例,即在提供一種測驗結果模擬評估之 ^統,其主要由一測驗題庫模組、一命題模組、一模擬測驗結果 模組以及一評估模組所組成。該測驗題庫模組係蒐集一具有答題 反應統計之試題組與該試題組之正確答案;該命題模組係根據該 測驗題庫模_組合&至少—料卷;賴擬卿^結果模組係利 用該至少-份試卷,計算—城財啦成绩;餅估模組係將 一使用者接受該至少一份試卷測驗後之成绩與該組虛擬受測者成 績進行比對,藉以評估該使用者之學習成果。 本發明之又一實施例,即在提供一種測驗結果模擬評估之 系統’其主要由一測驗題庫模組、一命題模組、一模擬測驗結果 模組、一評估模組、一輸入單元以及一顯示單元所組成。該測驗 題庫模組係蒐集一具有答題反應統計之試題組與該試題組之正確 答案;該命題模組係根據該測驗題庫模組而組合出至少一份試 卷;該模擬測驗結果模組係利用該至少一份試卷,並根據自該輸 入單元輸入之一特定值來計算出一組虚擬受測者成績;該評估棋 組係將一使用者經由該輪入單元與該顯示單元接受該至少一份試 卷測驗後之成績與該組虛擬受測者成绩進行比對,並將比對結果 201027359 於該顯示單元上顯示.。 . 本發明之再一實施例,即在提供一種測驗結果模擬評估之 方法,係包含下列步驟:蒐集一具有答題反應統計之試題組與該 試題組之正確答案;根據該試题組組合出至少檢試卷r將談至 少一試卷之各題答案數量依據答題反應統計將其數量等比例放大 至等於虛擬之受測者人數;每一虛擬受測者在各題中以隨機且不 重複的方式取得該試卷中各題等比例放大之複數個答案之一個答 案,以組合出每一虛擬受測者之一組答案;將每一虚擬受測者之 答案比對正確答案後,計算出每一虛擬受測者的成绩;以及將一 使用者接受該試卷測驗後之成績與每一虚擬受測者之成績進行比 •對’藉以評估該使用者之學習成果。 【實施方式】 本發明與一般模擬測驗後之成績排名評估主要不同處,即在 於利用過去針對各試題的答題統計資料來當作參數。以選擇題有 A、B、C、D、E等五個選項來說,若模擬試卷共有三十題測驗試題, 其中第一題在過去統計的答題反應比例為:A=3%、B=2〇%、c=i〇%、 D=25%、E=42% ’則若欲虛擬一萬名受測者的成绩分佈時,則該題 的答案選擇A、B、C、D、E的虛擬受測者人數分別有300人、2000 m 人、1000人、250〇人以及4200人,隨後每一虚擬受測者則以亂 馨數且不重複的方式對應到一答案,即此一萬名虚擬受測者針對第 一題的答案’將會有300人選A、2000人選B、1000人選C、2500 人選D以及4200人選E ;第二題亦利用相同之方式來對應答案, 直到此一萬名虛擬受測者的模擬試卷測驗試題都對應到答案後, 再針對這些答案進行評分,找出分數的分佈區間,得到分數模擬 評估的結果。其中,所取得具有答題反應統計資料之試題需考慮 是否足以代表目標測項目之大群體母體之試題,該具有答題反 應統計資料之試題來源可為歷次測驗之各測驗試題的答題統計, 例如:國,中學學生基本學力測驗、大學學科能力測驗、大學指 定科目考試、四技二專統一入學測驗、國家證照考試、能力檢定 201027359 考試等等》 參閱第一圖,係為本發明之系統方塊圖,如圖所示·本發明 之測驗結果模擬評估系統10,主要由一測驗題庫模組U、一命題 模組12以及r*模擬測驗結果模組η所組成。測驗题庫模組^係 蒐集一具有答題反應統計之試題組與該試題組之正確答案。該具 有答題反應統計之試題組即利用過去針對各試題的答題反應統言j 資料(比例)來當作參數。命題模組12係根據該測驗題庫模组Λ1 而組合出至少一份試卷。 由於測驗題庫模組11中可根據試題類型、難易度、出題範圍、 命題出處、測驗目標或歷屆配分率等進行分類或設定參數,故命 ❹題模組12可根據需求而組合出各種題型與難易度之試卷,且命題 模組12之試卷命題方式係根據測驗題庫模組η,經由人工選擇或 電滕設定組合試題,可依照比例原則(試題平均分布於各範圍)或 依照標準化測驗理論所述之命題方式(標準化測驗理論乃對各學 科之能力指標的擬定、試題的設計、施測程序的建立、計分方式 乃至於試題預試以及測驗信度、效度的建立等標準化程序來進行 測驗試卷編製’以使測驗能有最佳的測量效果)來命題,亦可參考 命題老師(使用者)所選擇測驗種類之標準試卷設計架構或前次測 驗之試題設計架構來組合試卷。模擬測驗結果模組13係利用該至 少一份試卷,計算一組虛擬受測者成績。而該組虛擬之受測者人 © 數至少為一人以上時,其成绩才具有分佈統計之意義。該組虛擬 受測者成绩可進一步依據分數高低進行排列,產生一測驗結果分 佈。其中’該虛擬人數為模擬估計將參加正式測驗的人數或參考 歷次參加測驗的人數。 其中’具有答題反應統計之試題種類可為單一選擇題、多重 選擇題、複選題、是非題、填充題、選擇式填充題或簡答題均可。 命題老師於命題時,為避免考生以背考古題答案的方式來應試, 則可以針對測驗題庫模組11内之試題進行參數設定,如改變正確 答案之位置(由Α變成C),或改變試題之計算參數,使答案随之改 變,但須注意的是其答題反應統計(比例)與正確答案亦需要隨之 201027359 .改變。 此外,模擬測驗結果模組13中計算一組虛擬受測者成绩之方 式係將試卷中各試題的答案數量依據答題反應統計將答案數量等 比例放大至等於虛擬之受測者人數,每一虛擬受測者以隨機(亂數) 且不重複的方式取得試卷中各試題之一個答案,以組合出每卞虛 擬受測者之一組試卷答案,比對正碟答案後,計算出每一虚擬受 測者的成績。待每一虛擬受測者的成绩分佈計算出來後,使甩者 可自行將該試卷測驗之成绩與每一虚擬受測者之成績進行比對, 並判斷其分數的排名’藉以評估該使用者之學習成果。其中,評 估該使用者之學習成果方法可根據目標測驗的評估方式,進一步 φ 結合其他統計方法加以評估,例如:台灣在西元2002年所開辦之 指定科目考試(簡稱指考),可利用各指定考科之成績人數累計表 評估,而在西元1994年開辦的學科能力測驗(簡稱學測)則結合 各測驗科目和總級分之級分人數百分比累計表評估學習成果。 如此一來,由試卷試題配合答題反應統計的答案可將模擬測 驗的虛擬成績分佈評估出來,且其參數為歷次測驗試題之答題反 應統計(比例),故虛擬成绩分佈將會與現實中非常的接近,故經 由本發明之系統來進行測驗結果模擬評估是極具有參考價值的。 另,本發明之測驗結果模擬評估系統1〇更包含有一評估模組 14,可自動將使用者之試卷測驗成績與每一虛擬受測者之成绩進 響行比對,並判斷其分數的排名,藉以評估該使用者之學習成果。 參閱第二囷’係為本發明之另一系統方塊圖,如圖所示:該 測驗結果模擬評估系統1〇除包含有測驗題庫模組U、命題模組 12二模擬測驗結果模組13與評估模組14之外,更包含有一顯示 單元15以及一輸入單元16。使用者可經由輸入單元16輸入之一 特定值,即為虛擬受測者之人數,藉以計算出該特定值人數之虛 擬受測f成绩及其分佈狀態《•經由命題模組12組合出之至少_試 卷係齡麟顯轉it 15上,使肖者卿輯齡單元15上之 試卷來經,輸入單元I6作答;而評估模組u係將該使用者經由 該輪入單το 16與該顯示單元15接受(進行作答)該至少一份試卷 201027359 測驗^之,績與該組虛擬受測者成绩進行比對,並將比對結果於 該顯不單元15上顯示,使用者則可以確實評估本身之成績分佈與 排名,亦可進一步進行可能錄取學校或校系組之預測分析。 參閱第二圖’係為本發明之又一系統方塊圈,如圖所示:由 於模擬,驗結果樓组13係以隨機(亂數)且不重複的方式來取得試 卷中各試題之一個答案,以組合出每一虚擬受測者之一組試卷答 案。由於是以乱數法來分配答案,因此會有其微小機率出現極端 分數分佈的情況’而不是較符合常態的分數分佈,例如有可能會 出現許多人滿分或零分這種極端分數分佈情況。 因此,本發明之 測驗結果模擬評估系統1〇更包含有一驗證模組丨7,可驗證其所有 ❿虛擬受測者之成螓(分數)分佈是否為常態。其驗證方法為▲甩統 計學之概念,方法概述如下: 1.依目標考试特性定義若干第一特徵值(例如學測,依級分定義分 別定義出頂標、前標、均標、後標、底標等等)。 2·將一試題組合以亂數法產生一樣本組(一組虛擬受測者成績此 組虛擬受測者之人數係由使用者所決定)。 3. 重複步驟2複數次,以產生複數樣本組。 4. 計算出複數樣本組之各若干第二特徵值(例如學測,依級分定義 分別定義出頂標、前標、均標、後標、底標等等)。 _ 5•選出與第一特徵值最接近之第二特徵值所對應之樣本組,並以 ® 該樣本組作為對照之一組虛擬受測者成績^ 舉例來說,若建立出10000份樣本組,分別將每份樣本之第 二特徵值(頂標、前標、均標、後標、底標值)取出,將最接近第 一特徵值的樣本組作為對照之一組虛擬受測者成績。其中,第一 特徵值可由目標考試歷屆考試結果中取得,亦可以為歷次考試取 得第一特徵值的平均值作為對照基準。 上述之模擬測驗是以聯合招生考試為例,本發明之系統並不 限於聯合招生考試才能使用,對於一般學校、補習班、政府機關 以及國際組織的考試均適用之,而且測驗題庫模組U内策集的試 題及正確答案反應統計數量愈多,則對本發明.之準碟度來說,將 201027359 有更大的助益。 參閱第四阖,係為本發明之實施流程圖,如圖所示:本發明 測驗結果模擬評估之方法,係包含下列步驟:蒐集一具有答題反 應統計之試題组與該試題組之正確答案(步驟S10),再根據該試題 組組合出至少一份試卷(步驟S11)。該具有答題反應統計之試題組 即利用歷次針對各種試題的答題統計資料(比例)來當作參數。命 題模組係根據該測驗題庫模組而組合出至少一份試卷。由於測驗 題庫模組中可根據試題類型、難易度以或範圍進行分類或設定參 數’故命題模組可根據需求而組合出各種題型與難易度之試卷, 且命題模組之試卷命題方式係根據測驗題庫模組.,經由人工選擇 鲁 或電腦設定組合試題,並依照比例原則(試題平均分布於各範圍〉 或依照標準化測驗理論所述之命題方式(標準化測驗理論乃對各 學科之能力指標的擬定、試題的設計、施測程序的建立、計分方 式乃至於試題預試以及測驗信度、效度的建立等標準化程序來進 行測驗試卷编製,以使測驗能有最佳的測量效果)來命題。隨後, 將該至少一試卷之各題答案數董依據答題反應統計將其數董等比 例放大至等於虚擬之受測者人數(步驟S12),且每一虛擬受測者以 隨機且不重複的方式取得該試卷中各試題之一個答案,以組合出 每一虛擬受測者之一組答案(步驟S13),再將每一虛擬受測者之答 案比對正確答案後’計算出每一虚擬受測者的成绩(步称S14);最 籲後’將一使用者接受該試卷測驗後之成绩與每一虛擬受測者之成 绩進行比對(步驟S15),藉以評估該使用者之學習成果。 在步驟12中,更包含輸入虛擬受測者人數的步驟(步称 S121),答題反應統計乘上虛擬受測者人數,就得到試卷之各題答 案數量。 在眾多試題組間又具有難易度之分,故以使用者測驗後之成 績分佈直接對應到上一屆聯考的成绩分佈時,分數上會出現些許 落差。而本發明提供一種測驗結果模擬評估之系統與方法,藉^ 達到較準確地評估考生真正的分數排名之功效。 雖然本發明已以實施例揭露如上,然其並非用以限定本發 201027359 明,任何所屬技術領域中具有通常知識者,在不脫離本發明之 精神和範圍内,當可作些許之更動與潤飾,因此本發明之保護 範圍當視後附之申請專利範圍所界定者為準。 201027359 · 【囷式簡單說明】 第一圓為本發明之系統方塊困。 第二囷為本發明之另一系統方塊圖。 第三圖為本發明之又一系統方塊圓。 第四囷為本發明之實施流程圖。 【主要元件符號說明】 10 :測驗結果模擬評估系統 11 :測驗題庫模組 12 :命題模組 φ 13 :模擬測驗結果模組 14 :評估模組 15 :顯示單元 16 :輸入單元 17 :驗證模組 S10·笼集一具有答題反應統計之試題組與該試題組之正確答 案 ° 511 :根據該試題組組合出至少一份試卷 512 ·將該至少一试卷之各題答案數量依據答題反應統計將其 數量等比例放大至等於虛擬之受測者人數 ® S121 :輸入虛擬之受測者人數 S13:每一虚擬受測者以隨機且不重複的方式取得該試卷中各 試題之一個答案,以組合出每一虛擬受測者之一組答案 S14 :將每一虛擬受測者之答案比對正確答案後,計算出&一 虛擬受測者的成绩 S15:將一使用者接受該試卷測驗後之成绩與每一虛擬受測者 之成績進行比對 11盥 ? ? ? ? ? ϊ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ τ For example, ίί iff ming the content, here is a test results simulation evaluation 1 if ΐ 验 test library module, - proposition module and a simulation test ? =, = into. The test question bank module collects a correct answer with the answer response statistics and the f question group f; the test _ according to the test question bank module, at least - (10) volume; Lai _ test result mode _ Xiang At least one test paper to calculate a set of virtual test subject scores. Another embodiment of the present invention provides a test result simulation evaluation system, which is mainly composed of a test question bank module, a proposition module, a simulation test result module, and an evaluation module. The test question bank module collects the correct answer of the test question group with the answer reaction statistics and the test question group; the proposition module is based on the test question module _ combination & at least - the volume; Lai Qiqing ^ result module system Using the at least one test paper, the calculation - the city financial performance score; the cake evaluation module compares the score of the user after receiving the at least one test paper test with the score of the virtual test subject, thereby evaluating the user Learning outcomes. Another embodiment of the present invention, that is, a system for providing a test result simulation evaluation, is mainly composed of a test question bank module, a proposition module, an analog test result module, an evaluation module, an input unit, and a The display unit is composed of. The test question bank module collects a correct answer of the test question group with the answer reaction statistics and the test question group; the proposition module combines at least one test paper according to the test question bank module; the simulation test result module is utilized The at least one test volume, and calculating a set of virtual subject scores according to a specific value input from the input unit; the evaluation chess set accepting the at least one by the user via the wheel entry unit and the display unit The scores after the test papers are compared with the scores of the virtual test subjects, and the comparison result 201027359 is displayed on the display unit. A further embodiment of the present invention, that is, a method for providing a simulation evaluation of a test result, comprising the steps of: collecting a correct answer to a test group having a reply response statistic and the test question group; and combining at least the test according to the test question group The test paper r will talk about the number of answers to at least one test paper according to the answer response statistics, and enlarge the number to equal the number of virtual subjects; each virtual subject obtains the question randomly and non-repeatedly in each question. Each of the multiple answers of the questions in the test paper is enlarged to combine one answer of each virtual subject; after each virtual subject's answer is compared with the correct answer, each virtual subject is calculated. The score of the tester; and the score of a user after receiving the test of the test paper is compared with the score of each virtual testee. [Embodiment] The present invention differs from the evaluation of the ranking of the results after the general simulation test, that is, the use of the past statistic data for each test question as a parameter. For the five options of A, B, C, D, E, etc., if there are 30 test questions in the simulated test paper, the proportion of the first question in the past is: A=3%, B= 2〇%, c=i〇%, D=25%, E=42%' If you want to virtualize the distribution of the results of 10,000 subjects, then the answer to the question is A, B, C, D, E. The number of virtual subjects is 300, 2000 m, 1000, 250, and 4,200. Each virtual subject then responds to an answer in a messy and non-repeating manner. The answer to the first question of 10,000 virtual subjects will be 300 candidates A, 2000 candidates B, 1000 candidates C, 2500 candidates D and 4200 candidates E; the second question also uses the same way to answer the answer, until this After the simulated test papers of 10,000 virtual subjects are matched to the answers, the answers are scored, the distribution interval of the scores is found, and the results of the score simulation evaluation are obtained. Among them, the test questions with the answer response statistics need to consider whether it is enough to represent the test questions of the large group of the target test items. The test questions with the answer test statistics can be the answer statistics of each test test of the previous test, for example: , middle school students' basic scholasticity test, university subject ability test, university designated subject test, four skills and two special entrance examinations, national certificate test, ability test 201027359 exam, etc. Refer to the first figure, which is the system block diagram of the invention. As shown in the figure, the test result simulation evaluation system 10 of the present invention is mainly composed of a test question bank module U, a proposition module 12 and an r* simulation test result module η. The test question bank module ^ system collects a test question group with the answer response statistics and the correct answer of the test question group. The test group with the answer response statistics is used as a parameter by using the past answer to the test answer for each question. The proposition module 12 combines at least one test paper according to the test question bank module Λ1. Since the test question bank module 11 can classify or set parameters according to the type of the test question, the difficulty level, the range of the question, the source of the test, the test target or the previous rate, the life test module 12 can combine various question types according to the requirements. And the difficulty test paper, and the test paper proposition method of the proposition module 12 is based on the test question bank module η, through manual selection or electric tweet setting combination test questions, according to the principle of proportionality (the test questions are evenly distributed in various ranges) or according to the standardized test theory The propositional method described above (standardized test theory is a standardized procedure for the formulation of the competency indicators of various disciplines, the design of test questions, the establishment of test procedures, the scoring method, the pretest of test questions, and the establishment of test reliability and validity. To test the test papers 'to make the test have the best measurement effect', you can also combine the standard test paper design structure of the test type selected by the proposition teacher (user) or the test design structure of the previous test to combine the test papers. The simulation test result module 13 uses the at least one test paper to calculate a set of virtual test subject scores. When the number of virtual subjects in the group is at least one person, the scores have the meaning of distribution statistics. The scores of the virtual subjects can be further ranked according to the scores, resulting in a test result distribution. Where 'the virtual number is the number of people who are estimated to participate in the formal test or refer to the number of people who participated in the test. Among them, the types of questions with the answer response statistics can be single-choice questions, multiple-choice questions, multiple-choice questions, yes or no questions, filled questions, selective fill questions or short answer questions. When the proposition teacher asks for the proposition, in order to avoid the candidate's answer in the way of answering the archaeological questions, the parameters of the test questions in the test question bank module 11 can be set, such as changing the position of the correct answer (from Α to C), or changing the test questions. The calculation parameters make the answer change, but it should be noted that the response statistics (proportion) and the correct answer also need to be changed accordingly. In addition, the method of calculating the scores of a set of virtual subjects in the simulation test result module 13 is to enlarge the number of answers of each test question in the test paper according to the answer reaction statistics, and enlarge the number of answers to be equal to the number of virtual test subjects, each virtual The testee obtains an answer to each test question in the test paper in a random (random number) and non-repeating manner, to combine the test papers of one of the virtual test subjects, and compare each virtual answer to calculate each virtual test. The testee's grades. After the score distribution of each virtual subject is calculated, the leader can compare the scores of the test paper test with the scores of each virtual subject and determine the ranking of the scores by which the user is evaluated. Learning outcomes. Among them, the method of assessing the learning outcome of the user can be further evaluated according to the evaluation method of the target test, and combined with other statistical methods. For example, the designated subject test (referred to as the test) conducted by Taiwan in 2002, can be used for each designation. The cumulative scores of the number of students in the examinations were evaluated, and the subject ability test (referred to as the “study test”), which was conducted in 1994, combined the scores of the test subjects and the total scores of the total scores to evaluate the learning results. In this way, the answer to the essay response statistic can be used to evaluate the virtual score distribution of the simulated test, and the parameters are the response statistics (proportion) of the previous test questions, so the virtual score distribution will be very different from the reality. Close proximity, so the simulation of the test results by the system of the present invention is extremely valuable. In addition, the test result simulation evaluation system 1 of the present invention further includes an evaluation module 14 which can automatically compare the user's test paper test score with the score of each virtual subject, and determine the ranking of the score. To evaluate the learning outcomes of the user. Referring to the second 囷 ' is another system block diagram of the present invention, as shown in the figure: the test result simulation evaluation system 1 includes the test question bank module U, the proposition module 12 and the second simulation test result module 13 and In addition to the evaluation module 14, there is further included a display unit 15 and an input unit 16. The user can input a specific value, that is, the number of virtual subjects, through the input unit 16, thereby calculating the virtual measured f-scores of the specific number of people and their distribution status. • At least the combination of the proposition modules 12 _ test papers are transferred to it on the 15th, so that the test papers on the Xiaorenqing ageing unit 15 are passed, and the input unit I6 answers; and the evaluation module u is the user via the round-in single το 16 and the display The unit 15 accepts (sends and answers) the at least one test paper 201027359 test ^, the performance is compared with the set of virtual test subject scores, and the comparison result is displayed on the display unit 15, the user can actually evaluate The distribution and ranking of the results of the students themselves can be further advanced to predict the analysis of the school or school group. Referring to the second figure, it is another system block of the invention, as shown in the figure: due to the simulation, the test group 13 is randomly (random) and non-repeating to obtain an answer to each test question in the test paper. To combine the answers of one of the test papers of each virtual subject. Since the answer is assigned in a random number method, there is a case where the micro-probability has an extreme score distribution' instead of a more normal score distribution, for example, there may be an extreme score distribution of many people's perfect scores or zero points. Therefore, the test result simulation evaluation system 1 of the present invention further includes a verification module 丨7, which can verify whether the distribution of the 螓(score) of all the virtual subjects is normal. The verification method is ▲ 甩 statistical concept, the method is summarized as follows: 1. Define a number of first eigenvalues according to the characteristics of the target test (for example, the test, define the top mark, the front mark, the average mark, the back mark respectively according to the definition of the level , the bottom mark, etc.). 2. Combine a test question into a random number method. This group (the number of virtual test subjects is the number of virtual test subjects determined by the user). 3. Repeat step 2 multiple times to generate a complex sample set. 4. Calculate each of the second eigenvalues of the complex sample set (for example, the test, define the top mark, the front mark, the average mark, the back mark, the bottom mark, etc. according to the definition of the level). _ 5• Select the sample group corresponding to the second eigenvalue closest to the first eigenvalue, and use the sample group as a control group to perform the virtual subject score. For example, if 10,000 sample groups are established The second eigenvalue (top mark, prescript, average mark, post mark, bottom mark value) of each sample is taken out, and the sample group closest to the first eigenvalue is used as a control group. . The first eigenvalue can be obtained from the previous test results of the target test, and the average value of the first eigenvalues obtained in the previous test can also be used as a reference. The above-mentioned simulation test is based on the joint enrollment examination. The system of the present invention is not limited to the joint enrollment examination, and is applicable to examinations of general schools, cram schools, government agencies, and international organizations, and the test question bank module U is used. The more the number of questions and the correct answer response statistics, the more useful the 201027359 for the standard version of the invention. Referring to the fourth aspect, which is a flowchart of the implementation of the present invention, as shown in the figure: the method for simulating the evaluation result of the test result of the present invention comprises the following steps: collecting a test question group having the answer reaction statistics and the correct answer of the test question group ( In step S10), at least one test paper is combined according to the test question group (step S11). The test group with the answer response statistics uses the previous answer statistics (proportion) for each test question as the parameters. The proposition module combines at least one test paper according to the test question bank module. Because the test question bank module can be classified according to the type of test questions, difficulty or range, or set parameters, the proposition module can combine various test questions and difficulty test papers according to the requirements, and the test paper proposition method of the proposition module According to the test question bank module, manually select the test questions by hand or by computer, and according to the principle of proportionality (the test questions are evenly distributed in various ranges) or the proposition method according to the standardized test theory (standardized test theory is the ability index of each subject) The preparation of the test, the design of the test questions, the establishment of the test procedures, the scoring method, and even the standard test procedures such as test pretests and test reliability and validity are used to test the test papers so that the test can have the best measurement results. Then, the number of answers to each of the at least one test paper is enlarged according to the answer response statistics, and the number of the number of subjects is equal to the number of virtual subjects (step S12), and each virtual subject is randomized. And answering each question in the test paper in a non-repeating manner to combine one of the answers of each virtual subject (step S13), after comparing the answers of each virtual subject to the correct answer, 'calculate the score of each virtual subject (step S14); the most appealing after the user accepts the test result of the test paper Comparing with the score of each virtual subject (step S15), thereby evaluating the learning result of the user. In step 12, the step of inputting the number of virtual subjects (step S121), answer response statistics By multiplying the number of virtual subjects, the number of answers to each question in the test paper is obtained. In many test questions, there is a difficulty degree, so the distribution of the results after the user test directly corresponds to the distribution of the results of the previous joint test. There is a slight drop in the score. The present invention provides a system and method for the simulation evaluation of the test results, which can achieve a more accurate evaluation of the candidate's true score ranking. Although the present invention has been disclosed above by way of example, it is not In order to limit the present invention, those skilled in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of protection of the Ming Dynasty shall be subject to the definition of the scope of the patent application. 201027359 · [Simple description of the 】] The first circle is a block of the system of the present invention. The second is a block diagram of another system of the present invention. The third figure is another system block circle of the present invention. The fourth embodiment is a flowchart of the implementation of the present invention. [Description of main component symbols] 10: Test result simulation evaluation system 11: Test question bank module 12: Proposition module φ 13 : Simulation test result module 14: evaluation module 15: display unit 16: input unit 17: verification module S10·cage a test group with answer response statistics and the correct answer of the test group 511: according to the test group combination At least one test paper 512 · The number of answers to each question of at least one test paper is proportionally enlarged according to the answer reaction statistics to be equal to the number of virtual testers. S121: Enter the number of virtual testees S13: each virtual The subject obtains an answer to each question in the test paper in a random and non-repeating manner to combine one of each virtual subject's answer S14: the answer of each virtual subject After comparing the correct answer, calculated & a virtual test subject results S15: a user will accept the post of the paper test scores and test scores by each virtual who's to compare 11

Claims (1)

201027359 七、申請專利範圍: 1. 一種測驗結果模擬評估之系統,係包含有: 賴組’係聽―具轉題反減 試題組之正確答案; 命題模組,係根據該測驗題庫模組而組合出至少一份試 卷;以及 擬"^^^结果模組係利用該至少一份試卷,計算一組虛 請ΐ概圍第1項所述之測驗結果模擬評估之系統,其 中,該組虛擬之受測者人數為至少二人以上。 鲁3·如申請專利範圍第!項所述之測驗結果模擬評估之系統其 中’該組虛擬受測者成績可進一步依據分數高低進行排列產 生一測驗結果分佈。 4. 如申請專利範圍第1項所述之測驗結果模擬評估之系統,其 中,該具有答題反應統計之試題種類可為單一選擇題、多重選 擇題二複選題、是非題、填充題、選擇式填充題或簡答題。 5. 如申請專利範圍第1項所述之測驗結果模擬評估之系統,其 中,該測驗題庫模組中可根據試題類型、難易度、出題範圍、、 命題出處、測驗目標或歷屆配分率進行分類或設定參數。 6. 如申請專利範圍第丨項所述之測驗結果模擬評估之系統其 中,該命題模組係參考一使用者所選擇測驗種類之標準試卷設 計或前次測驗之試題設計來進行該至少一試卷之組合。 7. 如申請專利範圍第1項所述之測驗結果模擬評估之系統,其 中,該模擬測驗結果模組中計算該組虛擬受測者成绩之方式係 將該至少一试卷中各試題的答案數量依據答題反應統計將答案 數量等比例放大至等於虛擬之受測者人數,每一虛擬受測者以 隨機且不重複的方式取得該至少一試卷中各試題之一個答案, 以組合出每一虛擬受測者之一組試卷答案,比對正碟答&後, 計算出每一虚擬受測者的成績。 ° 、 8· —種測驗結果模擬評估之系統,係包含有: 12 201027359 試:係笼集一具有答題反應統計之試題組與該 命題模組’係根據該測驗題庫模組而組合出至少一份試卷; 结果模,组,係利用該至少一份試卷,計算一組虚 擬mi者成績;以及 绩受:二:=該至少一份試卷測驗後之成 9. 申請專利範圍第8項所述之測驗結果模擬評估之系統,其 :’該組虛擬受測者可進—步依據分數高低進行排列,^ 生一測驗結果分佈。 馨10.如申請專利範圍第8項所述之測驗結果模擬評估之系統,其 中,該具有答題反應統計之試題種類可為單一選擇題、多重^ 擇題^選題、是非題、填充題、選擇式填充題或簡答題。 •如申請專利範圍第8項所述之測驗結果模擬評估之系統,其 :’該測驗題庫模組中可根據試題類型、難易度、出題範圍、 命題出處、測驗目標或歷屆配分率進行分類或設定參數。 12. 如申請專利範圍第8項所述之測驗結果模擬評估之系統, 其中,該模擬測驗結果模組中計算該組虛擬受測者成績之方式 係將該至少一試卷中各試題的答案數量依據答題反應統計將答 案=量等比例放大至等於虛擬之受測者人數,每一虛擬受測者 擊 以隨機且不重複的方式取得該至少一試卷中各試題之一偭答 案,以組合出每一虛擬受測者之一組試卷答案,比對正確答案 後,計算出每一虛擬受測者的成績。 13. —種測驗結果模擬評估之系統,係包含有。 一測驗題庫模組,係蒐集一具有答題反應統計之試題組與該 試題組之正確答案; 卷 一命題模組’係根據該測驗題庫模组而組合出至少一份試 一模擬測驗結果模組係利用該至少一份試卷,並根據自一輪 入單元輸入之一特定值來計算出一組虚擬受測者成绩; 13 201027359 一評估模組’係將一使用者經由該輸入單元與一顯示單元接 受該至少一份試卷測驗後之成績與該組虛擬受測者成绩進行比 對,並將比對結果於該顯示單元上顯示。 14. 如申請專利範圍第13項所述之測驗結果模擬評估之系統, 其中’該組虛擬受測者成績可進一步依據分數高低進行排列, 產生一測驗結果分佈, 15. 如申請專利範圍第13項所述之測驗結果模擬評估之系統, 其中,該具有答題反應統計之試題種類可為單一選擇題、多重 選擇題、複選題、是非題、填充題、選擇式填充題或簡答題。 16. 如申請專利範圍第13項所述之測驗結果模擬評估之系統, ❹ 其中,該測驗題庫模組中可根據試題類型、難易度以或範圍進 行分類或設定參數。 17·如申請專利範圍第13項所述之測驗結果模擬評估之系統, 其中,該模擬測驗結果模組中計算該組虛擬受測者成绩之方式 係將該至少一試卷中各試題的答案數量依據答題反應統計將答 案數量等比例放大至等於虚擬之受測者人數,每一虚擬受測者 以隨機且不重複的方式取得該至少一試卷中各試題之一個答 案,以組合出每一虛擬受測者之一組試卷答案,比對正確答案 後,計算出每一虛擬受測者的成绩。 _ 18· 一種測驗結果模擬評估之方法,係包含下列步驟: ® 蒐集一具有答題反應統計之試題組與該試題組之正確答案; 根據該試題組組合出至少一份試卷; 將該至少一試卷之各題答案數董依據答題反應統計將其數董 等比例放大至等於虛擬之受測者人數; 每一虛擬受測者以隨機且不重複的方式取得該試卷中各試題 之一個答案,以組合出每一虛擬受測者之一組答案; 將每一虛擬受測者之答案比對正確答案後,計算出每一虚擬 受測者的成績;以及 將一使用者接受該試卷測驗後之成績與每一虚擬受測者之成 绩進行比對,藉以評估該使用者之學習成果。 201027359 19.如申請專利範圍第18項所述之測驗結果模擬評估之方法, 更包含輸入該虛擬之受測者人數的步驟。201027359 VII. Scope of application for patents: 1. A system for simulating and evaluating test results, including: Lai group's correct answer to the question-reversing test group; Proposition module, based on the test question bank module Combining at least one test paper; and formulating the "^^^ result module is to use the at least one test paper to calculate a system for the simulation evaluation of the test results described in item 1 of the virtual request, wherein the group The number of virtual subjects is at least two. Lu 3 · If you apply for a patent scope! The test results of the test results are simulated in the system. The scores of the virtual test subjects can be further ranked according to the scores to produce a test result distribution. 4. The system for simulating the test results as described in item 1 of the patent application scope, wherein the type of test questions with the answer response statistics may be a single multiple choice question, multiple multiple choice question two multiple choice questions, yes and no questions, filled questions, selection Fill or short answer questions. 5. The system for simulating the test results as described in item 1 of the patent scope, wherein the test question bank module can be classified according to the type of the test question, the difficulty level, the scope of the question, the source of the test, the test target or the previous matching rate. Or set parameters. 6. The system for simulating the test results as described in the scope of the patent application, wherein the proposition module performs the at least one test paper with reference to a standard test paper design of the test type selected by the user or a test design of the previous test. The combination. 7. The system for simulating evaluation of test results according to item 1 of the patent application, wherein the method for calculating the scores of the set of virtual subjects in the test result module is the number of answers of each test question in the at least one test paper. According to the answer response statistics, the number of answers is proportionally enlarged to be equal to the number of virtual subjects, and each virtual subject obtains an answer of each test question in the at least one test paper in a random and non-repeating manner to combine each virtual One of the subjects' test paper answers, after comparing the correct answer, the score of each virtual subject is calculated. °, 8·—A system for the simulation evaluation of test results, including: 12 201027359 Test: The test group with the answer response statistics and the proposition module are combined according to the test question bank module. a test paper; a result model, a group, using the at least one test paper to calculate a set of virtual mi scores; and a score of two: = at least one test paper after the test is 9. The patent application scope is described in item 8. The test results simulate the evaluation system, which: 'The group of virtual subjects can be stepped according to the score level, and the test results distribution. Xin 10. The system for simulating the test results according to item 8 of the patent application scope, wherein the test questions with the answer response statistics can be a single multiple choice question, multiple multiple choice questions, multiple choice questions, yes and no questions, filled questions, Selective fill or short answer questions. • A system for simulating the test results as described in item 8 of the patent application, which: 'The test question bank module can be classified according to the type of test questions, difficulty level, range of questions, source of proposition, test target or previous distribution rate or Setting parameters. 12. The system for simulating and evaluating the test result described in claim 8 of the patent scope, wherein the method for calculating the score of the virtual subject in the simulated test result module is the number of answers of each test question in the at least one test paper According to the answer reaction statistics, the answer=quantity is proportionally enlarged to be equal to the number of virtual subjects, and each virtual subject obtains one of the questions in the at least one test paper in a random and non-repeating manner to combine One of the virtual subjects' test paper answers, and after comparing the correct answers, the scores of each virtual subject are calculated. 13. A system for the simulation evaluation of test results, including. A test question bank module collects a correct answer to the test question group with the answer response statistics and the test question group; the volume one proposition module combines at least one test one simulation test result module according to the test question bank module. Using the at least one test paper and calculating a set of virtual test subject scores according to a specific value input from a round-in unit; 13 201027359 an evaluation module 'passes a user via the input unit and a display unit The scores after accepting the at least one test paper are compared with the scores of the set of virtual subjects, and the comparison results are displayed on the display unit. 14. The system for simulating the test results as described in item 13 of the patent application, wherein 'the scores of the virtual subjects can be further ranked according to the scores, resulting in a test result distribution, 15. For example, the scope of patent application is 13 The test result simulation test system described in the item, wherein the test question type having the answer response statistics may be a single multiple choice question, multiple multiple choice questions, multiple choice questions, yes or no questions, filled questions, selective fill questions or short answer questions. 16. The system for simulating the test results as described in item 13 of the patent application, ❹ where the test question bank module can be classified or set according to the type of test questions, difficulty level or range. 17. The system for simulating and evaluating test results according to claim 13 of the patent application scope, wherein the method for calculating the scores of the virtual test subjects in the test test result module is the number of answers to the test questions in the at least one test paper. According to the answer response statistics, the number of answers is proportionally enlarged to be equal to the number of virtual subjects, and each virtual subject obtains an answer of each test question in the at least one test paper in a random and non-repeating manner to combine each virtual One of the subjects' test paper answers, and after comparing the correct answers, the scores of each virtual subject are calculated. _ 18· A method for simulating the test results, comprising the following steps: ® collecting a correct answer to the test group with the answer response statistics and the test question group; combining at least one test paper according to the test question group; According to the answer response statistics, the number of answers to each question is enlarged to equal the number of virtual subjects; each virtual subject obtains an answer to each question in the test paper in a random and non-repeating manner, Combining one set of answers for each virtual subject; calculating the score of each virtual subject after comparing the answers of each virtual subject to the correct answer; and after accepting the test of the test by a user The score is compared with the score of each virtual subject to evaluate the learning outcome of the user. 201027359 19. The method for simulating the test result as described in claim 18 of the patent application, further includes the step of inputting the number of the virtual subject. 1515
TW98100433A 2009-01-07 2009-01-07 The system and method of simulation results TWI397824B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW98100433A TWI397824B (en) 2009-01-07 2009-01-07 The system and method of simulation results

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW98100433A TWI397824B (en) 2009-01-07 2009-01-07 The system and method of simulation results

Publications (2)

Publication Number Publication Date
TW201027359A true TW201027359A (en) 2010-07-16
TWI397824B TWI397824B (en) 2013-06-01

Family

ID=44853167

Family Applications (1)

Application Number Title Priority Date Filing Date
TW98100433A TWI397824B (en) 2009-01-07 2009-01-07 The system and method of simulation results

Country Status (1)

Country Link
TW (1) TWI397824B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI478123B (en) * 2012-05-04 2015-03-21
TWI649718B (en) * 2017-06-08 2019-02-01 樂學網科技股份有限公司 Method and device for recommending similar school systems
CN110651294A (en) * 2017-05-19 2020-01-03 日益得有限公司 Method, apparatus and computer program for estimating test scores

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW460820B (en) * 1998-04-30 2001-10-21 Inst Information Industry On-line learning result evaluation system and method
TW454134B (en) * 1999-12-10 2001-09-11 Nat Science Council Method for collection and identification of automatic dynamic testing subjects
TW200506651A (en) * 2003-08-04 2005-02-16 Strawberry Software Inc A multi-dimension on-line intelligent evaluation and guiding system for remote distance learning
JP2006235808A (en) * 2005-02-23 2006-09-07 Tomoomi Kajino System for predicting the number of entrance examination applicants

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI478123B (en) * 2012-05-04 2015-03-21
CN110651294A (en) * 2017-05-19 2020-01-03 日益得有限公司 Method, apparatus and computer program for estimating test scores
TWI649718B (en) * 2017-06-08 2019-02-01 樂學網科技股份有限公司 Method and device for recommending similar school systems

Also Published As

Publication number Publication date
TWI397824B (en) 2013-06-01

Similar Documents

Publication Publication Date Title
Dogan et al. A Comparison of Rubrics and Graded Category Rating Scales with Various Methods Regarding Raters' Reliability.
Anthony et al. Identifying sets of maximally efficient items from the Academic Competence Evaluation Scales—Teacher Form.
Batool et al. Managing higher education quality enhancement in Pakistan through communication skill to achieve international opportunities.
Kartowagiran et al. Can student assessment sheets replace observation sheets?
TWI397824B (en) The system and method of simulation results
Lee Psychometric analyses of the Birthday Party
Wahyuni et al. Interrater Reliability: Comparison of essay’s tests and scoring rubrics
Kelly et al. The relationship between student grade point average, principal internship mentor's assessment scores and school leaders licensure assessment scores
Clarke et al. Mathematics screening measures for the primary grades.
Shahid et al. Academic self-concept and academic achievement among undergraduates in universities of Pakistan: A gender perspective
Lamprianou The tendency of individuals to respond to high-stakes tests in idiosyncratic ways
Herwin et al. Person fit statistics to identify irrational response patterns for multiple-choice tests in learning evaluation
Widhiarso et al. Validation of Setting and Design of Multi-Stage Testing (MST) to Portray Students’ Achievement on Reading Literacy in AKMI 2021
Rawlings et al. Reliability and validity of OSCE for assessment of BSW competency: lessons learned
Zimmerman et al. Calibration of self-efficacy for conducting a chi-squared test of independence
Nissen et al. Giving students a voice—A preliminary study of the validity of an ultra brief outcome measure for students: the learning rating scale LRS
Hanson A determination and classification of student errors in lower-level calculus through computer-aided assessment and analysis
Bichi et al. Classical Item Analysis of Science Achievement Test
Boereboom et al. Primary school entry assessment in New Zealand
Pelingon Exploring preservice elementary teachers’ mathematical knowledge for teaching
Chikezie et al. Content Validity Index of Basic Education Certificate Examination (BECE) Test Items in Basic Science and Technology (BST)
Schoeman Standard setting for specialist physician examinations in South Africa
Kennedy et al. Unified tertiary matriculation examination (UTME) and the post unified tertiary matriculation examination (PUTME) as predictors of undergraduate Students’ final grades
DARAMOLA et al. Equipercentile Equating of WAEC, NECO And NABTEB Senior School Certificate Multiple Choice Test Items In Economics
Connelly Susan Deehan Murray

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees