WO2021177413A1 - Report evaluation device, report evaluation method, and program - Google Patents

Report evaluation device, report evaluation method, and program Download PDF

Info

Publication number
WO2021177413A1
WO2021177413A1 PCT/JP2021/008493 JP2021008493W WO2021177413A1 WO 2021177413 A1 WO2021177413 A1 WO 2021177413A1 JP 2021008493 W JP2021008493 W JP 2021008493W WO 2021177413 A1 WO2021177413 A1 WO 2021177413A1
Authority
WO
WIPO (PCT)
Prior art keywords
report
evaluation
description
result
unit
Prior art date
Application number
PCT/JP2021/008493
Other languages
French (fr)
Japanese (ja)
Inventor
健太 佐々木
朋子 君島
麻未 梶井
鈴木　健一
Original Assignee
株式会社グロービス
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社グロービス filed Critical 株式会社グロービス
Publication of WO2021177413A1 publication Critical patent/WO2021177413A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education

Definitions

  • the present invention relates to a report evaluation device, a report evaluation method, and a program.
  • the present application claims priority based on Japanese Patent Application No. 2020-037109 filed in Japan on March 4, 2020, the contents of which are incorporated herein by reference.
  • the following scoring support devices are known as technologies that support user learning in an e-learning environment. That is, the scoring support device inputs a text such as an answer to a descriptive question as a score estimation target, and calculates the degree of similarity between the input text of the score estimation target and a preset reference text. Further, the scoring support device determines the relationship between the similarity calculated for the plurality of texts to which the score has been given and the score given to each of the plurality of texts. The scoring support device determines the score of the text to be scored based on the similarity of the text to be scored and the determined relationship (see, for example, Patent Document 1).
  • an object of the present invention is to enable accurate evaluation of a text having a sentence format.
  • One aspect of the present invention for solving the above-mentioned problems is to evaluate the report by using the result of extracting the description portion satisfying the evaluation criteria from the report described in the sentence format corresponding to the predetermined problem.
  • one aspect of the present invention includes an evaluation step of evaluating the report by using the result of extracting a description portion satisfying the evaluation criteria from the report described in a sentence format corresponding to a predetermined problem. It is a report evaluation method including at least a screen information generation step for generating report screen information corresponding to a report screen that can be displayed by reflecting the extraction result of the description portion by the evaluation step in the description content of the report.
  • one aspect of the present invention is an evaluation in which a computer evaluates the report by using the result of extracting a description portion satisfying the evaluation criteria from the report described in a sentence format corresponding to a predetermined problem.
  • This is a program for functioning as a screen information generation unit that generates report screen information corresponding to a report screen that can be displayed by reflecting the extraction result of the description part by at least the evaluation unit in the description content of the report. ..
  • FIG. 1 shows an overall configuration example of the learning support system of the present embodiment.
  • the learning support system of the present embodiment evaluates the report submitted by the user U according to the theme given. That is, the user U in the present embodiment is a person (learner, report submitter) who creates a report using the user terminal device 100 and receives an evaluation of the created report.
  • the learning support system of the present embodiment includes a plurality of user terminal devices 100, a learning support device 200 (an example of a report evaluation device), and an instructor terminal device 300.
  • the user terminal device 100 is a terminal device used by each user U for learning.
  • the user terminal device 100 may be, for example, a personal computer, a tablet terminal, a smartphone, or the like.
  • the learning support device 200 is a device that provides the user U with learning support corresponding to learning by communicating with each of the user terminal devices 100 via the network NT. That is, the learning support device 200 provides the learning course to the user U by communicating with the user terminal device 100.
  • the curriculum in the course provided by the learning support device 200 of the present embodiment includes report submission. That is, a certain theme (problem) for creating a report is presented to the user U.
  • the theme of the report is, for example, when the user U logs his / her user terminal device 100 into the website of the learning course of the learning support device 200 to perform learning, and is displayed according to the progress of learning. It may be presented on the web page.
  • User U creates a report according to the presented theme and submits the created report.
  • the report may be performed, for example, by the user creating a sentence by using the word processor function of the user terminal device 100.
  • the user submits the report by having the user terminal device 100 transmit the created report file to the learning support device 200 as the transmission destination.
  • the learning support device 200 can evaluate the transmitted report and transmit the evaluation result information indicating the evaluation result to the user terminal device 100.
  • the instructor terminal device 300 is a terminal device used by the instructor I.
  • the instructor terminal device 300 may be, for example, a personal computer, a tablet terminal, a smartphone, or the like.
  • the evaluation result of the report made by the learning support device 200 may be provided to the user U.
  • the instructor I confirms the evaluation result of the report made by the learning support device 200 by the instructor terminal device 300, and corrects the evaluation result by the learning support device 200 as necessary.
  • Lecturer I will be made to make the final evaluation. In this case, it is not necessary for the instructor I to extract the description part and the like that satisfy the evaluation criteria from the beginning of the report, and the evaluation can be performed by confirming the evaluation result by the learning support device 200 as described above. Therefore, the work related to the evaluation can be made more efficient.
  • FIG. 2 shows a configuration example of the learning support device 200.
  • the learning support device 200 shown in the figure includes a communication unit 201, a control unit 202, and a storage unit 203.
  • the communication unit 201 executes communication via the network NT.
  • the control unit 202 executes various controls in the learning support device 200.
  • the function as the control unit 202 is realized by executing a program by a CPU (Central Processing Unit) included in the learning support device 200.
  • the control unit 202 includes an evaluation unit 221, a screen information generation unit 222, and an evaluation result output unit 223.
  • the evaluation unit 221 evaluates the report by using the result of extracting the description portion satisfying the evaluation criteria from the report described in the sentence format corresponding to the predetermined task.
  • the screen information generation unit 222 generates report screen information corresponding to a report screen that can be displayed by reflecting at least the extraction result of the description portion by the evaluation unit 221 in the description content of the report.
  • the evaluation result output unit 223 outputs the evaluation result information for the report submitter in which the evaluation result by the evaluation unit 221 is reflected.
  • the storage unit 203 stores various information related to the learning support device 200.
  • the storage unit 203 includes a user information storage unit 231, a submission report storage unit 232, an evaluation utilization information storage unit 233, an evaluation result information storage unit 234, and a feedback comment storage unit 235.
  • the user information storage unit 231 stores information for each user as a learner who receives a learning course provided by the learning support device 200.
  • the submission report storage unit 232 stores the report submitted by the user U. That is, the submission report storage unit 232 stores the report transmitted from the user terminal device 100.
  • the report stored in the submitted report storage unit 232 is evaluated.
  • the evaluation utilization information storage unit 233 stores the information used by the evaluation unit 221 for the evaluation of the report.
  • the evaluation result information storage unit 234 stores evaluation result information indicating the evaluation result of the evaluation unit 221 for each submitted report.
  • the feedback comment storage unit 235 stores the feedback comment. Feedback comments will be described later.
  • FIG. 3 shows an example of evaluation utilization information stored in the evaluation utilization information storage unit 233.
  • the evaluation usage information in the figure includes the theme ID, the theme content, the question, and the area of the evaluation standard corresponding to each theme.
  • the theme ID area includes the theme ID, which is an identifier assigned to the corresponding theme.
  • the theme content area stores the content of the corresponding theme (theme content).
  • the question area stores the questions. In this embodiment, one or more questions are provided corresponding to one theme.
  • the question area specifically stores information indicating the content of the question provided according to the theme.
  • the questions are presented with the theme, for example, to user U, who is the submitter of the report. The user creates a report under the presented theme, including the answers to the similarly presented questions.
  • the evaluation criteria area stores the evaluation criteria.
  • the evaluation standard area specifically stores information indicating the contents of the evaluation standard defined for the relevant question. Taking the theme to which the theme ID "T0001" is assigned in the figure as an example, the theme content is indicated by the data "0001.thm” stored in the theme content area. Then, three questions “0011.set”, “0012.set”, and “0013.set” are provided corresponding to the theme contents indicated by the data "0001.thm”. The question “0011.set” is provided with two evaluation criteria “0001.kiz” and “0002.kiz”, and the question “0002.set” is provided with one evaluation standard "0003.kiz”. One evaluation standard "0004. Kiz" is provided in "0003. Set”.
  • Step S101 An example of a processing procedure executed by the learning support device 200 of the present embodiment in connection with the evaluation of the report will be described with reference to the flowchart of FIG. Step S101:
  • the evaluation unit 221 inputs a report to be evaluated.
  • the evaluation unit 221 reads the report to be evaluated from the submission report storage unit 232 and inputs the read report.
  • Step S102 In the present embodiment, the report stored in the submitted report storage unit 232 is in the same format as when it is transmitted from, for example, the user terminal device 100.
  • the format as it is transmitted from the user terminal device 100 may not be suitable for evaluation.
  • the evaluation unit 221 converts the evaluation target report input in step S101 into a predetermined format suitable for evaluation.
  • Step S103 The evaluation unit 221 inputs the evaluation criteria corresponding to the theme of the report to be evaluated from the evaluation utilization information storage unit 233.
  • Step S104 The report is text written in natural language. Therefore, the evaluation unit 221 extracts a description portion (evaluation criterion corresponding description portion) that satisfies the evaluation criteria input in step S103 from the report to be evaluated. At this time, the evaluation unit analyzes the description contents of the report using natural language processing. As an example, as an analysis of the report, the evaluation unit 221 may divide the character string of the report indicated by the text into words by morphological analysis and perform distributed expression for each word. Further, as the analysis of the report, the evaluation unit 221 may perform context analysis such as syntactic analysis and semantic analysis on the character string indicated by the report.
  • the evaluation unit 221 derives items such as the content of the report, the number of characters, the appropriateness of the vocabulary to be used (for example, easy-to-understand), etc. from the distributed expression for each word obtained as described above and the results of various analyzes. You can do it.
  • the evaluation unit 221 analyzes the description contents of the report as described above, identifies the description part that satisfies the conditions required by each evaluation standard from the entire description of the report, and evaluates the specified description part as the evaluation standard. Extract as the relevant description part.
  • the evaluation unit 221 may use a learning model in extracting the description portion related to the evaluation criteria in step S104.
  • the evaluation criteria have the content of determining whether or not a specific item is mentioned, for example, "referring to XX" in the report.
  • a learning model that extracts related description parts corresponding to such evaluation criteria is a sentence (which may be a short sentence or a compound sentence) and a phrase indicating items shown in a large number of evaluation criteria in a learning device. , Words, etc. can be constructed by inputting and learning a data set as learning data.
  • Step S105 The evaluation unit 221 scores the report to be evaluated as an evaluation.
  • the evaluation unit 221 gives a predetermined score to the evaluation criteria from which the description portion is extracted in step S104, and does not give a score to the evaluation criteria from which the description portion is not extracted.
  • the scoring may be done in this way.
  • the fact that the description part was extracted means that the content required by the evaluation criteria was described in the report, and the fact that the description part was not extracted means that the content required by the evaluation criteria was not described in the report. That is to say.
  • the evaluation unit 221 may store the scoring result in step S105 in the evaluation result information storage unit 234 so as to be included in the evaluation result information corresponding to the report to be evaluated.
  • Step S106 The screen information generation unit 222 generates report screen information.
  • the report screen information is information used for displaying the report screen.
  • the report screen is a screen in which the extraction result of the description portion performed by the evaluation unit 221 is reflected in the description content of the report.
  • the report screen information may be a file described in a markup language such as HTML format.
  • the report screen information in this format can be displayed by opening it with a web browser, for example.
  • the evaluation unit 221 stores the generated report screen information in the storage unit 203. At this time, the evaluation unit 221 may store the evaluation result information storage unit 234 so as to include it in the evaluation result information corresponding to the report to be evaluated.
  • Step S107 The report screen information generated in step S106 and stored in the storage unit 203 is used by the instructor I to refer to the evaluation result by the learning support device 200 when evaluating the report.
  • the instructor I makes the instructor terminal device 300 access the learning support device 200, and causes the instructor terminal device 300 to display the report screen of the report to be evaluated.
  • the evaluation result output unit 223 of the instructor terminal device 300 outputs (transmits) the report screen information of the report designated by the instructor terminal device 300 to the instructor terminal device 300.
  • the instructor terminal device 300 displays a report screen by using the transmitted report screen information by its own web browser function.
  • the instructor I may display the report screen of the report to be evaluated on the instructor terminal device 300 at any time after the report screen information is stored in the storage unit 203.
  • the report screen of the report to be evaluated may be displayed under the control of the learning support device 200 according to the arrival at a predetermined date and time according to the report evaluation schedule of the instructor I determined in advance.
  • FIG. 5 shows an example of the mode of the report screen displayed on the instructor terminal device 300.
  • the report area AR11 on the right side and the evaluation reference area AR12 on the left side are included.
  • the report area AR11 is an area in which the description contents of the report created by the user U according to the presented theme are displayed.
  • the evaluation reference area AR12 is an area in which the evaluation criteria corresponding to the report displayed in the report area AR11 are shown.
  • a “default” column is arranged.
  • the content of the question or evaluation standard is shown for each of the "question” column and the "evaluation standard” column provided under the question.
  • the evaluation standard area AR12 in the figure the content of the "question 1" is shown in the column of "question 1", and the three “evaluation criteria” provided under “question 1" are shown.
  • the contents of the corresponding evaluation criteria are shown for each of the columns of "1-1", “evaluation criteria 1-2", and "evaluation criteria 1-3".
  • radio buttons RB are arranged in each of the “default” column, the “question” column, and the “evaluation standard” column.
  • the radio button RB is used for highlighting the description portion related to the corresponding column in the description of the report displayed in the report area AR11.
  • the radio button RB in the "default” column is selected, the report description displayed in the report area AR11 is not highlighted.
  • the "default” column may be omitted in the evaluation reference area AR12.
  • the radio button RB in the "Question"("Question1",”Question2",”Question3" column is selected, the report description in the report area AR11 is based on the corresponding "Question”.
  • the corresponding description of the evaluation criteria is highlighted for each of the "evaluation criteria” provided in. Specifically, when the radio button RB in the "Question 1" column is selected, the three “evaluation criteria 1-1" provided under “Question 1" in the report description in the report area AR11. , “Evaluation Criteria 1-2", and “Evaluation Criteria 1-3” are highlighted. When the radio button RB in the "evaluation criteria” column is selected, the evaluation criteria corresponding description portion corresponding to the corresponding "evaluation criteria” is highlighted in the report description in the report area AR11.
  • the radio button RB in the "evaluation criterion 1-1" column is selected, the evaluation criterion corresponding description portion corresponding to "evaluation criterion 1-1" is highlighted in the report description in the report area AR11. Will be done.
  • the highlighting in the report area AR11 is performed by applying a line marker to the text portion as the evaluation standard corresponding description portion.
  • Line markers are color coded so that different colors are assigned to each corresponding "evaluation criterion".
  • a state in which three types of line markers MK (MK-1, MK-2, MK-3) having different colors are applied in the text portion is shown.
  • These three types of line markers MK (MK-1, MK-2, MK-3) are the three "evaluation criteria 1-1” and “evaluation criteria” in "question 1" selected in the evaluation reference area AR12. Corresponds to "1-2" and "evaluation criteria 1-3" respectively.
  • highlighting may be performed by, for example, surrounding the description portion corresponding to the evaluation criteria with a frame line or underlining.
  • Lecturer I can evaluate the report while checking the highlighted description of the evaluation criteria by appropriately selecting the radio button RB for each of the "question” or "evaluation criteria” columns.
  • the learning support device 200 determines that the evaluation standard applicable description part extracted in step S104 is incorrect in evaluating the report, the instructor I cancels the evaluation standard applicable description part or adds another evaluation standard applicable description part. It is possible to make corrections such as associating the evaluation criteria of. That is, the instructor I can perform an operation of correcting the evaluation result. Then, the instructor I can make a final score while referring to the result scored by the learning support device 200 in step S105, for example.
  • Instructor I gives a score of one of two stages, "1" and "0", depending on the correctness, for example, when the scoring for each evaluation standard in step S105 is given. For example, points may be given in multiple stages.
  • the report screen may also show the result scored by the learning support device 200 in step S105 so that the instructor I can immediately refer to the result scored by the learning support device 200 in step S105.
  • the scoring result corresponding to the evaluation standard, the scoring result corresponding to the question unit, the scoring result obtained by integrating the scoring results of all the evaluation criteria, and the like may be presented.
  • the instructor I can make corrections to the report screen displayed on the instructor terminal device 300.
  • the instructor terminal device 300 transmits information (change information) indicating the content changed by the modification to the learning support device 200 in response to the operation of modifying the report screen.
  • the evaluation unit 221 updates the corresponding report screen information stored in the evaluation result information storage unit 234 so that the content indicated by the transmitted change information is reflected.
  • Such updating of the report screen by the evaluation unit 221 is one aspect of modifying the evaluation result according to the operation.
  • Step S109 the instructor I can evaluate the report by displaying the report screen on the instructor terminal device 300.
  • the instructor I causes the instructor terminal device 300 to transmit information (instructor evaluation information) indicating the result of evaluation of the report to the learning support device 200.
  • the instructor evaluation information includes the result of instructor I scoring the report.
  • the instructor evaluation information may include a comment for the user U who created the report by the instructor I.
  • the learning support device 200 reflects the content of the instructor evaluation information transmitted from the instructor terminal device 300 in the evaluation result information stored in the evaluation result information storage unit 234.
  • the evaluation result information includes, for example, a scoring result by the instructor I, a comment created by the instructor I for the user U who is the report submitter, and the like.
  • Step S110 The evaluation unit 221 generates a feedback comment.
  • the feedback comment is a comment on the evaluation of the report to the user U who submitted the report to be evaluated.
  • the feedback comment may include, for example, a general comment on the report, an indication of the user U's thinking tendency and strengths, weak points, etc., and content that proposes future issues, goals, and the like.
  • the evaluation unit 221 may generate a feedback comment as follows.
  • a plurality of feedback comment modules are stored in advance in the feedback comment storage unit 235 of the storage unit 203.
  • the feedback comment module is associated with the categories set for the range of points for each evaluation criterion.
  • the feedback comment module associated with the division of the score range in which the score scored based on a certain evaluation standard is higher than a certain level can make the user U aware of the matters related to the evaluation standard. It has content that includes comments that guide the user to gain further awareness of matters related to the evaluation criteria after evaluating what is being done.
  • the evaluation unit 221 acquires a module of the feedback comment corresponding to each scoring result obtained in step S105 corresponding to each evaluation standard from the storage unit 203.
  • the evaluation unit 221 generates a feedback comment by integrating the acquired feedback comment modules into one sentence.
  • the feedback comment may include a report (scoring report) that emphasizes the description portion related to the evaluation criteria extracted in step S104.
  • a report scoring report
  • the description part related to the evaluation criteria is emphasized in the scoring report
  • a marker may be attached to the corresponding description part.
  • the color of the marker may be changed according to the score given by scoring the description portion to be emphasized.
  • the color of the marker attached to the description part can immediately grasp how accurate the description content in the description part is as an answer to the question.
  • the evaluation unit 221 may use a learning model in generating the feedback comment in step S106.
  • the evaluation unit 221 inputs the score scored for each evaluation standard into the learning model, so that the learning model identifies the corresponding feedback comment module and identifies the specified feedback comment module.
  • the process of integrating and generating feedback comments may be executed.
  • Such a learning model can be used with the learning device to identify a particular feedback comment module, for example, in correspondence with the correspondence between the evaluation criteria and the scores under the evaluation criteria. It is constructed by inputting a data set in combination with points as learning data and training it.
  • the learning model may be constructed so as to generate a sentence as a feedback comment according to the input of the score scored corresponding to each evaluation standard. In this case, it is not necessary to store the feedback comment module in the storage unit 203.
  • Step S111 The evaluation result output unit 223 transmits (outputs) the evaluation result information to the user terminal device 100 of the user U who submits the report. At this time, the evaluation result output unit 223 reads out the evaluation result information corresponding to the report targeted for this evaluation from the evaluation result information included in the evaluation result information storage unit 234, and transmits the read evaluation result information. do.
  • the evaluation result information transmitted in this way includes the scoring result for the report and the feedback comment generated in step S110.
  • the evaluation result information may be output to the instructor terminal device 300 in response to a request from the instructor terminal device 300, for example. Further, for example, when the instructor I can use the learning support device 200, the evaluation result output unit 223 outputs the evaluation result by a display unit (not shown) or a printer provided in the learning support device 200. May be done.
  • the learning support device 200 simply scores in step S105, and finally the instructor I scores and evaluates in more detail.
  • the evaluation unit 221 of the learning support device 200 performs scoring and evaluation as detailed as that performed by the instructor I in step S105, so that the evaluation result by the learning support device 200 without the evaluation by the instructor I intervenes. Information may be output.
  • the learning model used for the processing of steps S104, S105, S110, etc. includes, for example, Support Vector Machine, LSTM (Long Short-Term Memory) with attention introduced, or BERT (Bidirectional Encoder Representations from Transformers).
  • LSTM Long Short-Term Memory
  • BERT Bidirectional Encoder Representations from Transformers
  • a Transformer-based device or the like may be adopted.
  • the learning model used for the processing of steps S104, S105, S106 and the like is not limited to the LSTM having the above-mentioned attention introduced, and other algorithms may be adopted.
  • the function of the learning support device 200 of the present embodiment is, for example, distributed to a plurality of devices on a network, and the devices cooperate with each other to realize report scoring, feedback comment generation, and the like. You may be made to do so.
  • a program for realizing the functions of the user terminal device 100, the learning support device 200, the instructor terminal device 300, and the like described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is recorded in the computer system.
  • the above-mentioned user terminal device 100, learning support device 200, instructor terminal device 300, and the like may be processed by reading and executing the above-mentioned user terminal device 100, learning support device 200, and the like.
  • "loading and executing a program recorded on a recording medium into a computer system” includes installing the program in the computer system.
  • computer system as used herein includes hardware such as an OS and peripheral devices.
  • the "computer system” may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, and a dedicated line.
  • the "computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system.
  • the recording medium in which the program is stored may be a non-transient recording medium such as a CD-ROM.
  • the recording medium also includes an internal or external recording medium that can be accessed from the distribution server to distribute the program.
  • the code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format that can be executed by the terminal device. That is, the format stored in the distribution server does not matter as long as it can be downloaded from the distribution server and installed in a form that can be executed by the terminal device.
  • the program may be divided into a plurality of parts, downloaded at different timings, and then combined by the terminal device, or the distribution server for distributing each of the divided programs may be different.
  • a "computer-readable recording medium” is a volatile memory (RAM) inside a computer system that serves as a server or client when a program is transmitted via a network, and holds the program for a certain period of time. It shall also include things.
  • the above program may be for realizing a part of the above-mentioned functions. Further, it may be a so-called difference file (difference program) that can realize the above-mentioned function in combination with a program already recorded in the computer system.
  • difference file difference program
  • 100 user terminal device 200 learning support device, 201 communication unit, 202 control unit, 203 storage unit, 221 evaluation unit, 222 screen information generation unit, 223 evaluation result output unit, 231 user information storage unit, 232 submission report storage unit, 233 Evaluation use information storage unit, 234 Evaluation result information storage unit, 235 Feedback comment storage unit, 300 Instructor terminal device

Landscapes

  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Engineering & Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Educational Administration (AREA)
  • Marketing (AREA)
  • Educational Technology (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The purpose of the present invention is to accurately evaluate a text having a sentence format. Provided is a report evaluation device comprising an evaluation unit that evaluates a report using a result of extracting description portions satisfying evaluation criteria from the report, which is described in a sentence format corresponding to a predetermined assignment, and a screen information generation unit for generating report-screen information corresponding to a report screen capable of providing a display in which at least the result of extracting the description portions by the evaluation unit can be reflected in the description content of the report.

Description

レポート評価装置、レポート評価方法、及びプログラムReport evaluation device, report evaluation method, and program
　本発明は、レポート評価装置、レポート評価方法、及びプログラムに関する。
　本願は、２０２０年３月４日に日本に出願された特願２０２０－０３７１０９号に基づき優先権を主張し、その内容をここに援用する。 The present invention relates to a report evaluation device, a report evaluation method, and a program.
The present application claims priority based on Japanese Patent Application No. 2020-037109 filed in Japan on March 4, 2020, the contents of which are incorporated herein by reference.
　ｅラーニング環境のもとでユーザの学習を支援する技術として、以下のような採点支援装置が知られている。つまり、採点支援装置は、記述式問題の答案のようなテキストを点数推定対象として入力し、入力された点数推定対象のテキストと予め設定された基準テキストとの類似度を算出する。また、採点支援装置は、点数付与済みの複数のテキストについて算出した類似度と、これら複数のテキストの各々に付与された点数との関係を決定する。採点支援装置は、点数推定対象のテキストについての類似度と、決定された関係とに基づいて点数推定対象のテキストの点数を決定する（例えば、特許文献１参照）。 The following scoring support devices are known as technologies that support user learning in an e-learning environment. That is, the scoring support device inputs a text such as an answer to a descriptive question as a score estimation target, and calculates the degree of similarity between the input text of the score estimation target and a preset reference text. Further, the scoring support device determines the relationship between the similarity calculated for the plurality of texts to which the score has been given and the score given to each of the plurality of texts. The scoring support device determines the score of the text to be scored based on the similarity of the text to be scored and the determined relationship (see, for example, Patent Document 1).
特開２０１７－１８８０３９号公報JP-A-2017-188039
　しかしながら、特許文献１の技術では、点数推定対象のテキストの採点は、基準テキストに対する全体的類似度に基づいていることから、例えば採点にあたって注目すべき事項に対応して的確な採点が行われているとはいえない。 However, in the technique of Patent Document 1, since the scoring of the text to be scored is based on the overall similarity to the reference text, for example, accurate scoring is performed according to the matters to be noted in scoring. It cannot be said that there is.
　このような状況に鑑みて、本願発明は、文章形式を有するテキストの評価を的確に行えるようにすることを目的とする。 In view of such a situation, an object of the present invention is to enable accurate evaluation of a text having a sentence format.
　上述した課題を解決するための本発明の一態様は、所定の課題に対応して文章形式で記述されたレポートから評価基準を満たしている記述部分を抽出した結果を利用して前記レポートの評価を行う評価部と、少なくとも前記評価部による前記記述部分の抽出結果を前記レポートの記述内容に反映させた表示が可能なレポート画面に対応するレポート画面情報を生成する画面情報生成部とを備えるレポート評価装置である。 One aspect of the present invention for solving the above-mentioned problems is to evaluate the report by using the result of extracting the description portion satisfying the evaluation criteria from the report described in the sentence format corresponding to the predetermined problem. A report including an evaluation unit that generates report screen information corresponding to a report screen that can be displayed by reflecting at least the extraction result of the description part by the evaluation unit in the description content of the report. It is an evaluation device.
　また、本発明の一態様は、所定の課題に対応して文章形式で記述されたレポートから評価基準を満たしている記述部分を抽出した結果を利用して前記レポートの評価を行う評価ステップと、少なくとも前記評価ステップによる前記記述部分の抽出結果を前記レポートの記述内容に反映させた表示が可能なレポート画面に対応するレポート画面情報を生成する画面情報生成ステップとを備えるレポート評価方法である。 Further, one aspect of the present invention includes an evaluation step of evaluating the report by using the result of extracting a description portion satisfying the evaluation criteria from the report described in a sentence format corresponding to a predetermined problem. It is a report evaluation method including at least a screen information generation step for generating report screen information corresponding to a report screen that can be displayed by reflecting the extraction result of the description portion by the evaluation step in the description content of the report.
　また、本発明の一態様は、コンピュータを、所定の課題に対応して文章形式で記述されたレポートから評価基準を満たしている記述部分を抽出した結果を利用して前記レポートの評価を行う評価部、少なくとも前記評価部による前記記述部分の抽出結果を前記レポートの記述内容に反映させた表示が可能なレポート画面に対応するレポート画面情報を生成する画面情報生成部として機能させるためのプログラムである。 Further, one aspect of the present invention is an evaluation in which a computer evaluates the report by using the result of extracting a description portion satisfying the evaluation criteria from the report described in a sentence format corresponding to a predetermined problem. This is a program for functioning as a screen information generation unit that generates report screen information corresponding to a report screen that can be displayed by reflecting the extraction result of the description part by at least the evaluation unit in the description content of the report. ..
　以上説明したように、本発明によれば、文章形式を有するテキストの評価が的確に行えるようになるという効果が得られる。 As described above, according to the present invention, it is possible to obtain an effect that the text having a sentence format can be accurately evaluated.
本実施形態の学習支援システムの全体的な構成例を示す図である。It is a figure which shows the overall configuration example of the learning support system of this embodiment. 本実施形態の学習支援装置の構成例を示す図である。It is a figure which shows the configuration example of the learning support apparatus of this embodiment. 本実施形態の評価利用情報の一例を示す図である。It is a figure which shows an example of the evaluation use information of this embodiment. 本実施形態の学習支援装置がレポートの評価に関連して実行する処理手順例を示すフローチャートである。It is a flowchart which shows the example of the processing procedure which the learning support apparatus of this embodiment executes in relation to the evaluation of a report. 本実施形態のレポート画面の一例を示す図である。It is a figure which shows an example of the report screen of this embodiment.
　図１は、本実施形態の学習支援システムの全体的な構成例を示している。本実施形態の学習支援システムは、ユーザＵが出題されたテーマに応じて提出したレポートの評価を行う。即ち、本実施形態におけるユーザＵは、ユーザ端末装置１００を用いてレポートを作成し、作成したレポートの評価を受ける者（学習者、レポート提出者）である。
　本実施形態の学習支援システムは、複数のユーザ端末装置１００と、学習支援装置２００（レポート評価装置の一例）と、講師端末装置３００とを含む。
　ユーザ端末装置１００は、ユーザＵのそれぞれが、学習を行うために利用する端末装置である。ユーザ端末装置１００は、例えばパーソナルコンピュータ、タブレット端末、スマートフォン等であってよい。 FIG. 1 shows an overall configuration example of the learning support system of the present embodiment. The learning support system of the present embodiment evaluates the report submitted by the user U according to the theme given. That is, the user U in the present embodiment is a person (learner, report submitter) who creates a report using the user terminal device 100 and receives an evaluation of the created report.
The learning support system of the present embodiment includes a plurality of user terminal devices 100, a learning support device 200 (an example of a report evaluation device), and an instructor terminal device 300.
The user terminal device 100 is a terminal device used by each user U for learning. The user terminal device 100 may be, for example, a personal computer, a tablet terminal, a smartphone, or the like.
　学習支援装置２００は、ユーザ端末装置１００のそれぞれとネットワークＮＴ経由で通信を行うことで、学習に対応する学習支援をユーザＵに対して行う装置である。つまり、学習支援装置２００は、ユーザ端末装置１００との通信により、学習講座をユーザＵに提供する。 The learning support device 200 is a device that provides the user U with learning support corresponding to learning by communicating with each of the user terminal devices 100 via the network NT. That is, the learning support device 200 provides the learning course to the user U by communicating with the user terminal device 100.
　本実施形態の学習支援装置２００が提供する講座におけるカリキュラムにはレポート提出が含まれる。つまり、ユーザＵに対してレポート作成のための或るテーマ（課題）が提示される。レポートのテーマは、例えばユーザＵが自分のユーザ端末装置１００を学習支援装置２００の学習講座のウェブサイトにログインさせて学習を行っている際に、学習の進行に応じて、表示された或るウェブページにて提示されてよい。
　ユーザＵは、提示されたテーマに沿ったレポートを作成し、作成したレポートを提出する。レポートは、例えばユーザがユーザ端末装置１００のワードプロセッサ機能を利用して文章を作成することによって行われてよい。
　ユーザは、作成したレポートのファイルを、学習支援装置２００を送信先としてユーザ端末装置１００により送信させることでレポートを提出する。 The curriculum in the course provided by the learning support device 200 of the present embodiment includes report submission. That is, a certain theme (problem) for creating a report is presented to the user U. The theme of the report is, for example, when the user U logs his / her user terminal device 100 into the website of the learning course of the learning support device 200 to perform learning, and is displayed according to the progress of learning. It may be presented on the web page.
User U creates a report according to the presented theme and submits the created report. The report may be performed, for example, by the user creating a sentence by using the word processor function of the user terminal device 100.
The user submits the report by having the user terminal device 100 transmit the created report file to the learning support device 200 as the transmission destination.
　学習支援装置２００は、送信されたレポートについて評価し、評価結果を示す評価結果情報を、ユーザ端末装置１００に送信することができる。 The learning support device 200 can evaluate the transmitted report and transmit the evaluation result information indicating the evaluation result to the user terminal device 100.
　また、講師端末装置３００は、講師Ｉが利用する端末装置である。講師端末装置３００は、例えばパーソナルコンピュータ、タブレット端末、スマートフォン等であってよい。
　本実施形態としては、学習支援装置２００により行われたレポートについての評価結果をユーザＵに提供するようにしてもよい。しかしながら、本実施形態のもとでは、講師Ｉが講師端末装置３００により学習支援装置２００により行われたレポートについての評価結果を確認し、必要に応じて学習支援装置２００による評価結果について修正を行い、講師Ｉが最終的な評価を行うようにされる。この場合、講師Ｉにとっては、レポートについてはじめから評価基準を満たす記述部分等を抽出する作業を行う必要が無く、上記のように学習支援装置２００による評価結果の確認により評価を行っていくことができるので、評価に係る作業を効率化できる。 Further, the instructor terminal device 300 is a terminal device used by the instructor I. The instructor terminal device 300 may be, for example, a personal computer, a tablet terminal, a smartphone, or the like.
In this embodiment, the evaluation result of the report made by the learning support device 200 may be provided to the user U. However, under the present embodiment, the instructor I confirms the evaluation result of the report made by the learning support device 200 by the instructor terminal device 300, and corrects the evaluation result by the learning support device 200 as necessary. , Lecturer I will be made to make the final evaluation. In this case, it is not necessary for the instructor I to extract the description part and the like that satisfy the evaluation criteria from the beginning of the report, and the evaluation can be performed by confirming the evaluation result by the learning support device 200 as described above. Therefore, the work related to the evaluation can be made more efficient.
　図２は、学習支援装置２００の構成例を示している。同図の学習支援装置２００は、通信部２０１、制御部２０２、及び記憶部２０３を備える。
　通信部２０１は、ネットワークＮＴ経由で通信を実行する。 FIG. 2 shows a configuration example of the learning support device 200. The learning support device 200 shown in the figure includes a communication unit 201, a control unit 202, and a storage unit 203.
The communication unit 201 executes communication via the network NT.
　制御部２０２は、学習支援装置２００における各種の制御を実行する。制御部２０２としての機能は、学習支援装置２００が備えるＣＰＵ（Central Processing Unit）がプログラムを実行することにより実現される。制御部２０２は、評価部２２１、画面情報生成部２２２、及び評価結果出力部２２３を備える。
　評価部２２１は、所定の課題に対応して文章形式で記述されたレポートから評価基準を満たしている記述部分を抽出した結果を利用してレポートの評価を行う。
　画面情報生成部２２２は、少なくとも評価部２２１による記述部分の抽出結果をレポートの記述内容に反映させた表示が可能なレポート画面に対応するレポート画面情報を生成する。
　評価結果出力部２２３は、評価部２２１による評価結果が反映されたレポート提出者向けの評価結果情報を出力する。 The control unit 202 executes various controls in the learning support device 200. The function as the control unit 202 is realized by executing a program by a CPU (Central Processing Unit) included in the learning support device 200. The control unit 202 includes an evaluation unit 221, a screen information generation unit 222, and an evaluation result output unit 223.
The evaluation unit 221 evaluates the report by using the result of extracting the description portion satisfying the evaluation criteria from the report described in the sentence format corresponding to the predetermined task.
The screen information generation unit 222 generates report screen information corresponding to a report screen that can be displayed by reflecting at least the extraction result of the description portion by the evaluation unit 221 in the description content of the report.
The evaluation result output unit 223 outputs the evaluation result information for the report submitter in which the evaluation result by the evaluation unit 221 is reflected.
　記憶部２０３は、学習支援装置２００に関連する各種の情報を記憶する。記憶部２０３は、ユーザ情報記憶部２３１、提出レポート記憶部２３２、評価利用情報記憶部２３３、評価結果情報記憶部２３４、及びフィードバックコメント記憶部２３５を備える。
　ユーザ情報記憶部２３１は、学習支援装置２００が提供する学習講座を受ける学習者としてのユーザごとの情報を記憶する。
　提出レポート記憶部２３２は、ユーザＵから提出されたレポートを記憶する。つまり、提出レポート記憶部２３２は、ユーザ端末装置１００から送信されたレポートを記憶する。提出レポート記憶部２３２に記憶されたレポートが評価対象となる。
　評価利用情報記憶部２３３は、レポートの評価のために評価部２２１が利用する情報を記憶する。
　評価結果情報記憶部２３４は、提出されたレポートごとに評価部２２１が評価した結果を示す評価結果情報を記憶する。
　フィードバックコメント記憶部２３５は、フィードバックコメントを記憶する。フィードバックコメントについては後述する。 The storage unit 203 stores various information related to the learning support device 200. The storage unit 203 includes a user information storage unit 231, a submission report storage unit 232, an evaluation utilization information storage unit 233, an evaluation result information storage unit 234, and a feedback comment storage unit 235.
The user information storage unit 231 stores information for each user as a learner who receives a learning course provided by the learning support device 200.
The submission report storage unit 232 stores the report submitted by the user U. That is, the submission report storage unit 232 stores the report transmitted from the user terminal device 100. The report stored in the submitted report storage unit 232 is evaluated.
The evaluation utilization information storage unit 233 stores the information used by the evaluation unit 221 for the evaluation of the report.
The evaluation result information storage unit 234 stores evaluation result information indicating the evaluation result of the evaluation unit 221 for each submitted report.
The feedback comment storage unit 235 stores the feedback comment. Feedback comments will be described later.
　図３は、評価利用情報記憶部２３３が記憶する評価利用情報の一例を示している。同図の評価利用情報は、１のテーマごとに対応して、テーマＩＤ、テーマ内容、設問、及び評価基準の領域を含む。
　テーマＩＤの領域は、対応のテーマに付与された識別子であるテーマＩＤを含む。
　テーマ内容の領域は、対応のテーマの内容（テーマ内容）を格納する。
　設問の領域は、設問を格納する。本実施形態においては、１のテーマに対応して１以上の設問が設けられる。設問の領域は、具体的に、テーマに対応して設けられた設問内容を示す情報が格納される。設問は、例えばレポートの提出者であるユーザＵに向けて、テーマとともに提示される。ユーザは、提示されたテーマのもとで、同じく提示された設問に対する解答を含めるようにしてレポートを作成する。
　評価基準の領域は、評価基準を格納する。１つの設問には１以上の評価基準が設けられる。評価基準の領域は、具体的に、該当の設問について定められた評価基準の内容を示す情報が格納される。
　同図においてテーマＩＤ「Ｔ０００１」が付与されたテーマを例に挙げると、テーマ内容の領域に格納されるデータ「０００１．ｔｈｍ」によりテーマ内容が示される。そのうえで、データ「０００１．ｔｈｍ」が示すテーマ内容に対応して、３つの設問「００１１．ｓｅｔ」、「００１２．ｓｅｔ」、「００１３．ｓｅｔ」が設けられる。設問「００１１．ｓｅｔ」には２つの評価基準「０００１．ｋｉｚ」、「０００２．ｋｉｚ」が設けられ、設問「０００２．ｓｅｔ」には１つの評価基準「０００３．ｋｉｚ」が設けられ、設問「０００３．ｓｅｔ」には１つの評価基準「０００４．ｋｉｚ」が設けられる。 FIG. 3 shows an example of evaluation utilization information stored in the evaluation utilization information storage unit 233. The evaluation usage information in the figure includes the theme ID, the theme content, the question, and the area of the evaluation standard corresponding to each theme.
The theme ID area includes the theme ID, which is an identifier assigned to the corresponding theme.
The theme content area stores the content of the corresponding theme (theme content).
The question area stores the questions. In this embodiment, one or more questions are provided corresponding to one theme. The question area specifically stores information indicating the content of the question provided according to the theme. The questions are presented with the theme, for example, to user U, who is the submitter of the report. The user creates a report under the presented theme, including the answers to the similarly presented questions.
The evaluation criteria area stores the evaluation criteria. One or more evaluation criteria are set for one question. The evaluation standard area specifically stores information indicating the contents of the evaluation standard defined for the relevant question.
Taking the theme to which the theme ID "T0001" is assigned in the figure as an example, the theme content is indicated by the data "0001.thm" stored in the theme content area. Then, three questions "0011.set", "0012.set", and "0013.set" are provided corresponding to the theme contents indicated by the data "0001.thm". The question "0011.set" is provided with two evaluation criteria "0001.kiz" and "0002.kiz", and the question "0002.set" is provided with one evaluation standard "0003.kiz". One evaluation standard "0004. Kiz" is provided in "0003. Set".
　図４のフローチャートを参照して、本実施形態の学習支援装置２００がレポートの評価に関連して実行する処理手順例について説明する。
　ステップＳ１０１：学習支援装置２００において評価部２２１は、評価対象のレポートを入力する。この際、評価部２２１は、評価対象のレポートを提出レポート記憶部２３２から読み出し、読み出したレポートを入力する。 An example of a processing procedure executed by the learning support device 200 of the present embodiment in connection with the evaluation of the report will be described with reference to the flowchart of FIG.
Step S101: In the learning support device 200, the evaluation unit 221 inputs a report to be evaluated. At this time, the evaluation unit 221 reads the report to be evaluated from the submission report storage unit 232 and inputs the read report.
　ステップＳ１０２：本実施形態において、提出レポート記憶部２３２が記憶するレポートは、例えばユーザ端末装置１００から送信された際のままの形式である。ユーザ端末装置１００から送信された際のままの形式では評価に適さない場合がある。例えば、ユーザ端末装置１００から送信された際のままの形式では、自然言語処理に適さないといった例を挙げることができる。そこで、評価部２２１は、ステップＳ１０１により入力した評価対象のレポートを、評価に適した所定の形式に変換する。 Step S102: In the present embodiment, the report stored in the submitted report storage unit 232 is in the same format as when it is transmitted from, for example, the user terminal device 100. The format as it is transmitted from the user terminal device 100 may not be suitable for evaluation. For example, the format as it is transmitted from the user terminal device 100 may not be suitable for natural language processing. Therefore, the evaluation unit 221 converts the evaluation target report input in step S101 into a predetermined format suitable for evaluation.
　ステップＳ１０３：評価部２２１は、評価対象のレポートのテーマに対応する評価基準を、評価利用情報記憶部２３３から入力する。 Step S103: The evaluation unit 221 inputs the evaluation criteria corresponding to the theme of the report to be evaluated from the evaluation utilization information storage unit 233.
　ステップＳ１０４：レポートは、自然言語を用いて記述されたテキストである。そこで、評価部２２１は、評価対象のレポートから、ステップＳ１０３により入力した評価基準を満たしている記述部分（評価基準該当記述部分）を抽出する。
　この際、評価部は、自然言語処理を用いてレポートの記述内容を解析する。一例として、評価部２２１は、レポートの解析として、テキストにより示されるレポートの文字列について、形態素解析により単語に分割し、単語ごとに分散表現を行ってよい。また、評価部２２１は、レポートの分析として、レポートが示す文字列について構文解析、意味解析等、文脈解析を行ってよい。また、評価部２２１は、上記のようにして得られた単語ごとの分散表現、各種解析の結果から、レポートの内容、文字数、使用する語彙等の適切さ（例えば、わかりやすさ）等の事項を導出してよい。
　評価部２２１は、上記のようにしてレポートの記述内容の解析を行い、レポートの記述全体から、各評価基準が要求する条件を満たしている記述部分を特定し、特定された記述部分を評価基準該当記述部分として抽出する。 Step S104: The report is text written in natural language. Therefore, the evaluation unit 221 extracts a description portion (evaluation criterion corresponding description portion) that satisfies the evaluation criteria input in step S103 from the report to be evaluated.
At this time, the evaluation unit analyzes the description contents of the report using natural language processing. As an example, as an analysis of the report, the evaluation unit 221 may divide the character string of the report indicated by the text into words by morphological analysis and perform distributed expression for each word. Further, as the analysis of the report, the evaluation unit 221 may perform context analysis such as syntactic analysis and semantic analysis on the character string indicated by the report. In addition, the evaluation unit 221 derives items such as the content of the report, the number of characters, the appropriateness of the vocabulary to be used (for example, easy-to-understand), etc. from the distributed expression for each word obtained as described above and the results of various analyzes. You can do it.
The evaluation unit 221 analyzes the description contents of the report as described above, identifies the description part that satisfies the conditions required by each evaluation standard from the entire description of the report, and evaluates the specified description part as the evaluation standard. Extract as the relevant description part.
　評価部２２１は、当該ステップＳ１０４による評価基準に関連する記述部分の抽出にあたり、学習モデルを用いてよい。評価基準は、例えばレポートにおいて「○○○に言及していること」といったように、或る特定事項に言及しているか否かを判断する内容を有する。このような評価基準に対応して関連の記述部分を抽出する学習モデルは、学習器に、多数の評価基準において示される事項を示す文章（短文であっても複文であってもよい）、文節、単語等によるデータセットを学習データとして入力して学習させることにより構築できる。 The evaluation unit 221 may use a learning model in extracting the description portion related to the evaluation criteria in step S104. The evaluation criteria have the content of determining whether or not a specific item is mentioned, for example, "referring to XX" in the report. A learning model that extracts related description parts corresponding to such evaluation criteria is a sentence (which may be a short sentence or a compound sentence) and a phrase indicating items shown in a large number of evaluation criteria in a learning device. , Words, etc. can be constructed by inputting and learning a data set as learning data.
　ステップＳ１０５：評価部２２１は、評価として、評価対象のレポートについての採点を行う。ここでの採点として、評価部２２１は、例えば、ステップＳ１０４により記述部分が抽出された評価基準については所定の点数を付与し、記述部分が抽出されなかった評価基準については点数を付与しない、というようにして採点を行ってよい。記述部分が抽出されたということは、レポートにおいて評価基準が求める内容が記述されていたということであり、記述部分が抽出されなかったということは、レポートにおいて評価基準が求める内容が記述されていなかったということである。
　評価部２２１は、当該ステップＳ１０５による採点結果を、評価対象のレポートに対応する評価結果情報に含めるようにして評価結果情報記憶部２３４に記憶させてよい。 Step S105: The evaluation unit 221 scores the report to be evaluated as an evaluation. As a scoring here, for example, the evaluation unit 221 gives a predetermined score to the evaluation criteria from which the description portion is extracted in step S104, and does not give a score to the evaluation criteria from which the description portion is not extracted. The scoring may be done in this way. The fact that the description part was extracted means that the content required by the evaluation criteria was described in the report, and the fact that the description part was not extracted means that the content required by the evaluation criteria was not described in the report. That is to say.
The evaluation unit 221 may store the scoring result in step S105 in the evaluation result information storage unit 234 so as to be included in the evaluation result information corresponding to the report to be evaluated.
　ステップＳ１０６：画面情報生成部２２２は、レポート画面情報を生成する。レポート画面情報は、レポート画面の表示に用いられる情報である。レポート画面は、評価部２２１により行われた記述部分の抽出結果をレポートの記述内容に反映させた表示が行われる画面である。
　レポート画面情報は、例えばＨＴＭＬ形式等のマークアップ言語により記述されたファイルであってよい。このような形式のレポート画面情報は、例えばウェブブラウザにより開くことでレポート画面を表示することができる。
　評価部２２１は、生成されたレポート画面情報を記憶部２０３に記憶させる。この際、評価部２２１は、評価対象のレポートに対応する評価結果情報に含めるようにして評価結果情報記憶部２３４に記憶させてよい。 Step S106: The screen information generation unit 222 generates report screen information. The report screen information is information used for displaying the report screen. The report screen is a screen in which the extraction result of the description portion performed by the evaluation unit 221 is reflected in the description content of the report.
The report screen information may be a file described in a markup language such as HTML format. The report screen information in this format can be displayed by opening it with a web browser, for example.
The evaluation unit 221 stores the generated report screen information in the storage unit 203. At this time, the evaluation unit 221 may store the evaluation result information storage unit 234 so as to include it in the evaluation result information corresponding to the report to be evaluated.
　ステップＳ１０７：ステップＳ１０６により生成され、記憶部２０３に記憶されたレポート画面情報は、講師Ｉがレポートの評価を行うにあたり、学習支援装置２００による評価結果を参考とするのに利用される。このために、講師Ｉは、講師端末装置３００を学習支援装置２００にアクセスさせ、評価対象のレポートのレポート画面を講師端末装置３００に表示させる。この際、講師端末装置３００の評価結果出力部２２３は、講師端末装置３００により指定されたレポートのレポート画面情報を、講師端末装置３００に出力（送信）する。講師端末装置３００は、自己が備えるウェブブラウザ機能によって、送信されたレポート画面情報を利用してレポート画面を表示する。
　なお、このように講師Ｉが、評価対象のレポートのレポート画面を講師端末装置３００に表示させることは、レポート画面情報が記憶部２０３に記憶された後において、任意の機会で行われてよい。あるいは、予め定められた講師Ｉのレポート評価スケジュールに従って、所定の日時に到来したことに応じて、学習支援装置２００の制御によって、評価対象のレポートのレポート画面を表示させるようにしてよい。 Step S107: The report screen information generated in step S106 and stored in the storage unit 203 is used by the instructor I to refer to the evaluation result by the learning support device 200 when evaluating the report. For this purpose, the instructor I makes the instructor terminal device 300 access the learning support device 200, and causes the instructor terminal device 300 to display the report screen of the report to be evaluated. At this time, the evaluation result output unit 223 of the instructor terminal device 300 outputs (transmits) the report screen information of the report designated by the instructor terminal device 300 to the instructor terminal device 300. The instructor terminal device 300 displays a report screen by using the transmitted report screen information by its own web browser function.
It should be noted that the instructor I may display the report screen of the report to be evaluated on the instructor terminal device 300 at any time after the report screen information is stored in the storage unit 203. Alternatively, the report screen of the report to be evaluated may be displayed under the control of the learning support device 200 according to the arrival at a predetermined date and time according to the report evaluation schedule of the instructor I determined in advance.
　図５は、講師端末装置３００にて表示されたレポート画面の態様例を示している。レポート画面においては、右側のレポート領域ＡＲ１１と左側の評価基準領域ＡＲ１２とが含まれる。 FIG. 5 shows an example of the mode of the report screen displayed on the instructor terminal device 300. On the report screen, the report area AR11 on the right side and the evaluation reference area AR12 on the left side are included.
　レポート領域ＡＲ１１は、提示されたテーマに応じてユーザＵが作成したレポートの記述内容が表示される領域である。 The report area AR11 is an area in which the description contents of the report created by the user U according to the presented theme are displayed.
　評価基準領域ＡＲ１２は、レポート領域ＡＲ１１にて表示されたレポートに対応する評価基準が示される領域である。評価基準領域ＡＲ１２においては、まず、「デフォルト」の欄が配置されている。
　また、「デフォルト」の欄に続けて、「設問」の欄と、設問のもとで設けられた「評価基準」の欄ごとに、設問あるいは評価基準の内容が示される。
　具体的に、同図の評価基準領域ＡＲ１２おいては、「設問１」の欄において、当該「設問１」の内容が示され、「設問１」のもとで設けられた３つの「評価基準１－１」、「評価基準１－２」、「評価基準１－３」の欄ごとに、対応の評価基準の内容が示される。続いて、「設問２」の欄において、当該「設問２」の内容が示され、「設問２」のもとで設けられた２つの「評価基準２－１」、「評価基準２－２」の欄ごとに、対応の評価基準内容が示される。以下、同様に、「設問３」の欄において、当該「設問３」の内容が示され、「設問３」のもとで設けられた所定数の評価基準３－１・・・の欄ごとに、対応の評価基準の内容が示される。 The evaluation reference area AR12 is an area in which the evaluation criteria corresponding to the report displayed in the report area AR11 are shown. In the evaluation reference area AR12, first, a “default” column is arranged.
In addition, following the "default" column, the content of the question or evaluation standard is shown for each of the "question" column and the "evaluation standard" column provided under the question.
Specifically, in the evaluation standard area AR12 in the figure, the content of the "question 1" is shown in the column of "question 1", and the three "evaluation criteria" provided under "question 1" are shown. The contents of the corresponding evaluation criteria are shown for each of the columns of "1-1", "evaluation criteria 1-2", and "evaluation criteria 1-3". Next, in the "Question 2" column, the content of the "Question 2" is shown, and the two "Evaluation Criteria 2-1" and "Evaluation Criteria 2-2" provided under "Question 2" are shown. The contents of the corresponding evaluation criteria are shown for each column. Hereinafter, similarly, in the column of "Question 3", the content of the "Question 3" is shown, and for each column of the predetermined number of evaluation criteria 3-1 ... provided under "Question 3". , The contents of the corresponding evaluation criteria are shown.
　評価基準領域ＡＲ１２においては、「デフォルト」の欄、「設問」の欄、「評価基準」の欄ごとにラジオボタンＲＢが配置されている。ラジオボタンＲＢは、レポート領域ＡＲ１１にて表示されるレポートの記述において、対応の欄に関連する記述部分を強調表示する操作に用いられる。
　「デフォルト」の欄のラジオボタンＲＢが選択された状態では、レポート領域ＡＲ１１にて表示されるレポートの記述における強調表示は行われない。なお、評価基準領域ＡＲ１２において「デフォルト」の欄が省略されてよい。
　「設問」（「設問１」、「設問２」、「設問３」）の欄のラジオボタンＲＢが選択された状態では、レポート領域ＡＲ１１におけるレポートの記述のうち、対応の「設問」のもとで設けられた全ての「評価基準」ごとに対応する評価基準該当記述部分を強調表示することが行われる。具体的に、「設問１」の欄のラジオボタンＲＢが選択された状態では、レポート領域ＡＲ１１におけるレポートの記述のうち、「設問１」のもとで設けられた３つの「評価基準１－１」、「評価基準１－２」、「評価基準１－３」のそれぞれに対応する評価基準該当記述部分が強調表示される。
　「評価基準」の欄のラジオボタンＲＢが選択された状態では、レポート領域ＡＲ１１におけるレポートの記述のうち、対応の「評価基準」に対応する評価基準該当記述部分を強調表示することが行われる。例えば、「評価基準１－１」の欄のラジオボタンＲＢが選択された状態では、レポート領域ＡＲ１１におけるレポートの記述のうち、「評価基準１－１」に対応する評価基準該当記述部分が強調表示される。 In the evaluation standard area AR12, radio buttons RB are arranged in each of the “default” column, the “question” column, and the “evaluation standard” column. The radio button RB is used for highlighting the description portion related to the corresponding column in the description of the report displayed in the report area AR11.
When the radio button RB in the "default" column is selected, the report description displayed in the report area AR11 is not highlighted. The "default" column may be omitted in the evaluation reference area AR12.
When the radio button RB in the "Question"("Question1","Question2","Question3") column is selected, the report description in the report area AR11 is based on the corresponding "Question". The corresponding description of the evaluation criteria is highlighted for each of the "evaluation criteria" provided in. Specifically, when the radio button RB in the "Question 1" column is selected, the three "evaluation criteria 1-1" provided under "Question 1" in the report description in the report area AR11. , "Evaluation Criteria 1-2", and "Evaluation Criteria 1-3" are highlighted.
When the radio button RB in the "evaluation criteria" column is selected, the evaluation criteria corresponding description portion corresponding to the corresponding "evaluation criteria" is highlighted in the report description in the report area AR11. For example, when the radio button RB in the "evaluation criterion 1-1" column is selected, the evaluation criterion corresponding description portion corresponding to "evaluation criterion 1-1" is highlighted in the report description in the report area AR11. Will be done.
　レポート領域ＡＲ１１における強調表示は、評価基準該当記述部分としてのテキスト部分に対してラインマーカを施すことによって行われる。ラインマーカは、対応の「評価基準」ごとに異なる色が割り当てられるようにして色分けされる。同図においては、それぞれ色の異なる３種のラインマーカＭＫ（ＭＫ－１、ＭＫ－２、ＭＫ－３）がテキスト部分において施された状態が示されている。これらの３種のラインマーカＭＫ（ＭＫ－１、ＭＫ－２、ＭＫ－３）は、評価基準領域ＡＲ１２において選択されている「設問１」における３つの「評価基準１－１」、「評価基準１－２」、「評価基準１－３」にそれぞれ対応する。
　なお、ラインマーカＭＫ以外に、例えば評価基準該当記述部分を枠線で囲ったり、アンダーラインを引いたりすることによって、強調表示が行われてよい。 The highlighting in the report area AR11 is performed by applying a line marker to the text portion as the evaluation standard corresponding description portion. Line markers are color coded so that different colors are assigned to each corresponding "evaluation criterion". In the figure, a state in which three types of line markers MK (MK-1, MK-2, MK-3) having different colors are applied in the text portion is shown. These three types of line markers MK (MK-1, MK-2, MK-3) are the three "evaluation criteria 1-1" and "evaluation criteria" in "question 1" selected in the evaluation reference area AR12. Corresponds to "1-2" and "evaluation criteria 1-3" respectively.
In addition to the line marker MK, highlighting may be performed by, for example, surrounding the description portion corresponding to the evaluation criteria with a frame line or underlining.
　講師Ｉは、「設問」あるいは「評価基準」の欄ごとに適宜、ラジオボタンＲＢを選択する操作を行って強調表示された評価基準該当記述部分を確認しながら、レポートを評価することができる。講師Ｉは、レポートの評価にあたり、学習支援装置２００がステップＳ１０４により抽出された評価基準該当記述部分が誤っていると判断したときには、評価基準該当記述部分を取り消したり、評価基準該当記述部分に他の評価基準を対応付けるなどの修正を行うことができる。即ち、講師Ｉは、評価結果を修正する操作を行うことができる。そして、講師Ｉは、例えばステップＳ１０５により学習支援装置２００が採点した結果も参考にしながら、最終的な採点を行うことができる。講師Ｉは、採点にあたり、例えばステップＳ１０５による評価基準ごとの採点が例えば正誤に応じて「１」、「０」の２段階のうちのいずれかの点数を付与するといったものである場合には、例えばさらに多段階のもとで点数を付与するようにされてよい。
　講師ＩがステップＳ１０５により学習支援装置２００が採点した結果をすぐに参照できるように、レポート画面には、ステップＳ１０５により学習支援装置２００が採点した結果も示されるようにしてよい。この場合において、レポート画面においては、評価基準に対応する採点結果、設問単位に対応する採点結果、全ての評価基準の採点結果を総合した採点結果等が提示されるようにしてよい。 Lecturer I can evaluate the report while checking the highlighted description of the evaluation criteria by appropriately selecting the radio button RB for each of the "question" or "evaluation criteria" columns. When the learning support device 200 determines that the evaluation standard applicable description part extracted in step S104 is incorrect in evaluating the report, the instructor I cancels the evaluation standard applicable description part or adds another evaluation standard applicable description part. It is possible to make corrections such as associating the evaluation criteria of. That is, the instructor I can perform an operation of correcting the evaluation result. Then, the instructor I can make a final score while referring to the result scored by the learning support device 200 in step S105, for example. Instructor I gives a score of one of two stages, "1" and "0", depending on the correctness, for example, when the scoring for each evaluation standard in step S105 is given. For example, points may be given in multiple stages.
The report screen may also show the result scored by the learning support device 200 in step S105 so that the instructor I can immediately refer to the result scored by the learning support device 200 in step S105. In this case, on the report screen, the scoring result corresponding to the evaluation standard, the scoring result corresponding to the question unit, the scoring result obtained by integrating the scoring results of all the evaluation criteria, and the like may be presented.
　説明を図４に戻す。
　ステップＳ１０８：上記のように、講師Ｉは、講師端末装置３００にて表示されたレポート画面に対して修正を行うことができる。講師端末装置３００は、レポート画面を修正する操作が行われたことに応じて、修正により変更された内容を示す情報（変更情報）を学習支援装置２００に送信する。学習支援装置２００において評価部２２１は、送信された変更情報が示す内容が反映されるように、評価結果情報記憶部２３４に記憶される対応のレポート画面情報を更新する。このような評価部２２１によるレポート画面の更新は、操作に応じた評価結果の修正の一態様である。 The explanation is returned to FIG.
Step S108: As described above, the instructor I can make corrections to the report screen displayed on the instructor terminal device 300. The instructor terminal device 300 transmits information (change information) indicating the content changed by the modification to the learning support device 200 in response to the operation of modifying the report screen. In the learning support device 200, the evaluation unit 221 updates the corresponding report screen information stored in the evaluation result information storage unit 234 so that the content indicated by the transmitted change information is reflected. Such updating of the report screen by the evaluation unit 221 is one aspect of modifying the evaluation result according to the operation.
　ステップＳ１０９：前述のように、講師Ｉは、講師端末装置３００によりレポート画面を表示させてレポートの評価を行うことができる。講師Ｉは、自分がレポートについて評価した結果を示す情報（講師評価情報）を、講師端末装置３００により学習支援装置２００に送信させる。講師評価情報には、講師Ｉがレポートについて採点した結果が含まれる。また、講師評価情報には、講師Ｉがレポートを作成したユーザＵに向けたコメントが含まれてよい。
　学習支援装置２００は、講師端末装置３００から送信された講師評価情報の内容を、評価結果情報記憶部２３４が記憶する評価結果情報に反映させる。講師評価情報が反映されることで、評価結果情報には、例えば講師Ｉによる採点結果、講師Ｉがレポート提出者であるユーザＵに向けて作成したコメントなどが含まれる。 Step S109: As described above, the instructor I can evaluate the report by displaying the report screen on the instructor terminal device 300. The instructor I causes the instructor terminal device 300 to transmit information (instructor evaluation information) indicating the result of evaluation of the report to the learning support device 200. The instructor evaluation information includes the result of instructor I scoring the report. In addition, the instructor evaluation information may include a comment for the user U who created the report by the instructor I.
The learning support device 200 reflects the content of the instructor evaluation information transmitted from the instructor terminal device 300 in the evaluation result information stored in the evaluation result information storage unit 234. By reflecting the instructor evaluation information, the evaluation result information includes, for example, a scoring result by the instructor I, a comment created by the instructor I for the user U who is the report submitter, and the like.
　ステップＳ１１０：評価部２２１は、フィードバックコメントを生成する。フィードバックコメントは、評価対象のレポートを提出したユーザＵに向けてレポートに関する評価についてコメントしたものである。フィードバックコメントには、例えば、レポートについての総評、ユーザＵの思考の傾向や得意、不得意な点等の指摘、今後の課題や目標等を提案した内容等が含まれてよい。 Step S110: The evaluation unit 221 generates a feedback comment. The feedback comment is a comment on the evaluation of the report to the user U who submitted the report to be evaluated. The feedback comment may include, for example, a general comment on the report, an indication of the user U's thinking tendency and strengths, weak points, etc., and content that proposes future issues, goals, and the like.
　具体的に、評価部２２１は以下のようにフィードバックコメントを生成してよい。
　記憶部２０３のフィードバックコメント記憶部２３５に、複数のフィードバックコメントのモジュールを予め記憶しておくようにする。フィードバックコメントのモジュールは、評価基準ごとにおける点数の範囲に対して設定した区分に対応付けられている。 Specifically, the evaluation unit 221 may generate a feedback comment as follows.
A plurality of feedback comment modules are stored in advance in the feedback comment storage unit 235 of the storage unit 203. The feedback comment module is associated with the categories set for the range of points for each evaluation criterion.
　例えば、或る１の評価基準に基づいて採点された点数が一定以上に高い点数範囲の区分に対応付けられたフィードバックコメントのモジュールは、ユーザＵに向けて、評価基準に関連する事項が意識できていることを評価したうえで、評価基準に関連する事項に関してさらに気付きが得られるようにユーザを導くようなコメントを含む内容を有する。
　一方、或る１の評価基準に基づいて採点された点数が一定未満である場合に対応するフィードバックコメントのモジュールは、つまり、ユーザＵに向けて、評価基準に関連する事項に対する意識が十分にできていないことを指摘したうえで、評価基準に関連する事項を意識できるようにするためには、今後どのようにすればよいのかをアドバイスするようなコメントを含む内容を有する。 For example, the feedback comment module associated with the division of the score range in which the score scored based on a certain evaluation standard is higher than a certain level can make the user U aware of the matters related to the evaluation standard. It has content that includes comments that guide the user to gain further awareness of matters related to the evaluation criteria after evaluating what is being done.
On the other hand, the feedback comment module corresponding to the case where the score scored based on a certain evaluation standard is less than a certain value, that is, the user U can be fully aware of the matters related to the evaluation standard. It should be pointed out that it has not been done, and the content should include comments that advise on what to do in the future so that the matters related to the evaluation criteria can be conscious.
　そして、評価部２２１は、評価基準ごとに対応してステップＳ１０５により得られた採点結果ごとに対応するフィードバックコメントのモジュールを記憶部２０３から取得する。評価部２２１は、取得されたフィードバックコメントのモジュールを統合して１つの文章として構成することで、フィードバックコメントを生成する。 Then, the evaluation unit 221 acquires a module of the feedback comment corresponding to each scoring result obtained in step S105 corresponding to each evaluation standard from the storage unit 203. The evaluation unit 221 generates a feedback comment by integrating the acquired feedback comment modules into one sentence.
　また、フィードバックコメントには、ステップＳ１０４により抽出された評価基準に関連する記述部分を強調して示したレポート（採点レポート）を含めてよい。採点レポートにおいて評価基準に関連する記述部分を強調して示す態様としては、例えば該当の記述部分にマーカを付すというものであってよい。また、この場合において、強調対象とされた記述部分について、採点により付された点数に応じてマーカの色を変更するようにされてよい。これにより、例えば講師やユーザが採点レポートを見た際に、記述部分に付されたマーカの色により、記述部分における記述内容が設問に対する解答としてどの程度的確であったのかを即座に把握できる。 In addition, the feedback comment may include a report (scoring report) that emphasizes the description portion related to the evaluation criteria extracted in step S104. As an embodiment in which the description part related to the evaluation criteria is emphasized in the scoring report, for example, a marker may be attached to the corresponding description part. Further, in this case, the color of the marker may be changed according to the score given by scoring the description portion to be emphasized. As a result, for example, when the instructor or the user looks at the scoring report, the color of the marker attached to the description part can immediately grasp how accurate the description content in the description part is as an answer to the question.
　評価部２２１は、当該ステップＳ１０６によるフィードバックコメントの生成にあたり、学習モデルを用いてよい。この場合には、評価部２２１が、評価基準ごとに対応して採点された点数を学習モデルに入力することで、学習モデルが該当のフィードバックコメントのモジュールを特定し、特定したフィードバックコメントのモジュールを統合してフィードバックコメントを生成させる処理を実行すればよい。このような学習モデルは、例えば評価基準と当該評価基準のもとでの点数との対応関係に対応させて、或る特定のフィードバックコメントのモジュールを特定できるように、学習器に、評価基準と点数との組み合わせによるデータセットを学習データとして入力し、学習させることによって構築される。
　なお、学習モデルについて、評価基準ごとに対応して採点された点数を入力させたことに応じて、フィードバックコメントとしての文章を生成させるように構築してもよい。この場合には、フィードバックコメントのモジュールを記憶部２０３に記憶させておく必要はない。 The evaluation unit 221 may use a learning model in generating the feedback comment in step S106. In this case, the evaluation unit 221 inputs the score scored for each evaluation standard into the learning model, so that the learning model identifies the corresponding feedback comment module and identifies the specified feedback comment module. The process of integrating and generating feedback comments may be executed. Such a learning model can be used with the learning device to identify a particular feedback comment module, for example, in correspondence with the correspondence between the evaluation criteria and the scores under the evaluation criteria. It is constructed by inputting a data set in combination with points as learning data and training it.
It should be noted that the learning model may be constructed so as to generate a sentence as a feedback comment according to the input of the score scored corresponding to each evaluation standard. In this case, it is not necessary to store the feedback comment module in the storage unit 203.
　ステップＳ１１１：評価結果出力部２２３は、評価結果情報をレポート提出元のユーザＵのユーザ端末装置１００に送信（出力）する。この際、評価結果出力部２２３は、評価結果情報記憶部２３４に含まれる評価結果情報のうちから、今回の評価対象とされたレポートに対応する評価結果情報を読み出し、読み出した評価結果情報を送信する。このように送信される評価結果情報には、レポートについての採点結果と、ステップＳ１１０により生成されたフィードバックコメントとが含まれる。
　また、評価結果情報は、例えば講師端末装置３００からの要求に応じて、講師端末装置３００にも出力するようにされてよい。また、例えば学習支援装置２００を講師Ｉが使用可能な場合には、評価結果出力部２２３は、学習支援装置２００に設けた表示部（図示せず）やプリンタなどにより評価結果を出力するようにされてよい。 Step S111: The evaluation result output unit 223 transmits (outputs) the evaluation result information to the user terminal device 100 of the user U who submits the report. At this time, the evaluation result output unit 223 reads out the evaluation result information corresponding to the report targeted for this evaluation from the evaluation result information included in the evaluation result information storage unit 234, and transmits the read evaluation result information. do. The evaluation result information transmitted in this way includes the scoring result for the report and the feedback comment generated in step S110.
Further, the evaluation result information may be output to the instructor terminal device 300 in response to a request from the instructor terminal device 300, for example. Further, for example, when the instructor I can use the learning support device 200, the evaluation result output unit 223 outputs the evaluation result by a display unit (not shown) or a printer provided in the learning support device 200. May be done.
　なお、これまでの説明では、ステップＳ１０５により学習支援装置２００が簡易に採点を行ったうえで、最終的には講師Ｉがより詳細な採点、評価を行うようにされている。しかしながら、例えば、学習支援装置２００の評価部２２１がステップＳ１０５により、講師Ｉが行うのと同程度に詳細な採点、評価を行うことで、講師Ｉによる評価が介在しない学習支援装置２００による評価結果情報が出力されるようにしてよい。 In the explanation so far, the learning support device 200 simply scores in step S105, and finally the instructor I scores and evaluates in more detail. However, for example, the evaluation unit 221 of the learning support device 200 performs scoring and evaluation as detailed as that performed by the instructor I in step S105, so that the evaluation result by the learning support device 200 without the evaluation by the instructor I intervenes. Information may be output.
　ステップＳ１０４、Ｓ１０５、Ｓ１１０等の処理に用いられる学習モデルには、例えば、Support Vector Machine、あるいは、アテンションを導入したＬＳＴＭ（Long Short-Term Memory）、あるいはＢＥＲＴ（Bidirectional Encoder Representations from Transformers）をはじめとするＴｒａｎｓｆｏｒｍｅｒベースのもの等が採用されてよい。なお、一例として、ステップＳ１０４、Ｓ１０５、Ｓ１０６等の処理に用いられる学習モデルは、上記のようなアテンションを導入したＬＳＴＭに限定されるものではなく、他のアルゴリズムが採用されてよい。 The learning model used for the processing of steps S104, S105, S110, etc. includes, for example, Support Vector Machine, LSTM (Long Short-Term Memory) with attention introduced, or BERT (Bidirectional Encoder Representations from Transformers). A Transformer-based device or the like may be adopted. As an example, the learning model used for the processing of steps S104, S105, S106 and the like is not limited to the LSTM having the above-mentioned attention introduced, and other algorithms may be adopted.
　なお、本実施形態の学習支援装置２００としての機能は、例えばネットワーク上で複数の装置に分散されたうえで、各装置が相互に連携することで、レポートの採点、フィードバックコメントの生成等を実現するようにされてもよい。 The function of the learning support device 200 of the present embodiment is, for example, distributed to a plurality of devices on a network, and the devices cooperate with each other to realize report scoring, feedback comment generation, and the like. You may be made to do so.
　なお、上述のユーザ端末装置１００、学習支援装置２００、講師端末装置３００等の機能を実現するためのプログラムをコンピュータ読み取り可能な記録媒体に記録して、この記録媒体に記録されたプログラムをコンピュータシステムに読み込ませ、実行することにより上述のユーザ端末装置１００、学習支援装置２００、講師端末装置３００等の処理を行ってもよい。ここで、「記録媒体に記録されたプログラムをコンピュータシステムに読み込ませ、実行する」とは、コンピュータシステムにプログラムをインストールすることを含む。ここでいう「コンピュータシステム」とは、ＯＳや周辺機器等のハードウェアを含むものとする。また、「コンピュータシステム」は、インターネットやＷＡＮ、ＬＡＮ、専用回線等の通信回線を含むネットワークを介して接続された複数のコンピュータ装置を含んでもよい。また、「コンピュータ読み取り可能な記録媒体」とは、フレキシブルディスク、光磁気ディスク、ＲＯＭ、ＣＤ－ＲＯＭ等の可搬媒体、コンピュータシステムに内蔵されるハードディスク等の記憶装置のことをいう。このように、プログラムを記憶した記録媒体は、ＣＤ－ＲＯＭ等の非一過性の記録媒体であってもよい。また、記録媒体には、当該プログラムを配信するために配信サーバからアクセス可能な内部または外部に設けられた記録媒体も含まれる。配信サーバの記録媒体に記憶されるプログラムのコードは、端末装置で実行可能な形式のプログラムのコードと異なるものでもよい。すなわち、配信サーバからダウンロードされて端末装置で実行可能な形でインストールができるものであれば、配信サーバで記憶される形式は問わない。なお、プログラムを複数に分割し、それぞれ異なるタイミングでダウンロードした後に端末装置で合体される構成や、分割されたプログラムのそれぞれを配信する配信サーバが異なっていてもよい。さらに「コンピュータ読み取り可能な記録媒体」とは、ネットワークを介してプログラムが送信された場合のサーバやクライアントとなるコンピュータシステム内部の揮発性メモリ（ＲＡＭ）のように、一定時間プログラムを保持しているものも含むものとする。また、上記プログラムは、上述した機能の一部を実現するためのものであってもよい。さらに、上述した機能をコンピュータシステムにすでに記録されているプログラムとの組み合わせで実現できるもの、いわゆる差分ファイル（差分プログラム）であってもよい。 A program for realizing the functions of the user terminal device 100, the learning support device 200, the instructor terminal device 300, and the like described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is recorded in the computer system. The above-mentioned user terminal device 100, learning support device 200, instructor terminal device 300, and the like may be processed by reading and executing the above-mentioned user terminal device 100, learning support device 200, and the like. Here, "loading and executing a program recorded on a recording medium into a computer system" includes installing the program in the computer system. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Further, the "computer system" may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, and a dedicated line. Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system. As described above, the recording medium in which the program is stored may be a non-transient recording medium such as a CD-ROM. The recording medium also includes an internal or external recording medium that can be accessed from the distribution server to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format that can be executed by the terminal device. That is, the format stored in the distribution server does not matter as long as it can be downloaded from the distribution server and installed in a form that can be executed by the terminal device. The program may be divided into a plurality of parts, downloaded at different timings, and then combined by the terminal device, or the distribution server for distributing each of the divided programs may be different. Furthermore, a "computer-readable recording medium" is a volatile memory (RAM) inside a computer system that serves as a server or client when a program is transmitted via a network, and holds the program for a certain period of time. It shall also include things. Further, the above program may be for realizing a part of the above-mentioned functions. Further, it may be a so-called difference file (difference program) that can realize the above-mentioned function in combination with a program already recorded in the computer system.
１００　ユーザ端末装置、２００　学習支援装置、２０１　通信部、２０２　制御部、２０３　記憶部、２２１　評価部、２２２　画面情報生成部、２２３　評価結果出力部、２３１　ユーザ情報記憶部、２３２　提出レポート記憶部、２３３　評価利用情報記憶部、２３４　評価結果情報記憶部、２３５　フィードバックコメント記憶部、３００　講師端末装置 100 user terminal device, 200 learning support device, 201 communication unit, 202 control unit, 203 storage unit, 221 evaluation unit, 222 screen information generation unit, 223 evaluation result output unit, 231 user information storage unit, 232 submission report storage unit, 233 Evaluation use information storage unit, 234 Evaluation result information storage unit, 235 Feedback comment storage unit, 300 Instructor terminal device

Claims (11)

  1. 　所定の課題に対応して文章形式で記述されたレポートから評価基準を満たしている記述部分を抽出した結果を利用して前記レポートの評価を行う評価部と、
    　少なくとも前記評価部による前記記述部分の抽出結果を前記レポートの記述内容に反映させた表示が可能なレポート画面に対応するレポート画面情報を生成する画面情報生成部と
    　を備えるレポート評価装置。     An evaluation unit that evaluates the report using the results of extracting the description part that meets the evaluation criteria from the report described in text format corresponding to a predetermined task.
    A report evaluation device including at least a screen information generation unit that generates report screen information corresponding to a report screen that can be displayed by reflecting the extraction result of the description portion by the evaluation unit in the description content of the report.
  2. 　前記評価部による評価結果が反映されたレポート提出者向けの評価結果情報を出力する評価結果出力部を備える
    　請求項１に記載のレポート評価装置。     The report evaluation device according to claim 1, further comprising an evaluation result output unit that outputs evaluation result information for a report submitter that reflects the evaluation result by the evaluation unit.
  3. 　前記評価部は、前記記述部分を抽出した結果に基づいて採点を行う
    　請求項１または２に記載のレポート評価装置。     The report evaluation device according to claim 1 or 2, wherein the evaluation unit scores based on the result of extracting the description portion.
  4. 　前記評価部は、操作に応じて評価の結果を修正する
    　請求項３に記載のレポート評価装置。     The report evaluation device according to claim 3, wherein the evaluation unit corrects the evaluation result according to the operation.
  5. 　前記評価部は、前記レポートについて評価した結果に基づいて、レポート提出者に向けたコメントを生成する
    　請求項１から４のいずれか一項に記載のレポート評価装置。     The report evaluation device according to any one of claims 1 to 4, wherein the evaluation unit generates a comment for a report submitter based on the result of evaluating the report.
  6. 　前記レポート画面は、前記レポートの記述において前記評価部により抽出された記述部分が強調表示される
    　請求項１から５のいずれか一項に記載のレポート評価装置。     The report evaluation device according to any one of claims 1 to 5, wherein the report screen highlights the description portion extracted by the evaluation unit in the description of the report.
  7. 　前記レポート画面は、前記レポートの記述において前記評価部により抽出された記述部分のうち、選択された評価基準に対応して抽出された記述部分が強調表示される
    　請求項６に記載のレポート評価装置。     The report evaluation device according to claim 6, wherein the report screen highlights the description portion extracted by the evaluation unit in the description of the report, which is extracted according to the selected evaluation criteria. ..
  8. 　前記レポート画面は、評価基準の選択が行われる評価基準選択領域と、前記レポートのテキストにおいて前記評価部により抽出された記述部分が強調表示されるレポート領域とを同一画面に表示する
    　請求項７に記載のレポート評価装置。     In claim 7, the report screen displays an evaluation standard selection area in which evaluation criteria are selected and a report area in which a description portion extracted by the evaluation unit is highlighted in the text of the report on the same screen. Described report evaluation device.
  9. 　前記強調表示は、前記記述部分に対してラインマーカを施すように表示するものであり、評価基準ごとに異なる色のラインマーカが表示される
    　請求項６から８のいずれか一項に記載のレポート評価装置。     The report according to any one of claims 6 to 8, wherein the highlighting is displayed so as to apply a line marker to the description portion, and a line marker of a different color is displayed for each evaluation standard. Evaluation device.
  10. 　所定の課題に対応して文章形式で記述されたレポートから評価基準を満たしている記述部分を抽出した結果を利用して前記レポートの評価を行う評価ステップと、
    　少なくとも前記評価ステップによる前記記述部分の抽出結果を前記レポートの記述内容に反映させた表示が可能なレポート画面に対応するレポート画面情報を生成する画面情報生成ステップと
    　を備えるレポート評価方法。     An evaluation step in which the report is evaluated using the result of extracting the description part that meets the evaluation criteria from the report described in the text format corresponding to the predetermined task, and the evaluation step.
    A report evaluation method including at least a screen information generation step for generating report screen information corresponding to a report screen that can be displayed by reflecting the extraction result of the description portion by the evaluation step in the description content of the report.
  11. 　コンピュータを、
    　所定の課題に対応して文章形式で記述されたレポートから評価基準を満たしている記述部分を抽出した結果を利用して前記レポートの評価を行う評価部、
    　少なくとも前記評価部による前記記述部分の抽出結果を前記レポートの記述内容に反映させた表示が可能なレポート画面に対応するレポート画面情報を生成する画面情報生成部
    　として機能させるためのプログラム。     Computer,
    Evaluation department that evaluates the report using the result of extracting the description part that meets the evaluation criteria from the report described in the sentence format corresponding to the predetermined task.
    A program for functioning as a screen information generation unit that generates report screen information corresponding to a report screen that can be displayed by reflecting at least the extraction result of the description portion by the evaluation unit in the description content of the report.
PCT/JP2021/008493 2020-03-04 2021-03-04 Report evaluation device, report evaluation method, and program WO2021177413A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020037109A JP6943999B2 (en) 2020-03-04 2020-03-04 Report evaluation device, report evaluation method, and program
JP2020-037109 2020-03-04

Publications (1)

Publication Number Publication Date
WO2021177413A1 true WO2021177413A1 (en) 2021-09-10

Family

ID=77613421

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/008493 WO2021177413A1 (en) 2020-03-04 2021-03-04 Report evaluation device, report evaluation method, and program

Country Status (2)

Country Link
JP (1) JP6943999B2 (en)
WO (1) WO2021177413A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0876681A (en) * 1994-09-05 1996-03-22 Ricoh Co Ltd Image processor and question paper forming and marking system
JP2006277086A (en) * 2005-03-28 2006-10-12 Nippon Tokei Jimu Center:Kk Marking support method, marking support system, marking support device, marking management device and computer program
JP2011008355A (en) * 2009-06-23 2011-01-13 Omron Corp Fmea sheet creation support system and creation support program
JP2017068011A (en) * 2015-09-30 2017-04-06 京セラドキュメントソリューションズ株式会社 Image forming apparatus and image forming system
JP2017167413A (en) * 2016-03-17 2017-09-21 独立行政法人大学入試センター Marking auxiliary system
CN107832768A (en) * 2017-11-23 2018-03-23 盐城线尚天使科技企业孵化器有限公司 Efficient method to go over files and marking system based on deep learning
JP2019152793A (en) * 2018-03-05 2019-09-12 富士ゼロックス株式会社 Device, method, and program for processing information

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0968919A (en) * 1995-09-01 1997-03-11 Sharp Corp Answer rating processor
JP6556090B2 (en) * 2016-04-08 2019-08-07 Kddi株式会社 Program, apparatus and method for estimating score of text by calculating a plurality of similarities

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0876681A (en) * 1994-09-05 1996-03-22 Ricoh Co Ltd Image processor and question paper forming and marking system
JP2006277086A (en) * 2005-03-28 2006-10-12 Nippon Tokei Jimu Center:Kk Marking support method, marking support system, marking support device, marking management device and computer program
JP2011008355A (en) * 2009-06-23 2011-01-13 Omron Corp Fmea sheet creation support system and creation support program
JP2017068011A (en) * 2015-09-30 2017-04-06 京セラドキュメントソリューションズ株式会社 Image forming apparatus and image forming system
JP2017167413A (en) * 2016-03-17 2017-09-21 独立行政法人大学入試センター Marking auxiliary system
CN107832768A (en) * 2017-11-23 2018-03-23 盐城线尚天使科技企业孵化器有限公司 Efficient method to go over files and marking system based on deep learning
JP2019152793A (en) * 2018-03-05 2019-09-12 富士ゼロックス株式会社 Device, method, and program for processing information

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
ASAHI, NOBUSHIGE ET AL.: "A Grading Support System for Free Form Problems Considering the Grader's Intention", LECTURE PROCEEDINGS (4) OF THE 70TH (2008) NATIONAL CONFERENCE, 13 March 2008 (2008-03-13), pages 737 - 738 *
ISHIOKA, TSUNENORI: "Automated short-answer test scoring: The logic and the tasks", IEICE TECHNICAL REPORT, vol. 109, no. 84, 11 June 2009 (2009-06-11), pages 7 - 11, ISSN: 0913-5685 *
MORITA, NAOKI ET AL.: "A method of classifying description answers on realtime", FIT2002 FORUM ON INFORMATION TECHNOLOGY: INFORMATION TECHNOLOGY LETTERS, vol. 1, September 2002 (2002-09-01), pages 233 - 234 *
NAKAJIMA, KOJI: "Development and evaluation of scoring support tools for short answer response", PROCEEDINGS OF THE 17TH ANNUAL MEETING OF THE ASSOCIATION FOR NATURAL LANGUAGE PROCESSING, 7 March 2011 (2011-03-07), pages 611 - 614 *
OSHIMA, KAZUMA ET AL.: "Development of a scoring support system for short-answer written tests- Classification of answers based on usage of keywords", PROCEEDINGS OF 2011 PC CONFERENCE, 7 August 2011 (2011-08-07), pages 18 - 21 *

Also Published As

Publication number Publication date
JP6943999B2 (en) 2021-10-06
JP2021140426A (en) 2021-09-16

Similar Documents

Publication Publication Date Title
Lee The impact of using machine translation on EFL students’ writing
Nitzke Problem solving activities in post-editing and translation from scratch: A multi-method study
Cargill et al. Preparing Chinese graduate students of science facing an international publication requirement for graduation: Adapting an intensive workshop approach for early-candidature use
US20150106705A1 (en) Adaptive Grammar Instruction - Verb Tense
US20080145832A1 (en) Test Question Constructing Method and Apparatus, Test Sheet Fabricated Using the Method, and Computer-Readable Recording Medium Storing Test Question Constructing Program for Executing the Method
Soler-Monreal Announcing one's work in PhD theses in computer science: A comparison of Move 3 in literature reviews written in English L1, English L2 and Spanish L1
US20150093727A1 (en) Vocabulary learning system and method
US20110041052A1 (en) Markup language-based authoring and runtime environment for interactive content platform
KR20110096425A (en) English learning method, apparatus thereof and the book
KR102563530B1 (en) Method for guiding enhancement of reading comprehension and writing abilities and the apparatus thereof
WO2021177413A1 (en) Report evaluation device, report evaluation method, and program
KR101380692B1 (en) Apparatus for on-line study and method for the same
Qian et al. User Adaptive Language Learning Chatbots with a Curriculum
JP2019061189A (en) Teaching material authoring system
Godwin-Jones Focusing on form: Tools and strategies
KR20080100857A (en) Service system for word repetition study using round type
JP6988101B2 (en) Information processing equipment, programs and information processing methods
Moreno et al. A bridge to web accessibility from the usability heuristics
US7296260B2 (en) System and method for composing a multi-lingual instructional software
JPH07302036A (en) Formation of exercise for cai to be executed on personal computer
US10635862B2 (en) Method of facilitating natural language interactions, a method of simplifying an expression and a system thereof
KR20220000150A (en) System and method for providing English study program through terminal
JP2887660B2 (en) Translation Correction Support Device
US20180277007A1 (en) Method and apparatus for assisting persons with disabilities
Farrell Raw output evaluator, a freeware tool for manually assessing raw outputs from different machine translation engines

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21764677

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21764677

Country of ref document: EP

Kind code of ref document: A1