KR20200132080A - Apparatus for Generating Problem and Driving Method Thereof - Google Patents

Abstract

The present invention relates to a device for generating a question and a driving method thereof. According to an embodiment of the present invention, the device for generating a question may comprise: a storage unit storing question data related to a designated subject that a lecture about the designated subject is held; and a control unit receiving a generated question related to a designated subject submitted by each student from terminal devices of students taking lectures and extracting question data with the similarity less than a standard value by comparing the received generated questions with (previously) stored question data to provide the question data to a terminal device of a professor, who conducts a lecture.

Description

Problem generating device and its driving method {Apparatus for Generating Problem and Driving Method Thereof}

The present invention relates to a problem generating device and a method of driving the device, and more particularly, a problem generating device and a driving method of the device that allow the best evaluation to proceed when evaluating a final exam, etc. in an online class. It is about.

In recent years, due to the expansion of digital or cyber universities, students can continue their studies anytime, anywhere. Most of the lectures on the network are defined by the instructor and the corresponding lecture, and it is produced as a video in advance, so that the accurate lecture progress according to the parking. In addition, evaluations held in each semester (eg midterms, finals, etc.) are also conducted through the network, and questions are usually presented in a question bank method.

However, in the case of an evaluation questioned by the conventional question bank method, it is recognized as the best evaluation in online classes, although there is a limitation in accurately evaluating the student's participation in class as well as academic ability. Accordingly, in recent years, there has been a need for a method to induce more students' participation in class and at the same time ensure more objectivity in the evaluation of academic ability.

Korean Registered Patent Publication No. 10-1851878 (2018.04.18) Korean Registered Patent Publication No. 10-1493490 (2015.02.09) Korean Patent Publication No. 10-2010-0012943 (2010.02.09)

An object of the present invention is to provide an apparatus for generating a problem and a method of driving the apparatus to allow the best evaluation to proceed when evaluating a final exam, for example, in a class conducted online.

A problem generating device according to an embodiment of the present invention includes a storage unit for storing problem data related to a designated subject in which a lecture is to be held, and a terminal device of students taking the lecture, each student creates and submits in relation to the designated subject. Receives a self-written problem, compares the received self-written problem with the stored problem data, extracts problem data whose similarity is less than or equal to a reference value, and provides it to the terminal device of the instructor conducting the lecture to evaluate the difficulty of the problem. Includes a requesting control unit.

The control unit compares the similarity with the received self-created problem from the stored problem data, deletes problem data having a similarity greater than or equal to a reference value, and provides it to the instructor's terminal device.

The control unit may match the extracted problem data with grade evaluation information designated by the instructor and store it in the storage unit.

The storage unit matches and stores the self-written question and identification information of the student who submitted the self-written question, and the control unit includes a problem at a rate of the extracted question data and the questions specified in the self-written question when evaluating the designated subject. Can be selected and transmitted to the student's terminal device.

The control unit may select a question by further considering a questionnaire rate of an evaluation grade evaluated in the extracted question data when selecting a question by the questionnaire ratio.

The control unit may differently assign achievement scores according to the volume of the self-written problem submitted by each student.

In addition, the driving method of the problem generating device according to the embodiment of the present invention is a driving method of the problem generating device including a storage unit and a control unit, the step of storing problem data related to a designated subject in which a lecture is to be made in the storage unit, And the control unit receives a self-written problem that each student creates and submits in relation to the designated subject from a terminal device of the students taking the lecture, and compares the received self-written problem with the stored problem data to have similarity And extracting problem data less than this reference value and providing it to the terminal device of the instructor conducting the lecture, requesting a grade evaluation for the difficulty of the problem.

The control unit compares the similarity with the received self-created problem from the stored problem data, deletes problem data having a similarity greater than or equal to a reference value, and provides it to the instructor's terminal device.

The control unit may match the extracted problem data with grade evaluation information designated by the instructor and store it in the storage unit.

The storage unit matches and stores the self-written question and identification information of the student who submitted the self-written question, and the control unit includes a problem at a rate of the extracted question data and the questions specified in the self-written question when evaluating the designated subject. Can be selected and transmitted to the student's terminal device.

The control unit may select a question by further considering a questionnaire rate of an evaluation grade evaluated in the extracted question data when selecting a question by the questionnaire ratio.

The control unit may differently assign performance scores according to the amount of the self-written questions submitted by each student.

According to an embodiment of the present invention, in the case of online classes, the problem bank stored in the database and the problem submitted by the student, for example, are compared for the best evaluation of students, and the problem is presented to the student according to the comparison result. As a result, student participation in class will be enhanced and more objective evaluation will be made.

1 is a diagram showing a problem generating system according to an embodiment of the present invention;
FIG. 2 is a diagram schematically showing a problem generation process of the system of FIG. 1;
3 is a block diagram illustrating a detailed structure of the problem generating apparatus of FIG. 1, and
4 is a flowchart of a problem generation process according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings.

1 is a diagram illustrating a problem generating system according to an embodiment of the present invention, and FIG. 2 is a diagram schematically illustrating a problem generating process of the system of FIG. 1.

As shown in Fig. 1, the problem generation system 90 according to the embodiment of the present invention includes a learner terminal device 101, an instructor terminal device 103, a communication network 110, and a problem generation device (or learning service device). Includes some or all of 120.

Here, "including some or all" means that some components such as the communication network 110 are omitted so that the learner terminal device 101 and the instructor terminal device 103 communicate directly with the problem generating device 120 (eg: P2P communication), or a part or all of the problem generating device 120 is integrated into a network device (eg, a wireless switching device) in the communication network 110 to be configured. As meant, it will be described as including all in order to help a sufficient understanding of the invention.

The learner's terminal device 101 may include, for example, a desktop computer, a laptop computer, a tablet PC, a smartphone, a smart TV, or a wearable device such as Galaxy*, which can use services such as online classes provided by the problem generating device 120. I can. Of course, it may further include an artificial intelligence (AI) speaker as a peripheral device interlocking with the devices. In the embodiment of the present invention, any device may be used as long as it is connected to the problem generating device 120 on-line to perform learning, and for example, as long as it is possible to create and submit a problem as an assignment object.

The learner terminal device 101 accesses the problem generating device 120 and uses a learning service. For example, you can use learning services provided by digital or cyber universities. In addition, the learner terminal device 101 may create and submit a question after the progress of the lecture has progressed, or after, for example, after learning by designating the progress of a specific lecture. Of course, the written question can be submitted in the form of an assignment. In fact, since the learner can prepare the lecture in advance or understand the contents after taking the lecture, it will be possible to create a problem, so learning effect can be given.

For example, after learning through online learning of a designated subject, a learner can write a question on his own based on the specific content of the textbook. Such a problem may be provided by a program such as Korean Word or MS Word, but it may be possible to create and submit a problem by clicking a specific icon or button of the problem generating device 120. It doesn't matter if it's a multiple-choice problem or a subjective form problem.

In this way, if there are many problems submitted through the learner's terminal device 101, the problem generating device 120 may assign a large number of points to the corresponding learner in proportion thereto. For example, when there is an evaluation for a class, such as a midterm or final exam, this can be reflected. In addition, the learner terminal device 101 is an evaluation problem that selects the problem stored in the DB 120a filtered based on the problem provided by the problem generating device 120 and the problem provided by the student according to a certain ratio. You can receive an evaluation. In other words, about 50% of the questions submitted by you are included, and can be provided for evaluations such as midterm or final exams. Of course, such a problem is generated by classifying the problem filtered by the problem generating device 120 according to the difficulty level in the instructor terminal device 103, and appropriately including the classified class, and the generated problem can be provided. .

In addition, the instructor terminal device 103 includes various devices like the learner terminal device 101. Representatively, it may include a smartphone, a tablet PC, and a laptop computer. The instructor terminal device 103 may receive a question bank, that is, question data, for classifying a level of difficulty from the problem generating device 120. Problem data for classifying grades may be provided with problems with low or no similarity by comparing the problem submitted by the students through the learner terminal device 101 with problem data stored in the DB 120a.

The instructor terminal device 103 is presented as an assignment from the problem generating device 120 to the learner terminal device 101 according to an embodiment of the present invention, and the student or learners directly create and provide the problem (or question). Compared with the problems stored in the DB (120a) of, the problem of extracting only problems with similarity less than a reference value, for example, may be provided, and evaluation of the residual degree may be performed. For example, if a total of 1000 questions are stored in the DB (120a) as a question bank, and there are 500 questions provided by students, the similarity is compared to select problems below the standard value (e.g., the remaining 500), or The correct questions can be further selected (eg, 100 items that match the progress of the remaining 500) and transmitted to the instructor terminal device 103, and the instructor can input the difficulty level for this.

Of course, the questions may be provided in the form of a list, and while viewing the questions displayed on the instructor's terminal device 103 on the screen, the instructor ranks the questions, and when the questions are completed, the instructor can transmit them to the problem generation device 120.

The communication network 110 includes all wired and wireless communication networks. For example, as the communication network 110, a wired or wireless Internet network may be used or interlocked. Here, the wired network includes an Internet network such as a cable network or a public telephone network (PSTN), and the wireless communication network includes CDMA, WCDMA, GSM, Evolved Packet Core (EPC), Long Term Evolution (LTE), and Wibro networks. It is meant to include. Of course, the communication network 110 according to the embodiment of the present invention is not limited thereto, and may be used as an access network for a next-generation mobile communication system to be implemented in the future, for example, a cloud computing network or a 5G network under a cloud computing environment. For example, if the communication network 110 is a wired communication network, the access point in the communication network 110 can be connected to the switching center of the telephone office, but in the case of a wireless communication network, data is accessed by accessing SGSN or GGSN (Gateway GPRS Support Node) operated by the communication company. Alternatively, data can be processed by accessing various repeaters such as BTS (Base Station Transmission), NodeB, and e-NodeB.

The communication network 110 may include an access point. Here, the access point includes a small base station such as a femto or pico base station that is frequently installed in a building. Here, the femto base station or the pico base station is classified according to how many learner terminal devices 101 and instructor terminal devices 103 can be connected to at most, according to the classification of small base stations. Of course, the access point may include a short-range communication module for performing short-range communication such as ZigBee and Wi-Fi with at least one of the learner terminal device 101 and the instructor terminal device 103. The access point may use TCP/IP or Real-Time Streaming Protocol (RTSP) for wireless communication. Here, short-range communication may be performed in various standards such as Bluetooth, Zigbee, infrared, radio frequency (RF) such as ultra high frequency (UHF) and very high frequency (VHF), and ultra wideband communication (UWB) in addition to Wi-Fi. Accordingly, the access point may extract the location of the data packet, designate the best communication path for the extracted location, and forward the data packet to the next device, for example, the problem generating device 120 along the designated communication path. The access point can share several lines in a general network environment, and includes, for example, a router, a repeater, and a repeater.

The problem generation device 120 creates and submits a problem from the student terminal, that is, the learner terminal device 101, as an assignment for each class time, and the problem generation device 120 as the main server transmits each problem to the problem previously stored in the server. After comparing and deleting similar problems, a problem with no similarity is transmitted to the instructor terminal device 103. The instructor evaluates the problem received from the main server, classifies the difficulty level with A/B/C/D, and sends it back to the main server. In addition, the problem generating device 120, which is the main server, separates the problem received from the instructor terminal device 103 from the previously stored problem and stores it in, for example, the DB 120a. At this time, in the case of the stored problem, the unique code of the student who created the problem, that is, identification information is matched and stored. In addition, 50% of each of the questions that were previously stored in the evaluation, such as the final exam, that was created by the question bank and the student can be presented. In addition, it is possible to increase academic participation by distributing achievement points to students who have generated many problems during class evaluation.

As can be seen in FIG. 2, the problem generating device 120 compares the similarity with the problem submitted by the learner in the problem bank DB. Of course, the questions stored in the DB 120a may be questions that instructors have asked through online classes for many years, or may be problems collected under partnership by accessing an external device (eg, a server at another university). After collecting these problems to generate a problem bank, the similarity to the problems received from the learner terminal device 101 may be compared and filtered based on this. The comparison of similarity can be performed by simply analyzing the relevant item, extracting the keyword, and analyzing the relevant keyword. Of course, the problem generating device 120 may analyze the problem bank and store information on the keyword as a result of the analysis. Therefore, it is possible to filter the problem based on the similarity by comparing the keywords with each other and evaluating the similarity according to the number of matching keywords.

Of course, the problem generating device 120 retrieves the problem data stored in the problem bank, that is, the DB 120a, more precisely divided based on a specific progress, and compares the similarity with the problems submitted by the students as above. Thus, problems with similarity greater than or equal to the reference value are filtered or deleted. In addition, the remaining problems after deletion are transmitted to the instructor terminal device 103 to request a level of difficulty. The problem data processed in this way may be classified and stored in the DB 120a. For example, the problem data of the question bank is stored in the area A, the questions submitted by students are stored in the area B, and the data received after comparing the two data is stored in the area C. will be.

Thereafter, the problem generating device 120 may access the DB 120a for evaluation of a learner, that is, a student's final exam, to extract the items at a certain rate and transmit them to the learner terminal device 101. For example, 50% of questions are extracted from area B, where the questions submitted by students are stored, and 50% of questions are extracted from area C. Of course, when extracting an item from the C area, the level of difficulty can be determined and extracted in consideration of the student's level. For example, if the instructor separately specified the percentage of the questionnaire, the remaining 50% of the questions Can be tested. Of course, the purpose is to enhance learners' learning due to the nature of online classes, so it may be desirable to provide tailored provision for all students. For example, if a professor in a designated subject has set the ratio of grade D with high difficulty to 10% out of 50%, grades B and C as 15%, and grade A as 10%, Based on this, 50% of the questions are extracted and provided in combination with the 50% of the questions submitted by the student. In the case of a total of 30 questions, it can be seen that 15 questions submitted by the student and 15 questions with no similarity are classified according to the above scale.

In this way, it is possible to actively induce students to participate in classes in online classes such as cyber universities, and to enhance the academic ability of learners through the best evaluation.

Of course, when deep learning is performed using an artificial intelligence (AI) program, the problem generating device 120 may select an item with higher accuracy and present it at the time of evaluation. For example, when it is determined that it is better to reduce the proportion of questions with high difficulty as a result of analyzing the teaching patterns of students for several years, the questions can be submitted by adjusting the selection ratio of these difficulty levels. In addition, as a result of analyzing students' online class hours, if there are not many online class hours, of course, it may be the average time of the total time for all students. However, by analyzing these various data, students' behavior patterns are determined at appropriate timing. It will be able to predict and select questions based on the predicted results and present them to students.

3 is a block diagram illustrating a detailed structure of the problem generating apparatus of FIG. 1.

As shown in FIG. 3, the problem generating apparatus 120 according to the embodiment of the present invention includes a communication interface unit 300, a control unit 310, a problem generation execution unit 320, and a part of the storage unit 330 or Includes all.

Here, "including some or all" means that some components such as the storage unit 330 are omitted, or some components such as the problem generation execution unit 320 are other components such as the control unit 310 It is intended to mean something that can be integrated and configured in, and will be described as including all in order to help a sufficient understanding of the invention.

The communication interface unit 300 communicates with the learner terminal device 101 and the instructor terminal device 103 via the communication network 110 of FIG. 1. In a process of performing communication, the communication interface unit 300 may perform operations such as modulation/demodulation, coding/decoding, muxing/demuxing, and encryption/decryption. This is obvious to those skilled in the art, so further description will be omitted.

The communication interface unit 300 provides a learning service that enables online classes at the request of the learner's terminal device 101, and when there is a request to submit an assignment from an instructor in a designated course in the process, take the course as an assignment according to the request. You can write your own questions within the scope of the course of a lecture, and create and submit questions in various forms regardless of whether it is multiple choice or short answer. Of course, the more questions you submit, the more points you can get.

In addition, the communication interface unit 300 subtracts the problems submitted by the students from the problem data of the problem bank previously stored under the control of the control unit 310, and extracts only problems corresponding to the range of progress among the remaining problems. Thus, it can be transmitted to the instructor terminal device 103. Of course, the term "remaining problems" may mean problems in which the problems submitted by students are deleted from the entire problem data. Therefore, deleting and extracting could be interpreted in a similar sense.

Accordingly, the communication interface unit 300 may receive information on a level of difficulty, etc. each evaluated by the instructors for problems provided to the instructor terminal device 103 and transmit the information to the control unit 310.

The control unit 310 is in charge of overall control operations of the communication interface unit 300, the problem generation execution unit 320, and the storage unit 330 constituting the problem generation device 120. Information or data received through the communication interface unit 300 may be received, temporarily stored in the storage unit 330, and then recalled and provided to the problem generation execution unit 320. For example, when data relating to problems submitted by students through the communication interface unit 300 is received, the data may be temporarily stored in the storage unit 330 and then called and provided to the problem generation execution unit 320. Here, data related to problems submitted by students may be named a generation problem or the like according to an embodiment of the present invention.

In addition, the control unit 310 may provide problem data of the problem bank related to the designated subject from the DB 120a at the request of the problem generation execution unit 320. In addition, the communication interface unit 300 may be controlled to provide the remaining or remaining problem data excluding the generated problem submitted by the students from the problem data of the problem bank to the instructor terminal device 103.

In addition to this, the control unit 310 may perform various operations, but this has been sufficiently described through the problem generating apparatus 120 of FIG. 1, and thus the contents will be substituted.

Meanwhile, the problem generation execution unit 320 of FIG. 3 may perform an operation for generating a problem in addition to an operation for providing a learning service to the learner terminal device 101. Here, the problem creation is to receive and analyze the problem created through a document editor like MS Word in the form of a document file, or programmatically create a question through a separate UX/UI window or a pop-up window, and receive and analyze it. Such a method may be possible. Since various methods are possible, the embodiment of the present invention will not be particularly limited to any one method. Also, the problem generation execution unit 320 analyzes the received problems. In the simplest, keyword data can be generated by classifying it by keyword.

Therefore, the problem generation execution unit 320 analyzes the problems of the problem bank acquired through the learning service for many years and stores the keyword data (or first keyword data) as an analysis result and the keyword data obtained by analyzing the problems submitted by students. If (or second keyword data) is compared with each other, and if many identical or similar words are found, it is determined that the similarity is high, and the problem is deleted or excluded from the problem data of the problem bank based on the similarity. In this way, the remaining problem data excluding the data submitted by the students is extracted from the previously stored problem data and transmitted to the instructor terminal device 103.

In addition, the problem generation execution unit 320 generates the information on the evaluation grade evaluated by the instructors with respect to the problem data provided to the instructor terminal device 103 in a designated format, and generates the data in the designated format as a DB ( It can be updated and saved in 120a).

In addition, the problem generation execution unit 320 may select and present a question according to a ratio designated by the instructor, for example, for evaluation of learners' final exams. For example, questions submitted by students and the rest of the questions in the question bank excluding the corresponding question can be determined at a ratio of 50 to 50, and questions can be selected and presented according to the ratio. Above all, the remaining 50% of the question was graded from the instructor's terminal device 103, so if the instructor also specified the percentage of the questionnaire for that grade, for example, randomly selected questions that fit the grade based on the information. I can.

Further, the problem generation execution unit 320 may evaluate learners' learning. For example, you can submit a question as an assignment and give points to the assignment. Since the assignment can be substituted for the midterm exam, points are allocated in consideration of the number of questions submitted. In addition, in the case of the final exam, the grades for one semester can be calculated by grading the questions that were previously selected at a ratio of 50 to 50, and scoring them in total, and totaling and averaging them.

The storage unit 330 may temporarily store various information and data under the control of the controller 310 and may output it according to a request of the controller 310. Here, the information may be about a simple control command, and the data may be actual data. A typical data packet or packet data may include a header portion including additional information such as a control command, and a payload data portion (or control data portion) including real data, for example, problem data. The storage unit 330 may store data in a data packet.

4 is a flowchart of a problem generation process according to an embodiment of the present invention.

For convenience of explanation, referring to FIG. 4 together with FIG. 1, the problem generating apparatus 120 according to an embodiment of the present invention may store problem data related to a designated subject in which a lecture is to be made in a storage unit (S400). Of course, in addition to this, the problem generating device 120 may match the problem data and store keyword data extracted through the corresponding problem data.

In addition, the problem generating device 120 receives the generation problem related to the designated subject submitted by each student from the terminal device of the students taking the lecture, for example, the learner terminal device 101 of FIG. ) By comparing the stored problem data, problem data whose similarity is less than or equal to a reference value may be extracted and provided to the instructor terminal device 103 of the instructor who proceeds the lecture (S410).

Of course, in order to perform the above operation, the problem generation device 120 analyzes the generated problem created and submitted by students, extracts the keyword, and based on the extracted keyword and keyword data matching the problem data of the problem bank specified in the storage unit. If the similarity is high, the corresponding question is excluded, and if the similarity is low, the corresponding question can be provided to the instructor terminal device 103 for evaluation. For example, let's assume that a total of 10 keywords are set in the question bank's designated question data. And, by extracting the keywords of the generation problem submitted by the student, of course, the number may vary, but it is possible to determine how many of the total 10 keywords match. If it exceeds 50%, for example, it can be excluded. Here, "excluded" means that the instructor terminal device 103 may not be provided for evaluation of the grade, and may not be submitted to the student for evaluation such as a final exam.

In addition to the above contents, detailed operations related to the problem generating apparatus 120 have been sufficiently described above, and thus the contents will be substituted.

On the other hand, even if all the constituent elements constituting an embodiment of the present invention are described as being combined into one or operating in combination, the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all of the constituent elements may be selectively combined and operated in one or more. In addition, although all the components may be implemented as one independent hardware, a program module that performs some or all functions combined in one or more hardware by selectively combining some or all of the components. It may be implemented as a computer program having Codes and code segments constituting the computer program may be easily inferred by those skilled in the art of the present invention. Such a computer program is stored in a non-transitory computer readable media that can be read by a computer and is read and executed by a computer, thereby implementing an embodiment of the present invention.

Here, the non-transitory readable recording medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device. . Specifically, the above-described programs may be provided by being stored in a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, or the like.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and is generally used in the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. Various modifications are possible by those skilled in the art of course, and these modifications should not be individually understood from the technical idea or perspective of the present invention.

101: learner terminal device 103: instructor terminal device
110: communication network 120: problem generating device
300: communication interface unit 310: control unit
320: problem generation execution unit 330: storage unit

Claims (7)

A storage unit for storing problem data related to a designated subject in which a lecture is to be made; And
Problem data whose similarity is less than a standard value by receiving a self-written problem that each student creates and submits in relation to the designated subject from the terminal device of the students taking the lecture, and compares the received self-written problem with the stored problem data A control unit for extracting and providing it to the terminal device of the instructor conducting the lecture to request a grade evaluation for the difficulty of the problem;
Problem generating device comprising. The method of claim 1,
The control unit compares the similarity with the received self-created problem from the stored problem data, deletes problem data having a similarity greater than or equal to a reference value, and provides it to the instructor's terminal device. The method of claim 1,
The control unit matches the extracted problem data with grade evaluation information designated by the instructor, and stores the same in the storage unit. The method of claim 3,
The storage unit matches and stores the self-written problem and the identification information of the student who submitted the self-written problem,
The control unit selects a question according to a ratio of the extracted question data and the assigned question to the self-written question when evaluating the specified subject, and transmits the selected question to the terminal device of the student. The method of claim 4,
The control unit is a problem generating device for selecting a problem by further considering a ratio of questions of an evaluation grade evaluated in the extracted problem data when selecting a problem with the question rate. The method of claim 1,
The control unit is a problem generating device for assigning different performance points according to the volume of the self-written problem submitted by each student. A method of driving a problem generating apparatus including a storage unit and a control unit,
Storing problem data related to a designated subject in which a lecture is to be made in the storage unit; And
The control unit receives a self-written problem that each student creates and submits in relation to the designated subject from the terminal device of the students taking the lecture, and compares the received self-written problem with the stored problem data to have similarity. Extracting problem data less than a reference value and providing it to the terminal device of the instructor conducting the lecture to request a grade evaluation for the difficulty of the problem;
Driving method of the problem generating device comprising.

Images