JP2022165741A - Training support server, learner terminal, and training support system - Google Patents

Abstract

To improve training and learning effects by using role playing (RL).SOLUTION: The present invention is a training support server that is connected with a learner terminal and a lecturer terminal. The training support server comprises: a learner DB that stores information on a learner; and a training content DB that stores moving images of model answers of RL to questions, a keyword list, and a check list in association with each other. The training support server acquires moving images obtained by photographing the RL performed by the learner from the learner terminal, on the basis of text data generated on the basis of, voice data included in the moving images, generates extended text data obtained by associating attribute information with texts corresponding to a plurality of keywords included in the keyword list, generates a look-back screen including the extended text data and the check list and provides the screen to the learner terminal, and acquires a report including evaluation items input to the check list in the look-back screen from the learner terminal. Look-back screen data is configured to be able to play back and display role playing moving image data.SELECTED DRAWING: Figure 1

Description

The present invention relates to a training support server, a learner terminal, and a training support system.

Traditionally, online (sometimes referred to as "remote" or "non-face-to-face") communication has been held between instructors and multiple students (students) via communication networks such as the Internet. Training or education systems have been proposed to enable training to be conducted effectively.

For example, Patent Literature 1 below discloses a technique for making a learner aware that he/she is studying with other learners in order to give the learner a sense of presence in an educational system using the Internet. .

Further, Patent Document 2 below discloses a calligraphy correction education system that corrects calligraphy via a network and provides calligraphy education to students. In the calligraphy correction education system shown in Patent Document 2, the work created by the student is transmitted to the corrector terminal of the corrector, and the work corrected by the corrector is stored in a database, so that the student can view it. become.

Furthermore, the following patent document 3 discloses a nursing care skill learning support system that enables a learner to learn effectively and a teacher to efficiently and appropriately evaluate the learner. In the care skill learning support system shown in Patent Document 3, a learner terminal acquires learning content including an action manual video related to care skills taken at the facility to which the learner belongs, and at the same place as the action manual video The instructor's terminal acquires the learner's practical shooting video information and the operation manual video information along with the learner's practical shooting video information that is filmed and follows the movement of the action manual video.

JP-A-2000-172161 Japanese Patent Application Laid-Open No. 2003-173134 JP 2015-219250 A

In view of the recent social situation, there is an increasing need for online training in place of conventional group or face-to-face training in various corporate trainings. On the other hand, the above-mentioned conventional education system does not take training such as role-playing into consideration, and cannot be said to be sufficient for such training. For example, in role-playing that is imposed on students in training, although it is very effective for the students who implement it to check the reflection, the above-mentioned conventional education system does not allow the students to do this. It did not provide an environment that facilitates such reflection.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a training support system capable of improving training/education effects through role-playing demonstrations in training.

More specifically, the object of the present invention is to provide a training support system that facilitates review after a role-playing demonstration by a trainee (learner) imposed in training, and that can improve training and educational effects. to do.

The present invention for solving the above-mentioned problems includes the matters specifying the invention or the technical features described below.

The present invention according to one aspect is a training support server communicably connected to a learner terminal of a learner and a lecturer terminal of a lecturer. The training support server includes a learner database that stores information about the learner, model answer video data related to a video showing a role-playing model answer to a task, a keyword list including a plurality of keywords related to the task, and and a training content database for storing the checklists corresponding to the model answers in association with each other. Further, the training support server includes a role-playing video data acquisition unit that acquires from the learner terminal role-playing video data obtained by filming the role-playing performed by the learner, and the acquired role-playing video a text data generation unit that generates text data based on voice data associated with data; and at least one of the plurality of keywords included in the keyword list among the plurality of texts included in the generated text data. a text processing unit that generates expanded text data obtained by associating predetermined attribute information with a specific text corresponding to the above; and the expanded text data and the checklist stored in the training content database. a review screen data generation unit that generates review screen data including at least the text data and the checklist in order to display the review screen on the learner terminal; A report processing unit that acquires a report including evaluation items input by the learner from the learner terminal for the checklist. Further, the retrospective screen data is configured to be able to reproduce and display the role-playing video data.

Here, the retrospective screen may be displayed in such a manner that the specific text to which the predetermined attribute information is added is visually distinguished. Further, the predetermined attribute information is information for controlling the retrospective screen to be displayed in a visually distinguishable manner by at least one of emphasis, different color, bold, underline, italic, and blinking. obtain.

Also, the learner database stores the report received by the report processing unit.

Further, the training support server generates evaluation screen data including the extended text data and the report in order to display the evaluation screen based on the report received from the learner terminal on the instructor terminal. A data generator is further provided.

The training support server further includes an evaluation result processing unit that acquires evaluation result data including evaluation results input by the instructor on the evaluation screen from the instructor terminal. The learner database stores the evaluation result data acquired by the evaluation result processing unit.

Further, the evaluation result processing unit controls to transmit the obtained evaluation result data to the learner terminal so that an evaluation result screen based on the evaluation result is displayed on the learner terminal.

Moreover, the present invention according to another aspect is a learner terminal communicatively connected to a training support server for supporting training for learners. The learner terminal includes a shooting unit that shoots the role-playing performed by the learner, and a role-playing video data transmission unit that transmits the role-playing video data acquired by the shooting unit to the training support server. A review screen for receiving review screen data including a checklist for the role-playing and extended text data based on text data converted from the voice data, transmitted from the training support server in response to the role-playing video data. A data receiving unit and a display control unit for controlling display of a retrospective screen on a user interface unit based on the received retrospective screen data. Further, the display control unit performs control so that the role-playing video data is reproduced and displayed on the retrospective screen.

Here, the extended text data may include predetermined attribute information associated with specific texts corresponding to a plurality of keywords related to the role-playing model answers. The display control unit causes the user interface unit to display the extended text data in such a manner that the specific text associated with the predetermined attribute information is visually distinguished in the retrospective screen data. Control.

Further, the review screen includes an extended text data display area for displaying the extended text data, a checklist display area for displaying the checklist arranged adjacent to the extended text data display area, and the role-playing and a moving image reproduction display area for reproducing and displaying moving image data.

Further, the user interface unit receives evaluation items input by the learner to the checklist.

Further, the learner terminal performs control so as to transmit a report including the received evaluation items to the training support server.

The learner terminal receives evaluation result data including evaluation results of the transmitted report by the instructor. Then, the display control section performs control so that the evaluation result included in the received evaluation result data is displayed on the user interface section.

Further, the learner terminal receives model answer video data relating to a video showing the model answer of the role-playing. The display control unit controls the user interface unit to display the moving image based on the model answer moving image data.

Another aspect of the present invention is a training support system comprising a training support server and a learner terminal communicably connected to the training support server. The training support server includes a learner database that stores information about learners, model answer video data related to videos showing role-playing model answers to tasks, a keyword list that includes a plurality of keywords related to the tasks, and the A training content database that stores checklists along with model answers in association with each other, and a role-playing video that acquires role-playing video data obtained by filming the role-playing demonstrated by the learner from the learner terminal. a data acquisition unit; a text data generation unit that generates text data based on audio data associated with the acquired role-playing video data; a text processing unit that generates extended text data obtained by associating predetermined attribute information with a specific text corresponding to at least one of the plurality of keywords included in the list; and the extended text data and the training content. a review screen data generation unit that generates review screen data including the text data and the checklist in order to display the review screen including the checklist stored in a database on the learner terminal; A report processing unit that acquires from the learner terminal a report including evaluation items input by the learner for the checklist on the review screen based on screen data. The retrospective screen data is configured to be able to reproduce and display the role-playing video data. Further, the learner terminal includes a shooting unit that shoots the role-playing performed by the learner, and a role-playing video data transmission unit that transmits role-playing video data acquired by the shooting unit to the training support server. and a review screen including the checklist for the role-playing and the extended text data based on the text data converted from the voice data, transmitted from the training support server in response to the transmitted role-playing video data. A review screen data receiving section for receiving data, and a display control section for controlling display of the review screen on the user interface section based on the received review screen data.

The term "system" refers to a logical assembly of multiple devices (or functional modules that implement specific functions), and whether or not each device or functional module resides within a single housing. does not matter.

Advantageous Effects of Invention According to the present invention, it is possible to facilitate review after a role-playing demonstration by a trainee (student) imposed in training, and improve training/education effects.

Other technical features, objects, effects or advantages of the present invention will be made clear by the following embodiments described with reference to the accompanying drawings. The effects or advantages described herein are merely exemplary and not limiting, and other effects or advantages may also exist.

FIG. 1 is a block diagram showing an example of a schematic configuration of a training support system according to one embodiment of the present invention. FIG. 2 is a block diagram showing an example configuration of a training support server in the training support system according to one embodiment of the present invention. FIG. 3 is a diagram for explaining an example of the data structure of the learner database of the training support server according to one embodiment of the present invention. FIG. 4 is a diagram for explaining an example of the data structure of the training content database of the training support server according to one embodiment of the present invention. FIG. 5 is a block diagram showing an example of the configuration of a learner terminal in the training support system according to one embodiment of the present invention. FIG. 6A is a sequence chart for explaining an example of a series of processing flows in the training support system according to one embodiment of the present invention. FIG. 6B is a sequence chart for explaining an example of a series of processing flows in the training support system according to one embodiment of the present invention. FIG. 6C is a sequence chart for explaining an example of a series of processing flows in the training support system according to one embodiment of the present invention. FIG. 7 is a diagram showing an example of a training top screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 8 is a diagram showing an example of a training assignment implementation screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 9 is a diagram showing an example of a training assignment implementation screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 10 is a diagram showing an example of a training assignment implementation screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 11 is a diagram showing an example of a training assignment implementation screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 12 is a diagram showing an example of a training review screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 13 is a diagram showing an example of a training review screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 14 is a diagram showing an example of a training review screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 15 is a diagram showing an example of a training model answer screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 16 is a diagram showing an example of a training top screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention. FIG. 17 is a diagram showing an example of an evaluation result screen displayed on the user interface section of the learner terminal in the training support system according to one embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are merely examples, and are not intended to exclude various modifications and application of techniques not explicitly described below. The present invention can be implemented in various modifications (for example, by combining each embodiment) without departing from the scope of the invention. In addition, in the description of the drawings below, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not necessarily correspond to actual dimensions, proportions, and the like. Even between the drawings, there are cases where portions with different dimensional relationships and ratios are included.

FIG. 1 is a block diagram showing an example of a schematic configuration of a training support system according to one embodiment of the present invention. As shown in the figure, the training support system 1 includes, for example, a training support server 20, a learner terminal 30, and a lecturer terminal 40, which are communicably connected via a communication network 10. FIG.

The communication network 10 is the Internet constructed by an IP-based computer network, but is not limited to this, and may be any network that enables communication between nodes. For example, the communication network 10 may include a mobile communication network conforming to mobile communication system standards, and a wireless network (eg, Wi-Fi (registered trademark), etc.) constructed by wireless base stations or wireless access points.

The training support server 20 provides a service for supporting online training to learners or participants (hereinafter simply referred to as "learners") who take training. Training includes hands-on exercises such as role-playing by learners. Although not shown, the training support server 20 includes hardware resources such as a CPU (processor), chipset, memory, communication interface, user interface, various input/output devices, and an operating system (for example, kernel, various device drivers, standard It is a computing device composed of software resources such as libraries, etc. (hereinafter referred to as “OS”).

The training support server 20 includes various databases 210 . The database 210 may be configured as part of the training support server 20 , may be configured as a NAS (Network Attached Storage), or may be configured at a site separate from the training support server 20 . The database 210 includes, for example, a learner database 212 and a training content database 214, as described below.

Under the control of the processor, the training support server 20 executes a training support server program and implements various functions for supporting the implementation of online training for the learner terminal 30 and the instructor terminal 40 . For example, as will be described later, the training support server 20 receives video data related to a learner's role-playing uploaded from the learner terminal 30 (hereinafter referred to as "role-playing video data"), and the role-playing video data Generating text data from associated or contained audio data. Further, the training support server 20 performs text processing for associating predetermined attribute information with the generated text data so that the text corresponding to the specific keyword is displayed in a visually distinguishable manner. In the present disclosure, text data associated with such predetermined attribute information is referred to as extended text data. For example, rich text data, HTML data, and the like are forms of extended text data. Further, the training support server 20 transmits to the learner terminal 30 the extended text data and the video data (model answer video data) related to the video showing the model answers of the checklist role-playing. Further, the training support server 20 transmits to the learner terminal 30 the learner's role-playing video data or video data (model answer video data) relating to a video showing a model answer for role-playing. Furthermore, the training support server 20 receives the learner's report uploaded from the learner terminal 30, and transmits the learner's report to the instructor terminal 40 to enable evaluation by the instructor.

The learner terminal 30 is a computing device operated by each learner who attends the training. In this example, the learner's terminal 30 includes a camera module and an audio input module for capturing moving images. The learner terminal 30 functions as a client of the training support server 20 and provides an online training environment for the learner. For example, the learner terminal 30 implements a browser program as an application program, and provides the learner with an online training environment via the browser realized by executing the browser program. Alternatively, the learner terminal 30 may be equipped with a learner training support client program for realizing an online training environment on the learner side.

For example, the learner terminal 30 captures the learner's role-playing demonstration situation and acquires role-playing video data. In addition, the learner terminal 30 uploads the video data acquired by shooting to the training support server 20 via the communication network 10 . Also, the learner terminal 30 provides the learner with a review screen based on the review screen data transmitted from the training support server 20 via the communication network 10 . In addition, the learner terminal 30 makes the learner self-check his own role-playing according to the checklist on the review screen, prepares the report, and uploads it to the training support server 20 via the communication network 10. - 特許庁Also, the learner terminal 30 reproduces and displays a moving image based on model answer moving image data transmitted from the training support server 20 via the communication network 10 .

The instructor terminal 40 is a computing device operated by the instructor in training. Although only one lecturer terminal 40 is shown in the figure, it is not limited to this. The instructor terminal 40 also functions as a client of the training support server 20 and provides an online training environment for the instructor. For example, the instructor terminal 40 implements a browser program as an application program, and provides the instructor with an instruction environment for online training via the browser realized by executing the browser program.

For example, the instructor terminal 40 reproduces and displays a video based on the learner's role-playing video data uploaded to the training support server 20 so that the instructor can check the learner's role-playing. In addition, the instructor terminal 40 receives an input of evaluation results by the instructor for the learner's report transmitted from the training support server 20 and uploads evaluation result data based on the input to the training support server 20 .

FIG. 2 is a block diagram showing an example configuration of a training support server in the training support system according to one embodiment of the present invention. As shown in the figure, the training support server 20 of this embodiment includes components such as a database 210, a communication interface section 220, and a task processing section 230, for example. These components are realized by cooperation of hardware resources and/or software resources of the training support server 20 by executing the training support server program under the control of the processor.

The database 210 is a database system that stores and manages various data necessary to support training. The database 210 operates in response to an access request from the task processing section 230 under the control of a database control section (not shown). In the present disclosure, database 210 includes, for example, learner database 212 and training content database 214 .

Learner database 212 stores information about each learner taking the training. FIG. 3 is a diagram for explaining an example of the data structure of the learner database of the training support server according to one embodiment of the present invention. As shown in the figure, each record of the learner database 212 includes fields such as learner ID, name, affiliation, training name, training date, and folder ID. The folder ID is an ID for pointing to a folder that stores various types of training data created and submitted by the learner in training in a predetermined file format. For example, each learner's folder stores the learner's role-playing video data, text data, reports, and the like.

The training content database 214 stores various types of content used in training (hereinafter referred to as “training content”). The training content includes, for example, information about the tasks presented in the training and model answers to the tasks (for example, model answer videos), and is managed for each training ID. FIG. 4 is a diagram for explaining an example of the data structure of the training content database of the training support server according to one embodiment of the present invention. As shown in the figure, each record in the training content database 214 includes fields such as training ID, assignment ID, model answer video ID, keyword list ID, and checklist ID. In this example, the material of the assignment, the model answer, the keyword list, and the checklist data are stored in folders indicated by the assignment ID, model answer ID, keyword list ID, and checklist ID, respectively.

The assignment material data is data that should be referred to by learners in assignments prepared for training, and includes texts for explaining assignments and video data related to videos thereof.

The model answer data includes text data relating to model answers to assignments presented in the training and model answer video data created in advance by the training provider, for example. The model answer data is, for example, read from the model answer data folder in response to a request from the learner and transmitted to the learner terminal 30 .

The keyword list is, for example, a list of registered keywords that the learner should say in relation to the task when performing role-playing. In addition, in this disclosure, the keyword is used as a broad concept including not only words but also compound words and phrases. As an example, in a role-playing task of "explaining the typical functions of in-house product A", if "complete mastery" is one of the characteristics of in-house product A, "conventional drills", " Keywords such as "conventional teaching materials", "repeated learning", "complete understanding", and "complete mastery" are registered in the keyword list.

Also, the checklist is a list indicating the points (evaluation items) that the learner expects from the learner's answer for the task, for example, when performing role-playing. The checklist includes, for example, check boxes provided for each evaluation item. The learner can input (check) the checkboxes of the checklist displayed on the learner terminal 30 .

Returning to FIG. 2, communication interface unit 220 enables computer communication via communication network 10 . For example, the communication interface unit 220 performs IP-based computer communication with the learner terminal 30 and/or the instructor terminal 40 to enable transmission and reception of various data. The communication interface section 220 includes, for example, a transmission section and a reception section.

The task processing unit 230 executes and processes various tasks (processes) in the training support server 20 . In the figure, the task processing unit 230 includes a role-playing video data acquisition unit 231, a text data generation unit 232, a text processing unit 233, a review screen data generation unit 234, a report processing unit 235, and an evaluation screen data generation unit. It includes a section 236 and an evaluation result processing section 237 .

The role-playing video data acquisition unit 231 acquires role-playing video data uploaded from the learner terminal 30 of each learner via the communication interface unit 220 . The role-playing video data acquisition unit 231 performs control so that the acquired role-playing video data is stored in the learner database 212 . As a result, the learner's role-playing video data is stored in the learner's training folder in the learner database 212 . Also, the role-playing video data acquisition unit 231 passes the acquired role-playing video data to the text data generation unit 232 .

The text data generation unit 232 generates text data based on the audio data associated with the role-playing video data. For example, the text data generation unit 232 converts the voice data into text using a voice recognition technology to generate text data (plain text data). A known speech recognition technology can be used. In addition, the text data generation unit 232 may perform natural language processing on text data that has been converted to text in order to complement recognition accuracy.

The text processing unit 233 uses the training content database 214 to generate extended text data based on the generated text data. As described above, extended text data is text data associated with predetermined attribute information so that specific text is displayed in a visually distinguishable manner. Specifically, the text processing unit 233 first decomposes the generated text data into several texts by, for example, natural language processing (text mining). The text here is a concept including one morpheme and a combination of two or more morphemes. Subsequently, the text processing unit 233 refers to the keyword list of the training content database 214, extracts the text corresponding to the keyword registered in the keyword list, and associates the extracted text with predetermined attribute information, thereby Generate extended text data. The visually distinguishable attribute information is, for example, information indicating at least one of emphasis, different colors, bold letters, underlines, italics, and blinking that modify characters (text).

The review screen data generation unit 234 generates review screen data for displaying on the learner terminal 30 a review screen for prompting the learner to review his or her own role-playing. As will be described later, the review screen displays, for example, a video playback display area for playing model answers and videos shot by the learner, and text with character modifications (extended text) based on the generated extended text data. and a checklist display area for displaying the checklist. The retrospective screen data generation unit 234 generates retrospective screen data based on the generated extended text data and the checklist stored in the training content database 214 . The retrospective screen data generation unit 234 transmits the generated retrospective screen data to the learner terminal 30 via the communication interface unit 220 .

The report processing unit 235 processes the learner's report uploaded from the learner terminal 30 . For example, the report processing unit 235 acquires a report uploaded from the learner terminal 30 of each learner and received by the communication interface unit 220 , and controls such that the report is stored in the learner database 212 .

The evaluation screen data generation unit 236 generates evaluation screen data for displaying on the instructor terminal 40 an evaluation screen for the instructor to evaluate the learner's role-playing. Specifically, the evaluation screen data generator 236 generates evaluation screen data based on the obtained report and the checklist checked by the learner. The evaluation screen data generation section 236 transmits the generated evaluation target screen data to the instructor terminal 40 via the communication interface section 220 .

The evaluation result processing unit 237 acquires evaluation result data including evaluation results uploaded from the instructor terminal 40 for the transmitted evaluation screen data. The evaluation result processing unit 237 stores the acquired evaluation result data in the learner database 212 . In addition, the evaluation result processing unit 237 transmits the acquired evaluation result data to the learner terminal 30 in response to the learner's request.

FIG. 5 is a block diagram showing an example of the configuration of a learner terminal in the training support system according to one embodiment of the present invention. As shown in the figure, the learner terminal 30 of the present embodiment includes components such as a control unit 301, a storage unit 302, a communication interface unit 303, a user interface unit 304, and an imaging unit 305. be.

The control unit 301 comprehensively controls the operation of the learner terminal 30 . The control unit 301 is realized by cooperation of various hardware resources and software resources by executing an application program on the OS under the control of the processor. Under the control of the processor, the control unit 301 executes, for example, a browser program to realize a browser on the user interface unit 304, and controls various processes to be executed via the browser.

For example, the control unit 301 functions as a role-playing video data acquisition unit that controls the shooting unit 305 under the operation of the learner, shoots the implementation status of the learner's role-playing, and acquires role-playing video data. . The control unit 301 also functions as a role-playing video data transmission unit that performs control such that role-playing video data acquired by shooting is uploaded to the training support server 20 via the communication interface unit 303 . The control unit 301 also functions as a review screen data reception unit that receives review screen data transmitted from the training support server 20 via the communication interface unit 303 . Further, the control unit 301 functions as a display control unit that performs control so that the received retrospective screen is displayed on the browser on the user interface unit 304 . The control unit 301 also functions as a report creation unit that creates a report based on the checklist checked by the learner on the review screen and uploads it to the training support server 20 via the communication interface unit 303 . Also, the display control unit of the control unit 301 reproduces and displays a moving image based on model answer moving image data transmitted from the training support server 20 via the communication interface unit 303 .

The storage unit 302 stores various programs and data, and is used by the control unit 301 . For example, the storage unit 302 stores an OS and various application programs. A browser program is an example of an application program.

The communication interface section 303 enables computer communication with the training support server 20 via the communication network 10 . For example, the communication interface unit 303 performs IP-based computer communication with the training support server 20 to enable transmission and reception of various data. Communication interface section 303 may include, for example, a transmitter and a receiver.

The user interface unit 304 is a component for interactively operating the learner terminal 30 by the learner. The user interface unit 304 includes, for example, input devices such as a keyboard and mouse, and output devices such as a display and speakers. Alternatively, the user interface unit 304 may be configured integrally with an input device and an output device such as a touch panel.

A photographing unit 305 is a camera module capable of photographing still images or moving images, for example. In the present disclosure, for the sake of convenience, the imaging unit 305 includes an audio input device (not shown) such as a microphone that collects audio or the like in conjunction with video imaging. The shooting unit 305 outputs moving image data obtained by shooting a moving image and audio data associated therewith to the control unit 301 .

Note that in the present disclosure, the imaging unit 305 is configured as part of the learner terminal 30 , but is not limited to this, and may be configured physically separate from the learner terminal 30 . For example, an intelligent device such as a smart phone having a video shooting function may correspond to the shooting unit 305 in the present disclosure. For example, the learner may shoot a role-playing video using a smartphone and transfer the video data to the learner terminal 30 .

The instructor terminal 40 has the same configuration as the learner terminal 30, but the imaging unit 305 may be omitted. Since the configuration of the instructor terminal 40 is the same as that of the learner terminal 30, the description thereof will be omitted.

6A to 6C are sequence charts for explaining an example of a series of processing flows in the training support system according to one embodiment of the present invention. 7 to 19 are diagrams showing examples of various screens displayed on the learner terminal in the training support system according to one embodiment of the present invention. A series of processing flows in the training support system will be described below with reference to FIGS. 6A to 6C and FIGS. 7 to 19. FIG.

Referring to FIG. 6A, the learner operates the learner terminal 30 to access the training site provided by the training support server 20 (S601). For example, the learner inputs the URL of the training site into the browser on the learner terminal 30, and the learner terminal 30 transmits an access request to the training site to the training support server 20 according to the URL.

Upon receiving an access request from the learner terminal 30, the training support server 20 generates and transmits training screen data in order to display the training top screen for the learner on the learner terminal 30 in response to this request. (S602). Typically, the training support server 20 receives an access request from the learner terminal 30, performs predetermined user authentication, and then provides the learner terminal 30 with a training top screen for each learner.

The learner terminal 30 receives the training screen data from the training support server 20, and based on this, for example, displays a training top screen 700 as shown in FIG. 7 on the user interface section 304 (S603). The training top screen 700 includes, for example, a navigation area 701, a guidance menu area 702, and a training menu area 703, as shown in FIG.

The learner can proceed to a desired training out of a plurality of training menus (three in this example) displayed in the training menu area 703 . Here, for example, it is assumed that the learner selects the "solve problem" button 703a of "1. product features (1): complete acquisition" (hereinafter referred to as "training I"). As a result, the learner terminal 30 requests the training support server 20 for the next screen of training I, and based on the screen data transmitted from the training support server 20, for example, displays a training screen 800 as shown in FIG. .

The training screen 800 is a screen for allowing the learner to demonstrate by role-playing the task of training I, "Describe typical functions of company product A." The learner can check the assignments and their explanations displayed on the training screen 800, and furthermore, can view the videos related to the assignments. The learner demonstrates role-playing in front of the imaging unit 305 according to the instructions shown on the training screen 800 . Under the operation of the learner, the learner terminal 30 captures the learner's role-playing, acquires role-playing video data, and uploads (transmits) this to the training support server 20 (S604 in FIG. 6A).

For example, the learner refers to the training screen 800 and selects the “preparation for recording” button 801 after grasping the content of the assignment. As a result, the learner terminal 30 requests the training support server 20 for the next screen, and based on the screen data transmitted from the training support server 20, for example, displays a training screen 900 as shown in FIG. Alternatively, the learner terminal 30 may receive selection of the “preparation for recording” button 801 and may control the content of the screen to switch to the training screen 900 according to the script embedded in the screen data. The learner selects a "start recording" button 901 on the training screen 900, and thereby the imaging unit 305 starts imaging. For example, FIG. 10 shows a training screen 1000 during imaging by the imaging unit 305 . When the learner ends the role-playing demonstration in front of the imaging unit 305 , the learner selects the “end recording” button 1001 on the training screen 1000 to end the imaging by the imaging unit 305 . As a result, the learner terminal 30 switches to a training screen 1100 as shown in FIG. 11, for example. On the training screen 1100, the learner selects the "Retake" button 1101 if he/she wishes to retake the video, and if he or she determines that there is no need to retake the video, selects "Make a report. ” button 1102 . When the learner selects the “create report” button 1102 , the learner terminal 30 uploads the captured role-playing video data to the training support server 20 . This completes the learner's role-playing of the task.

Returning to FIG. 6A, upon receiving the role-playing video data transmitted from the learner terminal 30, the training support server 20 stores it in the learner database 212 (S605). The role-playing video data is stored in the learner's training folder in the learner database 212 . Subsequently, the training support server 20 uses the text data generation unit 232 to generate text data based on the voice data associated with the role-playing video data, and stores the text data in the learner database 212 (S606).

Next, the training support server 20 uses the text processing unit 233 to refer to the keyword list of the training content database 214, extract text corresponding to the keyword registered in the keyword list, and apply predetermined attribute information to the extracted text. are associated to generate extended text data (S607). Subsequently, the training support server 20 refers to the training content database 214 and extracts a checklist corresponding to the training selected by the learner (S608). Further, the training support server 20 generates review screen data based on the generated extended text data and the extracted checklist in order to allow the learner to review the role-playing, and transmits it to the learner terminal 30 ( S609).

When the learner terminal 30 receives the review screen data transmitted from the training support server 20, the learner terminal 30 displays, for example, a review screen 1200 as shown in FIG. S610 in FIG. 6B). On the review screen 1200, the learner terminal 30 accepts a self-check that the learner reviews her/his own role-playing and inputs for each evaluation item in the checklist (S611). Further, when the learner terminal 30 receives an instruction to submit a report from the learner, the learner terminal 30 transmits report data including the checked checklist to the training support server 20 (S612). The training support server 20 receives the report data transmitted from the learner terminal 30 and stores it in the learner database 212 (S613).

As shown in FIG. 12, for example, a plurality of tabs 1201 are prepared on the retrospective screen 1200 . Here, an "exemplary report" tab 1201a and a "report 1" tab 1201b are shown. The learner can switch the display contents of the screen by selecting one of the tabs 1201 . For example, the learner can view the model answer video for the assignment by selecting the "model report" tab 1201a (see FIG. 15).

The “report 1” tab 1201b of the review screen 1200 includes a video playback display area 1202, a text display area 1203, a checklist display area 1204, and a lecturer comment area 1205. FIG. The moving image reproduction display area 1202 is an area for reproducing the learner's role-playing moving image data and displaying the role-playing moving image. A text display area 1203 is an area for displaying text based on speech during role-playing. The text displayed in the text display area 1203 is expanded text displayed so as to visually distinguish the texts corresponding to the keywords included in the keyword list. The figure shows an example in which texts such as "Completely understood", "Completely established", "Completely mastered", "Similar subject", "Completely understood", "Timing that is easy to forget", and "Learn again" are highlighted. It is In the checklist display area 1204, the learner watches the role-playing video reproduced and displayed in the video playback display area 1202, and while confirming the text displayed in the text display area 1203, points (evaluation items) for the answer to the assignment are displayed. This is an area for self-checking. The learner can check a check box provided in the checklist display area 1204 . A lecturer's comment area 1205 is an area for displaying comments made by the lecturer who guides the training.

The learner looks back on his or her own role-playing on the review screen 1200, and if necessary, selects the "create report again" button 1206 to start over from filming the role-playing and create a report again. . On the other hand, the learner can submit the report to the lecturer by selecting the "submit report" button 1207 on the review screen 1200. FIG. When the learner has finished submitting the review screen 1200 report, the learner can temporarily leave the training site.

After the learner selects the "make a report again" button 1206, shoots the role-playing and uploads the role-playing video data, selects the "make a report" button 1102 on the training screen 1100 as shown in FIG. Then, the learner terminal 30 displays a review screen 1300 by recreating the report as shown in FIG. 13 based on the review screen data transmitted from the training support server 20 . In the review screen 1300 shown in FIG. 13, a "report 2" tab 1201c is newly added. Similarly, the learner can obtain a review screen 1400 to which a tab 1201d has been added by recreating the report as shown in FIG. . Thus, even if the learner has already created a report, the learner can repeat the creation of the report by selecting the "create report" button 1102 as necessary.

Note that the learner can view a model answer screen 1500 as shown in FIG. 15 by arbitrarily selecting the "model report" tab 1201a. In the model answer screen 1500, the learner can watch the role-playing video of the model answer to the assignment in the video playback display area 1202', and can check the text based on the voice in the text display area 1203'. can. In addition, the learner can review each item on the checklist in checklist area 1204'. Also, the learner can check the explanation for the training and the assignment in the explanation area 1501 .

Returning to FIG. 6B, after storing the report data received from the learner terminal 30 in the learner database 212, the training support server 20 transmits a report submission completion notice to the instructor terminal 40 (S614). The report submission completion notification may be sent by push notification or by e-mail, for example.

The instructor terminal 40 receives the report submission completion notice transmitted from the training support server 20 and displays it on the user interface section (S614). Thereby, the lecturer can know that the report has been submitted by the learner who is taking the training.

Referring to FIG. 6C, the instructor who has received the report submission completion notification operates the instructor terminal 40 to access the training site provided by the training support server 20 (S615). The instructor selects, for example, the URL included in the report submission completion notification received, and thereby the instructor terminal 40 transmits an access request to the training site to the training support server 20 .

Upon receiving an access request from the instructor terminal 40, the training support server 20 generates and transmits evaluation screen data in order to display an evaluation screen for the instructor on the instructor terminal 40 (S616). Typically, the training support server 20 receives an access request from the instructor terminal 40 and provides an evaluation screen to the instructor terminal 40 after performing predetermined user authentication.

The instructor terminal 40 receives the training screen data from the training support server 20, and based on this, displays the evaluation screen on the user interface section of the instructor terminal 40 (S617). The instructor inputs an evaluation for the learner's report on the evaluation screen. The assessment screen may be similar to the review screen shown in Figures 12-14, for example, and may include a checklist. When the instructor inputs an evaluation for the learner's report, the instructor terminal 40 generates and transmits evaluation result data based on the input evaluation (S618).

Upon receiving the evaluation result data transmitted from the instructor terminal 40, the training support server 20 stores it in the learner database 212 (S619). Subsequently, the training support server 20 generates an evaluation completion notification and transmits it to the learner terminal 30 (S620). This allows the learner to know that the lecturer's evaluation of the submitted report has been completed.

When the learner terminal 30 receives the evaluation completion notice transmitted from the training support server 20, it displays it. This allows the learner to know that the instructor in charge of the training has completed the evaluation of the report.

The learner who has received the evaluation completion notice enters the URL of the training site into the browser on the learner terminal 30, and accesses the training site as described above (S621). As a result, the learner terminal 30 displays a training top screen 1600 as shown in FIG. 16, for example. On the training top screen 1600, a "comment present" icon 1601 is additionally displayed, and the learner can know that the lecturer's comment can be referred to. When the learner selects the icon 1601 , the learner terminal 30 receives this and transmits an evaluation result request to the training support server 20 .

Upon receiving an evaluation result request from the learner terminal 30, the training support server 20 refers to the learner database 212 in response to this, extracts the learner's evaluation result data, and based on this, an evaluation result screen is displayed. Data is generated and transmitted (S622).

The learner terminal 30 receives the evaluation result screen data from the training support server 20, and based on this, for example, displays an evaluation result screen 1700 as shown in FIG. 17 on the user interface section 304 (S623). In the evaluation result screen 1700 , a check is entered in the check box for the lecturer in the checklist display area 1204 , and the lecturer's comment is added in the lecturer's comment area 1205 .

As described above, according to the present embodiment, the learner demonstrates role-playing, which is the subject of the training, according to the training screen on the learner terminal 30, and records the role-playing video data obtained by filming the demonstration. It can be easily uploaded to the training support server 20. - 特許庁In addition, according to the present embodiment, the training support server 20 converts the voice into text based on the role-playing video data, and furthermore visually distinguishes the text corresponding to the keyword related to the task, thereby enabling the training to be performed. Since the content is presented to the learner, the learner can easily look back on the role-playing that he or she has demonstrated, and can reliably self-check individual evaluation items. In addition, the learner can upload a report based on the self-check to the training support server 20, receive an evaluation by the instructor, and easily confirm the evaluation result.

Each of the above embodiments is an example for explaining the present invention, and is not intended to limit the present invention only to these embodiments. The present invention can be embodied in various forms without departing from the gist thereof.

For example, in the methods disclosed herein, steps, actions or functions may be performed in parallel or in a different order without conflicting results. The steps, acts and functions described are provided as examples only and some of the steps, acts and functions may be omitted or combined together without departing from the scope of the invention. one, and other steps, operations, or functions may be added.

In addition, although various embodiments are disclosed in this specification, specific features (technical matters) in one embodiment may be added to other embodiments or Certain features in the embodiments can be substituted and such forms are included in the gist of the invention.

1... Training support system 10... Communication network 20... Training support server 210... Database 212... Learner database 214... Training content database 220... Communication interface unit 230... Task processing unit 231... Role-playing video data acquisition unit 232... Text data generation Unit 233 Text processing unit 234 Review screen data generation unit 235 Report processing unit 236 Evaluation screen data generation unit 237 Evaluation result processing unit 30 Learner terminal 301 Control unit 302 Storage unit 303 Communication interface unit 304 ... user interface section 305 ... photographing section 40 ... lecturer terminal

Claims (15)

A training support server communicably connected to a learner terminal of a learner and a lecturer terminal of a lecturer,
a learner database that stores information about the learner;
a training content database that associates and stores model answer video data related to videos showing role-playing model answers to assignments, a keyword list including a plurality of keywords related to the assignments, and a checklist along the model answers; ,
a role-playing video data acquisition unit that acquires from the learner terminal role-playing video data obtained by filming the role-playing demonstrated by the learner;
a text data generation unit that generates text data based on the audio data associated with the acquired role-playing video data;
Extended text obtained by associating predetermined attribute information with a specific text corresponding to at least one of the plurality of keywords included in the keyword list, among the plurality of texts included in the generated text data. a text processing unit that generates data;
generating review screen data including at least the text data and the checklist in order to display the review screen including the extended text data and the checklist stored in the training content database on the learner terminal; a review screen data generation unit that
a report processing unit that acquires from the learner terminal a report including evaluation items input by the learner for the checklist on the review screen based on the review screen data,
the retrospective screen data is configured to be able to reproduce and display the role-playing video data;
Training support server. wherein the retrospective screen is displayed in a manner in which the specific text to which the predetermined attribute information is added is visually distinguished;
The training support server according to claim 1. The predetermined attribute information is information that controls the retrospective screen to be displayed in a manner that is visually distinguished by at least one of emphasis, different color, bold, underline, italic, and blinking.
The training support server according to claim 2. the learner database stores the report received by the report processing unit;
The training support server according to any one of claims 1 to 3. further comprising an evaluation screen data generation unit that generates evaluation screen data including the extended text data and the report in order to display an evaluation screen based on the report received from the learner terminal on the instructor terminal;
The training support server according to any one of claims 1 to 4. further comprising an evaluation result processing unit that acquires evaluation result data including evaluation results input by the instructor on the evaluation screen from the instructor terminal,
The learner database stores the evaluation result data acquired by the evaluation result processing unit,
The training support server according to claim 5. The evaluation result processing unit controls to transmit the acquired evaluation result data to the learner terminal so that an evaluation result screen based on the evaluation result is displayed on the learner terminal,
The training support server according to claim 6. A learner terminal communicably connected to a training support server for supporting training for learners,
a filming unit for filming the role-playing performed by the learner;
a role-playing video data transmission unit that transmits the role-playing video data acquired by the imaging unit to the training support server;
receiving review screen data including a checklist for the role-playing and expanded text data based on text data converted from the voice data, transmitted from the training support server in response to the transmitted role-playing video data; a retrospective screen data receiving unit;
a display control unit that controls to display a retrospective screen on a user interface unit based on the received retrospective screen data;
The display control unit controls such that the role-playing video data is reproduced and displayed on the retrospective screen.
Learner terminal. The extended text data includes predetermined attribute information associated with specific text corresponding to a plurality of keywords related to the role-playing model answer,
The display control unit controls such that the extended text data is displayed on the user interface unit in such a manner that the specific text associated with the predetermined attribute information is visually distinguished in the retrospective screen data. ,
The learner terminal according to claim 8. The review screen includes an extended text data display area for displaying the extended text data, a checklist display area for displaying the checklist arranged adjacent to the extended text data display area, and the role-playing video data. and a video playback display area that plays back and displays the
The learner terminal according to claim 9. The user interface unit accepts evaluation items entered by the learner for the checklist,
The learner terminal according to claim 10. The learner terminal controls to transmit a report containing the received evaluation items to the training support server,
The learner terminal according to claim 11. The learner terminal receives evaluation result data including the instructor's evaluation result for the transmitted report,
The display control unit controls so that the evaluation results included in the received evaluation result data are displayed on the user interface unit.
The learner terminal according to claim 12. The learner terminal receives model answer video data related to a video showing a model answer of the role-playing,
The display control unit controls to display the video based on the model answer video data on the user interface unit.
A learner terminal according to any one of claims 8 to 13. A training support system comprising a training support server and a learner terminal communicably connected to the training support server,
The training support server is
a learner database that stores information about learners;
Materials related to assignments, model answer video data related to videos showing role-playing model answers to assignments, a keyword list including a plurality of keywords related to the assignments, and a checklist along the model answers are stored in association with each other. training content database,
a role-playing video data acquisition unit that acquires from the learner terminal role-playing video data obtained by filming the role-playing demonstrated by the learner;
a text data generation unit that generates text data based on the audio data associated with the acquired role-playing video data;
Extended text obtained by associating predetermined attribute information with a specific text corresponding to at least one of the plurality of keywords included in the keyword list, among the plurality of texts included in the generated text data. a text processing unit that generates data;
Review generating review screen data including the text data and the checklist in order to display the review screen including the checklist stored in the training content database and the extended text data on the learner terminal. a screen data generator;
a report processing unit that acquires from the learner terminal a report including evaluation items input by the learner for the checklist on the review screen based on the review screen data,
the retrospective screen data is configured to be able to reproduce and display the role-playing video data,
The learner terminal,
a filming unit for filming the role-playing performed by the learner;
a role-playing video data transmission unit that transmits the role-playing video data acquired by the imaging unit to the training support server;
Review screen data including the checklist for the role-playing and the extended text data based on the text data converted from the voice data, transmitted from the training support server in response to the transmitted role-playing video data. a retrospective screen data receiving unit that receives the
a display control unit that controls to display a retrospective screen on a user interface unit based on the received retrospective screen data;
Training support system.

Images