WO2003098524A1 - Teaching material display method and program - Google Patents

Abstract

A client (20) which displays an animations and a document distributed from a learning server (10) on different regions and displaying each page of the document sequentially according to the progress of the animation is so constituted as to display a page unrelated with the progress of the animation. The client is so constituted that the progress of the animation may synchronize with that of the document upon the entry of a predetermined instruction while a page unrelated with the progress of the animation.

Description

 P T / JP02 / 10349

 Specification

Teaching material display method and teaching material display program

 The present invention causes a client device to display a document and a moving image distributed from a supermarket device in a so-called e-learning, and causes a computer to function as a device for realizing such a learning material display method. Related to the teaching material display program.

Background art

 In recent years, learning support systems using networks and Web (World Wide Web) technologies have been developed. In this system, a learner (learning student) uses a browser to access a learning server, which is a web server, so that the learner can take courses offered on the web.

 When a student starts attending a course, a predetermined program is transmitted from the learning server device to the client apparatus of the student, and the program is started. Then, at least two rectangular frames are formed in the window under the control of the browser.

After that, the client device is delivered with a document file that stores the electronic data of the textbooks and reference materials used in the course, as well as taking a picture of the lecture using the textbook and the like. Video and audio electronic data obtained by recording will be streamed. Then, the client device displays one page of the document in one frame of the window, displays the moving image in the other frame, and outputs audio synchronized with the moving image from the speaker. Also, in this client device, each page of the document is sequentially displayed one by one in accordance with the progress of the lecture being shown. Because of this, students

The state of the lecture shown in the window, the sound output from the speakers, and the documents displayed sequentially in the window according to the progress of this lecture indicate that you are present. In the same way, in the conventional learning support system as described above, the page goes on arbitrarily according to the progress of the video, so the student can skip the part of the page that he missed during the lecture. I couldn't read that page even if I wanted to read it again, or if I wanted to read the previous page.

 In order to deal with this problem, it is conceivable to completely separate the progress of the video from the progress of the document. However, even if the student displays a page unrelated to the content of the lecture, and then tries to return to the page synchronized with the content of the lecture, the video will automatically progress over time It is actually very difficult to return a page.

 Therefore, an object of the present invention is to make it possible to learn the contents before and after the contents of the lecture even while the student is using the learning support system to listen to the lecture, and It is an object of the present invention to provide a teaching material display method capable of returning to a page synchronized with the above, and a teaching material display program for functioning a view as a device for realizing such a teaching material display method. Disclosure of the invention

The teaching material display method according to the present invention configured to solve the above-mentioned problem is a method in which a server device on a network uses a moving image data composed of a plurality of frames and a document data of a document composed of a plurality of pages. In the evening, link information about the frame and the page to be displayed at the same time The client device on the network displays a moving image based on the moving image data streamed from the server device in a first display area on a display, and the link information received from the server device. According to the learning support system for sequentially displaying documents based on document data distributed from the server device in a second display area different from the first display area, When an input for designating any page in the document is received while displaying a moving image in the display area of (1), the page displayed in the second display area is changed according to the input. When switching to the specified page and receiving an input indicating a synchronization instruction, the progress of the video and the progress of the document are synchronized according to the link information. Is characterized by

 With this configuration, the operator (student) who operates the client device and accesses the server device can specify an arbitrary page and continue moving the moving image in the first display area. Page can be displayed in the second display area. Therefore, the student can read the missed portion again during the course or can read the previous page. In other words, the student can learn the contents before and after the content during the lecture during the lecture. Of course, even if a page different from the page corresponding to the video displayed in the first display area is displayed in the second display area, the student can enter the synchronization instruction and proceed with the video. And the progress of the document. Therefore, the page of the content corresponding to the content being lectured can be displayed in the second display area, or the video when the content of the page being displayed in the second display area is lectured can be displayed in the second display area. 1 can be displayed in the display area.

In addition, the teaching material display program according to the present invention configured to solve the above-described problem distributes moving images and documents from a server device on a network. An instruction to display a screen having a first display area and a second display area on the display and display a page irrelevant to the progress of the moving image is input to a computer having a display. Then, the page is displayed in the second display area, and when a predetermined instruction is input, the progress of the moving image and the progress of the document are synchronized and displayed on the display.

 Therefore, according to the teaching material display program of the present invention, it is possible to cause a computer to function as a device for implementing the above-described teaching material displaying method. BRIEF DESCRIPTION OF THE FIGURES

 FIG. 1 is an overall configuration diagram of a system according to a first embodiment of the present invention.

 FIG. 2 is a schematic diagram showing the overnight layout of scenario DB. FIG. 3 is a flowchart showing a content control process.

 FIG. 4 is a diagram showing the attendance screen.

 FIG. 5 is a flowchart showing an automatic synchronization subroutine. FIG. 6 is an explanatory diagram showing the relationship between the displayable area of the display and the attendance screen.

 FIG. 7 is a flowchart showing an automatic screen size changing subroutine.

 FIG. 8 is a flowchart showing a manual synchronization subroutine. FIG. 9 is a flowchart showing a manual screen size changing subroutine.

FIG. 10 is an explanatory diagram showing the relationship between the window and the attendance screen. Fig. 11 shows the relationship between the displayable area of the display and the attendance screen. FIG.

 FIG. 12 is a flowchart showing a content control process according to the second embodiment of the present invention.

 FIG. 13 is a diagram showing the attendance screen. BEST MODE FOR CARRYING OUT THE INVENTION

 Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. Embodiment 1

 FIG. 1 is an overall configuration diagram of a learning support system according to a first embodiment. This learning support system consists of a learning server device 10 which is a server installed in the e-learning center and one or more learning server devices 10 connected to the learning server device 10 via a network. It is composed of a client device 20.

 The learning server device 10 includes a CPU 10P, and a storage unit 10M including a hard disk and a memory connected to the CPU 10P. In the storage unit 10M, a learning support program 10L that is read and executed by the CPU 10P is installed, and is prepared for downloading to the client device 20 that has accessed it. Content control program 1 is installed. The storage unit 10M stores a document DB 11, a video / audio DB 12, and a scenario DB 13, respectively. The learning support program 10L has a web server • program module and a server side program module.

The client device 20 is a general personal computer having an input device such as a mouse or a keyboard, a display, a speaker, and a main body connected thereto. It consists of 10349 computers. The main body is provided with a CPU 20P and a storage unit 20M composed of a hard disk and a memory connected to the CPU 20P. A web browsing program (web browser) 21 is installed in the storage unit 20M, and a streaming content playback program is installed as a plug-in software of the web browser 21. 22 and the document display program 23 are installed. The streaming content playback program 22 is a program for playing back content (video and audio) streamed and delivered from a server-computer via a network. The document display program 23 is a program for displaying a document in a document file one page at a time. Then, the student can access the course provided by the learning server device 10 by accessing the learning server device 20 from the client device 20.

The learning materials provided by the learning server device 10 include a document file that stores electronic data (corresponding to document information) of documents such as textbooks and reference materials, and images of lectures using the documents. It consists of a video and audio file that stores video and audio electronic data (equivalent to video information) obtained by recording, and a scenario file. As shown in Fig. 2, the scenario file records correspondence information (corresponding to link information) in which the page number of a document is associated with the frame number of a video in which a lecture using that page is started. ing. These document files, video / audio files and scenario files are stored in the document DB 11, video / audio DB 12 and scenario DB 13, respectively. One course is composed of a plurality of chapters, and for each chapter, a set of document files, video / audio files, and scenario files is prepared. When a student attends a course, he / she responds to the unlearned chapters in that course. Acquire teaching materials and advance learning.

 By the way, when a student attends a course, the learning server device 10 'requests the client device 20 to start the content control program 1. At this time, if the content control program 1 is installed in the storage unit 20M, the client device 20 reads out the program 1 from the storage unit 20M and starts up. On the other hand, when the program 1 is not installed in the storage unit 20M, the client device 20 downloads the program 1 from the learning server device 10 and installs the program 1 in the storage unit 20M. Later, the program 1 is started.

 <Process when attending>

 Hereinafter, processing when a student takes a certain teaching material will be described. The student operates the client device 20 to start the web browser 21 and accesses the learning server device 20. Then, the learner notifies the learning server device 20 that he / she starts taking unlearned chapters in a certain course. Then, the learning server device 10 requests the client device 20 to start the content control program 1.

 Then, the client device 20 newly displays a window under the control of the web browser 21 on the display, activates the content control program 1, and starts the content control process. Fig. 3 shows the content of the content control process.

As shown in FIG. 3, first, the client device 20 displays the attendance screen in a window (hereinafter simply referred to as a window) under the control of the web browser 21 (S 1 0 1). Fig. 4 shows an example of the screen. As shown in FIG. 4, the attendance screen 30 is displayed in the window in the same size. Screen 3 for this course 0 is divided into three regions by three rectangular frames 31 to 33. Of the three frames 31 to 33, the first frame 31 is arranged so that its upper left corner coincides with the upper left corner of the attendance screen 30. Also, the second frame 32 is arranged so that it is close to the first frame 31 on the right side of the first frame 31 and the upper right corner thereof coincides with the upper right corner of the attendance screen 30. Have been. Also, the third frame 33 has the same width as the width of the first frame 31, and the attendance screen 30 is arranged so as to occupy the entire area under the first frame 31. Located in the lower left corner. Then, an image is displayed in the first frame 31 by the function of the streaming content / reproduction program 22. That is, in the first frame 31, a rewind button 31a, a fast-forward button 31b, a playback position display bar 31c, and the like are displayed, and a moving image is displayed frame by frame. Therefore, the inside of the first frame 31 functions as a moving image display unit. In the second frame 32, an image is displayed by the function of the document display program 23. That is, in the second frame 32, buttons 32a to 32d for displaying the first page, one page before, one page after, and the last page are displayed, and one page in the document is displayed. Is displayed. Therefore, the inside of the second frame 32 functions as a document display unit. In the third frame 33, two buttons 33a and 33b are displayed. In the area of the first button 33 a, for example, “Display the page corresponding to the currently playing lecture” is described, and in the area of the second button 33 b, for example, “displaying Play the lecture corresponding to the page "." The functions of the first and second buttons 33a and 33b will be described later. In addition, although not shown, in the third frame 33, there is displayed a klitzkapple button in which the title of each chapter of the course is described. Students can listen to a lecture in another chapter by clicking any of the click buttons. Therefore, the inside of the third frame 33 functions as an operation unit. [0210349] Then, after displaying the attendance screen 30 as shown in Fig. 4, the client device 20 substitutes the time at this time into the variable T and substitutes zero into the variable F (S 1 02). Then, the client device 20 waits until a scenario file is received from the learning server device 20 (S103), and upon receiving the scenario file, stores the received scenario file in the storage unit 20M (S104). ). Thereafter, the client device 20 waits until a document file is received from the learning server device 10 (S105), and upon receiving a document file, stores the received document file in the storage unit 20M ( S106), the first page of the document data in the document file is displayed in the second frame 32 (document display section) in accordance with the document display program 23 (S107). Thereafter, the client device 20 waits for a video / audio file to be transmitted from the learning server device 10 (S108), and upon receiving the video / audio file, according to the streaming content playback program 22. Then, the moving image is displayed in the first frame 31 (moving image display section) (S109), and the sound is output from the speaker. Hereinafter, the description of the audio is omitted.

 Next, the client device 20 reads the time at this point (S110), and starts executing the automatic synchronization subroutine (S111). Figure 5 shows the contents of the automatic synchronization subroutine.

As shown in FIG. 5, first, the client device 20 reads the frame number of the frame currently displayed in the first frame 31 (moving image display section) at this point (S201). It is determined whether or not the read frame number matches the value of the variable F (S202). If the read frame number matches the value of the variable F (S202; YES), the client device 20 ends the automatic synchronization subroutine and returns the processing to the main routine in FIG. On the other hand, if the read frame number does not match the value of variable F and In this case (S202: NO), the client device 20 updates the frame number by substituting the frame number into the variable F (S203). After that, the client device 20 specifies in the scenario file (see FIG. 2) whether the frame number is equal to this frame number, or specifies the most recent frame number before that (S204), and corresponds to the frame number. The page number to be read is read from the scenario file (S205), the page number of the page displayed in the second frame 32 (document display section) is read (S206), and the frame number is read. Then, it is determined whether or not the page number corresponding to matches the page number being displayed (S207). If they match (S207; YES), the client device 20 ends the automatic synchronization subroutine and returns the processing to the main routine in FIG. On the other hand, if the two do not match (S207; N〇), the client device 20 determines the size (X1, Y1) defined in the page of the page number corresponding to the frame number. Read (S208), execute the automatic screen resizing subroutine described later with reference to FIG. 6 (S209), and set the size of the attendance screen 30 (ie, the size of the window) and the second The size of the frame 32 and the display magnification of the page are determined. The client device 20 displays the attendance screen 30 (window) and the second frame 32 on the display at the determined size, and determines the display magnification determined according to the document display program 23. To display the entire page in the second frame 32 (document display section) (S210). Thereafter, the client device 20 ends the automatic synchronization subroutine, and returns the processing to the main routine of FIG.

Before describing the contents of the above-described automatic screen size change subroutine (S209), the relationship between the size of the displayable area of the display and the size of the attendance screen 30 will be described. FIG. 6 is a schematic diagram for explaining the relationship. The schematic diagram in Fig. 6 shows the vertical The second frame includes the horizontal size (DXL, DYL) and the variables (EXL, EYL) for determining the horizontal and vertical sizes of the attendance screen 30 that occupies the entire window under the control of the web browser 21. Variables (T XL, T YL) for determining the vertical and horizontal sizes of 32 (document display section) are shown. In addition, this schematic diagram shows the screen 30 for attendance when two-dimensional coordinates are defined on the displayable area of the display and the upper left corner of the displayable area is defined as the coordinate origin (0, 0). Variables indicating the coordinates of the reference point (upper left corner) (EXO, E

Y 0) and variables (TX0, TY0) indicating the coordinates of the reference point (upper left corner) of the second frame 32 (document display section) are also shown. Note that the vertical and horizontal sizes of the first frame 31 (moving display section) are constant, and the reference point (EX 0, EY 0) of the attendance screen 30 is shifted from the reference point of the second frame 32 (TX The distance and direction to 0, TY0) are also constant. Therefore, when the coordinates (EXO, EY0) are determined, the coordinates (Τ0, Τ0) are also uniquely determined. Based on the above, the contents of the automatic screen size change subroutine will be described based on the flowchart of FIG.

 As shown in FIG. 7, the client device 20 sets the page size (Χ1, Υ1) to be displayed in the second frame 32 (document display section) at Multiply by the substituted display magnification, and substitute the obtained numerical value (数 値 * （1, ** Υ1) into the variable (ΤXL2, TYL2) (S301). Next, the client device 20 reads the size (DXL, DYL) of the displayable area of the display and the coordinates (ΤX0, ΤΤ0) of the reference point of the second frame 32 at this time. , The values of the above variables (TXL2, TYL2) are added to the values of the coordinates (ΤΧ ,, ΤΥ0), and the resulting values (TXL2 + TX0, TYL2 + TY0) It is determined whether or not TXL2 + TX0 is greater than DXL (S302). Further, the client device 20 has T

Determine whether YL 2 + TY 0 is greater than DYL (S303, S 304). Then, the client device 20 branches the process into four based on these determination results. The four processes after branching are described below in each case.

 First, if TXL2 + TX0 is larger than DXL and TYL2 + TY0 is larger than DYL (S302; YES, S303; YES), the client The device 20 subtracts the value of the reference point coordinates (TX 0, TY 0) of the second frame 32 (document display section) from the size of the displayable area (DXL, DYL), and obtains the obtained numerical value ( DXL—TX0, DYL—TY0) is assigned to the variable (TXL, TYL) (S311). Next, the client device 20 divides the value of the variable (TXL, TYL) by the page size (XI, Y1) and divides the obtained numerical value (TX LZX1, TYL / Y1) into the variable (TXLZX1, TYL / Y1). (1), (a2) (S312). Thereafter, the client device 20 determines whether the value of the variable 1 is greater than the value of the variable 2 (S313). If the value of the variable 1 is greater than the value of the variable 2 (S 3 13; YES), the client device 20 assigns the value of the variable 1 (= TXL / X 1) to the variable. The display magnification is determined by substituting, and the value (H * Y1) obtained by multiplying the value of the variable a by the vertical size Y1 of the page is substituted into the variable TYL (S31). Four ). On the other hand, if the value of the variable 1 is smaller than the value of the variable 2 (S 3 13; NO), the client device 20 sends the value of the variable α 2 (= TYL / Y 1) to the variable. To determine the display magnification, and multiply the value of the variable α by the horizontal size X 1 of the page (α: * Χ 1) to the variable 値 XL ( S 3 15). In this way, the values of the variables (Τ X L, Τ Υ L) are determined.

Second, when TXL 2 + TX 0 is larger than DXL and TYL 2 + TY 0 is less than DYL (S 302; YE S, S 303; NO ), The client device 20 subtracts the value of the X coordinate TX0 of the reference point of the second frame 32 (document display section) from the size DXL beside the displayable area, and obtains the obtained value (DXL—TX0 ) Is assigned to the variable TXL (S321). Next, the client device 20 divides the value of the variable TXL by the vertical size X1 of the page and substitutes the obtained numerical value (TXL / X1) into the variable (S322) to display the value. Determine the magnification. Then, the client device 20 substitutes the value (H * Y1) obtained by multiplying the value of the variable H by the horizontal size Y1 of the page into the variable TYL (S323). In this way, the value of the variable (TXL, TYL) is determined.

 Third, if TXL 2 + TX 0 is less than DXL and TYL 2 + TY 0 is larger than DYL (S302; NO, S304; YES), the client device 20 displays Subtract the value of the y coordinate TY 0 of the reference point of the second frame 32 (document display) from the vertical size DYL of the possible area, and substitute the obtained value (DYL—TY 0) for the variable T YL Yes (S331). Next, the client device 20 divides the value of the variable TYL by the vertical size Y1 of the page and substitutes the obtained numerical value (TY LZY 1) into the variable H (S332) to display the value. Determine the magnification. Then, the client device 20 substitutes the value (α * Χ1) obtained by multiplying the value of the variable “H” by the horizontal size XI of the page into the variable ΤXL (S333) . In this way, the value of the variable (TXL, TYL) is determined.

After the value of the variable (TXL, TYL) is determined by performing the processing in any of the first to third cases, the client device 20 moves from the reference point on the attendance screen 30 to the second frame. Value obtained by adding the value of the variable (TXL, TYL) to the difference (TX0—ΕX0, TY0—EY0) to the reference point of 32 (TX0—EXO + TXL, TY0-EY0) + TY L) is assigned to the size variable (EXL, EYL) of the attendance screen 30 9

(S305). After determining the values of the variables (EXL, EYL) in this way, the client device 20 ends the automatic screen size change subroutine, and returns the processing to the automatic synchronization subroutine of FIG.

Fourth, when TXL 2 + TX 0 is less than DXL and TYL 2 + TY 0 is less than DYL (S 302; NO, S 304; N 0), the client device 20 Then, it is determined whether or not the value of the variable TXL2 is larger than the value of the variable TXL at this time (S341). If the value of the variable TXL2 is larger than the value of the variable TXL (S341; YES), the client device 20 keeps the value of the variable TXL as it is and executes the processing in S Proceed to 343. On the other hand, if the value of the variable TXL2 is less than or equal to the value of the variable TXL (S341; NO), the client device 20 substitutes the value of the variable TXL2 for the variable TXL, The value (TX O—EX 0 + T) obtained by adding the value of the variable TXL to the horizontal difference (TX O—EX 0) from the reference point on the attendance screen 30 to the reference point of the second Azusa 32 (XL) is substituted for the variable EXL in the horizontal size of the attendance screen 30 (S342), and then the process proceeds to S343. In S343, the client device 20 determines whether the value of the variable TYL2 is greater than the value of the variable TYL at this time. If the value of the variable TYL2 is larger than the value of the variable TYL (S343; YE S), the client device 20 keeps the value of the variable TYL as it is. On the other hand, if the value of the variable TYL2 is less than or equal to the value of the variable TYL (S343; NO), the client device 20 substitutes the value of the variable TYL2 for the variable TYL and Take the value (TY0—EY0 + TYL) obtained by adding the value of the variable TYL to the vertical difference (TY0—EY0) from the reference point of the surface 30 to the reference point of the second frame 32. It is assigned to the variable EYL of the vertical size of the display screen 30 (S344). After determining the values of variables (EXL, EYL) in this way Then, the client device 20 ends the automatic screen size changing subroutine, and returns the processing to the automatic synchronization subroutine of FIG.

 Then, after returning to the automatic synchronization subroutine, the client device 20 changes the size of the attendance screen 30 based on the variables (EXL, EYL), and displays the entire page at the display magnification based on the variable α. It is displayed in the frame 32 of S2 (S210). Thereafter, the client device 20 ends the automatic synchronization subroutine, and returns the processing to the main routine of FIG.

After returning to the main routine, the client device 20 closes the window (end of the course) and clicks one of the first and second buttons 33a and 33b. It is determined whether or not an event has occurred (S112). Then, when no event has occurred (S112; NO), the client device 20 advances the processing to S116. On the other hand, if any event has occurred (S112; YES), the client device 20 is caused by the operation of closing the window (end of the course) by the event. It is determined whether or not this is the case (S113). If the event is an operation to close the window (S113; YES), the client device 20 ends the main routine in FIG. At this time, the client device 20 terminates the execution of the web browser, but deletes the scenario file and the document file stored in the storage unit 20M according to the program at the time of terminating the web browser. On the other hand, if the event was not the operation of closing the window (S113: NO), the client device 20 sends the event by clicking the first and second buttons 33a and 33b. It is determined whether or not there is a lock (S114). If the event is not clicked on each of the buttons 33a and 33b (S114; N0), the client device 20 advances the process to S116. On the other hand, when the event is a click of each button 33a, 33b (S114; YES) ), The client device 20 starts execution of the manual synchronization subroutine (S115). Fig. 8 shows the contents of this manual synchronization subroutine.

 As shown in FIG. 8, first, the client device 20 determines whether or not the event is a click of the first button 33a (S401). If the event is the click of the first button 33a (S401; YE S), the client device 20 determines that the progress of the document is synchronized with the progress of the moving image. Reads the frame number of the frame displayed in the first frame 31 (moving image display section) (S402), and identifies the latest frame number before this frame number in the scenario file Yes (S403). Then, the client device 20 reads the page number corresponding to this frame number from the scenario file (S 404), and places the page of this page number in the second frame 32 (document according to the document display program 23). (S405). Thereafter, the client device 20 ends the manual synchronization subroutine, and returns the processing to the main routine in FIG.

 On the other hand, if the event was not a click on the first button 33a, that is, if the event was a click on the second button 33b (S401; N I), The client device 20 determines that the progress of the moving image is synchronized with the progress of the document, and reads the page number of the page displayed in the second frame 32 (document display section). (S406). Then, the client device 20 reads the frame number corresponding to this page number from the scenario file (S407), and according to the streaming content playback program 22, stores the frame of this frame number in the first frame. It is displayed in the frame 31 (moving image display section) (S408). Thereafter, the client device 20 terminates the manual synchronization subroutine, and returns the processing to the main routine of FIG.

After the end of this manual synchronization subroutine, or S 1 1 2 or S 1 1 After the completion of step 4, the client device 20 determines whether or not the time read in S110 is one second after the time set in the variable T (S111). 6). If the time is not a time after one second has elapsed from the time of the variable T (S116: NO), the client device 20 returns the processing to S110. On the other hand, when the time is one second after the time of the variable T (S116; YE S), the client device 20 substitutes the time into the variable T and updates (S116). 1 17), start execution of the manual screen size change subroutine (SI 18). Fig. 9 shows the contents of this screen size change subroutine.

 As shown in FIG. 9, first, the client device 20 turns off the size change flag (S501), and sets the horizontal length of the window 30, under the control of the web browser 21. And the horizontal length of the attendance screen 30 (variable EXL) is read (S502). FIG. 10 is an explanatory diagram showing the size relationship between the attendance screen 30 and the window 30 under the control of the web browser 21. According to the screen size change subroutine, when the frame of the window 30, is dragged, the size of the window 30 'can be changed. Therefore, in FIG. 10, the window 30 and the attendance screen 30 are shown separately for convenience of explanation.

Next, the client device 20 determines whether or not the value of the variable BXL is equal to the value of the variable EXL (S503). If both values are the same (BXL-EXL) (503; YES), the client device 20 advances the processing to S505 without changing the value of the variable EXL. On the other hand, if both values are different from each other (BXL ≠ EXL) (S503: NO), the client device 20 updates the variable EXL by substituting the value of the variable BXL, and updates the size. After the change flag is turned on (S504), the process proceeds to S505. Next, the client device 20 reads the vertical length of the window (variable BYL) and the vertical length of the attendance screen 30 (variable EYL) (S505), and the variable BYL It is determined whether or not the value of is equal to the value of the variable EYL (S506). If the two values are the same (BYL = EYL) (506; YE S), the client device 20 advances the processing to S508 without changing the value of the variable EYL. . On the other hand, when both values are different from each other (BYL ≠ EYL) (S506: NO), the client device 20 updates the size change flag by substituting the value of the variable BYL for the variable EYL. Switch on (S507). At this time, if the size change flag has already been turned on, the client device 20 keeps the ON state.

 Thereafter, the client device 20 determines whether the size change flag is on or off (S508). If the size change flag is off (S508; OFF), the client device 20 ends the screen size change subroutine, and returns the processing to the main routine of FIG. On the other hand, if the size change flag is on (S508; 〇N), the client device 20 changes the size of the attendance screen 30 based on the values of the variables EXL and EYL. Then, the size of the attendance screen 30 is made to match the size of the window 30 ', and the attendance screen 30 is displayed in the window 30 (S509). Thereafter, the client device 20 ends the screen size changing subroutine, and returns the processing to the main routine in FIG. After returning to the main routine, the client device 20 returns the process to S110.

 <Operation of the first embodiment>

By performing the processing described above, the student is displayed on the attendance screen 30 while the student accesses the learning server device 10 from the client device 20 and attends the lecture. Button 3 2 a to 3 2 d When the user clicks, a page unrelated to the progress of the moving image is displayed in the second frame 32 (document display section). At this time, the video of the lecture continues to be displayed in the first frame 31 (video display section) without delay according to the streaming content playback program 22 (S110 to S112, S116-S118).

In addition, when the page that should be displayed according to the content of the lecture does not match the page that is actually displayed, the page that should be displayed is switched to the next page as the video progresses. In this case, the page displayed in the second frame 32 switches from the page irrelevant to the progress of the video to the next page (Sill, S201 to S210). In the state where the content of the page does not match the content of the actually displayed page, when the student clicks the first button 33a, the content is displayed in the first frame 31 (moving image display section). A page corresponding to the content of the lecture being displayed is displayed in the second frame 32 (document display section) (S110 to S116, S401, S402 to S405) . Conversely, in the above state, when the student clicks the second button 33b, the video of the lecture shown in the first frame 31 (the video display section) is displayed in the second button 33b. Skip or play back to a location corresponding to the content of the page displayed in the frame 32 (document display section) (S110-S116, S401, S406-S408 When the student changes the size of the window by operating the mouse, the size of the attendance screen 30 is changed according to the change in the size of the window (S118, S501 to S 508) Then, the attendance screen 30 is displayed in the window while the size of the attendance screen 30 matches the size of the window (S509). Also, in the second frame 32 (document display section), each page of the document data is displayed one page at a time in accordance with the progress of the video of the lecture (S111). When the display moves from to the next page, if you try to display the entire next page with the display magnification of the previous page, as shown in Fig. 11, it must be outside the attendance screen 30. It may disappear (S302; N0, S304; N0, S334, S343). In this case, the size of the attendance screen 30 is enlarged while the reference point of the attendance screen 30 is fixed on the displayable area of the display (S342, S344). The next page is displayed in the second frame 3 2 at the same magnification o

 Also, when trying to display the entire next page with the display magnification of the previous page, it may be necessary to protrude from the displayable area of the display (S302, S303, S304; NO ). In this case, the size of the attendance screen 30 is enlarged while the reference point of the attendance screen 30 is fixed on the displayable area (S311 to S315, S321, S3 3 2 3, S 3 3 1, S 3 3 3), the right edge and the lower edge of the attendance screen 30 are in contact with the right edge and the Z or lower edge of the displayable area. The size of the frame 32 of 2 is reduced (S314, S315, S322, S332). As a result, the entire next page is displayed in the second frame 32 with its display magnification reduced.

 <Summary>

As described above, according to the first embodiment, while the video is being displayed in the first frame 31, the student uses the page used in the lecture in the second frame 32. A different page can be displayed. Therefore, the student turns over the page before the page where the lecture is given, confirms the meaning of the forgotten lexical, or turns over the previous page, and goes ahead of the content during the lecture. The contents of PC so-called orchid 49 can be grasped in advance. In other words, while listening to the lecture, the student can learn the contents before and after the contents of the lecture. Of course

Even if the progress of the video and the progress of the document are not synchronized, the first and second buttons 33a and 33b can be easily synchronized by operating the first and second buttons 33a and 33b. it can. Therefore, even when a textbook or reference material is made of paper and another page is opened from the page where the lecture is being conducted, it is easy to return to the page being lectured.

 Further, according to the first embodiment, it is checked every second whether or not the size of the window has been changed. If the size has been changed, the window is prioritized for processing the moving image. Change the size. Therefore, even if the CPU is busy with the processing of the moving image, it does not take much time to complete the window size change.

 Further, according to the first embodiment, even if the size of each page of the document varies, the attendance screen 30 and the second frame 3 2 are automatically set according to the size of each page. Is changed, and the display magnification is changed. This ensures that the entire page will be displayed, and that the student will be able to see the entire page while listening to the lecture without having to remember the discomfort of not being able to see part of the page. You can listen to the lectures comfortably without performing any cumbersome operations such as enlarging the window. Embodiment 2

The second embodiment of the present invention is an example in which the user can switch between a state where the moving image and the document are synchronized and a state where the moving image and the document are not synchronized. The second embodiment is different from the first embodiment in that the content of the processing by the content control program is slightly different, and that some buttons are added to the attendance screen. It has the same configuration. Therefore Hereinafter, differences from the first embodiment will be described.

 Similarly to the client device 20 according to the first embodiment, the client device 20 according to the second embodiment receives the request to start the content control program, reads the content control program, and executes the content control process. Start. FIG. 12 shows the content of the content control processing according to the second embodiment.

 As shown in FIG. 12, the client device 20 first displays the attendance screen in a window under the control of the web browser 21 (hereinafter simply referred to as a window) (S 6 0 1). Figure 13 shows an example of the screen. As shown in FIG. 13, the attendance screen 40 of the second embodiment has the same size in the window as the attendance screen 30 of the first embodiment. The inside is divided into three regions by three rectangular frames 41 to 43 having functions as a moving image display unit, a document display unit, and an operation unit. Note that, in addition to the rewind button 41 c, the fast forward button 41 d, and the playback position display bar 41 e similar to the first embodiment, the play button 41 a and the stop button 4 lb is displayed. The operation unit 43 displays an asynchronous button 43 a in addition to the first button 43 b and the second button 43 c as in the first embodiment. The function of the asynchronous button 43a will be described later.

Then, after displaying the attendance screen 40 as shown in FIG. 13, the client device 20 substitutes the time at this time into the variable T, and substitutes zero into the variable F. Assign zero to the variable S (S602). Then, the client device 20 waits for a scenario file to be transmitted from the learning server device 20 (S603), and upon receiving the scenario file, stores the received scenario file in the storage unit 20. Memorize in M (S604) . Thereafter, the client device 20 waits for a document file to be transmitted from the learning server device 10 (S605), and upon receiving the document file, stores the received document file in the storage unit 2. 0 M is stored (S606), and the first page of the document file in the document file is displayed in the second frame 42 (document display section) according to the document display program 23. (S607). Thereafter, the client device 20 waits for a video / audio file to be transmitted from the learning server device 10 (S608), and upon receiving the video / audio file, the streaming content. In accordance with the playback program 22, the video is displayed in the first frame 41 (video display section) (S609), and the sound is output from the speaker. Hereinafter, the description of the audio will be omitted.

 Subsequently, the client device 20 closes the window (end of the course) and clicks the asynchronous button 43a, the first button 43b, and the second button 43c. It is determined whether any of the events of the event has occurred (S610). If no event has occurred (S610; NO), the client device 20 determines whether the value of the variable S is 0 or 1 (S611). ). When the value of the variable S is 1 (S611; 1), the client device 20 advances the process to S619, and when the value of the variable S is 0 (S611). 11; 0), the display of the page is synchronized with the moving image by executing the automatic synchronization subroutine described with reference to FIG. 5 (S612), and then the process proceeds to S619.

On the other hand, if any event has occurred (S610; YES), the client device 20 determines whether the event is an operation to close the window (end of the course). Is determined (S613). If the event is an operation to close the window (S613; YES), the client device 20 ends the main routine shown in FIG. At this time, the client device 20 also terminates the execution of the web browser, The scenario file and the document file stored in the storage unit 20M are deleted according to the program at the time of termination of the web browser. On the other hand, if the event is not due to the operation of closing the window (S613; NO), the client device 20 determines whether the event is a click on the asynchronous button 43a or not. Then, it is determined whether the click is performed by clicking the second button 43a or 43b (S6114). If the event is a click of the asynchronous button 43 a (S 614; YES), the client device 20 substitutes 1 for the variable S (S 615) and executes the processing. Proceed to S619. On the other hand, if the event is not the click of the asynchronous button 43 a (S 614; YES), the client device 20 determines whether the event is the first and second buttons 43 b, 4. It is determined whether or not the click is 3c (S6 16). If the event is not a click on any of the buttons 43a and 43b (S616; NO), the client device 20 advances the process to S619. On the other hand, if the event is a click on one of the buttons 43b and 43c (S6 16; YES), the client device 20 substitutes zero for the variable S. Then, the manual synchronization subroutine described with reference to FIG. 8 is executed (S618). Then, by executing this manual synchronization subroutine, after performing the process of synchronizing the progress of the page with the progress of the moving image, or performing the process of synchronizing the progress of the moving image with the progress of the page, the client device 20 executes the process. The process proceeds to S619.

In S619, the client device 20 reads the time at this time, and determines whether or not the read time is a time after one second has elapsed from the time set in the variable T ( S620). Then, if the time is not a time after one second has elapsed from the time of the variable T (S620; N0), the client device 20 returns the process to S610. On the other hand, when the time is one second after the time of the variable T (S620; YES) Then, the client device 20 updates the time by substituting the time into the variable T (S621), and executes the manual screen size change subroutine described with reference to FIG. 9 (S622). By executing the manual screen size changing subroutine, the window size is matched with the window size only when the window size is changed. 0 returns the process to S610.

 Operation of Second Embodiment>

 By performing the processing described above, the student is displayed on the attendance screen 40 while the student accesses the learning server 1 device 10 from the client device 20 and attends the lecture. When one of the buttons 42a to 42d is clicked, a page unrelated to the progress of the moving image is displayed in the second frame 42 (document display section). At this time, the video of the lecture continues to be displayed without interruption in the first Azusa 41 (video display unit) in accordance with the streaming content playback program 22 (S610 to S612, S61 6 19 to S 62 2).

 In addition, when the page that should be displayed according to the content of the lecture does not match the page that is actually displayed, the page that should be displayed is switched to the next page as the movie progresses. Then, the display in the second frame 42 is switched from the page irrelevant to the progress of the moving image to the next page (S612, S201 to S210).

 Also, if the content of the lecture does not match the content of the page actually displayed, if the student clicks the asynchronous button 43a, the progress of the page will not be synchronized with the progress of the video. However, the video continues to play, but the page does not advance (S610 and S611, and S614 and S615).

Additionally, if the page progress is not synchronized with the video progress, When the student clicks the first button 43b, the page corresponding to the content of the lecture displayed in the first frame 41 (movie display section) is displayed in the second frame 4b. 2 (document display section) (S610, S616-S618, S401-S405). Conversely, in the above state, when the student clicks on the second button 43b, the video of the lecture shown in the first frame 41 (video display section) is 2 of the frame 4 within 2 to position corresponding to the contents of the page displayed on the (document display unit) to skip or playback (S 1 1 0, S 6 1 6~S 6 1 8, S 4 0 1 5 S406-S408).

 When the student changes the size of the window by operating the mouse, the size of the attendance screen 40 is changed in accordance with the change in the size of the window (S62, S50). 1 to S508). Then, the attendance screen 40 is displayed in the window with the size of the attendance screen 4 ° and the size of the window being matched (S509).

 Also, in the second frame 42 (document display section), each page of the document data is displayed one page at a time in accordance with the progress of the video of the lecture (S 6 1 2). If the display changes from the previous page to the next page, and if you try to display the entire next page with the display magnification of the previous page, as shown in Fig. 11, it must be outside the attendance screen 40. It may disappear (S302; N0, S304; NO, S341, S343). In this case, the size of the attendance screen 40 is enlarged while the reference point of the attendance screen 40 is fixed on the displayable area of the display (S3422, S344). The next page is displayed in the second frame 4 2 with the display magnification

Also, if you try to display the entire next page with the display magnification of the previous page, it may be necessary to protrude from the displayable area of the display (S302, S303, S304; N 〇). In this case, attendance screen 4 0 The size of the attendance screen 40 is enlarged while the reference point of the class is fixed on the displayable area (S311 to S315, S321, S321, S3311) , S 3 3 3), the right edge and / or lower edge of the attendance screen 30 is in contact with the right edge and / or lower edge of the displayable area, and the size of the second frame 4 2 Is reduced (S3 14, S3 15, S3 2 2, S3 3 2). As a result, the entire next page is displayed in the second frame 42 with its display magnification reduced.

 <Summary>

 As described above, also according to the second embodiment, while the moving image is being displayed in the first frame 41, the student can use the page used in the lecture in the second frame 42. Can display another page, and of course, by operating the first and second buttons 43b, 43c, they can be easily synchronized.

 Further, according to the second embodiment, the student can operate the asynchronous pointer 43a to synchronize the progress of the document with the progress of the moving image. By making such an asynchronous state, the student can display an arbitrary page irrelevant to the progress of the video by operating the buttons 42a to 42d, and the button 41a. By operating ~ 4 1d, you can play, rewind, or fast-forward a movie regardless of the progress of the document. Then, even when the moving image and the document progress asynchronously as described above, the first and second buttons 43b and 43c can be easily synchronized by operating the first and second buttons 43b and 43c. Industrial applicability

As described above, according to the present invention, even when a student is listening to a lecture using the learning support system, the content before and after the content during the lecture can be obtained. You can study the contents and, of course, return to the page synchronized with the contents of the lecture.

Claims

The scope of the claims

1. The server device on the network transmits the moving image data of the moving image composed of a plurality of frames, the document data of the document composed of a plurality of pages, and the link information on the frame and the page to be displayed simultaneously with each other. The client device on the network stores the moving image based on the moving image data streamed and distributed from the server device in a first display area on a display, and receives the moving image from the server device. A learning support system for sequentially displaying documents based on the document data distributed from the server device in a second display area different from the first display area in accordance with the link information;

 The client device,

 When an input for designating any page in the document is received while displaying a moving image in the first display area, the page displayed in the second display area is displayed by the input. When switching to the designated page and receiving an input indicating a synchronization instruction, the progress of the video and the progress of the document are synchronized according to the link information.

A teaching material display method characterized by the fact that:

 2. The client device synchronizes the progress of a document displayed in the second display area with the progress of a moving image displayed in the first display area according to the link information.

3. The method for displaying teaching materials according to claim 1, wherein:

3. When the client device receives an input indicating an asynchronous instruction while synchronizing the progress of the moving image and the progress of the document according to the link information, the client device displays the input in the second display area. 3. The method according to claim 1, wherein the progress of the document is stopped.

4. The client device displays a screen including the first and second display areas in a window under the control of a web browser displayed on the display, and when the size of the window is changed. Change the size of the screen according to its size change

3. The method for displaying teaching materials according to claim 1, wherein:

 5. The client device changes a size of the second display area according to a size of the page and a display magnification.

3. The method for displaying teaching materials according to claim 1, wherein:

 6. The client device displays a screen including the first and second display areas in a window under the control of a web browser displayed on the display, and displays the size of each page, its display magnification, 2. The teaching material display method according to claim 1, wherein the size of the screen and the size of the second display area are changed according to the following.

7. When changing the size of the screen, the client device changes the size of the second display area while keeping the size of the first display area fixed.

4. The method for displaying teaching materials according to claim 3, wherein:

 8. The client device displays a screen including the first and second display areas in a window under the control of a web browser displayed on the display, and the screen according to the size of each page. The teaching material display method according to claim 1, wherein the size of the second display area and the display magnification are changed.

9. Video and documents are distributed from the server device on the network,

Displaying a screen having a first display area and a second display area on the display; When an instruction is entered to display a page unrelated to the progress of the video

, Display the page in the second display area,

 When a predetermined instruction is input, the progress of the video and the progress of the document are synchronized and displayed on the display.

A teaching material display program characterized by the following.

 10. For the computer,

 Displaying a screen including the first and second display areas in a window under the control of the web browser;

 When the size of the window is changed, the size of the screen is changed according to the change in the size.

10. The teaching material display program according to claim 9, wherein:

 1 1. For the computer,

 Displaying a screen including the first and second display areas in a window under the control of the web browser;

 The size of the screen, the size of the second display area, and the display magnification are changed according to the size of each page.

10. The teaching material display program according to claim 9, wherein: