JP2003219382A - Server for remote education system and the remote education system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To realize a remote education system capable of providing detailed education information for each trainee in addition to mere distribution of lecture information. <P>SOLUTION: A server 10 for a remote education system is placed to a base station 3 and the server 10 transmits lecture information obtained from a lecture distribution station 2 to each trainee side terminal 4 via a two-way communication available network NW1. The trainee side terminal 4 is provided with a photographing device and a microphone, transmits a video image and audio of each trainee to the server 10 during a lecture. The server 10 applies processing of mixing the video and audio of trainee with the lecture video and audio obtained from the lecture distribution station 2 depending on a lecture state and transmits the result to each trainee side terminal 4. Further, the server 10 has a function of dynamically generating an image and a function of compositing a source video and audio to the video and audio and transmits the video and audio obtained as a result to each trainee side terminal 4. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a remote education system for performing education between remote places via a communication network.

[0002]

2. Description of the Related Art Conventionally, there are a TV telephone system using a telephone line, an Internet TV telephone system using the Internet, and the like, and a remote education for transmitting images and sounds by using these systems for remote education. There is an education system.

A conventional remote education system is composed of a transmitter / receiver side transmitter / receiver and a student side transmitter / receiver (a student terminal), and performs education while bidirectionally communicating a teacher image and a student image. It was

[0004]

However, in the conventional remote education system, many of them only display the lecture video on the student terminal, and it is necessary to check the personal information such as the progress status and grades of the student in real time. I couldn't.

In addition, it is not possible to automatically switch the video and audio according to the lecture situation. For example, when there are a plurality of students, even if one student asks a question, who is the other student asks a question. I was in a situation where I didn't really understand what was happening.

Further, in the conventional distance learning system, even if there are a plurality of students, the lecture video of the same content is transmitted to each student, and the lecture video corresponding to the situation of each student is individually transmitted. It was difficult.

In other words, it is difficult for the conventional distance learning system to provide detailed education to individual students.

Therefore, the present invention has been made to solve the above-mentioned problems, and it is possible for not only the attendees to view and listen to the lecture contents but also to manage personal information such as their own progress status and grades. The first purpose is to provide a distance education system that can be performed. A second object of the present invention is to realize a distance education system capable of providing a realistic lecture by switching between video and audio according to the lecture situation. A third object is to realize a distance education system capable of transmitting a lecture video according to the situation and the like.

[0009]

In order to achieve the above object, the invention according to claim 1 is a server for a remote education system for transmitting education information to a remote place via a network, Lecture information input means for inputting lecture information including lecture video and lecture audio, communication means for performing two-way data communication with the student side terminal device via the network, and the lecture input from the lecture information input means Lecture information transmitting means for transmitting information to the student side terminal device via the communication means, a database in which information about lectures and students is stored, and the student side terminal device via the communication means. When the inquiry information is input, the information is extracted from the database according to the inquiry information to dynamically generate a display image, and the inquiry information is transmitted via the communication unit. Image generating means for transmitting the display image with respect to a said student terminal device having input,
Is equipped with.

According to a second aspect of the present invention, in the distance learning system server according to the first aspect, the lecture information transmission means functions when the lecture information transmission ends, and the lecture is included in the database. And update means for updating the information about the students.

The invention according to claim 3 is the invention according to claim 1 or 2.
In the server for the remote education system described in [3], when the answer data is input from the student side terminal device via the communication means during the transmission of the lecture information, the answer data for determining whether the answer data is correct or incorrect. Further comprising processing means, wherein the image generation means dynamically generates the display video according to the determination result in the response data processing means,
The feature is that the display video is transmitted.

According to a fourth aspect of the invention, in the server for remote education system according to the third aspect, the updating means updates the information contained in the database based on the determination result of the response data processing means. It is characterized by doing.

A fifth aspect of the present invention is a server for a remote education system that transmits educational information to a remote place via a network, and lecture information for inputting lecture information including lecture video and lecture audio. The input means, the communication means for performing two-way data communication with the student side terminal device via the network, and the lecture information input from the lecture information input means via the communication means, the student side terminal. Lecture information transmitting means for transmitting to the device, and response data for determining whether the response data is correct or incorrect when response data is input from the student side terminal device via the communication means during transmission of the lecture information. The student side, which dynamically generates a display image according to the determination result in the processing means and the response data processing means, and in which the response data is input through the communication means. And a, and an image generating means for transmitting the display image with respect to end devices.

According to a sixth aspect of the invention, in the server for the remote education system according to the fifth aspect, the database is stored based on the database in which the information about the students is stored and the determination result in the response data processing means. Updating means for updating the information contained in the image generating means, wherein the image generating means responds to the inquiry information when there is input of inquiry information from the student side terminal device via the communication means. Information is extracted from the database to dynamically generate a display video, and the display video is transmitted to the student terminal device to which the inquiry information is input via the communication means.

The invention according to claim 7 is the same as claims 1 to 6.
In the server for a remote education system according to any one of the above, if the speech signal is received from the student side terminal via the communication means during transmission of the lecture video and the lecture audio, the student side terminal A video processing unit for generating and transmitting a video image of a student input from the device and the lecture video, and a lecture input from the student terminal device in synchronization with the video processing unit. It further comprises a voice processing means for generating and transmitting a voice in which the voice of the person and the lecture voice are mixed.

The invention according to claim 8 is a server for a remote education system for transmitting educational information to a remote place via a network, and lecture information for inputting lecture information including lecture video and lecture audio. The input means, the communication means for performing two-way data communication with the student side terminal device via the network, and the lecture information input from the lecture information input means via the communication means, the student side terminal. Input from the student side terminal device when a speech signal is received from the student side terminal through the communication means during transmission of the lecture information transmitting means to the device and the lecture video and the lecture audio. A video processing means for generating and transmitting a video in which the video of the student side and the lecture video are mixed, and input from the student side terminal device in synchronization with the video processing means. It includes a student's side of the voice, and a voice processing unit to transmit by generating a sound by mixing the lecture voice.

The invention described in claim 9 is the invention according to claims 1 to 8.
In the remote education system server according to any one of
When transmitting information from a database that stores material images used as teaching materials and the lecture information, when the student terminal device inputs information via the communication means, the material images are extracted according to the information. However, the image forming apparatus further includes a synthesizing unit that synthesizes the material image with the lecture image included in the lecture information.

According to a tenth aspect of the present invention, there is provided a server for a remote education system for transmitting educational information to a remote place via a network, wherein lecture information including lecture video and lecture audio is inputted. Input means, communication means for performing two-way data communication with the student side terminal device via the network, and lecture information transmitting means for transmitting the lecture information to the student side terminal device via the communication means. And a database that stores material videos for teaching materials,
If information is input from the student side terminal device via the communication means during transmission of the lecture information, the material image is combined with the lecture image included in the lecture information according to the information. And a synthesizing means to be given to the lecture information transmitting means.

The invention according to claim 11 is a server for a remote education system for transmitting educational information to a remote place via a network, and lecture information for inputting lecture information including lecture video and lecture audio. Based on the input means, the communication means for performing two-way data communication with the student side terminal device via the network, the database storing the information about the student and the material video for the teaching material, and the information about the student The state of the student is evaluated according to the evaluation result, and the composing means for composing the material video with the lecture video included in the lecture information, and the video composited by the compositing means are communicated according to the evaluation result. Lecture information transmitting means for transmitting to the student side terminal device via the means.

According to a twelfth aspect of the present invention, in the server for remote education system according to the tenth or eleventh aspect, the database further stores material voices, and the synthesizing means further stores the lecture information. It is characterized in that the material voice is synthesized with the included lecture voice.

According to a thirteenth aspect of the present invention, the base station and the student side terminal device are connected via a network, and bidirectional data communication is performed between the base station and the student side terminal device. A remote education system for transmitting and receiving educational information by means of the base station, comprising the server for remote education system according to any one of claims 1 to 12.

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a schematic configuration diagram showing an overall image of a remote education system 1 according to the present embodiment. As shown in FIG. 1, a distance learning system 1 includes a lecture distribution station 2 in which a lecture is given by a lecturer, and a base station 3 in which a distance learning system server (hereinafter, simply referred to as a server) 10 is installed.
And a plurality of student side terminal devices 4 (4a, 4b, ...).

The lecture distribution station 2 has a camera 2a for photographing a lecture scene by a lecturer to generate a lecture image, a display device 2b for displaying a lecture image given by the server 10 and a lecture speech by the lecturer. 2c for inputting a speaker, a speaker 2d for generating a lecture voice given from the server 10, a voice of a student, and the like, and a connection device 2e for connecting these units to a network NW2 capable of two-way communication. And is configured.

A server 10 is installed in the base station 3, and the server 10 is connected to the lecture distribution station 2 via the network NW2 and can perform bidirectional communication of lecture information including lecture video and lecture voice. Configured to be able to. In addition, the server 10 has a network NW1 for bidirectional communication with a plurality of student terminal devices 4 installed at remote locations.
Is connected to the lecture distribution station 2, and the lecture information input from the lecture distribution station 2 is subjected to video processing, audio processing, etc., and transmitted to each student terminal device 4 via the network NW1.

The networks NW1 and NW2 are bidirectional communication networks such as the Internet, but may be a composite network of the Internet and a TV telephone line.

Although FIG. 1 shows a configuration example in which the lecture distribution station 2 and the server 10 are connected by the network NW2, both the lecture distribution station 2 and the server 10 may be provided in the same station. Good.

In the remote education system 1 having the above-mentioned configuration, the server 10 has a function as a so-called Internet web server, a database function, a connection management function with each student terminal device 4, and a plurality of images and sounds. It has the function of mixed delivery.

FIG. 2 is a block diagram showing the configuration of the server 10. The server 10 includes a lecture information input / output unit 5 for inputting / outputting lecture information to / from the lecture distribution station 2 and a network NW.
A communication unit 6 that performs two-way communication with the student side terminal device 4 via 1, and a lecture information transmission unit that generates and transmits the lecture information to be individually transmitted to the student side terminal device 4 and the lecture distribution station 2. 20. The video and audio of the student side is received from the terminal device 4 of the student side, and the video and audio are separated and the lecture information transmitting unit 2
Video / audio receiver 11 to give to 0, student side terminal device 4
A video / audio transmitting unit 12 for giving a lecture video and a lecture audio to be transmitted to the communication unit 6, a data receiving unit 13 for receiving data other than the video and audio input from the student terminal device 4, and a data receiving unit 13. Access to the input data analysis unit 15 that analyzes the data input via the computer, the control unit 16 that controls the lecture information transmission unit 20 and the data processing unit 30, and the databases DB1 and DB2 to the student terminal device 4 The data processing unit 30 performs data generation for individual transmission, and the data transmission unit 14 for individually transmitting the data generated by the data processing unit 30 to the student side terminal device 4. The server 10 having such a configuration is realized by, for example, a computer and its peripheral devices.

Information relating to lectures is stored in the database DB1, and lecturer information registered for each lecturer,
Includes course information, etc. registered for each course. The instructor information includes, for example, the profile of the instructor, the content of the lecture, how to proceed with the lecture, the current progress of the lecture, and the supplementary teaching materials unique to the instructor. It includes the current progress of the course. Further, the database DB1 also stores answer data for each student when a task is given to each student during the lecture.

Further, the database DB2 stores the information about the attendees, and includes the attendee personal information, the progress management information and the like registered for each attendee. The personal information of the trainee includes the trainee's profile, grades to date,
The course history up to the present, the access history of the students, etc. are included, and the progress management information includes the progress status of each student, the preparation / review status, and data for comparing the progress status of multiple students.

The lecture information transmitting section 20 includes a video processing section 21,
Voice processing unit 22, synthesis processing unit 23 and database DB
Equipped with 3. In the database DB3, for synthesizing the video and audio to be transmitted to each student terminal device 4,
Stores material information (material video, material audio, etc.) for teaching materials. The material information includes, for example, past lecture videos, videos shot outdoors, CG (computer graphics) videos, other videos, audio accompanying them, and other text information.

The video processing unit 21 is configured to switch the video to be individually transmitted to each student terminal device 4 and edit the screen in response to a command from the control unit 16. The audio processing unit 22 is also configured to control the switching of the audio to be individually transmitted to each student terminal device 4 in response to a command from the control unit 16, and operates in synchronization with the video processing unit 21. Realized to do. Details of the video processing unit 21 and the audio processing unit 22 will be described later.

The synthesizing section 23 also functions in response to a command from the control section 16, and the database DB
The material video or the material audio is acquired from 3, and the material video synthesis processing or the material audio synthesis processing is performed on the lecture video or the lecture audio individually transmitted to each student side terminal device 4.

The input data analysis unit 15 analyzes the data input from the student terminal device 4, and gives the input data to the control unit 16 or the data processing unit 30 according to the analysis result. At this time, the input data analysis unit 15 has the control unit 16
Alternatively, the input data is given to the data processing unit 30 in a state where the student side terminal device 4 which is the transmission source of the input data is specified.

Upon receiving an access request from each student, the control unit 16 and the data processing unit 30 determine whether or not the student is a registered student, and if the student is a registered student, the student is concerned. The connection state with the student side terminal device 4 is established, transmission of the lecture information is started, and the data processing unit 30
Generates and sends images to provide various information to the students. Further, the control unit 16 controls the lecture information transmission unit 20 even during the course of the lecture to control the video and audio individually transmitted to each student terminal device 4 and the lecture distribution station 2.

For example, when the input data input from the input data analysis unit 15 is the speech signal during the lecture, the control unit 16 causes the video processing unit 21 and the audio processing unit 22 to function and each student side terminal. The lecture video and the lecture audio transmitted to the device 4 and the lecture distribution station 2 are processed to mix the video and the audio of the student who wants to speak.

FIG. 3 is a diagram showing a detailed configuration of the video processing unit 21. However, in FIG.
The case where the four student side terminal devices 4 of D are connected via the network NW1 is illustrated.

The image processing unit 21 is an image selection / screen adjustment unit 2.
1a and a destination selection unit 21b are provided, and the video processing unit 21 is configured to perform video processing that is individually transmitted to each student terminal device 4.

In the video selection / screen adjustment section 21a, the lecture video MV10 from the lecture distribution station 2 and the video M of the students A to D are provided.
V11 to MV14 are input, and the video selection unit 21a receives each video MV10 to MV1 based on a command from the control unit 16.
Select 4 to adjust the screen.

For example, when unilaterally transmitting the lecture contents by the lecturer to each of the students A to D, the video selection / screen adjustment unit 21a inputs the lecture video MV10 input from the lecture distribution station 2.
Is selected to adjust the lecture video MV10 to a full-screen display form. On the other hand, when a speech signal indicating that there is a question etc. is received from the student side terminal device 4 of the student A during the course of the lecture, the control unit 16 instructs the image selection / screen adjustment unit 21a to switch the screen. give. Then, the video selection / screen adjustment unit 21a displays the lecture video MV10 and the student A who asks a question.
Image MV11 is selected, and an image is generated by screen adjustment such as screen division so that both images are displayed on the same screen.

The image output from the image selection / screen adjustment unit 21a is given to the destination selection unit 21b.

The transmission destination selection unit 21b selects a transmission destination to which the image generated by the image selection / screen adjustment unit 21a is transmitted based on the instruction from the control unit 16.

For example, when transmitting the video obtained from the video selection / screen adjustment unit 21a to all the students and the lecture distribution station 2, the transmission destination selection unit 21b selects all the transmission destinations.

When it is not necessary to display the interrogator's image on the interrogator's own terminal, the transmission destination is set so as to transmit the screen-adjusted image to the instructor and other students. May be selected, and the destination may be selected so as to transmit the full-screen video of the lecture video MV10 to the student side terminal device 4 of the questioner. In this case, in the video selection / screen adjustment unit 21a, the full-screen display video of the lecture video MV10 and the video MV of the lecture video MV10 and the questioner (student A).
11 and a screen-adjusted image is generated by screen division, etc.,
The destination selection unit 21b selects the full-screen display video of the lecture video MV10 as the lecture video MV21 for the student A, and the lecture video MV10 and the video MV11 of the questioner (student A) are screen-adjusted by screen division or the like. The lectured video MV20 for the lecturer and the lecture videos MV22-MV for the students B to D
Select as 24.

By performing such video switching processing, when any of the students asks a question during the lecture, the other students can grasp who is asking the question. . As a result, for example, not only a one-way lecture from the lecturer but also a lecturer and each student can face each other while proceeding with the lecture, and various lecture forms can be provided.

FIG. 4 is a diagram showing a detailed configuration of the voice processing unit 22. However, similarly to FIG. 3, FIG. 4 exemplifies a case where four student side terminal devices 4 of the student A to D are connected to the server 10 via the network NW1.

The voice processing unit 22 is provided with a voice selecting unit 22a and a destination selecting unit 22b, and the voice processing unit 22 is configured to perform a voice process of individually transmitting to each student terminal device 4. To be done.

In the voice selection section 22a, the lecture voice VC10 from the lecture delivery station 2 and the images VC11 to V of the students A to D are provided.
C14 is input, and the voice selection unit 22a selects each of the voices VC10 to VC14 based on a command from the control unit 16 and gives it to the destination selection unit 22b.

For example, when unilaterally transmitting the lecture contents by the lecturer to each of the students A to D, the voice selection unit 22a selects only the lecture voice VC10 input from the lecture distribution station 2. At this time, when a speech signal indicating that there is a question or the like is received from the student-side terminal device 4 of the student A, the control unit 1
Reference numeral 6 gives the voice selection unit 22a a command to select the voice of the student A. Then, the voice selection unit 22a selects the lecture voice VC10 and the voice VC11 of the student A who asks the question, and asks the other students B to D about the question content of the student A and the response of the lecturer to the question. Can generate audio.

The transmission destination selection unit 21b selects a transmission destination to which the voice generated by the voice selection unit 22a is transmitted based on the instruction from the control unit 16.

For example, when transmitting the voices obtained from the voice selection unit 22a to all the students and the lecture distribution station 2, the transmission destination selection unit 21b selects all the transmission destinations.

When it is not necessary to reproduce the voice of the questioner on the terminal of the questioner himself, the transmission destination is set so that the voices of both the questioner and the lecturer are transmitted to the lecturer and other students. May be selected, and the destination may be selected so that only the lecture voice MV10 is transmitted to the student side terminal device 4 of the questioner. In this case, the speech selection unit 22a uses the lecture speech V
A voice in which only C10 is selected and a voice in which the lecture voice VC10 and the voice VC11 of the questioner (student A) are selected are generated, and the transmission destination selection unit 22b outputs only the voice of the lecture voice VC10 for the trainee A. Selected as the lecture voice VC21, and the lecture voice VC10 and the voice VC of the questioner (student A)
The selected voices 11 and 11 are selected as the lecture voice VC20 for the lecturer and the lecture voices VC22 to VC24 for the students B to D.

As a method for performing voice selection (voice mixing) and transmission, there are multimedia transfer protocols such as MPEG4 and H324 that have been proposed in the past.
A method of dividing a plurality of audio streams into a plurality of packets and transmitting the plurality of packets may be adopted. In that case, the voice selecting unit 22a performs packing processing into a plurality of packets and the destination selecting unit 22b is packed. The sound will be output to each student terminal device 4.

By performing such a voice switching process, when any of the students asks a question during the lecture, the other students can know who is asking the question. . As a result, a synergistic effect with the above-described video switching occurs. For example, it is possible to provide not only one-sided lectures from the instructor, but also to proceed with the lectures while the instructor and each student face-to-face with each other while having dialogues and discussions, thus providing various lecture forms. Become.

The operations of the video processing section 21 and the audio processing section 22 are controlled by the control section 16 so as to be synchronized with each other.

As described above, in the lecture information transmitting section 20, the video and audio individually transmitted to each student side terminal device 4 can be arbitrarily switched according to the lecture situation, etc. It is possible to provide a certain lecture video and lecture audio to each student. Further, the lecture can be advanced by the dialogue between the instructor and the student, and other learners can grasp the content of the dialogue.

In the above description, in order to be able to individually switch between the lecture video displayed in the lecture distribution station 2 and the lecture terminal terminal device 4 and the lecture audio to be reproduced, the transmission destination selection unit Although the example in which 21b and 22b are provided has been described, when the lecture video displayed in the lecture delivery station 2 and each student terminal device 4 and the played lecture audio may all have the same content, the destination selection unit The lecture information of the same content may be broadcasted without providing 21b and 22b.

Further, the synthesis processing section 23 functions according to a command from the control section 16, and synthesizes a material image and a material sound with respect to a lecture image and a lecture sound transmitted to each student terminal device 4. Give. When this synthesis processing is applied to the lecture video MV10 shown in FIG. 3 and the lecture voice VC10 shown in FIG. 4, the video displayed and the voice reproduced in the lecture distribution station 2 and each student side terminal device 4 are the same. The material video and the material sound of are the contents that have been synthesized. On the other hand, the lecture processing MV20 to MV24 shown in FIG.
In addition, when the lecture sounds VC20 to VC24 shown in FIG. 4 are individually applied, the images displayed and reproduced by the lecture distribution station 2 and each student terminal device 4 are different from each other. The content voice is the synthesized content. In the present embodiment, the composition processing is configured so that it can be performed either before or after the video processing unit 21 and the audio processing unit 22.

For example, when the background is set to a specific color in the lecture distribution station 2 and the lecturer gives a lecture in front of the background, the synthesizing unit 23 synthesizes the material images previously stored in the database DB3 by chroma key processing or the like. Lecture videos can be generated, and more easily understandable lecture videos can be distributed. In addition to chroma key processing,
Composition processing such as telop, switcher, AB roll, and CG composition can be applied. With this kind of composition processing, even if it is difficult for a lecturer to give a lecture in a classroom, etc., it is possible to explain using other images, so it is necessary to provide a lecture that is easy to understand. Will be possible.

Further, the control unit 16 accesses the database DB2 via the data processing unit 30 and instructs the synthesizing processing unit 23 to insert a telop or an image according to the grade and progress of each student. Based on this instruction, the composition processing unit 23 executes different composition processing for each student side terminal device 4. That is, the state of each student is evaluated based on the information about the student, and the material video is combined with the lecture video included in the lecture information and transmitted according to the evaluation result. . Therefore, for example, when the students are not taking progress, it is possible to compose a video that encourages students to take classes in the corners of the screen of the lecture video, etc. It is possible to grasp one's own state without performing.

Further, when the control unit 16 receives a signal to inquire about a term used in the lecture from the student terminal device 4 during the lecture, the control unit 16 instructs the synthesis processing unit 23 to that effect. Based on this command, the combining processing unit 23 executes a combining process for displaying the explanation of terms in a roll in the lecture video distributed to the student side terminal device 4 which has made an inquiry. As a result, each student can obtain necessary information even during the lecture, and can understand the lecture contents at an early stage.

Further, during the lecture, when the lecturer sends predetermined information to the server 10 or when the student terminal device 4 sends predetermined information to the server 10, the synthesizing unit 23 functions. Then, it is possible to synthesize the speech of the material with the speech of the lecture and to give a speech explanation that complements the speech of the lecturer.

By such synthesis processing, so-called video-on-demand is realized in the remote education system 1, and each student can check his / her own learning status in real time and immediately solve his / her own doubts. become.

Next, the data processing unit 30 will be described. The data processing unit 30 includes an image generation unit 31, a database updating unit (hereinafter, referred to as a DB updating unit) 32, and an evaluation unit 33.

When the image generation unit 31 receives the inquiry information from the student side terminal device 4, the image generation unit 31 makes a database DB1, DB
2 to obtain information about the course or information about the students and dynamically create an image according to the inquiry information. This image is, for example, HTML (Hypertext Markup L
It is created as a Web page image expressed in anguage format. More specifically, the image generating unit 31 searches the databases DB1 and DB2 based on the inquiry information, and arranges the information extracted as a result at a predetermined position in the template file in the HTML format for display. An image (video) is generated at that time in real time.

Then, the image generation section 31 gives the image generated based on the inquiry information to the data transmission section 14. At this time, the image generation unit 31 designates the student side terminal device 4 having input the inquiry information and gives the image to the data transmission unit 14.

The data transmission unit 14 transmits the image generated by the image generation unit 31 separately from the lecture information to the student side terminal device 4 which is the transmission source of the inquiry information. Data transmitter 1
4 transmits the image generated based on the inquiry information to the student side terminal device 4 designated by the image generation unit 31 via the communication unit 6.

Here, the reason why the lecture information transmitted by the lecture information transmitting unit 20 and the data transmitted by the data processing unit 30 are separately transmitted is that the lecture information transmitting unit 20 transmits the lecture currently distributed. While the lecture information is distributed to the registered attendees of the information, the data processing unit 30 allows the person other than the registered attendees of the lectures distributed at that time (that is, the registered attendees of other lectures). In some cases, you may want to manage your progress, manage your grades, or check the date and time of the next lecture, so even in such a case, the student terminal device that is different from the lecture information destination at that time This is because it is possible to transmit data to No. 4.

However, the inquiry side information can be transmitted during the reception of the lecture information even in the student side terminal device 4 receiving the lecture information distributed at that time, and in that case, the student side terminal device. In 4, the display video of both the lecture video and the dynamically generated image will be displayed.
That is, in this case, the image generation unit 31 gives the dynamically generated image to the synthesis processing unit 23 of the lecture information transmission unit 20 via the control unit 16, and the synthesis processing unit 23 dynamically generates the image. And a lecture video are combined to generate a display video (for example, a video in which the lecture video is inserted in the Web page screen) and transmit the video to the student side terminal device 4.

In this way, the image generation unit 31 dynamically generates an image from the information stored in the databases DB1 and DB2 in accordance with the inquiry information and transmits it to the student side terminal device 4 which has transmitted the inquiry information. As a result, it is not necessary to store the display image for each student and the display image for each lecture as a database, and the efficiency of the database can be improved. That is, since it is not necessary to store the latest video itself in the database, the capacity of the database can be reduced, and as a result, the management cost of the server can be reduced.

Further, since the student can obtain the information requested by him / herself in real time, he / she can easily attend not only the lecture but also the attendance management and the grade management. That is, since the server 10 includes the image generation unit 31, the distance learning system 1 can individually provide useful information to each student in real time.

Next, the DB updating unit 32 is connected to the lecture information transmitting unit 2
When 0 finishes sending one lecture information (ie,
When the lecture time is over), database DB1, D
Update information about lectures and students included in B2. That is, the lecture progress status of the information on the lecture in the database DB1 is updated, and the attendance status (attendance history) of the information about the student in the database DB2 is updated. As a result, each database DB
1, the latest information is always stored in DB2.

The evaluation unit 33 determines whether the answer data is correct or incorrect when the student terminal device 4 inputs the answer data via the communication unit 6 during the transmission of the lecture information, and the synthesis processing unit. Database database for inserting captions and images according to the grades and progress of each student in 23
Access 2 to evaluate the grades and progress of each student.

For example, when a task is given to a student during a lecture, answer data for the task is input from the student terminal device 4. When the input data is response data, the input data analysis unit 15 gives the response data to the evaluation unit 33, and the evaluation unit 33 compares the response data stored in advance in the database DB1 to determine the correctness of the response data. To do. This correctness / incorrectness determination result is given to the image generating unit 31, and the We
An image such as page b is dynamically generated and transmitted via the data transmission unit 14 to the student side terminal device 4 which is the transmission source of the response data. In addition, the image generation unit 31 uses the control unit 16 to combine the image relating to the correctness determination result with the synthesis processing unit
It may be transmitted to the student terminal device 4 after being combined with the lecture video.

When the evaluation unit 33 determines whether the answer data is correct or incorrect, the determination result is also given to the DB update unit 32, and the DB update unit 32 updates the information about the students included in the database DB2. As a result, the information about the student's grade stored in the database DB2 is always the latest information, and the student can check his or her latest grade after the lecture.

When the synthesizing unit 23 inserts a telop or an image in accordance with the grade or progress of each student, the evaluation unit 33 instructs the control unit 16 to evaluate the grade or progress of the student. When the evaluation is received, the evaluation unit 33 accesses the databases DB1 and DB2 and evaluates the student's grades and progress. Regarding the grade, for example, the rank of the trainee in the whole trainee is evaluated. Then, the evaluation unit 33 gives the evaluation result of the student to the image generation unit 31. The image generation unit 31 dynamically generates an image for displaying the evaluation result of the student, and the image is generated by the control unit 1.
It is given to the synthesis processing unit 23 via 6.

Thus, in the data processing section 30,
Images for individual transmission to each student side terminal device 4 are automatically generated in real time, and the databases DB1 and DB2 are automatically updated according to the progress status of the lecture. Therefore, the students can always get the latest information on the lectures and the latest information on their grades and progress in real time, and manage their own attendance even during the hours when the students are not taking courses. A remote education system 1 capable of performing is realized.

When the video / audio receiving unit 11 receives the video and audio via the communication unit 6, if the video information and audio information is compressed, decompression processing (compression / decompression processing) is performed. Video information and audio information are given to the lecture information transmitting unit 20. Further, even when the video / audio transmitting unit 12 is given the lecture information to be transmitted to each student side terminal device 4 from the lecture information transmitting unit 20, the lecture information is compressed and compressed by a predetermined compression method. The lecture information may be transmitted to each student terminal device 4.

The server 10 in the remote education system 1 is configured as described above, and is connected to each student side terminal device 4 via the network NW1 so that not only simple lecture scenery is delivered but also various educational services are provided. It becomes possible to provide.

Next, the configuration of the student side terminal device 4 will be described. FIG. 5 is a block diagram showing the configuration of the student side terminal device 4. As shown in FIG. 5, the student side terminal device 4
Is, for example, a computer and its peripherals, and displays an information processing device 41 that controls data communication with the server 10 via the network NW1, and images (lecture images and dynamically generated images) obtained from the server 10. A display unit 42 for shooting, a shooting unit 43 provided for shooting a student, an operation unit 44 such as a keyboard and a mouse for a student to input an operation, and a speaker for playing back lecture audio obtained from the server 10. 45 and a microphone 46 for inputting the voice of the student.

Further, the information processing device 41 includes the communication unit 41.
1, an information mixing / distributing device 412, an image processing unit 413, an information processing unit 414, and an audio processing unit 415. Communication unit 41
The server 1 performs data communication with the network NW1.
Data communication with 0. The information mixing / distributing device 412 distinguishes a video (including an image) and a sound based on the lecture information from the server 10 obtained via the communication unit 411, and also an image processing unit 413, an information processing unit 414, and a sound processing unit. It has a function of giving information input from each of 415 to the communication unit 411 and transmitting the information to the server 10.

The image processing unit 413 causes the display unit 42 to display the lecture video obtained from the server 10 and the image dynamically generated in the server 10. For example, when the image dynamically generated in the server 10 and the lecture video are separately input, the image processing unit 413 synthesizes these to generate an image for display, and the image is displayed on the screen of the display unit 42. Both the lecture video and the dynamically generated image are displayed simultaneously. As a result, it becomes possible for the learner to visually recognize the lecture video on the learner side terminal device 4 and at the same time grasp his or her grade and progress.

Further, the image processing unit 413 is the information processing unit 41.
It is also configured to display a guide screen or the like given from No. 4 on the display unit 42. With this guide screen display, when a student accesses the server 10 and wants to start taking a lecture or to check his or her own grades and progress, it is possible to easily follow the guide screen. Become.

Further, the image processing unit 413 performs a predetermined image processing on the video data of the student obtained by the shooting unit 43 shooting the student and outputs it to the information mixing / distributing device 412. However, the image processing unit 413 inputs the video data from the photographing unit 43 from the time when the student terminal device 4 establishes the session for the lecture with the server 10 to the time when the lecture ends. And the student side terminal device 4
The shooting section 43 during the time when the students of the
The shooting operation of is stopped. As a result, when the student is attending a lecture at the student terminal device 4, the video of the student is photographed by the photographing unit 43 and the video is transmitted to the server 10 via the network NW1. .

Next, the information processing section 414 gives information such as a guide screen to the image processing section 413 or generates each signal to the server 10 based on the instruction of the student input from the operation section 44. Output to the information mixing / distributing device 412. For example, when a student performs a predetermined key operation on the operation unit 44 during a lecture, the information processing unit 414 generates various signals such as a speech signal and reply data and outputs them to the information mixing / distributing device 412. To do. As a result, during the lecture, the utterance signal, reply data, etc. are transmitted to the server 10 via the network NW1 capable of two-way communication.

Further, the voice processing unit 415 gives the lecture voice obtained from the server 10 to the speaker 45 to generate a voice. For example, the voice of the lecturer during the lecture, the voice of the questioner when another student asks a question, and the like are generated from the speaker 45. As a result, the learner can understand the question contents of other learners while attending the lecture at the remote place.

Further, in the voice processing unit 415, the microphone 46 inputs the voice of the student, performs predetermined voice processing, and outputs it to the information mixing / distributing device 412. However, the voice processing unit 4
15 inputs voice data from the microphone 46 from the time when the student terminal device 4 establishes a session for attending a lecture with the server 10 to the time when the lecture ends. The voice input from the microphone 46 is stopped during the time period when the student of the terminal device 4 is not attending the lecture.
As a result, when the student is attending a lecture at the student terminal device 4, the voice of the student is the microphone 46.
Is input, and the voice is transmitted to the server 10 via the network NW1.

The student terminal device 4 having such a configuration has a program for a student terminal which causes a computer equipped with peripheral devices such as an image pickup device and a microphone to execute the above-mentioned video processing, audio processing, information processing and communication processing. It can be realized by executing.

In the remote education system 1 having the above configuration, the lecture delivery station 2 can deliver the lecture scenery by the lecturer to the plurality of student side terminal devices 4 by the function of the server 10. And the video / audio of the instructor,
By synthesizing the video / audio of the students and the material video / audio stored in the database DB3, the lecture can be promoted in a dialogue form between the instructor and each student, and the instructor can compete with CG characters. It is also possible to provide lectures in a variety of lecture formats that have not been realized in the past.

Further, particularly when the lecture information is distributed to the plurality of student side terminal devices 4 by the functions of the video processing unit 21 and the audio processing unit 22 in the server 10, each student side terminal device 4 is provided. Since it is configured so that the content of the lecture information distributed to each student can be switched individually, even if one student asks a question to the instructor during a lecture, other students can ask questions. It is possible to obtain the person's video and audio, and to easily understand who is asking what kind of question.

Further, since the server 10 is provided with the image generation unit 31 for dynamically generating the images to be individually delivered to the student side terminal devices 4, for example, the lecturer may be the lecturer during the lecture. When a problem (eg, XX problem) is given to each student, and the answer data to the question is obtained from each student, the server 10 generates an image in which the correctness of the answer data is determined in real time, and each student learns. Can be sent. That is, the instructor does not need to judge the correctness of each student's answer, and can immediately grasp the correct answer rate and the like. In addition, the learner can immediately obtain the correctness / incorrectness determination result of his / her answer.

Further, since the image generating unit 31 is configured to dynamically generate and transmit an image corresponding to the inquiry information in real time when the inquiry information is input from the student side terminal device 4. The server 10 not only transmits the contents of the lecture while the lecture is being given, but also provides such information in real time when the learner wants to check personal information such as his / her progress and grades. Is possible.

That is, in the remote education system 1 having the above-mentioned configuration, the function provided in the server 10 enables
Individual and real-time information can be transmitted to each student terminal device 4 connected via the network NW1 capable of two-way communication, and detailed education can be provided to each student.

Although the embodiments relating to the present invention have been described above, the present invention is not limited to the contents described above.

For example, in the above description, the server 10
However, a form having a plurality of functions such as a function of dynamically generating an image, a function of synthesizing a video and a sound, a function of mixing an instructor video and a student video, a function of evaluating response data and the like has been described. By providing at least one of the above-mentioned plurality of functions, it is possible to carry out distance learning effectively utilizing bidirectional communication. Further, the functions of the server 10 may be shared by a plurality of servers.

In the above description, the example in which the server 10 is provided with the three databases DB1 to DB3 has been shown, but they may be integrated and managed in one database.

Further, the above-mentioned distance education system 1 can be realized not only by a connection form using the Internet but also by a connection using a LAN laid inside a school or the like.

[0099]

As described above, according to the invention of claim 1, not only the lecture information is distributed to the student side terminal device, but also the information that the student wants to know is learned in real time. It is possible to provide information that can be transmitted to the terminal device on the side and that the student himself / herself can manage the results, the progress and the like in a timely and easy manner. Further, since the video related to the information extracted from the database is dynamically generated at that time, it is not necessary to store the video itself in the database, and the management cost of the server is reduced.

According to the invention described in claim 2, when the transmission of the lecture information is completed, the information about the lecture and the student included in the database is updated, so that the latest information is always stored in the database. Is stored. As a result, the students will always be provided with the latest information.

According to the invention described in claims 3 and 5, when the answer data is input from the student side terminal device during the transmission of the lecture information, it is judged whether the answer data is correct or incorrect, and the judgment is made. Since the image corresponding to the result is dynamically generated and transmitted, it is possible to provide the information that allows the learner to immediately confirm whether the answer is correct or not.

According to the invention described in claims 4 and 6, since the information contained in the database is updated based on the judgment result of the answer data, the database always stores the latest grades concerning the students. become. As a result,
Students will always be provided with the latest information about their grades.

According to the invention described in claims 7 and 8, when the lecture signal is received from the student side terminal while the lecture video and the lecture audio are being transmitted, the student side input from the student side terminal device. Is configured to generate a video in which the video of the lecture and the video of the lecture are mixed, and to generate and transmit a voice in which the voice of the student input from the terminal device of the student and the lecture voice are mixed. Therefore, the lecture can be advanced by the dialogue between the instructor and the learner, and the other learners can grasp the content of the dialogue.

According to the inventions of claims 9 and 10,
When information is input from the student terminal device while sending lecture information, the material video is extracted according to the information, and the material video is combined with the lecture video included in the lecture information and sent. Because it is composed of, the students can get the necessary information even during the lecture. For example, the learner can confirm the meaning of a term in a lecture in real time.

According to the invention described in claim 11, the state of the student is evaluated based on the information about the student, and the material image is synthesized with the lecture image included in the lecture information according to the evaluation result. Since it is configured to be transmitted after that, it is possible to transmit an image suitable for the student. For example, if the students are not taking progress, they can compose an image that encourages them to take a lesson in the corner of the screen of the lecture video, so that they can send inquiry information while they are attending the lecture. It is possible to grasp one's own state without doing it.

According to the twelfth aspect of the invention, since the material voice is synthesized with the lecture voice included in the lecture information and transmitted, it is possible to provide the voice information supplementing the lecturer's voice. .

According to the thirteenth aspect of the present invention, it is possible to provide the educational information that effectively uses the two-way communication, and to realize the distance learning system that can provide the detailed education.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram showing an overall image of a distance education system.

FIG. 2 is a block diagram showing a configuration of a server.

FIG. 3 is a diagram showing a detailed configuration of a video processing unit.

FIG. 4 is a diagram showing a detailed configuration of a voice processing unit.

FIG. 5 is a block diagram showing a configuration of a student side terminal device.

[Explanation of symbols]

1 Distance education system 2 lecture distribution station 3 base stations 4 Student side terminal equipment 5 Lecture information input / output unit (lecture information input means) 6 Communication unit (communication means) 10 Remote education system server (server) 13 Data receiver 15 Input data analysis unit 16 Control unit 20 Lecture Information Transmission Unit (Lecture Information Transmission Means) 21 Video processing unit (video processing means) 22 Voice processing unit (voice processing means) 23 Synthesis Processing Section (Synthesis Means) 30 Data processing unit 31 image generation unit (image generation means) 32 Database update unit (update means) 33 Evaluation Department (Reply data processing means, evaluation means) DB1, DB2, DB3 database NW1, NW2 network

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 7/18 H04N 5/91 LF term (reference) 2C028 AA00 BA01 BA02 BA03 BB04 BB06 BC02 BC05 BD02 CA13 CB12 DA01 DA03 5B075 KK02 KK07 ND06 ND20 UU40 5C053 FA23 JA01 LA01 LA15 5C054 AA02 AA05 CC02 EA07 GB01 HA16 5C064 AA01 AC04 AC06 AC12 AC16 AD08 AD14

Claims (13)

[Claims] 1. A server for a remote education system for transmitting educational information to a remote place via a network, comprising: lecture information input means for inputting lecture information including lecture video and lecture audio; and the network. Communication means for performing two-way data communication with the student side terminal device via the lecture information transmission for transmitting the lecture information input from the lecture information input means to the student side terminal device via the communication means Means, a database in which information about lectures and students is stored, and when there is input of inquiry information from the student side terminal device via the communication means, information from the database according to the inquiry information To dynamically generate a display image and send the display image to the student terminal device that has received the inquiry information via the communication means. Server for remote education system comprising an image generating unit, a to. 2. The server for a remote education system according to claim 1, which functions when the lecture information transmitting means finishes transmitting the lecture information, and updates the information about the lecture and the student included in the database. A server for a remote education system, further comprising: 3. The server for remote education system according to claim 1, wherein during the transmission of the lecture information, response data is input from the student side terminal device via the communication means, An answer data processing unit that determines whether the answer data is correct or not is further provided, and the image generation unit dynamically generates the display video image according to a determination result of the answer data processing unit and transmits the display video image. A server for a remote education system, which is characterized by: 4. The server for remote education system according to claim 3, wherein the updating means updates the information contained in the database based on the determination result by the response data processing means. Education system server. 5. A server for a remote education system for transmitting educational information to a remote place via a network, comprising: lecture information input means for inputting lecture information including lecture video and lecture audio; and the network. Communication means for performing two-way data communication with the student side terminal device via the lecture information transmission for transmitting the lecture information input from the lecture information input means to the student side terminal device via the communication means Means for answering data from the student terminal device via the communication means during transmission of the lecture information, and answer data processing means for judging whether the answer data is correct or incorrect; A video for display is dynamically generated according to the determination result in the processing means, and the video is displayed to the student terminal device to which the answer data is input via the communication means. Server for remote education system comprising an image generating means for transmitting 示用 image, a. 6. The server for remote education system according to claim 5, based on a database in which information about students is stored, and a determination result in the response data processing means,
Update means for updating the information contained in the database, the image generating means, when the inquiry information is input from the student side terminal device via the communication means, to the inquiry information Accordingly, information is extracted from the database to dynamically generate a display video, and the display video is transmitted to the student terminal device that has input the inquiry information via the communication means. Server for remote education system. 7. The server for remote education system according to claim 1, wherein during the transmission of the lecture video and the lecture audio, a speech signal is sent from the student side terminal via the communication means. When received, a video processing means for generating and transmitting a video obtained by mixing the video of the student input from the terminal device of the student and the lecture video, in synchronization with the video processing means, A server for a remote education system further comprising voice processing means for generating and transmitting a voice in which the voice of the student input from the terminal device of the student and the lecture voice are mixed and generated. 8. A server for a remote education system for transmitting educational information to a remote place via a network, comprising: lecture information input means for inputting lecture information including lecture video and lecture audio; and the network. Communication means for performing two-way data communication with the student side terminal device via the lecture information transmission for transmitting the lecture information input from the lecture information input means to the student side terminal device via the communication means Means and an image of the student side input from the student side terminal device when a speech signal is received from the student side terminal via the communication means during transmission of the lecture video and the lecture voice. A video processing means for generating and transmitting a video mixed with the lecture video, and a voice on the student side input from the student side terminal device in synchronization with the video processing means, Server for remote education system and a voice processing means for transmitting the speech obtained by mixing serial lectures speech to produce. 9. The distance education system server according to claim 1, wherein a database for storing material images to be used as teaching materials, and the student through the communication means during transmission of the lecture information. When there is information input from the side terminal device, a synthesizing unit that extracts the material video according to the information and synthesizes the material video with the lecture video included in the lecture information,
A server for distance learning system further comprising: 10. A server for a remote education system for transmitting educational information to a remote place via a network, comprising: lecture information input means for inputting lecture information including lecture video and lecture audio; and the network. Communication means for performing two-way data communication with the student side terminal device via the lecture information transmission means for transmitting the lecture information to the student side terminal device via the communication means, and material for teaching material A database for storing images, and during the transmission of the lecture information, when information is input from the student side terminal device via the communication means, the lecture images included in the lecture information are changed according to the information. And a synthesizing means for synthesizing the material images and giving them to the lecture information transmitting means. 11. A server for a remote education system for transmitting educational information to a remote place via a network, comprising: lecture information input means for inputting lecture information including lecture video and lecture audio; and the network. A communication means for performing two-way data communication with the student side terminal device through the database, a database storing information about the student and material images used as teaching materials, and the state of the student based on the information about the student. The synthesizing means for synthesizing the material video with the lecture video included in the lecture information according to the evaluation result, and the video synthesized by the synthesizing means, the student through the communication means. A server for a remote education system, comprising: lecture information transmitting means for transmitting to a terminal device on the side. 12. The server for remote education system according to claim 10, wherein material sound is further stored in the database, and the synthesizing means further corresponds to the lecture sound included in the lecture information. A server for a remote education system, which synthesizes the material voice. 13. A base station and a student terminal device are connected via a network, and two-way data communication is performed between the base station and the student terminal device to transmit and receive educational information. A distance learning system, wherein the base station comprises the distance learning system server according to any one of claims 1 to 12.