JP2002062790A - Community study system utilizing digital video - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize new teaching which is interactive and which gives high learning effects by making oneself of a leaner correctly grasp the state of movement in virtual space and making oneself of the learner reproduce action in the space of the past, in a study system bin which virtual reality is utilized. SOLUTION: A controller 3 for a teacher creates the image of a space A of a digital video and displays it on a large-screen display 1. The terminal device 2, provided with a small display of each learners, is provided with a means 21 for generating and displaying the image of the independent viewpoint of a learner for performing display by the independent viewpoint of the learner who walks about the virtual space in the image displayed on the large-screen display 1, and moreover, the terminal device 2 is provided with a means 22 for indicating movement information display of a leaner and a means 23 for controlling movement information display of the leaner and a means 24 for recording and storing movement information of the leaner to enable displaying of the state of movement of the leaner himself, in the virtual space.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a collaborative learning system using digital images using educational equipment connected to a computer via a communication network.

[0002]

2. Description of the Related Art Computers have been actively introduced into schools under the guidance of the Ministry of Education. In addition to using computers only for creating test questions and totaling grades, students can use their own independent educational equipment terminals connected to the computers via communication lines to provide questions, answer,
Various learning systems that perform tallying and information exchange have been proposed.

FIG. 23 is an example of a block diagram of a conventional learning system. In this configuration, a parent device 110 for teachers and a plurality of child devices 120 for students are connected via a LAN 130. In this learning system, the teacher uses the parent device 110 to provide questions and explanations to the child device 120,
The student gives an answer and a question from each child device 120 for himself, and the teacher can proceed with the lesson while grasping the degree of understanding of the student based on the total result.

A current learning system having such a function can be expected to have a certain learning effect when performing self-study, language learning and music learning using a terminal equipped with a microphone or a headphone.

However, when a teacher develops a class using a lecture using a blackboard, a projector, or the like, the learning system using the educational device terminals provided for the students has a difficulty in understanding each student. And the degree of interest are not sufficiently reflected in the class, and the class is ultimately advanced at the discretion of the teacher, making it a learning system with excellent interactivity.

[0006]

[Problems to be Solved by the Invention] Like a conventional learning system using educational equipment terminals, knowledge is transmitted in one direction,
Rather than a style that emphasizes knowledge retention in the mind, students can develop their own ability to search and discover issues in response to changes in the situation, and to consider and create multifaceted ways to respond to them. System development is required. In other words, it is desirable to shift from education that focuses on one-way knowledge absorption to an education and learning system that is suitable for a knowledge society that focuses on discovering and creating information by students themselves.

[0007] For this purpose, an audio-visual information input / output system that can flexibly respond by obtaining and sharing information while actively interacting with learning objects and others is effective. Virtual Reality (Virt
It is considered that the application of ual Reality technology is effective.

[0008] In consideration of this, when considering a learning system in which the alter ego of a learner (student) has a learner's own viewpoint in a digital video space of virtual reality and can freely roam in the space, It is necessary to be able to grasp the situation in each virtual space of each learner (for example, the state such as whether the learner is moving or stopped, the direction of the line of sight, etc.). Further, when a teacher gives an explanation to a series of actions of a learner in a virtual space, it is necessary to be able to reproduce past actions of the learner.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and presents learner's motion information in a virtual digital video space to provide a learner and a teacher with a learner in a virtual space. To understand the situation of
It is another object of the present invention to reproduce past learner's actions if necessary, so that lessons using a digital video space can be smoothly advanced.

[0010]

FIG. 1 is a diagram for explaining the outline of the present invention. The system includes a large-screen display 1, a plurality of terminal devices 2 with small displays for learners, a control device 3 for teachers that controls the large-screen display 1 and the terminal device 2 with small displays,
And a network connecting these devices.

The large-screen display 1 is a screen that can be viewed by both the teacher and the learner. The control device 3 for the teacher displays an image (digital video space A) full of a sense of presence on the large-screen display 1. It has a large-screen display control means 31 for creating and giving the learner an immersive feeling. This image is recorded and stored in a storage device in the system, together with search data for enabling a search.

Each of the terminal devices 2 with a small display has a learner's independent viewpoint for displaying the learner walking around the virtual digital video space A in the image displayed on the large screen display 1 from an independent viewpoint. Image generation and display means 21 is provided.

Further, each terminal device 2 with a small display is provided.
The learner operation information display instruction means 22 for instructing the display of the operation information of the learner using the digital video space by menu selection of the learner, etc. Learner motion information display control means 23 for presenting motion information of the learner in the digital video space. Further, there is provided learner operation information recording / storage means 24 for recording and accumulating operation information of the learner using the digital image space displayed on the large screen display 1 in the digital image space.
3 can read out the learner's movement information recorded and stored in the learner movement information recording and storage means 24, and reproduce past learner's movements. As a result, the learner can perform an interesting experiential learning in a form in which the learner blends into the virtual space in the large screen display 1, and an effective lesson that can satisfy the curiosity of the learner is realized. Further, the learner can always grasp his / her situation in the virtual space.

In addition, the controller 3 for the teacher also uses the learner's operation information for instructing the display of the operation information of the learner using the digital video space in order to know the situation of the learner walking around the virtual space. It has display instruction means 32 and learner operation information display control means 33 for presenting the learner's operation information in the digital video space in response to the learner's operation information display instruction. Further, there is a learner operation information recording and storage means 34 for recording and storing operation information of the specific learner or all learners using the digital image space displayed on the large screen display 1 in the digital image space.
The learner operation information display control unit 33 can also read the learner's operation information recorded and accumulated in the learner operation information recording and accumulation unit 34, and reproduce the past learner's operation.
As a result, it is possible to add a supplementary explanation later to a matter or a question that the learner wondered while acting in the digital video space.

Here, the learner's motion information is information such as the learner's position at a certain point in time, whether the learner is moving or stopped, the direction of the line of sight, and the like. A movement vector may be included. Further, these time-series data may be used.

The large screen display 1 can display an image of a virtual space in which a learner can walk around, and can also create and display an image of a textbook content common to all learners. Terminal device 2 with small display
Has input / output means for performing detailed explanation and reconfirmation of textbook contents displayed on the large-screen display 1 in response to a request from the learner.

The image of the virtual space displayed on the large-screen display 1 is converted based on instruction information from the terminal device 2 with a small display or the control device 3 for teachers.
Means for controlling can also be provided. By these,
It is possible to realize an interactive lesson adapted to the degree of interest and interest of the learner.

Further, the following means can be provided as needed. The controller 3 for teachers has, for example, a processing and editing means for copying, publicly transmitting, performing, showing, distributing, lending or adapting the recorded and stored image of the created image. As a result, it is possible to easily create original teaching materials that are needed at any time.

At the time of the processing and editing, processing and editing control means is provided for permitting processing of only the processing and editing for which the copyright regarding the duplication, public transmission, performance, screening, distribution, lending or adaptation of the recorded and stored image is approved. You can also. Furthermore, the terminal device 2 with a small display and the control device 3 for teachers
Means may be provided for displaying copyright data relating to use, including duplication, public transmission, performance, screening, distribution, lending or adaptation of the recorded image. This makes it possible to avoid copyright problems.

[0020] In addition, if the user wishes to copy, store, play, show, distribute, lend or adapt the recorded image, the copyright owner is inquired and the copyright owner's answer is displayed to the user. By providing means for managing copyright data related to use, it is possible to effectively use a copyrighted work of another person. At this time, by providing a means for charging according to the content of the copy, public transmission, performance, screening, distribution, lending or adaptation of the recorded and stored image, the use of useful work can be promoted.

Further, the processing / editing means attaches the specific terminal identification number, the name of the processing editor, and the copyright data to the video of the processing / editing result using, for example, a digital watermarking technique, so that the copyright for the processed / edited image is obtained. Management becomes possible.

[0022]

Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 2 is a configuration diagram of the first embodiment of the learning system according to the present invention. 1 is a large screen display, 2 is a terminal device with a small display, 3 is a controller for teachers, 4 is a LAN, and 5 is a computer.

A case of learning about a medieval historic building in a world history class will be described as an example. The teacher operates the control device 3 at hand, accesses the database of the computer 5, and projects on the large-screen display 1 an image related to a medieval building according to a predetermined story, such as a movie. At this time, the presence is enhanced by making full use of a three-dimensional image or a three-dimensional sound device. By looking at the large-screen display 1, the learners can enjoy an immersive feeling as if they were actually observing the building.

In such a learning situation, for example, each learner is interested in the structure and pattern of the pillars of the building, and is interested in the painting on the wall, It is expected that interests will be different, such as wanting to see inside.

In this case, the learner operates the terminal device 2 with a small display at hand, and, for example, a person who is interested in painting extracts a space containing the painting and enlarges the image of the painting on the small display. And images of paintings with different viewpoints. You can also listen to detailed explanations about the painting through the earphone. In this way, learners can acquire deeper knowledge.

It should be noted that the teacher observes the learning situation of each learner, grasps whether each learner is paying attention to his / her own terminal device 2 or the large screen display 1, and learns more than half of the learners. When the user is paying attention to his / her own terminal device 2, the control device 3 at hand can stop, delay, or adjust the projection on the large screen display 1. Further, the teacher operates the control device 3 to display the image of the painting or the like enlarged on the small display of the terminal device of a certain learner on the large screen display 1 or to display it on the small display of the terminal device of another learner. It is also possible to display it, and it is possible to deepen each other's learning.

Further, when the learner advances the lesson on the large screen display 1 while operating his / her own terminal device 2, the part of the learner who has escaped to the small display of the terminal device 2 is displayed. If the video is projected in the fast-forward mode to recover the delay, the video on the large screen display 1 is overlooked, or the description is missed, the content can be reconfirmed using the terminal device 2.

Next, another method of conducting a lesson using the learning system shown in FIG. 2 will be described.

Prior to the start of the lesson, one or several learners are selected. The chosen learner will be the avatar in the pre-determined role of the class for the day. The learner acting as the avatar operates the terminal device 2 to freely move around as a avatar in the historic building projected on the large-screen display 1 and relive the behavior of the historical person (roll). Play) to deepen learning. The whole story unfolds on the large screen display 1, but the location where it moves around varies depending on the interest and the degree of interest of the learner of the avatar role, and the end depends on the judgment of the learner of the avatar role. By changing the role of avatar, classes can be developed from multiple perspectives.

Each of the terminal device 2 and the control device 3 can display a guide map of a virtual space where the avatar of the learner is walking, and the position and the line of sight of the learner. The position can be confirmed, and if necessary, the teacher can confirm the position of the learner and give appropriate advice to the learner.

The contents and progress of the lecture as described above
Even if you start a lecture using the same teaching materials, it will naturally differ depending on the interests and understanding of the learners at that time. Therefore, during or at the end of the lecture, the image generated by the teacher for supplementary explanation is appropriately recorded and recorded on the recording device provided in the control device 3.
accumulate. Then, when recording / accumulating, the image data is
At this time, information for identifying when and which class is the class data, and search data for identifying an object such as an image related to a building or an image related to a painting are attached. By attaching the search data, the search can be easily performed at the next lecture or at a lecture in another class.

The control device 3 reproduces the recorded and stored image within the range specified by the copyright,
It has processing and editing means for performing, showing, distributing, lending, and adapting. By using this processing and editing means, the teacher can create a supplementary teaching material for the class and edit images for testing.

In this case, it is important to know whether the processing of the original image data is permitted by copyright or only the use is permitted. Therefore, the copyright data relating to the use of the recorded and stored image, including duplication, public transmission, performance, screening, distribution, lending, and adaptation, is displayed on a display device provided in the controller 3 for teachers. By checking the displayed copyright data, the teacher can judge whether the image can be freely processed and edited. In some cases, the copyright data may be displayed on the terminal device 2 with the small display.

FIG. 3 shows a display example of copyright information (data). The teacher's control device 3 includes, as the copyright data, the content name of the digital video to be copyright-managed, the name of the content copyright owner (there may be a plurality of people), the content usage conditions (period, place, usage mode, etc.). ), And holds and manages information such as content owner names. Information such as an e-mail address and a URL (Uniform Resource Locator) may be held as the content copyright owner name and content owner name. When there is a display request from the teacher, the controller 3 for teacher displays the information on the display. Also, when there is a request for processing / editing an image, which does not satisfy the usage conditions, the copyright data is automatically displayed.

If the data cannot be edited or edited without permission, the control device 3 inquires of the copyright holder using a communication line such as the Internet from the control device 3 that the user is not permitted to use the data. Then, an answer from the copyright holder regarding use is displayed on a display device provided in the control device 3. Based on the answer, the teacher performs additional registration of the copyright data on use in accordance with the content of the above-mentioned recorded and stored image, public transmission, performance, screening, distribution, lending, and adaptation. When the registration is made, a usage fee corresponding to the usage mode is charged, and the teacher or the accountant at the educational facility pays a predetermined fee.

When processing the recorded and stored image, the identification number of the specific terminal of the control device 3 used, the name of the processing editor, and the copyright data may be attached to the video of the processing and editing result. desirable. As this attachment method, it is possible to prevent falsification of the embedded data and prohibit its misuse by embedding it in video data using a digital watermarking technique described later.

As described above, since the use, processing, and editing of digital image data are performed in accordance with the copyright rules, copyright problems can be avoided.

FIG. 4 is a block diagram showing a second embodiment of the learning system according to the present invention.

The system shown in FIG. 4 has a configuration in which the learning system described in FIG. 2 is arranged at multiple points as system units 7 and these system units 7 are connected by a high-speed network 6. The system unit 7 is set, for example, on a class basis or a school basis. In the present embodiment,
A relatively large class can be developed using common teaching materials.

The system unit 7 is replaced by the large screen display 1, the terminal device 2 with a small display for the learner, and the LAN 4 connecting them without the computer 5 and the control device 3 for the teacher described in FIG. The sub-unit configuration consists of a high-speed network 6 by combining this sub-unit with a fully equipped system unit.
May be connected. In this case, only one teacher advances the lesson in the entire system, and even in a school where no teacher is familiar with the learning system of the present invention, a common lesson can be taken.

As described above, by linking the individual learning system units in the high-speed network 6,
One image recording and storing means 8 common to the high-speed network 6
By storing and generating images corresponding to each learning system unit, for example, a common class can be developed in different classes and schools, sharing knowledge and increasing the number of variations in experiential learning Therefore, the learning depth also increases. Further, by constructing such a learning system, it becomes possible to unify the above-mentioned copyright-related procedures and usage fees.

By connecting the above-mentioned learning systems with a higher-level high-speed network, it is also possible to construct a system for each city, prefecture, or country, thereby further expanding the sharing of knowledge. .

Hereinafter, a more detailed description will be given with reference to FIGS.

FIG. 5 shows a block diagram of the system configuration.
Reference numeral 1 in the figure corresponds to the large screen display 1 shown in FIG. 2, 11 is a controller processing unit for teacher, 12 is a display device (for teacher) control unit, 13 is a display for teacher, 1
4 is a database, 15 is a learner controller processing unit, 16 is a display device (for learner) control unit, 16 'is a display device control unit of another learner, 17 is a learner's display, 18 is a database, 19 Represents an audio device, 40 represents an image recording device, and 41 represents a related data recording device.

As described above, the teacher operates the teacher controller processing unit 11 to display a necessary screen on the teacher display 13 via the display device control unit 12, for example. At this time, the display device control unit 12 also causes the large screen display 1 to display the sound, and generates sound corresponding to the large screen as needed through the audio device 19. Further, it instructs the display device (for learner) control units 16, 16 'to generate necessary screens and sounds. The contents displayed on the large screen display 1 are basically the same as the contents displayed on the teacher display 13. However, the teacher display 13 may display, for example, a question from a learner or other information that only the teacher needs, due to a small window or the like, and contents that are not displayed on the large screen display 1 may be displayed. There is.

On the learner's side, the learner operates the learner's controller processing unit 15 to display necessary screens via the display device control unit 16. That is, a necessary screen is displayed on the display 17 for learners, and a screen instructed by the teacher is also displayed on the display 17 for learners as necessary. Also,
The learner selects necessary information (contents of a textbook, etc.) in the database 18 and gives control information to the display device (for teacher) control unit 12 by an operation from the learner. 1 can be changed or a new display can be added.

As described above, when the teacher or the learner judges that the image information (including the sound) created from the original image during the lecture should be recorded and accumulated, the teacher controller processing unit 11 Perform operations on By this operation, the teacher controller processing unit 11 attaches the search data to the created image, and records and accumulates the image in the image recording device 40 via the display device control unit 12. The images stored in the image recording device 40 are read out by operating the teacher controller processing unit 11 with reference to the attached search data, and the large-screen display 1, the teacher display 13, and the learner display are displayed. 17 is displayed.
In addition, a sound corresponding to a large screen is generated as necessary via the sound device 19.

Further, data related to the created image can be searched as needed, and the searched related data is
It can be recorded and stored in the related data recording device 41 at any time.

FIG. 6 shows an example of an operation menu in the control device for teachers and the terminal device with a small display.

As shown in FIG. 6A, pull-down menus such as "control", "position / operation window display", and "device control" are available as menus that the teacher can select and input from the teacher control device 3. There is a menu.
The menu items of “control” include “large screen control” for controlling the display of the digital video space on the large screen display 1 and the operation of the learner.
"Recording of large-screen display contents" to record and accumulate the display contents on the large-screen display, "All-learner terminal status display" to enable viewing of the actions of any learner or all learners at any time, past And "selection reading of all past operating conditions" for selecting and reading all the operating conditions recorded in the past.

The "position / operation window display" menu item includes an operation display indicating whether the selected learner is moving, stopped, or learning on another screen. "Operation display On / Off", "Map display On / Off" indicating whether or not to display a guide map window for a virtual digital video space displayed on the large screen display 1, a specific learner or all "Physical position display On / Of" indicates whether the position of the learner in the digital video space is displayed in the guidance map window.
f) (valid only when map display is on), and "Past operation status display On / Off" indicating whether or not to display the past operation status of a specific learner or all learners (however, map (Valid only when the display is ON)).

Further, as a menu item of “device control”, a “learner terminal” for displaying the use status of the terminal device 2 with a small display, selecting the terminal device 2 with a small display, and controlling the terminal device 2 is controlled. "Control" and "recording / storage device control" for performing control such as copying, deletion, and file name change of image data recorded and stored in the image recording device 40.

FIG. 6 shows a menu that can be selected and input by each learner from the terminal device 2 with a small display.
As shown in (B), there are pull-down menus such as "control" and "position / operation window display". Basically, it is the same as the teacher menu of FIG. 6A described above, but in the case of the learner menu, there is no “device control” menu. Further, in the menu item of "control", there is no function of directly controlling the large screen display 1, and only the small display of the terminal itself can be controlled.
However, the learner's terminal has a menu that can instruct recording and accumulation of display contents on the large screen display 1 and recording and accumulation of display contents on the small display of the terminal itself. "Student terminal status display" can display the terminal status of all learners in the case of the teacher's menu, whereas the learner's menu displays the browsing of the terminal status. Only the learner's terminal status can be viewed.
As for “reading the past operation status”, only the operation status that is open to the learner can be browsed.

FIG. 7 shows a display example by selecting the position / operation window display menu. The same is true for the teacher menu and the learner menu. When “operation display On” is selected, a superimposed operation display window is displayed on the display screen of the virtual digital video space as shown in FIG. In this window, learner's operation information such as moving, stopping, and learning is displayed. When the operation information of a plurality of learners is displayed, a learner name or a terminal name is also displayed.

When "map display On" is selected, FIG.
As shown in (B), a map of the digital video space is displayed on the screen of the virtual digital video space, and where the current viewpoint A corresponds in the space is displayed.
When there are a plurality of learners, they can be distinguished by color coding, display of learner names, terminal names, and the like.

When "physical position display On" is further selected while "map display On" is selected, in addition to the position of the learner in the map display, the line of sight of each learner is displayed. It is displayed as shown in FIG. In the same figure, an example of the learner A facing to the right is shown.
In the case of “past operation status display On”, FIG.
As shown in (D), the arrow or the character indicating the physical position or the like becomes semi-transparent to indicate that it is past information.

Next, a normal lecture flow using the learning system shown in FIGS. 2 and 5 will be described.

FIG. 8 shows a processing flow in the display device (for teacher) control unit 12. Step S1: Select three-dimensional digital video space model data to be displayed. The model data is structured by time, such as when the three-dimensional space is intended, and data to be read can be arbitrarily selected. In addition, it is possible to select to read the recorded contents on the large screen or the past operation status. Step S2: Load from a storage device and read model data in a three-dimensional space. Step S3: A viewpoint position for determining from which viewpoint the three-dimensional space is to be displayed is calculated. Step S4: Calculate the relative positional relationship of each part in the three-dimensional space from the position of the viewpoint. Step S5: Conversion of screen size, display area, display accuracy, etc. is performed as necessary. Step S6: For example, a process of generating an object (for example, an avatar for a teacher or an avatar for a learner) to be present in a three-dimensional space (for example, in a background space) is performed. Step S7: The position of the object is calculated based on the input to the controller and information from the learner (for example, learner's position information). This is sent to the display device control unit 16 for the learner. Step S8: Calculation is performed on the object corresponding to the movement of the object based on the input to the controller. This is the display control unit 1 for the learner.
It is sent to the side of 6. Step S9: Calculate shadows and shadows corresponding to the presence and movement of the object. Step S10: The display method specified by the position / operation window display menu described with reference to FIG. 6 is selected, and if necessary, data to be displayed in the operation display window or the map display window is created. Step S11: Output to the display.

FIG. 9 shows a display device (for learner) control unit 16.
2 shows a processing flow. Step S20: Select three-dimensional digital video space model data to be displayed on the learner's display 17.
Here, it is possible to display, for example, a comparison of a temporal change of a structure by designating how many years ago or how many years later the digital video space displayed on the large screen display 1 is. It has become. In addition, it is possible to select to read the recorded contents on the large screen or the past operation status. Step S21: Download the model data of the three-dimensional space from the display device (for teacher) control unit 12. Step S22: The viewpoint position for determining from which viewpoint the three-dimensional space is to be displayed is calculated. Step S23: Calculate the relative positional relationship of each part in the three-dimensional space from the position of the viewpoint. Step S24: Conversion such as screen size, display area, and display accuracy is performed as necessary. Step S25: Information about the current content, participant information in the virtual space, and the like are received from the display device (for teacher) control unit 12 and the display device control unit 16 'of another learner. Step S26: A process of combining the objects on the screen is performed. Step S27: The display method designated by the position / operation window display menu described with reference to FIG. 6 is selected, and if necessary, data to be displayed in the operation display window or the map display window is created. Step S28: Output to the learner's display 17.

FIG. 10 shows a processing flow of the device control menu processing in the display device (for teacher) control unit 12 in particular. Step S30: Display the menu of the display device (for teacher) control unit 12. Step S31: When "learner terminal control" is selected in the "device control" menu shown in FIG. 6, the selection operation is detected. Step S32: Display and select the terminal status of all learners. Here, the terminal status refers to load information, usage status, and the like of the terminal computer being used. Step S33: Select a learner's terminal. Step S34: The priority of the user authority is set to be higher for the teacher than for the learner using the selected terminal. Step S35: Control the computer of the learner's terminal. Thereby, the control of the content displayed on the learner's display 17 can be performed from the teacher's control device 3. Step S36: When "recording / storage device control" is selected in the "device control" menu shown in FIG. 6, the selection operation is detected. Step S37: Editing (addition, addition, etc.) of data in the recording server (the image recording device 40, the related data recording device 41, etc.)
Delete, move, copy, etc.).

FIG. 11 shows the teacher controller processing unit 11.
2 shows a processing flow. Step S40: In response to the input, it is determined whether the input is a keyboard input or an input from a controller such as a video game controller. Step S41: In the case of an input from the controller, a process described later with reference to FIG. 13 is started. Step S42: In the case of input from the keyboard,
It is checked whether the input is preset for each key of the keyboard. Step S43: If NO, error processing is performed. Step S44-i (i = 1 to n): In the case of YES, the preset processing (for example, movement to position i on the screen) is performed in response to key input.

FIG. 12 shows the controller processing unit 1 for the learner.
5 shows a processing flow. Step S50: In response to the input, it is determined whether the input is a keyboard input or an input from a controller such as a video game controller. Step S51: In the case of an input from the controller, a process described later with reference to FIG. 13 is started. Step S52: In the case of input from the keyboard,
Determine whether it is a command or a screen selection. Step S53: In the case of screen selection, it is checked whether the input is a preset input. Step S54: If NO, error processing is performed. Step S55-i (i = 1 to n): If YES, move to the position i on the screen according to the preset value. Step S56: If it is a command, the process corresponding to the command is started. Step S57: If NO, error processing is performed. Step S58: Check whether the command is a preset command. If NO, error processing is performed. Step S59-i (i = 1 to n): In the case of YES, the corresponding process is started. As a command,
For example, there are various kinds of instructions, such as instructions for searching the database for related data, instructions for displaying text such as detailed explanations, instructions for displaying video such as rewinding and fast-forwarding, instructions for selecting a communication mode, ..., and instructions for connecting to the Internet. ing.

FIG. 13 shows a processing flow of the controller processing. Step S60: It is checked whether or not the viewpoint is preset at a predetermined position according to the input. If YES, the process proceeds to step S78. Step S61: In the case of NO, it is checked whether the position has moved back and forth or left and right. Step S62: In the case of YES, the movement amount before and after or right and left of the position is detected. Step S63: The moving amount is checked to see if it is out of the range. Step S64: If the movement is out of the range, the movement is limited to the end. Step S65: If within the range, move by that amount. Step S66: If step S61 is NO,
Check whether the height of the viewpoint has risen or fallen. Step S67: In the case of NO, it is checked whether or not the viewpoint is directed diagonally upward or diagonally downward (it is checked whether only the eyes are moved and the user looks upward or downward). Step S68: If step S67 is NO,
Processing is canceled. Step S69: If step S67 is YES, check the value. Step S70: If the value is within the range, the position to which the viewpoint is directed is calculated and displayed. Step S71: If it is out of the range, the movement is limited to the boundary (end). Step S72: If step S66 is YES, check the value. Step S73: If the value is within the range, the position of the object to be viewed is detected. Step S74: If it is out of the range, the further moving process corresponding to the upper and lower sides of the viewpoint is stopped. (A display outside the range is displayed. For example, a display such as the sky or the ground is performed.) Step S75: It is detected whether the object to be viewed is inside or outside a building or the like. Step S76: If the object goes outside, the object to be viewed is changed. Step S77: If it is inside, further movement of the viewpoint is permitted. Step S78: If step S60 is YES, it is checked whether or not the viewpoint is to be centered at the origin position. Step S79: In the case of YES, centering is performed. Step S80: If NO, the current viewpoint position is confirmed assuming that a plurality of preset viewpoint positions are prepared. Step S81: A plurality of preset positions of the viewpoint are incremented. Step S82: The next preset position is displayed.

FIG. 14 shows a control configuration for the large screen display 1. Reference numerals 1 and 13 in the figure correspond to the same reference numerals in FIG. 5, reference numeral 42 denotes a display screen size converter,
43 indicates an external synchronizing device. The content displayed on the teacher display 13 is converted in size by the display screen size converter 42 while being synchronized by the external synchronizer 43. Then, the result is displayed on the large screen display 1. If necessary, the image is divided and displayed on the large screen display 1 in a screen of a selectable size. For example, the large-screen display 1 is formed by combining three or more displays, and these three or more displays are arranged so as to surround the learner, and are configured to lead to a high sense of reality.

FIG. 15 shows a processing flow in the audio device 19. Step S90: Load the three-dimensional space model data from the storage device. Step S91: The position of the viewpoint is calculated. Step S92: Calculate the positional relationship with a plurality of sound sources. Step S93: Calculate the sound that reaches directly. Step S94: Calculation for adjusting the volume and delay time of the sound that arrives reverberantly is performed. Step S95: synthesize sound. Step S96: Sounds are separated from each other so as to generate sounds matched to the n-channel speaker positions from four channels. Step S97-i: The sound is amplified by the amplifier. Step S98-i: A sound is generated by the speaker.

FIG. 16 shows a processing flow corresponding to the databases 14 and 18. Step S100: A search request for the database 14 or 18 is received from the teacher or the learner. Step S101: It is checked whether or not the request corresponds to a request for which a preset corresponding to a search has been performed for a text or an image. If not applicable,
Error processing. Step S102-i: Extract data corresponding to the preset. Step S103: Perform window size calculation and reduction / enlargement processing within the screen. Step S104: A selection process between windows is performed. Step S105: Go to display processing.

FIG. 17 shows a processing flow when the learner accesses the large-screen display 1. The display control on the large screen display 1 is basically performed by the controller 3 for teachers, but the display control can be entrusted to the learner as needed. At this time, based on the instruction information from the learner controller processing unit 15, the learner can control the image on the large screen display 1 and switch the display on the large screen display 1. Reference numerals 11 and 15 in the figure correspond to FIG. Step S110: It is determined whether the input is from the keyboard or the controller. Step S111: In the case of input using the keyboard, it is checked whether or not to select a teacher's screen.
In the case of NO, the process proceeds to step S112. Step S112: In the case of input by the controller, processing in the learner controller processing unit 15 (FIG. 1)
2), the information determined by the processing is displayed on the large screen display 1. Step S113: If step S111 is YES, the processing in the teacher controller processing unit 11 (FIG. 1)
In step 1), display on the large screen display 1 is performed based on the input from the teacher controller processing unit 11. Step S114: The process of step S113 is stopped as necessary. Step S115: If the process is interrupted in step S114, the process enters into the process of the learner controller processing unit 15, and the display according to the instruction from the learner controller processing unit 15 is performed.

FIG. 18 shows a processing flow corresponding to the case where the generated image is recorded and stored. In step S11 in FIG. 8, the processing flow starts from a state where the generated image is displayed on the large screen display 1. Step S120: The image recording / accumulating program is loaded and activated based on an input to the controller. Step S121: Search data (image name, class name, date, etc.) is input from the controller. Step S122: Check on the display 13 for teacher whether the input is correct, and if correct,
By inputting YES, the image data generated on the large screen display 1 is stored in the image recording device 40 with the search data as a file name. If NO, the process returns to step S121.

FIG. 19 shows a processing flow corresponding to the case of searching for stored images. Step S130: The image recording / retrieval program is loaded and activated based on the input to the controller. Step S131: A list of file names corresponding to the search data is displayed on the teacher display 13. Step S132: Select a desired file from the above list (for example, move the cursor and click the mouse)
Then, the accumulated image is displayed on the teacher display 13 and the large screen display 1.

FIG. 20 shows a processing flow corresponding to the processing and editing of the stored image. Step S140: With the accumulated image displayed on the teacher display 13 in step S132 of FIG.
The image processing program is loaded and activated based on the input to the controller. Step S141: operating the controller to copy, publicly transmit, perform the image displayed on the display,
Perform desired processing or editing work for screening, distribution, lending, adaptation, etc. Step S142: The copyright data is embedded in the image data processed or edited using the digital watermark technology. Step S143: The processing flow of FIG.
In accordance with steps S120 to S122), the processed or edited image is stored in the image recording device 40.

FIG. 21 shows a processing flow corresponding to copyright management. Step S150: The copyright data of the image displayed on the teacher display 13 or the large screen display 1 is read out based on the input from the controller. Step S151: Check the contents of the read copyright data. Step S152: As a result of confirming the contents of the copyright data, if the use form to be performed (for example, copying or processing) is permitted, the operation proceeds as it is in accordance with the flow of FIG. Step S153: If the form of use to be performed is not permitted, the process inquires the copyright holder via the Internet. Step S154: The inquired answer is displayed on the teacher display 13. Step S155: If use is permitted, additional registration of copyright data relating to use is performed via the Internet. Step S156: After registration, processing or editing work is performed according to the flow of FIG. Step S157: A usage fee is paid to the copyright holder according to the processing or editing content, for example, using an electronic payment system.

The digital watermarking technique is a kind of digital signature. The signature is appropriately embedded in the entire image data in the image data itself, and it is not noticed just by looking at the image. This is a technology that shows the signature.
The technique disclosed in No. 5, "Embedded Information in Digital Image" can be used for embedding copyright data of the present invention.

FIG. 22 shows a configuration for performing learning at a remote place. Reference numerals 50-i (i = 1 to n) in FIG.
A system 51 is shown as shown in FIG. The whole system corresponds to Fig. 4,
A plurality of systems 50-i as shown in FIG. 5 are connected to the high-speed network 51, and learning at a remote place is possible.

[0074]

According to the present invention, the learner operates his / her own terminal device in accordance with the degree of understanding and interest to obtain detailed explanations and images with different viewpoints in addition to the common lesson contents. As a result, deep knowledge can be obtained and active and fulfilling classes can be developed. In addition, as an avatar, oneself can blend into the large-screen display, and experience learning can be performed, and an interactive lesson adapted to the degree of interest and interest of the learner can be realized. In particular, since the learner's motion information in the virtual digital video space can be presented, the learner and the teacher can grasp the learner's situation in the virtual space. In addition, if necessary, past learner's actions can be reproduced, and there is an effect that a lesson using the digital video space can be smoothly performed.

[Brief description of the drawings]

FIG. 1 is a diagram for explaining an outline of the present invention.

FIG. 2 is a configuration diagram of a first embodiment of the learning system of the present invention.

FIG. 3 is a diagram showing a display example of copyright information.

FIG. 4 is a configuration diagram of a learning system according to a second embodiment of the present invention.

FIG. 5 is a diagram showing a system configuration block diagram.

FIG. 6 is a diagram illustrating an example of an operation menu in a teacher control device and a terminal device with a small display.

FIG. 7 is a diagram showing a display example by selecting a position / operation window display menu.

FIG. 8 is a diagram showing a processing flow in a display device (for teacher) control unit.

FIG. 9 is a diagram illustrating a processing flow in a display device (for learner) control unit.

FIG. 10 is a diagram illustrating a processing flow of an apparatus control menu processing.

FIG. 11 is a diagram showing a processing flow in a teacher controller processing unit.

FIG. 12 is a diagram showing a processing flow in a learner controller processing unit.

FIG. 13 is a diagram showing a processing flow for controller processing.

FIG. 14 is a diagram showing a control configuration for a large screen display.

FIG. 15 is a diagram showing a processing flow in the acoustic device.

FIG. 16 is a diagram showing a processing flow corresponding to a database.

FIG. 17 is a diagram showing a processing flow when a learner accesses a large-screen display.

FIG. 18 is a diagram showing a processing flow corresponding to image recording and accumulation.

FIG. 19 is a diagram showing a processing flow corresponding to an image search.

FIG. 20 is a diagram showing a processing flow corresponding to processing and editing of a stored image.

FIG. 21 is a diagram showing a processing flow corresponding to copyright management.

FIG. 22 is a diagram showing a configuration for performing learning at a remote place.

FIG. 23 is a block diagram of a conventional learning system.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 Large screen display 2 Terminal device with small display 3 Control device for teacher 4 LAN 5 Computer 6 High-speed network 7 System unit 8 Image recording / storage means 11 Controller processing unit for teacher 12 Display device (for teacher) control unit 13 Teacher display 14 Database 15 Controller processing unit for learner 16 Display unit (for learner) control unit 17 Display for learner 18 Database 19 Sound device 21 Image generation and display unit of learner's independent viewpoint 22 Learner operation information display instruction unit 23 Learning Learner movement information display control means 24 learner movement information recording and accumulation means 31 large screen display control means 32 learner movement information display instructing means 33 learner movement information display control means 34 learner movement information recording and storage means 40 image recording device 41 related Data recording device

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Shuichi Sumita 2-3-1 Otemachi, Chiyoda-ku, Tokyo Within Nippon Telegraph and Telephone Corporation (72) Inventor Tatsuo Mori 2-3-3, Otemachi, Chiyoda-ku, Tokyo No. 1 F-term in Nippon Telegraph and Telephone Corporation (reference) 2C028 BA02 BA05 BB04 BB05 BC01 BD02 BD03 CA12 CB13 DA04 DA07 2C032 HB03 HC23 HC32 5B049 AA01 AA02 BB21 FF01 FF03 5B050 AA06 BA07 BA08 CA07 DA07 FA02 A37AC02 AC02 DA03 EB06 FA14 FA27 FA36 FA46 FB44

Claims (4)

[Claims] 1. A large-screen display, a plurality of terminal devices with a small display for learners, a control device for a teacher for controlling the large-screen display and the terminal device with a small display, and connecting these devices A learning system comprising a network that performs virtual networking on the large-screen display, and a terminal device with a small display, the learning device comprising: Means for generating and displaying an image of an independent viewpoint for performing display from an independent viewpoint of a learner walking around the virtual space of the learner; Means for instructing the display of motion information, and a digital image of the learner in response to the instruction to display the learner's motion information. Means for presenting motion information in space. A collaborative learning system using digital images. 2. A large-screen display, a plurality of terminal devices with a small display for learners, a control device for a teacher for controlling the large-screen display and the terminal device with a small display, and connecting these devices. A learning system comprising a network that performs virtual networking on the large-screen display, and a terminal device with a small display, the learning device comprising: Means for generating and displaying an image of an independent viewpoint for displaying the learner walking around the virtual space from the independent viewpoint, and operation information of the learner using the digital video space in the control device for the teacher. Means for instructing the display of the learner, and in response to the instruction to display the learner's movement information, the learner's movement information in digital video space. And a means for presenting a report. 3. A collaborative learning system using digital images according to claim 1 or 2, wherein the operation information in the digital image space of the learner using the digital image space displayed on the large-screen display is displayed. A collaborative learning system using digital video, comprising means for recording and accumulating, and wherein the means for presenting the learner's motion information displays the learner's motion information that has been recorded and accumulated. 4. A system unit comprising at least one set of learning systems according to any one of claims 1 to 3, and a system unit having the same configuration as the system unit or the teacher from the system unit. A collaborative learning system using digital video, wherein one or more units of a subsystem unit excluding a control unit for the system are connected via a network.