JPH0323486A - Information processor - Google Patents

Abstract

PURPOSE:To realize effective education, etc., combining the characteristics of each information by displaying video information synchronous with character/ graphic information. CONSTITUTION:An video information outputting means 11 which outputs video information and a character/graphic information outputting means 12 which outputs character/graphic information formed by a computer as information related to the video information are provided. Further, an information synchronizing means 13 which synchronizes the timing of the video information and character/graphic information, and a displaying means 14 such as CTR, etc., which inputs the video information and the character/graphic information and displays them in hourly parallel are provided. Then, video information and character/graphic information derived from both of the video information outputting means 11 such as video tape reproducing machine, etc., and character/ graphic information outputting means 12 which outputs character/graphic information formed by the computer are displayed simultaneously on the displaying means 14. In this way, video information can be handled as well as graphic information and image information, and effective education and market research, etc., can be realized.

Description

Detailed Description of the Invention "Field of Industrial Application" The present invention relates to an information processing device that is suitable for use in, for example, education using images or survey research, and particularly relates to an information processing device that is suitable for use in, for example, education using images or survey research. The present invention relates to an information processing device for handling and achieving desired purposes such as education and market research.

``Prior Art'' With the spread of television receivers and CRTs, education using these has become popular. For example, in classrooms such as elementary schools, television broadcasts and video tapes are used to output video information from a television receiver, and teachers ask questions based on this information to provide education. It is also widely practiced for individuals to study English conversation at home using teaching materials recorded on television or videotapes.

On the other hand, education using computers is also becoming more active.

In such education, educational content is displayed on the C'RT using characters and figures, or questions are asked and input answers are processed.

``Problems to be solved by inventions'' On the contrary, in the former type of education using television receivers, only the television receiver-driven education is carried out, and there is a risk that those receiving the education may become bored or drop out.

In order to eliminate this drawback, methods have been adopted in which teachers give supplementary explanations in front of the television receiver or ask questions after watching the video. However, this method requires teachers to familiarize themselves with the content of the video information output from the television and understand the questions to be asked in advance, and as the teaching materials become more diverse, the burden on teachers increases. Put it away. Also,
There is also the problem that the video information flows in one direction, making it difficult to match the level of the person receiving the education.

In contrast, in education using computers, interactive learning can be performed using input devices such as keyboards and mice. However, when graphic information or image information is used to facilitate understanding, there is a problem that image processing takes time and response becomes slow. Another problem is that it is difficult to express visual information that changes from moment to moment using graphical information or image information.

The above is an explanation using information processing devices related to education as an example.
However, similar problems existed with information processing devices used for other purposes such as collecting questionnaires.

Therefore, the first object of the present invention is to provide information processing that can handle not only graphical information and image information, but also video information!
The goal is to provide ffi.

A second object of the present invention is to provide an information processing device that can interact with information including video information.

A third object of the present invention is to provide information that, when handling video information in addition to graphic information and image information, can simplify the interface of a device that is interposed between devices that handle the former information and after-sound information. The purpose of this invention is to provide a processing device.

"Means for Solving the Problem" In the invention as claimed in claim 1, as shown in principle in FIG. Character/graphic information output means l2 that outputs created character/graphic information
, an information synchronizing means 13 for temporally synchronizing these video information and character/graphic information, and a display means 14 such as a CRT for inputting these video information and character/graphic information and displaying them temporally in parallel. Provided in the processing equipment.

And video information output means 11 such as a video tape player
and the character/graphic information output means 12 which outputs the character/graphic information created by a computer. achieve the purpose.

Further, in the invention as claimed in claim 2, as also shown in principle in FIG.
1, character/graphic information output means 12 for outputting character/graphic information created by a computer as information related to this video information, and information synchronization means 13 for temporally synchronizing the video information and character/graphic information. C, which inputs these video information and character/graphic information and displays them temporally in parallel.
Display means 14 such as RT, and text/graphic information output means l2
The information processing apparatus is provided with an input means 15 for inputting an answer to the question displayed on the display means 14, and an answer processing means 16 for processing the answer inputted by the input means 15.

Then, the operator's response to the video information and character/graphic information (hereinafter simply referred to as character information) displayed on the display means 14 such as a CRT is inputted from the input means 15, and this is processed by the response processing means 16. This enables interaction with information including video information. Here, information including video information means that other information such as audio and text is used in conjunction with the video information as necessary.

In the invention as claimed in claim 3, as also shown in principle in FIG. A command sent from the character/graphic information output means 12 is sent to the video information output means 1l to a signal processing means 17 such as an information synchronization means 13 arranged between the character/graphic information output means 12 to be outputted. The video information output device is provided with a command selection and output stage that analyzes whether the command is required or a command that is necessary within its own device and transmits the necessary command to the video information output hand.

Further, it is omitted to provide interfaces dedicated to the video information output means 11 and character/graphic information output means 12 in the signal processing means 17, thereby simplifying the system.

"Example" Hereinafter, the present invention will be explained in detail with reference to Examples.

(Overall System Structure) FIG. 2 shows a communication system using an information processing device according to an embodiment of the present invention.

In this communication system, a plurality of information processing devices (workstations > 22-1
~22-N, a file service 23, a mail service 24, a print service 25, and a communication service 26 are connected, respectively.

In the case of this embodiment, the information processing devices 22-1 to 22-N each include a control unit main body 27, a display 28, a keyboard 29, and a mouse 3 as a pointing device.
It is structured from the beginning.

A videotape recording/playback device 32 is incorporated in the control unit main body 27 . This video tape recording and playback device 32
The video to be played back is displayed in a predetermined area of the display 28. Furthermore, the audio reproduced by the videotape green image reproducing device 32 can be heard by inserting headphones (not shown) into a headphone jack (not shown) in the control section main body 27.

The file service 23 is the information processing device 22-1 to 22-
This is for receiving a storage request for documents and video information from N and storing these files, and for receiving a search request and sending the file. That is, unlike a normal local area network, this file service 23 can also handle video information files. Files containing documents and normal image information are stored on a magnetic drum or hard disk within the file service 23, while files containing video information are stored on the video tape recording/playback device 32. Instead of the videotape recording/playback device 32, it is also possible to use other storage media, such as a read/write optical disc.

The mail service 24 is for managing electronic mail. This mail service 24 is also used as a storage medium for storing ordinary files such as documents, as well as a video tape recording and reproducing device 3 for storing video information files.
2.

The print service 25 is for printing out a document and, if necessary, a designated image displayed on the display 28 of the information processing device 22 as a still image from a laser printer, for example.

Communication service 26 is for communicating with other local area networks through line 40. In FIG. 2, a communication service 26 is shown connected to a communication service 42 constituting another local area network 41. As shown in FIG.

E-mail can of course be sent and received between workstations within the same local area network, and can also be sent between two or more local area networks using communications service 26. E-mail is normally used only for transmitting text information, but in the communication system of this embodiment, the video tape recording and playback device 32 is used within the same local network.
It is now possible to transfer video information output from. Further, by using, for example, a broadband ISDN (Integrated Services Digital Network), each local area network can transmit documents and video information between its networks at high speed.

(Overview of Information Processing Apparatus) FIG. 3 shows an overview of the configuration of the information processing apparatus of this embodiment.

The information processing apparatus of this embodiment includes a main CPtJ (central processing unit) 51. As already described, the main CPU 51 is connected to the following units via a bus 52 such as a data path.

(a) Magnetic disk control device 53: This is a device for transmitting and receiving various data to and from the magnetic disk 54 stored in the control section main body 27. The magnetic disk 54 stores various programs for controlling this information processing device, as well as character information created and possessed by the own information processing device.

(Example) RAM 55: This is a random access memory that stores the programs stored on the magnetic disk 54 and is used as a primary storage area for various data.

(c) Audio person output control device 57: video tape recording and playback device 32 and audio person output device 5
8, and amplifies the audio signal output from the video tape recording/playback device 32 and outputs it to the headphone portion of the microphone-equipped headphone of the audio output device if5g.

Audio signals and alarm sounds created on the workstation side can also be output to the audio input/output device 58 via the audio input/output control device 57. The audio output control device 57 can also input the audio input from the microphone of the audio input/output device 58 and the audio signal output from the workstation to the video tape recording/playback device 32 and record it.

The voice output device 58 is equipped with a microphone in this way.
Although it is configured with a phone, it is also possible to use only headphones when audio input is not required. It is also possible to arrange speakers in preparation for emergency broadcasts or local broadcasts in the event of a disaster. The voice input from the microphone of the voice output device 58 is converted into a digital signal by the voice input/output control device 57, and then can be transferred to the other t+V information processing device 22.

(2) Keyboard 29: This is an input device used when inputting various data from this information processing device. A mouse 31 as a keyboard device is connected to the keyboard 29.

(E) Display control device 59 This is a control device for outputting both video information and text information to the display 28. The video signal of the video information output from the video tape recording/playback device 32 is supplied to the display control device 59, where it is combined with text information and output to the display 28. This will be explained in FIG. 4 below.

(f) Image memory 61: This is a memory that stores character information to be displayed on the display 28. When video information is to be transferred to the print service 25, the video can also be stored in the image memory 61.

(g) DMAC6 2 : A circuit that controls the transfer of information stored in the image memory 61.

(Specific configuration of display control device) FIG. 4 specifically shows the display control device.

The display control device 59 inputs an analog level video signal sent from the video tape recording/playback device 32 shown in FIG. supply

The NTSC decoder 73 decomposes the video signal into three color video signals of R, G, and B for the NTSC color television signal. A synchronizing signal 74 is simultaneously taken out from the NTSC decoder 73 and sent to the timing generator 75.
supplied to The timing generator 75 outputs a clock signal 76 based on this synchronization signal 74, and supplies this to an A/D converter 77 and an RGB frame memory circuit 78.

The A/D converter 77 receives the three R, G, and B signals after the decomposition described above.
Color video signals are supplied, and these are each 8
It is converted into a bit digital video signal. These 3
The color digital video signals are supplied to an RGB frame memory circuit 78 and written in response to a write signal 79 supplied from a timing generator 75. The reason why these digital video signals are written into the RGB frame memory circuit 78 is to read out the NTSC video signals in synchronization with the clock of the display control device 59 since the NTSC video signals are inputted asynchronously with the clock of the display control device 59.

The RGB frame memory circuit 78 includes a frame memory for one screen prepared for each of R, G, and 83 colors, and a buffer memory that temporarily stores video signals written to and read from the frame memory while maintaining synchronization. It is constructed as a circuit that includes the following. For this purpose, the clock signal 76 and the clock signal 8l prepared on the main CPU 51 side are used.

In order to create this clock signal 81, the display control device 5
A synchronization signal prepared on the main CPU 5 1 side is input to the synchronization signal input terminal 95 of 9, and a synchronization signal 97 that has passed through a buffer amplifier 96 is supplied to the timing generator 75. There is. and,
A clock signal 8 created based on this synchronization signal 97
1 is supplied to the RGB frame memory circuit 78, and the video signal is read out.

The three-color video signals output from the RGB frame memory circuit 78 are supplied to a D/A converter 104, which receives a control signal 10 supplied from a timing generator 75.
5 is converted into an analog signal again. The video signals of R, G, and 83 colors thus obtained are supplied from the output terminals 106 to 108 to the R, G, and B terminals (not shown) of the display 28 shown in FIG. become. A synchronizing signal 97 is supplied to the other output terminal 109, and is used as a synchronizing signal when controlling the display on the display 28.

Note that the RGB frame memory circuit lot is connected to a control signal line 83 used when transferring video data to the image memory 61 and a data bus 84.

FIG. 5 shows an area where the video signal obtained from the video tape recording/playback device is displayed on the display. A video window 112 for displaying video signals is arranged on a display screen 111 of the display. Display screen 1
11, 782 scanning lines are displayed. The size of the video window 112 in the vertical direction (sub-scanning direction) corresponds to 480 scanning lines on the display screen 111. Therefore, the video signal obtained from the video tape recording/playback device is displayed within the video window 112 occupying a portion of the display screen 111 without converting the number of scanning lines. The position of the video window 112 for this video signal is R as shown in FIG.
A desired position can be set by adjusting the timing of reading the video signal from the GB frame memory 88.

In the other area 113 of the display screen 111, character information consisting of characters, figures, and images (still images) originally created or handled by the workstation that is the basis of the information processing device 22 is displayed. This will be explained by returning to FIG.

A video signal representing character information is supplied to the character information input terminal 121 in FIG. The video signal 123 after being amplified by the amplifier 122 is directly sent to the D/A converter 104.
Here, the signal is digitally added to the three-color video signal output from the RGB frame memory circuit 78, and then converted into an analog signal. The video signal 123 is also supplied to a shadow adding circuit 124, where a video signal 125 with added shadows is created.

This video signal 125 is also supplied to the A/D converter 104 and converted into an analog signal. The D/Δ converter 104 supplies the conversion results of these signals to the display 28 as video signals of R, G, and 83 colors. Here, the video signal with added shadows is a signal for expressing outlines of different brightness or different colors in order to distinguish characters, etc. of the same color as the background part from the background part.

The video signal representing the text information supplied to the text information input terminal 121 is not subjected to any particular signal processing other than the addition of shadows by the display control device ff59. Therefore, the character information can be displayed on the entire display screen 111 shown in FIG. 5. The reason why the text information is displayed in the area 113 outside the video window 112 is based on the assumption that the information is processed in advance so that the text information exists only in the area 113 and output to the display 28. It is. If you want to point to a certain part of the video in the video window 112 with a cursor or add text to the video, you can display the cursor, characters, etc. as text information without avoiding the video window 112. .

By the way, the display control device 59 in FIG.
1 (FIG. 3) is equipped with its own CPU 131. The CPU131 connects to the ROM131 via the bus 132.
, RAM 134, r/O boat 135, and first and second SCCs (serial communication controllers) 136 and 137. The ■/○ boat 135 is also connected to the control signal line 83 described above. The first SCC 136 has a command input terminal 1
38, commands created on the original workstation side are input. The CPU 131 interprets the meaning of this command, converts the result into a signal form that can be recognized by the videotape recording/playback device 32, and sends it to the output terminal 139 from the second SCC I37. The signal output from this output terminal 139 is
The data is sent to the video tape recording/playback device 32, where various operations such as image playback and temporary stop of image feed are performed.

The CPU 131 also controls the period during which the video signal supplied from the video tape recording/playback device 32 is output to the display screen 111. This control is performed through the I/O boat 135, and from the time when the open/close control signal 141 to the timing generator 75 indicates "open", the video sent from the video window 112 and the video tape recording/playback device 32 is displayed. These displays are designed to disappear instantly when "closed" is indicated.

When the opening/closing control signal 141 is “closed”, the display screen 11
1, only the character information created on the original workstation side will be displayed.

The response sent from the video tape recording/playback device 32 is sent back to the workstation as is.

FIG. 6 shows a conventional general circuit connection method in such a case.

In FIG. 6, the first device 151 and the second device 152 are both existing devices, and the third device 153 is a device newly added between them. To exemplify this embodiment, the first device 151 corresponds to a workstation that is the basis of the information processing device 22. Second device 15
2 corresponds to the video tape recording/playback device 32. Both of these have conventionally existed. The third device corresponds to a display control device 59 newly provided to configure the information processing device of this embodiment.

When placing the new device 153 between the existing devices 151 and 152 in this way, communication between the first device 151 and the third device 153 and communication between the second device 152 and the third device 153 are required. Communication between the parties must be ensured. Therefore, in the conventional system shown in FIG.
53, controllers 154 and 155 for two channels were arranged. A controller 156 provided in the first device 151 and one controller 1 of the third device
54, and between the controller 157 provided in the second device 152 and the other controller 155 of the third device. Note that these controllers 154 to 15
is a controller that complies with the RS232C standard defined by EIA (Electronic Industries Institute of America).

In the information processing device of this embodiment, a controller for only one channel is provided in the third device to reduce the cost required for the system.

FIG. 7 shows the connection principle in the communication system that can be adopted in this embodiment, in which communication is performed by a drop-in connection. In this figure, the first device 161 to the third device 1
63 correspond to the first device 151 to the third device 153 in FIG. 6, respectively. If either or both of the first device 161 and the second device 162 uses a connection method that does not allow handshaking, it is necessary to perform a trickle connection as in this example.

Also in the communication system shown in FIG. 7, commands sent from the first device 161 are supplied to the third device 163. The third device 163 analyzes this command and
The commands that are necessary for the device 162 and those that are not are selected. Then, only commands necessary for the second device 162 are sent to this device 162. In this communication system,
The third device 163 does not participate in any response from the second device 162. In other words, the command sent from the second device 162 passes through the third device 163 and is sent to the first device.
The data will be sent to the device 161.

FIG. 8 shows a specific example of this drip connection. The handshake method consists of: ■ The first step is to turn on “RST” on the sending side and notify “CTS” on the receiving side;
■Turn on “DTR” on the receiving side and “DSR” on the sending side
There is a second stage in which the sending side sends "TXD" and the third stage receives it on the receiving side's "RXD". It is in a state.

On the other hand, FIG. 9 shows the connection state when performing communication among the communication systems that can be employed in this embodiment. In this case, the third device 163
Regarding the data sent from the second device 161, data is transferred by hand-taking between the devices 161 and 162 on both sides, but the data sent from the second device 162 is not involved. That is, regarding the latter data, the first device 161 and the second device 162 directly perform handshake.

In the information processing device of this embodiment shown in FIG. 4, etc., the connection structure is such that the video information output means such as the video tape recording/playback device 32 used as the second device 162 cannot be shaken. In this case, the connection shown in FIG. 8 is made, and when the connection state is such that node shake is possible, the connection shown in FIG. 9 is made. As a result, only one channel of the RS232C controller is required, and accordingly, the number of driver circuits and receiver circuits can be halved.

(Education using an information processing device) FIG. 10 shows an overview of operations when this information processing device is used for education. When the power is turned on and an operator such as a student sets this device to the learning mode for learning (step ■; Y), the display 28 shown in FIG. will be displayed separately (step ■).

FIG. 11 shows the contents displayed on the display at this selection stage. On the display 28, in this example, the display screen 111 shows "rXX Beginner Course" and "XX
Three icons (pictograms) 171 to 173 and cursor 17 displaying ``Intermediate Course'' and ``rXX Advanced Course.''
4 is displayed. The position of the cursor 174 can be moved using the mouse 31. When the operator specifies any of these icons 171 to 173 with the cursor 174 and clicks a button (not shown) on the mouse 31, a desired course is selected (step 2; Y). In this state, the main CPU 51 displays the name of the selected course on the display 28, and also displays an instruction to input the employee number and name of the operator, that is, the student (step 2).

FIG. 12 shows an example of what is displayed on the display when the creator selects the course by pointing to the icon labeled "XX Beginner Course" and then inputs the employee number and name. At a display position 181 on the upper left side of the display screen 12, the selected course name is displayed. Further, a frame 182 is arranged in the center of the display screen 111, and a text instructing the input of the employee number and name and the employee number and name of the student are displayed in this frame. Students will input these data using a simulated keyboard 29 (Figure 3).

When the above input is completed, the student moves the cursor 174 to the “start” display area 183 within the frame 182 and clicks the mouse 3
By clicking the button 1, the education, which will be explained in detail later, is executed and the resulting answer is determined (step ■).

On the other hand, if the student places the cursor 174 on the "Cancel" display area 184 and clicks the button of the mouse 31 after or before inputting the employee number and name (step ■; Y), this The series of operations in the attendance mode ends (end).

By the way, the execution of education and the resultant answer judgment operation are determined whether the processing for one unit is completed (step ■;
Y), the student cancels the course midway through using the mouse 31 (
(End)) (Step ■; This is carried out until Y). If the operation to cancel the course is performed, the series of operations in the course mode ends (End). When the process is completed (step ■; Y),
The main CPU 5 1 files the student's employee number, name, answer results, and learning history on the magnetic disk 54 (
step 0). Then, these data are transferred as learning data files to the mail service 24 (Figure 2), and sent through there to the workstations of the training center (step ■>). In addition to storing the learning data that comes, it analyzes this data and sends advice for subsequent training and learning via e-mail to each student's workstation (information processing device) as necessary.

FIG. 13 specifically shows the flow of the execution of the education and the resultant answer judgment operation in step (2) of FIG. 10. That is, when the student instructs "start" with the cursor 174 (FIG. 12), the video window 1 shown in FIG. 5 appears on the display 28.
12 is opened (Step ■ in Figure 13). Display screen 11
In the area outside this video window 112 in 1, precautions etc. when starting education are displayed (13th
Figure step ■).

FIG. 14 shows such display contents on the display screen. Video window 11 on display screen 111
For the outside part of 2, start the rXX beginner course as shown. ” and “Please put on your headphones.” and the text “Are you ready?” are displayed. Also, in the video window 112, “XX
The text "Beginner Course" will be displayed in large letters. The characters displayed in the video window 112 at this point are characters created by the workstation, and the video tape recording/playback device 32 (FIG. 3) has not yet been activated.

At this point, the workstation side is connected to the display control device 59.
Instruct the side to prepare so that it can start outputting "XX Beginner Course".

In conjunction with this, the videotape recording and reproducing device 32 starts the operation of finding the beginning of the "XX Beginner Course" (Step 2 in FIG. 13). Therefore, the main CPU 51 may cause the video window 112 to display a note such as "accessing the corresponding course" at this point.

The student completes preparations by putting on headphones as the voice output device 58 (FIG. 3), and the display screen 111 displays "Yes".
Place the cursor 174 on the display area 191 and press the mouse 31
Click the button (Figure 13 Step ■; Y)
, the main CPU 51 sends a video start command to the display control device 59. The display control device 59 sends this to the video tape recording and reproducing device 32 to start sending out the video signal of "rXX Beginner Course" (step
). If the video tape recording/playback device 32 is still being accessed at this point, the main CPU 51 will start sending out the video signal when cueing is completed.

When the student selects and clicks the "No" display area 192 instead of the "Yes" display area 191 with the cursor 174 (step ■; Y), a corresponding selection appears on the display screen 111. will be displayed (step ■).

FIG. 15 shows the display contents of the selected techniques.

In an area outside the video window 112 of the display screen 111, a question ``Do you want to change the course?'' is displayed, and the student is asked to select the desired one using the cursor 174. If the student selects the "Start" display area 201 (Step ■; Y in Figure 13), this means that the student selects the "No" display area 192 due to a mistake, so return to Step ■ and select the "×X Beginner Course" Perform the work to start sending out the video signal. “End” for this
When display area 202 is selected (step ■: Y)
, sends a video stop command to the display control device 59 to stop access to the video tape recording/playback device 32, and then ends the attendance mode (end). When the "course change" display area 203 is selected (step @; Y in FIG. 13), a video stop command is similarly sent to the display control device 59 to stop access to the videotape recording and playback device 32 (step (2) After this, the process returns to step (2) in FIG. 10 and the work begins with course selection.

On the other hand, when a video start command is sent to the display control device 59 in step (2) and the sending of the video signal of "XX Beginner Course" is started, the video of this course is displayed in the video window 112 of the display screen 111. Then, audio is sent to the student through the headphones and the education begins. Students will continue to complete <Step ■; N> until the end of the unit's education.
, the keyboard 29 (Fig. 3) and the mouse 31 can be used to give instructions such as audio and video paste play and Bose (stop) (step 0; Y).When operating the keyboard 29, each Key functions are assigned on a virtual keyboard or dedicated keys are placed on the board.When operating the mouse 31, the video tape recording and playback device 32 is pressed on the display screen 111 in advance. Display the menu and click on the desired location. When such an operation is performed, a corresponding command such as replay will be sent to the videotape recording/playback device 32 via the display control device 59 ( Step ■).

As a result of the student progressing through the course in this way, if one unit of education is completed (Step ■Y), the main C
The PU 51 sends a question submission command to the display control device 59 (step ①), stops the play of the video tape recording and reproducing device 32, and causes the “question” screen prepared for this unit to be searched. Information on where on the tape the "problem" screen is located is sent to the display control device 59 together with the question submission command. When the "problem" screen is retrieved, it is displayed on the display 28 and the student is tested (step @). Note that the problem may be output as a still image, or may be output as a moving image by running the video tape recording and reproducing device 32. Also,
The problem does not necessarily need to be prepared on the video tape recording/playback device 32 side, but it is also possible to prepare it on the workstation side and display it inside or outside the video window 112.

FIG. 16 shows an example of a problem output as a still image from a video tape recording/playback device. The video window 112 of the display screen 111 contains two figures (Figure A
, Figure B) are displayed, and the student must move the cursor 174 using the mouse 31 and click on the correct figure number.

When the student answers the question (Step @: Y)
, the main CPU 51 determines whether the answer is correct or not by referring to an answer table prepared in advance for the "XX beginner course" (step @). Then, it is determined whether retraining is to be performed, and if the answer is wrong and retraining is necessary, take the step [phase].
:Y), perform re-education (step ■>). Then, return to Stenb [phase] again and output the problem.

If retraining is not necessary, such as when a correct answer is given, a check is made to see if the final question has been output (step 0).

If the final problem has not been reached (N), the process returns to step [phase] and the next problem is output. When the answer to the final question is completed (Y), the work regarding the execution of the education and the judgment of the answer is completed (End).

FIG. 17 shows in detail the re-education work in the step of FIG. 13. When re-education is to be carried out, the main CPU 51 outputs a command to play the video and audio portions related to the part that the student made a mistake (step in FIG. 17). Address information indicating the location of the video tape recording/reproducing device 32 is added to this command. The student receives re-education by inputting images of the relevant part through the display screen 111 and headphones. At this time, the student must press the keyboard 29 until the reeducation program ends (step ■; N).
(FIG. 3) and by operating the mouse 31, instructions such as voice and video paste play, pause (stop), etc. can be given (step 2; Y).

When such an operation is performed, the main CPU 5l determines whether this is a keyword input (step 2). And if a keyword is entered (
Y>, the storage location of the explanation corresponding to the keyword, for example "LED" is searched (step 2). Then, based on the relationship with the current location, a command is sent to the display control device 59 to reach the location of the keyword and perform playback (Stenop (2)). For example, if the student wants to see the explanation of light emitting diodes again, the student enters the keyword "LED" or "light emitting diode," and the main CPU 51 sends a command to return the playback position to that location. Become.

If an instruction such as normal glue play or fast forwarding is given instead of inputting a keyword (step ■; N), the main CPU
51 sends a corresponding command to the display control device 59 to operate the video tape recording and reproducing device 32 (step 2).

FIG. 18 shows an example of the display state when the reeducation program is in progress.

A video window 112 on the display screen 111 displays videos for retraining so that the trainer can easily understand the relevant items.
It is explained. This explanatory video and audio are output from the video tape recording/playback device @32. Display screen 111
A window 211 for normal operation and an explanatory keyword input +l 212 are newly arranged. The student can perform operations such as stopping the image by moving the cursor 174 to a desired position on the normal operation window 211 and clicking. Keywords are input from the keyboard 29, but a list of searchable keywords may be displayed on the display screen in the order of keywords, for example, and the student can select one.

In this way, re-education progresses, and when the program is completed (Step ■: Y in Figure 17), the main CP
U51 outputs a command to submit a problem related to this re-education (step ■). Address information indicating the playback location of the videotape recording/playback device 32 is also added to this command. As a result, the process proceeds to step [phase] in FIG. 13, where the question is submitted.

<Management of students at the education center> FIG. 19 shows the flow of student management at the education center that provides education as described above. The education center sets a period for each course and accepts student applications via e-mail, and registers the applications received (see Figure 19). After the application period has passed (stenop ■N), the text will be delivered by e-mail to each student's information processing device (workstation) (sdep ■). At the same time, or during times when communications are not busy, such as at night, educational software such as a videotape is transmitted to the videotape recording and reproducing device 32 of each person's information processing device,
Recording step ■). However, if necessary, videotapes and the like may be sent as they are via in-house email, or images may be sent directly from the education center during education. In the latter case, sufficient communication capacity is required.

Once you have the text and educational software as described above,
Students can take the course at any time that is convenient for them. When the student completes the education, the learning data is sent to the education center as explained in Figure 0 (Step 2: Y).On the other hand, if the learning data is not sent within the specified period. If not, <Step ■; N>
, the education center sends an electronic mail reminder to the students to remind them to take the course (step ■). This reminder can also be sent to the student's supervisor if necessary.

After sending the reminder e-mail, reset the specified period for the course (step ■). In principle, this reset period is set by the education center, but it can also be specified by the student or his/her supervisor if the student has urgent business or is ill. The education center will check once again to see if the learning data will be returned within the reset period (step ■・■) 0 In addition, the student will, for example, go on an overseas business trip to a branch office or affiliated company. Even in such cases, you can receive education at a local workstation by bringing educational software such as a videotape, and the resulting learning data can be sent to line 4 in Figure 2.
0 to the first communication cable 2l, and can be delivered to the education center.

When the learning data is sent to the education center (Step ■; Y) in FIG. 19, the education center stores it for use in various materials (Step ■).

Next, a completion certificate for the student is electronically created and sent by email to the student's information processing device (step [phase]). If the person in question wishes to send the information to another workstation, such as while on a business trip overseas, it is also possible to send the information to that location.

"Effects of the Invention" As described above, according to the invention described in claim 1, since the video information and the character/graphic information are displayed in synchronization, effective education etc. can be achieved by combining the characteristics of each information. It can be realized.

Further, in the invention as claimed in claim 2, since the answer to the displayed question is input and processed,
It is possible to effectively discover parts that the students do not understand, and provide education according to the level of the students.

Furthermore, in the invention as claimed in claim 3, the interface can be simplified even when a new device is connected between existing devices, and an inexpensive and flexible system with excellent device compatibility can be created. be able to.

[Brief explanation of the drawing]

Figure 1 is a block diagram showing the principle of the present invention, Figures 2 to 1
Figure 9 is for explaining one embodiment of the present invention, of which Figure 2 is a system configuration diagram showing an overview of a communication system using an information processing device, and Figure 3 is a system configuration diagram showing the outline of a communication system using an information processing device. FIG. 4 is a block diagram showing an overview, FIG. 4 is a block diagram showing the specific structure of the display control device, and FIG. 5 shows the area where the video signal obtained from the video tape recording/playback device is displayed on the display. An explanatory diagram, FIG. 6 is a block diagram showing a general configuration for connecting a new device between two existing devices, and FIG. FIG. 8 is an explanatory diagram showing the connection principle when this connection is performed. FIG. 8 is a connection configuration diagram showing a specific example of this flow-through connection. FIG. 9 is a connection when handshake is performed in the communication system that can be adopted in this embodiment. Figure 10 is a flowchart showing the outline of a mock-up when the information processing device is used for teaching, and Figure 11 shows the educational software that can be taken by course. 12 is a plan view showing the display screen of
Figure 13 is a plan view showing an example of the display screen when the employee number and name are entered after selecting the course by pointing to the icon labeled xx Beginner course j. A flowchart showing the flow of execution and judgment of the answer as a result. Figure 14 is a plan view showing the state of the display screen in the preparation state for starting education. Figure 15 is a flowchart showing the state of the display screen in the preparation state for starting education. FIG. 16 is a plan view showing the display contents of the display screen when a selection is made, FIG. Figure 18 is a plan view showing an example of what is displayed on the display screen while the re-education program is in progress; Figure 19 is a flowchart showing the details of the re-education work in each step; It is a flowchart showing the flow of student management. 11...Video information output means, 12...Character/graphic information output means, 13...
... Information synchronization means, l4 ... Display means, 15
...Input means, l6 ...Response processing means, 17 ... Signal processing means, 22 ... Information processing device, 26 ... Communication Service, 28...
...Display, 29...Keyboard,
31...Mouse, 32...Video tape recording/playback device, 51...Main CPU, 53...Magnetic disk control device, 55, 134
...RAM, 57...Audio human output control device, 58...
・Audio input/output device, 78...RGB frame memory circuit, 111・
...Display screen, 112...Video window, 131...
...CPU, 133...ROM, 136...
・First SCC, 137...Second SCC, 161...First device, 162...Second device, 163......Second SCC 3 device, 174...
····cursor. Applicant: Fuji Xerox Co., Ltd. Figure 1 Agent

Claims (1)

[Scope of Claims] 1. Video information output means for outputting video information, character/graphic information output means for outputting character/graphic information created by a computer as information related to this video information, and these video information. 1. An information processing device comprising: information synchronization means for temporally synchronizing text and graphic information; and display means for inputting the video information and text and graphic information and displaying them temporally in parallel. 2. A video information output means for outputting video information; a character/graphic information output means for outputting character/graphic information created by a computer as information related to this video information; information synchronization means for temporally synchronizing; display means for inputting and displaying the video information and text/graphic information in parallel in time; and answers to questions displayed on the display means by text/graphic information output means. What is claimed is: 1. An information processing device comprising: input means for inputting the following information; and answer processing means for processing answers input by the input means. 3. A video information output means for outputting video information, a character/graphic information output means for outputting character/graphic information created by a computer as information related to the video information, and a character/graphic information output means disposed between these means.・Command selection for analyzing whether the command sent from the graphic information output means is a command to be sent to the video information output means or a command necessary within the own device and sending the necessary command to the video information output means. 1. An information processing device comprising: a signal processing means having a sending means.