JP2003087725A - Information generating method, information generating apparatus, and network information processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate confirmation of contents of particular still picture information by displaying the information with magnification. SOLUTION: The information generating method of this invention includes the steps of; selecting a display pattern of a reproduced image depending on the number of display devices in the case of applying edit to still picture information recorded and reproducing the recorded still picture information displayed on a plurality of the display devices synchronously with moving picture/audio information from a moving picture/audio input device so as to reproduce and display a plurality of the still picture information items on the same screen at the same time, and reproducing the still picture information displayed in a display pattern with magnification by instructing an icon displayed in the display pattern. Since a user can grasp when, from which display device and by what file name the still picture information is displayed in time series according to a reproduction management list, all of the still picture information is fitted without missing to split display screens and can be displayed. Since the still picture information displayed on the display screen can be displayed with magnification by having only to point out one of the still picture information displayed on the display screen, the contents can easily be viewed and the visibility can be enhanced.

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a method for creating information,
The present invention relates to an information creating device and a network information processing system. Specifically, when multiple display devices are used for video / audio information from the video / audio input device,
In the case where multiple pieces of still image information are provided from multiple display devices by recording multiple pieces of still image information displayed in each of them in synchronization with video / audio information, and by generating playback content from them. Even if there is, still image information can be displayed at the same time, and the still image information that is currently being played back in synchronization with the video / audio information can be enlarged to make it easier to see the content of the still image information. It was made possible.

When the network information processing system according to the present invention is applied to an electronic conferencing system or the like, a plurality of video projectors are used even when a presentation material is used to display presentation materials and a conference is in progress. It makes it possible to record multiple presentation materials displayed in, and when playing back the content, these presentation materials can be displayed on the same screen in synchronization with the progress of the conference. The presentation material being displayed is enlarged to make it easier to see.

[0003]

2. Description of the Related Art As an information processing system performed via a network, a network electronic conference system (network conference system), a network education system, a network game system, etc. can be considered.

Among these, for example, in the network conference system, the pattern of the conference is captured by a video camera, and the materials used for the presentation are provided to the conference participants by using a video projector or the like.

In the case of recording each of these pieces of information and later creating the minutes (meeting contents) of the meeting, the moving image / audio information of the image of the ordinary meeting and the still image used in the meeting are recorded. It is usually stored separately from the information (presentation materials used for the presentation). This is because the conference organizer often manages the video / audio information that records the pattern of the conference, and the presentation material is often managed by the person who gave the presentation (presenter). And
At a later date, a conference participant, who is instructed by the conference organizer, creates the minutes of the conference as electronic data (conference content) using the information stored separately.

[0006]

As described above, it is troublesome to create the conference contents by using the moving image / audio information and the presentation material which are separately managed. In addition to this, the following problems are derived.

When a conference is held, the number of video projectors used is not limited to one. In many cases, several video projectors are used, and different presentation materials are displayed and explanations are given to each of them to proceed with the conference.

When there is only one video projector, the insertion timing of the presentation material is examined while reproducing the moving image / sound information recorded on the day, and if the timing is appropriate, the presentation material is inserted into the moving image / sound information. By repeating the process, the minutes of the meeting can be electronically created.

However, when a conference is in progress while displaying presentation materials on each of a plurality of video projectors, which presentation material is used in which scene is used for the presentation? I'm not sure.

Further, even if the timing of using the presentation material is known, it is often impossible to accurately determine at what timing the presentation material should be combined with the moving image / audio information, and in that case, immediately before that. This new presentation material is inserted in place of the presentation material that was being used, and the previous presentation material disappears. However, in actual meetings, there are many cases where the meeting is in progress using both materials. Therefore, the same state as the actual conference cannot be reproduced in the conference content that is the minutes.

This conference system is not limited to the case where a conference room is held only in one conference room, but a plurality of conference rooms are electronically connected via a network to advance a conference, or a conference room at a remote place (for example, a head office). , Multiple locations such as branch offices, factories, and research laboratories) also cause similar problems.

Such a problem is not limited to a network conference system, but also a network education system for conducting classes and lectures between prep schools, sister schools, etc. using a network, and between multiple people staying in remote areas. It also occurs in network game systems where you can enjoy games with.

Therefore, the present invention solves such a conventional problem, and in particular, even when a plurality of display devices are used, still image information displayed on them is recorded and reproduced without omission. In this case, all still image information can be displayed on the same screen, and the still image information currently in use can be enlarged and displayed. A creation device and a network information processing system are proposed.

[0014]

In order to solve the above-mentioned problems, in the information creating method according to the present invention as set forth in claim 1, a plurality of information are synchronized with the moving image / sound information from the moving image / sound input device. The number of display devices is set so that the still image information displayed on the display device is recorded and the plurality of still image information items can be reproduced and displayed on the same screen at the same time when editing for reproducing the recorded information. According to the step of selecting a display pattern on the reproduction screen, and by instructing the icon displayed in the display pattern to enlarge and reproduce the still image information displayed in the display pattern. It is characterized by

According to the seventh aspect of the present invention, there is provided an information recording device for recording moving image / sound information from a moving image / sound input device and still image information from a plurality of display devices, and an input device. A reproduction management list creating means for creating a list of attribute information about a plurality of still image information,
A knitting unit that reorganizes the moving image / audio information and the still image information while selecting a display pattern capable of simultaneously displaying the plurality of still image information on the display screen based on the attribute information from the reproduction management list creating unit. , And a control means for controlling these plurality of means.

Further, in the network information processing system according to the present invention as set forth in claim 13, one or more information processing devices having an input operation function and processing arbitrary information, and at least the information processing device transferred from the information processing device. A display device for displaying a video based on information, and an information processing support device for supporting network information processing including the display device based on an input operation instruction from the information processing device,
Communication means for connecting the information processing support device and the information processing device, a video / audio input device for inputting video and audio other than information transferred from the information processing device, the information processing device, and the video / audio input device. An information creating device that records information transferred from a voice input device according to an instruction from the information processing device and reorganizes the information as content that can be communicated via a network. Information recording means for recording moving image / audio information from the audio input device and still image information from a plurality of display devices, and reproduction management list creating means for listing attribute information about a plurality of input still image information And a display pattern capable of simultaneously displaying the plurality of still image information on the display screen based on the attribute information from the reproduction management list creating means. While selecting the over emissions, the moving image,
It is characterized in that it is constituted by an organization means for reorganizing the audio information and the still image information, and a control means for controlling the plurality of means.

In the present invention, both moving image / audio information and still image information are recorded. When the still image information is displayed on a plurality of display devices, it is the information displayed on all the display devices. At the same time as recording this information,
Create a reproduction management list of still image information for audio information.

The reproduction management list includes file names of still image information, time management information such as display start time on the display device, display device identification information, and the like. It is possible to grasp in chronological order whether or not the names are displayed.

At the end of recording, these pieces of information are reorganized into contents (HTML format) which can be reproduced via the network. Further, a display pattern (screen division pattern) to be displayed on one screen is determined according to the number of display devices used.

In the reproduction mode, all the still picture information is displayed by being inserted into the divided screen corresponding to the display pattern determined based on the reproduction management list. Video / audio information is displayed in a fixed display area other than this.
By doing so, there is no problem that only specific still image information is reproduced.

In the case of a network conference, since the presentation materials used in all video projectors can be divided and displayed on the same screen at the same time, the conference contents can be created and displayed without missing the presentation materials.

When an instruction to enlarge the currently displayed still image information is given, the still image information is enlarged and displayed. For example, a display pattern (maximum display pattern) displayed when only one display device is used is selected and enlarged. By doing so, the content of the still image information becomes easier to see and the visibility is improved.
When the still image information is switched to new one and displayed, the updated new still image information is also enlarged and displayed.

[0023]

BEST MODE FOR CARRYING OUT THE INVENTION Next, an embodiment of an information creating method, an information creating apparatus and a network information processing system according to the present invention will be described in detail with reference to the drawings. For convenience of description, a case where the present invention is applied to a network conference system will be described below as an embodiment.

The network electronic conferencing system is a system in which electronically created presentation materials are transferred to a projector or the like as a display device, and a conference is advanced while the materials are enlarged and displayed. Therefore, a computer (personal computer) as an information processing device for managing presentation materials is provided, and
The entire system is constructed by including an information processing support device (personal computer configuration) used for transferring presentation materials to a display device.

FIG. 1 shows an example of the configuration of the main part of this network electronic conference system 100. This system 100
An information processing device (hereinafter referred to as a client PC) 2 that stores and manages presentation materials (file data) as described above, a projector for projectively displaying presentation materials and presentation materials imported from a document camera In addition to having a display device (hereinafter referred to as a projector) 4 that uses a personal computer, an information processing support device (hereinafter referred to as a communicator (Comm
3).

The communicator 3 is controlled by the client PC 2, and the display image of the video projector 4 is controlled via the communicator 3. Therefore, there is RG between the communicator 2 and the projector 4.
It is connected with a B cable or the like.

The client PC 2 and the communicator 3 are connected by a communication means (network adapter) 2a. The communication means 2a may be wireless or wired, but in this embodiment, wireless is used as the communication means.

Therefore, both the client PC 2 and the communicator 3 are equipped with a wireless LAN card (network interface card) 2a as a communication means for connecting them. Of course, even in the case of wireless communication, an access point (not shown) may be used in addition to the use of a wireless LAN card, and communication may be performed via the access point.

This network electronic conference system 100
In addition, the information of the meeting room is recorded as video and audio, and the presentation materials used in the meeting are recorded to create the minutes of the meeting (meeting content) (hereinafter referred to as creator). )
1 are connected by a LAN. A video camera 5a as a moving image input device and a microphone 5b as an audio input device are connected to the creator 1. This video / audio input device 5 is directly connected to the creator 1 in this example,
The operation mode can be controlled according to an instruction from the client PC 2.

In order to enable the communicator 3 and the creator 1 to carry out a conference between the conference rooms installed between remote places through the communication between them and the network such as the Internet, the creator 1 in this example.
And the communicator 3 each have a global IP address of the same segment. Mutual communication does not hinder even global IP addresses in different segments.

A server 6 as an information storage device is further connected to the electronic conference system via a LAN so that the server 6 can collectively store and manage conference contents and the like.

The client PC 2 has electronic conference application software installed. Up to 16 devices can be used in one conference system. When using a plurality of client PCs, a unique private IP address is set for each.

When a plurality of client PCs 2 are used, a closed environment is created in the conference room, and there is secrecy so that an unspecified third party cannot participate in the conference or view the conference contents from the outside. To build a conference system,
A common password is set.

This password can be freely set by the first conference participant, and the remaining conference participants can participate in this conference system by inputting the password.

One of the conference participants transfers the presentation material from the client PC 2 to the communicator 3 via the wireless LAN card 2a and displays it on the projector 4 to acquire the right to give a presentation. Since the right to give a presentation can be abandoned and the right to give a presentation to another conference participant can be delegated simply by operating the function keys of the client PC, all the conference participants hold their qualifications as presenters. .

One of the remaining participants of the conference can control the operation mode such as recording and reproduction for the creator 1 by using the client PC 2. In other words, one of the rest gets the right to make material for meeting minutes.

Next, the network electronic conference system 10
Each component of 0 will be described.

The simplest basic configuration is that one projector 4 is installed in one conference room, and thus one communicator 3 constitutes an electronic conference system. However, in some cases, it may be possible to operate the conference more efficiently by advancing the conference using a plurality of projectors 4. This is because there are many cases in which different presentation materials are simultaneously displayed on a plurality of projectors and explanations are given while using them.

In such a case, the communicator 3 is basically arranged according to the number of projectors 4 installed. FIG. 1 shows an example of the configuration when three projectors 4 are used. When using a plurality of communicators 3, one of them is used as a main communicator (Main Communicator) 3a, and the other two are used as sub communicators (Sub Communicator) 3b and 3c. .

In this case, the presentation materials sent from the client PC 2 are managed by the main communicator 3a, and each sub-communicator 3a manages them.
The control system is such that the corresponding projectors 4b and 4c display via b and 3c. Therefore, the sub communicators 3b and 3c have private IP addresses. It is also possible to control the plurality of communicators 3a, 3b, 3c independently of each other.

The main communicator 3a also uses the presentation material itself transferred from the client PC 2 and attribute information (page switching time, page information, etc.) when the page of the presentation material is switched as reproduction management information. It has a function of sending it to the creator PC 1 via the, and receiving the information recorded in the creator PC 1 according to the instruction from the client PC 2 and distributing it to the client PC 2.

FIG. 2 shows the structure of the communicator 3. As shown in FIG. 2, the communicator 3 includes a network adapter 30a for transmitting and receiving presentation materials from the client PC 2, a storage device 30b storing a processing program, and a working memory (Work RAM) 30c. , A CPU 30d, and a display adapter 30e for outputting presentation materials as RGB signals.

As the network adapter 30a, the above-mentioned wireless LAN card 2a is used in this example. The storage device 30b stores basic software (electronic conference application software) for operating the communicator 3 and a processing program for processing presentation materials.

The work RAM 30c is used to temporarily store the received presentation material and to process the material. The presentation material is converted into R, G, B signals under the intervention of the CPU 30d and then supplied to the display adapter 30e. The projector 4 is connected to the communicator 3 with an RGB cable.

FIG. 3 shows the configuration of the creator 1.
This creator 1 is a CPU 1a that processes a program.
And a work memory (hard disk H in this example) for processing transmitted / received information (information such as moving images and still images).
DD) 1b, a storage device 1c for recording information such as presentation materials as well as video / audio, and a control program for processing them, and a communicator 3
And a network adapter 1d for connecting to. The creator 1 is further provided with a video / audio input terminal (I / O interface) 1e for receiving and controlling the video and audio information from the video / audio input device 5.

The creator 1 records information about the presentation material displayed on the communicator 3 as described above, and also communicates information about attendees who attended the electronic conference (information such as IP address and face photo). The information transferred from the computer 3, and further the moving image / audio information and the like are recorded. Then, it has a function of automatically generating the conference contents which can be called the minutes of the conference when the recording is completed. The process of automatically creating conference content will be described later.

Creator 1 and video / audio input device 5
Control over multiple clients P as described above.
If C exists, one of the client PCs 2
Controlled by. That is, the client PC of the secretary
It is managed by the (recorder client PC) 2.

In order to become a client PC serving as a secretary, a control screen used as an operation screen for the creator 1 may be opened. If there is a client PC having the control screen open, the prohibition flag is set in the communicator 3 so that the remaining client PCs cannot be the recorder client PCs. FIG. 4 is a diagram showing an example of a GUI screen displayed on the display screen of the recorder client PC.

This display screen is composed of roughly three vertically divided display screens, and the client P is provided at the center thereof.
A basic screen on the C side is displayed, a participant screen displaying information about the participants participating in the conference is displayed on the right side thereof, and a control screen for controlling the creator 1 is displayed on the left side of the basic screen. . A horizontally long memo screen is displayed at the bottom of the screen.

On the upper side of the basic screen, icons of devices connected to the electronic conference system are displayed. In the figure, the icon of the creator 1 and the icon of the communicator 3 are displayed. Although not shown in the drawing, an icon for the moving image / audio input device 5 is also displayed.

The lower side of the basic screen is used as a file list field, and the file names stored in the client PC are displayed here.

On the participant screen, a face picture of the participant, the private IP address of the client PC owned by the participant, etc. are displayed.

The uppermost part of the control screen is a video display part, and the video imaged by the video camera 5a is displayed here as a moving image. The central part is a band-shaped display area, and is a plurality of soft key operation parts including function keys, and the bottom part thereof is an input part for titles and the like. REC key, STOP
In addition to the keys and PAUSE key, to save the MARK key to mark important video points during recording, the MEMO key to open the memo screen, and the still image information (presentation material) displayed on the projector 4. of
The CAPTURE key etc. are displayed.

Client PC 2 to Communicator 3
When you log on to, only the basic screen is displayed on the display screen. By dragging and dropping the file in the file list to the icon of the communicator 3, the file data (presentation material) can be transferred to the communicator 3 and displayed on the projector 4 for presentation. However, this is the case where the operation is performed on the client PC 2 side that has obtained the presenter qualification.

When the Attendee key on the basic screen is pressed, the participant screen is displayed on the right side as shown in FIG.

When the creator icon is right-clicked, a menu screen as shown in FIG. 5 is displayed.
When "Control" is selected from the menu screen, the control screen shown in FIG. 4 is displayed. When the MEMO key is operated from the control screen, a memo screen is displayed at the screen position shown in Fig. 4, and sentences etc. can be input here. The memo screen has a space of 4 to 6 lines.

When "Content Manager" is selected from the menu screen shown in FIG. 5, a list menu for conference contents (creator.
The content manager screen) is displayed.

FIG. 6 shows a display example of the creator content manager screen. On this screen, a content list stored in the creator 1 is displayed, and soft keys for selecting an operation mode for the selected content list are displayed. In the embodiment, the Review key for reproducing the selected content, the client transfer key (Download to My Computer key) for transferring the selected content to the client PC 2, and the server transfer key (Upload for transferring the selected content to the server. to Server key), a detailed key (Show Contents Inform) to see detailed information of the selected content.
ation key), Delete key for deleting the selected content, etc. are displayed.

Network electronic conference system 1 described above
00, in particular, the system mode shown in FIG. 1 is an electronic conference system when a network is constructed only in one conference room, but a network electronic conference system can also be constructed in other cases.

The network electronic conferencing system 200 shown in FIG. 7 is a system applied when a conference is advanced while making a presentation using a plurality of, for example, two conference rooms.

In this case, the system constructions of the conference rooms A and B are often the same, but they may not be the same. FIG. 7 shows the embodiment. The system in the conference room A includes a creator 1, a client PC 2, a communicator 3, a projector 4 connected to the communicator 3, and a video / audio input device 5. 3 projectors
It is a stand. Therefore, three communicators 3 are also installed. The wireless LAN card 2a is used as the communication means.

The system of the conference room B has the same structure, but since only one projector 4 is installed in this embodiment, one communicator 3 is installed. In the conference room B, the communication is performed between the client PC 2 and the communicator 3 via the access point 2b.

The two conference rooms A and B are connected by LAN. Using the client PC 2 on the conference room B side,
It is possible to participate in the presentation in the conference room A via the access point 2b.

In this case, for example, when the presenter of the conference room A transfers the presentation material to the communicator 3 in the conference room A and displays the material on the projector 4 for the main communicator, the communicator of the conference room B is displayed. The same presentation materials were transferred to
The material transferred to the projector 4 is displayed.

When the pointer on the display screen is moved with a mouse or the like, mutual display is controlled so that the pointer is displayed at the same position on the conference room B side. That is, the conference rooms A and B have a mirror display configuration.

The same applies when the material is transferred from the conference room B to the conference room A side. However, since only one projector is installed in the conference room B, the sub communicators 3b and 3c of the conference room A are not used in such a case.

The embodiment shown in FIG. 8 is applied to the network electronic conferencing system 300 in the case of giving a presentation between conference rooms at two remote locations.

In this system 300, the conference rooms A and B are L
The case where the conference rooms A and B are connected by AN and the communication lines are connected to the conference room C at the remote point by a network is shown. It is assumed that the system described in FIG. 1 or FIG. 7 is built in each of the conference rooms A, B, and C. Therefore, details of individual components are omitted. It is sufficient if one creator 1 and one server 6 are installed in common.

Also in this case, since the mirror display of the presentation material is realized by the projector 4 in each conference room by the communication between the communicators 3 in the conference rooms A, B and C, the conference participants can simultaneously display the same display. You can attend the conference while looking at the materials. Further, even between remote places, it is possible to synchronously display the pointers on the same display screen according to the movement of the mouse.

Next, the operation of the network electronic conference system 100 described above will be described with reference to FIG.

First, in step S1, the conference participant's client PC 2 is used to activate the electronic conference application software and log on to the communicator (or main communicator) 3.

In this case, it has already been explained that the first conference participant can set the password and the subsequent conference participants can participate in the conference by inputting the password. Since the password is not a unique value pre-determined for the electronic conferencing system, forget the password,
It is possible to eliminate the inconvenient problem that the electronic conference system cannot be started by mistake.

In step S2, when the conference participant opens the control (CONTROL) screen which is the operation screen of the creator 1, only that client is the recorder client PC.
(See FIG. 4).

On the GUI screen of the client PC 2, right-click the icon of the creator 1 (see FIG. 4) and select "Control" from the displayed menu.
The control screen is displayed. (See FIG. 4) In step S3, when the REC key (FIG. 4) on the control screen is pressed, the moving image / audio input device 5 is activated to start recording the image of the conference.

When the memo key (FIG. 4) is pressed on the control screen, the memo screen as shown in FIG. 4 opens and the text can be input. When you press the SEND key, the entered text is taken into the creator 1.

In step S4, if the presentation material is dragged and dropped from the file list of the client PC 2 onto the icon of the projector 4 on which the presentation material is to be displayed, this presentation material is transferred to the creator 3 and selected in the file list on the screen of the projector 4. This presentation material is displayed. At the same time, the presentation material and page switching information are stored in the hard disk in the creator 1.

In step S5, when the recording is finished, the STOP key is pressed on the control screen. At that time, a save confirmation screen as shown in FIG. 10 is displayed on the recorder-side client PC 2. The contents are deleted except for the saving process. When the saving operation is performed, the conference content is automatically generated in step S6. That is, in this step S6, the conference content is generated based on the still image information from the communicator 3 and the moving image / sound information from the moving image / sound input device 5. In order to make this conference content visible over networks such as the Internet,
File data is converted to HTML format file data.

When the generation of the conference contents is completed in step S7, the creator contents manager screen is displayed, and the conference contents saved in the creator 1 can be confirmed (see FIG. 6).

In step S8, by selecting the conference content to be viewed from the creator content manager screen, the content can be reproduced. The content whose contents have been confirmed is transferred to the server (Server) 6 to be stored (step S9).

In step S8, when the conference content is reproduced and the content is desired to be edited, step S1
By operating the Creator Content Manager screen at 0, the conference content can be displayed on the client PC.
It can be transferred to the side and edited with known editing software. The edited server content is transferred to the server 6 and stored (step S9).

The conference content on the server 6 can be reproduced from the client PC 2 which is the recorder (step S11). FIG. 11 is an example of the content reproduction screen.

As shown in the figure, the content reproduction screen has a moving image reproduction section in which the pattern of the conference is recorded in the upper left portion,
The still image reproducing unit of the presentation material, which is the still image information used in the conference, is divided and displayed so as to be located in the right half thereof, and these are displayed on the same display screen at the same time.

Therefore, the display pattern of the still image reproducing unit for the presentation material differs depending on the maximum number of projectors installed in one conference room. In the embodiment, up to three projectors can be connected, and a maximum of three presentation materials may be displayed. Therefore, the playback screen configuration of the still image playback unit has a display pattern that can be divided into up to four.

This display pattern is templated, and the templated display pattern (templates 1 to 3) is selected according to the number of projectors used. FIG. 11 shows a case of the display pattern of the template 3 and is an example of display when three projectors are used. The still image P1 is the material displayed by the projector 4a, and similarly, the still images P2 and P3 are the projector 4b,
It is the material displayed using 4c. At the time of content reproduction, the material displayed in the still image reproduction unit is automatically switched with the passage of time. Details of the display patterns of templates 1 and 2 will be described later.

In addition to displaying the above-mentioned symbol mark indicating only the video and audio of the conference, the moving image reproducing section reproduces the moving image with the horizontal axis (horizontal direction) as the reproduction time axis just below the image display section. A mark SM indicating time is displayed.

By clicking this mark SM with a mouse, it is possible to shift (seek) this mark SM to an arbitrary position on the reproduction time axis. Then, the reproduction time axis of the moving image is shifted to the seek position, and the normal reproduction of the moving image is resumed from this reproduction time axis, so that the mark SM also functions as a seek mark.

Then, the presentation material, which is still image information, is also reproduced in synchronization with the seek reproduction time axis.
Therefore, the presentation material that matches this reproduction time axis is displayed in the corresponding display area.

The display portion further below the display position of the mark SM is divided into two stages, and a maximum of six presentation materials displayed by the projector are displayed as thumbnails. When using a plurality of projectors, the thumbnails of the materials displayed on the selected one projector are displayed.

When an arbitrary thumbnail is selected, the moving image displayed above is also synchronized with this and shifted to the time axis at which the thumbnail is displayed, and is normally played back from that time axis.

It is possible to switch to the mark display described above instead of the thumbnail display. Switching between thumbnail display and mark display is selected in the View switching section. In the order in which the MARK key on the control screen was pressed during the meeting, the titles given during the editing process (If there is no title, click `` Unt
It becomes "it led") and the time is displayed. Then, when the title of the mark display field is clicked with the mouse, the moving image displayed above is also shifted to the time axis in synchronization with this and becomes normal reproduction. As a result, the moving image and the still image (presentation material) are always displayed in synchronization with each other. During playback, the display will change over time.

At the bottom of each display screen of the still image reproducing section, there is a screen enlargement display key. When this key is selected, the still image displayed is switched to the maximum display pattern and displayed (original size). Displayed) (Fig. 1
8).

Next, the recording operation of the creator 1 will be described with reference to the flowcharts of FIGS.

In accordance with the recording instruction from the client PC 2, the creator 1 records a moving image, and also records and saves the presentation information sent from the communicator 3. As presentation materials, still images themselves, material creation software (presentation software), for example, materials created using power point, text display files created in PDF (Potable Document Format) format, GIF (Graphic Interchange)
Format) format, including image data, file data created by spreadsheet software, and other various data.

It will be described with reference to FIG. First, client P
When the REC key is pressed using the control screen of C2, recording of a moving image is started (step S21).

Next, in step S22, the information from the communicator 3 is monitored. This information includes capture key operation information when the presentation material is transferred, when the page of the transferred material is switched, and when the display screen is changed due to scrolling etc. although the page is not switched. Etc. are also included.

For example, as shown in FIG. 14, the amount of file data transferred as presentation material is large,
When the projector 4 cannot display the information of the whole material, first, for example, the upper half material A is displayed on the projector 4 (time ta), and the screen is scrolled at the next appropriate timing (time tb). Lower half of document B
Is displayed on the projector 4.

In such a presentation, it is unclear which part the presenter actually uses as the explanation with only the file information transferred first, and the explanation and the contents of the material are inconsistent.
Therefore, in such a case, it is preferable to record the actual material displayed on the projector 4 as the meeting material.

In such a case, it is preferable that the recorder press the “CAPHURE” key on the control screen so that the presentation material displayed on the projector 4 at that time can be recorded. Such captured information sent is also one of the information to be monitored.

Next, in step S23, the attribute information for the still image information transferred from the communicator 3 is determined, and if the attribute information is a still image file, the attribute information indicating that it is a still image file is managed. Information is written in the management list (playback management list) (step S2).
0).

Similarly, when it is confirmed in step 24 that the attribute information (text file) is related to the memo, the information to that effect is described in the reproduction management list (step 20), and the file created at the power point is also related. When it is attribute information, information indicating that is described (steps S25 and S20).

When the input information is neither of these information, it is determined whether or not the attribute information is the information indicating the end of the display, and when it is the display end information, the information is similarly described in the reproduction management list ( Steps S26 and S
20).

Now, the determination of the attribute information is completed in steps S20 to S26 of FIG. 12, and the process proceeds to the step of determining the type of the still image information itself. This will be described with reference to FIG.

First, when the still picture information transferred in step S27 is a still picture file, it is saved in the corresponding folder (step S28).

When three projectors 4 are used in the electronic conference system, the material (still image file) used by the projector 4a is stored in the P1 folder and the material (still image file) used by the projector 4b is stored. Sometimes to P2 folder and then projector 4c
The materials (still image files) used in are copied to the P3 folder respectively.

By thus specifying the folder to be saved according to the projector used for the presentation, a plurality of presentation materials can be simultaneously displayed on the content playback screen by using the target display template when playing the conference content. You will be able to play and display.

Next, when it is determined in step S29 that the memo file is a memo file, the memo file is saved in the memo folder (step S30). When the transferred still image information is a Power Point file, this Power Point file is image-compressed in step 32. As the compression format, for example, the JPEG format, which is widely used in networks such as the Internet, can be used. The new file converted into the JPEG file is given a unique name and then saved in the image folder (step S33). When waiting for compression processing in step S32,
It will be temporarily stored in the queue.

The process of monitoring the attribute information and the process of storing the still image information in the specific folder while discriminating the type of the still image information are repeated at the timing when the information is input from the communicator 3 (step S22).

Now, the communicator 3 described with reference to FIG.
Attribute information sent from A) Power Point display page (display start time, page information when changing pages, projector number, etc.) B) JPEG file name (display start time, projector number) C) File name of GIF file (including display start time and projector number) D) End of all display. And so on. Based on this, a reproduction management list (database) is created.

FIG. 15 shows an example of the reproduction management list. Here, the display start time is a display start time of a still image or a memo or a relative time from the head of a moving image.

The function code is 11 = still images are displayed at still image display locations (locations P1 to P3 corresponding to projectors 1 to 3). 12 = Display memo on memo screen. 13 = Turn off the still image display in the still image display area (P1 to P3). 14 = turn off the memo display. Is represented. The file name is the name of the file to be displayed. If you convert a Power Point file to JPEG, it will be named in the following format, for example. Converted time_page number.jpg (converted time = YYYYMMDDhhmms
s)

Subsequently, the moving image / audio information and the still image information recorded as described above are automatically reorganized into the conference contents used as the minutes of the conference when the recording is completed. This conference content is generated as a content that can be searched and viewed with Web Viewer. 16 and 1
This will be described with reference to FIG.

FIG. 16 is a flow chart at the time of content generation. To end recording on the creator 1 side,
Press the STOP key on the control screen. The content generation process starts at the same time as the recording is finished, and first, Power Point
If there is a file, it is confirmed that the JPEG file conversion of this file is completed (step S40).

After the conversion to the JPEG file is completed, in step S41 the image folder is copied to the P1 to P3 folders corresponding to only the necessary JPEG data. This is because the JPEG conversion file is also copied to the same folder when using the same projector.

In step S42, the reproduction management list is rewritten to the JPEG file name to have the same extension. In the next step S43, it is confirmed whether or not to save the conference content (see FIG. 10).

When there is an instruction not to save in step S50, it is confirmed whether the entire file data should be removed. If so, all the data recorded in step S51 is deleted and the content generation process is stopped.

On the other hand, when the process of saving the file is selected, of the data saved in step S44, whether the information sent from the moving picture / sound input device 5 is only the sound or the sound is shared with the moving picture. It is confirmed whether or not (step S44). This is because the subsequent processing is different when only audio is used and when video and audio are shared.

Explaining from the case where video and audio are shared, in this case, the number of projectors used for the presentation is checked in step S45. If there are not multiple projectors, that is, one projector is used,
Template 1 is selected as a content display template, that is, a display pattern (step S45a).

When two projectors are used, the display template 2 is selected (steps S46 and S46).
a) When there are three units, the display template 3 is selected (steps S46 and S46c).

In this way, by selecting the display template according to the number of projectors used and reproducing and displaying it as the content screen, the presentation materials for the number of projectors are always displayed together with the moving images regardless of the number of projectors used. Playback can be displayed. As a result, when a plurality of projectors are simultaneously used for presentation, the inconvenient problem that the presentation material used by some projectors cannot be reproduced as conference contents can be eliminated.

Here, the display size in the still picture reproducing section when the template 1 is selected as the display template is the largest display size as shown in an example in FIG. On the other hand, when the template 2 is selected, the still image information from the two projectors is displayed on the screen at the same time so that the still image information is displayed in two rows, as shown in FIG. Therefore, the display size is slightly smaller. When three units are used, the display pattern is as shown in FIG. FIG. 11 shows a screen aspect ratio of 4:
It is a display example when it is set to 3. Incidentally, the minimum display size in this embodiment is 320 × 240 pixel display.

Next, as shown in step S47 of FIG. 17, an HTML file is created in accordance with the selected template, but before that, processing for voice only is also performed. In the case of only sound, not only the image of the conference but the symbol mark indicating only the sound is displayed on the moving image reproducing unit, and the template corresponding to the number of projectors to be used is selected. Therefore, steps S55, S55a,
The mode of the template selected in S56, S56a, and S56b is the same as in the case of video / audio sharing, and thus detailed description thereof will be omitted. Here, the template 4 corresponds to the template 1, and the templates 5 and 6 correspond to the templates 2 and 3, respectively.
Incidentally, FIG. 20 shows an example of a conference content reproduction screen when three projectors are used.

The moving image / sound or only the sound data for which the display template is determined in this manner is converted into an HTML file in the state of the template in step S47 described above.

After that, in step S48, all the data, that is, the moving image / audio data, including the JPEG of the reproduction management list
Data, still image file data (JPEG data), power
All the JPEG data and text data of the point file are copied to the content storage location. After that, the work area secured in the hard disk 1b, which is the work memory of the creator 1, is deleted, and the conference content automatic creation process ends (step S49).

Next, the operation of reproducing the conference contents will be described with reference to FIG.
And it demonstrates with reference to the flowchart of FIG.

A menu is selected to open the creator content manager screen shown in FIG. Then, press the Review key after instructing the meeting content you want to see,
eb browser (eg Internet Explorer) opens and HTM
The contents of the file are displayed in frame units according to the L file (step S60).

If the data is voice only in step S61, a symbol mark indicating only voice is displayed at the moving image display position in step S62 (see FIG. 20). Then, the sound is reproduced (step S64). If there is a moving image, a moving image (meeting image) is displayed at the moving image display position in step S63.
To play.

Thereafter, the reproduction time is monitored in step S65, and when the reproduction of the moving image or the audio is not the last (step S66), the still image information (file data in HTML format) matching the reproduction time is displayed as shown in FIG. ) Is present (step S68).

If there is file data that matches the reproduction time of a moving image or the like and it is a still image file, the still image file of the corresponding time is displayed in the designated display areas P1 to P3 (step S69, S7
0). If the file data is a text file (memo information), it is displayed in the memo display area at the corresponding time (step S72).

Moreover, not only the display of the image but also the deletion thereof is monitored. When the reproduction management list includes information for erasing a still image or a memo, the arrival of the time is monitored, and when the time comes, if the image is a still image, the display at the display location is erased (steps S73 and S74). . If it is a memo, the display at the display location is erased (step S).
75, S76).

The display management processing and the deletion management processing as described above are performed until the reproduction of the moving image or the sound is completed (step S66), and the conference content reproduction processing mode is completed at the same time.

In the flowchart shown in FIG. 22, when the enlargement display key is pressed while the still image information is being reproduced and displayed on the screen, the image on which the enlargement display key is pressed is enlarged and displayed. When this is displayed as shown in FIG. 11, the presentation material displayed on all projectors can be viewed, but the size of the presentation material itself cannot be confirmed. In such a case, this enlarged display function enlarges and displays the material that is actually giving the presentation (the past presentation material may be used).

In this case, the following processing is added to the flowchart shown in FIG. Therefore, FIG.
3 is from the end of the determination processing in step S75 of FIG.
The process is performed up to step S66 shown in 1.

As shown in FIG. 23, when there is an instruction to enlarge and display the still image being reproduced and displayed (step S81), another window is opened to display the still image in the original size (step S82). Of course, the display template that determines the display pattern can be changed to the template 1 to display a still image.

After that, it is checked whether or not there is an instruction to close the enlarged display window (original size window) (step S83), and when there is an instruction to close the window, the window closing process is performed (step S84). This returns to the original display.

When there is no instruction to close the window, the enlarged display is continued. Therefore, when the still image displayed in the same place is switched in this state, the updated still image is also enlarged and displayed.

When there is a normal instruction, the original template is restored and a still image is displayed (step S8).
4). By doing so, it becomes possible to arbitrarily select a still image whose contents are to be confirmed and display it in an enlarged manner.

When the mark SM displayed on the content reproduction screen shown in FIG. 11 is clicked to seek, the moving image is normally reproduced from the end of the seek as described above, and the presentation material is also synchronized with this. It has been described that it is displayed at the display position.

An example for performing such a synchronous reproduction process will be described with reference to the flowchart in FIG. This processing procedure can be inserted, for example, after monitoring the memo deletion processing in step S75 in FIG. 22 and before transitioning to processing step S66 in FIG. When the processing procedure of FIG. 23 exists, the processing procedure of FIG. 24 may be inserted after this processing procedure ends.

First, in step S91, the click of the mark SM is monitored, and when the mark SM is clicked,
The seek end timing of the mark SM is monitored while managing the reproduction time axis (steps S92 and S93). The moving image is normally played back from the playback time axis after the seek is completed (step S94).

Then, the seek playback time information and the time management information regarding the presentation material recorded in the playback management list are constantly collated during the seek period, and the presentation material matching the time management information at the end of the seek is searched. If there is a matching presentation material that is searched for, the presentation material is selected as the reproduction information after the seek ends (step 9).
5).

When the seek end timing is between the display start time of one presentation material and the display start time of the next presentation material, the presentation material which is the first display start time is selected as the presentation material for reproduction. .

For example, the playback time at the end of seek is 00:00.
When it is 5 minutes 00 seconds, if you refer to the playback management list,
Display start time of the corresponding time management information is 00: 04: 0
When there is presentation material at 0 seconds and at 00: 07: 00: 00, the display start time is 00:00.
The first presentation material of 4 minutes 00 seconds is selected as the presentation material for reproduction and is reproduced and displayed.

By doing so, no matter what position on the reproduction time axis the mark SM is shifted, the presentation material synchronized with the moving image can be surely reproduced and displayed. In other words, depending on the seek position, the problem that the presentation material is not updated in synchronization with the moving image can be eliminated.

In the above embodiment, the present invention is applied to the network electronic conference system.
It is not limited to this. For example, the present invention can be similarly applied to the network education system, the network game system, and the like described at the beginning.

[0145]

As described above, according to the present invention, in recording both moving image / audio information and still image information, when the still image information is displayed on a plurality of display devices, all the display devices are displayed. Record the information displayed in, create a playback management list of still image information for video / audio information, and use this playback management list to manage content reorganization and display patterns of playback processing, etc. The still image information being reproduced can be enlarged and displayed.

According to this, in addition to the feature that the moving image / audio information and the still image information used in the presentation can be managed in the same dimension, the reproduction management list displays the file name at what time on what display device. It is possible to grasp the chronological order. Therefore, HTM
Even when the content expressed in the L format or the like is reproduced, since the display pattern to be reproduced can be easily selected on the same screen, it is possible to fit and display all the still image information on the split screen without omission.

By doing so, there is no problem that only specific still image information is reproduced, and a state close to an actually held conference can be reproduced. Therefore, in the case of a network conference, since the presentation materials used in all video projectors can be simultaneously split and displayed on the same screen, there is a feature that the conference content can be created and displayed without lacking the presentation materials.

Further, according to the present invention, since one still image information displayed on the display screen can be enlarged and displayed, its contents can be easily seen and the visibility can be improved.

Therefore, the present invention is extremely suitable when applied to a network conference system, a network education system, a network game system, etc., where a conference is held using the network, a lesson or lecture is given, and a game is enjoyed. .

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration when a network information processing system is applied to a network electronic conference system.

FIG. 2 is a diagram showing a configuration of a communicator that functions as an information processing support device.

FIG. 3 is a diagram illustrating a configuration of a creator that functions as an information creating device.

FIG. 4 is a client PC that functions as an information processing device.
It is a figure which shows the display screen of.

FIG. 5 is a diagram showing a state in which a creator menu is displayed.

FIG. 6 is a diagram showing a content manager screen.

FIG. 7 is a diagram showing another example of a network electronic conference system.

FIG. 8 is a diagram showing another example of a network electronic conference system.

FIG. 9 is a flowchart of system operation.

FIG. 10 is a diagram showing a content storage confirmation screen.

FIG. 11 is a diagram showing a content reproduction screen.

FIG. 12 is a flowchart of a recording operation of the creator (No. 1).

FIG. 13 is a flowchart of the recording operation of the creator (No. 2).

FIG. 14 is a diagram showing a file transfer and an example of an actual display screen.

FIG. 15 is a diagram showing an example of a reproduction management list.

FIG. 16 is a flowchart of the content generation operation of the creator (part 1).

FIG. 17 is a flowchart of the content generation operation of the creator (part 2).

FIG. 18 is a diagram showing a display pattern using a template when one projector is used.

FIG. 19 is a diagram showing a display pattern using a template when two projectors are used.

FIG. 20 is a diagram showing a display pattern using a template when three projectors are used with only sound.

FIG. 21 is a flowchart of a content reproducing operation of the creator (part 1).

FIG. 22 is a flowchart of the content reproducing operation of the creator (part 2).

FIG. 23 is a diagram showing a part of a flowchart for enlarged display.

FIG. 24 is a diagram showing a part of a flowchart for an example of seek processing.

[Explanation of symbols]

1 ... Information creation device (creator), 1a, 30d
..CPU, 1b, 30c ... Work RAM, 1d, 3
0a ... Network adapter, 1e ... Video / audio input terminal, 2 ... Information processing device (client P
C) 2a ... communication means (wireless LAN card), 2b
... Access point, 3 ... Information processing support device (communicator), 30e ... Display adapter, 4 ... Projector, 5 ... Video / audio input device, 5a ... Video camera, 5b ... Mike, 6
... Server, 100, 200, 300 ... Network electronic conference system

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G09G 5/36 H04N 7/15 H04N 1/387 5/91 N 5/76 J 7/15 G09G 5/36 520F 5/00 555D (72) Inventor Shuji Kurashige 6-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Terminology F-term (reference) 5C052 AB04 CC11 DD02 DD04 DD06 EE03 5C053 FA06 FA07 GB36 JA01 JA16 JA21 JA30 LA01 LA06 LA11 LA14 5C064 AA02 AB03 AB04 AB06 AC04 AC06 AC13 AC16 AC20 AD07 AD14 5C076 AA19 AA21 CA02 5C082 AA03 BA02 BA12 BA26 BB01 BB25 CA33 CA62 CA76 DA86 DA89 MM02 MM05 MM09

Claims (19)

[Claims] 1. Still image information displayed on a plurality of display devices is recorded in synchronization with moving image / audio information from a moving image / audio input device, and editing is performed to reproduce the recorded information. , A step of selecting a display pattern of the reproduction screen according to the number of the display devices so that the plurality of still image information can be reproduced and displayed on the same screen at the same time, and indicating an icon displayed in the display pattern And a step of enlarging and reproducing the still image information displayed in the display pattern. 2. The information creating method according to claim 1, wherein the display screen has steps for reproducing and displaying the moving image / audio information at the same time. 3. The display pattern in the step of selecting the display pattern has four display patterns capable of dividing a display area into a maximum of four, and the four display patterns are selected according to the number of display devices used. The information creating method according to claim 1, wherein the information creating method is performed. 4. When a command to enlarge and display the still image information reproduced in synchronization with the moving image / audio information is input, one display device is used as the display pattern and the still image information is displayed. 2. The information creating method according to claim 1, wherein the maximum display pattern used when displaying is selected. 5. In a state where the still image information is enlarged,
The information creating method according to claim 1, wherein when the still image information is updated, the updated still image information is enlarged and displayed. 6. The information creating method according to claim 1, wherein the moving image / audio input device is a video camera, and the display device is a video projector. 7. A list of information recording means for recording moving image / audio information from a moving image / audio input device and still image information from a plurality of display devices, and attribute information about a plurality of input still image information. And a moving picture / audio information and still image while selecting a display pattern capable of simultaneously displaying the plurality of still image information on the display screen based on the attribute information from the reproducing management list creating means. An information producing apparatus comprising an organizing means for reorganizing information and a control means for controlling the plurality of means. 8. The reproduction management list includes identification information for identifying a display device displaying the still image information, time management information such as a display start time, and a file name of the still image information. The information creating apparatus according to claim 7. 9. The information creating device according to claim 7, wherein the attribute information is identification information for identifying the display device. 10. The information creating apparatus according to claim 9, wherein a display pattern is selected according to the identification information. 11. When a command to enlarge and display the still image information displayed in synchronization with the moving image / audio information is input, one display device is used as the display pattern to display the still image information. 10. The information creating apparatus according to claim 9, wherein the maximum display pattern used when displaying is selected. 12. The updated still image information is enlarged and displayed when the still image information is updated while the still image information is being enlarged.
1. The information creation device described in 1. 13. An information processing device which has an input operation function and which processes arbitrary information, a display device which displays an image based on at least the information transferred from the information processing device, and the information processing device. An information processing support device that supports network information processing including the display device based on an input operation instruction from the device, a communication unit that connects the information processing support device and the information processing device, and transfer from the information processing device. The video / audio input device for inputting video and audio other than the information to be recorded, and the information transferred from the information processing device and the video / audio input device according to the instruction from the information processing device. And an information creation device that reorganizes the content as a content that can be communicated via a network. Information recording means for respectively recording the moving image / audio information from the input device and the still image information from the plurality of display devices, and a reproduction management list creating means for listing the attribute information about the plurality of input still image information, A knitting unit that reorganizes the moving image / audio information and the still image information while selecting a display pattern capable of simultaneously displaying the plurality of still image information on the display screen based on the attribute information from the reproduction management list creating unit. A network information processing system comprising: a control means for controlling the plurality of means. 14. The network information processing system according to claim 13, wherein the communication means is a wired system or a wireless system. 15. The information processing support device and the information creation device are connected to a network.
3. The network information processing system described in 3. 16. The video / audio information from the video / audio input device reproduced by the information creating device and the still image information displayed on the display device are transferred to the display screen of the information processing device at the same time. 14. The network information processing system according to claim 13, which is displayed. 17. The network information according to claim 13, wherein when there are a plurality of display devices, the still image information is simultaneously displayed on the display screen according to a divided display pattern corresponding to the number. Processing system. 18. A maximum display used when displaying the still image information by using one display device as the display pattern when there is an instruction from the information processing device to enlarge and display the still image information. 14. The network information processing system according to claim 13, wherein a pattern is selected. 19. The updated still image information is enlarged and displayed when the still image information is updated while the still image information is being enlarged.
8. A network information processing system according to item 8.