JP4244545B2 - Information creation method, information creation apparatus, and network information processing system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information creation method, an information creation device, and a network information processing system. Specifically, when multiple display devices are used for moving image / audio information from the moving image / audio input device, a plurality of still image information displayed on each display device is recorded in synchronization with the moving image / audio information. Furthermore, by generating playback content from them, even when a plurality of still image information is provided from a plurality of display devices, the still image information can be displayed at the same time. -The still image information reproduced in synchronization with the audio information is enlarged and displayed so that the content of the still image information can be easily seen.
[0002]
When the network information processing system according to the present invention is applied to an electronic conference system or the like, even when a presentation material is displayed using a plurality of video projectors and the conference is proceeding, the video information is displayed on the plurality of video projectors. It is possible to record multiple presentation materials, and when reproducing the contents, these presentation materials can be displayed on the same screen in synchronization with the progress of the meeting, and are currently used at that time. The presentation material is enlarged to make it easier to see.
[0003]
[Prior art]
As an information processing system performed via a network, a network electronic conference system (network conference system), a network education system, a network game system, etc. can be considered.
[0004]
Among these, for example, in a network conferencing system, a conference pattern is taken by a video camera, and materials used for presentation are provided to a conference person using a video projector or the like.
[0005]
When recording each of these pieces of information and later creating it as meeting minutes (meeting content), video / audio information that captures the pattern of a normal meeting and still picture information (presentation) used in the meeting It is usually stored separately from the presentation material used for This is because the conference organizer manages the video / audio information recording the conference pattern, and the presentation material is often managed by the person who made the presentation (presenter). Then, a conference participant who is instructed by the conference organizer later creates a meeting minutes as electronic data (conference content) using these separately stored information.
[0006]
[Problems to be solved by the invention]
As described above, it is troublesome to create conference contents using separately managed video / audio information and presentation materials. In addition to this, the following problems are also derived.
[0007]
When a meeting is performed, the number of video projectors used is not limited to one. In many cases, conferences are carried out using several video projectors and adding explanations while displaying separate presentation materials.
[0008]
If there is only one video projector, review the insertion timing of the presentation material while playing the video / audio information recorded on the day, and if appropriate, insert the presentation material into the video / audio information. By repeating, the minutes of the day's meeting can be created electronically.
[0009]
However, when a conference is in progress using multiple video projectors and displaying presentation materials on each of them, it is unclear which presentation material is used in which scene. .
[0010]
In addition, even if the timing of using presentation materials is known, there are many cases where it is not possible to accurately determine at what timing the presentation materials should be combined with video / audio information. Since this new presentation material is inserted instead of the previous presentation material, the previous presentation material disappears. However, in actual meetings, meetings are often performed using both materials. Therefore, the same state as the actual conference cannot be reproduced in the conference content as the minutes.
[0011]
This conference system is not only performed in one conference room, but also a plurality of conference rooms are electronically connected via a network to advance a conference, or a remote conference room (for example, a head office, a branch office, The same problem is caused when connecting multiple sites (factories, laboratories, etc.) via a network.
[0012]
Such problems include not only network conferencing systems, but also network education systems that use classes to provide classes and lectures at prep schools and sister schools, and games between multiple people who are staying at remote locations. It also occurs in enjoyable network game systems.
[0013]
Therefore, the present invention solves such a conventional problem, particularly in a case where still image information displayed on them is recorded and reproduced without omission even when a plurality of display devices are used. In this case, all the still image information can be displayed on the same screen, and the currently used still image information can be enlarged and displayed. A network information processing system is proposed.
[0014]
[Means for Solving the Problems]
In order to solve the above-described problem, in the information creation method according to the first aspect of the present invention, still image information displayed on a plurality of display devices in synchronization with the moving image / audio information from the moving image / audio input device Is recorded, and when performing editing to reproduce these recorded information,
Selecting a display pattern of the playback screen according to the number of the display devices so that the plurality of still image information can be simultaneously played back and displayed on the same screen;
A step of enlarging and reproducing the still image information displayed in the display pattern by designating an icon displayed in the display pattern.
[0015]
In the information creation device according to the present invention described in claim 7, information recording means for recording the moving image / audio information from the moving image / audio input device and the still image information from the plurality of display devices,
Reproduction management list creation means for listing attribute information for a plurality of input still image information;
Organizing means for reorganizing the video / audio information and the still image information while selecting a display pattern capable of simultaneously displaying the plurality of still image information on a display screen based on the attribute information from the reproduction management list creating means; ,
It is characterized by comprising control means for controlling these plural means.
[0016]
Furthermore, in the network information processing system according to the present invention described in claim 13, one or more information processing apparatuses that have an input operation function and process arbitrary information;
A display device that displays video based on at least information transferred from the information processing device;
The display device based on an input operation instruction from the information processing device Display processing An information processing support device for supporting network information processing including:
Communication means for connecting the information processing support device and the information processing device;
A video / audio input device for inputting video and audio other than information transferred from the information processing device;
An information creation device that records information transferred from the information processing device and the video / audio input device in accordance with an instruction from the information processing device and reorganizes the information as content that can be communicated via a network; ,
This information creation device
Information recording means for recording moving image / audio information from the moving image / audio input device and still image information from a plurality of display devices,
Reproduction management list creation means for listing attribute information for a plurality of input still image information;
Organizing means for reorganizing the video / audio information and the still image information while selecting a display pattern capable of simultaneously displaying the plurality of still image information on a display screen based on the attribute information from the reproduction management list creating means; ,
It is characterized by comprising control means for controlling these plural means.
[0017]
In the present invention, both moving image / audio information and still image information are recorded. When still image information is displayed on a plurality of display devices, the still image information is information displayed on all the display devices. Simultaneously with the recording of these information, a reproduction management list of still image information for moving image / audio information is created.
[0018]
The playback management list includes the file name of still image information, time management information such as display start time on the display device, display device identification information, etc., and this list displays what file name from what display device at what time. It is possible to grasp in time series whether or not
[0019]
Then, at the end of recording, these pieces of information are reorganized into contents (HTML format) that can be reproduced via the network. Further, a display pattern (screen division pattern) to be displayed on one screen is determined according to the number of display devices being used.
[0020]
In the playback mode, all still image information is inserted and displayed on the divided screen corresponding to the display pattern determined based on the playback management list. Video / audio information is displayed in a fixed display area other than this. This eliminates the problem of reproducing only specific still image information.
[0021]
In the case of a network conference, presentation materials used in all video projectors can be divided and displayed on the same screen at the same time, so that conference contents can be created and displayed without lacking presentation materials.
[0022]
When an enlargement display instruction is given to the still image information that is currently displayed, the still image information is enlarged and displayed. For example, a display pattern (maximum display pattern) displayed when only one display device is used is selected and enlarged. By doing so, the content of the still image information becomes easy to see and the visibility is improved. When the still image information is switched to a new one and displayed, the updated new still image information is also enlarged and displayed.
[0023]
DETAILED DESCRIPTION OF THE INVENTION
Next, an embodiment of an information creation method, an information creation device, and a network information processing system according to the present invention will be described in detail with reference to the drawings. Hereinafter, for convenience of explanation, a case where the present invention is applied to a network conference system will be described as an embodiment.
[0024]
The network electronic conferencing system is a system for transferring a presentation material created electronically to a projector or the like as a display device, and proceeding with the conference while enlarging and displaying the material. Therefore, the system includes a computer (personal computer) as an information processing apparatus for managing presentation materials, and an information processing support device (personal computer configuration) used for transferring presentation materials to a display device. The whole is built.
[0025]
FIG. 1 shows a configuration example of a main part of the network electronic conference system 100. As described above, the system 100 projects and displays an information processing apparatus (hereinafter referred to as a client PC) 2 that stores and manages presentation materials (file data), presentation materials and presentation materials taken from a document camera. In addition to a display device (hereinafter referred to as a projector) 4 that uses a projector or the like, an information processing support device (hereinafter referred to as a communicator) composed of a personal computer that supports data exchange or data processing between the client PC 2 and the projector 4. (Referred to as Communicator) 3.
[0026]
The communicator 3 is controlled by the client PC 2, and the display image of the video projector 4 is controlled via the communicator 3. Therefore, communicator 3 And the projector 4 are connected by an RGB cable or the like.
[0027]
The client PC 2 and the communicator 3 are connected by a communication means (network adapter) 2a. The communication means 2a can be wireless or wired. In this embodiment, wireless is used as the communication means.
[0028]
Therefore, both the client PC 2 and the communicator 3 are equipped with a wireless LAN card (network interface card) 2a as a communication means for connecting between them. Of course, even in the case of wireless communication, in addition to using a wireless LAN card, an access point (not shown) can be used to communicate with each other via this access point.
[0029]
The network electronic conference system 100 further records information on a conference room as video and audio, and also records presentation materials used in the conference to create a meeting minutes (meeting content). (Hereinafter referred to as “Creator”) 1 is connected by a LAN. The creator 1 is connected with a video camera 5a as a moving image input device and a microphone 5b as an audio input device. In this example, the moving image / audio input device 5 is directly connected to the creator 1 and is configured so that its operation mode can be controlled in accordance with an instruction from the client PC 2.
[0030]
In order to enable the communicator 3 and the creator 1 to perform a conference between the conference rooms installed between remote places via a communication between them and a network such as the Internet, in this example, the creator 1 and the communicator 3 are used. Each holds a global IP address of the same segment. Even if the global IP address is in a different segment, mutual communication is not hindered.
[0031]
Further, a server 6 as an information storage device is connected to the electronic conference system via a LAN so that conference content and the like can be stored and managed collectively by the server 6.
[0032]
The client PC 2 has electronic conference application software installed. In one conference system, up to 16 units can be used. When a plurality of client PCs are used, a unique private IP address is set for each.
[0033]
When using multiple client PCs 2, create a closed environment in the conference room, and establish a confidential conference system so that unspecified third parties cannot participate in the conference or view the conference content from the outside. To build, a common password is set.
[0034]
This password can be freely set by the first conference participant, and the remaining conference participants can join this conference system by entering the password.
[0035]
One of the participants in the conference transfers the presentation material from the client PC 2 to the communicator 3 via the wireless LAN card 2a and displays it on the projector 4 to acquire the right to make a presentation. By simply operating the function key of the client PC, the right to present can be abandoned, and the right to present to another conference participant can be delegated, so all conference participants are suspended as presenters. .
[0036]
One of the remaining conference participants is configured to be able to control the operation mode such as recording and reproduction for the creator 1 using the client PC 2. In other words, one of the remaining persons will have the right to make materials for the minutes of the meeting.
[0037]
Next, each component of the network electronic conference system 100 will be described.
[0038]
In one conference room, one projector 4 is installed, and therefore, an electronic conference system is constructed by one communicator 3 is the simplest basic configuration. However, in some cases, the conference can be operated more efficiently if the conference is progressed using a plurality of projectors 4. This is because there are many cases where different presentation materials are simultaneously displayed on a plurality of projectors and explanations are made while using them.
[0039]
In such a case, the communicator 3 is basically arranged according to the number of projectors 4 installed. FIG. 1 shows a configuration example when three projectors 4 are used. When a plurality of communicators 3 are used in this way, one of them is used as a main communicator (Main Communicator) 3a, and the remaining two are used as sub communicators (Sub Communicators) 3b and 3c. .
[0040]
In this case, the presentation material or the like sent from the client PC 2 is managed by the main communicator 3a and is displayed on the corresponding projectors 4b and 4c via the sub-communicators 3b and 3c. . Therefore, the subcommunicators 3b and 3c have private IP addresses. It is also possible to control the plurality of communicators 3a, 3b, 3c independently of each other.
[0041]
The main communicator 3a also uses the presentation material itself transferred from the client PC 2 and attribute information (such as page switching time and page information) when switching the page of the presentation material as reproduction management information via the LAN. It has a function of sending information to the creator 1 or receiving information recorded in the creator 1 and distributing it to the client PC 2 in accordance with an instruction from the client PC 2.
[0042]
FIG. 2 shows the configuration of the communicator 3. As shown in FIG. 2, the communicator 3 includes a network adapter 30a for sending and receiving presentation materials from the client PC 2, a storage device 30b for storing processing programs, and a working memory (Work RAM) 30c. , A CPU 30d, and a display adapter 30e for outputting presentation materials as RGB signals.
[0043]
In this example, the above-described wireless LAN card 2a is used as the network adapter 30a. The storage device 30b stores basic software (electronic conference application software) for operating the communicator 3 and a processing program for processing presentation materials.
[0044]
The Work RAM 30c is used for temporarily storing received presentation materials and processing the materials. Presentation materials are converted into R, G, B signals under the intervention of the CPU 30d and then supplied to the display adapter 30e. The projector 4 is connected to the communicator 3 with an RGB cable.
[0045]
FIG. 3 shows the configuration of the creator 1. The creator 1 includes a CPU 1a for processing a program, a work memory (in this example, a hard disk HDD) 1b for processing transmitted / received information (information such as a moving image and a still image), and a moving image / audio including presentation materials. And a storage device 1c that records a control program for processing them, and a network adapter 1d for connecting to the communicator 3. The creator 1 further includes a video / audio input terminal (I / O interface) 1e for receiving and controlling the video and audio information from the video / audio input device 5.
[0046]
The creator 1 records information related to the presentation material displayed on the communicator 3 as described above, and information on the attendees attending the electronic conference (information such as IP address and face photo) from the communicator 3. It records information to be transferred, as well as video / audio information. And it has the function to generate | occur | produce automatically the meeting content which can be called the minutes of a meeting with the completion | finish of recording. The conference content automatic creation process will be described later.
[0047]
When there are a plurality of client PCs as described above, the creator 1 and the moving image / audio input device 5 are controlled by one client PC 2. That is, it is managed by the client PC (recorder client PC) 2 of the clerk.
[0048]
In order to become a clerk client PC, a control (CONTROL) screen used as an operation screen for the creator 1 may be opened. If there is a client PC that has opened the control screen, the communicator 3 sets a prohibition flag so that the remaining client PCs cannot become recorder client PCs. FIG. 4 shows an example of a GUI screen displayed on the display screen of the recording client PC.
[0049]
This display screen consists of roughly three vertically divided display screens. The basic screen on the client PC side is displayed in the center of the display screen. On the right side of the display, information about participants who are participating in the conference is displayed. A user screen is displayed, and a control screen for controlling the creator 1 is displayed on the left side of the basic screen. A horizontally long memo screen is displayed at the bottom of the screen.
[0050]
On the upper side of the basic screen, icons of devices connected to the electronic conference system are displayed. In the figure, an icon (1) for the creator 1 and an icon (2) for the communicator 3 are displayed. Further, although not indicated by a symbol in the figure, an icon for the moving image / audio input device 5 is also displayed.
[0051]
The lower part of the basic screen is used as a file list field, and the file name {circle over (3)} stored in the client PC is displayed here.
[0052]
The participant screen shows the participant's face photo and the client PC owned by the participant. 2 Private IP address etc. are displayed.
[0053]
The uppermost part of the control screen is a video display unit, and video captured by the video camera 5a is displayed here as a moving image. The central part is a strip-shaped display area, which is a plurality of soft key operation parts including function keys, and the lowermost part is an input part such as a title. In addition to the REC key (4), STOP key (5), PAUSE key (6), the MARK key (7) for marking important video locations during recording and a memo screen are opened For example, a MEMO key {circle over (8)} and a CAPTURE key {circle around (9)} for saving still image information (presentation material) displayed on the projector 4 are displayed.
[0054]
When the client PC 2 logs on to the communicator 3, only the basic screen is displayed on the display screen. By dragging and dropping the file in the file list (3) to the icon of the communicator 3, the file data (presentation material) is transferred to the communicator 3 and displayed on the projector 4 for presentation. However, this is a case where the operation is performed on the client PC 2 side having the presenter qualification.
[0055]
When the attendee key on the basic screen is pressed, the participant screen is displayed on the right side as shown in FIG.
[0056]
When the creator icon (1) is right-clicked, a menu screen as shown in FIG. 5 is displayed. When “control” is selected from the menu screen, the control screen shown in FIG. 4 is displayed. When the MEMO key (8) is operated from the control screen, a memo screen is displayed at the screen position in FIG. 4, and a text or the like can be input here. The memo screen has 4-6 lines of space.
[0057]
When “content manager” is selected from the menu screen shown in FIG. 5, the conference content list menu (creator content manager screen) stored in the creator 1 is displayed.
[0058]
FIG. 6 shows a display example of the creator content manager screen. On this screen, the content list {circle over (1)} stored in the creator 1 is displayed and soft keys for selecting an operation mode for the selected content list are displayed. In the embodiment, the Review key (2) for playing back the selected content, the client transfer key (Download to My Computer key) (3) for transferring the selected content to the client PC 2, and the selected content to the server Server transfer key (Upload to Server key) (4), detail key (Show Contents Information key) (5) for viewing detailed information of the selected content, Delete key (6) for deleting the selected content ▼ etc. are displayed.
[0059]
The network electronic conference system 100 described above, particularly the system shown in FIG. 1, is an electronic conference system when a network is constructed only in one conference room, but a network electronic conference system can be constructed in other cases.
[0060]
A network electronic conference system 200 shown in FIG. 7 is a system that is applied when a conference proceeds while making a presentation using a plurality of, for example, two conference rooms.
[0061]
In this case, the conference rooms A and B often have the same system construction, but may not. FIG. 7 shows the embodiment. The system in the conference room A includes a creator 1, a client PC 2, a communicator 3, a projector 4 connected to the communicator 3, and a video / audio input device 5. There are three projectors. Therefore, three communicators 3 are also installed. As a communication means, a wireless LAN card 2a is used.
[0062]
The system of the conference room B is configured in the same manner, but since only one projector 4 is equipped in this embodiment, one communicator 3 is installed. In the conference room B, communication is performed between the client PC 2 and the communicator 3 through the access point 2b.
[0063]
The two conference rooms A and B are connected by a LAN. It is possible to participate in the presentation in the conference room A via the access point 2b using the client PC 2 on the conference room B side.
[0064]
In this case, for example, when the presenter in the conference room A transfers the presentation material to the communicator 3 in the conference room A and displays the material on the projector 4 for the main communicator, the presenter displays it in the communicator 3 in the conference room B. The same presentation material is transferred, and the transferred material is displayed on the projector 4.
[0065]
When the pointer on the display screen is moved with a mouse or the like, mutual display is controlled so that the pointer is also displayed at the same position on the conference room B side. That is, the conference rooms A and B have a mirror display configuration.
[0066]
The same applies when materials are transferred from the conference room B to the conference room A side. However, since only one projector is installed in the conference room B, the subcommunicators 3b and 3c in the conference room A are not used in such a case.
[0067]
The embodiment shown in FIG. 8 is a case where the present invention is applied to a network electronic conference system 300 in the case of giving a presentation between conference rooms at two remote locations.
[0068]
This system 300 shows a case where the conference rooms A and B are connected by a LAN, and the communication lines are connected between the conference rooms A and B and the conference room C at a remote location via a network. It is assumed that the system described in FIG. 1 or FIG. 7 is constructed in each of the conference rooms A, B, and C. Therefore, the details about each configuration are omitted. It is sufficient that one creator 1 and one server 6 are installed in common.
[0069]
Also in this case, since the presentation material mirror display is realized by the projector 4 in each conference room by communication between the communicators 3 in the conference rooms A, B, and C, the conference participants can view the same display material at the same time. While attending the meeting. Further, even between remote locations, pointers can be displayed in synchronization on the same display screen according to the movement of the mouse.
[0070]
Next, the operation of the network electronic conference system 100 described above will be described with reference to FIG.
[0071]
First, in step S 1, the electronic conference application software is activated using the client PC 2 of the conference participant and logged on to the communicator (or main communicator) 3.
[0072]
In this case, it has already been described that the first conference participant sets a password, and subsequent participants can join the conference by entering the password. Since the password is not a unique value determined in advance for the electronic conference system, it is possible to eliminate an inconvenient problem such as forgetting the password or inadvertently starting the electronic conference system.
[0073]
In step S2, when a conference participant opens a control (CONTROL) screen that is an operation screen of the creator 1, only the client becomes the recorder client PC (see FIG. 4).
[0074]
On the GUI screen of the client PC 2, right-click on the icon 1 of the creator 1 (see FIG. 4) and select “control” from the displayed menu to display the control screen. (See Figure 4)
In step S3, when the REC key (4) (FIG. 4) on the control screen is pressed, the moving image / audio input device 5 is activated and video recording of the conference is started.
[0075]
When the memo key (8) (FIG. 4) is pressed on the control screen, the memo screen as shown in FIG. 4 is opened and text can be input. When the SEND key is pressed, the entered text is taken into the creator 1.
[0076]
In step S4, dragging and dropping the presentation material from the file list (3) of the client PC 2 to the icon (2) of the projector 4 for which the presentation material is to be displayed is transferred to the creator 3 and displayed in the file list on the screen of the projector 4 The selected presentation material is displayed. At the same time, the presentation material and page switching information are stored in the hard disk in the creator 1.
[0077]
To end recording in step S5, press the STOP key (5) on the control screen. At that time, a storage confirmation screen as shown in FIG. The contents are deleted except for the saving process. When the save operation is performed, conference content is automatically generated in step S6. That is, in this step S 6, conference content is generated based on the still image information from the communicator 3 and the moving image / audio information from the moving image / audio input device 5. In order to be able to refer to the conference content via a network such as the Internet, the file data is converted into HTML format file data.
[0078]
When the generation of the conference content is completed in step S7, the creator content manager screen is displayed, and the conference content stored in the creator 1 can be confirmed (see FIG. 6).
[0079]
In step S8, the content can be reproduced by selecting the conference content to be viewed from the creator content manager screen. The content whose contents have been confirmed is saved by being transferred to the server 6 (step S9).
[0080]
In step S8, when the conference content is played back and it is desired to edit the content, in step S10, the conference content is transferred to the client PC side by operating the creator content manager screen, and the known content is edited. Can be edited with software. The edited server content is transferred to the server 6 and stored (step S9).
[0081]
The conference content on the server 6 can be reproduced from the client PC 2 that is the recorder (step S11). FIG. 11 is an example of a content playback screen.
[0082]
On the content playback screen, as shown in the figure, the video playback unit that recorded the conference pattern is located in the upper left, and the still image playback unit for the presentation material that is still image information used in the conference is located in the right half The screen configuration is such that these can be divided and displayed simultaneously on the same display screen.
[0083]
Therefore, the display pattern of the still image reproducing unit for presentation materials differs depending on the maximum number of projectors installed in one conference room. In the embodiment, the projector can be connected to up to three projectors, and a maximum of three presentation materials may be displayed. Therefore, the playback screen configuration of the still image playback unit has a display pattern that can be divided into a maximum of four.
[0084]
This display pattern is templated, and templated display patterns (templates 1 to 3) are selected according to the number of projectors used. FIG. 11 shows a display pattern of the template 3, which is a display example when three projectors are used. The still image P1 is the material {circle around (5)} displayed by the projector 4a. Similarly, the still images P2 and P3 are the material {circle around (5)} displayed using the projectors 4b and 4c. When the content is reproduced, the material {circle over (5)} displayed on the still image reproducing unit is automatically switched as time elapses. Details of the display patterns of templates 1 and 2 will be described later.
[0085]
In addition to displaying the above-described symbol mark indicating only the video and audio of the conference, the video playback unit shows the playback time of the video with the horizontal axis (horizontal direction) as the playback time axis immediately below the video display unit. The mark SM is displayed.
[0086]
The mark SM can be shifted (seeked) to an arbitrary position on the reproduction time axis by clicking the mark SM with a mouse. Then, the reproduction time axis of the moving image is shifted to the seek position, and normal reproduction of the moving image is resumed from this reproduction time axis, so that this mark SM also functions as a seek mark.
[0087]
Then, presentation material as still image information is also reproduced in synchronization with the seek reproduction time axis. Accordingly, the presentation material that matches the reproduction time axis is displayed in the corresponding display area.
[0088]
The display section further below the display position of the mark SM is divided into two stages, and up to six presentation materials displayed by the projector are displayed as thumbnails. When a plurality of projectors are used, the materials displayed on the selected projector are displayed as thumbnails.
[0089]
When an arbitrary thumbnail is selected, the moving image displayed above is also synchronized with this, and is shifted to the time axis on which the thumbnail is displayed, and is normally reproduced from the time axis.
[0090]
Instead of the thumbnail display (2), the above-mentioned mark display (4) can be switched. Switching between thumbnail display and mark display is selected by the view switching section (1).
In the order in which the MARK key (7) on the control screen is pressed during the meeting, the titles given during the editing process (if there is no title, “Untitled”) and the time are displayed. When the title of the mark display column (4) is clicked with the mouse, the moving image displayed above is also shifted to the time axis in synchronization with this and normal playback is performed. As a result, the moving image and the still image (presentation material) are always displayed in synchronization.
During playback, the display is switched as time elapses.
[0091]
On the lower side of each display screen of the above-described still image reproduction section, there is an enlarged display key (6). When this is selected, the displayed still image is switched to the maximum display pattern and displayed (original size). Display) (see FIG. 18).
[0092]
Next, the recording operation of the creator 1 will be described with reference to the flowcharts of FIGS. 12 and 13.
[0093]
In accordance with a recording instruction from the client PC 2, the creator 1 records a moving image and records and saves presentation information sent from the communicator 3. Presentation materials include still images themselves, document creation software (presentation software), for example, documents created using power points, text display files created in PDF (Potable Document Format) format, GIF (Graphic Interchange Format) It includes various data such as image data created in a format, file data created with spreadsheet software.
[0094]
It demonstrates from FIG. First, when the REC key (4) is pressed using the control screen of the client PC 2, recording of a moving image is started (step S21).
[0095]
Next, in step S22, information from the communicator 3 is monitored.
This information includes the operation information of the capture key when the presentation material is transferred, when the page of the transferred material is switched, or when the display screen is changed due to scrolling etc. Etc.
[0096]
For example, as shown in FIG. 14, when the amount of file data transferred as presentation material is large and the projector 4 cannot display the information of the entire material, the material A in the upper half is first displayed on the projector 4 ( In this case, the screen is scrolled and the lower half of the document B is displayed on the projector 4 at the next appropriate timing (time tb).
[0097]
In such a presentation, it is unclear which part the presenter is currently using as the explanation only by the file information transferred first, and the explanation and the contents of the material are inconsistent. Therefore, in such a case, it is preferable to record the actual material displayed on the projector 4 as the conference material.
[0098]
In such a case, it is preferable that the recording person presses the “CAPHURE” key on the control screen so that the presentation material displayed on the projector 4 can be recorded at that time, and is sent from the communicator 3. Such capture information is one of the information that should be monitored.
[0099]
Next, in step S23, attribute information for the still image information transferred from the communicator 3 is determined. When the attribute information is a still image file, the attribute information indicating that the image is a still image file is managed as management information. It describes in the list (reproduction management list) (step S20).
[0100]
Similarly, when it is confirmed in step 24 that the attribute information (text file) is related to the memo, the information to that effect is described in the reproduction management list (step 20), and the attribute information related to the file created at the power point is used. If there is, information indicating that is described (steps S25 and S20).
[0101]
If the input information is not any of these information, it is determined whether the attribute information is information indicating the end of display. If the input information is display end information, the information is similarly described in the reproduction management list (step S26, S20).
[0102]
Now, the determination of the attribute information is completed in steps S20 to S26 in FIG. 12, and then the process proceeds to a step of determining the type of still image information itself. This will be described with reference to FIG.
[0103]
First, when the still image information transferred in step S27 is a still image file, it is stored in the corresponding folder (step S28).
[0104]
When three projectors 4 are used in the electronic conference system, when the material (still image file) used by the projector 4a is the document (still image file) used by the projector 4b to the P1 folder The material (still image file) used in the P2 folder and in the projector 4c is copied to the P3 folder.
[0105]
By specifying the folder to be saved according to the projector used for the presentation in this way, multiple presentation materials can be played and displayed simultaneously on the content playback screen using the target display template when playing the conference content Will be able to.
[0106]
Next, when it is determined in step S29 that the file is a memo file, the memo file is stored in the memo folder (step S30). If the transferred still image information is a power point file, the power point file is compressed in step 32. As the compression format, for example, the JPEG format frequently used in networks such as the Internet can be used. The new file converted into the JPEG file is given a unique name and stored in the image folder (step S33). When waiting for compression processing in step S32, it is temporarily stored in the queue.
[0107]
The above-described monitoring of attribute information and the process of storing in a specific folder while determining the type of still image information are repeated at the timing when information is input from the communicator 3 (step S22).
[0108]
Now, as attribute information sent from the communicator 3 described in FIG.
A) Power Point display page (display start time, page information when the page is changed, projector number, etc.)
B) JPEG file name (including display start time and projector number)
C) GIF file name (including display start time and projector number)
D) All display ends.
And so on. Based on this, a reproduction management list (database) is created.
[0109]
FIG. 15 shows an example of the reproduction management list. Here, the display start time is a display start time of a still image or a memo or a relative time from the beginning of a moving image.
[0110]
Function code is 11 = Still image display location (location corresponding to projectors 1-3
Display still images on P1 to P3).
12 = Show note on note screen.
13 = Turn off the still image display in the still image display area (P1 to P3).
14 = Turn off the memo display.
Represents. The file name is the name of the file to be displayed. When a Power Point file is converted to JPEG, it is named in the following format, for example.
Converted time_page number.jpg (converted time = YYYYMMDDhhmmss)
[0111]
Subsequently, the moving image / audio information and still image information recorded as described above are automatically reorganized into conference content used as the minutes of the conference upon completion of recording. This conference content is generated as a content that can be searched and viewed by Web Viewer. This will be described with reference to FIGS. 16 and 17.
[0112]
FIG. 16 is a flowchart when content is generated. To stop recording on the creator 1, press the STOP key (5) on the control screen. The content generation process starts simultaneously with the end of recording, and when there is a Power Point file, the end of JPEG file conversion of this file is confirmed (step S40).
[0113]
After completing the conversion to the JPEG file, in step S41, only the necessary JPEG data is copied from the image folder to the corresponding P1 folder to P3 folder. This is because the JPEG conversion file is copied to the same folder when using the same projector.
[0114]
In step S42, the reproduction management list is rewritten with the JPEG file name to have the same extension. In the next step S43, it is confirmed whether or not to save as conference content (see FIG. 10).
[0115]
If there is an instruction not to save in step S50, it is confirmed whether or not the entire file data is to be deleted. If so, all the data recorded in step S51 is deleted, and the content generation process is stopped.
[0116]
On the other hand, when the process for saving the file is selected, whether the information sent from the video / audio input device 5 is only audio or the video and audio are shared among the data saved in step S44. Confirm (step S44). This is because the subsequent processing is different in the case of sharing only audio and moving image and audio.
[0117]
The description starts from the case where the moving image and the sound are shared. In this case, the number of projectors used for the presentation is checked in step S45. When there are not a plurality of projectors, that is, when one projector is used, the template 1 is selected as a template for displaying contents, that is, a display pattern (step S45a).
[0118]
When two projectors are used, the display template 2 is selected (steps S46 and S46a), and when three projectors are used, the display template 3 is selected (steps S46 and S46c).
[0119]
As described above, if a display template is selected according to the number of projectors 4 used and reproduced and displayed as a content screen, presentation materials for the number of projectors used can always be reproduced and displayed at the same time, regardless of the number of projectors used. . As a result, when a plurality of projectors are used for presentation at the same time, it is possible to surely eliminate an inconvenient problem in which presentation materials used by some projectors cannot be reproduced as conference content.
[0120]
Here, when the template 1 is selected as the display template, the display size in the still image reproduction unit is the largest display size as shown in FIG. On the other hand, when the template 2 is selected, the still image information from the two projectors is displayed on the screen at the same time as shown in FIG. Therefore, the display size is slightly reduced. When three units are used, a display pattern as shown in FIG. 11 is obtained. FIG. 11 shows a display example when the aspect ratio of the screen is 4: 3. Incidentally, in this embodiment, the minimum display size is 320 × 240 pixel display.
[0121]
Next, as shown in step S47 in FIG. 17, an HTML file is created in accordance with the selected template, but before that, processing in the case of only audio is also performed.
In the case of only audio, a template corresponding to the number of projectors to be used is selected only by displaying a symbol mark indicating only audio, not a conference video, in the moving image reproduction unit. Accordingly, the template mode selected in steps S55, S55a, S56, S56a, and S56b is the same as that in the case of video / audio sharing, and the detailed description thereof is omitted. Here, the template 4 corresponds to the template 1, and the templates 5 and 6 correspond to the templates 2 and 3, respectively. Incidentally, FIG. 20 shows an example of a conference content playback screen when three projectors are used.
[0122]
In this way, the moving image / audio or audio-only data for which the display template is determined is converted into an HTML file in the above-described state in step S47.
[0123]
After that, in step S48, all the data, that is, all of the JPEG data, still image file data (JPEG data) in the playback management list, JPEG data in the power point file, and text data are copied to the content storage location, including video / audio data. Is done. Thereafter, the work area secured in the hard disk 1b, which is the work memory of the creator 1, is deleted, and the conference content automatic creation process ends (step S49).
[0124]
Next, the conference content playback operation will be described with reference to the flowcharts of FIGS.
[0125]
The menu is selected to open the creator content manager screen shown in FIG. When the user wants to view the conference content and presses the Review key (2), a Web browser (for example, Internet Explorer) is opened, and the contents of the file are displayed in units of frames according to the HTML file (step S60).
[0126]
If the data is audio only at step S61, a symbol mark indicating only audio is displayed at the moving image display position at step S62 (see FIG. 20). Then, the sound is reproduced (step S64). If there is a moving image, the moving image (conference video) is reproduced at the moving image display position in step S63.
[0127]
Thereafter, the playback time is monitored in step S65, and when the video or audio playback is not the last (step S66), there is still image information (file data in HTML format) that matches the playback time as shown in FIG. It is confirmed whether or not to perform (step S68).
[0128]
If there is file data matching the playback time such as a moving image and it is a still image file, the still image file at the corresponding time is displayed in the designated display areas P1 to P3 (steps S69 and S70). If the file data is a text file (memo information), it is displayed in the memo display area at the corresponding time (step S72).
[0129]
Moreover, not only the display of the image but also the deletion thereof is monitored. When there is information for erasing a still image or memo in the reproduction management list, the arrival of the time is monitored, and when that time is reached, if it is a still image, the display at that display location is erased (steps S73, S74). . If it is a memo, processing for erasing the display at the display location is performed (steps S75 and S76).
[0130]
Such display management processing and erasure management processing are performed until the reproduction of the moving image or the sound is completed (step S66), and the conference content reproduction processing mode is terminated at the same time.
[0131]
In the flowchart shown in FIG. 22, when the enlarged display key is pressed while the still image information is reproduced and displayed on the screen, the image with the enlarged display key pressed is enlarged and displayed. This is because the presentation material displayed on all projectors can be viewed when displayed as shown in FIG. 11, but the size of the presentation material itself is not large enough to be confirmed. In such a case, this enlarged display function displays an enlarged material (which may be a past presentation material) that is actually being presented.
[0132]
In this case, the following processing is further added to the flowchart shown in FIG. Accordingly, FIG. 23 is processed from the end of the determination process in step S75 of FIG. 22 to the step S66 shown in FIG.
[0133]
As shown in FIG. 23, when there is an enlarged display instruction for the still image being reproduced and displayed (step S81), another window is opened to display the still image in the original size (step S82). Of course, the display template for determining the display pattern can be changed to the template 1 to display a still image.
[0134]
Thereafter, it is checked whether or not there is an instruction to close the enlarged display window (original size window) (step S83), and when there is an instruction to close the window, a process for closing the window is performed (step S84). This returns to the original display.
[0135]
When there is no instruction to close the window, the enlarged display is continued. Therefore, when the still image displayed at the same place is switched in this state, the updated still image is also displayed in an enlarged manner.
[0136]
When there is a normal instruction, the original template is restored and a still image is displayed (step S84). In this way, a still image whose contents are to be confirmed can be arbitrarily selected and displayed in an enlarged manner.
[0137]
When the mark SM displayed on the content playback screen shown in FIG. 11 is clicked to seek, the video is normally played back from the end of the seek as described above, and the display position corresponding to the presentation material is also synchronized with this. It explained that it is displayed in.
[0138]
An example for performing such synchronous reproduction processing will be described with reference to the flowchart of FIG. This processing procedure can be inserted after monitoring the memo erasing process in step S75 in FIG. 22, for example, and before transitioning to processing step S66 in FIG. If the processing procedure of FIG. 23 exists, the processing procedure of FIG. 24 may be inserted after this processing procedure is completed.
[0139]
First, in step S91, the click of the mark SM is monitored. When the mark SM is clicked, the seek end timing of the mark SM is monitored while managing the reproduction time axis (steps S92 and S93). The moving image is normally reproduced from the reproduction time axis at which the seek is completed (step S94).
[0140]
The seek time information and the time management information related to the presentation material recorded in the reproduction management list are always collated during the seek period, and the presentation material matching the time management information at the end of the seek is searched. If there is a matching presentation material, the presentation material is selected as reproduction information after the end of seek (step 95).
[0141]
When the seek end timing is between the display start time of one presentation material and the display start time of the next presentation material, the presentation material that is the first display start time is selected as a presentation material for reproduction.
[0142]
For example, when the playback time at the end of seek is 00:05:00, referring to the playback management list, the display start times of the corresponding time management information are 00:04:00 and 00:07:00. When each presentation material exists, the first presentation material whose display start time is 00:04:00 is selected as a presentation material for reproduction and reproduced and displayed.
[0143]
In this way, the presentation material synchronized with the moving image can be reliably reproduced and displayed regardless of the position of the mark SM on the reproduction time axis. In other words, depending on the seek position, it is possible to eliminate the problem that the presentation material is not updated in synchronization with the moving image.
[0144]
In the above embodiment, the present invention is applied to a network electronic conference system, but the present invention is not limited to this. For example, the present invention can be similarly applied to a network education system, a network game system, and the like described in the beginning.
[0145]
【The invention's effect】
As described above, in the present invention, when recording both moving image / audio information and still image information, when still image information is displayed on a plurality of display devices, it is displayed on all the display devices. Record information, create a playback management list of still image information for video / audio information, use this playback management list to manage content reorganization, playback processing display patterns, etc. The image information can be enlarged and displayed.
[0146]
According to this, in addition to the feature that video / audio information and still image information used in presentations can be managed in the same dimension, what time and what file name was displayed from what display device by the playback management list It can be grasped in time series. Therefore, even when content expressed in the HTML format or the like is reproduced, a display pattern to be reproduced on the same screen can be easily selected, so that all still image information can be fitted and displayed on the divided screen without omission.
[0147]
By doing this, there is no problem that only specific still image information is reproduced, and a state close to an actual conference can be reproduced. Accordingly, in the case of a network conference, presentation materials used in all video projectors can be divided and displayed on the same screen at the same time, so that the conference content can be created and displayed without the lack of presentation materials.
[0148]
Furthermore, in this invention, since one still picture information currently displayed on the display screen can be enlarged and displayed, the contents can be easily seen and visibility can be improved.
[0149]
Therefore, the present invention is extremely suitable when applied to a network conference system, a network education system, a network game system, or the like that uses a network to hold a meeting, conduct a class or lecture, or enjoy a game.
[Brief description of the drawings]
FIG. 1 is a diagram showing a configuration when a network information processing system is applied to a network electronic conference system.
FIG. 2 is a diagram illustrating a configuration of a communicator that functions as an information processing support apparatus.
FIG. 3 is a diagram illustrating a configuration of a creator that functions as an information creation device.
FIG. 4 is a diagram illustrating a display screen of a client PC that functions as an information processing apparatus.
FIG. 5 is a diagram showing a state in which a creator menu is displayed.
FIG. 6 is a diagram showing a content manager screen.
FIG. 7 is a diagram showing another example of a network electronic conference system.
FIG. 8 is a diagram showing another example of a network electronic conference system.
FIG. 9 is a flowchart of system operation.
FIG. 10 is a diagram showing a content storage confirmation screen.
FIG. 11 is a diagram showing a content playback screen.
FIG. 12 is a flowchart of the recording operation of the creator (part 1).
FIG. 13 is a flowchart of the recording operation of the creator (part 2).
FIG. 14 is a diagram illustrating an example of a file transfer and an actual display screen.
FIG. 15 is a diagram illustrating an example of a reproduction management list.
FIG. 16 is a flowchart of a creator content generation operation (part 1);
FIG. 17 is a flowchart of the content generation operation of the creator (part 2).
FIG. 18 is a diagram showing a display pattern using a template when one projector is used.
FIG. 19 is a diagram showing a display pattern using a template when two projectors are used.
FIG. 20 is a diagram showing a display pattern using a template when only three projectors are used when only sound is used.
FIG. 21 is a flowchart of the content reproduction operation of the creator (part 1).
FIG. 22 is a flowchart of the content reproduction operation of the creator (part 2).
FIG. 23 is a diagram illustrating a partial flowchart for enlarged display;
FIG. 24 is a diagram illustrating a partial flowchart for an example of seek processing.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Information preparation apparatus (creator), 1a, 30d ... CPU, 1b, 30c ... Work RAM, 1d, 30a ... Network adapter, 1e ... Video / audio input terminal, 2. .. Information processing device (client PC), 2a ... communication means (wireless LAN card), 2b ... access point, 3 ... information processing support device (communicator), 30e ... display adapter, 4 ... Projector, 5 ... Video / audio input device, 5a ... Video camera, 5b ... Microphone, 6 ... Server, 100, 200, 300 ... Network electronic conference system

Claims (19)

In synchronization with video / audio information from the video / audio input device, still image information displayed on a plurality of display devices is recorded, and when performing editing for reproducing these recorded information,
Selecting a display pattern of the playback screen according to the number of the display devices so that the plurality of still image information can be simultaneously played back and displayed on the same screen;
And a step of enlarging and reproducing still image information displayed in the display pattern by designating an icon displayed in the display pattern. 2. The information creating method according to claim 1, further comprising the step of reproducing and displaying the moving image / audio information simultaneously on the display screen. The display pattern in the step of selecting the display pattern has four display patterns that can divide the display area into four at maximum,
2. The method according to claim 1, wherein the four display patterns are selected according to the number of display devices used. When an instruction to enlarge and display the still image information reproduced in synchronization with the video / audio information is input, the display pattern is displayed when the still image information is displayed using one display device. 2. The information creation method according to claim 1, wherein a maximum display pattern to be used is selected. 2. The information creating method according to claim 1, wherein when the still image information is updated while the still image information is enlarged, the updated still image information is enlarged and displayed. 2. The information creation method according to claim 1, wherein the video / audio input device is a video camera, and the display device is a video projector. Information recording means for recording moving image / audio information from the moving image / audio input device and still image information from a plurality of display devices,
Reproduction management list creation means for listing attribute information for a plurality of input still image information;
Organizing means for reorganizing the video / audio information and the still image information while selecting a display pattern capable of simultaneously displaying the plurality of still image information on a display screen based on the attribute information from the reproduction management list creating means; ,
An information creating apparatus characterized by comprising control means for controlling the plurality of means. 8. The reproduction management list includes identification information for identifying a display device displaying the still image information, time management information such as a display start time, a file name of the still image information, and the like. Information creation device. 8. The information creating apparatus according to claim 7, wherein the attribute information is identification information for identifying the display device. The information generation apparatus according to claim 9, wherein a display pattern is selected according to the identification information. Used when displaying the still image information using one display device as the display pattern when an instruction to enlarge the display is input for the still image information displayed in synchronization with the moving image / audio information. The information creating apparatus according to claim 9, wherein a maximum display pattern to be selected is selected. 12. The information creating apparatus according to claim 11, wherein when the still image information is updated while the still image information is enlarged, the updated still image information is displayed in an enlarged manner. One or more information processing devices that have an input operation function and process arbitrary information;
A display device that displays video based on at least information transferred from the information processing device;
An information processing support device that supports network information processing including display processing in the display device based on an input operation instruction from the information processing device;
Communication means for connecting the information processing support device and the information processing device;
A video / audio input device for inputting video and audio other than information transferred from the information processing device;
An information creation device that records information transferred from the information processing device and the video / audio input device in accordance with an instruction from the information processing device and reorganizes the information as content that can be communicated via a network; ,
This information creation device
Information recording means for recording moving image / audio information from the moving image / audio input device and still image information from a plurality of display devices,
Reproduction management list creation means for listing attribute information for a plurality of input still image information;
Organizing means for reorganizing the video / audio information and the still image information while selecting a display pattern capable of simultaneously displaying the plurality of still image information on a display screen based on the attribute information from the reproduction management list creating means; ,
A network information processing system comprising control means for controlling the plurality of means. 14. The network information processing system according to claim 13, wherein the communication means is a wired system or a wireless system. 14. The network information processing system according to claim 13, wherein the information processing support device and the information creation device are connected to a network. On the display screen of the information processing device, the moving image / audio information from the moving image / audio input device reproduced by the information creating device and the still image information displayed on the display device are transferred and displayed simultaneously. The network information processing system according to claim 13, characterized in that: 14. The network information processing system according to claim 13, wherein when there are a plurality of display devices, the still image information is simultaneously displayed on the display screen according to a divided display pattern corresponding to the number of display devices. When the information processing apparatus gives an instruction to enlarge and display the still image information, a maximum display pattern used when displaying the still image information using one display device is selected as the display pattern. The network information processing system according to claim 13. 19. The network information processing system according to claim 18, wherein when the still image information is updated while the still image information is enlarged, the updated still image information is displayed in an enlarged manner.

Images