JP2021039617A - Information processing system, information processing device, image display method, and program - Google Patents

Abstract

To provide an information processing system by which a user easily specifies a desired meeting.SOLUTION: An information processing system 100 is configured such that in a meeting in which screens displayed by one communication terminal 2 are shared with another communication terminal 2 via an information processing device 6, the information processing device accumulates captured images in which screens are captured. The information processing device has an image determination unit 71 determining a representative captured image that is representative of one or more captured images for each meeting based on a predetermined selection criterion. The communication terminal has a display control unit 24 displaying a list of meetings in which the representative captured image determined by the image determination unit is mapped to at least one or more meetings.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing system, an information processing device, an image display method, and a program.

A conference system is known in which communication terminals communicating via a network share a screen to hold a conference or the like. In the conference system, the captured image captured (captured) by the user can be saved. The user can also record a memo or the like in the captured image.

The user can refer to the captured image or memo later (see, for example, Patent Document 1). Patent Document 1 describes a system in which a communication terminal can display a personal memo of the meeting, a video of the meeting site, and a board at the time of the meeting when the user specifies the meeting.

However, the conventional technique has a problem that it may take time and effort for the user to identify a desired conference. For example, when a communication terminal displays a conference list screen and a user searches for a conference for which he or she wants to see notes or materials from the list screen, it is difficult to remember the contents of the conference only from bibliographic information such as the conference name and holding time. In some cases. If you cannot remember the contents of the meeting only from the bibliographic information of the meeting, you need to open the captured images and memos of the meeting one by one, and it takes time to search for the materials and memos of the meeting.

In view of the above problems, an object of the present invention is to provide an information processing system that makes it easy for a user to identify a desired conference.

In view of the above problems, in the present invention, at a meeting in which a screen displayed by one communication terminal is shared with another communication terminal via an information processing device, the information processing device accumulates captured images captured by the screen. Information processing system
The information processing device has an image determination unit that determines a representative captured image representing one or more captured images for each meeting based on a preset selection criterion.
The communication terminal is characterized by having a display control unit that displays a list of meetings in which the representative captured image determined by the image determination unit is associated with at least one or more meetings.

It is possible to provide an information processing system that makes it easy for the user to identify a desired meeting.

It is a figure which shows the display example of the personal portal screen of this embodiment. It is an overall overview diagram of an information processing system during a meeting. It is a figure of an example explaining the outline of the personal portal in an information processing system. It is a hardware block diagram of an example of the computer which concerns on this embodiment. It is a hardware block diagram of an example of the smartphone which concerns on this embodiment. It is a hardware block diagram of an example of the projector which concerns on this embodiment. It is a hardware block diagram of an example of IWB which concerns on this embodiment. It is a functional block diagram of each terminal and a server constituting an information processing system. It is an image diagram of an example of a personal board screen before the display of the projection screen and the first screen capture are performed. It is an image diagram of an example of a personal board screen on which a projection screen is displayed. It is an image diagram of an example of a personal board screen in which the first screen capture was performed. It is a block diagram of an example of a personal memo management DB. It is a block diagram of an example of a shared memo management DB. It is a block diagram of an example of a personal memo DB. It is a block diagram of an example of a shared memo DB. It is a block diagram of an example of interest degree management DB. It is a block diagram of an example of a personal setting DB. It is a figure which shows an example of the selection criterion setting screen displayed by a personal terminal. It is an example flowchart which showed the processing of the information processing system which concerns on this embodiment. It is a sequence diagram of an example of the process from the meeting preparation to the display of the projection screen on the personal board screen. It is an image diagram of an example of a screen for selecting a target to be screen-transmitted to a shared screen. It is a sequence diagram of an example of the process of capturing the captured image of the projection screen and making a memo in the captured image and the text memo area. It is a sequence diagram of an example of a process in which a user leaves a conference being held and the conference ends. It is a figure which shows an example of a meeting data. It is an example of the figure explaining the selection of the image captured first or the image with the largest amount of writing. It is an example of a diagram illustrating the selection of captured images to the largest number of participants. This is an example of a flowchart showing a procedure in which the image determination unit determines a representative captured image of each user. It is a sequence diagram of an example of a process in which a participant looks back on a memo of a meeting from a personal terminal. It is a figure which shows another display example of a personal portal screen.

Hereinafter, the information processing system and the image display method performed by the information processing system will be described as an example of the embodiment for carrying out the present invention.

In this embodiment, an information system used for a meeting as an example of a meeting, and an example of an information system that can use a shared screen and a personal board will be described, but the present invention is not limited to this, and seminars, classes, etc. It can be applied to various information processing systems used for. Further, in the present embodiment, an example of a conference in which a plurality of users are mainly in the same conference room is described, but not all the users are in the same room and the users are physically separated from each other. It may be present at a distance.

<Display example of personal portal screen (meeting list screen)>
FIG. 1 is a diagram showing a display example of the personal portal screen of the present embodiment. The personal portal screen 5000 is a screen that displays a list of meetings that the user has participated in in the past, and the date and time of the meeting, the meeting name, the place, the personal board, the shared board, the self-evaluation, and the bibliographic information are displayed for each meeting. Is displayed. Details of the personal portal screen will be described later.

In the present embodiment, at least one of the personal memo button 5030 and the shared memo button 5040 displays a thumbnail of the captured image generated by the user performing a capture operation during the meeting (during the meeting). A thumbnail is a reduced image of the original image. The captured image displayed as a thumbnail is a representative captured image selected by the selection criteria set by the user. The selection criteria are, for example, the first captured image captured at the conference, the most written captured image, or the captured image captured by the largest number of participants.

It is difficult for the user to remember the contents of the meeting only from the meeting name, holding time, etc. Furthermore, even if the contents of the meeting cannot be remembered from the bibliographic information of the meeting, the representative captured image is displayed, so the user aims. It will be easier to identify the meeting. Therefore, it is not necessary to open individual boards (memo) one by one, and it is possible to reduce the time and effort required to identify a desired meeting.

Although the representative captured image is displayed in each conference in FIG. 1, it is sufficient that the representative captured image is displayed in at least one conference. If there may be a meeting in which the processing of this embodiment has not been performed, the representative captured image is not displayed.

<Terminology>
Capturing a screen means saving the image displayed on the screen as data. In addition, it is said to capture the capture. The captured image is called a captured image or a captured image. The operation for capturing is called a capture operation or a capture operation. The representative captured image is an example of the representative captured image.

A meeting that shares a screen may be in the same situation as a meeting that is realized by sharing the same screen on a communication terminal or the like. There are various types of meetings such as meetings, meetings, study sessions, classes, seminars, and presentations. "Every meeting" is an example of "every meeting".

The representative captured image may be a captured image selected from the captured images by some selection criteria. It does not matter whether the content represents the meeting or not.

<Overview of the information processing system during the meeting>
First, the overall outline of the information processing system 100 during the meeting will be described with reference to FIG. FIG. 2 is an overall schematic view of an example of an information processing system during a meeting. Here, a state is shown in which users A, B, and C in the meeting room X of the company are holding a meeting using the information processing system. In the conference room X, the user A brings the personal terminal 2a, the user B brings the personal terminal 2b, and the user C brings the personal terminal 2c. In the following, when the generic name of the personal terminals 2a, 2b, and 2c is shown, it is described as "personal terminal 2". Further, an example in which user A is a presenter and users B and C are listeners will be described below.

The personal terminal 2 is a computer that can be used individually (dedicatedly) and viewed (referenced) by each user (an example of an information processing device within the scope of claims). The personal terminal 2 is, for example, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a smartphone, a tablet terminal, a wearable PC, or the like. The personal terminal 2 is an example of a communication terminal (or information processing terminal).

The personal terminal 2 can communicate with the content management server 6 via a communication network 9 such as the Internet. The communication network 9 may be one or more LANs (Local Area Network) inside the firewall, or may include the Internet outside the firewall in addition to the LAN. In addition, VPN (Virtual Private Network) and wide area Ethernet (registered trademark) may be included. The communication network 9 may be constructed either by wire or wirelessly, and may be a combination of wired and wireless. When the communication network 9 is connected by a mobile phone network such as 3G, LTE (Long Term Evolution), or 4G, there is no need for a LAN.

The content management server 6 is a computer having a function as a web (Web) server (or HTTP server) that stores and manages content data to be transmitted to the personal terminal 2 (information processing within the scope of patent claims). An example of a device or a second information processing device). The content management server 6 includes a storage unit 6000, which will be described later. The content management server 6 transmits the screen received from one personal terminal 2 to the other personal terminal 2.

A storage position (or storage area) for realizing personal boards dc1 to dc3 that can be accessed only from each personal terminal 2 is constructed in the storage unit 6000. Only personal terminals 2a, 2b, and 2c can access the personal boards dc1, dc2, and dc3, respectively. In the following, when the general term of the personal board dc1, dc2, dc3 is shown, it is referred to as "personal board dc". The content management server 6 may support cloud computing. Cloud computing refers to a usage pattern in which resources on a network are used without being aware of specific hardware resources. Further, the storage unit 6000 of the content management server 6 has a storage position (or storage area) for realizing the shared screen ss described later.

The personal board dc is a virtual space created in the storage position (or storage area) of the storage unit 6000 of the content management server 6. The personal board dc can be accessed by, for example, a web application having a function of viewing and editing contents by using a Canvas element and JavaScript (registered trademark) or the like.

A web application operates by coordinating a program in a script language (for example, JavaScript (registered trademark)) that operates on a web browser application (hereinafter referred to as a web browser) and a program on the web server side, and operates on the web browser. Indicates the software used in or its mechanism. The personal board dc has a finite or infinite area within the storage area of the storage unit 6000. For example, the personal board dc may be finite or infinite in both the vertical and horizontal directions, or may be finite or infinite in either the vertical and horizontal directions.

Further, the shared screen ss is a virtual space created in the storage position (or storage area) of the storage unit 6000 of the content management server 6. This shared screen ss has a function of holding the data of the content uploaded by streaming from the personal terminal 2a of the user A who is the presenter until the data of the next content is acquired. The shared screen ss is, for example, a computer screen such as an application screen, and is a target for capturing a captured image as described later.

Further, the personal board dc is an electronic space dedicated to each individual of the users participating in the conference. Each user's personal terminal 2 can access only the personal board dc dedicated to each user, and can view and edit (input, delete, copy, etc.) contents such as characters and images.

The content management server 6 manages information such as contents developed on the shared screen ss and the personal board dc in association with each virtual conference room (hereinafter, simply referred to as a room) which is an example of a virtual room. .. As a result, even if the content management server 6 manages a plurality of rooms, the content data is not communicated between the different rooms.

Since each personal terminal 2 can access the contents of the personal board dc and the shared screen ss of the room in which the user participates by the web application of the installed web browser, it is possible to hold a conference close to the actual conference room. ..

With such an information processing system, the presenter user A uses the captured image of the content uploaded to the shared screen ss as personal material as the personal material of the listeners B and C's personal board dc. Can be incorporated into.

The system configuration of FIG. 2 is an example of a case where personal terminals 2a to 2c exist in the conference room X. However, one or more personal terminals 2a to 2c may be connected to a telephone communication network (3G, LTE, 4G, 5G, etc.). Further, a permanent terminal described later may be arranged in the conference room X.

<Overview of personal portal in information processing system>
Next, the outline of the personal portal will be described with reference to FIG. FIG. 3 is an example diagram illustrating an outline of a personal portal in an information processing system. The content management server 6 generates data of the personal portal screens dp1, dp2, dp3 dedicated to each personal terminal 2 and displays them on each personal terminal 2. In the following, when the general term of the personal portal screen dp1, dp2, dp3 is shown, it is described as "personal portal screen dp".

The content management server 6 stores the shared memo cm, which is the content edited during the meeting on the shared screen ss of FIG. 3, and the personal memo dm1, dm2, dm3, which is the content edited on the personal board dc. Be managed. In the following, when the generic name of the personal memo dm1, dm2, dm3 is shown, it is described as "personal memo dm". By accessing the dedicated personal portal screen dp of each personal terminal 2, each user can display a list of conferences in which the user who operates the personal terminal 2 participates.

The user can display the shared memo cm, the personal memo dm, and the bibliographic information of the conference of each conference from the list of conferences displayed on the personal portal screen dp as described later. Therefore, the user can easily display the desired shared memo cm, personal memo dm, and bibliographic information of the conference when looking back on the contents of the conference. In addition, each user accesses the dedicated personal portal screen dp of each personal terminal 2, and from the list of meetings of the user who operates the personal terminal 2, the desired meeting can be referred to as a keyword (character) as described later. You can search. As the search target of the character search, bibliographic information of the conference, text data and handwritten characters included in the personal memo dm, evaluation of the conference by the user, and the like are used. The bibliographic information of the conference is included in the conference information.

<Hardware configuration>
<< Computer >>
The content management server 6 is realized by, for example, the computer 500 having the hardware configuration shown in FIG. Further, when the personal terminal 2 is a PC which is an example of an information processing terminal, it is realized by, for example, the computer 500 having the hardware configuration shown in FIG.

FIG. 4 is a hardware configuration diagram of an example of the computer 500 according to the present embodiment. As shown in FIG. 4, the computer 500 includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, an HD504, an HDD (Hard Disk Drive) controller 505, and a display 506. , External device connection I / F (Interface) 508, Network I / F 509, Data bus 510, Keyboard 511, Pointing device 512, DVD-RW (Digital Versatile Disk Rewritable) drive 514, Media I / F 516.

Of these, the CPU 501 controls the operation of the entire computer 500. The ROM 502 stores a program used to drive the CPU 501 such as an IPL. The RAM 503 is used as a work area of the CPU 501. The HD504 stores various data such as programs. The HDD controller 505 controls reading or writing of various data to the HD 504 according to the control of the CPU 501.

The display 506 displays various information such as a cursor, a menu, a window, a character, or an image. The external device connection I / F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I / F 509 is an interface for performing data communication using the communication network 9. The data bus 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501.

The keyboard 511 is a kind of input means including a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The DVD-RW drive 514 controls reading or writing of various data to the DVD-RW 513 as an example of the removable recording medium. In addition, it is not limited to DVD-RW, and may be DVD-R or the like. The media I / F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

<< Smartphone >>
The personal terminal 2, which is an example of the information processing terminal, may be realized by, for example, the smartphone 600 having the hardware configuration shown in FIG.

FIG. 5 is a hardware configuration diagram of an example of the smartphone 600 according to the present embodiment. As shown in FIG. 5, the smartphone 600 includes a CPU 601, ROM 602, RAM 603, EEPROM 604, CMOS sensor 605, image sensor I / F 606, acceleration / orientation sensor 607, media I / F 609, and GPS receiver 611. There is.

Of these, the CPU 601 controls the operation of the entire smartphone 600. The ROM 602 stores a program used to drive the CPU 601 such as the CPU 601 and the IPL. The RAM 603 is used as a work area of the CPU 601. The EEPROM 604 reads or writes various data such as a smartphone program under the control of the CPU 601.

The CMOS (Complementary Metal Oxide Semiconductor) sensor 605 is a kind of built-in photographing means for acquiring image data by photographing a subject (mainly a self-portrait) under the control of the CPU 601. Instead of the CMOS sensor 605, a photographing means such as a CCD (Charge Coupled Device) sensor may be used. The image sensor I / F 606 is a circuit that controls the drive of the CMOS sensor 605. The acceleration / orientation sensor 607 is a variety of sensors such as an electronic magnetic compass, a gyro compass, and an acceleration sensor that detect the geomagnetism.

The media I / F 609 controls reading or writing (storage) of data to a recording medium 608 such as a flash memory. The GPS receiving unit 611 receives GPS signals from GPS satellites.

Further, the smartphone 600 includes a long-distance communication circuit 612, a CMOS sensor 613, an image sensor I / F 614, a microphone 615, a speaker 616, a sound input / output I / F 617, a display 618, an external device connection I / F 618, and a short-range communication circuit 620. , The antenna 620a of the short-range communication circuit 620, and the touch panel 621 are provided.

Of these, the long-distance communication circuit 612 is a circuit that communicates with other devices via the communication network 9. The CMOS sensor 613 is a kind of built-in photographing means for photographing a subject and obtaining image data under the control of the CPU 601. The image sensor I / F 614 is a circuit that controls the drive of the CMOS sensor 613. The microphone 615 is a built-in circuit that converts sound into an electrical signal. The speaker 616 is a built-in circuit that converts an electric signal into physical vibration to produce sounds such as music and voice.

The sound input / output I / F 617 is a circuit that processes sound signal input / output between the microphone 615 and the speaker 616 under the control of the CPU 601. The display 618 is a kind of display means such as a liquid crystal or an organic EL (Electro Luminescence) for displaying an image of a subject, various icons, and the like.

The external device connection I / F619 is an interface for connecting various external devices. The short-range communication circuit 620 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 621 is a kind of input means for operating the smartphone 600 by the user pressing the display 618.

In addition, the smartphone 600 is provided with a bus line 610. The bus line 610 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 601 shown in FIG.

<< Projector >>
The projector 700, which is an example of a permanent terminal, may be realized by, for example, the hardware configuration shown in FIG.

FIG. 6 is a hardware configuration diagram of an example of the projector 700 according to the present embodiment. As shown in FIG. 6, the projector 700 includes a CPU 701, a ROM 702, a RAM 703, a media I / F 707, an operation unit 708, a power switch 709, a bus line 710, a network I / F 711, an LED (Light Emitting Diode) drive circuit 714, and an LED. It includes a light source 715, a projection device 716, a projection lens 717, an external device connection I / F718, a fan drive circuit 719, and a cooling fan 720.

Of these, the CPU 701 controls the operation of the entire projector 700. The ROM 702 stores a program used to drive the CPU 701. The RAM 703 is used as a work area for the CPU 701. The media I / F 707 controls reading or writing (storage) of data to a recording medium 706 such as a flash memory.

The operation unit 708 is provided with various keys, buttons, LEDs, and the like, and is used for performing various operations other than turning on / off the power of the projector 700 by the user. For example, the operation unit 708 receives instructional operations such as a projected image size adjustment operation, a color tone adjustment operation, a focus adjustment operation, and a keystone adjustment operation, and outputs the received operation contents to the CPU 701.

The power switch 709 is a switch for switching ON / OFF of the power supply of the projector 700. The bus line 710 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 701 shown in FIG. The network I / F711 is an interface for data communication using a communication network 9 such as the Internet.

The LED drive circuit 714 controls the lighting and extinguishing of the LED light source 715 under the control of the CPU 701. When the LED light source 715 is turned on under the control of the LED drive circuit 714, the LED light source 715 irradiates the projection device 716 with the projected light. The projection device 716 transmits the modulated light obtained by modulating the projected light from the LED light source 715 by the spatial light modulation method based on the image data given via the external device connection I / F718 or the like through the projection lens 717. , Project as an image on the projection surface of the screen. As the projection device 716, for example, a liquid crystal panel or a DMD (Digital Micro mirror Device) or the like is used.

The LED drive circuit 714, the LED light source 715, the projection device 716, and the projection lens 717 function as a projection unit (projection means) for projecting a projected image on the projection surface based on the image data as a whole.

The external device connection I / F718 is directly connected to a PC (Personal Computer) and acquires control signals and image data from the PC. Further, the external device connection I / F718 is an interface for connecting various external devices (stick PC730, etc.). The fan drive circuit 719 is connected to the CPU 701 and the cooling fan 720, and drives / stops the cooling fan 720 based on the control signal from the CPU 701. The cooling fan 720 rotates to exhaust the air inside the projector 700 and cool the inside of the projector 700.

Further, when the power supply power is supplied, the CPU 701 is activated according to the control program stored in advance in the ROM 702, gives a control signal to the LED drive circuit 714 to light the LED light source 715, and causes the fan drive circuit 719 to light up. A control signal is given to rotate the cooling fan 720 at a predetermined rated rotation speed. Further, when the power supply power from the power supply circuit is started to be supplied to the projector 700, the projection device 716 is in a state where the image can be displayed, and power is further supplied from the power supply circuit to various other components. Further, when the power switch 709 of the projector 700 is turned off, a power OFF signal is sent from the power switch 709 to the CPU 701.

When the CPU 701 detects the power OFF signal, it gives a control signal to the LED drive circuit 714 to turn off the LED light source 715. After that, when a predetermined time elapses, the CPU 701 gives a control signal to the fan drive circuit 719 to stop the cooling fan 720, terminates its own control process, and finally gives an instruction to the power supply circuit to supply power. Stop the supply of.

<< IWB >>
The IWB 800, which is an example of a permanent terminal, may be realized by, for example, the hardware configuration shown in FIG.

FIG. 7 is a hardware configuration diagram of an example of the IWB 800 according to the present embodiment. As shown in FIG. 7, the IWB 800 includes a CPU 801 and a ROM 802, a RAM 803, an SSD (Solid State Drive) 804, a network I / F805, and an external device connection I / F806.

Of these, the CPU 801 controls the operation of the entire IWB 800. The ROM 802 stores a program used to drive the CPU 801 such as the CPU 801 and the IPL. The RAM 803 is used as a work area of the CPU 801. The SSD 804 stores various data such as a program for IWB. The network I / F805 controls communication with the communication network 9. The external device connection I / F806 is an interface for connecting various external devices. The external device in this case is, for example, a USB memory 830, an external device (microphone 840, speaker 850, camera 860).

Further, the IWB 800 includes a capture device 811, a GPU 812, a display controller 813, a contact sensor 814, a sensor controller 815, an electronic pen controller 816, a short-range communication circuit 819, and an antenna 819a, a power switch 822, and a selection switch of the short-range communication circuit 819. It has a class 823.

Of these, the capture device 811 causes the display of the external PC 870 to display the video information as a still image or a moving image. The GPU (Graphics Processing Unit) 812 is a semiconductor chip that specializes in graphics. The display controller 813 controls and manages the screen display in order to output the output image from the GPU 812 to the display 880 or the like.

The contact sensor 814 detects that the electronic pen 890, the user's hand H, or the like has come into contact with the display 880. The sensor controller 815 controls the processing of the contact sensor 814. The contact sensor 814 inputs and detects the coordinates by the infrared blocking method. In this method of inputting coordinates and detecting coordinates, two light receiving and emitting devices installed at both upper ends of the display 880 radiate a plurality of infrared rays in parallel with the display 880 and are provided around the display 880. This is a method of receiving light that is reflected by a reflecting member and returns on the same optical path as the light path emitted by the light receiving element.

The contact sensor 814 outputs an infrared ID emitted by two light emitting / receiving devices blocked by the object to the sensor controller 815, and the sensor controller 815 specifies a coordinate position which is a contact position of the object. The electronic pen controller 816 determines whether or not there is a touch of the pen tip or a touch of the pen tail on the display 880 by communicating with the electronic pen 890. The short-range communication circuit 819 is a communication circuit such as NFC or Bluetooth (registered trademark). The power switch 822 is a switch for switching ON / OFF of the power supply of the IWB 800. The selection switches 823 are, for example, a group of switches for adjusting the brightness and color tone of the display of the display 880.

In addition, the IWB 800 is equipped with a bus line 810. The bus line 810 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 801 shown in FIG. 7.

The contact sensor 814 is not limited to the infrared blocking method, but is a capacitive touch panel that specifies the contact position by detecting a change in capacitance, and the contact position is specified by a voltage change between two opposing resistance films. Various detection means such as a resistance film type touch panel and an electromagnetic induction type touch panel that detects the electromagnetic induction generated when a contact object comes into contact with the display unit and specifies the contact position may be used. Further, the electronic pen controller 816 may determine whether or not there is a touch not only on the pen tip and pen end of the electronic pen 890, but also on the portion gripped by the user of the electronic pen 890 and other electronic pen portions. ..

<Functional configuration>
The functional configuration of each terminal and server constituting the information processing system will be described with reference to FIG. FIG. 8 is a functional block diagram of each terminal and server constituting the information processing system.

<< Functional configuration of personal terminal >>
First, the functional configuration of the personal terminal 2a will be described. As shown in FIG. 8, the personal terminal 2a includes a transmission / reception unit 21a, a reception unit 22a, an image processing unit 23a, a display control unit 24a, a determination unit 25a, a storage / reading processing unit 29a, and a communication management unit 30a. Have. Each of these parts is a function realized or a means for functioning by operating any of the components shown in FIG. 5 by an instruction from the CPU 601 according to a program developed from the EEPROM 604 to the RAM 603. is there. Further, the personal terminal 2a has a storage unit 2000a constructed by the RAM 603 and the EEPROM 604 shown in FIG.

The transmission / reception unit 21a, the reception unit 22a, the image processing unit 23a, the display control unit 24a, the judgment unit 25a, and the storage / reading processing unit 29a are realized by a web browser (web application) that displays a personal board screen described later. Will be done. The communication management unit 30a is realized by a dedicated communication application.

(Each function configuration)
Next, each functional configuration of the personal terminal 2a will be described in detail. The transmission / reception unit 21a transmits / receives various data (or information) to / from another terminal, device, server, or the like via the communication network 9. For example, the transmission / reception unit 21a receives content data described in HTML, CSS (Cascade Style Sheet), and JavaScript (registered trademark) from the content management server 6. Further, the transmission / reception unit 21a transmits the operation information input by the user to the content management server 6.

The reception unit 22a receives various inputs from the touch panel 621 by the user. The image processing unit 23a performs processing such as creating vector data (or stroke data) according to the drawing of the user, for example. Further, the image processing unit 23a has a function as a capture unit, and captures a captured image by, for example, photographing a shared screen ss.

The display control unit 24a causes the display 618 to display the personal board screen and the shared screen ss, which will be described later. The determination unit 25a makes various determinations. The storage / reading processing unit 29a is executed by an instruction from the CPU 601 and the EEPROM 604 to perform a process of storing various data in the storage unit 2000a and reading various data from the storage unit 2000a.

The communication management unit 30a is mainly realized by an instruction from the CPU 601 shown in FIG. 5, and inputs / outputs data to / from the transmission / reception unit 21a and the like. The communication management unit 30a further includes a transmission / reception unit 31a, an acquisition unit 33a, and a determination unit 35a.

Of these, the transmission / reception unit 31a transmits / receives various data (or information) to and from the content management server 6 via the communication network 9 independently of the transmission / reception unit 21a. The capturing unit 33a basically has the same function as the function as the capturing unit of the image processing unit 23a. For example, the capture unit 33a captures the captured image by performing a screen capture of the shared screen ss described later. The determination unit 35a makes various determinations, and determines, for example, whether or not the captured image is referenced by the user. Since the functional configurations of the personal terminals 2b and 2c are the same as the functional configurations of the personal terminal 2a, the description thereof will be omitted.

<< Functional configuration of permanent terminal 4 >>
Subsequently, the functional configuration of the permanent terminal 4 will be described. As shown in FIG. 8, the permanent terminal 4 includes a transmission / reception unit 41, a reception unit 42, an image processing unit 43, a display control unit 44, a determination unit 45, a storage / reading processing unit 49, and a communication management unit 50. Have. Each of these parts has a function or a function realized by operating any of the components shown in FIG. 6 or the like by an instruction from the CPU 701 according to a program developed on the RAM 703 from the recording medium 706. It is a means to do.

Each part is a function realized by operating any of the components shown in FIG. 6 by a command from the CPU of the stick PC 730 according to a program developed on the RAM of the stick PC 730. , Or it may be a functioning means. Further, the permanent terminal 4 has a storage unit 4000 constructed by the RAM 703 shown in FIG. 6 and the like. A shared memo DB 4002 is constructed in the storage unit 4000 of the permanent terminal 4.

In the permanent terminal 4, the transmission / reception unit 41, the reception unit 42, the image processing unit 43, the display control unit 44, the judgment unit 45, the storage / reading processing unit 49, the communication management unit 50, and the storage unit 4000 are individuals. Since it is the same as the transmission / reception unit 21a, the reception unit 22a, the image processing unit 23a, the display control unit 24a, the judgment unit 25a, the storage / reading processing unit 29a, the communication management unit 30, and the storage unit 2000a in the terminal 2a, the description is omitted. To do. Further, the communication management unit 50 in the permanent terminal 4 has a transmission / reception unit 51, an acquisition unit 53, and a determination unit 55, which are the same as the transmission / reception unit 31a, the acquisition unit 33a, and the determination unit 35a, respectively. Since it is a function, the description thereof will be omitted.

The transmission / reception unit 41, the reception unit 42, the image processing unit 43, the display control unit 44, the determination unit 45, and the storage / reading processing unit 49 are realized by a web browser (web application) that displays the shared screen ss. .. The communication management unit 50 is realized by a dedicated communication application.

<< Functional configuration of content management server >>
Subsequently, the functional configuration of the content management server 6 will be described. As shown in FIG. 8, the content management server 6 includes a transmission / reception unit 61, a schedule interlocking unit 62, an image processing unit 63, a creation unit 64, a judgment unit 65, a web page creation unit 66, a search unit 67, and an authentication unit. It has 68, an image determination unit 71, and a storage / reading processing unit 69. Each of these parts is a function realized by operating any of the components shown in FIG. 4 by an instruction from the CPU 501 according to a program developed on the RAM 503 from the HD 504, or a means for the function. is there. Further, the content management server 6 has a storage unit 6000 constructed by the RAM 503 and the HD 504 shown in FIG.

(Each function configuration)
Next, each functional configuration of the content management server 6 will be described in detail. The transmission / reception unit 61 transmits / receives various data (or information) to / from another terminal, device, server, or the like via the communication network 9. The schedule interlocking unit 62 acquires schedule information including bibliographic information of a meeting in which a user participates from a schedule management server 8 connected to a communication network 9 so as to be able to send and receive various data (or information). The schedule management server 8 stores schedule information (meeting (list) information) for each user (for each user ID).

The image processing unit 63 has a function as a capture unit, and captures the captured image by performing screen capture of the shared screen ss described later. The creation unit 64 creates a unique content ID, personal memo ID, shared memo ID, and the like. The determination unit 65 determines whether or not the content ID, personal memo ID, shared memo ID, and the like have been received by the transmission / reception unit 61.

The web page creation unit 66 creates web page data to be displayed on the web browsers of the personal terminal 2 and the permanent terminal 4. The search unit 67 receives a search request from the personal portal screen described later displayed on the web browsers of the personal terminal 2 and the permanent terminal 4, and performs a search according to the search request. In addition, the authentication unit 68 performs user authentication processing. The authentication unit 68 may be other than the content management server 6, and may use, for example, an authentication server connected to the communication network 9. The image determination unit 71 determines the representative captured image from the personal memo or the shared memo.

The storage / reading processing unit 69 is executed by commands from the CPU 501, the HDD controller 505, the media I / F516, and the DVD-RW drive 514, and stores various data in the storage unit 6000, the DVD-RW513, and the recording media 515. It also performs processing such as reading various data from the storage unit 6000, the DVD-RW 513, and the recording medium 515.

Further, in the storage unit 6000 of the content management server 6, a personal memo DB 6001, a shared memo DB 6002, an interest level management DB 6003, a personal memo management DB 6004, a shared memo management DB 6005, and a personal setting DB 6006 are constructed.

Note that these data may be stored in another server other than the content management server 6. In that case, the timing of data acquisition / transmission may be acquired from another server each time the personal terminal 2 requests data acquisition / transmission, or the user can refer to the meeting, the personal board, or the shared screen ss. During this period, the data may be stored in the content management server 6, deleted from the content management server 6 after the end of the conference or reference (or after a certain period of time), and sent to another server.

The device group described in the present embodiment is merely one of a plurality of computing environments for implementing the embodiment disclosed in the present specification. In certain embodiments, the content management server 6 includes a plurality of computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including networks, shared memory, and the like, and perform the processes disclosed herein. Similarly, the personal terminal 2 and the permanent terminal 4 can include a plurality of computing devices configured to communicate with each other.

Further, the content management server 6, the personal terminal 2, and the permanent terminal 4 can be configured to share the disclosed processing steps, for example, FIG. 20, in various combinations. For example, a part of the process executed by the content management server 6 can be executed by the personal terminal 2 and the permanent terminal 4. Further, each element of the content management server 6, the personal terminal 2, and the permanent terminal 4 may be integrated into one device, or may be divided into a plurality of devices.

<Display example of personal board screen>
A display example of the personal board screen 1000 until the end of the conference will be described with reference to FIGS. 9 to 11. The personal board screen 1000 is a screen for displaying information to be presented to the user by GUI (Graphical User Interface) and accepting operations from the user, and is a display form of a web browser or application software. ..

As shown in FIGS. 9 to 11, the personal board screen 1000 until the end of the conference has a projection area for displaying the projection screen on the left side and a memo area on the right side. The shared screen ss is displayed as a projection screen in the projection area. In the memo area, each combination of the captured image 1022 of the projection screen and the text memo area 1024 accompanying the captured image 1022 is displayed on the sheet 1020.

By pressing the capture button 1016, the user takes a picture of the projection screen displayed in the projection area, and puts the sheet 1020 on which the set of the captured image 1022 and the text memo area 1024 is displayed in the memo area. Can be additionally displayed in. The operation of pressing the capture button 1016 is an example, and may be, for example, an operation of pressing a shortcut key from the keyboard or a gesture operation from the touch panel.

FIG. 9 is an image diagram of an example of the personal board screen 1000 before the projection screen is displayed and the first screen capture is performed. For example, on the personal board screen 1000 of FIG. 9, a guidance message "display the projection screen here" is displayed in the projection area. Further, in the memo area of FIG. 9, a guidance message "The captured image is displayed" is displayed as the captured image 1022. By displaying such a guidance message, on the personal board screen of FIG. 9, the user can imagine the screen image after the screen capture is performed before the first screen capture is performed. The guidance message may not be displayed. Further, even before the first screen capture is performed, the input from the user to the text memo area 1024 may be accepted.

When content data such as stream data is transmitted to the shared screen ss, the personal board screen 1000 of FIG. 9 becomes the personal board screen 1000 as shown in FIG. FIG. 10 is an image diagram of an example of the personal board screen 1000 on which the projection screen 1040 is displayed. In the projection area of FIG. 10, a screen of contents such as stream data transmitted to the shared screen ss is displayed as a projection screen 1040.

When the personal board screen 1000 of FIG. 10 receives an operation of pressing the capture button 1016 from the user, the personal board screen 1000 of FIG. 11 becomes the personal board screen 1000 of FIG. FIG. 11 is an image diagram of an example of the personal board screen 1000 in which the first screen capture was performed.

By pressing the capture button 1016, the user can take a picture of the projection screen 1040 at that time and display the captured image 1022 of the projection screen 1040 in the memo area. In addition, the user can display the text memo area 1024 attached to the captured image 1022 in the memo area. The captured image 1022 and the text memo area 1024 attached to the captured image 1022 are displayed on, for example, one sheet 1020, so that the combination of the captured image 1022 and the text memo area 1024 is displayed in an easy-to-understand manner. .. When the user accepts the operation of pressing the capture button 1016, the projection screen 1040 at that time is compared with the captured image 1022 of the captured projection screen 1040 displayed in the memo area, and the same content is projected. The screen 1040 may not be captured.

In addition, the mouse cursor is set to the first line of the newly displayed text memo area 1024 by pressing the capture button 1016 of the user. Therefore, the user can easily shift from the operation of pressing the capture button 1016 to the text memo operation to the text memo area 1024. The text memo area 1024 extends downward finitely or infinitely according to the input of the text memo by the user.

An object can also be drawn on the captured image 1022 using a pen tool or the like. On the personal board screen 1000, a tool palette displaying a hand tool button 1002, a pen tool button 1004, a text tool button 1006, an Endo button 1008, a Redo button 1010, an HTML save button 1012, a PDF save button 1014, and a capture button 1016 is displayed. Has been done.

The hand tool button 1002 is a button for the user to start using the hand tool. By using the hand tool, the user can select the object drawn on the captured image 1022 and move it by dragging and dropping. The pen tool button 1004 is a button for the user to start using the pen tool. By using the pen tool, the user can select a color and a line thickness and draw an object on the captured image 1022.

The text tool button 1006 is a button for the user to start using the text tool. By using the text tool, the user can generate a text area on the captured image 1022 and input text. The Undo button 1008 is a button for undoing the work done. The Redo button 1010 is a button for advancing the work returned by the Endo button 1008.

The HTML save button 1012 is a button for locally saving the information of the personal board screen 1000 as an HTML file. The PDF save button 1014 is a button for locally saving the captured image 1022 and the text memo area 1024 displayed in the memo area of the personal board screen 1000 as a PDF file. The capture button 1016 is a button for photographing the projection screen 1040 displayed in the projection area and additionally displaying the sheet 1020 in which the set of the captured image 1022 and the text memo area 1024 is displayed in the memo area.

<DB configuration>
<< Personal memo management DB >>
FIG. 12 is a configuration diagram of an example of the personal memo management DB 6004. A personal memo management DB 6004 as shown in FIG. 12 is constructed in the storage unit 6000 of the content management server 6. The personal memo management DB 6004 of FIG. 12 stores and manages the personal memo ID, the user ID, the room ID, the sheet ID, the captured image, and the representative captured image in association with each other.

The item "personal memo ID" is an example of personal memo identification information that identifies the personal memo dm of the personal board dc. The item "user ID" is an example of user identification information that identifies a user. The item "room ID" is an example of room identification information that identifies a room (even if the conference is in the same conference room, the ID of the conference is different for each conference). The item "sheet ID" is an example of sheet identification information that identifies the sheets 1020 and 1120. The item “captured image” is an example of image file identification information that identifies an image file in which the projection screen 1040 is captured.

The item "representative captured image" is a representative captured image determined based on the selection criteria for each user among the captured images generated by the user as a personal memo at a certain meeting. One representative captured image is determined for each user per conference (room). For example, since User-a's first captured "capture-A1.jpg" is the representative captured image, this thumbnail "capture-A1-sum.jpg" is registered. The number of representative captured images does not have to be one, and a plurality of representative captured images may be determined as selection criteria. By doing so, even if the user changes the selection criteria, the content management server 6 does not need to reselect the representative captured image.

If the user ID of the user who operates the personal terminal 2 is specified by the personal memo management DB 6004 of FIG. 12, the room ID and personal memo ID of the room in which the user participates can be specified. Further, the personal memo management DB 6004 of FIG. 12 can identify, for example, the sheet 1020 displayed on the personal board screen 1000 and the image file of the captured image 1022 displayed on the sheet 1020, which are specified from the personal memo ID.

<< Shared memo management DB >>
FIG. 13 is a configuration diagram of an example of the shared memo management DB 6005. A shared memo management DB 6005 as shown in FIG. 13 is constructed in the storage unit 6000 of the content management server 6. The shared memo management DB 6005 of FIG. 13 manages the shared memo ID, the room ID, the bibliographic information of the meeting, and the representative captured image in association with each other.

The item "shared memo ID" is an example of shared memo identification information for specifying the shared memo cm on the shared screen ss. The item "room ID" is an example of room identification information that identifies a room. The item "meeting bibliographic information" is the bibliographic information of the meeting held in the room specified by the room ID. If the room ID is specified by the shared memo management DB 6005 of FIG. 13, the bibliographic information of the meeting can be specified. The item "representative captured image" is a representative captured image determined for each meeting among the captured images captured as a shared memo in a certain meeting. The number of representative captured images is determined by the number of selection criteria per conference (room). This is because the selection criteria may differ depending on the user, and the representative captured image is registered for each selection criterion. In FIG. 13, three representative captured images are registered. For one conference (room), only one representative captured image may be determined in common for all users. In this case, any user can view the same representative capture in the same conference.

<< Personal memo DB >>
FIG. 14 is a configuration diagram of an example of the personal memo DB 2001a. A personal memo DB 2001a as shown in FIG. 14 is constructed in the storage unit 2000a of the personal terminal 2a. Since the personal memo DB 2001a is created in the cache of the web browser, it exists only while the web browser is running.

The data managed by the personal memo DB 2001a is the same as the data for each personal terminal 2 managed by the personal memo DB 6001 in the content management server 6. The personal terminal 2a acquires the data for the personal terminal 2a out of the data of each personal terminal 2 managed by the content management server 6 and manages it in the personal memo DB 2001a.

The personal memo DB 2001a of FIG. 14 manages the personal memo ID, the sheet ID, the content ID, the content data, and the display position in association with each other. The item "personal memo ID" is an example of personal memo identification information that identifies the personal memo dm of the personal board dc. The item "sheet ID" is an example of sheet identification information that identifies the sheets 1020 and 1120. The item "content ID" is an example of content identification information that identifies each content such as a text memo or a drawn object input to the sheets 1020 and 1120.

The item "content data" is data such as text memos and drawn objects input to the sheets 1020 and 1120. For example, the content data of the content ID "c101" is a "text memo" whose type is input to the text memo area 1024 or the like, a font type is "Mincho", a size is "20", and the input text. An example is shown in which the character is "aiueo".

Further, the content data of the content ID "c103" is vector data whose type is drawn on the captured image 1022 or the like, and shows an example in which the vector data is represented by numerical data. In the case of text input to the captured image 1022 or the like by using the text tool, for example, by expressing the type of content data by "text" or the like, the text input to the captured image 1022 or the like and the text memo area 1024 It can be distinguished from the text memo entered in.

The item "display position" indicates the display position of the text memo or the drawn object input to the sheets 1020 and 1120. For example, the display position of the content input to the captured image 1022 or the like is represented by, for example, coordinates. Further, the display position of the text memo input in the text memo area 1024 or the like is represented by, for example, the number of lines and the number of characters.

Since the personal memo DB 6001 has the same data structure as the personal memo DB 2001a, the description thereof will be omitted. However, the personal memo DB 6001 has all the data of the personal memo DB 2001a, 2001b, 2001c.

<< Shared memo DB >>
FIG. 15 is a configuration diagram of an example of the shared memo DB 2002a. A shared memo DB 2002a as shown in FIG. 15 is constructed in the storage unit 2000a of the personal terminal 2a. Since the shared memo DB 2002a is created in the cache of the web browser, it exists only while the web browser is running. Since the shared memo DB 6002 has the same data structure as the shared memo DB 2002a, the description thereof will be omitted.

The data managed by the shared memo DB 2002a is the same as the data managed by the shared memo DB 6002 in the content management server 6. The personal terminal 2a acquires the data managed by the shared memo DB 6002 of the content management server 6 and manages it by the shared memo DB 2002a.

In the shared memo DB 2002a, a set of the content ID, the content data, and the display position of the content data is managed in association with the shared memo ID for specifying the shared memo on the shared screen ss.

The item "content ID" is an example of content identification information for identifying each content. The item "content data" is content data such as text input to the shared screen ss, pasted images, and vector data obtained by drawing. The item "display position" indicates the display position of the content on the shared screen ss.

<< Interest level management DB >>
FIG. 16 is a configuration diagram of an example of interest level management DB 6003. The interest level management DB 6003 as shown in FIG. 16 is constructed in the storage unit 6000 of the content management server 6. The interest level management DB 6003 of FIG. 16 manages DLs in association with each other by personal memo ID, number of captures of streaming, number of capture references, number of writes, and PDF.

The item "personal memo ID" is an example of personal memo identification information that identifies the personal memo dm of the personal board dc. The item "number of captures of streaming" is the number of times the user has taken the projection screen 1040 on the personal board screen 1000 of the room specified by the personal memo ID.

The item "capture reference count" is an example of the reference count of the total number of captures and the reference for each capture as an example of the reference count of the user referring to the sheet 1120 on the personal board screen 1100 of the room specified by the personal memo ID after the meeting. It represents the number of times and the reference time.

The number of references and the reference time for each capture are the number of times and the date and time for each sheet 1120 in which the user referred to the sheet 1120 on the personal board screen 1100 of the room specified by the personal memo ID. The number of references to the total number of captures is the total number of times for each sheet 1120 that the user referred to the sheet 1120.

The item "number of writes" is the number of writes written by the user on the sheet 1020 or 1120 on the personal board screen 1100 of the room specified by the personal memo ID. In the interest level management DB 6003 of FIG. 16, as an example of the number of writes, the total number of text characters for each personal memo, the number of text characters for each capture in the personal memo, the number of handwritten objects (lines, stamps, etc.), and the capture in the personal memo. It represents the number of handwritten objects for each and the number of handwritten characters for the capture.

The total number of text characters for each personal memo is the total number of text characters obtained by adding the number of text characters for each text memo area 1024 such as the sheet 1020. The number of text characters for each capture in the personal memo is the number of text characters for each text memo area 1024 such as the sheet 1020.

The number of handwritten objects (lines, stamps, etc.) is the total number of objects obtained by adding the number of handwritten objects for each captured image 1022 such as the sheet 1020. The number of handwritten objects for each capture in the personal memo is the number of handwritten objects for each captured image 1022 such as the sheet 1020. The number of handwritten characters for the capture is the total number of characters obtained by adding the number of handwritten characters for each captured image 1022 such as the sheet 1020.

The item "DL in PDF" indicates whether or not the captured image 1022 and the text memo area 1024 displayed in the memo area of the personal board screen 1000 are locally saved (downloaded) as a PDF file by the above-mentioned PDF save button 1014. Represents.

<< Personal setting DB >>
FIG. 17 is a configuration diagram of an example of the personal setting DB 6006. A personal setting DB 6006 as shown in FIG. 17 is constructed in the storage unit 6000 of the content management server 6. The personal setting DB 6006 of FIG. 17 manages the user ID and the selection criteria of the representative captured image in association with each other.

The item "user ID" is user identification information. The item "Selection criteria for representative captured images" is a selection criteria for determining representative captured images set by each user. Each user sets a desired selection criterion from the selection criterion setting screen as shown in FIG.

<Selection criteria setting screen>
FIG. 18 is an example of the selection criterion setting screen 300 displayed by the personal terminal 2. The selection criterion setting screen 300 is a radio associated with each selection criterion of "the first captured image" 301, "the image with the largest amount of writing" 302, and "the image captured by the largest number of participants" 303. Has a button. When the user selects a desired radio button and presses the OK button, the selection criteria selected by the user is transmitted to the content management server 6, and the content management server 6 associates the selection criteria with the user ID to personalize the selection criteria DB6006. Register with. In this way, each user can set desired selection criteria.

<Processing or operation>
Subsequently, the processing or operation of the present embodiment will be described. In the present embodiment, the presenter, who is an example of a user who operates the personal terminal 2a, performs streaming distribution to the shared screen ss at a conference held by the user in the room, and is an example of a user who operates the personal terminal 2b. An example of a participant attending a conference will be described.

FIG. 19 is a flowchart of an example showing the processing of the information processing system according to the present embodiment. In step S10, the information processing system prepares for the meeting. In the conference preparation, the information processing system prepares the room based on the request from the personal terminal 2 or the permanent terminal 4 by the presenter or the organizer of the conference, and connects the personal terminal 2a and the personal terminal 2b to the room. .. The personal board screen 1000 as shown in FIG. 9 is displayed on the personal terminal 2a and the personal terminal 2b connected to the room.

In step S12, a meeting is held in the information processing system. In response to the request from the presenter's personal terminal 2, the information processing system performs streaming distribution to the shared screen ss of the room, and causes each personal terminal 2 to display the projection screen 1040 as shown in the personal board screen 1000 of FIG. .. Participants perform an operation of pressing the capture button 1016 displayed on the personal board screen 1000 at the timing when they want to take a picture while referring to the projection screen 1040 displayed on the personal board screen 1000.

The personal board screen 1000 that has received the operation of pressing the capture button 1016 by the participant captures the captured image 1022 of the projection screen 1040 at that time. Then, for example, like the memo area of the personal board screen 1000 shown in FIG. 11, the captured image 1022 and the text memo area 1024 attached to the captured image 1022 are displayed on one sheet 1020.

In this way, the participant can additionally display the captured image 1022 of the projection screen 1040 and the text memo area 1024 attached to the captured image 1022 in the memo area at an arbitrary timing. Participants enter memos such as inputting text memos in the text memo area 1024 displayed in the memo area as shown in FIG. 11 and drawing objects (inputting handwritten memos) in the captured image 1022 displayed in the memo area. I do. The contents of the various DBs described above are updated according to the contents of the memo entry.

In step S14, in the information processing system, the personal memo dm in which the participant wrote a memo during the meeting can be viewed (review of the memo), and the memo of the meeting can be reviewed. The information on the review of the memo of the meeting by the participants is transmitted to the content management server 6 for updating the interest level management DB 6003.

Further, in step S16, the information processing system displays and utilizes the degree of interest of the participants in the contents of the meeting based on the method of taking the personal memo dm by the participants and the review of the personal memo dm as described later. To do.

For example, the display of the degree of interest of participants in the content of the conference may be viewed not only by the presenter and the organizer but also by the participants by abstracting the content. In addition, the display of the degree of interest of the participants in the content of the conference may be viewed only by the presenter or the organizer by restricting access. Presenters and organizers can view the degree of interest of participants in the content of the conference and utilize it for approaching participants (sales, etc.) and feedback to the next conference as described later.

According to steps S12 and S14, the operability and usability of the user can be improved by the UI that makes it easy to take the personal memo dm. Further, according to step S16, by visualizing and providing the degree of interest of the participants in the content of the meeting, it is possible to promote the utilization for the approach to the participants (sales, etc.) and the feedback to the next meeting.

FIG. 20 is a sequence diagram of an example of processing from the preparation of a conference held between a plurality of personal terminals to the display of the projection screen 1040 on the personal board screen 1000. Steps S20 to S24 are steps executed at the end of the meeting (when leaving the room). In step S20, the permanent terminal 4 automatically makes a room creation request to the content management server 6 when leaving the previous meeting. .. The content management server 6 creates a room and responds to the permanent terminal 4 with the room information (including the access destination) of the created room. In step S24, the permanent terminal 4 displays the access destination of the room included in the response from the content management server 6 by a URL, a two-dimensional code, or the like. In addition, when the participants who participate in the conference are registered in advance in the content management server 6 and the address for connecting each personal terminal 2 to the room is transmitted from the content management server 6, the participants can connect to the room in advance. When the address is recognized, the permanent terminal 4 is not necessarily an indispensable configuration. When a user who participates in a conference wants to display a shared screen on a large screen in a configuration without a permanent terminal 4, the personal terminal 2 sharing the screen can output to a projector, a display, an electronic whiteboard, or the like.

In step S26, the presenter who operates the personal terminal 2a inputs the access destination of the room on which the permanent terminal 4 is displayed into the web browser. The presenter enters the user ID and password to log in to the content management server 6.

Proceeding to step S28, the personal terminal 2a accesses the access destination input to the web browser, transmits the room information, and makes a personal board creation request and a WebSocket communication establishment request. WebSocket communication is a communication method different from HTTP for performing two-way communication (socket communication) between a web server and a web browser. According to the WebSocket communication, a TCP connection is established between the content management server 6 and the personal terminal 2 while the page (here, the personal board) to be the target of the WebSocket communication is displayed, and the content management server 6 and the individual are displayed. Both web browsers of the terminal 2 continue to communicate at the timing. In other words, when accessing the personal board, it communicates by HTTP including the handshake, after opening the personal board, it switches to WebSocket communication and performs two-way communication, and when the personal board is closed, WebSocket communication of the page ends. ..

Proceeding to step S30, the content management server 6 transmits the personal board screen data and the room ID to the personal terminal 2a, and approves the establishment of WebSocket communication. Proceeding to step S32, the personal terminal 2a responds to the establishment approval of the WebSocket communication in step S30. In steps S28 to S30, a handshake by the HTTP protocol is performed between the personal terminal 2a and the content management server 6, and while the personal board screen 1000 is displayed, bidirectional communication can be performed by WebSocket communication.

In step S34, the participant who operates the personal terminal 2b inputs the access destination of the room displayed by the permanent terminal 4 into the web browser. Participants enter the user ID and password to log in to the content management server 6.

Proceeding to step S36, the personal terminal 2b accesses the access destination input to the web browser, transmits the room information, and makes a personal board creation request and a WebSocket communication establishment request.

Proceeding to step S38, the content management server 6 transmits the personal board screen data and the room ID to the personal terminal 2b, and approves the establishment of WebSocket communication. Proceeding to step S40, the personal terminal 2b responds to the establishment approval of the WebSocket communication in step S38. In steps S36 to S38, a handshake by the HTTP protocol is performed between the personal terminal 2b and the content management server 6, and while the personal board screen 1000 is displayed, bidirectional communication can be performed by WebSocket communication.

Proceeding to step S42, the presenter who operates the personal terminal 2a selects a target to be screen-transmitted from the screen 1200 as shown in FIG. 21, for example, to the shared screen ss. FIG. 21 is an image diagram of an example of a screen for selecting a target to be screen-transmitted to the shared screen ss. The screen of FIG. 21 shows an example of targeting the target to be transmitted to the shared screen ss from "Share full screen", "Share application window", and "Share browser tab".

The screen 1200 of FIG. 21 is an example in which the presenter selects “share the entire screen”. On the screen 1200, an example is shown in which the "screen 1" of the entire desktop or another screen "screen 2" displayed on the dual display is an option. In addition, when "Share application window" is selected on the screen 1200, a plurality of running applications (including an application for displaying a conference / presentation material file) are displayed as options. In addition, when "Share browser tab" is selected on the screen 1200, the tab of the running web browser is displayed as an option.

Proceeding to step S44, the personal terminal 2a specifies the room ID or the personal board ID, and transmits the streaming of the target to be screen-transmitted to the shared screen ss of the specific room by WebRTC. WebRTC is a standard that realizes high-speed data communication via a web browser, and is one of HTML APIs. WebRTC can send and receive large-capacity data such as video and audio in real time.

Proceeding to step S46, the content management server 6 performs streaming distribution by WebRTC to the personal terminal 2a, the personal terminal 2b, and the personal board screen 1000 of the permanent terminal 4 associated with the room ID specified in step S44.

In step S48, the personal terminal 2a can display the streamed projection screen 1040 in the projection area of the personal board screen 1000 displayed by the web browser, for example, as shown in FIG. Further, in step S50, the personal terminal 2b can display the streamed projection screen 1040 in the projection area of the personal board screen 1000 displayed by the web browser, for example, as shown in FIG. Further, in step S52, the permanent terminal 4 can display the streamed projection screen 1040 in the projection area of the personal board screen 1000 displayed by the web browser, for example, as shown in FIG.

For example, a participant who operates the personal terminal 2b can capture the captured image 1022 of the projection screen 1040 and make a memo to the captured image 1022 and the text memo area 1024 by the procedure shown in the sequence diagram of FIG.

<Capture of projection screen>
The projection screen can be captured by either the content management server 6 or the personal terminal 2, and if there is a permanent terminal 4, it can also be captured by the permanent terminal 4. It is also possible with a transmitting terminal (any personal terminal 2) that transmits a projection screen. Hereinafter, as an example, a process in which the content management server 6 captures the projected screen will be described.

FIG. 22 is a sequence diagram of an example of a process of capturing the captured image 1022 of the projection screen 1040 and making a memo in the captured image 1022 and the text memo area 1024. FIG. 22 describes a case where the content management server 6 captures.

Participants who operate the personal terminal 2c in step S60 perform an operation of pressing the capture button 1016. The personal terminal 2c makes a capture shooting request to the content management server 6.

In step S62, the image processing unit 63 of the content management server 6 photographs the projection screen 1040 at that time, and returns the image file of the captured captured image 1022 to the personal terminal 2c.

The personal terminal 2c that has received the image file of the captured image 1022 from the content management server 6 proceeds to step S66, and additionally displays the captured image 1022 of the projection screen 1040 in the memo area using the received image file, for example, as shown in FIG. To do. Further, the personal terminal 2c displays the text memo area 1024 attached to the captured image 1022 on the same sheet 1020 as the additionally displayed captured image 1022, as shown in FIG. 11, for example.

Proceeding to step S68, the participant who operates the personal terminal 2c draws an object on the captured image 1022 on the additionally displayed sheet 1020 and inputs a text memo in the text memo area 1024.

In the sequence of FIG. 22, only the image file of the captured image 1022 is transmitted from the content management server 6 to the personal terminal 2c. In this case, JavaScript (registered trademark) included in the data of the web page and operating on the browser of the personal terminal 2c may create the text memo area.

Further, the content management server 6 may transmit the data of the sheet 1020 including the image of the captured image 1022 and the text memo area 1024. Further, the display position of the captured image 1022 and the sheet 1020 at this time may be determined by a program such as a script executed by the browser of the personal terminal 2c, or the content management server specifies the display position and the personal terminal. It may be transmitted to 2c.

Further, a sheet 1020 in which the acquired image and the text memo area are combined may be generated on the server side. The area of the sheet 1020 other than the captured image and the text memo area (the area represented by black in the drawing) can be an area where handwriting can be performed or an area where handwriting cannot be performed.

When a sheet other than the additionally displayed sheet 1020 (selected sheet 1020) is clicked, the personal terminal 2b determines that the editing is temporarily completed, and proceeds to step S70. In step S70, the personal terminal 2b transmits the information regarding the additionally displayed sheet 1020 and the edited contents for the sheet 1020 to the content management server 6. In step S70, the personal terminal 2b may transmit the information about all the sheets 1020 and the edited contents for all the sheets 1020 to the content management server 6.

The content management server 6 updates the contents of the various DBs described above with the received information about the sheet 1020 and the edited contents for the sheet 1020. In this way, the captured image 1022 captured on the personal board screen 1000, the handwritten memo on the captured image 1022, and the text memo input in the text memo area 1024 are associated with each other by the sheet 1020 and saved in the content management server 6. Will be done.

<Exit from the meeting>
As described above, during the meeting, each user accesses the personal board dc, performs a capture operation, and registers the captured image in the content management server 6. Since the personal memo and the shared memo are confirmed at the end of the meeting, the thumbnail of the representative captured image can be created by the content management server 6 after the end of the meeting. The representative captured images of the personal memo and the shared memo are registered in the personal memo management DB 6004 and the shared memo management DB 6005.

FIG. 23 is a sequence diagram of an example of a process in which a user leaves the ongoing conference and the conference ends. FIG. 23 shows a case where the permanent terminal 4 is used. In step S200, the participant who operates the personal terminal 2b performs an exit operation to exit the conference and instructs the participant to exit the conference.

Proceeding to step S202, the personal terminal 2b requests the content management server 6 to leave the conference using the conference ID and the user ID. The content management server 6 proceeds to step S204, and selects, for example, the user ID of the participant who is the user B of the personal terminal 2b from the field of the participant provided in the conference data of FIG. 24 (A).

Then, the content management server 6 assigns the exit flag "left" to the user ID of the participant of the personal terminal 2b registered in the field of the participant, so that the participant who is the user B of the personal terminal 2b can be assigned. Exit the meeting. The exited flag "left" indicates that the user who has participated in the conference once has already exited the conference. When a user who has left the conference rejoins the same conference, the exit flag "left" is deleted.

Further, in step S206, the content management server 6 notifies the permanent terminal 4 connected to the conference of the exit of the user B. Proceeding to step S208, the permanent terminal 4 displays the exit of the user B. Further, in step S210, the content management server 6 notifies the personal terminal 2a connected to the conference of the exit of the user B. Proceeding to step S212, the personal terminal 2a displays the exit of the user B.

In step S214, the presenter, who is the user A who operates the personal terminal 2a, performs an exit operation to exit the conference and instructs the exit from the conference. Proceeding to step S216, the personal terminal 2a requests the content management server 6 to leave the conference using the conference ID and the user ID. The content management server 6 proceeds to step S218, and selects, for example, the user ID of the participant of the personal terminal 2a from the field of the participant provided in the conference data of FIG. 24 (B).

Then, the content management server 6 assigns the exit flag "left" to the user ID of the presenter of the personal terminal 2a registered in the participant's field, thereby causing the participant of the personal terminal 2a to leave the conference.

Further, in step S220, the content management server 6 notifies the permanent terminal 4 connected to the conference of the exit of the presenter. Proceeding to step S222, the permanent terminal 4 displays the exit of the presenter (user A).

In step S224, the content management server 6 considers that the meeting has ended because the exit flag "left" is given to all the user IDs registered in the participant's field. The content management server 6 terminates the conference by adding the conference end flag "Finished" to the conference data shown in FIG. 24 (C).

Further, in step S226, the content management server 6 notifies the permanent terminal 4 connected to the conference of the end of the conference. The process proceeds to step S228, and the permanent terminal 4 displays the end of the conference. The conference end flag "Finished" is added to the conference data.

In addition, when the exit flag is given to all user IDs and the meeting end flag is given to the meeting data, if there is a shared screen during the meeting displayed on the permanent terminal 4, the shared screen is displayed. The screen may be deleted, or the screen may be changed to another screen such as a screen for the next meeting or a standby screen such as a service guidance screen.

Therefore, when a request to participate in the conference associated with the ID of the permanent terminal 4 is made after the conference is completed, the content management server 6 determines that the conference associated with the ID of the permanent terminal 4 is not being held. Create a new meeting.

In this way, in the information processing system according to the present embodiment, by managing the exit from the conference of the participants who participated in the conference, the conference can be terminated by the exit from the conference of all the participants who participated in the conference. it can.

In step S230, when all the participants of the conference leave, it is determined that the conference has ended. Therefore, the image determination unit 71 of the content management server 6 determines representative capture images for each user A and B, and thumbnails of each. To create. For shared memos, three representative captured images are created, and thumbnails for each are created.

<Three selection criteria for representative captured images>
Subsequently, the three selection criteria shown on the above selection criteria setting screen will be described.

<< First captured image >>
The first captured image may include the title of the meeting, the agenda, etc., and is likely to represent the content of the meeting, and thus may be suitable as a representative captured image.

FIG. 25 is a diagram illustrating selection of the first captured image or the image with the highest write amount. FIG. 25 shows that the captured images of 1, 2, 3, 4, 5 ... N are registered in the personal memo management DB 6004 for one user. The numbers are in the order in which they were captured. Therefore, when the selection criterion is the first captured image, the image determination unit 71 determines the first captured image as the representative captured image.

If each captured image has a time stamp (creation date and time), the image determination unit 71 may determine the time stamp, and if the captured image does not have a time stamp, the file name of the captured image is in ascending order. The image determination unit 71 determines by utilizing the fact that the numbers are assigned.

<< Image with the largest amount of writing >>
An image with a large amount of writing is likely to be important in the conference or impress the user with the content of the conference, and thus may be suitable as a representative captured image.

In FIG. 25, the writing amount is quantified and shown below each captured image. This numerical value is a numerical value for explanation rather than an actual calculation result. The image determination unit 71 calculates the amount of writing to each captured image (for each sheet) from the content data registered in the personal memo DB 6001. For example, the coefficient is weighted and calculated for each type of content. Assuming that the coefficient of the text memo is α, the coefficient of the image is β, and the coefficient of the vector is γ, it can be calculated as follows, for example.
Amount of writing = α × number of characters in text memo + β × number of images + γ × number of vector data Although not shown in the personal memo DB 6001, it is better to consider stamps, for example. A stamp is a standard image that can be displayed by the user with a simple operation, such as "important" or "secret". Captured images with "important" or "secret" are likely to be important and are weighted separately.
Writing amount = α × number of characters in text memo + β × number of images + γ × number of vector data + ε × number of stamps By doing so, the image determination unit 71 determines the captured image that may be important as the representative capture image. it can. In the example of FIG. 25, since the amount of writing of the second captured image is the largest, the image determination unit 71 determines the second captured image as the representative captured image.

<< Images captured by the largest number of participants >>
Images captured by the largest number of participants are likely to contain important content of the conference and may be suitable as representative captured images. This participant is a participant in the conference and corresponds to the user.

FIG. 26 is a diagram illustrating selection of images captured by the largest number of participants. When the image captured by the largest number of participants is used as the selection criterion, it is assumed that the projection screen is a still image because each user needs to capture a common projection screen. Therefore, for example, the image processing unit 63 may detect the switching of the still image. That is, it is detected that the user of the transmitting terminal has paged. As a detection method, a page feed signal may be acquired from a transmission terminal (personal terminal 2a), or a continuously transmitted image at time t and an image at t + 1 are compared, and if the images are different, a still image is obtained. May be detected that has been switched. The image processing unit 63 assigns, for example, serial number page numbers to still images. When the content management server 6 receives the capture request from the personal terminal 2, the image processing unit 63 assigns the assigned current page number to the captured image. For example, include the page number in the file name.

The numbers 1 to 5 in FIG. 26 are page numbers when the projected screen is a still image. In FIG. 26, the page numbers captured by the users A to D are shown. According to FIG. 26, since the fourth page is captured by three people, the image determination unit 71 determines the captured image on the fourth page as the representative captured image captured by the largest number of participants.

However, Mr. D has not captured the 4th page. In this case, the image determination unit 71 determines the captured image captured by the largest number of participants among the images captured by Mr. D as the representative captured image. Mr. D captures the 3rd and 5th pages, of which Mr. A also captures the 3rd page. Therefore, the representative captured image of Mr. D is the captured image on the third page.

<How to determine the representative captured image>
FIG. 27 is an example of a flowchart showing a procedure in which the image determination unit 71 determines a representative captured image of each user. As described above, the process of FIG. 27 is executed at the end of the meeting, but may be executed at the time of displaying the personal portal screen 5000 shown in FIG. It may be executed from the end of the meeting to the display of the personal portal screen 5000.

First, the image determination unit 71 acquires the selection criteria of the user of interest from the personal setting DB 6006 (S201). This user is a user who has participated in a conference (for example, a conference that has ended), and is a user associated with a room ID in which the conference has ended. The process of FIG. 27 is performed for each user.

Next, the process branches into three according to the selection criteria (S202). When the "first captured image" is the selection criterion, the image determination unit 71 determines the image first captured by this user as the representative captured image (S203).

When "the image with the largest amount of writing" is the selection criterion, the image determination unit 71 calculates the amount of writing for each captured image (S204).

Next, the image determination unit 71 determines the capture image having the largest amount of writing as the representative capture image (S205). Here, the writing amount may be the writing amount of only this user or the total writing amount of each user who participated in the same conference. In the case of the total writing amount of each user who participated in the same conference, the captured image having the largest writing amount among the images captured by this user may be determined as the representative captured image.

When "the image captured by the largest number of participants" is the selection criterion, the image determination unit 71 extracts the page number of the captured image of each user who participated in the same conference (S206). By counting the number of the same page number, you can identify the page number with the highest number of captures.

The image determination unit 71 determines whether or not the user paying attention to the page number having the largest number of captures is capturing (S207).

If the determination in step S207 is Yes, the image determination unit 71 determines the image with the page number having the largest number of captures as the representative capture image (S208).

When the determination in step S207 is No, the image determination unit 71 determines the image with the page number having the largest number of captures as the representative captured image among the images captured by the user of interest (S209). The image determination unit 71 creates a thumbnail of the determined representative captured image and registers it in the personal memo management DB 6004.

By doing so, thumbnails of representative captured images are registered in the personal memo management DB 6004 for each user. Since the selection criteria for the representative capture image of the shared memo may differ depending on the user, the image determination unit 71 determines the representative capture image by each of the three selection criteria. Since there is only one type of shared memo, the image determination unit 71 cannot apply the selection criterion of "page number with the largest number of captures". Therefore, as the representative captured image of the shared memo determined by the selection criterion of "the page number with the largest number of captures", the page number with the largest number of captures for the personal memo is used as the representative captured image.

<Display of personal portal screen>
Participants and presenters can look back on the memos of the conference and display and utilize the degree of interest of the participants in the content of the conference as follows, for example. When looking back, in order to identify the meeting that the user wants to look back on and display a personal memo or a shared memo, a personal portal screen 5000 that can display a list of meetings is displayed. Here, an example in which a participant looks back on a memo of a meeting from a personal terminal 2b will be described.

FIG. 28 is a sequence diagram of an example of a process in which a participant looks back on a memo of a meeting from a personal terminal 2b. In step S80, the participant who operates the personal terminal 2b performs an access operation to the personal portal screen 5000 as shown in FIG. FIG. 1 is a diagram showing a display example of the personal portal screen 5000.

The personal portal screen 5000 of FIG. 1 displays a list 5010 of meetings in which participants who operate the personal terminal 2b participated. The conference list 5010 can be created by using the personal memo management DB 6004, the shared memo management DB 6005, and the interest level management DB 6003 described above.

In the example of the conference list 5010 of FIG. 1, the date and time, the conference name, the place, the personal memo button 5030, the shared memo button 5040, the self-evaluation, and the bibliographic information button 5050 are displayed as items for each conference. According to the personal portal screen 5000 of FIG. 1, the participant can confirm the list 5010 of the conference in which he / she participated.

The personal memo button 5030 is a thumbnail of the representative captured image of the personal memo described so far, and is linked to the personal board screen 1100 that displays the personal memo dm of the conference. The shared memo button 5040 is a thumbnail of a representative captured image of the shared memo, and is linked to a shared memo screen for displaying the shared memo cm of the conference. The bibliographic information button 5050 is linked to the bibliographic information screen 5100 that displays the bibliographic information of the meeting.

When the bibliographic information button 5050 on the personal portal screen 5000 is pressed, the personal terminal 2b displays the bibliographic information screen corresponding to the pressed bibliographic information button 5050. On the bibliographic information screen, for example, "meeting bibliographic information" of the shared memo management DB 6005, information of the interest level management DB 6003, and the like are displayed.

The access operation to the personal portal screen 5000 in step S80 may be to input the connection address to the personal portal screen 5000 into the web browser or to select the personal portal screen 5000 using the bookmark.

Proceeding to step S82, the web browser of the personal terminal 2b accesses the personal portal screen 5000. In step S84, the content management server 6 performs an authentication process for the participant who operates the personal terminal 2b. Here, the explanation will be continued assuming that the authentication is successful. The content management server 6 proceeds to step S86 and reads the data for the personal portal screen 5000 from the storage unit 6000.

For example, the content management server 6 identifies the room ID corresponding to the conference in which the user participates from the personal memo management DB 6004 of the storage unit 6000 using the user ID of the authenticated participant as a key. Further, using the specified room ID (meeting) as a key, the content management server 6 specifies the bibliographic information of the meeting from the shared memo management DB 6005 of the storage unit 6000. In addition, a representative captured image associated with the user ID of the user is acquired from the personal memo management DB 6004 for each meeting. In addition, the selection criteria associated with the user ID are acquired from the personal setting DB 6006, and the representative captured image corresponding to the selection criteria is acquired from the shared memo management DB 6005.

In this way, if the user ID of the participant can be specified, the content management server 6 can acquire the data necessary for creating the personal portal screen 5000 of FIG. 1 from various DBs of the storage unit 6000.

Proceeding to step S88, the content management server 6 creates the data of the web page of the personal portal screen 5000 from the acquired data for the personal portal screen 5000. Proceeding to step S90, the content management server 6 transmits the data of the web page for the personal portal screen 5000 to the personal terminal 2b.

Proceeding to step S92, the personal terminal 2b can display the personal portal screen 5000 as shown in FIG. On the personal portal screen 5000 of FIG. 1, a list 5010 of meetings in which participants who operate the personal terminal 2b participate is displayed.

In this way, on the personal portal screen 5000, the representative captured image (thumbnail) selected by the selection criteria from the captured images captured during the meeting is displayed for each meeting, so that the user can display the representative captured image (thumbnail) of the meeting. Even if you cannot remember the contents of the meeting only from the bibliographic information, it will be easier to find the materials and memos of the meeting.

Further, when the selection criteria are different for each user, the content management server 6 can change the thumbnail of the representative captured image displayed on the personal portal screen 5000 according to the user even if the meeting is the same. ..

<Modification example of display of representative capture image>
In the present embodiment, only the representative capture image selected by only one of the three selection criteria is displayed for the personal memo, but the personal portal screen 5000 displays the three representative captures selected by each of the three selection criteria. All images may be displayed.

FIG. 29 is a diagram showing another display example of the personal portal screen 5000. In FIG. 29, three representative captured images 5030A to 5030C are determined for each user. The display control unit 24 of the personal terminal 2 requests another representative captured images 5030A to 5030C from the content management server 6 with the passage of time. Alternatively, the representative captured images 5030A to 5030C may be transmitted from the content management server 6 side to the personal terminal 2 every time. Alternatively, the content management server 6 may transmit the three representative captured images 5030A to 5030C together with the screen information of the personal portal screen 5000 to the personal terminal 2, and the display control unit 24 may switch over time.

By doing so, the user can check a plurality of representative captured images for one meeting, so that it becomes easy to remember the contents of the meeting. As for the shared memo, the personal terminal 2 can similarly display a plurality of representative captured images.

The personal terminal 2 may display all the captured images in the order of capture according to the passage of time. Further, as a selection criterion, the user may be able to select the captured image having the largest number of bytes. The user may be able to select the captured image having the largest number of colors used as the selection criterion.

<Summary>
As described above, in the present embodiment, since the representative captured image is displayed on the personal portal screen 5000, it is difficult to remember the contents of the meeting only from the meeting name, the holding time, etc., and further, from the bibliographic information of the meeting. Even if the content of the meeting cannot be remembered, the user can easily identify the target meeting. Therefore, it is not necessary to open individual boards (memo) one by one, and the time and effort required to search for meeting materials and memos can be reduced.

Further, when the selection criteria are different for each user, the content management server 6 can change the thumbnail of the representative captured image displayed on the personal portal screen 5000 according to the user even if the meeting is the same. ..

[Other Embodiments]
Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and substitutions can be added without departing from the gist of the present invention. For example, the information processing system according to this embodiment can be used in the following situations.

In the general seminar, the customer corresponds to the participant of this embodiment, and the sales person corresponds to the presenter or organizer of this embodiment, and the interest of the participant can be visualized. In school use, the student corresponds to the participant of this embodiment, the teacher corresponds to the presenter or organizer of this embodiment, and the degree of concentration of the student in the lesson can be analyzed. In the general meeting, the employee corresponds to the participant of this embodiment, the manager corresponds to the presenter and the organizer of this embodiment, and the manager can grasp the situation of the meeting in the company.

Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in the present specification is a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

2a, 2b, 2c Personal terminal 4 Permanent terminal 6 Content management server 8 Schedule management server 9 Communication network 100 Information processing system

Japanese Unexamined Patent Publication No. 2006-146415

Claims (14)

At a meeting in which a screen displayed by one communication terminal is shared with another communication terminal via an information processing device, the information processing device is an information processing system that stores captured images captured by the screen.
The information processing device
It has an image determination unit, which determines a representative captured image representing one or more captured images for each meeting based on a preset selection criterion.
The communication terminal is
An information processing system including a display control unit for displaying a list of meetings in which the representative captured image determined by the image determination unit is associated with at least one or more meetings. The selection criteria are set in association with the identification information of the user of the communication terminal.
The image determination unit determines the representative captured image for each meeting based on the selection criteria associated with the identification information of the user who has logged in to the information processing system. Information processing system described in. The information processing device stores captured images captured in response to a user's capture operation during one meeting in association with the user's identification information.
The image determination unit is based on the selection criteria associated with the identification information of the user who has logged in to the information processing system, and from the captured image associated with the user's identification information, the representative captured image. The information processing system according to claim 2, wherein the information processing system is characterized in that. The information processing device accumulates captured images shared by each user at each meeting.
The image determination unit determines the number of representative capture images of the selection criteria from the shared capture images for each of the different preset selection criteria.
The communication terminal acquires the representative captured image of the shared captured image selected by the selection criterion associated with the identification information of the user who has logged in to the information processing system from the information processing apparatus.
The information processing system according to claim 3, wherein the display control unit displays the representative captured image acquired from the information processing apparatus. The image determination unit determines a plurality of representative captured images for each meeting from the captured images accumulated in association with the user's identification information according to each of the different preset selection criteria.
The information processing system according to claim 3, wherein the display control unit displays a list of the meetings while switching a plurality of the representative captured images determined by the image determination unit. The information processing system according to claim 3, wherein the display control unit displays the representative captured image, which differs depending on the user, in association with the meeting in the list of the meetings. The display control unit displays a selection standard setting screen for accepting the setting of the selection standard, and displays the selection standard setting screen.
The information processing system according to any one of claims 3 to 6, wherein the information processing device stores the selection criteria received on the selection criteria setting screen in association with the user's identification information. .. 3. The selection criterion is characterized in that, among the captured images associated with the user's identification information at one meeting, the first captured captured image is determined as the representative captured image. The information processing system according to any one of 6 to 6. The information processing device holds the writing for the captured image in association with the captured image.
3. The selection criterion is characterized in that, among the captured images associated with the user's identification information at one meeting, the captured image having the largest writing amount is determined as the representative captured image. The information processing system according to any one of 6 to 6. The captured image held by the information processing device has a page number and has a page number.
The selection criterion is any one of claims 3 to 6, wherein the captured image of the page number captured by the largest number of users in one meeting is determined as the representative captured image. The information processing system described. An information processing device that performs processing related to a meeting that shares a screen with another information processing device via a second information processing device.
The second information processing device stores the captured image in which the screen is captured, and the second information processing device stores the captured image.
It has an image determination unit that determines a representative captured image representing one or more captured images for each meeting based on a preset selection criterion.
An information processing apparatus comprising: a display control unit for displaying a list of meetings in which the representative captured image determined by the image determination unit is associated with at least one or more meetings. An information processing device that transmits a screen received from one communication terminal to the other communication terminal at a meeting held between a plurality of communication terminals and stores captured images captured by the screen.
It has an image determination unit, which determines a representative captured image representing one or more captured images for each meeting based on a preset selection criterion.
The communication terminal is an information processing device that displays a list of meetings in which the representative captured image determined by the image determination unit is associated with at least one or more meetings. At a meeting in which a screen displayed by one communication terminal is shared with another communication terminal via an information processing device, the information processing device is an image display method performed by an information processing system that accumulates captured images captured by the screen. And
The information processing device
It comprises a step of determining, for each meeting, a representative capture image representing one or more of the capture images, based on preset selection criteria.
The communication terminal is
An image display method comprising: displaying a list of meetings in which the representative captured image determined by the information processing apparatus is associated with at least one or more meetings. An information processing device that performs processing related to a meeting that shares a screen with another information processing device via a second information processing device.
The second information processing device stores the captured image in which the screen is captured, and the second information processing device stores the captured image.
It has an image determination unit that determines a representative captured image representing one or more captured images for each meeting based on a preset selection criterion.
A program for functioning as a display control unit for displaying a list of meetings in which the representative captured image determined by the image determination unit is associated with at least one or more meetings.

Images