JP7452602B2 - Terminal device, communication system, communication method, and program - Google Patents

Description

The present invention relates to a terminal device , a communication system, a communication method , and a program.

Communication systems that communicate with remote locations via communication networks such as the Internet have become widespread. Examples of the communication system include a conference system that conducts remote conferences. In a typical conference system, a communication terminal used by one party to a remote conference converts images and sounds of objects in a conference room into digital data, and transmits the digital data to a communication terminal used by the other party. Next, the communication terminal used by the other party displays an image on the display and outputs sound from the speaker. This allows a conference between remote locations to be held in conditions similar to an actual conference.

In such conference systems, there is a known technology for sharing image data by transmitting image data indicating materials, etc. held or displayed on one communication terminal side to the other communication terminal via a communication network. (For example, see Patent Document 1).

In addition, communication terminals such as electronic blackboards that display images on displays and allow users to draw stroke images of letters, numbers, figures, etc. at meetings in companies, educational institutions, administrative agencies, etc. (For example, see Patent Document 2).

This stroke image is drawn by the communication terminal electronically converting the content drawn by the user by touching and moving an electronic pen or hand on the display, and generating stroke data such as coordinate data. Ru. In addition, when a stroke image is drawn on one communication terminal, the stroke data for reproducing this stroke image is sent to the other communication terminal via the communication network, so that the same stroke image can be drawn on the other communication terminal. is displayed.

For example, when a session (conference) is being held to share shared images including stroke images between multiple terminal devices such as electronic blackboards, a new terminal device (hereinafter referred to as (referred to as participating terminals) may participate.

In this case, since a stroke image is generally composed of a combination of a plurality of stroke data, the participating terminal can reproduce (reproduce) the stroke image by acquiring a plurality of stroke data.

However, with this method, if the amount of stroke data is large, multiple pieces of stroke data are acquired, so it takes time from the time the participating terminal joins the session until the shared image including the stroke image is displayed. There is a problem.

Embodiments of the present invention have been made in view of the above-mentioned problems, and include a terminal device that joins a session in the middle of a session in which shared images including stroke images are shared among a plurality of terminal devices. Reduce the time it takes to display a shared image.

In order to solve the above problems, a terminal device according to an embodiment of the present invention is a terminal device that establishes a session with another terminal device via a management device and displays a shared image including a shared stroke image. and, based on the session information obtained by logging into the management device, display the shared image shared in the session before starting call control for participating in the session midway through. an acquisition unit that acquires information for displaying the shared image from the management device ; and an acquisition unit that displays the shared image on a display screen when participating in the session, based on information for displaying the shared image that the acquisition unit acquired from the management device. and display control means for displaying.

According to an embodiment of the present invention, in a terminal device that joins a session in the middle of a session in which a shared image including a stroke image is shared between a plurality of terminal devices, the time from joining the session to displaying the shared image is Can be shortened.

FIG. 2 is a schematic diagram showing an example of a communication route in a communication system according to an embodiment. FIG. 2 is a diagram for explaining a usage image of an electronic whiteboard according to an embodiment. FIG. 1 is a diagram illustrating an example of a hardware configuration of an electronic whiteboard according to an embodiment. FIG. 1 is a diagram illustrating an example of a hardware configuration of a computer according to an embodiment. 1 is a diagram illustrating an example of a system configuration of a communication system according to an embodiment. FIG. 1 is a diagram illustrating an example of a functional configuration of a communication system according to an embodiment. FIG. 3 is a diagram illustrating an example of an authentication management table according to an embodiment. FIG. 3 is a diagram illustrating an example of a terminal management table according to an embodiment. FIG. 3 is a diagram illustrating an example of a destination list management table according to an embodiment. FIG. 3 is a diagram illustrating an example of a session management table according to an embodiment. FIG. 3 is a diagram illustrating an example of a relay device management table according to an embodiment. FIG. 3 is a diagram illustrating an example of a user information management table according to an embodiment. FIG. 2 is a sequence diagram illustrating an example of preparation stage processing according to an embodiment. FIG. 3 is a diagram illustrating an example of a destination list screen according to an embodiment. FIG. 3 is a sequence diagram illustrating an example of session start processing according to an embodiment. FIG. 3 is a sequence diagram illustrating an example of page data sharing processing according to an embodiment. FIG. 3 is a diagram illustrating an example of stroke data and image data according to an embodiment. FIG. 2 is a sequence diagram illustrating an example of preparation stage processing according to the first embodiment. FIG. 3 is a diagram illustrating an example of conference schedule information according to the first embodiment. FIG. 2 is a sequence diagram illustrating an example of session participation processing according to the first embodiment. FIG. 3 is a sequence diagram illustrating an example of page data sharing processing according to the first embodiment. FIG. 3 is a diagram showing an example of a display screen according to the first embodiment. FIG. 7 is a sequence diagram illustrating an example of page data provision processing according to the second embodiment.

Embodiments of the present invention will be described in detail below with reference to the drawings.

[Overview of communication system]
<Communication route>
First, a communication system 100 for holding a video conference while drawing between a plurality of electronic whiteboards 1a and 1b will be described using FIG. 1. FIG. 1 is a schematic diagram showing an example of a communication route in a communication system according to an embodiment. Note that a "video conference" is an example of a session held in the communication system 100, and may also be called a "teleconference," a "remote conference," or the like. Further, here, as an example, the session held in the communication system will be described as a video conference, but the session held in the communication system may be a meeting, a simple conversation, or the like.

The communication system 100 is constructed by a plurality of electronic whiteboards 1a, 1b, a relay device 3, a management device 5, a page data storage device 7, and the like.

The electronic whiteboards (terminal devices) 1a and 1b are terminal devices that perform mutual communication of content data such as video data and sound data for calls, image data for sharing, and stroke data, and are also referred to as IWB (Interactive White Board). Called. In the following description, "electronic blackboard 1" will be used to refer to any electronic blackboard among the plurality of electronic blackboards 1a and 1b.

Note that the electronic whiteboard 1 is an example of a terminal device according to this embodiment. The terminal device may be another terminal device having a communication function, a drawing function, a display function, and the like. For example, the terminal device may be an information terminal such as a PC (Personal Computer), a tablet terminal, or a smartphone, in which an application program compatible with the communication system 100 is installed.

As shown in FIG. 1, a management information session sei is established between the electronic whiteboard 1a and the electronic whiteboard 1b via the management device 5 for transmitting and receiving various types of management information. In addition, between the electronic whiteboard 1a and the electronic whiteboard 1b, a video/video signal for transmitting/receiving high-resolution video data, medium-resolution video data, low-resolution video data, sound data, etc. is provided via the relay device 3. A sound data session sed (hereinafter simply referred to as "session") is established. Note that a session may be established directly between the electronic whiteboard 1a and the electronic whiteboard 1b without using the relay device 3. Further, the number of sessions does not necessarily have to be four, and the number of sessions may be less than or greater than four sessions.

Here, the video resolution of the video data handled in this embodiment will be explained. The low-resolution video data consists of, for example, 160 pixels horizontally and 120 pixels vertically, and serves as a base image. Medium resolution video data consists of 320 pixels horizontally and 240 pixels vertically. High-resolution video data consists of, for example, 640 pixels horizontally and 480 pixels vertically. Among these, when passing through a narrowband path, low-quality video data consisting only of low-resolution video data serving as a base image is relayed. When the band is relatively wide, medium-quality video data consisting of low-resolution video data serving as a base image and medium-resolution video data is relayed. Furthermore, if the band is very wide, high-quality video data consisting of low-resolution video data, medium-resolution video data, and high-resolution video data serving as a base image is relayed. Since the amount of audio data is smaller than that of video data, it is relayed even through a narrowband path.

The electronic whiteboards 1a and 1b enable video conferencing by reproducing the video and sound of the other party by transmitting and receiving video data and sound data during the session.

Further, the electronic blackboards 1a and 1b can communicate between the electronic blackboards 1a and 1b by, for example, transmitting and receiving stroke data of a shared stroke image, shared image data, etc. via the page data storage device 7. Images can be shared.

A stroke image is an image showing a line or the like drawn by a user with a handwritten stroke using an electronic pen or the like. The stroke image is displayed by stroke data indicating points specifying coordinates on the display. Note that the stroke data is data necessary to reproduce (reproduce) a stroke image, and includes coordinate data, line width data, line color data, vector data, and the like.

The image data for sharing is data for displaying a document image displayed on the display of the electronic blackboard 1. The material images may include, for example, images of meeting materials, a background image displayed on a display, a captured screen when a display screen is captured, and the like.

Note that the communication system is not limited to the two electronic whiteboards 1a and 1b, but may be constructed using three or more electronic whiteboards 1.

In FIG. 1, an electronic blackboard equipped with a video conference function is shown as an example of the electronic blackboards 1a and 1b. Note that the image of the video data may be a moving image or a still image.

Furthermore, in the following description, the electronic whiteboard 1 that is the request source that requests the start of a video conference will be referred to as a "starting terminal," and the electronic whiteboard 1 that is the destination (relay destination) that is the request destination will be referred to as a "destination terminal." For example, in FIG. 1, when the electronic whiteboard 1a requests the electronic whiteboard 1b to start a video conference, the electronic whiteboard 1a becomes the starting terminal and the electronic whiteboard 1b becomes the destination terminal. Further, when another electronic blackboard 1 participates in a video conference being held between the electronic blackboard 1a and the electronic blackboard 1b, the electronic whiteboard 1 that participates in the video conference being held is called a "participating terminal."

In addition, each electronic blackboard 1 is not limited to communication between multiple offices or between different rooms in the same office, but also communication within the same room, communication between outdoors and indoors, or communication between outdoors and outdoors. May be used in

The relay device 3 is configured by a computer and relays video data and sound data transmitted and received between the plurality of electronic whiteboards 1.

The management device 5 is configured by a computer, and manages, for example, authentication of login from the electronic whiteboard 1, management of the communication status of the electronic whiteboard 1, management of the destination list, communication status of the relay device 3, and the like. The management device 5 also manages page data URLs, which are URL (Uniform Resource Locator) information of page data to be described later, which are transmitted and received between the plurality of electronic whiteboards 1.

The page data storage device 7 is, for example, a storage server configured by a computer. The page data storage device 7 functions as a page data storage unit (page data storage unit) that stores page data including shared image data, stroke data, etc. uploaded from the electronic blackboard 1, for example. For example, the page data storage device 7 stores page data uploaded from the electronic whiteboard 1a, and provides the stored page data to the electronic whiteboard 1b in response to a page data acquisition request from the electronic whiteboard 1b.

<Image of using electronic blackboard>
FIG. 2 is a diagram for explaining the usage image of the electronic whiteboard according to one embodiment. As shown in FIG. 2, the electronic whiteboard 1 includes a leg portion 151 provided with a plurality of casters on the lower side, a support 152 provided on the upper side of the leg portion 151, and an electronic whiteboard 1 provided on the upper side of the support 152. The main body 153 includes a display 160 provided on the front surface of the main body 153, and the like. The main body 153 has a built-in CPU 101, which will be described later. The user can then input (draw) stroke images such as characters on the display 160 using the electronic pen 140 or the like.

[Hardware configuration]
Next, the hardware configuration of each device according to this embodiment will be explained.

<Hardware configuration of electronic whiteboard>
FIG. 3 is a diagram illustrating an example of a hardware configuration of an electronic whiteboard according to an embodiment. As shown in FIG. 3, the electronic whiteboard 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an SSD (Solid State Drive) 104, and a network I/O. It includes an F (Interface) 105, an external device connection I/F 106, and the like.

Among these, the CPU 101 is a calculation device that controls the operation of the electronic whiteboard 1 as a whole. The ROM 102 is a nonvolatile memory that stores programs used to start the CPU 101, such as the CPU 101 and an IPL (Initial Program Loader). The RAM 103 is a volatile memory used as a work area for the CPU 101. The SSD 104 is a large-capacity storage device that stores various data such as programs for the electronic whiteboard 1.

The network I/F 105 is a communication interface for connecting the electronic whiteboard 1 to a communication network and performing communication. The external device connection I/F 106 is an interface for connecting various external devices. External devices in this case include, for example, a USB (Universal Serial Bus) memory 131, external devices (microphone 132, speaker 133, camera 134), and the like.

The electronic whiteboard 1 also includes a capture device 111, a GPU (Graphics Processing Unit) 112, a display controller 113, a contact sensor 114, a sensor controller 115, an electronic pen controller 116, a short-range communication circuit 119, and an antenna for the short-range communication circuit 119. 119a, a power switch 117, selection switches 118, and the like.

Among these, the capture device 111 captures (obtains) a display screen displayed on the display of an external PC (Personal Computer) 150, etc., as a still image or a moving image. The GPU 112 is a semiconductor chip (processor) that specializes in graphics. The display controller 113 controls and manages screen display in order to output the output image from the GPU 112 to the display 160 or the like. The contact sensor 114 detects when the electronic pen 140, the user's hand H, or the like comes into contact with the display 160. Sensor controller 115 controls processing of contact sensor 114.

The contact sensor 114 performs coordinate input and coordinate detection using, for example, an infrared cutoff method. In this method of inputting and detecting coordinates, two light receiving and emitting devices installed at both ends of the upper side of the display 160 emit a plurality of infrared rays in parallel to the display 160. This is a method of receiving light that is reflected by a reflecting member and returns along the same optical path as the light emitted by the light receiving element. The contact sensor 114 outputs the ID of the infrared rays emitted by the two light receiving and emitting devices blocked by the object to the sensor controller 115, and the sensor controller 115 identifies the coordinate position that is the contact position of the object. The electronic pen controller 116 communicates with the electronic pen 140 to determine whether the display 160 has been touched with the tip of the pen or the end of the pen. The near field communication circuit 119 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark).

The power switch 117 is a switch for switching the power of the electronic whiteboard 1 on and off. The selection switches 118 are, for example, a group of switches for adjusting the brightness, shade, etc. of the display 160.

Further, the electronic whiteboard 1 includes a bus line 120. The bus line 120 includes an address bus, a data bus, various control signals, etc. for electrically connecting each component such as the CPU 101 shown in FIG. 3.

Note that the contact sensor 114 is not limited to the infrared cutoff type, but may also be a capacitive type touch panel that identifies the touch position by detecting changes in capacitance, or a touch sensor that identifies the touch position by voltage changes between two opposing resistive films. A resistive touch panel or the like may also be used. Further, the contact sensor 114 may use various detection means such as an electromagnetic induction type touch panel that detects electromagnetic induction generated when a contact object contacts the display section and specifies the contact position. Further, the electronic pen controller 116 may determine whether or not there is a touch not only at the tip and the butt of the electronic pen 140 but also at a portion of the electronic pen 140 that the user grips or other portions of the electronic pen.

<Hardware configuration of management device, relay device, page data storage device, PC, etc.>
The management device 5, the relay device 3, the page data storage device 7, the PC 150, and the like have, for example, the hardware configuration of a computer 400 as shown in FIG. Alternatively, the management device 5, the relay device 3, and the page data storage device 7 may be realized by a plurality of computers 400.

FIG. 4 is a diagram illustrating an example of the hardware configuration of a computer according to an embodiment. The computer 400 includes, for example, a CPU 401, ROM 402, RAM 403, HD (Hard Disk) 404, HDD (Hard Disk Drive) controller 405, display 406, external device connection I/F 407, network I/F 408, keyboard 409, pointing device 410, It includes a DVD-RW (Digital Versatile Disk ReWritable) drive 412, a media I/F 414, a bus line 415, and the like.

Among these, the CPU 401 is a calculation device that controls the overall operation of the computer 400. The ROM 402 is a nonvolatile memory that stores programs used to drive the CPU 401 such as IPL. The RAM 403 is a volatile memory used as a work area for the CPU 401. The HD 404 is a large-capacity storage device that stores programs such as an OS (Operating System) and applications, and various data. The HDD controller 405 controls reading and writing of various data to the HD 404 under the control of the CPU 401.

The display 406 displays various information such as a cursor, menu, window, characters, or images. The external device connection I/F 407 is an interface for connecting various external devices. Network I/F 408 is a communication interface for data communication using a communication network. The keyboard 409 is a type of input means that includes a plurality of keys for inputting characters, numbers, various instructions, and the like. The pointing device 410 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like.

The DVD-RW drive 412 controls reading or writing (storage) of data to the DVD-RW 411 . Note that the DVD-RW drive 412 may control reading or writing (storage) of data on a disc such as a BD-RE (Blu-ray (registered trademark) Disc Rewritable) instead of the DVD-RW 411. The media I/F 414 controls reading or writing (storage) of data to a recording medium 413 such as a flash memory. The bus line 415 includes an address bus, a data bus, various control signals, etc. for electrically connecting each component such as the CPU 401 shown in FIG. 4.

<System configuration of communication system>
Next, the overall configuration of the communication system 100 will be explained. FIG. 5 is a diagram illustrating an example of a system configuration of a communication system according to an embodiment.

In the communication system 100, for example, a management device 5, a page data storage device 7, a relay device 3, and a plurality of electronic blackboards 1a, 1b, and 1c are connected via a communication network 501 such as the Internet or a LAN (Local Area Network). and are connected for communication. Note that the communication network 501 may include a wireless communication portion.

Note that, as shown in FIG. 5, the management device 5 and the page data storage device 7 may be included in one communication management system (communication management device) 500. Further, the communication management system 500 may include the relay device 3.

A schedule management device (schedule management system) 502 is an external system that manages schedule information of meetings (eg, video conferences) in which users (eg, users A, B, C, etc.) participate. The schedule management device 502 manages, for example, the conference name, participants, holding time (scheduled start time, scheduled end time), etc. of the conference in which the user participates. Note that although the communication system 100 will be described here as operating in cooperation with an external schedule management device 502, the schedule management device 502 may be included in the communication management system 500.

As shown in FIG. 5, it is assumed that the electronic blackboards 1a, 1b, and 1c are installed at base A, electronic blackboard 1a, base B, and base C, respectively. Further, it is assumed that at base A, user A is using the electronic whiteboard 1a, and at base B, user B is using the electronic whiteboard 1b. Furthermore, it is assumed that at base C, user C uses the electronic blackboard 1c.

Here, the following description will be given assuming that the electronic blackboards 1a, 1b, and 1c are all electronic blackboards 1 that can conduct video conferences and share stroke images. Further, a PC 150 is connected to the electronic whiteboard 1a, and the user A can capture the display screen displayed on the PC 150 and share the captured image with other electronic whiteboards 1b, 1c, etc. It shall be possible.

[Functional configuration of communication system]
Next, the functional configuration of the communication system 100 will be explained. FIG. 6 is a diagram illustrating an example of a functional configuration of a communication system according to an embodiment. In FIG. 6, it is assumed that the electronic whiteboards 1b and 1c have the same functional configuration as the electronic blackboard 1a.

<Functional configuration of electronic blackboard>
For example, the electronic blackboard 1 is configured by executing a predetermined program on the CPU 101 shown in FIG. 16, a page information acquisition unit 17, a short-range communication unit 18, a storage/read processing unit 19, etc. Note that at least some of the above functional configurations may be realized by hardware. Further, the electronic whiteboard 1 has a storage unit 1001 implemented by the SSD 104, RAM 103, etc. in FIG.

The transmitting/receiving unit 11 transmits and receives various data and information to and from other terminals, devices, or systems via the communication network 501. The transmitting/receiving unit 11 also plays a role as an initiating unit, and performs processing for logging into the communication management system 500, management device 5, etc., processing for starting communication with other terminal devices, and the like. The reception unit 12 receives various inputs from the user using an electronic pen 140 or the like.

The video/sound processing section 13 performs the main processing of the video conference function. For example, the video/sound processing unit 13 performs digital processing such as encoding of video data and sound data in conjunction with the output signal of the microphone 132 and the output signal of the camera 134. Further, the video/sound processing section 13 generates a video signal, a sound signal, etc. based on the video data and sound data received by the transmitting/receiving section 11. Furthermore, the video/sound processing section 13 also performs processing such as combining video data with different resolutions.

The display control unit 14 outputs a video signal (image signal) and the like to the display 160 and performs control for displaying a display screen. The image processing unit 15 performs the main processing of the electronic whiteboard function. For example, the image processing unit 15 performs a process of creating a stroke image and stroke data based on a stroke of the electronic pen 140 or the like accepted by the receiving unit 12, or a process of creating a stroke image and stroke data based on stroke data received by the transmitting/receiving unit 11. Perform the process to create. Further, the image processing section 15 generates an image signal based on the image data of the document image received by the transmitting/receiving section 11 .

The page information transmitter 16 uploads page data updated on the electronic blackboard 1 to the page data storage device 7 when the electronic blackboard 1 is participating in a video conference (hereinafter referred to as a session). For example, the page information transmitter 16 acquires a page data URL, which is URL information indicating a storage location and an acquisition destination of page data, from the management device 5, and uploads the page data to the acquired URL.

Further, the page information transmitting unit 16 transmits to the management device 5 a page data URL indicating a source from which the page data uploaded to the page data storage device 7 is obtained. The page data URL transmitted to the management device 5 is provided by the management device 5 to other electronic whiteboards 1 participating in the same session.

The page information acquisition unit 17 uses the page data URL provided by the management device 5 to acquire page data stored in the page data storage device 7 by other electronic blackboards 1 participating in the same session.

The short-range communication unit 18 acquires and provides data by short-range wireless communication with each terminal having a short-range communication unit.

The storage/read processing unit 19 performs processing of storing various data in the storage unit 1001 or a recording medium 1002 such as the USB memory 131, and reading out various data stored in the storage unit 1001 or the recording medium 1002.

The storage unit 1001 overwrites and stores video data and sound data that are received when communicating with other terminals each time the data is received. Among these, an image is displayed on the display 160 using the video data before being overwritten, and audio is output from the speaker 133 using the sound data before being overwritten.

<Functional configuration of management device>
For example, the management device 5 executes a predetermined program on the CPU 401 in FIG. It implements an information providing section 57, a page information management section 58, a storage/reading processing section 59, and the like. Note that at least some of the above functional configurations may be realized by hardware.

The management device 5 also includes a storage unit 5000 implemented by the HD 404 in FIG. The storage unit 5000 stores, for example, an authentication management DB (Database) 5001, a terminal management DB 5002, a destination list management DB 5003, a session management DB 5004, a relay device management DB 5005, a user information management DB 5006, and the like.

(Authentication management table)
FIG. 7 is a diagram illustrating an example of an authentication management table according to an embodiment. The storage unit 5000 stores an authentication management DB 5001 configured by an authentication management table 700 as shown in FIG. 7, for example. In this authentication management table 700, each password is managed in association with each terminal ID of all the electronic whiteboards (terminal devices) 1 managed by the management device 5. For example, in the authentication management table 700 shown in FIG. 7, it is shown that the password corresponding to "01aa", which is the terminal ID of the electronic whiteboard 1a (terminal device), is "aaaa".

Note that the terminal ID is identification information for identifying the electronic whiteboard (terminal device) 1, and is an example of identification information for the management device 5 to manage the terminal device such as the electronic whiteboard 1. For example, the communication management system 500 manages the electronic whiteboard 1 using a user ID for identifying a user, a contract ID for identifying a subscriber, a communication ID for identifying a communication source, etc., instead of a terminal ID. It may be.

Further, the password is an example of authentication information for authenticating a terminal device such as the electronic whiteboard 1. The authentication information may be authentication information other than a password, such as an access token, for example.

(terminal management table)
FIG. 8 is a diagram illustrating an example of a terminal management table according to an embodiment. A terminal management DB 5002 configured by a terminal management table 800 as shown in FIG. 8 is stored in the storage unit 5000. In this terminal management table 800, for each terminal ID for identifying each electronic blackboard (terminal device) 1, the destination name when each electronic blackboard 1 is the destination, the operating state of each electronic blackboard 1, and the login request described below. The date and time when the information was received by the management device 5, the IP address of each electronic blackboard 1 (terminal device), etc. are associated and managed. For example, in the terminal management table 800 shown in FIG. 8, the electronic whiteboard 1a with the terminal ID "01aa" has the terminal name "Japan Tokyo office AA terminal" and the operating status is "Online (communication available)". ” has been shown to be. Furthermore, for the electronic whiteboard 1a whose terminal ID is "01aa", the date and time when the login request information was received by the management device 5 is "13:40 on April 10, 2015", and the IP address of the electronic whiteboard 1a is It is shown that it is "1.2.1.3". Note that the terminal ID, destination name, IP address of the terminal, etc. are stored, for example, when each electronic whiteboard 1 is pre-registered to receive services provided by the management device 5.

(Destination list management table)
FIG. 9 is a diagram illustrating an example of a destination list management table according to an embodiment. The storage unit 5000 stores a destination list management DB 5003 configured by a destination list management table 900 as shown in FIG. 9, for example. In this destination list management table 900, all the terminal IDs of the electronic blackboards (terminal devices) 1 registered as destination terminal candidates are managed in association with the terminal ID of the starting terminal that requests the start of communication. . For example, in the destination list management table 900 shown in FIG. includes electronic whiteboards 1 such as "01ba" and "01ca". These destination terminal candidates are updated by being added or deleted in response to an addition or deletion request from each starting terminal to the management device 5.

Note that the destination list is an example of destination information, and the destination information may not be in a list format, but may include information related to destinations such as terminal IDs.

(Session management table)
FIG. 10 is a diagram illustrating an example of a session management table according to an embodiment. The storage unit 5000 stores a session management DB 5004 configured by a session management table 1000 as shown in FIG. 10, for example. In this session management table 1000, for each session ID for identifying a session, the device ID of the relay device 3 used, the terminal ID of the starting terminal, the terminal ID of the destination terminal, the terminal ID of one or more participating terminals, etc. are managed in association with each other. The session management table 1000 also includes, for example, the reception delay time (ms) when video data is received at the destination terminal, and the reception date and time when the delay information indicating this delay time was received from the destination terminal. Information is further associated and managed. For example, in the session management table 1000 shown in FIG. 10, the session with the session ID "se01" is executed by the relay device 3 with the relay device ID "111a", the starting terminal with the terminal ID "01aa", and the destination terminal with the terminal ID "01ba". It relays communication between. Further, in the session with session ID "se01", it is shown that the delay time of video data at "13:41 on April 10, 2015" is 200 (ms).

(Relay device management table)
FIG. 11 is a diagram illustrating an example of a relay device management table according to an embodiment. The storage unit 5000 stores a relay device management DB 5005 that includes a relay device management table 1100 as shown in FIG. 11, for example. In this relay device management table 1100, for each relay device ID of a plurality of relay devices 3, the operating state of each relay device 3, the reception date and time when the state information indicating the operating state was received, the IP address of the relay device 3, and the maximum Data transmission speed (Mbps) etc. are associated and managed. For example, in the relay device management table 1100 shown in FIG. 11, the relay device 3 with the relay device ID “111a” has the operating status “online” and the date and time when the status information was received by the management device 5 is “ 12:00 on April 10, 2015." Further, for the relay device 3 whose relay device ID is “111a”, the IP address of this relay device 3 is “1.2.1.2”, and the maximum data transmission rate in this relay device 3 is 100 Mbps. has been done.

(User information management table)
FIG. 12 is a diagram illustrating an example of a user information management table according to an embodiment. The storage unit 5000 stores a user information management DB 5006 configured by a user information management table 1200 as shown in FIG. 12, for example. In this user information management DB 5006, information that identifies a user (for example, user ID, user name, etc.) and a terminal ID that identifies the electronic blackboard (terminal device) 1 used by the user are managed in association with each other. . For example, the user information management table 1200 shown in FIG. 12 shows that the terminal ID of the electronic whiteboard 1a used by the user A with the user ID "U0001" is "01aa".

<Functional configuration of management device>
Here, returning to FIG. 6, each functional configuration of the management device 5 will be explained.

The transmitting/receiving unit 51 transmits and receives various data (or information) to and from other terminals, devices, or systems via the communication network 501 .

The authentication unit 52 authenticates the login request received via the transmitting/receiving unit 51. For example, if the combination of terminal ID and password included in the login request received from the electronic whiteboard 1 is stored in the authentication management table 700 as shown in FIG. Allow.

The terminal management unit 53 manages the terminal management DB 5002, and updates information such as the operating state, reception date and time, and terminal IP address in a terminal management table 800 as shown in FIG. 8, for example, according to the state of the electronic whiteboard 1. do.

Further, the terminal management unit 53 manages a destination list management table 900, and, for example, in response to a request from the electronic whiteboard 1, the terminal management section 53 manages a destination list including the terminal ID of the destination terminal in the destination list management table 900 as shown in FIG. Provide information.

The session management unit 54 manages sessions held in the communication system 100. For example, the session management unit 54 generates a session ID for identifying a session in response to start request information requesting the start of communication from the electronic whiteboard 1. Further, the session management unit 54 stores and manages various information related to sessions in association with session IDs in a session management table 1000 as shown in FIG. 10, for example.

The relay device management unit 55 manages the relay device management DB 5005, and selects the relay device 3 used for relaying the session, for example, using a relay device management table 1100 as shown in FIG. For example, the relay device management unit 55 selects a relay device 3 near the starting terminal from the IP address of each relay device 3 stored in the relay device management table 1100 and the IP address of the starting terminal. It's okay. Alternatively, the relay device management unit 55 may select the relay device 3 based on the maximum data transfer rate of each relay device 3 stored in the relay device management table 1100.

Note that in this embodiment, the method for selecting the relay device 3 used for relaying the session may be any method. Further, the number of relay devices 3 included in the communication system 100 may be one.

The information acquisition unit 56 acquires, from the schedule management device 502, conference schedule information including the scheduled start time of a conference in which the electronic whiteboard (terminal device) 1 that has logged into the management device 5 participates.

For example, when the electronic whiteboard 1c with the terminal ID "01ca" is logged into the management device 5, the information acquisition unit 56 refers to the user information management table 1200 as shown in FIG. Obtain the user name or user ID of the corresponding user C. Further, the information acquisition unit 56 uses the user C's user name, user ID, etc. to receive information about the conference including the scheduled start time, participants, etc. of the conference that the user C is scheduled to participate in from the schedule management device 502. Get schedule information. Note that the conference schedule information is an example of session information that includes the scheduled start time of a session in which a terminal device (electronic whiteboard 1) that has logged into the communication management system 500 participates.

Based on the session information acquired by the information acquisition unit 56, the information providing unit 57 performs a sharing process in the session before the electronic blackboard 1 logged into the management device 5 starts call control for participating in the session from the middle. Information for displaying the shared image being displayed is provided to the electronic blackboard 1.

For example, the information providing unit 57 uses the conference schedule information, the user information management table 1200, the session management table 1000, etc. acquired by the information acquisition unit 56 to determine whether the electronic blackboard 1 Determine whether or not. Furthermore, if the electronic blackboard is a participating terminal that joins a session in progress, the information providing unit 57 displays a shared image before the electronic blackboard 1 starts call control for participating in the session. The electronic whiteboard 1 is provided with information to do so.

Here, the shared images include stroke images shared in a session and document images shared in a session. Further, the information provided by the information providing unit 57 to the electronic blackboard 1 includes page data URL, which is URL information for acquiring page data including stroke data for reproducing stroke images, image data of document images, etc. etc. are included.

In response to a request from an electronic whiteboard 1 participating in a session, the page information management unit 58 generates a page data URL, which is URL information indicating a storage location for storing page data of the session and a location from which the page data is obtained. generate. Further, the page information management unit 58 notifies the generated page data URL to the requesting electronic whiteboard 1, and stores and manages it in the storage unit 5000 or the like in association with the session ID.

The storage/read processing unit 59 performs processing for storing various data in the storage unit 5000, processing for reading out various data stored in the storage unit 5000, and the like.

With the above configuration, the information providing unit 57 can, for example, provide a page managed by the page information management unit 58 in association with the session ID “se01” for the electronic blackboard 1c that joins the session with the session ID “se01” midway through. Provide data URLs all at once. This allows the electronic whiteboard 1c to acquire information (for example, stroke data, etc.) necessary to generate a shared image that is being shared in a conference to be attended, before participating in a session. .

<Functional configuration of page data storage device>
The page data storage device (page data storage unit) 7 implements a transmitting/receiving unit 71, a storage/reading processing unit 72, etc., by executing a predetermined program with the CPU 401 in FIG. 4, for example. Note that at least a portion of these functional configurations may be realized by hardware.

Further, the page data storage device 7 includes a storage section 7000 implemented by, for example, the RAM 403, HD 404, etc. in FIG.

(Functional configuration of page data storage device)
The transmitting/receiving unit 71 transmits and receives various data, information, etc. to and from other terminals, devices, or systems via the communication network 501 .

The storage/read processing unit 72 performs processing for storing various data in the storage unit 7000, processing for reading out various data stored in the storage unit 7000, and the like.

With the above configuration, the page data storage device 7 functions, for example, as a page data storage section that stores one or more page data including stroke data for reproducing stroke images. For example, the page data storage device 7 stores the page data transmitted from the electronic blackboard 1 during a session at a specified URL, and also stores the page data transmitted from the electronic blackboard 1 at the requested URL in response to a request from the electronic blackboard 1. Provide page data.

<Functional configuration of relay device>
In this embodiment, the functional configuration of the relay device may be arbitrary, so a detailed description of the functional configuration will be omitted. Using the same session ID, the relay device 3 relays video data such as conference video and sound data transmitted from a plurality of electronic whiteboards 1 that establish sessions with the relay device.

For example, it is assumed that electronic whiteboards 1a, 1b, and 1c have established a session with a relay device with session ID "se01." In this case, the relay device 3 transfers the video data and sound data transmitted by the electronic whiteboard 1a to the electronic whiteboards 1b and 1c. Similarly, the relay device 3 transfers the video data and sound data transmitted by the electronic whiteboard 1b to the electronic whiteboards 1a and 1c, and transfers the video data and sound data transmitted from the electronic whiteboard 1c to the electronic whiteboards 1a and 1b. Transfer to.

[Processing flow]
Next, the processing flow of the communication management method according to this embodiment will be explained.

<Remote communication preparation stage processing>
FIG. 13 is a sequence diagram illustrating an example of preparation stage processing according to an embodiment. This process is an example of a preparatory process executed in the communication system 100 before the electronic whiteboard 1 participates in a session (video conference).

First, when the power switch 117 on the electronic whiteboard 1a is turned on, the reception unit 12 accepts the power-on request (step S22).

Next, the transmitter/receiver 11 transmits login request information requesting login to the management device 5 via the communication network 501 (step S23). This login request information includes, for example, the terminal ID and password of the electronic whiteboard 1a.

Next, the authentication unit 52 of the management device 5 searches the authentication management table 700 as shown in FIG. 7 using the terminal ID and password included in the login request information received via the transmission/reception unit 51 as a search key. . Further, if the combination of terminal ID and password included in the login request information is managed in the authentication management table 700, the authentication unit 52 permits login to the electronic whiteboard 1a (step S24). For example, if the combination of terminal ID and password included in the login request information is managed in the authentication management table 700, the processes from step S25 onwards are executed.

When login to the electronic whiteboard 1a is permitted, the terminal management unit 53 updates information corresponding to the terminal ID "01aa" of the electronic whiteboard 1a in a terminal management table 800 as shown in FIG. For example, the terminal management unit 53 changes the "operating status" information corresponding to the terminal ID "01aa" to "online (communicatable)" and changes the "reception date and time" information to the date and time when the login request information was received. (Step S25). Note that the information on the IP address of the terminal may not be registered in advance, but the IP address transmitted from the electronic whiteboard 1a in step S23 above may be used. As a result, in the terminal management table 800, for example, as shown in FIG. 8, the terminal ID "01aa", the operating state "online (communication available)", the reception date and time "2015.4.10.13:40", and IP addresses such as "1.2.1.3" are managed in association with each other.

Next, the session management unit 54 creates a new record in which the terminal ID "01aa" of the electronic whiteboard 1a received in step S23 above is set as the "terminal ID of the starting terminal" in the session management table 1000 as shown in FIG. (Step S26). Then, the transmitting/receiving unit 51 of the management device 5 transmits the authentication result information indicating the authentication result obtained through the process of step 24 to the electronic whiteboard 1a that has requested the login via the communication network 501 (step S27).

Upon receiving the authentication result information indicating that login is permitted, the transmitting/receiving unit 11 of the electronic blackboard 1a sends destination list request information indicating that a destination list is requested to the management device 5 via the communication network 501. Transmit (step S28). Thereby, the transmitting/receiving unit 51 of the management device 5 receives the destination list request information.

Next, the terminal management unit 53 searches the destination list management table 900 as shown in FIG. 9 using the terminal ID "01aa" of the electronic whiteboard 1a as a search key, and searches for destination candidates that can communicate with the electronic whiteboard 1a. Read the terminal ID. Further, the terminal management unit 53 reads the destination name corresponding to the terminal ID of the destination candidate from the terminal management table 800 as shown in FIG. 8 (step S29). As a result, each terminal ID of the destination candidates corresponding to the terminal ID "01aa" of the electronic whiteboard 1a and the corresponding destination name are extracted.

Next, the transmitting/receiving unit 51 of the management device 5 reads, for example, the data of the destination list frame and the data of the icon indicating the operating state stored in the storage unit 5000 via the storage/reading processing unit 59 (step S30). In addition, the transmitting/receiving unit 51 of the management device 5 generates "destination list information (destination list frame, icon, terminal ID, destination name)" including the read destination list frame and icon, the terminal ID and destination name extracted in step S29. is transmitted to the electronic whiteboard 1a (step S31). As a result, in the electronic whiteboard 1a, the transmitting/receiving section 11 receives the destination list information, and the storage/reading processing section 19 stores the received destination list information in the storage section 1001 (step S32).

In this manner, in this embodiment, instead of managing destination list information on each electronic whiteboard 1, the management device 5 centrally manages destination list information of all terminals. Therefore, when a new electronic blackboard 1 is registered in the communication management system 500, when a new model of terminal device is registered in place of the already included electronic whiteboard 1, when the appearance of the destination list frame, etc. is changed, etc. etc., it is possible to save the effort of changing the destination list information on each electronic whiteboard 1 side.

Further, the terminal management unit 53 of the management device 5 searches the terminal management table 800 as shown in FIG. 8 using the destination candidate terminal ID extracted in step S29 as a search key, and searches the terminal management table 800 as shown in FIG. 8 for each destination candidate terminal ID. Read out the operating status. Thereby, the terminal management unit 53 acquires the operating state of each electronic whiteboard 1 corresponding to the terminal ID of the destination candidate (step S33).

Next, the transmitting/receiving unit 51 of the management device 5 sends "terminal status information" including the terminal ID used as the search key in step S33 and the operating status of each corresponding destination terminal to the communication network 501. via the electronic whiteboard 1a (step S34).

Next, the storage/read processing unit 19 of the electronic whiteboard 1a sequentially stores the terminal status information received from the management device 5 in the storage unit 1001 (step S35). Therefore, by receiving the status information of each electronic whiteboard 1, the electronic whiteboard 1a can acquire the current operating status of the electronic whiteboards 1b, 1c, etc., which are destination candidates that can communicate with the electronic whiteboard 1a. .

Next, the display control unit 14 of the electronic blackboard 1a creates a destination list that reflects the status of the terminal as a destination candidate, based on the destination list information stored in the storage unit 1001 and the status information of the terminal. . Further, the display control unit 14 uses the created destination list to display, for example, a destination list screen 1400 as shown in FIG. 14 on the display 160 of the electronic whiteboard 1a (step S36). This destination list screen 1400 displays an icon indicating an operating state, a terminal ID, and a destination name for each destination candidate. In the example of FIG. 14, the icons indicating the operating status of each terminal are that the electronic blackboard (terminal device) 1 with the terminal ID "01ba" is "online (communication possible)" and the electronic blackboard 1 with the terminal ID "01ca" indicates that it is "offline".

On the other hand, the terminal management unit 53 of the management device 5 registers the electronic whiteboard 1a as a destination candidate by searching the destination list management table 900 as shown in FIG. 9 based on the terminal ID "01aa" of the electronic whiteboard 1a. Terminal IDs of other terminals are extracted (step S37). In the destination list management table 900 shown in FIG. 9, the terminal IDs of other terminals to be read include "01ba", "01ca", etc.

Next, the terminal management unit 53 of the management device 5 searches the terminal management table 800 as shown in FIG. 8 based on the terminal ID "01aa" of the electronic whiteboard 1a, and obtains the operating state of the electronic whiteboard 1a ( Step S38).

Then, the transmitter/receiver 51 adds the terminal ID and operating state of the electronic whiteboard 1a to the electronic whiteboard 1 of the terminal ID whose operating state is "online" in the terminal management table 800 among the terminal IDs extracted in step S37. ``Terminal status information'' including the information is transmitted (step S39). Note that when transmitting the terminal status information to each electronic whiteboard 1, the transmitting/receiving unit 51 refers to the IP address of each electronic whiteboard 1 managed in the terminal management table 800 based on each terminal ID. Thereby, the terminal ID "01aa" and the operating state "online" of the electronic whiteboard 1a can be transmitted to each electronic whiteboard 1 that can communicate with the electronic whiteboard 1a as a destination candidate. Thereby, the status of the electronic blackboard 1a can also be displayed on each electronic blackboard 1 that is a destination candidate (step S40).

<Session start processing>
FIG. 15 is a sequence diagram illustrating an example of session start processing according to an embodiment. This process is an example of a session start process executed by the communication system 100 when, for example, the electronic whiteboard 1a requests the electronic whiteboard 1b to start a session.

In step S1501, when the electronic whiteboard 1a, which is the starting terminal, receives destination selection by user A, the processes from step S1502 onwards are executed. Note that the user A can select the electronic whiteboard 1b as the destination terminal by pressing the button with the terminal ID "01ba" from the destination list screen 1400 as shown in FIG. 14, for example.

In step S1502, when the electronic whiteboard 1a receives the destination selection by the user A, the transmitting/receiving unit 11 of the electronic whiteboard 1a transmits start request information requesting the start of a session to the management device 5. This start request information includes, for example, the terminal ID "01aa" of the electronic whiteboard 1a which is the starting terminal, the terminal ID etc. "01ba" of the electronic blackboard 1b which is the destination terminal, the IP address of the electronic blackboard 1a which is the starting terminal, etc. is included. Thereby, the transmitting/receiving unit 51 of the management device 5 receives the start request information and also receives the IP address of the starting terminal (electronic whiteboard 1a) that is the transmission source.

In step S1503, the terminal management unit 53 of the management device 5 updates the terminal management DB 5002 based on the terminal ID of the start terminal and the terminal ID of the destination terminal included in the start request information. For example, the terminal management unit 53 sets the terminal IDs "01aa" and "01ba" in the terminal management table 800 based on the terminal ID "01aa" of the start terminal and the terminal ID "01ba" of the destination terminal included in the start request information. Update the corresponding "operating status" to "online (communicating)". Note that in this state, the electronic whiteboard 1a, which is the starting terminal, and the electronic whiteboard 1b, which is the destination terminal, are not participating in the session, but are managed as being in a communicating state.

In step S1504, the session management unit 54 of the management device 5 generates a session ID for identifying the session held between the electronic whiteboard 1a and the electronic whiteboard 1b. Here, it is assumed that the session management unit 54 generates the session ID "se01".

In step S1505, the session management unit 54 associates the generated session ID, the terminal ID "01aa" of the starting terminal, the terminal ID "01ba" of the destination terminal, etc. with the session management table 1000 as shown in FIG. Remember and manage.

In step S1506, the relay device management unit 55 of the management device 5 selects the relay device 3 that relays the session between the start terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b).

In steps S1507a and S1507b, the session management unit 54 of the management device 5 transmits relay device selection information to the starting terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) via the transmitting/receiving unit 51. This relay device selection information includes, for example, the IP address of the relay device 3 selected in step S1506, the session ID generated in step S1504, and the IP address of the management device 5.

In steps S1508a and S1508b, upon receiving the relay device selection information, the transmitter/receiver 11 of the start terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) transmits reception completion information indicating that the relay device selection information has been received. , to the management device 5. This reception completion information includes, for example, the session ID "se01" included in the relay device selection information.

In steps S1509a and S1509b, the transmitting/receiving units 11 of the starting terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) use the device ID and session ID of the relay device 3 included in the relay device selection information. and establishes a session with the relay device 3. As a result, the electronic whiteboard 1a and the electronic whiteboard 1b can participate in the session with the same session ID "se01" and can mutually send and receive video data such as conference video, audio data, etc. via the relay device 3. become.

Through the above processing, a video conference can be held between the user A of the electronic whiteboard 1a and the user B of the electronic whiteboard 1b, in which conference images and the like are transmitted and received.

<Page data sharing process>
In the communication system 100, a user A of the electronic blackboard 1a and a user B of the electronic blackboard 1b who are participating in a video conference share stroke images drawn with the electronic pen 140 or the like on each electronic blackboard 1 as a shared image. can be displayed on the electronic blackboard 1.

Further, for example, the user A of the electronic whiteboard 1a may share a document image such as a captured image of a display screen displayed on the display of the PC 150 connected to the electronic whiteboard 1a, together with a stroke image. can be displayed on the electronic blackboard 1b as follows.

In this embodiment, data for displaying a shared image (for example, stroke data for reproducing a stroke image, image data for displaying a material image, etc.) is referred to as page data. Furthermore, here, an example of a process for sharing page data between the electronic blackboard 1a and the electronic blackboard 1b participating in the same session will be described.

FIG. 16 is a sequence diagram illustrating an example of page data sharing processing according to an embodiment. It is assumed that, at the start of the process shown in FIG. 16, the electronic whiteboard 1a and the electronic whiteboard 1b are participating in the same session, for example, by the session start process described with reference to FIG.

In step S1601, when the electronic blackboard 1a receives image data of a document image or stroke data of a stroke image drawn on the electronic blackboard 1a by user A, processing from step S1602 onwards is executed.

In step S1602, the page information transmitting unit 16 of the electronic whiteboard 1a requests the management device 5 to obtain a page data URL, which is URL information indicating a storage location of page data.

Note that the URL information is an example of address information indicating the storage location of page data, the acquisition location of page data, and the like. The address information indicating the storage location of the page data, the acquisition location of the page data, etc. may be other address information such as a URI (Uniform Resource Identifier).

In step S1603, the page information management unit 58 of the management device 5 generates a page data URL indicating the storage location of the page data. Further, the page information management unit 58 stores the generated page data URL in the storage unit 5000 or the like in association with the session ID “se01” of the session in which the requesting electronic whiteboard 1a participates.

In step S1604, the page information management unit 58 of the management device 5 transmits the generated page data URL to the requesting electronic whiteboard 1a.

In step S1605, the page information transmitting unit 16 of the electronic whiteboard 1a transmits (uploads) page data to the URL in the page data storage device 7 indicated by the page data URL.

In step S1606, the storage/read processing unit 72 of the page data storage device 7 stores the page data transmitted from the electronic whiteboard 1a in the URL in the storage unit 7000.

Here, the page data includes, for example, stroke data, image data, etc. as shown in FIG. 17.

FIG. 17 is a diagram illustrating an example of stroke data and image data according to an embodiment. FIG. 17(a) shows an image of an example of stroke data. A stroke image is represented by one or more stroke data as shown in each row of FIG. 17(a), for example. Each stroke data includes information such as a stroke data ID, start time, end time, color, width, and coordinate array ID.

Stroke data ID is identification information for identifying stroke data. The start time and end time are information indicating the time when writing one stroke started and the time when writing ended, respectively. The color and width are information indicating the color and width of the stroke, respectively. The coordinate array data ID is, for example, identification information for identifying coordinate array data indicating an array of passing points of a stroke, as shown in FIG. 17(b).

FIG. 17(b) shows an image of an example of coordinate array data. The coordinate array data includes a point (X coordinate value, Y coordinate value) on the display 160, the time difference (ms) from the stroke start time when passing this point, and the electronic pen 140 at this point. Shows information about pen pressure.

For example, in FIG. 17A, stroke data with stroke ID "s001" includes array data ID "c001". This indicates that the stroke data with the stroke ID "s001" is represented by a plurality of points included in the tab "c001" in the coordinate array data of FIG. 17(b). For example, when a user draws the alphabet "S" with the electronic pen 140, it is written in one stroke, but since the user passes through multiple passing points before finishing drawing "S", the coordinate array data is used to draw the alphabet "S" in one stroke. Shows information on passing points.

FIG. 17(c) shows an image of an example of image data. For example, as shown in FIG. 17C, the image data includes information such as media data ID, data type, recording time, X coordinate value, Y coordinate value, width, height, and data.

Media data ID is identification information that identifies image data. The data type is information indicating the type of image data. The recording time is information indicating the time when the image data was stored. The X coordinate value and the Y coordinate value are information indicating the position (coordinates) of the image displayed on the display 160 based on the image data, and the width and height are information indicating the size of the image displayed based on the image data. It is. The data is image data for displaying captured images and the like.

Now, returning to FIG. 16, the explanation of the sequence diagram will be continued.

In step S1607, the page information transmitting unit 16 of the electronic whiteboard 1a transmits the page data URL for acquiring the page data uploaded to the page data storage device 7 to the management device 5, for example, in session sei.

In step S1608, the page information management unit 58 of the management device 5 transmits the page data URL received in step S1607 to the electronic blackboard 1b participating in the same session as the electronic blackboard 1a in the session sei.

In steps S1609 and S1610, the page information acquisition unit 17 of the electronic whiteboard 1b acquires page data from the page data storage device 7 using the page data URL that the transmission/reception unit 11 received from the management device 5.

In step S1608, the image processing unit 15 of the electronic whiteboard 1b creates a stroke image using the stroke data included in the page data acquired by the page information acquisition unit 17. Further, if the page data acquired by the page information acquisition unit 17 includes image data such as a captured image, the image processing unit 15 creates a shared image including the stroke image and the captured image. As a result, for example, the shared image displayed on the electronic whiteboard 1b is updated (or created).

Through the above processing, the communication system 100 can display, for example, stroke data, image data, etc. received by the electronic whiteboard 1a as a shared image on another electronic whiteboard 1b participating in the same session. Furthermore, through similar processing, the communication system 100 can display stroke data, image data, etc. received by the electronic blackboard 1b as a shared image on other electronic blackboards 1a participating in the same session.

The above describes the process when a session is performed between the electronic whiteboard 1a and the electronic whiteboard 1b to share shared images including stroke images. Next, a description will be given of a process when the electronic whiteboard 1c joins a session being held between the electronic whiteboard 1a and the electronic whiteboard 1b midway through.

[First embodiment]
In a session for sharing a shared image including a stroke image, for example, by the page data sharing process shown in FIG. has been accumulated.

As a result, when the electronic blackboard 1c joins a session being held between the electronic blackboard 1a and the electronic blackboard 1b midway through, the electronic blackboard 1c can display multiple page data stored in the page data storage device 7. You can retrieve the stroke image and play the stroke image.

However, with this method, if the amount of page data stored in the page data storage device 7 is large, there is a problem that it takes time after the electronic whiteboard 1c participates in a session until it displays the shared image. be. Therefore, for example, after the user C of the electronic whiteboard 1c participates in the session, he or she may not be able to participate in the discussion until the shared image is correctly displayed.

Therefore, in the first embodiment, the electronic blackboard 1c, which joins a session held between the electronic blackboard 1a and the electronic blackboard 1b midway through, posts a shared image including a stroke image after participating in the session. An example of processing for shortening the time until display will be described.

<Processing flow>
(Preparatory stage processing)
FIG. 18 is a sequence diagram illustrating an example of preparation stage processing according to the first embodiment. This process is an example of a preparatory process executed before the electronic whiteboard 1 participates in a session (video conference) in the communication system 100 according to the first embodiment.

In step S1801, the electronic whiteboard 1a and the electronic whiteboard 1b participate in the session with session ID "se01" by, for example, the process shown in FIG. 15, and share page data by the process shown in FIG. shall be taken as a thing. Further, it is assumed that a plurality of page data including stroke data for reproducing a stroke image are accumulated in the page data storage device 7.

In step S1802, for example, when the power switch 117 of the electronic whiteboard 1c is turned on, the reception unit 12 accepts the power-on request.

In step S1803, the transmitting/receiving unit 11 of the electronic whiteboard 1c transmits login request information requesting login to the management device 5.

Thereby, in step S1804, for example, preparation stage processing as shown in steps S24 to S40 in FIG. 13 is performed on the electronic whiteboard 1c. Furthermore, in the communication system 100 according to the first embodiment, processes such as those shown in steps S1805 to S1810 are executed.

In steps S1805 and S1806, the information acquisition unit 56 of the management device 5 acquires, for example, the conference schedule information of the user C of the electronic whiteboard 1c who logged into the communication system 100 in step S1804 from the schedule management device 502.

For example, the information acquisition unit 56 uses a user information management table 1200 as shown in FIG. do. Furthermore, the information acquisition unit 56 uses the acquired information about the user C to acquire conference schedule information that is managed by the schedule management device 502 and includes the scheduled start time of the conference in which the user C participates.

FIG. 19 is a diagram illustrating an example of conference schedule information according to the first embodiment. In the example of FIG. 19, the conference schedule information 1900 includes information such as "meeting name", "user", "scheduled start date and time", and "scheduled end date and time". The "meeting name" information is an example of information for identifying a meeting, and may be a meeting ID or the like. The "participant" information is information for identifying users (participants) who are scheduled to participate in the conference, and may be a user ID or the like. The "scheduled start date and time" information is information indicating the scheduled date and time when the conference is scheduled to start. The "scheduled end date and time" information is an example of information indicating the scheduled end date and time of the meeting, and may be information such as the required time of the meeting, for example.

In the example of FIG. 19, user C of electronic whiteboard 1c is included in the participants of conference A. In this case, the information acquisition unit 56 acquires information about a conference A in which the user C of the electronic whiteboard 1c who has logged in to the communication system 100 is scheduled to participate, from the schedule management device 502, for example. Note that the conference schedule information 1900 as shown in FIG. 19 may be managed within the communication management system 500.

Now, returning to FIG. 18, the explanation of the sequence diagram will be continued.

In step S1807, the information providing unit 57 of the management device 5 refers to the conference schedule information, the user information management table 1200, the session management table 1000, etc. acquired by the information acquisition unit 56, and determines which session the electronic whiteboard 1c is scheduled to participate in. Identify.

For example, the information providing unit 57 determines from the obtained conference schedule information that user C is scheduled to participate in conference A scheduled to be held from 13:40 on April 10, 2015, in which user A and user B will participate. Identify that.

Further, if the current time is within the scheduled time for conference A, the information providing unit 57 selects the terminal ID "01aa" corresponding to user A from the user information management table 1200 as shown in FIG. The terminal ID "01ba" corresponding to user B is acquired.

Furthermore, from the session management table 1000 as shown in FIG. Identify the session you plan to attend.

Here, if a session in which the electronic whiteboard 1c is scheduled to participate can be identified, the processes of steps S1808 to S1810 are executed.

In step S1808, the information providing unit 57 of the management device 5 associates one or more page data URLs managed by the page information management unit 58 with the session ID “se01” of the session identified in step S1807. Send (provide) to the electronic blackboard 1c. Note that the one or more page data URLs are an example of information for displaying a shared image shared in the session with the session ID "se01".

In steps S1809 and S1810, the page information acquisition unit 17 of the electronic whiteboard 1c acquires page data from the page data storage device 7 using one or more page data URLs provided by the management device 5. Note that when there are multiple page data URLs, the page information acquisition unit 17 acquires page data from the page data storage device 7 by the number of page data URLs. Further, the image processing unit 15 of the electronic blackboard 1c reproduces (creates) a stroke image using the stroke data included in the page data acquired by the page information acquisition unit 17.

In step S1811, when the electronic whiteboard 1c, which is a participating terminal that joins a session in progress, receives an operation by user C to participate in the session, the process in step S1812 is executed. For example, user C can participate in a session by selecting a destination whose status is an "online (communicating)" icon on the destination list screen 1400 shown in FIG. can.

In step S1812, the transmitting/receiving unit 11 of the electronic whiteboard 1c starts call control for the electronic whiteboard 1c to participate in the session by transmitting participation request information requesting participation in the session to the management device 5.

As described above, according to the present embodiment, a participating terminal (electronic whiteboard 1c) that joins a session that is being held midway through, before starting call control for participating in the session, Page data for displaying images can be obtained. Thereby, the participating terminal (electronic whiteboard 1c) can quickly display the shared image when participating in the session.

Therefore, according to the present embodiment, a terminal device that joins a session in the middle of a session in which shared images including stroke images are shared among a plurality of terminal devices (electronic blackboard 1) displays the shared images after participating in the session. The time it takes to do so can be shortened.

(Participation process in session)
FIG. 20 is a sequence diagram illustrating an example of session participation processing according to the first embodiment. This process is an example of a participation process in which the electronic whiteboard 1c, which is an example of a participating terminal, joins a session being held between the electronic whiteboard 1a and the electronic whiteboard 1b midway through.

In steps S2001 and S2002, it is assumed that the electronic whiteboard 1a and the electronic whiteboard 1b establish a session with the relay device 3 and participate in the session with the session ID "se01", for example.

In steps S2003 and S2004, when the electronic whiteboard 1c receives the user C's operation to participate in the session, it transmits participation request information requesting participation in the session to the management device 5. This participation request information includes, for example, the terminal ID (participating terminal ID) of the electronic blackboard 1c that is a participating terminal, the terminal ID (starting terminal ID, destination terminal ID, etc.). Note that this process corresponds to the processes of steps S1811 and S1812 in FIG.

In step S2005, the terminal management unit 53 of the management device 5 updates the terminal management table 800 as shown in FIG. 8 based on the terminal ID (participating terminal ID) of the electronic whiteboard 1c included in the participation request information. For example, the terminal management unit 53 updates the "operating status" corresponding to the terminal ID "01ca" of the electronic whiteboard 1c to "online (communicating)".

Note that the processing from step S2006 onward may be executed automatically, or participation request information may be sent to the electronic blackboards 1a and 1b that are already participating in the session, so that user A or user B can It may also be executed in response to a response operation. Here, the following explanation will be given assuming that the processing from step S2006 onwards is automatically executed.

In step S2006, the session management unit 54 of the management device 5 updates the session management table 1000 as shown in FIG. For example, in the session management table 1000, the session management unit 54 adds the electronic blackboard 1c, which is a participating terminal, to the record of "terminal ID of participating terminal" of the session (session ID "se01") including the starting terminal ID "01aa". Store the terminal ID “01ca”.

In step S2007, the session management unit 54 of the management device 5 transmits relay device selection information to the electronic whiteboard 1c, which is a participating terminal. This relay device selection information includes, for example, the session ID “se01” of the session in which the terminal ID of the electronic whiteboard 1c was stored in step S2006, the IP address of the relay device 3, and the like.

In step S2008, upon receiving the relay device selection information, the electronic whiteboard 1c transmits reception completion information indicating that the relay device selection information has been received to the management device 5. This reception completion information includes, for example, the session ID "se01".

In step S2009, the transmitting/receiving unit 11 of the electronic whiteboard 1c establishes a session with the relay device 3 using the IP address and session ID of the relay device 3 included in the relay device selection information. As a result, the electronic whiteboard 1c participates in the session with the same session ID "se01" as the electronic whiteboards 1a and 1b, and sends and receives video data, audio data, etc. to and from the electronic whiteboards 1a and 1b via the relay device 3. You will be able to do this.

(Page data sharing process)
FIG. 21 is a sequence diagram illustrating an example of page data sharing processing according to the first embodiment. This process is executed on page data in the communication system 100 when the electronic blackboard 1c participates in a session held between the electronic blackboard 1a and the electronic blackboard 1b by the session participation process shown in FIG. An example of shared processing is shown below.

In step S2101, it is assumed that the electronic blackboard 1c participates in the session with the session ID "se01" held between the electronic blackboard 1a and the electronic blackboard 1b through the session participation process shown in FIG.

In step S2102, the image processing unit 15 of the electronic whiteboard 1c uses one or more page data acquired in the preparatory stage process shown in FIG. Create shared images such as captured images and stroke images. Note that the process of creating a shared image such as a captured image or a stroke image may be executed before step S2101.

Further, the display control unit 14 of the electronic blackboard 1c causes the display 160 to display a session display screen including the shared image created by the image processing unit 15.

FIG. 22 is a diagram showing an example of a display screen according to the first embodiment. This figure shows an image of an example of a display screen 2200 displayed by the electronic blackboard 1c, which is a participating terminal, in step S2101 of FIG. 21, for example. In the example of FIG. 22, the display screen 2200 includes a stroke image 2201 shared between the electronic blackboard 1a and the electronic blackboard 1b, a document image 2202, a meeting video 2203 of base A, a conference video 2204 of base B, and A meeting video 2205 of the base, etc. is displayed.

Among these display elements, the stroke image 2201 is created by the image processing unit 15 of the electronic blackboard 1c using stroke data (see FIG. 17) included in one or more page data acquired in the preparatory stage processing. Ru. The material image 2202 is created by the image processing unit 15 of the electronic blackboard 1c using image data (see FIG. 17) included in one or more page data acquired in the preparation stage process.

Furthermore, the meeting video 2203 of base A and the conference video 2204 of base B are created by the video/sound processing unit 13 of the electronic blackboard 1c, etc., based on the video data received by the transmitting/receiving unit 11 of the electronic blackboard 1c. The conference video 2205 of the own site is created by the video/sound processing unit 13 of the electronic blackboard 1c based on video data captured by the camera 134 of the electronic blackboard 1c. Note that the display screen 2200 may further display various operation buttons such as a "share" button 2206 that accepts an operation to share a document image.

Now, returning to FIG. 21, the explanation of the sequence diagram will be continued.

In step S2103, for example, when the electronic blackboard 1b receives image data of a document image or stroke data of a stroke image drawn on the electronic blackboard 1b by user B, the processes from step S2104 onwards are executed.

In step S2104, the page information transmitting unit 16 of the electronic whiteboard 1b requests the management device 5 to acquire the page data URL, which is URL information indicating the storage location of the page data.

In step S2105, the page information management unit 58 of the management device 5 generates a page data URL indicating the storage location of the page data. Further, the page information management unit 58 stores the generated page data URL in the storage unit 5000 or the like in association with the session ID “se01” of the session in which the requesting electronic whiteboard 1b participates.

In step S2106, the page information management unit 58 of the management device 5 transmits the generated page data URL to the requesting electronic whiteboard 1b.

In step S2107, the page information transmitting unit 16 of the electronic whiteboard 1b uploads page data to the URL in the page data storage device 7 indicated by the page data URL.

In step S2108, the storage/read processing unit 72 of the page data storage device 7 stores the page data transmitted from the electronic whiteboard 1b in the URL in the storage unit 7000.

In step S2109, the page information transmitting unit 16 of the electronic whiteboard 1b transmits the page data URL for acquiring the page data uploaded to the page data storage device 7 in step S2107 to the management device 5, for example, in session sei. .

In steps S2110 and S2111, the page information management unit 58 of the management device 5 transmits the page data URL received in step S2109 to the electronic blackboards 1a and 1c participating in the same session as the electronic blackboard 1b, for example, in session sei. Send.

In steps S2112 and S2113, the page information acquisition unit 17 of the electronic whiteboard 1c uses the page data URL received from the management device 5 to acquire the page data uploaded to the page data storage device 7 in step S2107.

In step S2114, the image processing unit 15 of the electronic whiteboard 1c creates a stroke image using one or more stroke data included in the page data acquired by the page information acquisition unit 17. Furthermore, if the page data acquired by the page information acquisition unit 17 includes image data of a document image, the image processing unit 15 creates the document image. Furthermore, the display control unit 14 of the electronic blackboard 1c uses the stroke images, document images, etc. created by the image processing unit 15 to update the shared images (stroke images 2201, document images 2202, etc.) displayed on the display screen 2200. Update.

Similarly, in steps S2115 and S2116, the page information acquisition unit 17 of the electronic whiteboard 1a uses the page data URL received from the management device 5 to acquire the page data uploaded to the page data storage device 7 in step S2107. do.

In step S2117, the image processing unit 15 of the electronic whiteboard 1a creates a stroke image using one or more stroke data included in the page data acquired by the page information acquisition unit 17. Furthermore, if the page data acquired by the page information acquisition unit 17 includes image data of a document image, the image processing unit 15 creates the document image. Further, the display control unit 14 of the electronic blackboard 1a updates the shared images (stroke image 2201, document image 2202) displayed on the display screen 2200 using the stroke image, document image, etc. created by the image processing unit 15.

Through the above processing, the communication system 100 can display, for example, stroke data, image data, etc. received by the electronic blackboard 1b as a shared image on the other electronic blackboards 1a and 1c participating in the same session. . Further, through similar processing, the communication system 100 can display stroke data, image data, etc. received by the electronic blackboard 1a as a shared image on other electronic blackboards 1b and 1c participating in the same session. . Further, through similar processing, the communication system 100 can display stroke data, image data, etc. received by the electronic blackboard 1c as a shared image on other electronic blackboards 1a and 1b participating in the same session. .

In addition, through the above process, when the electronic blackboard 1c, which is a participating terminal, joins a session held between the electronic blackboard 1a and the electronic blackboard 1b midway through, the electronic blackboard 1c, which is a participating terminal, immediately uses the acquired page data to Shared images can be displayed.

As described above, according to the first embodiment, in a terminal device that joins a session in the middle of a session in which shared images including stroke images are shared among a plurality of terminal devices (electronic blackboard 1), the shared image is not displayed after participating in the session. The time it takes to display the image can be shortened.

[Second embodiment]
In the first embodiment, for example, as shown in FIG. 18, when the electronic blackboard 1c, which is a participating terminal, logs into the management device 5, the management device 5 stores the page data of the session that the electronic blackboard 1c plans to participate in. An example of processing when providing a URL to the electronic whiteboard 1c has been described.

In the second embodiment, an example of processing will be described in which the management device 5 provides the electronic whiteboard 1c that has already logged into the management device 5 with the page data URL of the session that the electronic blackboard 1c is scheduled to participate in. .

(Page data provision processing)
FIG. 23 is a sequence diagram illustrating an example of page data provision processing according to the second embodiment. In this process, the management device 5 provides the electronic blackboard 1c, which is a participating terminal that has already logged into the management device 5, with information for displaying a shared image shared in a session in which the electronic blackboard 1c is scheduled to participate. An example of processing is shown below. Note that the processes from step S1809 onward in FIG. 23 are similar to the page data sharing process according to the first embodiment described in FIG. conduct.

In step S2301, it is assumed that the electronic whiteboard 1c, which is a participating terminal, has already logged into the management device 5 through the preparatory process shown in FIG. 13, for example. Note that the electronic whiteboard 1c that has already logged into the management device 5 is an example of a terminal device that has logged into the communication management system 500.

In step S2302, the electronic whiteboard 1a, which is the starting terminal, and the electronic whiteboard 1b, which is the destination terminal, have participated in the same session by, for example, the session start process shown in FIG. 15, and the page as shown in FIG. It is assumed that a meeting (video conference, etc.) is being held through data sharing processing.

In steps S2303 and S2404, the information acquisition unit 56 of the management device 5 acquires schedule information of the meeting currently being held between the electronic whiteboard 1a and the electronic whiteboard 1b.

For example, the information acquisition unit 56 uses a session management table 1000 as shown in FIG. 10 to acquire the terminal ID of the electronic whiteboard 1 participating in the conference being held. For example, the information acquisition unit 56 obtains, from the session management table 1000 as shown in FIG. get.

Further, the information acquisition unit 56 acquires user information (user ID, user name, etc.) corresponding to the terminal IDs "01aa" and "01ba" using a user information management table 1200 as shown in FIG. 12, for example. .

Furthermore, the information acquisition unit 56 transmits a request to acquire schedule information including the specified user information (user ID, user name, etc.) to the schedule management device 502, so that the information acquisition unit 56 can send a schedule information acquisition request including the specified user information (user ID, user name, etc.) to the schedule management device 502. ” to get schedule information.

If the schedule information of the conference being held can be obtained through this processing, the processing from step S2305 onwards is executed.

In step S2305, the information providing unit 57 of the management device 5 identifies participating terminals that have already logged in to the management device 5 from among the participating terminals scheduled to participate in the conference.

For example, the information providing unit 57 uses the schedule information of the meeting name "Meeting A" shown in FIG. 19 and the user information management table 1200 shown in FIG. Obtain "01aa", "01ba", and "01ca".

Furthermore, the information providing unit 57 uses a session management table 1000 as shown in FIG. ``se01'' session). Furthermore, the information providing unit 57 specifies the terminal ID "01ca" of the participating terminal that has not yet participated in the session among the terminal IDs "01aa", "01ba", and "01ca" of the electronic whiteboard 1 scheduled to participate in the conference. do.

Furthermore, the information providing unit 57 uses a terminal management table 800 as shown in FIG. to decide. In the example of FIG. 8, the operating state of the electronic whiteboard 1 that has already been logged into the management device 5 is represented as "online."

As a result of the above processing, if there is a participating terminal that is already logged in to the management device 5 among the participating terminals that are scheduled to join the ongoing session (conference) midway through, the processing from step S2306 onwards is executed. Here, the following explanation will be given assuming that there is a logged-in electronic blackboard 1c scheduled to participate in the session being held (session ID "se01").

In step S2306, the information providing unit 57 of the management device 5 associates the electronic blackboard 1c, which is the participating terminal identified in step S2305, with the session ID "se01", and links it to one page managed by the page information management unit 58. The above page data URL is provided.

The processing after step S1809 is similar to the processing according to the first embodiment described in FIG. 18.

Through the above process, the management device 5 provides the electronic blackboard 1c, which is a logged-in participating terminal, with the page data URL for displaying the shared image shared in the conference (session) that the electronic blackboard 1c is scheduled to participate in. can be provided.

As a result, in the second embodiment as well, in a terminal device that joins a session in the middle of a session in which shared images including stroke images are shared among a plurality of terminal devices (electronic blackboard 1), the shared image cannot be changed after participating in the session. The time it takes to display the image can be shortened.

As described above, according to each embodiment of the present invention, in a terminal device that joins a session in the middle of a session in which a shared image including a stroke image is shared between a plurality of terminal devices, the process from joining the session to displaying the shared image is It can save time.

<Supplement>
Each function of each embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules.

Further, in each of the embodiments described above, the terminal device is the electronic whiteboard 1, but the terminal device is not limited to this. Other examples of terminal devices include information terminals such as PCs, smartphones, smart watches, and car navigation devices that execute applications compatible with the communication system 100. Furthermore, communication terminals include medical equipment. In the case of medical equipment, the document images include images of patients and the like.

Further, in each of the embodiments described above, a case where a video conference is held using the communication system 100 has been described, but the present invention is not limited to this, and is not limited to a meeting, a general conversation between family members or friends, remote diagnosis, or , may be used to present information in one direction.

1 Electronic blackboard (terminal device)
7 Page data storage device (page data storage unit)
16 Page information transmission unit 17 Page information acquisition unit 56 Information acquisition unit 57 Information provision unit 100 Communication system 500 Communication management system (communication management device)
502 Schedule management device (schedule management system)

Japanese Patent Application Publication No. 2011-254453 JP 2015-70543 Publication

Claims (8)

A terminal device that establishes a session with another terminal device via a management device and displays a shared image including a shared stroke image, the terminal device comprising:
information for displaying the shared image shared in the session before starting call control for participating in the session midway through, based on session information obtained by logging into the management device; an acquisition unit that acquires from the management device ;
Display control means for displaying the shared image on a display screen when participating in the session based on information for displaying the shared image acquired by the acquisition unit from the management device ;
A terminal device having: It has a reception section that accepts a participation operation to join the session from the middle,
When the reception unit receives the participation operation, the acquisition unit acquires information for displaying the shared image shared in the session before participating in the session midway through.
The terminal device according to claim 1. A communication system that displays a shared image including a shared stroke image on a terminal device via a communication management system that manages sessions of a plurality of terminal devices, the communication system comprising:
The terminal device is
a reception unit that accepts a request to join the session midway through;
a transmitting unit that transmits the request received by the receiving unit to the communication management system,
The communication management system includes:
Based on the request received from the transmission unit, before starting call control for participating in the session midway through, the session is transmitted based on the session information notified to the terminal device logged into the communication management system. an information providing unit that provides the terminal device with information for displaying the shared image shared by the
A communication system with A terminal device that establishes a session with another terminal device via a management device and displays a shared image including a shared stroke image,
Information for displaying the shared image shared in the session before starting call control for participating in the session midway through, based on session information obtained by logging into the management device. an acquisition process of acquiring from the management device ;
Display control processing for displaying the shared image on a display screen when participating in the session based on information for displaying the shared image acquired from the management device in the acquisition process;
How to communicate. the terminal device executes a reception process for accepting a participation operation to join the session midway;
The acquisition process includes, upon receiving the participation operation in the reception process, acquiring information for displaying the shared image shared in the session before joining the session midway through.
The communication method according to claim 4. A terminal device that establishes a session with another terminal device via a management device and displays a shared image including a shared stroke image,
information for displaying the shared image shared in the session before starting call control for participating in the session midway through, based on session information obtained by logging into the management device; an acquisition process of acquiring from the management device ;
Display control processing for displaying the shared image on a display screen when participating in the session based on information for displaying the shared image acquired from the management device in the acquisition process;
A program to run. causing the terminal device to execute a reception process for accepting a participation operation to join the session midway through;
The acquisition process includes, upon receiving the participation operation in the reception process, acquiring information for displaying the shared image shared in the session before joining the session midway through.
The program according to claim 6. In a communication system that displays a shared image including a shared stroke image on a terminal device via a communication management system that manages sessions of a plurality of terminal devices,
The terminal device is
a reception process that accepts a request to join the session midway;
a transmission process of transmitting the request accepted in the reception process to the communication management system;
Run
The communication management system includes:
Based on the session information notified to the terminal device logged into the communication management system , before starting call control for participating in the session from the middle based on a request received from the terminal device, executing an information providing process for providing the terminal device with information for displaying the shared image shared by the terminal device;
Communication method.

Images