JP2022043668A - Communication terminal, communication system, communication method, and program - Google Patents

Abstract

To provide a communication terminal, a communication system, a communication method, and a program for allowing the communication terminal to share a display screen with a plurality of terminals to exchange information.SOLUTION: In a communication system 100 in which a plurality of electronic blackboards 1a, 1b... 1t, a relay device 3, a communication management device 5, and an image storage device 7 are connected with a communication network 200, the communication terminal (electronic blackboard) is a communication terminal that shares image data with the plurality of terminals, and has: a display control unit that displays the image data; a receiving unit that receives a predetermined operation; and a page information management unit that, based on the predetermined operation received by the receiving unit, reproduces the image data displayed on the communication terminal in a number equal to the number of the plurality of terminals and stores them as different pieces of image data.SELECTED DRAWING: Figure 6

Description

The present invention relates to communication terminals, communication systems, communication methods, and programs.

A communication system that shares a display screen among a plurality of communication terminals via a communication network such as the Internet has become widespread.

For example, a communication system for sharing a stroke image by transmitting and receiving stroke data for reproducing a stroke image drawn by a user with an electronic pen or a hand between communication terminals is known (for example, a patent document). See 1).

In addition, text information is performed between the communication terminal of the instructor and the communication terminal of each student while communicating between the communication terminal of the instructor and the communication terminals of a plurality of students and maintaining the communication. There are known communication systems that exchange one-to-one communication (see, for example, Patent Document 2).

For example, in a communication system as shown in Patent Document 2, there is a communication system in which character information is exchanged one-to-one between a communication terminal on the instructor side and a terminal on the student side.

However, when there are multiple terminals on the student side and text information is exchanged between the terminal on the instructor side and each of the terminals on the multiple student sides, the display screen of the terminal on the instructor side can be shared with multiple terminals on the student side. However, it is not possible to exchange information with each of a plurality of terminals.

One embodiment of the present invention has been made in view of the above problems, and shares the display screen of a communication terminal with a plurality of terminals so that information can be exchanged.

In order to solve the above problems, the communication terminal according to the embodiment of the present invention is a communication terminal that shares image data with a plurality of terminals, and receives a display control unit for displaying image data and a predetermined operation. A reception unit and a page information management unit that duplicates the image data displayed on the communication terminal for the plurality of terminals and stores the image data as different image data based on the predetermined operation received by the reception unit. Have.

According to one embodiment of the present invention, the display screen of a communication terminal can be shared with a plurality of terminals to exchange information.

It is a schematic diagram which shows an example of the communication route in the communication system which concerns on one Embodiment. It is a figure for demonstrating the use image of the electronic blackboard which concerns on one Embodiment. It is a figure which shows an example of the hardware composition of the electronic blackboard which concerns on one Embodiment. It is a figure which shows an example of the hardware composition of the communication management apparatus, the relay apparatus and the image storage apparatus which concerns on one Embodiment. It is a figure which shows an example of the system configuration of the communication system which concerns on one Embodiment. It is a figure which shows an example of the functional structure of the communication system which concerns on one Embodiment. It is a conceptual diagram which shows an example of the page information which concerns on one Embodiment. It is a conceptual diagram which shows an example of the operation information which concerns on one Embodiment. It is a conceptual diagram which shows an example of the authentication management table which concerns on one Embodiment. It is a conceptual diagram which shows an example of the terminal management table which concerns on one Embodiment. It is a conceptual diagram which shows an example of the destination list management table which concerns on one Embodiment. It is a conceptual diagram which shows an example of the session management table which concerns on one Embodiment. It is a conceptual diagram which shows an example of the relay device management table which concerns on one Embodiment. It is a conceptual diagram which shows an example of the shared data management table which concerns on one Embodiment. It is a conceptual diagram which shows an example of the shared state management table which concerns on one Embodiment. It is a sequence diagram which shows an example of the process of the preparation stage which concerns on one Embodiment. It is a figure which shows an example of the destination list screen displayed by the electronic blackboard which concerns on one Embodiment. It is a sequence diagram which shows the example of the session start processing which concerns on one Embodiment. It is a sequence diagram which shows an example of the participation processing to the session which concerns on one Embodiment. It is a sequence diagram which shows the example of the screen sharing processing in the lecture mode which concerns on 1st Embodiment. It is a figure (1) which shows the example of the display screen of the electronic blackboard which concerns on 1st Embodiment. It is a sequence diagram (1) which shows the example of the screen sharing processing in the answer mode which concerns on 1st Embodiment. It is a figure which shows the example of the lecture information which concerns on 1st Embodiment. It is a sequence diagram (2) which shows the example of the screen sharing processing in the answer mode which concerns on 1st Embodiment. It is a figure (2) which shows the example of the display screen of the electronic blackboard which concerns on 1st Embodiment. It is a sequence diagram (1) which shows the example of the screen sharing processing after the end of the answer mode which concerns on 1st Embodiment. It is a sequence diagram (1) which shows the example of the screen sharing processing after the end of the answer mode which concerns on 1st Embodiment. It is a sequence diagram which shows the example of the call control processing in the answer mode which concerns on 2nd Embodiment.

Hereinafter, embodiments for carrying out the invention will be described with reference to the drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted.

[Outline of communication system]
First, with reference to FIG. 1, a communication system for conducting a video conference, a distance lecture, or the like while drawing between a plurality of electronic blackboards 1a and 1b, which is a premise of the present embodiment, will be described. FIG. 1 is a schematic diagram showing an example of a communication route in a communication system according to an embodiment. The "video conference" may be referred to as a "video conference", a "remote conference", or the like. In addition, "distance lecture" may be called "distance lesson", "distance lesson" or the like.

Further, "video conference", "distance lecture", etc. are examples of sessions (communication) in which a page to be displayed on a display screen is shared among a plurality of terminals. The session for sharing the page to be displayed on the display screen may be, for example, another session for performing a remote examination, a remote test, a remote investigation, a meeting, a simple conversation, or the like. In addition, a session that shares a page to be displayed on the display screen may be used for presenting information in one direction.

The communication system is constructed by, for example, a plurality of electronic blackboards 1a and 1b, a relay device 3, a communication management device 5, and an image storage device 7. The electronic blackboards 1a and 1b mutually communicate image data and sound data for a call, and content data such as image data and stroke data for sharing. The stroke data is data necessary for reproducing (reproducing) the stroke image, and indicates, for example, coordinate data, line width data, line color data, vector data, and pen pressure when the stroke is drawn. Includes data etc. Further, the stroke data is transmitted and received as a character string serialized by, for example, the electronic blackboards 1a and 1b. The electronic blackboards 1a and 1b can make a remote video call by reproducing the base image and sound of the base of the other party by transmitting and receiving image data and sound data for a call.

By transmitting and receiving image data of the background image for sharing on the electronic blackboards 1a and 1b, participants using the communication system can share the same background image. The background image is an image displayed on the display of the electronic blackboard 1. The background image includes, for example, a material image in which electronic files such as conference materials and lecture materials are displayed on the display 180. The image data of the background image is transmitted and received in a file format such as JPEG (Joint Photographic Experts Group). Further, the electronic blackboards 1a and 1b can share the same stroke image by the participants who use the communication system by transmitting and receiving the stroke data of the stroke image for sharing. The stroke image is an image showing a line or the like drawn by a user with a handwritten stroke with an electronic pen or the like. The stroke image is displayed by stroke data indicating a point that specifies a coordinate on the display.

The communication system is not limited to the two electronic blackboards 1a and 1b, and may be constructed by three or more electronic blackboards. Hereinafter, when the generic names of the electronic blackboards 1a and 1b are shown, they are referred to as "electronic blackboard 1". Further, the electronic blackboard 1 is an example of a communication terminal having a communication function, a drawing function, a display function, and the like. The communication terminal may be, for example, a PC (Personal Computer), a smartphone, a tablet terminal, a smart watch, a car navigation terminal, a game machine, a telepresence robot, or the like in which an application program corresponding to a communication system is installed. Further, the communication terminal may be a medical device. In the case of a medical device, the background image is the patient's image.

FIG. 1 shows an electronic blackboard equipped with a video conference function as an example of the electronic blackboards 1a and 1b. The base image related to the base image data may be a moving image or a still image.

Further, in the following description, the electronic blackboard as a request source for requesting the start of a video conference may be referred to as a "start terminal", and the electronic blackboard as a destination (relay destination) as a request destination may be referred to as a "destination terminal". be. For example, in FIG. 1, when requesting the start of a video conference from the electronic blackboard 1a, the electronic blackboard 1a is the start terminal and the electronic blackboard 1b is the destination terminal. When requesting the start of the video conference from the electronic blackboard 1b, the electronic blackboard 1b becomes the start terminal and the electronic blackboard 1a becomes the destination terminal. The electronic blackboards 1a and 1b are used not only for communication between a plurality of business establishments and between different rooms in the same business establishment, but also for communication within the same room, outdoors and indoors, or outdoors and outdoors. It may be used in the communication of.

The relay device 3 is configured by a computer and performs a process of relaying content data for a call between a plurality of electronic blackboards 1a and 1b.

The communication management device 5 is configured by a computer and centrally manages login authentication from the electronic blackboards 1a and 1b, management of the communication status of the electronic blackboards 1a and 1b, management of the destination list, communication status of the relay device 3, and the like. do. Further, the communication management device 5 relays the stroke data for sharing between the plurality of electronic blackboards 1a and 1b.

The image storage device 7 is configured by a computer, stores image data of a background image for sharing uploaded from the electronic blackboard 1a, and downloads the image data to the electronic blackboard 1b. And vice versa. That is, the image storage device 7 stores the image data uploaded from the electronic blackboard 1b and downloads it to the electronic blackboard 1a.

The relay device 3, the communication management device 5, and the image storage device 7 may be constructed by a single computer, or a plurality of parts (functions or means) of each device may be divided and arbitrarily assigned. It may be built by a computer. Here, the communication management device 5 and the image storage device 7 constitute a server system 6 that manages data shared between a plurality of electronic blackboards 1a and 1b. The server system 6 may be configured by a single computer including each part (function or means) of the communication management device 5 and the image storage device 7. Further, the image storage device 7 may be configured to relay stroke data for sharing between a plurality of electronic blackboards 1a and 1b instead of the communication management device 5.

Further, in the communication system, a management information session sei for transmitting and receiving various management information is established between the electronic blackboards 1a and 1b via the communication management device 5. Further, between the electronic blackboards 1a and 1b, four types of data, high-resolution base image data, medium-resolution base image data, low-resolution base image data, and sound data, are transmitted and received via the relay device 3. Four sessions are established to do so. In FIG. 1, these four sessions are collectively shown as a session sed for image / sound data. The image / sound data session sed does not necessarily have to be four sessions, and may have a number of sessions less than or greater than the number of four sessions. Further, a communication session may be directly established between the start terminal and the destination terminal without going through the relay device 3. Further, in the communication system, even if the communication management device 5 has the function of the relay device 3 and the session seed for image / sound data between the electronic blackboards 1a and 1b is established via the communication management device 5. good.

Further, in the communication system, stroke data can be transmitted / received between the electronic blackboards 1a and 1b by using the management information session sei.

Here, the image resolution of the base image data handled by the communication system will be described. The low-resolution base image data is, for example, 160 pixels in the horizontal direction and 120 pixels in the vertical direction, and is a base image. The medium-resolution base image data consists of 320 pixels in the horizontal direction and 240 pixels in the vertical direction. The high-resolution base image data is composed of, for example, 640 pixels in the horizontal direction and 480 pixels in the vertical direction. Of these, when passing through a narrow band path, low-quality image data consisting of only low-resolution base image data as a base image is relayed. When the band is relatively wide, the low-resolution base image data as the base image and the medium-quality image data including the medium-resolution base image data are relayed. When the band is very wide, high-quality image data including low-resolution base image data as a base image, medium-resolution base image data, and high-resolution base image data is relayed. Since the amount of sound data is smaller than that of the base image data, it is relayed even in a narrow band path.

(Image of using electronic blackboard)
FIG. 2 is a diagram for explaining a usage image of the electronic blackboard according to the embodiment. As shown in FIG. 2, the electronic blackboard 1 is provided on the leg 151 having a plurality of casters on the lower side, the support 152 provided on the upper side of the leg 151, and the upper side of the support 152. It is composed of a main body 153 of the electronic blackboard 1 and a display 180 provided on the front surface of the main body 153. The main body 153 has a built-in CPU 101 and the like, which will be described later. Then, the user can input (draw) a stroke image such as a character on the display 180 by using the electronic pen 190. The display 180 is an example of a display unit.

<Hardware configuration>
Next, the hardware configuration of each device or terminal constituting the communication system will be described with reference to FIGS. 3 and 4. In the hardware configuration shown in FIGS. 3 and 4, components may be added or deleted as necessary.

(Hardware configuration of electronic blackboard)
FIG. 3 is a diagram showing an example of the hardware configuration of the electronic blackboard according to the embodiment. As shown in FIG. 3, the electronic blackboard 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an SSD (Solid State Drive) 104, and a network I /. It includes an F (Interface) 105 and an external device connection I / F 106.

Of these, the CPU 101 controls the operation of the entire electronic blackboard 1. The ROM 102 is a non-volatile memory that stores a program used to drive the CPU 101 such as the CPU 101 and the IPL (Initial Program Loader). The RAM 103 is a volatile memory used as a work area of the CPU 101. The SSD 104 is a large-capacity storage device that stores various data such as a program for an electronic blackboard. The network I / F 105 is a communication interface for connecting the electronic blackboard 1 to the communication network 200 and performing communication. The external device connection I / F 106 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory 130, an external device (microphone 140, speaker 150, camera 160).

Further, the electronic blackboard 1 includes a capture device 111, a GPU (Graphics Processing Unit) 112, a display controller 113, a contact sensor 114, a sensor controller 115, an electronic pen controller 116, a short-range communication circuit 119, and an antenna 119a of the short-range communication circuit 119. , Power switch 122 and selection switches 123.

Of these, the capture device 111 causes the image data (image information) to be displayed as a still image or a moving image on the display of the external PC 170 or the like. The GPU 112 is a semiconductor chip (processor) that specializes in graphics. The display controller 113 controls and manages the screen display in order to output the output image from the GPU 112 to the display 180 or the like. The contact sensor 114 detects that the electronic pen 190, the user's hand H, or the like touches the display 180. The sensor controller 115 controls the processing of the contact sensor 114.

The contact sensor 114 inputs coordinates and detects coordinates by an infrared blocking method. In this method of inputting coordinates and detecting coordinates, two light receiving / receiving devices installed at both upper ends of the display 180 radiate a plurality of infrared rays in parallel with the display 180 and are provided around the display 180. This is a method of receiving light that is reflected by a reflecting member and returns on the same optical path as the optical path of the light emitted by the light receiving element. The contact sensor 114 outputs an infrared ID emitted by two light receiving / receiving devices blocked by the object to the sensor controller 115, and the sensor controller 115 specifies a coordinate position which is a contact position of the object.

The electronic pen controller 116 communicates with the electronic pen 190 to determine whether or not there is a touch of the pen tip or a touch of the pen tip on the display 180. The short-range communication circuit 119 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The power switch 122 is a switch for switching ON / OFF of the power of the electronic blackboard 1. The selection switches 123 are, for example, a group of switches for adjusting the brightness and hue of the display 180.

Further, the electronic blackboard 1 is provided with a bus line 110. The bus line 110 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 101 shown in FIG.

The contact sensor 114 is not limited to the infrared blocking method, but is a capacitive touch panel that specifies a contact position by detecting a change in capacitance, and a contact position is specified by a voltage change between two opposing resistance films. Various detection means such as a resistance film type touch panel, an electromagnetic induction type touch panel that detects electromagnetic induction generated by contact of a contact object with a display unit, and specifies a contact position may be used. Further, the electronic pen controller 116 may determine whether or not there is a touch not only on the pen tip and pen tail of the electronic pen 190 but also on the portion gripped by the user of the electronic pen 190 and other electronic pen portions. ..

(Hardware configuration of communication management device, relay device, and image storage device)
FIG. 4 is a diagram showing an example of the hardware configuration of the communication management device, the relay device, and the image storage device according to the embodiment. A computer as an example of the communication management device 5 includes a CPU 501, a ROM 502, a RAM 503, an HD (Hard Disk) 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F (Interface) 508, and a network I /. It includes an F509, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk ReWritable) drive 514, a media I / F 516, and a bus line 510.

Of these, the CPU 501 controls the operation of the entire communication management device 5. The ROM 502 is a non-volatile memory that stores a program used to drive the CPU 501 such as an IPL. The RAM 503 is a volatile memory used as a work area of the CPU 501. The HD504 is a large-capacity storage device that stores various data such as a communication management program. The HDD controller 505 controls reading or writing of various data to the HD 504 according to the control of the CPU 501.

The display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. The network I / F 509 is an interface for performing data communication using a communication network 200 such as the Internet. The keyboard 511 is a kind of input means including a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like.

The DVD-RW drive 514 controls reading or writing (storage) of data to the DVD-RW 513. The DVD-RW513 may be a DVD-R or the like. Further, the DVD-RW drive 514 is a Blu-ray drive that controls reading or writing (storage) of data to a disc such as BD-RE (Blu-ray (registered trademark) Disc Rewritable) or CD-RW (Compact Disc-ReWritable). Alternatively, it may be a CD-RW drive or the like. The media I / F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory. Further, the bus line 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501 shown in FIG.

Further, the relay device 3 is constructed by a general computer, and as shown in FIG. 6, the CPU 301, ROM 302, RAM 303, HD 304, HDD controller 305, display 306, external device connection I / F 308, and network. It includes an I / F 309, a keyboard 311 and a pointing device 312, a DVD-RW drive 314, a media I / F 316 and a bus line 310. These are CPU 501, ROM 502, RAM 503, HD 504, HDD controller 505, display 506, external device connection I / F 508, network I / F 509, keyboard 511, pointing device 512, DVD-RW drive 514, and media in the communication management device 5, respectively. Since the configuration is the same as that of the I / F 516 and the bus line 510, the description thereof will be omitted. However, in the case of the relay device 3, the relay program is stored in the HD 304.

Further, the image storage device 7 is constructed by a general computer, and as shown in FIG. 6, the CPU 701, ROM 702, RAM 703, HD 704, HDD controller 705, display 706, external device connection I / F 708, It includes a network I / F709, a keyboard 711, a pointing device 712, a DVD-RW drive 714, a media I / F716 and a bus line 710. These are CPU 501, ROM 502, RAM 503, HD 504, HDD controller 505, display 506, external device connection I / F 508, network I / F 509, keyboard 511, pointing device 512, DVD-RW drive 514, and media in the communication management device 5, respectively. Since the configuration is the same as that of the I / F 516 and the bus line 510, the description thereof will be omitted. Further, in the case of the image storage device 7, the image storage program is stored in the HD704.

Further, each of the above programs may be a file in an installable format or an executable format, and may be recorded and distributed on a computer-readable recording medium. Examples of the recording medium include a CD-R (Compact Disc Recordable), a DVD, a Blu-ray disc, an SD card, a USB memory, and the like. In addition, the recording medium can be provided domestically or internationally as a program product. For example, the electronic blackboard 1b realizes the screen sharing method according to the present invention by executing the program according to the present invention.

<Communication system system configuration>
Subsequently, the system configuration of the communication system 100 according to the present embodiment will be described with reference to FIG. FIG. 5 is a diagram showing an example of a system configuration of a communication system according to an embodiment. Here, as an example, the following explanation will be given assuming that the lecturer and the students A to C give a distance lecture using the communication system 100.

In FIG. 5, it is assumed that the electronic blackboard (communication terminal) 1t is installed at a base where a lecturer who gives a lecture is located (hereinafter referred to as a lecturer base). It is assumed that the electronic blackboard (first terminal) 1a is installed at the base A, and the student A takes a lecture using the electronic blackboard 1a. Further, it is assumed that the electronic blackboard (second terminal) 1b is installed at the base B, and the student B takes a lecture using the electronic blackboard 1b. Further, it is assumed that the electronic blackboard (third terminal) 1c is installed at the base C, and the student C takes a lecture using the electronic blackboard 1c. The numbers of the electronic blackboards 1a to 1c and the students A to C are examples, and may be other numbers.

The electronic blackboards 1a, 1b, 1c, the relay device 3, the communication management device 5, and the image storage device 7 mutually transmit and receive data via a communication network 200 such as the Internet or a LAN (Local Area Network), for example. It is connected so that it can be done. Further, the communication network 200 may have a place where wireless communication such as Wi-Fi (registered trademark) is performed as well as wired communication.

Further, the communication management device 5 and the image storage device 7 may be included in one server system 6 as described above.

<Functional configuration>
Next, the functional configuration of the communication system 100 according to the present embodiment will be described. FIG. 6 is a diagram showing an example of the functional configuration of the communication system according to the embodiment. In FIG. 5, it is assumed that the electronic blackboards 1a to 1c have the same functional configuration as the electronic blackboard 1t. Further, in the following description, when any electronic blackboard among the electronic blackboard 1t and the electronic blackboards 1a to 1c is shown, the "electronic blackboard 1" is used.

<Functional configuration of electronic blackboard>
The electronic blackboard 1 has, for example, a communication unit 11, a reception unit 12, an image / sound processing unit 13, a display control unit 14, a determination unit 15, and an image processing unit 16 by executing a predetermined program on the CPU 101 of FIG. A page information management unit 17, an information transmission unit 18, a reception unit 19, a shared state switching unit 20, a short-range communication unit 21, a storage / reading processing unit 22, and the like are realized. It should be noted that at least a part of each of the above functional configurations may be realized by hardware.

Further, the electronic blackboard 1 has, for example, a storage unit 1000 realized by the RAM 103, SSD 104, etc. of FIG.

For example, using the network I / F 105 of FIG. 3, the communication unit 11 connects the electronic blackboard 1 to the communication network 200, and performs communication processing for transmitting and receiving various data (or information) to and from other terminals, devices, or systems. Execute. The communication unit 11 also serves as, for example, a start unit, and performs a process of starting communication with another electronic blackboard 1.

The reception unit 12 uses, for example, the contact sensor 114, the electronic pen controller 116, and the like in FIG. 3 to execute a reception process for receiving various input operations from the user using the electronic pen 190, the hand H, and the like.

The image / sound processing unit 13 executes main processing related to the video conference function. The image / sound processing unit 13 performs digital processing such as encoding of the base image data and the sound data together with the output signal of the microphone 140 and the output signal of the camera 160, for example. Further, the image / sound processing unit 13 generates an image signal or a sound signal based on the base image data and the sound data received by the communication unit 11, for example. Further, the image / sound processing unit 13 performs processing for combining base image data having different resolutions, for example.

The display control unit 14 uses, for example, the display controller 113 or the like in FIG. 3 to output image data or the like to a display unit such as the display 180 and execute a display control process for displaying the image data or the like. The display control unit 14 causes the display unit such as the display 180 to display the page to be displayed based on the display screen data generated by the image processing unit 16, for example.

Further, the display control unit 14 of the electronic blackboard 1t displays a plurality of pages managed by the page information management unit 17 of the electronic blackboard 1t on a display unit such as a display 180 so as to be selectable, and displays the selected pages on other electronic devices. The process of displaying on the blackboards 1a to 1c is executed. The determination unit 15 executes a determination process for making various determinations.

The image processing unit 16 executes the main processing related to the electronic blackboard function. The image processing unit 16 generates stroke data and a stroke image based on, for example, a drawing operation by the electronic pen 190, the hand H, or the like received by the reception unit 12. Further, the image processing unit 16 generates a stroke image based on the stroke data received by the communication unit 11, for example. Further, the image processing unit 16 generates, for example, drawing screen data including the generated stroke image.

The page information management unit 17 performs a page information management process for storing and managing information on a plurality of pages that can be displayed on a display unit such as the display 180 of the electronic blackboard 1 in the page information 1001 as shown in FIG. 7, for example. Execute.

In the example of FIG. 7, the page information 1001 has a hierarchical structure of "session", "pages (pages 1 to 3)", and "strokes (strokes 1 to 5)". The "stroke" corresponds to the stroke data according to the present embodiment, and is managed for each "page". The “page” indicates a state in which image data related to the screen (display screen) of one page displayed on the display 180 is stored. Further, the "session" indicates information on the communication performed by the electronic blackboard 1 (for example, the communication for giving a distance lecture).

For example, the stroke 1 includes a stroke ID (id = aaaaa) for identifying the stroke 1, information for identifying the page 1 in which the stroke 1 exists (parent = page01), and a vid (global id) “g001” of the drawing data 1. , And drawing data 1 and the like are included. For example, when an operation such as movement is performed on the stroke image represented by the stroke 1, the stroke ID (id = aaaaaa) is inherited as it is, but the guide "g001" that distinguishes the drawing data 1 from the drawing data 1 is , Will be updated. The drawing data 1 is drawing data for reproducing the stroke 1. The drawing data 1 includes, for example, coordinate data, line width data, line color data, vector data, and the like. The drawing data may be stored in a storage area different from the page information 1001 in association with the guide.

The pages of the electronic blackboard 1 can be switched, and the "pages" correspond to each page of the electronic blackboard 1. For example, on page 1, a page ID (id = page01) for identifying page 1, information for identifying a "session" being executed on the electronic blackboard 1, (partent = se01), and a page (page data) are identified. The guide "g01" and the image data 1 and the like are included. The image data 1 is image data of the background image constituting the page 1. That is, the image data 1 indicates the background image displayed on the page 1. The page may not include image data. In this case, it means that the page containing the image data does not have a background image (it is a blank background).

The "session" corresponds to the communication (here, remote lecture) executed on the electronic blackboard 1, and the identification information (gid = g2) for identifying the page information 1001 and the session ID (id = se01) for identifying the session. ), Information indicating the pages generated in the session (pages), information indicating the pages constituting the display screen currently displayed on the electronic blackboard 1 (curent page), and the like. For example, the image processing unit 16 of the electronic blackboard 1 can generate a stroke image drawn on the page 1 by using the drawing data 1 to 3 included in the strokes 1 to 3. The guides shown in each layer are numbered by, for example, the communication management device 5 when sharing data with other electronic blackboards. Further, the hierarchical structure of the page information 1001 shown in FIG. 7 is shared among a plurality of electronic blackboards 1 participating in the same session.

Further, in the response mode described later, the page information management unit 17 of the electronic blackboard 1t converts the image data to be made into the electronic blackboard 1t from the plurality of electronic blackboards (terminals) 1a to 1a based on the predetermined operation received by the reception unit 12. Only 1c is duplicated and stored as different image data.

Here, returning to FIG. 6, the explanation of the functional configuration of the electronic blackboard 1 will be continued.

The information transmission unit 18 transmits various information such as stroke data representing a stroke image written on a page displayed by the electronic blackboard 1 and lecture information which is control information related to a lecture via a communication management device 5. Then, the information transmission process to be transmitted to the other electronic blackboard 1 is executed. As another example, even if the information transmission unit 18 transmits various information such as operation information and lecture information to another electronic blackboard 1 that participates in the lecture without going through the communication management device 5. good.

Further, in the response mode described later, the information transmission unit 18 of the electronic blackboard 1t transfers a plurality of different image data stored in the page information management unit 17 to the plurality of electronic blackboards (terminals) 1a to 1c for each image data. Execute the process to send.

The receiving unit 19 executes a receiving process for receiving various information such as image data (stroke data and the like) or lecture information transmitted from the information transmitting unit 18 of the other electronic blackboard 1.

The shared state switching unit 20 executes a shared state switching process for switching the shared state of the display screen with the other electronic blackboard 1. For example, when a specific operation on the display screen is accepted, the sharing state switching unit 20 shifts to an asynchronous state in which screen sharing with another electronic blackboard 1 is stopped.

The short-range communication unit 21 performs short-range wireless communication with each terminal having a short-range communication unit such as an IC card or a smartphone by using, for example, the short-range communication circuit 119 and the antenna 119a in FIG. ..

The storage / reading processing unit 22 stores various data in the storage unit 1000, or executes a process of reading various data from the storage unit 1000. The storage unit 1000 overwrites and stores the base image data and the sound data received when communicating with the other electronic blackboard 1 each time it is received. Of these, the image is displayed on the display 180 by the base image data before being overwritten, and the sound is output from the speaker 150 by the sound data before being overwritten. Further, the storage unit 1000 stores stroke data related to the stroke image drawn on the display 180 and background image data related to the background image displayed on the display 180.

Further, in the present embodiment, the storage unit 1000 stores the page information 1001 described above, the operation information 1002 as shown in FIG. 8, and the like.

FIG. 8 is a schematic diagram showing an example of operation information according to an embodiment. The operation information 1002 shown in FIG. 8 stores information on the operation executed for the display screen displayed on the electronic blackboard 1. The operation information 1002 shown in FIG. 8 includes a stroke ID (Id) for identifying the stroke data, a page ID (DistId) for identifying the page on which the stroke data is drawn, and execution for the display screen. Includes operation type information (Operation Type) indicating the type of operation performed, data type information (Data Type) indicating the type of data to be operated, and detailed data information (Data) indicating the content of the data to be operated. ing.

Of these, the operation type information (Operation Type) indicates the type of operation executed by the user for the strokes and pages included in the display screen. For example, when the operation target is a stroke, the operation type information is "Add" when the stroke is drawn, "Remove" when the stroke is deleted, and "Update" when the stroke is moved. Is shown. Further, in the data type information (Data Type), "Stroke" is indicated when the operation target is a stroke, and "Page" is indicated when the operation target is a page. Further, when the operation target is a stroke, the detailed data information (Data) corresponds to the stroke data, and includes information such as coordinate data, line width data, and line color data. The detailed data information corresponds to the body information shown in the shared data management table (see FIG. 14) described later.

The data to be operated is not limited to strokes or page units, but may be object units that are a set of a plurality of strokes. This object may contain text whose strokes are OCR (Optical Character Reader) processed as symbols such as letters or numbers, system-generated characters such as date or time, predetermined figures such as triangles, stars or circles, or arrows. Line segments or lines such as Bezier curves are included.

<Functional configuration of relay device>
The relay device 3 has a communication unit 31 that also serves as a transfer unit, a determination unit 32, and a storage / reading processing unit 33. Each of these parts has a function or functions realized by operating any of the components shown in FIG. 4 by an instruction from the CPU 501 according to a relay program developed on the RAM 303 from the HD 304. It is a means. Further, the relay device 3 has a storage unit 3000 constructed by the RAM 303, HD 304 or the recording medium 315 shown in FIG.

The communication unit 31 is realized by a command from the CPU 301 shown in FIG. 4 and a network I / F 309, and transmits / receives various data (or information) to / from another terminal, device, or system via the communication network 200. It is a function to be performed. In addition, the communication unit 31 also serves as a transfer unit, and transfers the base image data and sound data transmitted from a predetermined terminal to another terminal.

The determination unit 32 is realized by an instruction from the CPU 301 shown in FIG. 4, and is a function of performing various determinations such as determination of a data delay state and the like.

The storage / reading processing unit 33 is a function executed by a command from the CPU 301 shown in FIG. 4 to store various data in the storage unit 3000 or read out various data stored in the storage unit 3000.

<Functional configuration of communication management device>
The communication management device 5, for example, by executing a predetermined program on the CPU 501 of FIG. 4, the communication unit 51, the authentication unit 52, the determination unit 53, the terminal management unit 54, the session management unit 55, the relay device management unit 56, The shared data management unit 57, the shared state management unit 58, the storage / reading processing unit 59, and the like are realized. It should be noted that at least a part of each of the above functional configurations may be realized by hardware.

Further, the communication management device 5 has a storage unit 5000 constructed by the RAM 503, HD 504 or the recording medium 515 shown in FIG.

The communication unit 51 connects the communication management device 5 to the communication network 200 by using, for example, the network I / F 509 of FIG. 4, and performs communication processing for transmitting and receiving various data (or information) with another terminal or device. To execute. The communication unit 51 receives, for example, stroke data, lecture information, operation information, etc. transmitted from the electronic blackboard 1, and transfers the received information to another electronic blackboard 1 or the like participating in the same session as the electronic blackboard 1. Send.

When the communication unit 51 receives the login request from the electronic blackboard 1, the authentication unit 52 authenticates the login request with reference to, for example, the authentication management table 900 as shown in FIG.

FIG. 9 is a conceptual diagram showing an example of the authentication management table according to the embodiment. In the storage unit 5000, for example, an authentication management DB 5001 configured by an authentication management table 900 as shown in FIG. 9 is constructed. In the authentication management table 900, each password is associated and managed for each terminal ID of all the electronic blackboards 1 managed by the communication management device 5. For example, in the authentication management table 900 shown in FIG. 9, it is shown that the password corresponding to the terminal ID "01aa" of the electronic blackboard 1a is "aaaa". The password is an example of authentication information. The authentication information may be, for example, authentication information other than a password such as an access token or a digital certificate.

For example, when the combination of the terminal ID and the password included in the login request received from the electronic blackboard 1 is stored in the authentication management table 900 as shown in FIG. 9, the authentication unit 52 logs in to the electronic blackboard 1. Allow. The determination unit 53 executes a determination process for making various determinations.

The terminal management unit 54 stores and manages the states of the plurality of electronic blackboards 1 included in the communication system 100 in the terminal management table 1010 as shown in FIG. 10, for example.

FIG. 10 is a conceptual diagram showing an example of a terminal management table according to an embodiment. In the storage unit 5000, for example, a terminal management DB 5002 configured by a terminal management table 1010 as shown in FIG. 10 is constructed. In the terminal management table 1010, for each terminal ID that identifies each electronic blackboard 1, the destination name when each electronic blackboard 1 is the destination, the operating state of each electronic blackboard 1, and the login request information described later are the communication management device 5. The reception date and time received in, the IP address of each electronic blackboard 1, and the like are managed in association with each other. For example, in the terminal management table 1010 shown in FIG. 10, the electronic blackboard 1a having the terminal ID "01aa" has the terminal name "Japan Tokyo Office AA terminal" and the operating state is "online (communication possible)". The date and time when the login request information was received by the communication management device 5 is "13:40 on February 10, 20xx", and the IP address of this electronic blackboard 1a is "1.2.1.3". It is shown that. The terminal ID, the destination name, and the IP address of the terminal are stored when each electronic blackboard 1 is pre-registered to receive the service provided by the communication management device 5.

The terminal management unit 54 updates information such as the operating state, the reception date and time, and the IP address of the terminal in the terminal management table 1010, for example.

Further, the terminal management unit 54 manages, for example, the destination list management table 1100 as shown in FIG. 11, and in response to a request from the electronic blackboard 1, the terminal ID of the destination terminal managed by the destination list management table 1100. Provides destination list information including.

FIG. 11 is a conceptual diagram showing an example of a destination list management table according to an embodiment. In the storage unit 5000, for example, a destination list management DB 5003 configured by a destination list management table 1100 as shown in FIG. 11 is constructed. In the destination list management table 1100, all the terminal IDs of the destination terminals registered as candidates for the electronic blackboard 1 (destination terminal) are associated with the terminal ID of the electronic blackboard 1 (starting terminal) requesting the start of communication. Be managed. For example, in the destination list management table 1100 shown in FIG. 11, the terminal ID is a candidate for a destination terminal that can request the start of communication from the start terminal (electronic blackboard 1a) whose terminal ID is "01aa". It is shown that it is the electronic blackboard 1 of "01ba, 01ca, 01ta, ...". The candidate of the destination terminal is updated by being added or deleted at the request of addition or deletion to the communication management device 5 from any starting terminal.

The session management unit 55 stores and manages information about a session held in the communication system 100 in the session management table 1200 as shown in FIG. 12, for example.

FIG. 12 is a conceptual diagram showing an example of a session management table according to an embodiment. In the storage unit 5000, for example, a session management DB 5004 configured by a session management table 1200 as shown in FIG. 12 is constructed. In this session management table 1200, for example, for each session ID for identifying a session (communication), the relay device ID of the relay device 3 to be used, the terminal ID of the start terminal, the terminal ID of the destination terminal, and the terminal of the participating terminal. IDs and the like are associated and managed. In this embodiment, one or more other terminals (electronic blackboard 1) can participate in the session held between the start terminal and the destination terminal. In this way, a terminal that participates in a session from the middle may be called a "participating terminal".

Further, in the session management table 1200, for example, the communication management device 5 receives the reception delay time (ms) when the base image data is received at the destination terminal and the delay information indicating the delay time. Information such as the date and time of reception is associated and managed. For example, in the session management table 1200 shown in FIG. 12, the session with the session ID "se01" uses the relay device 3 with the relay device ID "111a" to start the terminal with the terminal ID "01aa" and the terminal. It is shown that the event is held with the destination terminal whose ID is "01ta". In addition, participating terminals with terminal IDs "01ba" and "01ca" participate in the session with session ID "se01", and the base image data as of "13:41 on April 10, 20xx" It has been shown that the delay time is 200 (ms).

The session management unit 55 generates, for example, a session ID for identifying a session according to the start request information requesting the start of communication from the electronic blackboard 1. Further, the session management unit 55 stores and manages various information about the session in the session management table 1200 as shown in FIG. 12, for example, in association with the session ID.

The relay device management unit 56 stores and manages information of a plurality of relay devices 3 included in the communication system 100 in the relay device management table 1300 as shown in FIG. 13, and manages the information from the plurality of relay devices 3. Select the relay device 3 used for relaying the session.

FIG. 13 is a conceptual diagram showing an example of a relay device management table according to an embodiment. In the storage unit 5000, for example, a relay device management DB 5005 configured by a relay device management table 1300 as shown in FIG. 13 is constructed. In this relay device management table 1300, for each relay device ID, the operating status of each relay device 3, the reception date and time when the status information indicating the operating status is received, the IP address of the relay device 3, and the maximum data transmission in the relay device 3 Information such as speed (Mbps) is associated and managed. For example, in the relay device management table 1300 of FIG. 13, the relay device 3 having the relay device ID "111a" is in the "online" operating state, and the date and time when the communication management device 5 receives the status information is "April 20xx". It is shown to be "13:30 on the 10th." Further, in the relay device management table 1300, it is shown that the IP address of the relay device 3 is "1.2.1.2" and the maximum data transmission speed of the relay device 3 is 100 Mbps.

The relay device management unit 56 selects the relay device 3 to be used for relaying the session, for example, by using various information about each relay device 3 stored in the relay device management table 1300. The relay device management unit 56 selects the relay device 3 near the start terminal from, for example, the IP address of each relay device 3 stored in the relay device management table 1300 and the IP address of the start terminal. Further, the relay device management unit 56 may select the relay device 3 based on, for example, the maximum data transmission speed of each relay device 3 stored in the relay device management table 1300. In this embodiment, the method of selecting the relay device 3 used for relaying the session may be any method. Further, the number of relay devices 3 included in the communication system 100 may be one.

The shared data management unit 57 stores and manages various data related to the display screen transmitted and received between the electronic blackboards 1 in the shared data management table 1400 as shown in FIG. 14, for example. For example, the shared data management unit 57 stores various data transmitted in the session sei from the electronic blackboard 1 participating in the session in the shared data management table 1400 in association with the session ID.

FIG. 14 is a conceptual diagram showing an example of a shared data management table according to an embodiment. In the storage unit 5000, for example, a shared data management DB 5006 configured by a shared data management table 1400 as shown in FIG. 14 is constructed. In the shared data management table 1400, various data related to the display screen shared and stored between the electronic blackboards 1 are stored and managed for each session ID for identifying the session. The shared data management table 1400 is managed by the page information management unit 17 of each electronic blackboard 1, for example, "image data 1 to 3" and "drawing data 1 to 5" of page information 1001 as shown in FIG. The data corresponding to "etc." is included.

The data shown in the shared data management table includes an ID for identifying each data, a sequence number indicating the order in which each data is generated, information indicating the contents of the data (body), and an upper layer (parent). Information (parent) for specifying data is included. In the example of FIG. 14, the shared data management table 1400 has a session ID for identifying a session being held, information (children) indicating a page generated in the session, and a display currently displayed on the electronic blackboard 1. Information (curent page) indicating the pages constituting the screen is included. Further, for example, in the case of page data, in the shared data management table, a page ID for identifying the page (page data) and a URL (Uniform Resource Locator) indicating a storage position of background image data constituting the corresponding page are displayed. It is included.

Further, in the shared data management table 1400, a stroke ID for identifying the generated stroke data, information indicating the content of the stroke data, and information for identifying a page (page data) in which the stroke exists (partent) It is included. In this case, the information (body) indicating the content of the stroke data includes, for example, the color of the drawn stroke, the width indicating the line thickness of the drawn stroke, and the vertices (x, y) of the drawn stroke. Information is included.

Here, the stroke data is drawing data representing a stroke image drawn by the "stroke drawing" event. Further, the "stroke drawing" event is an input process of drawing information by the user. For example, the user presses the electronic pen 190 against the display 180, moves the electronic pen 190 in this state, and moves the electronic pen 190 from the display 180 to the electronic pen 190. It is an event until you release. The stroke color is an RGBA (Red Green Blue Alpha) data format, and each element is represented by a numerical value of 0-255. Further, the width of the line thickness of the drawn stroke is expressed by the number of pixels. The vertices of the drawn strokes are represented by XY coordinates, and when each vertex is connected by a Bezier curve, it becomes a line segment indicating the stroke. The shared data management table 1400 allows the communication management device 5 to manage various data related to the display screen including stroke data generated by a video conference or the like using a specific communication session.

The shared state management unit 58 stores and manages the screen sharing state of the electronic blackboard 1 in the shared state management table 1500 as shown in FIG. 15, for example. The shared state management unit 58 updates the "shared state" stored in the shared state management table 1500 according to, for example, the shared state information indicating the screen sharing state of the electronic blackboard 1 transmitted from the electronic blackboard 1. ..

The storage / reading processing unit 59 stores various data in the storage unit 5000, or executes a process of reading various data stored in the storage unit 5000.

<Functional configuration of image storage device>
The image storage device 7 has a communication unit 71, a generation unit 73, and a storage / reading processing unit 79. Each of these parts has a function or a function realized by operating any of the components shown in FIG. 4 by a command from the CPU 701 according to an image storage program developed on the RAM 703 from the HD 704. It is a means to do. Further, the image storage device 7 has a storage unit 7000 constructed by the RAM 703, HD 704 or the recording medium 715 shown in FIG.

The communication unit 71 is realized by a command from the CPU 701 shown in FIG. 4 and a network I / F 709, and has a function of transmitting and receiving various data (or information) to and from another terminal or device via the communication network 200. Is. The generation unit 73 is a function realized by a command from the CPU 701 shown in FIG. 4 and generates a URL indicating a storage position of the background image data. The storage / reading processing unit 79 is a function executed by a command from the CPU 701 shown in FIG. 4 to store various data in the storage unit 7000 or read out various data stored in the storage unit 7000.

The functional configuration of the communication system 100 shown in FIG. 6 is an example. For example, in FIG. 6, the electronic blackboard 1 may have at least a part of the functional configurations included in the communication management device 5. Further, the communication management device 5 may have at least a part of the functional configurations included in the electronic blackboard 1. Further, each functional configuration included in the image storage device 7 may be provided in the communication management device 5, or may be realized by a cloud service or the like outside the communication system 100. Furthermore, the function of the video conference included in the electronic blackboard 1 may be realized by an external video conference device or the like.

Further, the electronic blackboards 1a to 1c may not have at least a part of the functional configurations included in the electronic blackboard 1t.

<Processing flow>
Subsequently, the flow of processing of the communication method according to the present embodiment will be described.

(Processing in preparation stage)
FIG. 16 is a sequence diagram showing an example of processing in the preparation stage according to the embodiment. This process shows an example of a preparatory process executed before starting a session (communication) between the electronic blackboards 1 in the communication system 100. Since the processing in the preparatory stage executed by the electronic blackboards 1b and 1c is the same as the processing of the electronic blackboard 1a, the description thereof will be omitted. Further, at the start of the process shown in FIG. 16, it is assumed that the electronic blackboard 1t has already executed the process in the preparation stage and has already logged in to the communication management device 5.

First, when the power switch 122 is turned on by the electronic blackboard 1a, the reception unit 12 of the electronic blackboard 1a receives the power ON (step S11).

Next, the communication unit 11 of the electronic blackboard 1a transmits login request information indicating a login authentication request to the communication management device 5 via the communication network 200 (step S12). The login request information includes the terminal ID and password of the electronic blackboard 1a. These terminal IDs and passwords are data read from the storage unit 1000 of the electronic blackboard 1a by the storage / reading processing unit 22 of the electronic blackboard 1a and sent to the communication unit 11. The terminal ID and password are not limited to this, and the terminal ID and password entered by the user by an input means such as a keyboard may be transmitted. Further, a terminal ID or password read from a recording medium such as a SIM (Subscriber Identity Module Card) card or SD card connected to the electronic blackboard 1a may be transmitted. As a result, the communication unit 51 of the communication management device 5 receives the login request information transmitted from the electronic blackboard 1a.

Next, the authentication unit 52 of the communication management device 5 searches the authentication management table 900 as shown in FIG. 9 using the terminal ID and password included in the login request information received via the communication unit 51 as search keys. do. Further, the authentication unit 52 permits the login of the electronic blackboard 1a when the combination of the terminal ID and the password included in the login request information is managed by the authentication management table (step S13). Here, if the login of the electronic blackboard 1a is permitted, the processes after step S14 are executed.

When the login of the electronic blackboard 1a is permitted, the terminal management unit 54 updates the information corresponding to the terminal ID "01aa" of the electronic blackboard 1a in the terminal management table 1010 as shown in FIG. For example, the terminal management unit 54 changes the information of the "operating state" corresponding to the terminal ID "01aa" to "online (communication possible)", and the information of the "reception date and time" is the date and time when the login request information is received. Update to (step S14). The IP address information of the terminal is not registered in advance, but the IP address transmitted from the electronic blackboard 1a in step S12 may be used. As a result, in the terminal management table, for example, as shown in FIG. 10, the terminal ID "01aa", the operating state "online (communication possible)", and the reception date and time "20xx.4.1.13: 40" are displayed. And the IP address "1.2.1.3" will be managed in association with each other.

Next, the session management unit 55 puts a new record with the terminal ID "01aa" of the electronic blackboard 1a received in step S12 as the "terminal ID of the start terminal" in the session management table 1200 as shown in FIG. Add and manage (step S15). Then, the communication unit 51 transmits the authentication result information showing the authentication result obtained by the process of step 13 to the electronic blackboard 1a that has requested the login via the communication network 200 (step S16).

When the communication unit 11 of the electronic blackboard 1a receives the authentication result information indicating that login is permitted, the destination list request information indicating that the communication management device 5 is requested to the destination list via the communication network 200. Is transmitted (step S17). As a result, the communication unit 51 of the communication management device 5 receives the destination list request information.

Next, the terminal management unit 54 searches the destination list management table 1100 as shown in FIG. 11 using the terminal ID "01aa" of the electronic blackboard 1a as a search key, and is a destination candidate capable of communicating with the electronic blackboard 1a. Read the terminal ID. Further, the terminal management unit 54 reads out the destination name corresponding to the terminal ID of the destination candidate from the terminal management table 1010 as shown in FIG. 10 (step S18). Here, the terminal IDs of the destination candidates corresponding to the terminal ID "01aa" of the electronic blackboard 1a and the destination names corresponding to these are extracted.

Next, the communication unit 51 reads, for example, the data of the destination list frame and the data of the icon indicating the operating state from the storage unit 5000 via the storage / reading processing unit 59 (step S19). Further, the communication unit 51 electronically outputs "destination list information (destination list frame, icon, terminal ID, destination name)" including the read destination list frame and icon, and the terminal ID and destination name extracted in step S18. It is transmitted to the blackboard 1a (step S20). As a result, in the electronic blackboard 1a, the communication unit 11 receives the destination list information, and the storage / reading processing unit 22 stores the received destination list information in the storage unit 1000 (step S21).

As described above, in the present embodiment, the communication management device 5 centrally manages the destination list information of all the terminals, instead of managing the destination list information in each terminal. Therefore, the new electronic blackboard 1 will be included in the communication system, a new model terminal will be included instead of the already included terminal, and the appearance of the destination list frame will be changed. Even in this case, since the communication system according to the present embodiment collectively handles the communication management device 5, it is possible to save the trouble of changing the destination list information on each terminal side.

Further, the terminal management unit 54 searches the terminal management table 1010 as shown in FIG. 10 using the terminal ID of the destination candidate extracted in step 18 as a search key, and sets the corresponding operating state for each destination candidate terminal ID. read out. As a result, the terminal management unit 54 acquires each operating state of each electronic blackboard 1 corresponding to the terminal ID of the destination candidate (step S22).

Next, the communication unit 51 electronically transmits "terminal status information" including the terminal ID used as the search key in step S22 and the operating status of each corresponding destination terminal via the communication network 200. It is transmitted to the blackboard 1a (step S23).

Next, the storage / reading processing unit 22 of the electronic blackboard 1a sequentially stores the state information of the terminal received from the communication management device 5 in the storage unit 1000 of the electronic blackboard 1a (step S24). Therefore, by receiving the state information of each of the electronic blackboards, the electronic blackboard 1a can acquire the current operating state of the electronic blackboard 1t or the like, which is a destination candidate capable of communicating with the electronic blackboard 1a. ..

Next, the display control unit 14 of the electronic blackboard 1a reflects the state of the terminal as a destination candidate based on the destination list information stored in the storage unit 1000 of the electronic blackboard 1a and the state information of the terminal. Create a list. Further, the display control unit 14 of the electronic blackboard 1a displays the destination list screen 1700 as shown in FIG. 17, for example, on the display 180 of the electronic blackboard 1a by using the created destination list (step). S25). On the destination list screen 1700, an icon indicating an operating state, a terminal ID, and a destination name are displayed for each destination candidate. In the example of FIG. 17, the icons indicating the operating states of each terminal are displayed as "offline", "online (communicable)", and "online (communicable)" from the top.

On the other hand, the terminal management unit 54 of the communication management device 5 searches the destination list management table 1100 based on the terminal ID "01aa" of the electronic blackboard 1a, and thereby registers the electronic blackboard 1a as a destination candidate. (Step S26). In the destination list management table shown in FIG. 10A, the terminal IDs of other terminals to be read are "01ba", "01ca", "01ta" and the like.

Next, the terminal management unit 54 searches the terminal management table 1010 based on the terminal ID "01aa" of the electronic blackboard 1a, and acquires the operating state of the electronic blackboard 1a (step S27).

Then, the communication unit 51 selects the terminal whose operating state is "online" in the terminal management table 1010 among the terminals related to the terminal ID extracted in step S26, and the terminal of the electronic blackboard 1a acquired in step S27. The "terminal status information" including the ID "01aa" and the operating status "online" is transmitted (step S28). When the communication unit 51 transmits the state information of the terminal to the electronic blackboard 1t, the IP address of the electronic blackboard managed in the terminal management table 1010 is referred to based on each terminal ID. As a result, the terminal ID "01aa" of the electronic blackboard 1a and the operating state "online" can be transmitted to each of the other destination terminals capable of communicating with the electronic blackboard 1a as the destination candidate. Therefore, the status of the destination candidate can be displayed even on the destination candidate (electronic blackboard 1t or the like) (step S29).

(Session start processing)
FIG. 14 is a sequence diagram showing an example of session start processing according to an embodiment. This process is, for example, a session start process executed by the communication system 100 when the electronic blackboard (first terminal) 1a requests the electronic blackboard (communication terminal) 1t to start a session (communication). An example is shown.

In step S1801, when the reception unit 12 of the electronic blackboard 1a receives the destination selection by the student A, the processes after step S1802 are executed. Here, it is assumed that the electronic blackboard 1t is selected as the destination terminal by the student A, and the following description will be given.

In step S1802, the communication unit 11 of the electronic blackboard 1a transmits the start request information requesting the start of the session to the communication management device 5. The start request information includes, for example, the terminal ID "01aa" (start terminal ID) of the electronic blackboard 1a, the terminal ID "01ta" (destination terminal ID) of the electronic blackboard 1t, the IP address of the electronic blackboard 1a, and the like. .. As a result, the communication unit 51 of the communication management device 5 receives the start request information and acquires the IP address of the electronic blackboard 1a which is the transmission source.

In step S1803, the terminal management unit 54 of the communication management device 5 updates the terminal management DB 5002 based on the terminal ID of the start terminal and the terminal ID of the destination terminal included in the start request information. For example, the terminal management unit 54 sets the terminal IDs “01aa” and “ Update the "operating status" corresponding to "01ta" to "online (communication)". In this state, the electronic blackboard 1a and the electronic blackboard 1t do not start the session (communication), but are managed as the communication in progress state.

In step S1804, the session management unit 55 of the communication management device 5 generates a session ID for identifying a session (lecture) to be held between the electronic blackboard 1a and the electronic blackboard 1t. Here, it is assumed that the session management unit 55 generates the session ID “se01”.

In step S1805, the session management unit 55 associates the generated session ID, the terminal ID “01aa” of the start terminal, the terminal ID “01ta” of the destination terminal, and the like with the session management table 1200 as shown in FIG. Remember.

In step S1806, the relay device management unit 56 of the communication management device 5 selects the relay device 3 that relays the session (communication) between the electronic blackboard 1a and the electronic blackboard 1t. For example, the relay device management unit 56 selects the relay device 3 having an IP address close to the IP address of the electronic blackboard 1a in the terminal management table 1010 among the relay devices 3 whose operating state is “online” in the relay device management table 1300. .. Here, it is assumed that the relay device 3 having the device ID "111a" is selected.

In steps S1807a and S1807b, the session management unit 55 of the communication management device 5 transmits relay device selection information to the electronic blackboard 1a and the electronic blackboard 1t via the communication unit 51. The relay device selection information includes, for example, the IP address of the relay device 3 selected in step S1806, the session ID generated in step S1804, the IP address of the communication management device 5 (management device IP address), and the like. ..

In steps S1808a and S1808b, the communication unit 11 of the electronic blackboard 1a and the electronic blackboard 1t sends the reception completion information indicating that the relay device selection information has been received to the communication management device 5 in response to the reception of the relay device selection information. Send. The reception completion information includes, for example, the session ID "se01" included in the relay device selection information.

In steps S1809a and S1809b, the communication unit 11 of the electronic blackboard 1a and the electronic blackboard 1t has a session with the relay device 3 using the IP address and session ID of the relay device 3 included in the relay device selection information. Establish. As a result, the electronic blackboard 1a and the electronic blackboard 1t can participate in the session with the same session ID "se01" and can transmit and receive the base image data, the sound data, and the like to and from each other via the relay device 3.

(Participation process in session)
FIG. 19 is a sequence diagram showing an example of a session participation process according to an embodiment. This process shows, for example, an example of a participation process in which the electronic blackboards 1b and 1c participate in a session being communicated between the electronic blackboard 1t and the electronic blackboard 1 in the session start process of FIG.

In step S1901, it is assumed that the electronic blackboard 1t and the electronic blackboard 1a are in a communicating state in which they can participate in the same session via the relay device 3 and can transmit and receive base image data, sound data, and the like.

In step S1902, when the reception unit 12 of the electronic blackboard 1b accepts the operation of participation in the session by the student B, the processes of steps S1903 to S1910 are executed.

In step S1903, the communication unit 11 of the electronic blackboard 1b transmits the participation request information requesting participation in the session to the communication management device 5. The start request information includes, for example, the terminal ID "01aa" (participating terminal ID) of the electronic blackboard 1b, the terminal ID "01ta" (destination terminal ID) of the electronic blackboard 1t used by the instructor, and the like.

In step S1904, the terminal management unit 54 of the communication management device 5 updates the terminal management DB 5002 based on the terminal ID of the participating terminal included in the participation request information. For example, the terminal management unit 54 sets the "operating state" corresponding to the terminal ID "01ba" online (during communication) in the terminal management table 1010 based on the terminal ID "01ba" of the electronic blackboard 1b included in the participation request information. ) ”.

In step S1905, the session management unit 55 of the communication management device 5 updates the session management DB 5004. For example, the session management unit 55 stores the ID "01ba" of the participating terminal in association with the terminal ID "01ta" of the destination terminal in the session management table 1200 as shown in FIG.

In step S1906, the session management unit 55 of the communication management device 5 transmits the relay device selection information to the electronic blackboard 1b via the communication unit 51. The relay device selection information includes, for example, the IP address of the relay device 3 relaying the session in which the electronic blackboard 1t, which is the destination terminal, participates, the session ID of the session in which the electronic blackboard 1t participates, and the like. included.

In step S1907, the communication unit 11 of the electronic blackboard 1b transmits the reception completion information indicating that the relay device selection information has been received to the communication management device 5 in response to the reception of the relay device selection information.

In step S1908, the communication unit 11 of the electronic blackboard 1b establishes a session with the relay device 3 by using the IP address and the session ID of the relay device 3 included in the relay device selection information. As a result, in step S1909, the electronic blackboard 1b can participate in the same session as the electronic blackboard 1t and the electronic blackboard 1a, and can transmit and receive base image data, sound data, and the like to and from each other via the relay device 3. become.

In steps S1910 to S1907, the electronic blackboard 1c executes the same processing as the electronic blackboard 1b, and establishes a session with the relay device 3. As a result, the electronic blackboard 1c can participate in the same session as the electronic blackboard 1t, the electronic blackboard 1a, and the electronic blackboard 1b, and can transmit and receive base image data, sound data, and the like to and from each other via the relay device 3. become.

Next, each process in the lecture (distance lecture) will be explained.

[First Embodiment]
(Screen sharing process in lecture mode)
FIG. 20 is a sequence diagram showing an example of processing in the lecture mode according to the first embodiment. In the present embodiment, the page displayed on the display unit of the electronic blackboard 1t by the instructor is displayed on the display unit of the electronic blackboards 1a to 1c of the student, and the base image data and the sound data are transmitted and received to the instructor. The state in which the lecturer gives a lecture is called "lecturer mode". However, the name representing this state is not limited to the "lecture mode", and may be any name such as "explanatory mode", "listening mode", and "explanatory state".

Further, at the start of the processing shown in FIG. 20, it is assumed that the electronic blackboard 1t and the electronic blackboards 1a to 1c are participating in the same session by the processing of FIGS. 18 and 19.

In step S2001, when the reception unit 12 of the electronic blackboard 1t receives the input operation of the stroke image by the instructor, the processing after step S2002 is executed.

In step S2002, the image processing unit 16 of the electronic blackboard 1t creates stroke data (for example, coordinate data, line width data, line color data, vector data, etc.) representing the input stroke image. Further, in step S2003, the display control unit (first display control unit) 14 of the electronic blackboard 1t causes the display unit such as the display 180 of the electronic blackboard 1t to display the input stroke image.

In step S2004, the information transmission unit 18 of the electronic blackboard 1t transmits the stroke data created in step S2002 to the communication management device 5.

In step S2005, the shared data management unit 57 of the communication management device 5 associates the stroke data received from the electronic blackboard 1t with, for example, the shared data management table 1400 as shown in FIG. 14 with the session ID “se01”. Remember. For example, as shown in FIG. 14, the shared data management unit 57 stores the stroke data received by the communication unit 51 in the order of occurrence (sequence order) in association with the session ID. Further, the shared data management unit 57 assigns a guide corresponding to the stroke data received in step S2004.

In step S2006, the shared data management unit 57 of the communication management device 5 transmits the stroke data stored in the shared data management table 1400 and the numbered guide in step S2005 to the electronic blackboard 1t via the communication unit 51. .. As a result, the electronic blackboard 1t can grasp that the transmitted stroke data has been accepted, and can know the numbered guide.

In steps S2007a to S2007c, the shared data management unit 57 of the communication management device 5 transmits the stroke data stored in the shared data management table 1400 and the numbered guide to the electronic blackboards 1a to 1c via the communication unit 51. do. As a result, the receiving units 19 of the electronic blackboards 1a to 1c receive the stroke data and the guide transmitted from the communication management device 5.

In steps S2008a to S2008c, the page information management unit 17 of the electronic blackboards 1a to 1c stores the stroke data and the guide received from the communication management device 5 in the page information 1001 as shown in FIG. 7, for example.

In steps S2009a to S2009c, the display control units (second display control units) 14 of the electronic blackboards 1a to 1c display the stroke image represented by the stroke data received from the communication management device 5 on the display unit such as the display 180. Display.

By repeatedly executing the above processing, a stroke image (for example, a mathematical formula, a character string) drawn by the instructor is displayed on the display unit of the electronic blackboard 1t used by the instructor, for example, as shown in FIG. 21 (A). , Figure, etc.) is displayed on the display screen 2101. Similarly, the display screen 2101 for displaying the stroke image drawn by the instructor is also displayed on the display units of the electronic blackboards 1a to 1c used by the students A to C.

(Screen sharing process in answer mode)
22 and 24 are sequence diagrams showing an example of screen sharing processing in the response mode according to the first embodiment. Here, a copy of the page (for example, page 1) displayed by the instructor on the display unit of the electronic blackboard 1t is displayed on the display unit of the electronic blackboards 1a to 1c of the student, and the student is asked to input an answer. Is called "answer mode". However, the name representing this state is not limited to the "answer mode", and may be any name such as "test mode", "test state", and "at the time of entry acceptance".

In step S2201, when the reception unit 12 of the electronic blackboard 1t receives the start operation of the answer mode by the instructor, the processes after step S2202 are executed. The operation to start the answer mode is an example of an operation of switching from a shared state of image data between a plurality of terminals (electronic blackboards 1a to 1c) and a communication terminal (electronic blackboard 1t) to a non-shared state.

In step S2202, the shared state switching unit 20 of the electronic blackboard 1t sets the shared state of the electronic blackboard 1t and the electronic blackboards 1a to 1c to "asynchronous" in the communication management device 5 via the communication unit 11. To send.

In step S2203, when the shared state management unit 58 of the communication management device 5 receives the asynchronous setting information from the electronic blackboard 1t, for example, the shared state management table 1500 as shown in FIG. 15 is updated, and the electronic blackboard 1t becomes electronic. Set the shared state of the blackboards 1a to 1c to "asynchronous".

In step S2204, the communication unit 51 of the communication management device 5 transmits the asynchronous setting information received from the electronic blackboard 1t to the electronic blackboard 1t. As a result, in step S2205, the shared state switching unit 20 of the electronic blackboard 1t switches the shared state of the electronic blackboard 1t to "asynchronous". The process of step S2204 is not essential, and the electronic blackboard 1t may execute the process of step S2205 after step S2202.

In steps S2206a to 2206c, the communication unit 51 of the communication management device 5 transmits the asynchronous setting information received from the electronic blackboard 1t to the electronic blackboards 1a to 1c. As a result, in steps S2207a to S2207c, the shared state switching unit 20 of the electronic blackboards 1a to 1c switches the shared state of the electronic blackboards 1a to 1c to "asynchronous".

In the present embodiment, "asynchronous" in the shared state represents a state in which the page switching operation with respect to the electronic blackboard 1 is not reflected in the other electronic blackboard 1 during communication. For example, when the shared state of the electronic blackboard 1t is set to "asynchronous", the electronic blackboard 1t does not transmit the operation information related to the page switching to the communication management device 5 even if the page switching operation for the electronic blackboard 1t is performed. However, even in this state, stroke data is shared.

On the other hand, when the shared state of the electronic blackboard 1t is set to "synchronous", when the page switching operation for the electronic blackboard 1t is performed, the electronic blackboard 1t transmits the operation information regarding the page switching to the communication management device 5.

In step S2211, the page information management unit 17 of the electronic blackboard 1t copies the page 1 displayed on the display unit of the electronic blackboard 1t and creates pages 2 to 4 to be displayed on the electronic blackboards 1a to 1c. For example, the page information management unit 17 of the electronic blackboard 1t copies the page 1 displayed on the display screen 2101 of the electronic blackboard 1t to create a display screen 2102 as shown in FIG. 21B, and the page 2 is created. As (second page), it is stored and managed in the page information 1001. Further, the page information management unit 17 of the electronic blackboard 1t copies the page 1 displayed on the display screen 2101 of the electronic blackboard 1t to create a display screen 2103 as shown in FIG. 21C, and the page 3 is created. As (third page), it is stored and managed in the page information 1001. Similarly, the page information management unit 17 of the electronic blackboard 1t copies the page 1 displayed on the display screen 2101 of the electronic blackboard 1t to create a display screen 2104 as shown in FIG. 21D, and creates a page. As No. 4, the page information 1001 as shown in FIG. 7 is stored and managed.

In this way, the page information management unit 17 of the electronic blackboard 1t duplicates the image data displayed on the electronic blackboard 1t for a plurality of electronic blackboards 1a to 1c based on the predetermined operation received by the reception unit 12. (Duplicate for multiple terminals) and store as different image data.

In step S2212, the page information management unit 17 of the electronic blackboard 1t creates, for example, lecture information 2301 as shown in FIG. 23 (A). In the lecture information 2301 shown in FIG. 23A, “gid” is identification information for identifying the lecture, and “id” is identification information for identifying the session. “Pages” is information indicating pages created in the lecture, and in the example of FIG. 20A, it indicates that pages 1 to 4 are created. The "curent_Page" indicates the page currently displayed by the electronic blackboard 1t (for example, page 1).

"Force_curent" indicates a page to be displayed on the electronic blackboards 1a to 1c. In the example of FIG. 2A, it is shown that the electronic blackboard 1a (terminal A) displays the page 2, the electronic blackboard 1b (terminal B) displays the page 3, and the electronic blackboard 1c (terminal C) displays the page 4.

In step S2213, the display control unit 14 of the electronic blackboard 1t transmits the lecture information 2301 created by the page information management unit 17 and the information of pages 2 to 4 to the communication management device 5 by using the information transmission unit 18. do.

In steps S2214a to S2214c, the communication unit 51 of the communication management device 5 transmits (transfers) the lecture information received from the electronic blackboard 1t and the information on pages 2 to 4 to the electronic blackboards 1a to 1c.

In step S2215, the display control unit 14 of the electronic blackboard 1a causes the display unit such as the display 180 of the electronic blackboard 1a to display the page 2 based on the lecture information received from the communication management device 5 and the information of the page 2. At this time, the electronic blackboard 1a prohibits the student A and the like from switching pages.

In step S2216, the display control unit 14 of the electronic blackboard 1b causes the display unit such as the display 180 of the electronic blackboard 1b to display the page 3 based on the lecture information received from the communication management device 5 and the information on the page 3. At this time, the electronic blackboard 1b prohibits the student B and the like from switching pages.

In step S2217, the display control unit 14 of the electronic blackboard 1b causes the display unit such as the display 180 of the electronic blackboard 1b to display the page 4 based on the lecture information received from the communication management device 5 and the information on the page 4. At this time, the electronic blackboard 1c prohibits the switching of pages by the student C or the like.

By the above processing, the display control unit 14 of the electronic blackboard 1t makes a plurality of copies of the page 1 (first page) displayed on the display unit in response to the start operation (predetermined operation) of the answer mode. It can be displayed on the display unit of the terminal (electronic blackboard 1a to 1c).

In this state, for example, when the student A inputs a stroke image to the electronic blackboard 1a, the process shown in FIG. 24 is executed.

In step S2401, when the reception unit 12 of the electronic blackboard 1a receives the input of the stroke image by the student A, the processes after step S2402 are executed.

In step S2402, the image processing unit 16 of the electronic blackboard 1a creates stroke data (for example, coordinate data, line width data, line color data, vector data, etc.) representing the input stroke image. Further, in step S2403, the display control unit 14 of the electronic blackboard 1a causes the display unit such as the display 180 of the electronic blackboard 1a to display the input stroke image.

In step S2404, the information transmission unit 18 of the electronic blackboard 1a transmits the stroke data created in step S2402 to the communication management device 5.

In step S2005, the shared data management unit 57 of the communication management device 5 associates the stroke data received from the electronic blackboard 1a with the shared data management table 1400 as shown in FIG. 14, for example, in association with the session ID “se01”. Remember. For example, as shown in FIG. 14, the shared data management unit 57 stores the stroke data received by the communication unit 51 in the order of occurrence (sequence order) in association with the session ID. Further, the shared data management unit 57 assigns a number corresponding to the stroke data received in step S2404.

In step S2406, the shared data management unit 57 of the communication management device 5 transmits the stroke data stored in the shared data management table 1400 in step S2405 and the numbered guide to the electronic blackboard 1t via the communication unit 51. ..

In step S2407, the page information management unit 17 of the electronic blackboard 1t stores the stroke data and the gid received from the communication management device 5 in the page information 1001 as shown in FIG. 7, for example.

In steps S2408a to S2408c, the shared data management unit 57 of the communication management device 5 transmits the stroke data stored in the shared data management table 1400 and the numbered guide to the electronic blackboards 1a to 1c via the communication unit 51. do.

In steps S2409a to S2409c, the page information management unit 17 of the electronic blackboards 1a to 1c stores the stroke data and the gid received from the communication management device 5 in the page information 1001 as shown in FIG. 7, for example.

By repeatedly executing the above processing, a stroke image (for example, for example) added by the student A is added to the display unit of the electronic blackboard 1a used by the student A, for example, as shown in FIG. 25 (A). The display screen 2510 including the answer etc.) is displayed.

Further, in the electronic blackboard 1b used by the student B, the same processing as in FIG. 24 is repeatedly executed on the electronic blackboard 1b, so that the electronic blackboard 1b is displayed on the display unit as shown in FIG. 25 (B). The display screen 2520 including the stroke image added by the person B is displayed. The display screen 2520 does not include the stroke image added by the student A during the answer mode.

Similarly, in the electronic blackboard 1c used by the student C, the same processing as in FIG. 24 is repeatedly executed on the electronic blackboard 1c, so that the display unit of the electronic blackboard 1c is displayed as shown in FIG. 25 (C). The display screen 2530 including the stroke image added by the student C is displayed. The display screen 2530 does not include the stroke image added by the student A and the student B during the answer mode.

Preferably, the display control unit 14 of the electronic blackboard 1t causes the display screen 2540 to display the selection screen 2411 of one or more pages to be displayed as shown in FIG. 25 (D), for example, in step S2411. Further, the reception unit 12 of the electronic blackboard 1t accepts a selection operation for the page selection screen 2411. In the example of FIG. 25 (D), the page selection screen 2411 has a "1" button for selecting page 1, a "2" button 2442 for selecting page 2, a "3" button for selecting page 3, and page 4. The "4" button for selecting is displayed.

In step S2412, the display control unit 14 of the electronic blackboard 1t locally displays one or more pages selected on the page selection screen 2411 on the display unit such as the display 180 of the electronic blackboard 1t. For example, when the "2" button 2442 is selected on the page selection screen 2441 as shown in FIG. 25 (D), the display screen 2540 displays, for example, page 2 as shown in FIG. 25 (A). , Page selection screen 2441 and so on are displayed. At this time, the display screen 2540 displayed locally is not displayed on the electronic blackboards 1a to 1c. As a result, the instructor can confirm the answer status of the students A to C and perform scoring, etc. during the answer mode.

As a preferred example, the display control unit 14 of the electronic blackboard 1t may have a function of displaying a display screen 2550 that displays thumbnails of pages 1 to 4, as shown in FIG. 25 (E), for example.

(Screen sharing process after the answer mode ends)
FIG. 26 is a sequence diagram showing an example of the screen sharing process after the end of the answer mode according to the first embodiment.

When the reception unit 12 of the electronic blackboard 1t receives the end operation of the answer mode in step S2601, the processes after step S2602 are executed.

In step S2602, the sharing state switching unit 20 of the electronic blackboard 1t sets the sharing state of the electronic blackboard 1t and the electronic blackboards 1a to 1c to "synchronization" in the communication management device 5 via the communication unit 11. To send.

In step S2603, when the shared state management unit 58 of the communication management device 5 receives the synchronization setting information from the electronic blackboard 1t, for example, the shared state management table 1500 as shown in FIG. 15 is updated, and the electronic blackboard 1t becomes electronic. Set the shared state of the blackboards 1a to 1c to "synchronous".

In step S2604, the communication unit 51 of the communication management device 5 transmits the synchronization setting information received from the electronic blackboard 1t to the electronic blackboard 1t. As a result, in step S1605, the shared state switching unit 20 of the electronic blackboard 1t switches the shared state of the electronic blackboard 1t to "asynchronous". The process of step S2604 is not essential, and the electronic blackboard 1t may execute the process of step S2605 after step S2602.

In steps S2606a to 2606c, the communication unit 51 of the communication management device 5 transmits the synchronization setting information received from the electronic blackboard 1t to the electronic blackboards 1a to 1c. As a result, in steps S2607a to S2607c, the shared state switching unit 20 of the electronic blackboards 1a to 1c switches the shared state of the electronic blackboards 1a to 1c to "synchronous".

In step 2611, the page information management unit 17 of the electronic blackboard 1t creates, for example, lecture information 2302 as shown in FIG. 23 (B). The lecture information 2302 has a configuration in which the information of "force_curent" is deleted from the lecture information 2301 shown in FIG. 23 (A). Further, the information of "curent_page" indicating the current page is set to page 1 which is the page at the start of the answer mode.

In step S2603, the display control unit 14 of the electronic blackboard 1t uses the information transmission unit 18 to transmit the lecture information 2302 created by the page information management unit 17 to the communication management device 5.

In steps S2604a to S2604c, the communication unit 51 of the communication management device 5 transmits (transfers) the lecture information 2303 received from the electronic blackboard 1t to the electronic blackboards 1a to 1c.

In steps S2605a to S2605c, the display control unit 14 of the electronic blackboards 1a to 1c displays the page 1 on the display unit such as the display 180 based on the lecture information 2302 received from the communication management device 5.

From this state, for example, in step S2701 of FIG. 27, when the reception unit 12 of the electronic blackboard 1t receives the switching operation to page 2 (selection operation of page 2), the processes after step S2702 are executed.

In step S2702, the display control unit 14 of the electronic blackboard 1t causes the display unit such as the display 180 of the electronic blackboard 1t to display the page 2.

In step S2703, the page information management unit 17 of the electronic blackboard 1t creates, for example, lecture information 2303 as shown in FIG. 23 (C). In this lecture information 2303, the information of "curent_page" of the lecture information 2302 shown in FIG. 23 (B) is changed to page 2.

In step S2704, the display control unit 14 of the electronic blackboard 1t uses the information transmission unit 18 to transmit the lecture information 2303 created by the page information management unit 17 to the communication management device 5.

In steps S2705a to S2705c, the communication unit 51 of the communication management device 5 transmits (transfers) the lecture information 2303 received from the electronic blackboard 1t to the electronic blackboards 1a to 1c.

In steps S2706a to S2706c, the display control unit 14 of the electronic blackboards 1a to 1c causes the display unit such as the display 180 to display the page 2 based on the lecture information 2302 received from the communication management device 5.

By the above processing, the electronic blackboard 1t can share the page 2 shared with the electronic blackboard 1a with other electronic blackboards 1b and 1c during the answer mode.

In the above explanation, an example in which a stroke image is input to the electronic blackboard 1a during the answer mode has been described, but the student A displays characters, character strings, etc. instead of the stroke image on the display screen 2505. The electronic blackboard 1a may share the input character information with other electronic blackboards.

As described above, according to the present embodiment, in the communication terminal 100 including a communication terminal and a plurality of terminals sharing a display screen with the communication terminal, a display screen shared by the communication terminal with one of the plurality of terminals is provided. , Can be shared with other terminals.

[Second Embodiment]
FIG. 27 is a sequence diagram showing an example of voice processing in the response mode according to the second embodiment. This process shows an example of a process for controlling a call (display of a base image, output of sound, etc.) in the answer mode. It should be noted that this process is executed in parallel with the screen sharing process in the answer mode described, for example, in FIGS. 22 and 24.

When the reception unit 12 of the electronic blackboard 1t receives the start operation of the answer mode in step S2801, the processes after step S2802 are executed.

In step S2802, the information transmission unit 18 of the electronic blackboard 1t transmits the call control information (All OFF) requesting the display of the base image and the stop of the sound output to the communication management device 5.

In steps S2803a to S2803c, the communication unit 51 of the communication management device 5 transmits (transfers) the call control information (All OFF) received from the electronic blackboard 1t to the electronic blackboards 1a to 1c.

In steps S2804a to S2804c, the image / sound processing unit 13 of the electronic blackboards 1a to 1c stops displaying the base image and outputting the sound.

In step S2811, for example, when the reception unit 12 of the electronic blackboard 1t receives a call operation with the electronic blackboard 1a, the processes after step S2812 are executed.

In step S2812, the information transmission unit 18 of the electronic blackboard 1t transmits the call control information (terminal ID “01aa” ON) for controlling the call function with the electronic blackboard 1a to the communication management device 5.

In steps S2813a to S2813c, the communication unit 51 of the communication management device 5 transmits (transfers) the call control information (terminal ID "01aa" ON) received from the electronic blackboard 1t to the electronic blackboards 1a to 1c.

In step S2814, when the image / sound processing unit 13 of the electronic blackboard 1a receives the call control information (terminal ID "01aa" ON), the display of the base image and the output of the sound are resumed.

In steps S2715 and S2716, the image / sound processing unit 13 of the electronic blackboards 1b and 1c maintains a state in which the display of the base image and the output of the sound are stopped.

By the above processing, the instructor can make a one-to-one call with a designated student (for example, student A) during the answer mode, and can give individual guidance, attention, and the like.

As described above, according to each embodiment of the present invention, the display screen of the communication terminal can be shared with a plurality of terminals and information can be exchanged.

<Supplement>
Each function of each embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" as used herein is a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

Further, in each of the above embodiments, the communication terminal and the plurality of terminals have been described as assuming that the electronic blackboard 1 is used. However, the communication terminal or the plurality of terminals execute, for example, an application corresponding to the communication system 100. It may be an information terminal having a communication function such as a PC, a smartphone, or a tablet terminal. Further, the communication terminal may be various electronic devices having a communication function and a display function such as a projector, a video conference device, a digital signage, a medical device, a car navigation device, etc. corresponding to the communication system 100.

The programs of the electronic blackboard 1 and the communication management device 5 may be, for example, files in an installable format or an executable format, recorded on a recording medium readable by a computer, and distributed. Further, the programs of the electronic blackboard 1 and the communication management device 5 may be not only a recording medium but also, for example, one that can be downloaded from a server (cloud or on-premises) and installed in a communication terminal.

Further, the communication management device 5 is not limited to the computer 400 as shown in FIG. 4, and is, for example, an electronic device such as a mobile phone, a smartphone, a tablet terminal, a wearable terminal, a PDA (Personal data assistant), and an image forming device. It may be realized.

1t electronic blackboard (communication terminal)
1a, 1b, 1c Electronic blackboard (terminal)
5 Communication management device 12 Reception unit 14 Display control unit 17 Page Information management unit 18 Information transmission unit 19 Reception unit 51 Communication unit 100 Communication system

Japanese Unexamined Patent Publication No. 2018-93361 Japanese Unexamined Patent Publication No. 2012-215786

Claims (16)

A communication terminal that shares image data with multiple terminals.
A display control unit that displays image data and
The reception desk that accepts predetermined operations and
A page information management unit that duplicates the image data displayed on the communication terminal for the plurality of terminals and stores the image data as different image data based on the predetermined operation received by the reception unit.
Communication terminal with. The communication terminal according to claim 1, further comprising an information transmission unit that transmits the plurality of different image data stored in the page information management unit to the plurality of terminals for each image data. The reception unit receives an operation of switching from a shared state of image data between the plurality of terminals and the communication terminal to a non-shared state.
The information transmission unit transmits the switching operation received by the reception unit to the plurality of terminals.
The communication terminal according to claim 2. The page information management unit manages the duplicated different image data, and manages the duplicated image data.
The reception unit accepts a selection operation for selecting image data to be transmitted to any one of the plurality of terminals from among the plurality of different image data managed by the page information management unit.
The communication terminal according to any one of claims 1 to 3. The page information management unit generates identification information for a remote conference between the plurality of terminals and the communication terminal.
The information transmission unit transmits the identification information generated by the page information management unit to the plurality of terminals.
The communication terminal according to claim 2 or 3. A communication system that shares image data between multiple terminals and communication terminals.
The communication terminal is
The first display control unit that displays image data,
The reception desk that accepts predetermined operations and
A page information management unit that duplicates the image data displayed on the communication terminal for the plurality of terminals and stores the image data as different image data based on the predetermined operation received by the reception unit.
An information transmission unit that transmits the plurality of different image data stored in the page information management unit to the plurality of terminals for each image data, and an information transmission unit.
Communication system with. The plurality of terminals
A receiving unit that receives image data transmitted from the information transmitting unit, and a receiving unit.
It has a second display control unit that displays the image data received by the reception unit.
The communication system according to claim 6. A communication system for sharing image data between a plurality of terminals and a communication terminal via a communication management device.
The communication terminal is
The first display control unit that displays image data,
The reception desk that accepts predetermined operations and
A page information management unit that duplicates the image data displayed on the communication terminal for the plurality of terminals and stores the image data as different image data based on the predetermined operation received by the reception unit.
An information transmission unit that transmits the plurality of different image data stored in the page information management unit to the communication management device, and an information transmission unit.
Communication system with. The communication management device is
It has a communication unit that transfers the plurality of different image data received from the communication terminal to the plurality of terminals for each image data.
The plurality of terminals
A receiving unit that receives image data transmitted from the communication management device, and a receiving unit.
It has a second display control unit that displays the image data received by the reception unit.
The communication system according to claim 8. The reception unit receives an operation of switching from a shared state of image data between the plurality of terminals and the communication terminal to a non-shared state.
The information transmission unit transmits the switching operation received by the reception unit to the plurality of terminals.
The communication system according to claim 6 or 8. The page information management unit manages the plurality of different image data and manages the plurality of different image data.
The reception unit accepts a selection operation for selecting image data to be transmitted to any one of the plurality of terminals from among the plurality of different image data managed by the page information management unit.
The communication system according to any one of claims 6 to 10. The page information management unit generates identification information for a remote conference between the plurality of terminals and the communication terminal.
The information transmission unit transmits the identification information generated by the page information management unit to the plurality of terminals.
The communication system according to any one of claims 6 to 11. A communication method executed by a communication terminal that shares image data with multiple terminals.
A display control step to display image data and
A reception step that accepts a predetermined operation and
A page information management step in which the image data displayed on the communication terminal is duplicated for the plurality of terminals and stored as different image data based on the predetermined operation received in the reception step.
An information transmission step of transmitting the plurality of different image data stored in the page information management step to the plurality of terminals for each image data.
Communication method with. A communication method in a communication system that shares image data between a plurality of terminals and a communication terminal.
The communication terminal
A display control step to display image data and
A reception step that accepts a predetermined operation and
A page information management step in which the image data displayed on the communication terminal is duplicated for the plurality of terminals and stored as different image data based on the predetermined operation received in the reception step.
An information transmission step of transmitting the plurality of different image data stored in the page information management step to the plurality of terminals for each image data.
Communication method to execute. It is a communication method in a communication system in which image data is shared between a plurality of terminals and a communication terminal via a communication management device.
The communication terminal
A display control step to display image data and
A reception step that accepts a predetermined operation and
A page information management step in which the image data displayed on the communication terminal is duplicated for the plurality of terminals and stored as different image data based on the predetermined operation received in the reception step.
An information transmission step of transmitting the plurality of different image data stored in the page information management step to the communication management device, and
Communication method to execute. A program for causing a communication terminal to execute the communication method according to any one of claims 13 to 15.

Images