JP2020156085A - Communication management system, communication system, communication management device, image processing method and program - Google Patents

Abstract

To prevent an operation different from the intention of a user performed to a stroke image by an operation from a plurality of terminal devices, in a session which shares the stroke image among the plurality of terminal devices.SOLUTION: A communication management system, which manages a session which shares a stroke image among a plurality of terminal devices, includes: a stroke information management unit which manages stroke information including a plurality of stroke data which represent the stroke image; a receiver unit which receives, from the first terminal device, group operation information designating one or more stroke data to be operated among the plurality of stroke data; and an operation restriction unit which, based on the group operation information, restricts an operation, related to the one or more stroke data, from a second terminal device which is different from the first terminal device.SELECTED DRAWING: Figure 6

Description

The present invention relates to a communication management system, a communication system, a communication management device, an image processing method, and a program.

A conference system for holding a conference between a plurality of terminal devices via a communication network such as the Internet has become widespread. Further, in such a conference system, stroke data for reproducing a stroke image drawn by a user with an electronic pen, a user's hand, or the like is transmitted and received between the terminal devices using a terminal device such as an electronic blackboard. As a result, the stroke image is shared.

Further, in such a conference system, a technology for displaying information on operations by users of other bases on a display or the like so that users of each base can grasp the operations by users of other bases in advance. It is known (see, for example, Patent Document 1).

In a conference where a stroke image is shared between a plurality of terminal devices, when an operation is performed on the shared stroke image from a plurality of terminal devices, the user's intention for the stroke image depends on the timing of the operation. There is a problem that an operation different from that is performed.

It should be noted that such a problem is not limited to the conference system for holding a conference, but is common to various communication systems in which a session for sharing a stroke image is performed, such as a distance lesson and a distance medical treatment.

An embodiment of the present invention has been made in view of the above problems, and in a session in which a stroke image is shared between a plurality of terminal devices, a stroke image can be obtained by operating from a plurality of terminal devices. The purpose is to prevent operations that are not intended by the user.

In order to solve the above problems, the communication management system according to the embodiment of the present invention is a communication management system that manages a session for sharing a stroke image between a plurality of terminal devices.
From the stroke information management unit that manages stroke information including a plurality of stroke data representing the stroke image and the first terminal device, one or more stroke data to be operated is designated from the plurality of stroke data. A receiving unit that receives the group operation information to be used, and an operation limiting unit that restricts operations related to the one or more stroke data by a second terminal device different from the first terminal device based on the group operation information. Has.

According to one embodiment of the present invention, in a session in which a stroke image is shared between a plurality of terminal devices, an operation different from the user's intention is performed on the stroke image by an operation from the plurality of terminal devices. It can be prevented from being lost.

It is a schematic diagram which shows the example of the communication route in the communication system which concerns on one Embodiment. It is a figure for demonstrating the use image of the electronic blackboard which concerns on one Embodiment. It is a figure which shows the example of the hardware composition of the electronic blackboard which concerns on one Embodiment. It is a figure which shows the example of the hardware configuration of the computer which concerns on one Embodiment. It is a figure which shows the example of the system configuration of the communication system which concerns on one Embodiment. It is a figure which shows the example of the functional structure of the communication system which concerns on one Embodiment. It is a figure which shows the example of the authentication management table which concerns on one Embodiment. It is a figure which shows the example of the terminal management table which concerns on one Embodiment. It is a figure which shows the example of the destination list management table which concerns on one Embodiment. It is a figure which shows the example of the session management table which concerns on one Embodiment. It is a figure which shows the example of the relay device management table which concerns on one Embodiment. It is a figure for demonstrating stroke information which concerns on one Embodiment. It is a sequence diagram which shows the example of the process of the preparation stage which concerns on one Embodiment. It is a sequence diagram which shows the example of the session start processing which concerns on one Embodiment. It is a sequence diagram which shows the example of the sharing process of the stroke image which concerns on one Embodiment. It is a sequence diagram which shows the example of the movement processing of the stroke image which concerns on one Embodiment. It is a figure which shows the example of the display screen which concerns on one Embodiment. It is a sequence diagram (1) which shows the example of the operation restriction processing which concerns on 1st Embodiment. It is a figure which shows the example of the group operation information which concerns on one Embodiment. It is a sequence diagram (2) which shows the example of the operation restriction processing which concerns on 1st Embodiment. It is a sequence diagram which shows the example of the operation restriction processing which concerns on 2nd Embodiment. It is a figure which shows the example of the display screen which concerns on 2nd Embodiment. It is a sequence diagram which shows the example of the operation restriction processing which concerns on 3rd Embodiment. It is a figure which shows the example of the display screen which concerns on 3rd Embodiment. It is a figure which shows another example of the use scene which concerns on one Embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[Outline of communication system]
<Communication route>
First, the communication system 100 for conducting a video conference while drawing between a plurality of electronic blackboards 1a and 1b will be described with reference to FIG. FIG. 1 is a schematic view showing a communication route of the present embodiment. Further, the "video conference" may be referred to as a "video conference", a "remote conference", or the like.

The "video conference", "video conference", and "remote conference" are examples of sessions in which stroke images are shared between a plurality of terminal devices. For example, the session for sharing the stroke image may be a session other than the conference, in which distance lessons, distance medical treatment, meetings, simple conversations, etc. are held.

The communication system 100 is constructed of, for example, a plurality of electronic blackboards 1a and 1b, a relay device 3, a communication management system 5, an image storage device 7, and the like.

The electronic whiteboards (terminal devices) 1a and 1b are terminal devices for mutual communication of content data such as video data and sound data for calls, image data for sharing, and stroke data, and are also referred to as IWB (Interactive White Board). Called.

The communication system 100 is not limited to the two electronic blackboards 1a and 1b, and may have three or more electronic blackboards. Further, in the following description, when indicating an arbitrary electronic blackboard among a plurality of electronic blackboards included in the communication system 100, "electronic blackboard 1" is used.

The electronic blackboard 1 is an example of the terminal device according to the present embodiment. The terminal device may be another terminal device having a communication function, a drawing function, a display function, and the like. For example, the terminal device may be an information terminal such as a PC (Personal Computer), a tablet terminal, or a smartphone in which an application program corresponding to the communication system 100 is installed.

The stroke data is data necessary for reproducing (reproducing) the stroke image, and includes coordinate data, line width data, line color data, vector data, and the like. Further, the electronic blackboards 1a and 1b can make a video call by reproducing the video and sound of the other party by transmitting and receiving video data and sound data for a call.

The electronic blackboards 1a and 1b can share the same material image by the user who uses the communication system 100 by transmitting and receiving the image data of the material image for sharing. The material image is an image displayed on the display of the electronic blackboard 1, and may include, for example, a conference material, a background image displayed on the display, an image of a captured screen when the display screen is captured, and the like.

Further, the electronic blackboards 1a and 1b can share the same stroke image by the participants who use the communication system by transmitting and receiving the stroke data of the stroke image for sharing. The stroke image is an image showing a line or the like drawn by a user with a handwritten stroke with an electronic pen or the like. The stroke image is displayed by stroke data indicating points that specify coordinates on the display.

In FIG. 1, an electronic blackboard equipped with a video conferencing function is shown as an example of the electronic blackboards 1a and 1b. The image of the video data may be a moving image or a still image.

Further, in the following description, the electronic blackboard 1 of the requesting source requesting the start of the video conference is referred to as a "start terminal", and the electronic blackboard 1 of the destination (relay destination) of the request destination is referred to as a "destination terminal". For example, in FIG. 1, when the electronic blackboard 1a requests the electronic blackboard 1b to start a video conference, the electronic blackboard 1a becomes the start terminal and the electronic blackboard 1b becomes the destination terminal. The electronic blackboards 1b and 1b are used not only for communication between a plurality of business establishments and between different rooms in the same business establishment, but also for communication within the same room, outdoors and indoors, or outdoors and outdoors. It may be used in the communication of.

The relay device 3 is composed of a computer, and performs a process of relaying content data for a call between a plurality of electronic blackboards 1a and 1b.

The communication management system 5 is composed of a computer, and centrally manages login authentication from the electronic blackboards 1a and 1b, management of the communication status of the electronic blackboards 1a and 1b, management of the destination list, communication status of the relay device 3, and the like. to manage. Further, the communication management system 5 relays stroke data for sharing between a plurality of electronic blackboards 1a and 1b.

The image storage device 7 is configured by a computer, stores image data of a material image for sharing uploaded from the electronic whiteboard 1a, and downloads the image data to the electronic whiteboard 1b. And vice versa. That is, the image storage device 7 saves the image data uploaded from the electronic blackboard 1b and downloads it to the electronic blackboard 1a.

The relay device 3, the communication management system 5, and the image storage device 7 may be constructed by a single computer, or may be constructed by a plurality of computers arbitrarily assigned by dividing each part (function or means). You may be.

Further, in the communication system 100, a management information session sei (hereinafter, referred to as "session sei") for transmitting and receiving various management information is provided between the electronic blackboards 1a and 1b via the communication management system 5. Established. Further, for transmitting and receiving four types of data, high-resolution image data, medium-resolution image data, low-resolution image data, and sound data, between the electronic blackboards 1a and 1b via the relay device 3. Four sessions are established. In FIG. 1, these four sessions are collectively shown as a session sed for image / sound data (hereinafter, simply referred to as “session”). The number of sessions does not necessarily have to be four, and the number of sessions may be less than or greater than the number of four sessions. Further, a session may be directly established between the start terminal and the destination terminal without going through the relay device 3.

Further, in the communication system 100, stroke data can be transmitted and received between the electronic blackboards 1a and 1b by using the session sea.

Here, the video resolution of the video data handled in this embodiment will be described. The low-resolution video data is, for example, composed of 160 pixels in the horizontal direction and 120 pixels in the vertical direction, and serves as a base image. The medium-resolution video data consists of 320 pixels in the horizontal direction and 240 pixels in the vertical direction. The high-resolution video data includes, for example, 640 pixels in the horizontal direction and 480 pixels in the vertical direction. Of these, when passing through a narrow band path, low-quality video data consisting of only low-resolution video data as a base image is relayed. When the band is relatively wide, low-resolution video data as a base image and medium-quality video data consisting of medium-resolution video data are relayed. When the band is very wide, high-quality video data including low-resolution video data as a base image, medium-resolution video data, and high-resolution video data is relayed. Since the amount of sound data is smaller than that of video data, it is relayed even in a narrow band path.

<Image of using electronic blackboard>
FIG. 2 is a diagram for explaining a usage image of the electronic blackboard according to the embodiment. As shown in FIG. 2, the electronic blackboard 1 includes a leg 151 having a plurality of casters on the lower side, a support 152 provided on the upper side of the leg 151, and an electronic blackboard 1 provided on the upper side of the support 152. It has a main body 153 and a display 160 and the like provided on the front surface of the main body 153. The main body 153 has a built-in CPU 101 and the like, which will be described later. Then, the user can input (draw) a stroke image such as characters on the display 160 by using the electronic pen 140 or the like.

[Hardware configuration]
Next, the hardware configuration of each device according to the present embodiment will be described.

<Hardware configuration of electronic blackboard>
FIG. 3 is a diagram showing an example of the hardware configuration of the electronic blackboard according to the embodiment. As shown in FIG. 3, the electronic blackboard 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an SSD (Solid State Drive) 104, and a network I / It includes an F (Interface) 105, an external device connection I / F 106, and the like.

Of these, the CPU 101 is an arithmetic unit that controls the operation of the entire electronic blackboard 1. The ROM 102 is a non-volatile memory for storing programs used for starting the CPU 101 such as the CPU 101 and the IPL (Initial Program Loader). The RAM 103 is a volatile memory used as a work area of the CPU 101. The SSD 104 is a large-capacity storage device that stores various data such as a program for the electronic blackboard 1.

The network I / F 105 is a communication interface for connecting the electronic blackboard 1 to the communication network and performing communication. The external device connection I / F 106 is an interface for connecting various external devices. The external device in this case includes, for example, a USB (Universal Serial Bus) memory 131, an external device (microphone 132, speaker 133, camera 134), and the like.

Further, the electronic blackboard 1 is an antenna of a capture device 111, a GPU (Graphics Processing Unit) 112, a display controller 113, a contact sensor 114, a sensor controller 115, an electronic pen controller 116, a short-range communication circuit 119, and a short-range communication circuit 119. It includes 119a, a power switch 117, selection switches 118, and the like.

Of these, the capture device 111 captures (acquires) a display screen or the like displayed on the display or the like of an external PC (Personal Computer) 150 as a still image or a moving image. The GPU 112 is a semiconductor chip (processor) that specializes in graphics. The display controller 113 controls and manages the screen display in order to output the output image from the GPU 112 to the display 160 or the like. The contact sensor 114 detects that the electronic pen 140, the user's hand H, or the like has come into contact with the display 160. The sensor controller 115 controls the processing of the contact sensor 114.

The contact sensor 114, for example, inputs coordinates and detects coordinates by an infrared blocking method. In the method of inputting the coordinates and detecting the coordinates, two light receiving and emitting devices installed at both upper ends of the display 160 emit a plurality of infrared rays in parallel with the display 160 and are provided around the display 160. This is a method of receiving light that is reflected by a reflecting member and returns on the same optical path as the light path emitted by the light receiving element. The contact sensor 114 outputs an infrared ID emitted by two light emitting / receiving devices blocked by the object to the sensor controller 115, and the sensor controller 115 specifies a coordinate position which is a contact position of the object. The electronic pen controller 116 communicates with the electronic pen 140 to determine whether or not there is a touch of the pen tip or a touch of the pen tip on the display 160. The short-range communication circuit 119 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark).

The power switch 117 is a switch for switching the power on / off of the electronic blackboard 1. The selection switches 118 are, for example, a group of switches for adjusting the brightness and hue of the display 160.

Further, the electronic blackboard 1 is provided with a bus line 120. The bus line 120 includes an address bus, a data bus, various control signals, and the like for electrically connecting each component such as the CPU 101 shown in FIG.

The contact sensor 114 is not limited to the infrared blocking method, but is a capacitive touch panel that specifies the contact position by detecting a change in capacitance, and the contact position is specified by a voltage change between two opposing resistance films. A resistance film type touch panel or the like may be used. Further, the contact sensor 114 may use various detection means such as an electromagnetic induction type touch panel that detects the electromagnetic induction generated by the contact of the contact object with the display unit and specifies the contact position. Further, the electronic pen controller 116 may determine whether or not there is a touch not only on the pen tip and pen tip of the electronic pen 140 but also on the portion gripped by the user of the electronic pen 140 and other electronic pen portions.

<Hardware configuration of management device, relay device, image storage device, PC, etc.>
The communication management system 5, the relay device 3, the image storage device 7, the PC 150, and the like include, for example, the hardware configuration of the computer 400 as shown in FIG. Alternatively, the communication management system 5, the relay device 3, and the image storage device 7 may be realized by a plurality of computers 400.

FIG. 4 is a diagram showing an example of a computer hardware configuration according to an embodiment. The computer 400 includes, for example, a CPU 401, a ROM 402, a RAM 403, an HD (Hard Disk) 404, an HDD (Hard Disk Drive) controller 405, a display 406, an external device connection I / F407, a network I / F408, a keyboard 409, and a pointing device 410. It is equipped with a DVD-RW (Digital Versatile Disk ReWritable) drive 412, a media I / F 414, a bus line 415, and the like.

Of these, the CPU 401 is an arithmetic unit that controls the overall operation of the computer 400. The ROM 402 is a non-volatile memory that stores a program used to drive the CPU 401 such as an IPL. The RAM 403 is a volatile memory used as a work area of the CPU 401. The HD404 is a large-capacity storage device that stores programs such as an OS (Operating System) and applications, and various data. The HDD controller 405 controls reading or writing of various data to the HD404 according to the control of the CPU 401.

The display 406 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 407 is an interface for connecting various external devices. The network I / F408 is a communication interface for performing data communication using a communication network. The keyboard 409 is a kind of input means including a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device 410 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like.

The DVD-RW drive 412 controls reading or writing (storage) of data to the DVD-RW411. The DVD-RW drive 412 may control reading or writing (storage) of data to a disc such as a BD-RE (Blu-ray (registered trademark) Disc Rewritable) instead of the DVD-RW411. The media I / F414 controls reading or writing (storage) of data to a recording medium 413 such as a flash memory. The bus line 415 includes an address bus, a data bus, various control signals, and the like for electrically connecting each component such as the CPU 401 shown in FIG.

[Overall configuration of communication system]
Subsequently, the overall configuration of the communication system 100 will be described. FIG. 5 is a diagram showing an example of a system configuration of a communication system according to an embodiment.

In FIG. 5, the electronic blackboard 1a is installed at the base A, and the electronic blackboard 1b is installed at the base B. For example, base A is the Tokyo office in Japan, and base B is the Osaka office in Japan. It is assumed that the user A uses the electronic blackboard 1a at the base A, and the user B and the user C use the electronic blackboard 1b at the base B. The electronic blackboard 1a is an example of the first terminal device, and the electronic blackboard 1b is an example of the second terminal device.

Further, the electronic blackboards 1a and 1b, the relay device 3, the communication management system 5, and the image storage device 7 transmit and receive data to and from each other via, for example, a communication network 500 such as the Internet or a LAN (Local Area Network). Can be done. The communication network 500 may include a wireless communication portion. In FIG. 5, the electronic blackboards 1a and 1b are assumed to be electronic blackboards capable of transmitting and receiving conference images.

[Functional configuration of communication system]
Next, the functional configuration of the communication system 100 according to the present embodiment will be described. FIG. 6 is a diagram showing an example of the functional configuration of the communication system according to the embodiment. In FIG. 6, it is assumed that the electronic blackboard 1b has the same functional configuration as the electronic blackboard 1a.

<Functional configuration of electronic blackboard>
Each electronic blackboard 1 has a transmission / reception unit 11, a reception unit 12, a video / sound processing unit 13, a display control unit 14, an image processing unit 15, and an information transmission unit 16 by executing a predetermined program on the CPU 101 of FIG. The short-range communication unit 17, the storage / reading processing unit 18, and the like are realized. It should be noted that at least a part of each of the above functional configurations may be realized by hardware. Further, the electronic blackboard 1 has a storage unit 1001 realized by the RAM 103, SSD 104, etc. of FIG.

(Each function configuration of electronic blackboard 1)
The transmission / reception unit 11 transmits / receives various data (or information) to / from another terminal, device, or system via the communication network 500. The transmission / reception unit 11 also serves as a start unit, and performs a process of logging in to the communication management system 5 and the like and a process of starting communication with another terminal device.

The reception unit 12 receives various inputs from the user using the electronic pen 140 or the like. For example, the reception unit 12 receives a designation operation for designating one or more stroke data to be operated, a change operation related to the stroke data, a stroke image drawing operation, and the like.

The video / sound processing unit 13 performs the main processing of the video conferencing function. For example, the video / sound processing unit 13 performs digital processing such as encoding of video data and sound data together with the output signal of the microphone 132 and the output signal of the camera 134. Further, the video / sound processing unit 13 generates a video signal, a sound signal, and the like based on the video data and the sound data received by the transmission / reception unit 11. Further, the video / sound processing unit 13 also performs processing such as combining video data having different resolutions.

The display control unit 14 outputs a video signal (image signal) or the like to the display 160 to control the display screen.

The image processing unit 15 performs the main processing of the electronic blackboard function. For example, the image processing unit 15 creates a stroke image and stroke data based on the stroke of the electronic pen 140 or the like received by the reception unit 12, or creates a stroke image based on the stroke data received by the transmission / reception unit 11. Perform the process of creating. The image processing unit 15 also performs a process of generating an image signal based on the image data of the material image received by the transmission / reception unit 11.

The information transmission unit 16 transmits the stroke data created by the image processing unit 15 to the communication management system 5. Further, the information transmission unit 16 communicates group operation information for designating one or more stroke data in response to a designated operation for designating one or more stroke data to be operated received by the reception unit 12. Send to management system 5.

The short-range communication unit 17 acquires and provides data by short-range wireless communication with each terminal having the short-range communication unit.

The storage / reading processing unit 18 performs a process of storing various data in a recording medium 1002 such as a storage unit 1001 or a USB memory 131, a process of reading various data stored in the storage unit 1001 or the recording medium 1002, and the like.

In addition, the storage unit 1001 overwrites and stores the video data and sound data received when communicating with another terminal each time it is received. Of these, the image is displayed on the display 160 by the video data before being overwritten, and the sound is output from the speaker 133 by the sound data before being overwritten.

<Functional configuration of communication management system>
The communication management system (communication management device) 5 is, for example, by executing a predetermined program on the CPU 401 of FIG. 4, the transmission / reception unit 51, the authentication unit 52, the terminal management unit 53, the session management unit 54, and the relay device management unit 55. , The stroke information management unit 56, the operation restriction unit 57, the storage / reading processing unit 58, and the like are realized. It should be noted that each of the above functional configurations may be realized by a program executed by a plurality of computers 400. Further, at least a part of each of the above functional configurations may be realized by hardware. Further, the communication management system 5 has a storage unit 5000 realized by the HD504 or the like shown in FIG. The storage unit 5000 stores, for example, an authentication management DB (Database) 5001, a terminal management DB 5002, a destination list management DB 5003, a session management DB 5004, a relay device management DB 5005, a stroke information 5006, and the like.

(Authentication management table)
FIG. 7 is a diagram showing an example of an authentication management table according to an embodiment. In the storage unit 5000, for example, the authentication management DB 5001 configured by the authentication management table 700 as shown in FIG. 7 is stored. In the authentication management table 700, each password is associated and managed for each terminal ID of all the electronic blackboards 1 managed by the communication management system 5. For example, in the authentication management table 700 shown in FIG. 7, it is shown that the password corresponding to the terminal ID of the electronic blackboard 1a (terminal device) is "01aa" is "aaaa".

The terminal ID is identification information for identifying the electronic blackboard (terminal device) 1, and is an example of identification information for the communication management system 5 to manage a terminal device such as the electronic blackboard 1. For example, the communication management system 5 manages the electronic blackboard 1 by using a user ID that identifies a user, a contract ID that identifies a contractor, a communication ID that identifies a communication source, and the like instead of a terminal ID. It may be.

The password is an example of authentication information for authenticating a terminal device such as the electronic blackboard 1. The authentication information may be, for example, authentication information other than a password such as an access token.

(Terminal management table)
FIG. 8 is a diagram showing an example of a terminal management table according to an embodiment. In the storage unit 5000, for example, the terminal management DB 5002 configured by the terminal management table 800 as shown in FIG. 8 is stored. In the terminal management table 800, for each terminal ID for identifying each electronic blackboard 1 (terminal device), the destination name when each electronic blackboard 1 is set as the destination, the operating state of each electronic blackboard 1, and the login request described later. The reception date and time when the information is received by the communication management system 5 and the IP address of each electronic blackboard 1 (terminal device) are associated and managed.

For example, in the terminal management table 800 shown in FIG. 8, the electronic blackboard 1a having the terminal ID "01aa" has the terminal name "Japan Tokyo Office AA terminal" and the operating state is "online (communicable)". It is shown to be. Further, in the electronic blackboard 1a having the terminal ID "01aa", the date and time when the login request information is received by the communication management system 5 is "13:40 on April 10, 2015", and the IP address is "1.2". It is shown to be ".1.3." The terminal ID, destination name, IP address of the terminal, and the like are stored when each electronic blackboard 1 is pre-registered to receive the service provided by the communication management system 5.

(Destination list management table)
FIG. 9 is a diagram showing an example of a destination list management table according to an embodiment. In the storage unit 5000, for example, the destination list management DB 5003 configured by the destination list management table 900 as shown in FIG. 9 is stored. In the destination list management table 900, all the terminal IDs of the destination terminals registered as candidates for the electronic blackboard 1 (destination terminal) are associated with the terminal ID of the electronic blackboard 1 (starting terminal) requesting the start of communication. Be managed. For example, in the destination list management table 900 shown in FIG. 9, the terminal ID is a candidate for a destination terminal that can request the start of communication from the start terminal (electronic blackboard 1a) whose terminal ID is "01aa". Is shown to include the electronic blackboard 1b and the like of "01ba". The candidate of the destination terminal is updated by being added or deleted at the request of addition or deletion to the communication management system 5 from an arbitrary starting terminal.

The destination list is an example of destination information, and the destination information may not be in the form of a list and may include information related to the destination such as a terminal ID.

(Session management table)
FIG. 10 is a diagram showing an example of a session management table according to an embodiment. In the storage unit 5000, for example, the session management DB 5004 configured by the session management table 1000 as shown in FIG. 10 is stored. In the session management table 1000, for each session ID for identifying a session, the device ID of the relay device 3 to be used, the terminal ID of the starting terminal, the terminal ID of the destination terminal, the terminal ID of one or more participating terminals, and the like. Is associated and managed. Further, in the session management table 1000, for example, the reception delay time (ms) when the video data is received at the destination terminal, the reception date / time when the delay information indicating the delay time is received from the destination terminal, and the like are displayed. Information is further associated and managed. For example, in the session management table 1000 shown in FIG. 10, in the session of the session ID "se01", the relay device 3 of the relay device ID "111a" is the start terminal of the terminal ID "01aa" and the destination terminal of the terminal ID "01ba". Is relaying communication with. Further, in the session with the session ID "se01", it is shown that the delay time of the video data as of "13:41 on April 10, 2015" is 200 (ms).

(Relay device management table)
FIG. 11 is a diagram showing an example of a relay device management table according to an embodiment. In the storage unit 5000, for example, the relay device management DB 5005 configured by the relay device management table 1100 as shown in FIG. 11 is stored. In the relay device management table 1100, the operating status of each relay device 3, the reception date and time when the status information indicating the operating status is received, the IP address of the relay device 3, and the IP address of the relay device 3 are used for each relay device ID of the plurality of relay devices 3. The maximum data transmission rate (Mbps) and the like are associated and managed. For example, in the relay device management table 1100 shown in FIG. 11, the relay device 3 having the relay device ID "111a" has an operating state of "online" and the date and time when the state information is received by the communication management system 5. It is shown to be "12:00 on April 10, 2015". Further, it is shown that the relay device 3 having the relay device ID "111a" has the IP address of the relay device 3 "1.2.1.2" and the maximum data transmission speed in the relay device 3 is 100 Mbps. Has been done.

(Stroke information)
FIG. 12 is a diagram for explaining stroke information according to one embodiment. This figure shows an image of an example of stroke information 5006 stored in the storage unit 5000.

In the example of FIG. 12, the stroke information 5006 has a hierarchical structure of "meeting", "pages (pages 1 to 3)", and "strokes (strokes 1 to 5)".

The "stroke" corresponds to the stroke data according to the present embodiment, and is managed for each "page" by the stroke information management unit 56. For example, the stroke 1 includes a stroke ID (id = aaaaaaa) that identifies the stroke 1, information that identifies the parent page 1 (part = hijkl), a Gid “g001” that identifies the drawing data 1, and drawing data 1. Etc. are included. For example, when an operation such as movement is performed on the stroke image represented by the stroke 1, the stroke ID (id = aaaaaaa) is inherited as it is, but the Gid "g001" that distinguishes the drawing data 1 from the drawing data 1 is , Will be updated.

The drawing data 1 is drawing data for reproducing the stroke 1, and includes, for example, coordinate data, line width data, line color data, vector data, and the like.

The pages of the electronic blackboard 1 can be switched, and the "pages" correspond to each page of the electronic blackboard 1. For example, the page 1 includes information such as a page ID (id = hijkl) for identifying the page 1 and information for identifying a parent "meeting" (partent = abcdefg).

The "meeting" corresponds to a session managed by the communication system 100, and is managed by, for example, a session ID (id = abcdefg) that identifies the session.

For example, the image processing unit 15 of the electronic blackboard 1 can create a stroke image drawn on the page 1 by using the drawing data 1 to 5 included in the strokes 1 to 5.

The session ID (id = abcdefg) is an example of the first identification information for identifying the session (meeting), and the stroke ID (id = aaaaaa) is an example of the second identification information for identifying the stroke data. Is. Further, the Gid "g001" or the like that identifies the drawing data 1 is an example of the third identification information that identifies the drawing data.

(Each function configuration of communication management system)
Here, returning to FIG. 6, each functional configuration of the communication management system 5 will be described.

The transmission / reception unit 51 transmits / receives various data (or information) to / from another terminal, device, or system via the communication network 500. For example, the transmission / reception unit 51 functions as a reception unit that receives group operation information that specifies one or more stroke data to be operated from the electronic blackboard 1.

The authentication unit 52 authenticates the login request received via the transmission / reception unit 51. For example, when the combination of the terminal ID and the password included in the login request received from the electronic blackboard 1 is stored in the authentication management table 700 as shown in FIG. 7, the authentication unit 52 logs in to the electronic blackboard 1. Allow.

The terminal management unit 53 manages the terminal management DB 5002, and updates information such as the operating state, the reception date and time, and the IP address of the terminal in the terminal management table 800 as shown in FIG. 8, for example, according to the state of the electronic blackboard 1. To do.

Further, the terminal management unit 53 manages the destination list management table 900, and for example, in response to a request from the electronic blackboard 1, the destination list including the terminal ID of the destination terminal in the destination list management table 900 as shown in FIG. Provide information.

The session management unit 54 manages the sessions held in the communication system 100. For example, the session management unit 54 generates a session ID for identifying a session according to the start request information requesting the start of communication from the electronic blackboard 1. Further, the session management unit 54 stores and manages various information about the session in the session management table 1000 as shown in FIG. 10, for example, in association with the session ID.

The relay device management unit 55 manages the relay device management DB 5005, and selects, for example, the relay device 3 to be used for relaying the session by using the relay device management table 1100 as shown in FIG. For example, the relay device management unit 55 selects the relay device 3 near the start terminal from the IP address of each relay device 3 stored in the relay device management table 1100 and the IP address of the start terminal. There may be. Alternatively, the relay device management unit 55 may select the relay device 3 based on the maximum data transmission speed of each relay device 3 stored in the relay device management table 1100.

In the present embodiment, the method of selecting the relay device 3 used for relaying the session may be any method. Further, the number of relay devices 3 included in the communication system 100 may be one.

The stroke information management unit 56 stores and manages stroke data transmitted in, for example, session sei from the electronic blackboard 1 participating in the session in the storage unit 5000 or the like in association with the session ID. For example, the stroke information management unit 56 stores the stroke data received from the electronic blackboard 1 in the stroke information 5006 as shown in FIG. Further, the stroke information management unit 56 transfers, for example, the stroke data received from the electronic blackboard 1 to another electronic blackboard 1 participating in the same session as the electronic blackboard 1.

The operation restriction unit 57 receives the stroke data designated by the other electronic blackboard 1 based on the group operation information that specifies one or more stroke data to be operated, which is received from the electronic blackboard 1 by the transmission / reception unit 51. Restrict operations related to. The processing by the operation restriction unit 57 and the group operation information will be described later.

The storage / reading processing unit 58 performs a process of storing various data in the storage unit 5000, a process of reading various data stored in the storage unit 5000, and the like.

<Functional configuration of image storage device>
The image storage device 7 realizes the transmission / reception unit 71, the storage / reading processing unit 72, and the like by executing a predetermined program on the CPU 401 of FIG. 4, for example. Further, the image storage device 7 has a storage unit 7000 realized by the RAM 403, HD404, etc. of FIG.

(Each function configuration of the image storage device)
The transmission / reception unit 71 transmits / receives various data (or information) to / from another terminal, device, or system via the communication network 500. The storage / reading processing unit 72 performs a process of storing various data in the storage unit 7000 and reading various data stored in the storage unit 7000.

With the above configuration, the image storage device 7 stores, for example, the image data uploaded from the electronic blackboard 1 in a designated URL (Uniform Resource Locator), and is designated in response to a request from the electronic whiteboard 1. The image data stored in the URL is provided.

<Functional configuration of relay device>
The relay device 3 realizes the transmission / reception unit 31, the determination unit 32, the storage / reading processing unit 33, and the like by executing a predetermined program on the CPU 401 of FIG. 4, for example. Further, the relay device 3 has a storage unit 3000 realized by the RAM 403, HD404, etc. of FIG.

(Each function configuration of the relay device)
The transmission / reception unit 31 transmits / receives various data (or information) to / from another terminal, device, or system via the communication network 500. The transmission / reception unit 31 also serves as a transfer unit, and for example, transfers video data and sound data received from the electronic blackboard 1 to another electronic blackboard 1 participating in the same session as the electronic blackboard 1. The determination unit 32 makes various determinations such as determination of a data delay state and the like.

The storage / reading processing unit 33 performs a process of storing various data in the storage unit 3000, a process of reading various data stored in the storage unit 3000, and the like.

The functional configuration of the communication system 100 shown in FIG. 6 is an example, and the communication system 100 can be modified in various ways. For example, each functional configuration included in the communication management system 5 may be realized by a plurality of computers 400. Further, the function of the image storage device 7 may be realized by an external storage server or the like of the communication system 100. Further, at least a part of the functional configurations of the image storage device 7 and the relay device 3 may be included in the communication management system 5. Furthermore, the electronic blackboard 1 is an example of a terminal device, and the terminal device may be an information terminal that executes an application corresponding to the communication system 100.

[Processing flow]
Subsequently, the processing flow of the communication management method and the image processing method according to the present embodiment will be described.

<Processing in the preparatory stage of remote communication>
FIG. 13 is a sequence diagram showing an example of processing in the preparatory stage according to the embodiment. This process shows an example of a preparatory process that is executed before the electronic blackboard 1 participates in a session (video conference) in the communication system 100.

First, when the power switch 117 is turned on on the electronic blackboard 1a, the reception unit 12 receives the power on (step S22).

Next, the transmission / reception unit 11 transmits login request information requesting login to the communication management system 5 via the communication network 500 (step S23). The login request information includes, for example, a terminal ID and password of the electronic blackboard 1a.

Next, the authentication unit 52 of the communication management system 5 searches the authentication management table 700 as shown in FIG. 7 using the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys. To do. Further, the authentication unit 52 permits the login of the electronic blackboard 1a when the combination of the terminal ID and the password included in the login request information is managed by the authentication management table 700 (step S24). Here, when the combination of the terminal ID and the password included in the login request information is managed by the authentication management table 700, the processes after step S25 are executed.

When the login of the electronic blackboard 1a is permitted, the terminal management unit 53 updates the information corresponding to the terminal ID "01aa" of the electronic blackboard 1a in the terminal management table 800 as shown in FIG. For example, the terminal management unit 53 changes the "operating status" information corresponding to the terminal ID "01aa" to "online (communicable)", and changes the "reception date and time" information to the date and time when the login request information is received. Update to (step S25). Note that the IP address information of the terminal is not registered in advance, but the IP address transmitted from the electronic blackboard 1a in step S23 may be used. As a result, in the terminal management table 800, for example, as shown in FIG. 8, the terminal ID "01aa", the operating state "online (communication possible)", the reception date and time "2015.4.1.13: 40", and The IP address "1.2.1.3" and the like are managed in association with each other.

Next, the session management unit 54 sets a new record in which the terminal ID “01aa” of the electronic blackboard 1a received in step S23 is set as the “terminal ID of the start terminal” in the session management table 1000 as shown in FIG. And manage it (step S26). Then, the transmission / reception unit 51 of the communication management system 5 transmits the authentication result information indicating the authentication result obtained by the process of step 24 to the electronic blackboard 1a that has requested the login via the communication network 500 ( Step S27).

When the transmission / reception unit 11 of the electronic blackboard 1a receives the authentication result information indicating that login is permitted, the destination list request information indicating that the destination list is requested from the communication management system 5 via the communication network 500. Is transmitted (step S28). As a result, the transmission / reception unit 51 of the communication management system 5 receives the destination list request information.

Next, the terminal management unit 53 searches the destination list management table 900 as shown in FIG. 9 using the terminal ID “01aa” of the electronic blackboard 1a as a search key, and is a destination candidate capable of communicating with the electronic blackboard 1a. Read the terminal ID. Further, the terminal management unit 53 reads the destination name corresponding to the terminal ID of the destination candidate from the terminal management table 800 as shown in FIG. 8 (step S29). As a result, the terminal IDs of the destination candidates corresponding to the terminal ID "01aa" of the electronic blackboard 1a and the destination names corresponding to these are extracted.

Next, the transmission / reception unit 51 of the communication management system 5 reads, for example, the data of the destination list frame stored in the storage unit 5000 and the data of the icon indicating the operating state via the storage / reading processing unit 58 ( Step S30). Further, the transmission / reception unit 51 of the communication management system 5 includes "destination list information (destination list frame, icon, terminal ID, destination name) including the read destination list frame and icon, the terminal ID and the destination name extracted in step S29). Is transmitted to the electronic blackboard 1a (step S31). As a result, in the electronic blackboard 1a, the transmission / reception unit 11 receives the destination list information, and the storage / reading processing unit 18 stores the received destination list information in the storage unit 1001 (step S32).

As described above, in the present embodiment, the communication management system 5 centrally manages the destination list information of all terminals, instead of managing the destination list information on each electronic blackboard 1. Therefore, when a new electronic blackboard 1 is registered in the communication management system 5, a new model terminal device is registered in place of the already included electronic blackboard 1, and the appearance of the destination list frame is changed. However, it is possible to save the trouble of changing the destination list information on each electronic blackboard 1 side.

Further, the terminal management unit 53 of the communication management system 5 searches the terminal management table 800 as shown in FIG. 8 using the terminal ID of the destination candidate extracted in step S29 as a search key, and searches for each destination candidate terminal ID. Read the corresponding operating status. As a result, the terminal management unit 53 acquires the operating state of each electronic blackboard 1 corresponding to the terminal ID of the destination candidate (step S33).

Next, the transmission / reception unit 51 of the communication management system 5 provides "terminal status information" including the terminal ID used as the search key in step S33 and the operating status of each corresponding destination terminal to the communication network 500. Is transmitted to the electronic blackboard 1a via the above (step S34).

Next, the storage / reading processing unit 18 of the electronic blackboard 1a sequentially stores the state information of the terminal received from the communication management system 5 in the storage unit 1001 (step S35). Therefore, by receiving the status information of each of the electronic blackboards 1a, the electronic blackboard 1a can acquire the current operating status of the electronic blackboards 1b, 1c, etc., which are candidate destinations capable of communicating with the electronic blackboard 1a. ..

Next, the display control unit 14 of the electronic blackboard 1a creates a destination list that reflects the state of the terminal as a destination candidate based on the destination list information stored in the storage unit 1001 and the state information of the terminal. .. Further, the display control unit 14 displays the destination list screen on the display 160 of the electronic blackboard 1a by using the created destination list (step S36).

On the other hand, the terminal management unit 53 of the communication management system 5 uses the electronic blackboard 1a as a destination candidate by searching the destination list management table 900 as shown in FIG. 9 based on the terminal ID "01aa" of the electronic blackboard 1a. The terminal ID of another registered terminal is extracted (step S37).

Next, the terminal management unit 53 of the communication management system 5 searches the terminal management table 800 as shown in FIG. 8 based on the terminal ID “01aa” of the electronic blackboard 1a, and acquires the operating state of the electronic blackboard 1a. (Step S38).

Then, the transmission / reception unit 51 sets the terminal ID of the electronic blackboard 1a and the operating state on the electronic blackboard 1 of the terminal ID whose operating state is "online" in the terminal management table 800 among the terminal IDs extracted in step S37. "Terminal status information" including the above is transmitted (step S39). When transmitting the state information of the terminal to each electronic blackboard 1, the transmission / reception unit 51 refers to the IP address of each electronic blackboard 1 managed in the terminal management table 800 based on each terminal ID. As a result, the terminal ID "01aa" of the electronic blackboard 1a and the operating state "online" can be transmitted to each electronic blackboard 1 capable of communicating with the electronic blackboard 1a as a destination candidate. As a result, the state of the electronic blackboard 1a can be displayed on each electronic blackboard 1 that is a destination candidate (step S40).

<Session start processing>
FIG. 14 is a sequence diagram showing an example of session start processing according to the embodiment. This process shows, for example, an example of a session start process executed by the communication system 100 when the electronic blackboard 1a requests the electronic blackboard 1b to start a session.

In step S1401, when the electronic blackboard 1a, which is the start terminal, accepts the destination selection by the user A, the processes after step S1402 are executed. Here, it is assumed that the electronic blackboard 1b is selected as the destination terminal by the user A.

In step S1402, when the electronic blackboard 1a accepts the destination selection by the user A, the transmission / reception unit 11 of the electronic blackboard 1a transmits the start request information requesting the start of the session to the communication management system 5. The start request information includes, for example, the terminal ID "01aa" of the electronic blackboard 1a which is the start terminal, the terminal ID "01ba" of the electronic blackboard 1b which is the destination terminal, the IP address of the electronic blackboard 1a which is the start terminal, and the like. Is included. As a result, the transmission / reception unit 51 of the communication management system 5 receives the start request information and also receives the IP address of the start terminal (electronic blackboard 1a) that is the transmission source.

In step S1403, the terminal management unit 53 of the communication management system 5 updates the terminal management DB 5002 based on the terminal ID of the start terminal and the terminal ID of the destination terminal included in the start request information. For example, the terminal management unit 53 sets the terminal IDs "01aa" and "01ba" in the terminal management table 800 based on the terminal ID "01aa" of the start terminal and the terminal ID "01ba" of the destination terminal included in the start request information. Update the corresponding "Operating status" to "Online (in communication)". In this state, the electronic blackboard 1a, which is the start terminal, and the electronic blackboard 1b, which is the destination terminal, do not participate in the session, but are managed as being in communication.

In step S1404, the session management unit 54 of the communication management system 5 generates a session ID for identifying the session to be held between the electronic blackboard 1a and the electronic blackboard 1b. Here, it is assumed that the session management unit 54 generates the session ID "se01".

In step S1405, the session management unit 54 associates the generated session ID, the terminal ID “01aa” of the start terminal, the terminal ID “01ba” of the destination terminal, and the like with the session management table 1000 as shown in FIG. Remember and manage.

In step S1406, the relay device management unit 55 of the communication management system 5 selects the relay device 3 that relays the session between the start terminal (electronic blackboard 1a) and the destination terminal (electronic blackboard 1b). For example, the relay device management unit 55 has an IP that is close to the IP address of the start terminal (electronic blackboard 1a) in the terminal management table 800 among the device IDs related to the relay device 3 whose operating state is “online” in the relay device management table 1100. Select the address relay device 3. Here, it is assumed that the relay device 3 having the device ID “111a” is selected.

In steps S1407a and S1407b, the session management unit 54 of the communication management system 5 transmits relay device selection information to the start terminal (electronic blackboard 1a) and the destination terminal (electronic blackboard 1b) via the transmission / reception unit 51. The relay device selection information includes, for example, the IP address of the relay device 3 selected in step S1406, the session ID generated in step S1404, the IP address of the communication management system 5, and the like.

In steps S1408a and S1408b, when the transmission / reception unit 11 of the start terminal (electronic blackboard 1a) and the destination terminal (electronic blackboard 1b) receives the relay device selection information, the transmission / reception unit 11 receives reception completion information indicating that the relay device selection information has been received. , Transmit to the communication management system 5. The reception completion information includes, for example, the session ID "se01" included in the relay device selection information.

In steps S1409a and S1409b, the transmission / reception unit 11 of the start terminal (electronic blackboard 1a) and the destination terminal (electronic blackboard 1b) uses the device ID and session ID of the relay device 3 included in the relay device selection information. Then, a session is established with the relay device 3. As a result, the electronic blackboard 1a and the electronic blackboard 1b can participate in the session with the same session ID "se01" and can transmit and receive video data such as conference video, sound data, and the like to and from each other via the relay device 3. become.

By the above processing, a video conference for transmitting and receiving a conference video or the like can be performed between the user A of the electronic blackboard 1a and the user B of the electronic blackboard 1b.

<Stroke image sharing process>
In the communication system 100, the user A of the electronic blackboard 1a and the users B and C of the electronic blackboard 1b participating in the video conference use a stroke image drawn on each electronic blackboard 1 with an electronic pen 140 or the like as a shared image. , Can be displayed on another electronic blackboard 1. Here, an example of a process of sharing a stroke image between the electronic blackboard 1a and the electronic blackboard 1b participating in the same session will be described.

FIG. 15 is a sequence diagram showing an example of stroke image sharing processing according to one embodiment. At the start of the process shown in FIG. 15, it is assumed that the electronic blackboard 1a and the electronic blackboard 1b are participating in the same session by, for example, the session start process shown in FIG.

Further, it is assumed that the electronic blackboard 1a and the electronic blackboard 1b share the material image via the image storage device 7 and display the material image on the display 160, if necessary.

In step S1501, the user A brings the electronic pen 140 or the hand H into contact with the display 160 of the electronic blackboard 1a to draw (move), so that the reception unit 12 inputs the drawn stroke (trajectory). Accept.

In step S1502, the image processing unit 15 of the electronic blackboard 1a creates stroke data for displaying the stroke image corresponding to the stroke received by the reception unit 12.

In step S1503, the display control unit 14 of the electronic blackboard 1a causes the display 160 to display a stroke image based on the stroke data created by the image processing unit 15. As a result, the stroke image drawn by the user A on the display 160 with the electronic pen 140 or the like is displayed on the display 160.

In step S1504, the transmission / reception unit 11 of the electronic blackboard 1a transmits stroke data for reproducing the stroke image drawn by the user A to the communication management system 5 in, for example, session sei. As a result, the transmission / reception unit 51 of the communication management system 5 receives the stroke data transmitted from the electronic blackboard 1a.

In step S1505, the stroke information management unit 56 of the communication management system 5 registers the stroke data received from the electronic blackboard 1a in the stroke information 5006 as shown in FIG. 12, for example.

In step S1506, the stroke information management unit 56 of the communication management system 5 transfers the stroke data to the electronic blackboard 1b participating in the same session as the electronic blackboard 1a. As a result, the transmission / reception unit 11 of the electronic blackboard 1b receives the stroke data.

In step S1507, the image processing unit 15 of the electronic blackboard 1b creates a stroke image based on the stroke data received by the transmission / reception unit 11.

In step S1508, the display control unit 14 of the electronic blackboard 1b causes the display 160 to display the stroke image created by the image processing unit 15, that is, the stroke image drawn by the user A in step S1501.

When the user B or the user C draws on the electronic blackboard 1b with the electronic pen 140 or the like, the stroke image can be displayed on the electronic blackboard 1a in the same manner.

In this way, the stroke image can be shared between the electronic blackboard 1a and the electronic blackboard 1b participating in the same session.

<Movement process of stroke image>
In a conference in which a stroke image is shared between a plurality of electronic blackboards (terminal devices) 1a and 1b, the shared stroke image is edited from the plurality of electronic blackboards 1a and 1b, such as movement processing, respectively. It can be carried out. In this case, for example, when a movement operation or the like is performed on a shared stroke image from a plurality of electronic blackboards 1a and 1b, depending on the timing of the operation, the stroke image may be the intention of the user. May result in different operations.

In order to solve such a problem, the communication management system 5 restricts the editing operation by the user B on the stroke image, for example, when the user A is performing the editing operation on the stroke image to be operated. It has an operation restriction function.

Here, before explaining the operation restriction function, an example of stroke image movement processing when the operation restriction function is not used will be described.

FIG. 16 is a sequence diagram showing an example of stroke image movement processing according to an embodiment. At the start of the process shown in FIG. 16, for example, by the stroke image sharing process shown in FIG. 15, the stroke images ST1 to 5 are displayed on the displays of the electronic blackboard 1a and the electronic blackboard 1b as shown in FIG. 17 (A). It is assumed that the display screen 1710 including the above is displayed. Further, in the stroke information 5006 managed by the stroke information management unit 56 of the communication management system 5, for example, as shown in FIG. 12, stroke data (strokes 1 to 5) corresponding to the stroke images ST1 to 5 are stored. It is assumed that there is.

Further, here, as an example for explanation, the user A of the electronic blackboard 1a performs an operation of sequentially moving the stroke images ST1 to 5 to the left, and the user B of the electronic blackboard 1b performs the stroke images ST2 to It is assumed that the operation of sequentially moving 4 downward is performed.

In step S1601, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST1 (Gid = g001) to the left by a predetermined distance in response to the movement operation to the stroke image ST1 by the user A. , Transmit to the communication management system 5. This operation information includes, for example, coordinate information after the stroke image ST1 is moved.

In response to this, the stroke information management unit 56 of the communication management system 5 updates the drawing data 1 of the stroke 1 corresponding to the stroke image ST1 (Gid = g001) and the Gid in the stroke information 5006 shown in FIG. To do. Further, as a result, for example, as in the display screen 1720 shown in FIG. 17B, the stroke image ST1 shared between the electronic blackboard 1a and the electronic blackboard 1b moves to the left.

In step S1602, the stroke information management unit 56 of the communication management system 5 transmits a success notification indicating that the movement of the stroke image ST1 is successful to the electronic blackboard 1a. This success notification includes an updated gid of the stroke image ST1 (eg, Gid = g006).

In step S1603, the information transmission unit 16 of the electronic blackboard 1a transmits operation information for moving the stroke image ST2 (Gid = g002) to the left by a predetermined distance in response to the movement operation to the stroke image ST2 by the user A. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates the drawing data 2 of the stroke 2 and the Gid corresponding to the stroke image ST2 (Gid = g002) in the stroke information 5006 shown in FIG. To do. Further, as a result, for example, as in the display screen 1730 shown in FIG. 17C, the stroke image ST2 shared between the electronic blackboard 1a and the electronic blackboard 1b moves to the left.

In step S1604, the stroke information management unit 56 of the communication management system 5 transmits a success notification indicating that the movement of the stroke image ST2 is successful to the electronic blackboard 1a. This success notification includes an updated gid of the stroke image ST2 (eg, Gid = g007).

In step S1605, the information transmission unit 16 of the electronic blackboard 1b transmits operation information for moving the stroke image ST2 (Gid = g002) downward by a predetermined distance in response to the movement operation to the stroke image ST2 by the user B. , Transmit to the communication management system 5. However, since the vid of the stroke image ST2 has been updated to "g007", the stroke information management unit 56 of the communication management system 5 cannot perform the movement processing of the stroke image ST2 (Gid = g002).

In step S1606, the stroke information management unit 56 of the communication management system 5 transmits a failure notification indicating that the movement of the stroke image ST2 has failed to the electronic blackboard 1b.

In step S1607, the information transmission unit 16 of the electronic blackboard 1b provides operation information for moving the stroke image ST3 (Gid = g003) downward by a predetermined distance in response to the movement operation to the stroke image ST3 by the user B. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates the drawing data 3 of the stroke 3 corresponding to the stroke image ST3 (Gid = g003) and the Gid in the stroke information 5006 shown in FIG. To do. Further, as a result, for example, as in the display screen 1740 shown in FIG. 17D, the stroke image ST3 shared between the electronic blackboard 1a and the electronic blackboard 1b moves downward.

In step S1608, the stroke information management unit 56 of the communication management system 5 transmits a success notification indicating that the movement of the stroke image ST3 is successful to the electronic blackboard 1b. This success notification includes an updated gid of the stroke image ST3 (eg, Gid = g008).

In step S1609, the information transmission unit 16 of the electronic blackboard 1b transmits operation information for moving the stroke image ST4 (Gid = g004) downward by a predetermined distance in response to the movement operation to the stroke image ST4 by the user B. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates the drawing data 3 of the stroke 4 corresponding to the stroke image ST4 (Gid = g004) and the Gid in the stroke information 5006 shown in FIG. To do. Further, as a result, for example, as in the display screen 1750 shown in FIG. 17 (E), the stroke image ST4 shared between the electronic blackboard 1a and the electronic blackboard 1b moves downward.

In step S1610, the stroke information management unit 56 of the communication management system 5 transmits a success notification indicating that the movement of the stroke image ST4 is successful to the electronic blackboard 1b. This success notification includes an updated gid of the stroke image ST4 (eg, Gid = g009).

In step S1611, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST3 (Gid = g003) to the left by a predetermined distance in response to the movement operation to the stroke image ST3 by the user A. , Transmit to the communication management system 5. However, since the guide of the stroke image ST3 has been updated to "g008", the stroke information management unit 56 of the communication management system 5 cannot perform the movement processing of the stroke image ST3 (Gid = g003).

In step S1612, the stroke information management unit 56 of the communication management system 5 transmits a failure notification indicating that the movement of the stroke image ST3 has failed to the electronic blackboard 1a.

In step S1613, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST4 (Gid = g004) to the left by a predetermined distance in response to the movement operation to the stroke image ST4 by the user A. , Transmit to the communication management system 5. However, since the gid of the stroke image ST4 has been updated to "g009", the stroke information management unit 56 of the communication management system 5 cannot perform the movement process of the stroke image ST4 (Gid = g004).

In step S1614, the stroke information management unit 56 of the communication management system 5 transmits a failure notification indicating that the movement of the stroke image ST4 has failed to the electronic blackboard 1a.

In step S1615, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST5 (Gid = g005) to the left by a predetermined distance in response to the movement operation to the stroke image ST5 by the user A. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates the drawing data 2 of the stroke 2 corresponding to the stroke image ST5 (Gid = g005) and the Gid in the stroke information 5006 shown in FIG. To do. Further, as a result, the stroke image ST5 shared between the electronic blackboard 1a and the electronic blackboard 1b moves to the left, for example, as shown in the display screen 1760 shown in FIG. 17 (F).

As described above, when the operation restriction function is not used, the stroke images ST1, ST2, and ST5 move to the left according to the operation of the user A as shown in the display screen 1760 shown in FIG. 17 (F). The stroke images ST3 and ST4 move downward according to the operation of the user B. As a result, the stroke images ST1 to 5 are moved to a position different from the intention of the user A and the intention of the user B.

In order to solve such a problem, the communication management system 5 restricts the editing operation by the user B on the stroke image, for example, when the user A is performing the editing operation on the stroke image to be operated. It has an operation restriction function.

[First Embodiment]
FIG. 18 is a sequence diagram (1) showing an example of the operation restriction process according to the first embodiment. This process shows an example of the operation restriction process by the operation restriction unit 57 of the communication management system 5.

At the start of the process shown in FIG. 18, for example, by sharing the stroke image shown in FIG. 15, the stroke image ST1 is displayed on the displays of the electronic blackboard 1a and the electronic blackboard 1b as shown in FIG. 17 (A). It is assumed that the display screen 1710 including ~ 5 is displayed. Further, in the stroke information 5006 managed by the stroke information management unit 56 of the communication management system 5, for example, as shown in FIG. 12, stroke data (strokes 1 to 5) corresponding to the stroke images ST1 to 5 are stored. It is assumed that there is.

Further, here, as an example for explanation, it is assumed that the user A of the electronic blackboard 1a performs an operation of sequentially moving the stroke images ST1 to 5 to the left.

In step S1801, the reception unit 12 of the electronic blackboard 1a receives the group selection operation by the user A.

In the present embodiment, the user selects a stroke image to be operated and notifies the communication management system 5 of a list of stroke data to be operated before editing the shared stroke image. It shall be possible.

In step S1802, the information transmission unit 16 of the electronic blackboard 1a sends a group operation request 1 for designating one or more stroke data to be operated to the communication management system 5 in response to the group selection operation by the user A. Send. The group operation request 1 is an example of group operation information that specifies one or more stroke data to be operated.

FIG. 19A shows an image of an example of group operation information 1910 (group operation request 1) transmitted by the information transmission unit 16 of the electronic blackboard 1a to the communication management system 5. In the group operation information 1910 shown in FIG. 19A, the character string "" lock ":" abcdefg "" is information that specifies identification information that identifies a conference (session) to be operated. In the example of FIG. 19A, it is shown that the stroke information to be operated is, for example, the stroke information 5006 of the conference (id = abcdefg) shown in FIG.

Further, the character string "" list ": [" aaaaa "," bbbbb "," ccccc "," ddddd "," eeee "]" is information that specifies the stroke ID of the stroke data to be operated. In the example of FIG. 19A, it is shown that the stroke data to be operated is stroke 1, stroke 2, stroke 3, stroke 4, and stroke 5.

In step S1803 of FIG. 18, when the operation restriction unit 57 of the communication management system 5 receives the group operation request 1 transmitted from the electronic blackboard 1a, the operation restriction unit 57 operates on the operation target (stroke data) specified in the group operation request 1. Determine whether the restricted operation target (stroke data) is included.

If the operation target specified in the group operation request 1 does not include the operation target whose operation is restricted, the processes after step S1804 are executed. On the other hand, when the operation target specified in the group operation request 1 includes the operation target whose operation is restricted, the operation restriction unit 57 of the communication management system 5 puts the operation restriction unit 57 on the request source electronic blackboard 1 as described later. Send a refusal notice.

In step S1804, the operation restriction unit 57 of the communication management system 5 starts the operation restriction process for the stroke data specified in the group operation request 1. As a result, the operation limiting unit 57 prohibits operations from the other electronic blackboard 1b regarding the stroke image specified in the group operation request 1 transmitted from the electronic blackboard 1a.

In step S1805, the operation restriction unit 57 of the communication management system 5 transmits a reception notification indicating that the group operation request 1 has been accepted to the electronic blackboard 1a of the request source.

In step S1806, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST1 (Gid = g001) to the left by a predetermined distance in response to the movement operation to the stroke image ST1 by the user A. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates, for example, the drawing data 1 of the stroke 1 corresponding to the stroke image ST1 (Gid = g001) in the stroke information 5006 shown in FIG. Is updated to "g006".

In step S1807, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST2 (Gid = g002) to the left by a predetermined distance in response to the movement operation to the stroke image ST2 by the user A. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates, for example, the drawing data 2 of the stroke 2 corresponding to the stroke image ST2 (Gid = g002) in the stroke information 5006 shown in FIG. Is updated to "g007".

Here, for example, in step S1808, the reception unit 12 of the electronic blackboard 1b is assumed to accept the group selection operation by the user B.

In step S1809, the information transmission unit 16 of the electronic blackboard 1b sends a group operation request 2 for designating one or more stroke data to be operated to the communication management system 5 in response to the group selection operation by the user B. Send. The group operation request 2 is another example of group operation information that specifies one or more stroke data to be operated.

FIG. 19B shows an image of an example of group operation information 1920 (group operation request 2) transmitted by the information transmission unit 16 of the electronic blackboard 1b to the communication management system 5. In the group operation information 1920 shown in FIG. 19B, the stroke information to be operated by the character string "" lock ":" abcdefg "" is, for example, the stroke information 5006 of the conference (id = abcdefg) shown in FIG. It is shown to be.

Further, the character string "" list ": [" bbbbbb "," ccccc "," dddddd "]" indicates that the stroke data to be operated is the stroke 2, the stroke 3, and the stroke 4.

In step S1810 of FIG. 18, when the operation restriction unit 57 of the communication management system 5 receives the group operation request 2 transmitted from the electronic blackboard 1b, the operation restriction unit 57 operates on the operation target (stroke data) specified in the group operation request 2. Determine whether or not the restricted operation target (stroke data) is included.

Here, in step S1804, the group operation information 1910 shown in FIG. 19A starts the operation restriction process for the stroke data of the stroke IDs "aaaaaa", "bbbbbb", "cccccc", [dddddd], and "eeeeee". Has been done. Further, in the group operation information 1920 shown in FIG. 19B, stroke IDs “bbbbbb”, “cccccc”, and [dddddd] are specified as stroke data to be operated.

In this way, when a part or all of the designated operation target (stroke data) is included in the operation target (stroke data) whose operation is restricted, the operation restriction unit 57 sets the requesting electron in step 1811. A rejection notice (or failure notice) is sent to the blackboard 1b. In this case, users B and C of the electronic blackboard 1b cannot perform operations on the stroke data ST2, ST3, and ST4 to be operated.

In step S1812, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST3 (Gid = g003) to the left by a predetermined distance in response to the movement operation to the stroke image ST3 by the user A. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates, for example, the drawing data 3 of the stroke 3 corresponding to the stroke image ST3 (Gid = g003) in the stroke information 5006 shown in FIG. Is updated to "g008".

In step S1813, the information transmission unit 16 of the electronic blackboard 1a provides operation information for moving the stroke image ST4 (Gid = g004) to the left by a predetermined distance in response to the movement operation to the stroke image ST4 by the user A. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates, for example, the drawing data 4 of the stroke 4 corresponding to the stroke image ST4 (Gid = g004) in the stroke information 5006 shown in FIG. Is updated to "g009".

In step S1814, the information transmission unit 16 of the electronic blackboard 1a transmits operation information for moving the stroke image ST5 (Gid = g005) to the left by a predetermined distance in response to the movement operation to the stroke image ST5 by the user A. , Transmit to the communication management system 5. In response to this, the stroke information management unit 56 of the communication management system 5 updates, for example, the drawing data 5 of the stroke 4 corresponding to the stroke image ST5 (Gid = g005) in the stroke information 5006 shown in FIG. Is updated to "g010".

In step S1815, when the operation restriction unit 57 of the communication management system 5 receives an operation for all the stroke data designated as the operation target, it determines that the group operation has been completed and ends the operation restriction process.

As another example, the operation restriction unit 57 may determine that the group operation is completed when the end information of the group operation is received from the electronic blackboard 1a.

Preferably, the operation restriction unit 57 ends the group restriction process when a predetermined time has elapsed from the start of the operation restriction process. As a result, for example, when the electronic blackboard 1a transmits group operation information to the communication management system 5 and exits the session due to an obstacle or the like before completing the operation for all the stroke information to be operated, the operation target Can be prevented from becoming uneditable.

In step S1816, the operation restriction unit 57 of the communication management system 5 transmits the completion information indicating that the group operation is completed to the electronic blackboard 1a. The Gid of each stroke data updated by the group operation may be notified to the electronic blackboard 1a using this completion information. For example, a success notification as shown in step S1602 of FIG. 16 may be used. The electronic blackboard 1a may be notified.

By the above processing, for example, as shown in the display screen 1770 of FIG. 17 (G), the stroke images ST1 to ST5 to be operated are moved to the left side as intended by the user A.

FIG. 20 is a sequence diagram (2) showing an example of the operation restriction process according to the first embodiment. This process shows another example of the operation restriction process by the operation restriction unit 57 of the communication management system 5. Of the processes shown in FIG. 20, the processes of steps S1801 to S1807 and S1812 to S1816 are the same as the processes described in FIG. 18, and therefore, the differences from the processes shown in FIG. 18 will be mainly described here. ..

In step S2001, the reception unit 12 of the electronic blackboard 1b receives a movement operation by the user B for moving the stroke image ST3 downward by a predetermined distance during the group operation for the stroke images ST1 to ST5 by the user A. It shall be.

In step S2002, the information transmission unit 16 of the electronic blackboard 1b provides operation information for moving the stroke image ST3 (Gid = g003) downward by a predetermined distance in response to the movement operation to the stroke image ST3 by the user B. , Transmit to the communication management system 5. However, since the stroke image ST3 is restricted in operation by the operation restriction process by the operation restriction unit 57 of the communication management system 5, the stroke information management unit 56 performs the movement process of the stroke image ST3 (Gid = g003). I can't.

In step S2003, the stroke information management unit 56 of the communication management system 5 transmits a failure notification indicating that the movement of the stroke image ST3 has failed to the electronic blackboard 1b.

As described above, when the operation restriction unit 57 according to the present embodiment receives the group operation information transmitted from the electronic blackboard 1, it restricts the operations from the other electronic blackboard 1 regarding the stroke image specified by the group operation information. ..

Therefore, according to the present embodiment, in a session in which a stroke image is shared between a plurality of terminal devices, an operation different from the user's intention is performed on the stroke image by an operation from the plurality of terminal devices. It can be prevented from being stored.

[Second Embodiment]
FIG. 21 is a sequence diagram showing an example of the operation restriction process according to the second embodiment. This process shows an example of the operation restriction process by the communication management system 5 and the electronic blackboard 1.

Here, the communication system 100 has three electronic blackboards 1a, 1b, and 1c, and the three electronic blackboards 1a, 1b, and 1c participate in a video conference sharing the same stroke image. The following explanation will be given as if it were.

In step S2101, the reception unit 12 of the electronic blackboard 1a receives a group selection operation by the user A who uses the electronic blackboard 1a. Here, it is assumed that "Page 1" of the electronic blackboard 1a is selected by the group selection operation. As described above, the group selection operation for designating one or more stroke data to be operated may be performed on a page-by-page basis.

In step S2102, the information transmission unit 16 of the electronic blackboard 1a has "page 1" which is the information of the selected operation target and the terminal ID "10aa" of the electronic blackboard 1a according to the group selection operation by the user A. A group operation request including and is transmitted to the communication management system 5.

In step S2103, when the operation restriction unit 57 of the communication management system 5 receives the group operation request transmitted from the electronic blackboard 1a, the operation target (stroke) whose operation is restricted is displayed on the "page 1" specified by the group operation request. Determine if data, pages, etc.) are included.

If the operation target specified in the group operation request does not include the operation target whose operation is restricted, the processes after step S2104 are executed. On the other hand, when the operation target specified in the group operation request includes the operation target whose operation is restricted, the operation restriction unit 57 of the communication management system 5 cancels the execution of the processes after step S2104 and requests. Send a refusal notice to the original electronic blackboard 1a. Here, the following description will be given assuming that the operation target specified in the group operation request does not include the operation target whose operation is restricted.

In step S2104, the operation restriction unit 57 of the communication management system 5 starts the operation restriction process for the page 1 specified in the group operation request.

In step S2105, the operation restriction unit 57 of the communication management system 5 transmits a reception notification indicating that the group operation request has been accepted to the electronic blackboard 1a of the request source.

In addition, the operation restriction unit 57 of the communication management system 5 according to the second embodiment performs operation restriction processing on all the other electronic blackboards 1b and 1c participating in the video conference in steps S2106 and S2107. Sends an operation restriction notification indicating that it has started. In this operation restriction notification, for example, information on the operation target subject to the operation restriction (for example, "page 1") and information on the electronic blackboard 1a on which the operation restriction is applied to the operation target (for example, the terminal ID "10aa"). ) Etc. are included. The information on the electronic blackboard 1a may be the terminal name of the electronic blackboard 1a, the destination name managed by the terminal management table 800, or the like.

In steps S2108 and S2109, the display control unit 14 of the electronic blackboards 1b and 1c that received the operation restriction notification from the communication management system 5 displays, for example, that page 1 is operation-restricted, as shown in FIG. Display screen 2200.

FIG. 22 is a diagram showing an example of a display screen according to the second embodiment. This figure shows an example of the display screen 2200 displayed by the electronic blackboards 1b and 1c in steps S2108 and S2109 of FIG. 21, for example. In FIG. 22, it is assumed that the page 1 is displayed on the display screen 2200 of the electronic blackboards 1b and 1c. Further, on the display screen 2200, a message 2201 indicating that the operation of page 1 is restricted is displayed. With this message 2201, it is possible to suppress the operation on the page 1 by the electronic blackboards 1b and 1c. Preferably, the message 2201 includes information (for example, a terminal name, a destination name, a terminal ID, etc.) regarding the electronic blackboard 1a that locks (operates) the page 1.

The message 2201 is an example of display information indicating that the operation is restricted. For example, the display information indicating that the operation is restricted may be information other than a character string such as a pictogram or an icon.

By the above processing, the user A who uses the electronic blackboard 1a can preferentially operate the stroke image included in the operation target “page 1”.

For example, in step S2111, when the user A moves the stroke image ST1 of page 1 of the electronic blackboard 1a to the right, the processes after step S2112 are executed.

In step S2112, the information transmission unit 16 of the electronic blackboard 1a transmits operation information for moving the stroke image ST1 (stroke1) of page 1 to the right by a predetermined distance to the communication management system 5.

In steps S2113 and S2114, the stroke information management unit 56 of the communication management system 5 transmits operation information for moving the stroke image ST1 (stroke1) to the right by a predetermined distance to the electronic blackboards 1b and 1c.

As a result, in steps S2115 and S2116, the stroke image ST1 of page 1 on the electronic blackboards 1b and 1c is moved to the right, and the same stroke image is displayed on page 1 of the electronic blackboards 1a, 1b and 1c.

As described above, according to the communication system 100 according to the second embodiment, the stroke image is operated differently from the user's intention by the operation from the plurality of electronic blackboards 1a, 1b, and 1c. You can prevent that.

[Third Embodiment]
FIG. 23 is a sequence diagram showing an example of the operation restriction process according to the third embodiment. Since the processes of steps S2101 to S2104 of FIG. 23 are the same as the processes of the second embodiment described with reference to FIG. 21, the differences from the second embodiment will be mainly described here.

In step S2104 of FIG. 23, after the operation restriction unit 57 of the communication management system 5 starts the operation restriction process, the operation restriction notification is transmitted to the electronic blackboards 1b and 1c on the electronic blackboards 1b and 1c. There is a risk that the operation for page 1 will be performed.

For example, in step S2301 of FIG. 23, it is assumed that the user B using the electronic blackboard 1b moves the stroke image ST1 on the page 1 to the left. In this case, the communication management system 5 and the electronic blackboard 1 execute the processes of steps S2302 to S2304.

In step S2302, the information transmission unit 16 of the electronic blackboard 1b transmits operation information for moving the stroke image ST1 (stroke1) of page 1 to the left by a predetermined distance to the communication management system 5.

However, since the operation of page 1 has already been restricted by the operation restriction process by the operation restriction unit 57 of the communication management system 5, the stroke information management unit 56 may perform the movement process of the stroke image ST1 on page 1. Can not. In such a case, the stroke information management unit 56 of the communication management system 5 transmits a failure notification indicating that the movement of the stroke image ST1 on page 1 has failed to the electronic blackboard 1b in step S2303.

In step S2304, when the image processing unit 15 of the electronic blackboard 1b receives the failure notification from the communication management system 5, the stroke image ST1 of the page 1 that failed to move is returned to the original position. As a result, the stroke image of page 1 displayed on the electronic blackboards 1a, 1b, and 1c can be maintained in the same state.

In the second embodiment, when the electronic blackboard 1b is displaying the display screen 2200 as shown in FIG. 22, the movement operation for the stroke image ST1 on page 1 is also accepted in FIG. 23. The processing of steps S2302 to S2304 can be applied.

Subsequently, in step S2305, the processing after the operation restriction unit 57 of the communication management system 5 transmits the reception notification indicating that the group operation request has been accepted to the electronic blackboard 1a of the request source will be described.

In steps S2306 and S2307, the operation limiting unit 57 of the communication management system 5 is
An operation restriction notification indicating that the operation restriction process has started is transmitted to all the other electronic blackboards 1b and 1c participating in the video conference.

In steps S2308 and S2309, the electronic blackboards 1b and 1c that have received the operation restriction notification from the communication management system 5 prohibit the operation on the stroke image of the page 1 subject to the operation restriction. For example, the display control unit 14 of the electronic blackboards 1b and 1c displays the display screen 2400 as shown in FIG. 24, and the reception unit 12 of the electronic blackboards 1b and 1c accepts the editing operation for the stroke image of page 1. Ban.

FIG. 24 is a diagram showing an example of a display screen according to the third embodiment. This figure shows an example of the display screen 2400 displayed by the electronic blackboards 1b and 1c in steps S2308 and S2309 of FIG. 23, for example.

In FIG. 24, it is assumed that page 1 is displayed on the display screen 2400 of the electronic blackboards 1b and 1c. However, page 1 is displayed in gray out, for example, so that the operation cannot be performed. Further, on the display screen 2400, the operation of page 1 is restricted, and a message 2401 indicating that the operation cannot be performed is displayed. Preferably, the message 2401 includes information (for example, a terminal name, a destination name, a terminal ID, etc.) regarding the electronic blackboard 1a that locks (operates) the page 1.

Since the electronic blackboards 1b and 1c cannot perform editing operations on the stroke image of the page 1 by the above processing, the user A who uses the electronic blackboard 1a gives priority to the stroke image included in the page 1. Can be operated as a target.

In the second and third embodiments, as an example, an example in which the operation is restricted with respect to the stroke image on page 1 has been described, but the stroke data subject to the operation restriction is the stroke data of the first embodiment. Similarly, it may be one or more selected stroke images. Further, the stroke data subject to the operation restriction may be a stroke image of a plurality of pages.

As described above, according to each embodiment of the present invention, in a session in which a stroke image is shared between a plurality of terminal devices, an operation different from the user's intention for the stroke image can be performed by an operation from the plurality of terminal devices. It can be prevented from being done.

<Supplement>
Each function of each embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in the present specification is a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

Further, in the embodiment described above, the terminal device is assumed to be the electronic blackboard 1, but the present invention is not limited to this. For example, each embodiment of the present invention is also applicable to the interactive projector 2501 as shown in FIG. The interactive projector 2501 is, for example, a terminal device capable of projecting a display screen 2503 on a projection surface 2502 and writing a stroke image, selecting a menu, or the like with a pen, a user's finger, or the like, similar to the electronic blackboard 1. ..

Further, as another example of the terminal device, an information terminal such as a PC, a smartphone, a smart watch, a car navigation device, etc. that executes an application corresponding to the communication system 100 may be included. In addition, the terminal device includes a medical device. In the case of medical devices, the document image may include a patient image or the like.

Further, in each of the embodiments described above, the case where the video conferencing is performed by the communication system 100 has been described, but the present invention is not limited to this, and the present invention is not limited to this, and the general conversation such as meetings, family and friends, remote medical care, or , May be used to present information in one direction.

1 Electronic blackboard (an example of terminal device)
5 Communication management system (communication management device)
51 Transmitter / receiver (receiver)
56 Stroke information management unit 57 Operation restriction unit 100 Communication system 1910, 1920 Group operation information 5006 Stroke information

Japanese Unexamined Patent Publication No. 2015-60592

Claims (13)

A communication management system that manages sessions that share stroke images between multiple terminal devices.
A stroke information management unit that manages stroke information including a plurality of stroke data representing the stroke image, and
A receiving unit that receives group operation information that specifies one or more stroke data to be operated from the plurality of stroke data from the first terminal device.
An operation limiting unit that limits operations related to the one or more stroke data by a second terminal device different from the first terminal device based on the group operation information.
Has a communication management system. When the one or more stroke data designated by the group operation information does not include the stroke data whose operation is being restricted, the operation restriction unit relates to the one or more stroke data by the second terminal device. The communication management system according to claim 1, which prohibits operation. When the one or more stroke data designated by the group operation information includes the stroke data whose operation is being restricted, the operation restriction unit performs an operation related to the one or more stroke data by the second terminal device. The communication management system according to claim 1 or 2, which cancels the process of prohibiting. The operation restriction unit is
When the operation related to the one or more stroke data by the second terminal device is prohibited, and then the operation related to each of the one or more stroke data to be the target of the operation is performed by the first terminal device. The communication management system according to any one of claims 1 to 3, which terminates the prohibition of operations relating to one or more stroke data. The stroke information management unit manages the plurality of stroke data in association with the first identification information that identifies the session.
The stroke data includes the second identification information for identifying the stroke data, the drawing data for reproducing the stroke image, and the third identification information for identifying the drawing data. The communication management system according to any one of 4. The communication management system according to claim 5, wherein the group operation information includes the first identification information and the second identification information for identifying the one or more stroke data. A communication system including the communication management system according to any one of claims 1 to 6 and a plurality of terminal devices participating in a session managed by the communication management system.
The terminal device is
A designated operation that specifies one or more stroke data to be operated, and a reception unit that accepts an editing operation related to the one or more stroke data.
An information transmission unit that transmits group operation information that specifies one or more stroke data to be the target of the editing operation to the communication management system in response to the designated operation.
A communication system that has. The terminal device indicates that the operation related to the one or more stroke data is restricted in response to the operation restriction notification that restricts the operation related to the one or more stroke data notified from the communication management system. The communication system according to claim 7, further comprising a display control unit that displays information on a display screen. The claim that the reception unit prohibits the acceptance of editing operations related to the one or more stroke data in response to the operation restriction notification that restricts the operations related to the one or more stroke data notified from the communication management system. The communication system according to 7 or 8. The operation restriction unit of the communication management system is
Based on the group operation information that specifies one or more stroke data received from the first terminal device, each of the second terminal devices different from the first terminal device among the plurality of terminal devices The communication system according to any one of claims 7 to 9, wherein an operation restriction notification indicating that the operation related to the one or more stroke data is restricted is transmitted. A communication management device that manages sessions that share stroke images between multiple terminal devices.
A stroke information management unit that manages stroke information including a plurality of stroke data representing the stroke image, and
A receiving unit that receives group operation information that specifies one or more stroke data to be operated from the plurality of stroke data from the first terminal device.
An operation limiting unit that limits operations related to the one or more stroke data by a second terminal device different from the first terminal device based on the group operation information.
A communication management device that has. A communication management system that manages sessions that share stroke images between multiple terminal devices
A process for managing stroke information including a plurality of stroke data representing the stroke image, and
A process of receiving group operation information for designating one or more stroke data to be operated from the plurality of stroke data from the first terminal device.
Based on the group operation information, a process of restricting operations related to the one or more stroke data by a second terminal device different from the first terminal device, and
Image processing method to execute. A program that causes a communication management system to execute the image processing method according to claim 12.