JP2019135567A - Information processing apparatus, management system, image sharing system, image sharing method, and program - Google Patents

Abstract

To improve convenience by controlling display of drawing information displayed on each information processing apparatus according to display authority for the drawing information that an input side having input the drawing information has, when the drawing information input into the information processing apparatus is shared among the plurality of information processing apparatuses.SOLUTION: An information processing apparatus including a display unit that receives and displays display information displayed on an external apparatus via a network includes: reception means that receives an input of the drawing information to the display unit; and display control means that controls display of the drawing information on the basis of authority information indicating display authority for the received drawing information to the display unit.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing apparatus, a management system, an image sharing system, an image sharing method, and a program.

  In recent years, remote conference systems that perform communication between bases via a communication network such as the Internet have become widespread. In such a remote conference system, for example, one communication terminal is installed at one site, and the other communication terminal is installed at the other site. When a conference or the like is performed using a remote conference system, one communication terminal captures an image of one user, collects comments and the like, and transmits them as content data to the other communication terminal. The other communication terminal can realize a conference between remote bases by outputting the received content data.

  The communication terminal can also share the conference material between the bases by transmitting an image of an opened window or the like as the conference material to the other communication terminal. Furthermore, in such a remote conference system, in order to proceed with the discussion efficiently, it is possible to draw (handwritten) on the display screen on which the shared conference material is displayed, and a technology that can also share the drawn drawing information. Are known.

  For example, Patent Document 1 discloses a technology of a whiteboard sharing system that shares drawing information input to a handwritten input display device as drawing information drawn on an electronic whiteboard between each of a plurality of handwritten input display devices. Disclosure.

  In such a system, there is a case where it is desired to restrict the input of drawing information for each handwriting input display device (for example, information processing device). For example, there is a case where it is desired to erase the drawing information input from the other information processing apparatus while displaying the drawing information input from one information processing apparatus. However, in the conventional method, when input drawing information is shared among a plurality of information processing devices, the information is displayed on each information processing device according to the display authority of the drawing information that the input side that has input the drawing information has. The display of the drawn information cannot be controlled, which is not convenient.

  An information processing apparatus according to the present invention is an information processing apparatus including a display unit that receives and displays display information displayed on an external device via a network, and an accepting unit that receives input of drawing information to the display unit; Display control means for controlling display of drawing information based on authority information indicating display authority of the accepted drawing information to the display unit.

  According to the present invention, when input drawing information is shared and displayed between a plurality of information processing devices, each information processing device is displayed according to the display authority of the drawing information on the input side that has input the drawing information. Convenience can be improved by controlling the display of the drawing information displayed on the screen.

1 is a diagram illustrating an example of a system configuration of an image sharing system according to a first embodiment. It is a figure which shows an example of the state of transmission / reception of various information in the image sharing system which concerns on 1st Embodiment. 1 is a schematic diagram for explaining an outline of an image sharing system according to a first embodiment. It is a figure which shows an example of the hardware constitutions of the information processing apparatus which concerns on 1st Embodiment. It is a figure which shows an example of the hardware constitutions of the transmission terminal which concerns on 1st Embodiment. It is a figure which shows an example of the hardware constitutions of the communication management apparatus which concerns on 1st Embodiment. It is a figure which shows an example of a function structure of the image sharing system which concerns on 1st Embodiment. It is a figure which shows an example of the authentication management table which concerns on 1st Embodiment. It is a figure which shows an example of the state management table which concerns on 1st Embodiment. It is a figure which shows an example of the destination list management table which concerns on 1st Embodiment. It is a figure which shows an example of the session management table which concerns on 1st Embodiment. It is a figure which shows an example of the drawing authority management table which concerns on 1st Embodiment. It is a flowchart which shows an example of the image sharing process in the image sharing system which concerns on 1st Embodiment. In the image sharing system according to the first embodiment, it is a sequence diagram illustrating an example of processing for preparing a communication between transmission terminals and establishing a session. In the image sharing system according to the first embodiment, it is a sequence diagram illustrating an example of a process of displaying display data displayed by an information processing apparatus on an information processing apparatus that is a sharing destination. 4 is a flowchart illustrating an example of an input screen generation process for receiving drawing information input in the information processing apparatus according to the first embodiment. It is a figure which shows an example of the display screen displayed on the information processing apparatus which has normal drawing authority and temporary drawing authority. It is a figure which shows an example of the display screen displayed on the information processing apparatus which does not have normal drawing authority but has temporary drawing authority. It is a figure for demonstrating an example of the superimposition of the several image in the display data displayed on the information processing apparatus which concerns on 1st Embodiment. It is a figure for demonstrating an example of page data. It is a figure for demonstrating an example of stroke arrangement | sequence data. It is a figure for demonstrating an example of coordinate arrangement | sequence data. It is a figure for demonstrating an example of media data. It is a sequence diagram for sharing the drawing image in the image sharing system which concerns on 1st Embodiment. It is a flowchart which shows an example of the drawing process with respect to the display data displayed on the information processing apparatus which concerns on 1st Embodiment. It is a figure which shows an example of the drawing authority management table which concerns on the modification 1 of 1st Embodiment. It is a figure which shows an example of the drawing authority management table which concerns on the modification 2 of 1st Embodiment. It is a figure which shows an example of the display screen displayed on the information processing apparatus which concerns on the modification 2 of 1st Embodiment. It is a figure which shows an example of the system configuration | structure of the image sharing system which concerns on 2nd Embodiment. It is a figure which shows an example of a function structure of the image sharing system which concerns on 2nd Embodiment. In the image sharing system which concerns on 2nd Embodiment, it is a sequence diagram which shows an example of the process which displays the display data which the information processing apparatus displayed on the information processing apparatus which is a share destination. It is a sequence diagram for sharing the drawing image in the image sharing system which concerns on 2nd Embodiment. It is a figure which shows an example of the system configuration | structure of the image sharing system which concerns on 3rd Embodiment.

  Hereinafter, embodiments for carrying out the invention will be described with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant descriptions are omitted.

● First embodiment ●
System Configuration FIG. 1 is a diagram illustrating an example of a system configuration of the image sharing system according to the first embodiment. The image sharing system shown in FIG. 1 is a system that can share a display image displayed on the information processing apparatus 10 installed at each of a plurality of bases. In addition, the image sharing system illustrated in FIG. 1 has the drawing information included in the input side to which the drawing information is input when the drawing information input to the information processing apparatus 10 is shared and displayed between the plurality of information processing apparatuses 10. The display of the drawing information displayed on each information processing apparatus 10 can be controlled according to the display authority.

  The image sharing system includes a plurality of information processing apparatuses 10 (10a, 10b, hereinafter referred to as information processing apparatus 10 when it is not necessary to distinguish them), and a plurality of transmission terminals 40 (40a, 40b, hereinafter referred to as "identification"). When there is not, it is set as the transmission terminal 40.), a plurality of external input devices 50 (50a, 50b, hereinafter referred to as the external input device 50 when it is not necessary to distinguish), the administrator terminal 60, the relay device 70 and the communication management device 90.

  The image sharing system is a data providing system that transmits content data in one direction from one transmission terminal 40a to which the information processing apparatus 10a is connected to the other transmission terminal 40b to which the information processing apparatus 10b is connected, or a plurality of transmissions This is a communication system for transmitting content data between terminals 40 in both directions. Examples of the communication system include a video conference system, a video phone system, and a chat system.

  Hereinafter, in the present embodiment, a case where the content data is image data and sound data will be described. In the present embodiment, the image sharing system is a video conference system having a function of sharing a display image displayed on the information processing apparatus 10 connected to each transmission terminal 40 as an example of a communication system. explain.

  The image of the image data includes an image of a conference participant taken by the transmission terminal 40 and an image of a conference material opened by a viewer or an editor of the external input device 50. These images may be moving images or still images, and may be both moving images and still images. Note that “video conference” is used synonymously with “video conference”.

  The image sharing system shown in FIG. 1 can share image data displayed on one information processing apparatus 10a with another information processing apparatus 10b. In the image sharing system shown in FIG. 1, drawing information (handwritten content) input to one information processing apparatus 10 is displayed on the other information processing apparatus 10. For example, the drawing information (handwritten content) input to the information processing apparatus 10a is transmitted via communication between the transmission terminals 40 and displayed on the information processing apparatus 10b. Similarly, the drawing information (handwritten content) input to the information processing apparatus 10b is transmitted via communication between the transmission terminals 40 and displayed on the information processing apparatus 10a.

  The information processing apparatus 10 is a handwriting input device that has a display 115 (see FIG. 4) having a touch panel function and can input drawing information (handwriting input) on the display 115. In the present embodiment, a case where the information processing apparatus 10 is a white board (electronic blackboard; IWB) having an electronic blackboard function capable of mutual communication with other information processing apparatuses 10 will be described. The information processing apparatus 10 may be not only the above-described electronic blackboard but also a tablet terminal, a smartphone, a notebook computer (Personal Computer), or the like having a handwriting input function.

  The information processing device 10a is connected to the transmission terminal 40a and the external input device 50a via a cable or the like. Similarly, the information processing device 10b is connected to the transmission terminal 40b and the external input device 50b via cables. Here, the information processing apparatus 10a, and the transmission terminal 40a and the external input apparatus 50a connected to the information processing apparatus 10a are referred to as a terminal system 3a. The information processing device 10b, and the transmission terminal 40b and the external input device 50b connected to the information processing device 10b are referred to as a terminal system 3b. In addition, although the example which has the two terminal systems 3 (the terminal system 3a and the terminal system 3b) in the image sharing system shown in FIG. 1 is demonstrated, the number of the terminal systems 3 is not restricted to this. The image sharing system may include three or more terminal systems 3 and perform communication using three or more bases.

  The information processing apparatus 10 receives the image data displayed on the display 115 and the drawing information which is the handwritten content input (handwritten input) on the display 115 via the transmission terminal 40 connected to each other. Transmit to device 10. Further, the information processing apparatus 10 causes the display 115 to display the output image input from the external input device 50.

  A cable that connects each device constituting the terminal system 3 can be DisplayPort, DVI (Digital Visual Interface), HDMI (registered trademark) (High-Definition Multimedia Interface), or VGA (Video Graphics Array). Cable. The transmission terminal 40 and the external input device 50 may be connected to the information processing apparatus 10 by wireless communication such as Wi-Fi (Wireless Fidelity (registered trademark)). In addition, the transmission terminal 40 and the external input device 50 may be connected to the information processing apparatus 10 by wireless communication complying with a standard such as Bluetooth (registered trademark).

  The information processing apparatus 10 receives input of drawing information (handwriting input) to the display 115 using an electronic pen 2400 (see FIG. 4) or the like. When the pen tip of the electronic pen 2400 is pressed against the display 115, it is pushed into the electronic pen 2400 by a repulsive force from the display 115. The electronic pen 2400 notifies the corresponding information processing apparatus 10 when the pen tip is pushed into the electronic pen 2400. Communication between the electronic pen 2400 and the corresponding information processing apparatus 10 is performed by infrared rays.

  The drawing information drawn on the display 115 of the information processing apparatus 10a at one base is also displayed on the display 115 of the information processing apparatus 10b at another base. On the other hand, the drawing information drawn on the display 115 of the information processing apparatus 10b at another base is displayed on the display 115 of the information processing apparatus 10a at one base. In addition, the information processing apparatus 10 can change the image displayed on the display 115 based on, for example, a gesture such as enlargement, reduction, and page turning that the user uses. As described above, the image sharing system shown in FIG. 1 can perform remote sharing processing for sharing the same image at a remote location, and is therefore very convenient when used for a conference at a remote location. Note that the drawing information input (handwriting input) to the display 115 may be performed using not only the electronic pen 2400 but also the user's hand, for example.

  The transmission terminal 40 transmits / receives image data, audio data, and the like to / from other transmission terminals 40. Each transmission terminal 40 is connected to the information processing apparatus 10 and transmits the image data displayed on the information processing apparatus 10 to another transmission terminal 40. And the information processing apparatus 10 connected to the other transmission terminal 40 can share the image data displayed among the several information processing apparatuses 10 by displaying the transmitted image data. The transmission terminal 40 will be described as an example, but the function of the transmission terminal 40 may be executed by an application installed in the information processing apparatus 10.

  The plurality of transmission terminals 40 and the communication management device 90 are communicably connected via the communication network 2. Each of the plurality of transmission terminals 40 is installed at an arbitrary base such as a conference room at the Tokyo office in Japan or a conference room at the New York office in the United States. The plurality of transmission terminals 40 perform communication between bases by transmitting and receiving image data and sound data. The transmission terminal 40 is used not only in a plurality of remote offices but also in an arbitrary base such as in the same office, outdoors and indoors, or outdoors and outdoors. When the transmission terminal 40 is used outdoors, wireless communication such as a cellular phone communication network is performed. The transmission terminal 40 is not limited to use in a video conference, but may be used for general conversation between users.

  The communication network 2 is constructed by, for example, a LAN (Local Area Network), a dedicated line, the Internet, and the like. The communication network 2 may include a place where wireless communication such as Wi-Fi (Wireless Fidelity (registered trademark)) or Bluetooth (registered trademark) is performed in addition to wired communication.

  The external input device 50 is connected to the information processing device 10 and outputs image data such as conference material to the information processing device 10. The image data output here is data used by using, for example, document creation software, spreadsheet software, presentation software, or the like. The external input device 50 is, for example, a PC, but may be a tablet, a smartphone, a PDA (Personal Data Assistant), a USB (Universal Serial Bus) memory, or the like.

  The administrator terminal 60 is a communication terminal such as a PC that is connected to the communication network 2 and used by the administrator of the image sharing system. The administrator terminal 60 performs processing such as registration of various information managed by the communication management apparatus 90. In addition, although the example in which the administrator terminal 60 is provided as one terminal has been described in FIG. 1, any one of the information processing apparatus 10, the transmission terminal 40, or the external input apparatus 50 has a function as the administrator terminal 60. You may be responsible.

  The relay device 70 is a device that relays content data between the transmission terminals 40. The communication management device 90 is a server device that performs login authentication of the transmission terminal 40, management of communication by the transmission terminal 40, management of display of drawing information input to the information processing apparatus 10, and the like. Note that the image sharing system may be configured such that the communication management device 90 functions as the relay device 70 and the relay device 70 is not provided. Here, the relay device 70 and the communication management device 90 are referred to as a management system 5 that relays and manages communication of content data between the respective terminal systems 3.

  The management system 5 may include other devices connected to the communication network 2, for example. For example, the management system 5 may include a program providing system that transmits a terminal program to the transmission terminal 40 and transmits a communication management program to the communication management device 90. For example, the management system 5 may include a maintenance system that performs maintenance such as maintenance, management, and maintenance of at least one of the terminal system 3, the relay device 70, and the communication management device 90. Furthermore, the management system 5 may be installed at the same site as the terminal system 3 or may be installed at a different site.

  FIG. 2 is a diagram illustrating an example of a state of transmission / reception of various types of information in the image sharing system according to the first embodiment. FIG. 2 illustrates an example in which content data is transmitted via the relay device 70 between the transmission terminals 40 to which the information processing devices 10 are respectively connected. The communication between the transmission terminals 40 is not limited to this, and may be performed by an arbitrary method such as P2P (Peer to Peer).

  As shown in FIG. 2, in communication between the transmission terminal 40 and the communication management device 90, a management information session sei for establishing transmission / reception of various types of management information such as call control messages is established. In communication between the transmission terminal 40a and the transmission terminal 40b, a session sed1 for transmitting image data and a session sed2 for transmitting sound data are established via the relay device 70. Hereinafter, one or more arbitrary sessions among the sessions sed1 and sed2 for transmitting content data between the transmission terminals 40 are represented as a session sed.

  The image data includes image data of participants in a video conference captured by the transmission terminal 40 and image data such as conference materials displayed in a window opened by the information processing apparatus 10. Therefore, the image data transmission session sed1 may include a session for transmitting and receiving captured image data and a session for transmitting and receiving image data such as conference materials.

  Further, the image data may have basic data essential for reproducing the image and extended data for improving the quality of the image to be reproduced by combining with the basic data. In this case, the image data transmission session sed1 includes a session for transmitting / receiving basic data and a session for transmitting / receiving extension data. As described above, in the image sharing system, the communication management device 90 may have the function of the relay device 70, and the session sed between the transmission terminals 40 may be established via the communication management device 90.

Outline FIG. 3 is a schematic view for explaining the outline of the image sharing system according to the first embodiment. Note that FIG. 3 is a simplified description of the outline of the image sharing system according to the first embodiment, and details of functions and the like realized by the image sharing system will be described with reference to drawings and the like to be described later.

  FIG. 3 shows an example in which the image sharing system performs remote communication between a service provider and a customer who receives the service. The image sharing system can share image data such as contract documents displayed on the information processing apparatus 10b used by the service provider and the information processing apparatus 10a used by the customer.

  When the user's position (role) of the image sharing system is different, such as a service provider and a customer, it may be desired to restrict input of drawing information (handwriting input) to the information processing apparatus 10 for each user. For example, consider a case where a service provider and a customer are trying to make a contract using a remote conference. In such a usage scene, image data of the contract is transmitted from the service provider to the customer, and handwritten input is remotely performed on the contract that is the image data received by the customer.

  In this case, the customer may be able to input drawing information (handwritten input) reflected in the contract, but the service provider must not be able to do the same. On the other hand, the service provider points to the customer where to fill in the contract, so there may be a need to input drawing information (handwriting input) that will not be reflected in the contract but will disappear after a certain period of time. .

  Therefore, the image sharing system according to the first embodiment sets the authority for displaying the drawing information that is the handwritten content input to each information processing apparatus 10 for each input side that has input the drawing information. Then, the image sharing system controls display of the drawing information displayed on each information processing apparatus 10 based on the set authority.

  In the image sharing system shown in FIG. 3, the drawing authority management table 505 in which the management system 5 associates the display authority for drawing information with the input side information for identifying the input side that has input the drawing information is stored and managed. ing. The input side to which the drawing information is input is, for example, the user who has input the drawing information or the information processing apparatus 10 to which the drawing information has been input. The management system 5 notifies each user (each information processing apparatus 10) of display authority information (drawing authority information 5050) associated with the input side information.

  Based on the acquired drawing authority information 5050, the information processing apparatus 10 controls display of drawing information that is input handwritten content. Here, it is assumed that the display authority for drawing information, which is handwritten content input on the service provider side, is a temporary drawing authority for automatically deleting the input drawing information based on a predetermined condition. The predetermined condition is, for example, a condition indicating that a predetermined time has elapsed since handwritten content was input. On the other hand, the display authority for drawing information that is handwritten content input on the customer side is a normal drawing authority that can be deleted only by the user on the input side who has input the handwritten content.

  The information processing apparatus 10b used by the service provider transmits, for example, image data of shared material (for example, a contract) shared with the customer to the information processing apparatus 10a used by the customer. The information processing apparatus 10a and the information processing apparatus 10b share and display the image data transmitted by the information processing apparatus 10a.

  As shown in FIG. 3, first, the service provider inputs drawing information (handwritten input) for pointing the customer to the signature location on the contract with the information processing apparatus 10b. The information processing apparatus 10b transmits the input drawing information to the information processing apparatus 10a. Then, the information processing apparatus 10b displays the drawing information input on the service provider side.

  Next, the customer inputs drawing information (handwritten input) (signature) into the signature location indicated by the service provider to the information processing apparatus 10b. The information processing apparatus 10b transmits image data including the input drawing information (signature) to the information processing apparatus 10a.

  Here, the drawing information (handwritten content) input on the service provider side is deleted when a predetermined time has elapsed. In the information processing apparatus 10a and the information processing apparatus 10b, only drawing information (signature) that is handwritten content input on the customer side is displayed. This allows the service provider to receive a signed contract signed by the customer.

  As described above, the image sharing system according to the first embodiment is a system in which the display of the drawing information input to the information processing apparatus 10 is shared among the plurality of information processing apparatuses 10. The drawing authority information 5050 indicating the display authority of the input drawing information is managed in association with the information indicating the input side. Then, the information processing apparatus 10 controls display of the corresponding drawing information based on the drawing authority information 5050 associated with the input side that has input the drawing information. Therefore, the image sharing system according to the first embodiment responds to the display authority of the drawing information on the input side of the drawing information with respect to the display image including the drawing information displayed in common in the plurality of information processing apparatuses 10. Thus, display of drawing information can be controlled.

Hardware Configuration Next, a hardware configuration of an apparatus or a terminal constituting the image sharing system will be described with reference to FIGS. 4 to 6. The hardware configurations shown in FIGS. 4 to 6 may include the same configuration in each embodiment, and components may be added or deleted as necessary.

FIG. 4 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the first embodiment. FIG. 4 illustrates an example in which the information processing apparatus 10 is an electronic blackboard as described above. As shown in FIG. 4, the information processing apparatus 10 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an SSD (Solid State Drive) 104, a network I / F ( Interface) 105 and an external device connection I / F 106.

  The CPU 101 controls the overall operation of the information processing apparatus 10. The ROM 102 stores programs used for driving the CPU 101 such as the CPU 101 and IPL (Initial Program Loader). The RAM 103 is used as a work area for the CPU 101. The SSD 104 stores various data such as a program for the information processing apparatus 10. The information processing apparatus 10 realizes the image sharing method according to the present invention by executing a program according to the present invention stored in the ROM 102 or the SSD 104, for example. The network I / F 105 controls communication with the communication network 2.

  The external device connection I / F 106 controls communication with the transmission terminal 40, the external input device 50, or external devices (microphone 2100, speaker 2200, and camera 2300). When the functions of the information processing apparatus 10 and the transmission terminal 40 are integrated, the information processing apparatus 10 implements a remote conference using the microphone 2100, the speaker 2200, the camera 2300, and the like. When the transmission terminal 40 is connected to the information processing apparatus 10, the information processing apparatus 10 may not include various external devices (the microphone 2100, the speaker 2200, and the camera 2300).

  The information processing apparatus 10 includes a capture device 109, a GPU (Graphics Processing Unit) 110, a display controller 111, a contact sensor 113, a sensor controller 112, an electronic pen controller 114, an antenna of the short-range communication circuit 107, and a short-range communication circuit 107. 107a.

  The capture device 109 displays the image information on the display 115 as a still image. The capture device 109 displays the video information on the display 115 as a still image or a moving image. The GPU 110 is a semiconductor chip that specializes in graphics. The display controller 111 controls and manages screen display in order to output an output image from the GPU 110 to the display 115 or the like. The contact sensor 113 detects that the electronic pen 2400, the user's hand H, or the like has touched the display 115. The sensor controller 112 controls processing of the contact sensor 113.

  The contact sensor 113 performs coordinate input and coordinate detection by an infrared ray blocking method. In this coordinate input and coordinate detection method, two light emitting / receiving devices installed at both upper ends of the display 115 emit a plurality of infrared rays in parallel with the display 115 and are provided around the display 115. In this method, the light reflected by the reflecting member and returned on the same optical path as the light emitted from the light receiving element is received. The contact sensor 113 outputs the infrared ID emitted by the two light receiving and emitting devices blocked by the object to the sensor controller 112. Then, the sensor controller 112 specifies the coordinate position that is the contact position of the object.

  The electronic pen controller 114 communicates with the electronic pen 2400 to determine whether the pen 115 touches the display 115 or the pen butt touch. The short-range communication circuit 107 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark).

  Further, the information processing apparatus 10 includes a bus line 108. As shown in FIG. 4, the bus line 108 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 101.

  Note that the contact sensor 113 is not limited to the infrared blocking method, and a capacitance type touch panel that identifies a contact position by detecting a change in capacitance, and a contact position is identified by a voltage change between two opposing resistance films. Various detection means such as a resistive film type touch panel or an electromagnetic induction type touch panel that detects electromagnetic induction caused by contact of a contact object with the display unit and identifies a contact position may be used. Further, the electronic pen controller 114 may determine whether there is a touch on a part of the electronic pen 2400 held by the user or other electronic pen part as well as the pen tip or the bottom of the electronic pen 2400.

O Hardware Configuration of Transmission Terminal FIG. 5 is a diagram illustrating an example of a hardware configuration of the transmission terminal according to the first embodiment. FIG. 5 illustrates an example in which the transmission terminal 40 is a video conference terminal (video conference terminal) as described above. As shown in FIG. 5, the transmission terminal 40 includes a CPU 401, ROM 402, RAM 403, flash memory 404, SSD 405, media I / F 407, operation buttons 408, power switch 409, bus line 410, network I / F 411, camera 412 and imaging. An element I / F 413, a microphone 414, a speaker 415, a sound input / output I / F 416, a display I / F 417, an external device connection I / F 418, a short-range communication circuit 419, and an antenna 419a of the short-range communication circuit 419 are provided.

  The CPU 401 controls the operation of the entire transmission terminal 40. The ROM 402 stores a program used for driving the CPU 401 such as IPL. The RAM 403 is used as a work area for the CPU 401. The flash memory 404 stores various data such as a communication program, image data, and sound data. The SSD 405 controls reading or writing of various data with respect to the flash memory 404 according to the control of the CPU 401. The SSD 405 may use an HDD (Hard Disk Drive).

  The media I / F 407 is an interface for reading or writing (storing) data to a recording medium 406 such as a flash memory. The operation button 408 is a button that is operated when the destination of the transmission terminal 40 is selected. The power switch 409 is a switch for switching ON / OFF the power of the transmission terminal 40.

  The network I / F 411 is an interface for performing data communication using the communication network 2. The camera 412 is a kind of built-in imaging unit that captures an image of a subject under the control of the CPU 401 and obtains image data. The image sensor I / F 413 is a circuit that controls driving of the camera 412. The microphone 414 is a kind of built-in sound collecting means for inputting sound. The sound input / output I / F 416 is a circuit that processes input / output of a sound signal between the microphone 414 and the speaker 415 under the control of the CPU 401.

  A display I / F 417 is a circuit that transmits image data to an external display 420 under the control of the CPU 401. The external device connection I / F 418 is an interface for connecting various external devices. The short-range communication circuit 419 is a communication circuit such as NFC or Bluetooth.

  The bus line 410 is an address bus, a data bus, or the like for electrically connecting components such as the CPU 401 shown in FIG.

  The display 420 is a kind of display means constituted by a liquid crystal or an organic EL that displays an image of a subject, an operation icon, and the like. The display 420 is connected to the display I / F 417 via a cable 420c. The cable 420c may be an analog RGB (VGA) signal cable, a component video cable, or an HDMI or DVI signal cable. When the information processing apparatus 10 is connected to the external device connection I / F 418, the display 115 of the information processing apparatus 10 functions as a display unit. Therefore, the transmission terminal 40 does not include the display 420. Also good.

  Note that the camera 412 includes a lens and a solid-state imaging device that converts light into electric charges and digitizes a subject image (video). The camera 412 uses a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) as a solid-state image sensor. The external device connection I / F 418 can be connected to an external device such as an external camera, an external microphone, and an external speaker by a USB cable or the like. When an external camera is connected, the external camera is driven with priority over the built-in camera 412 according to the control of the CPU 401. Similarly, when an external microphone is connected or when an external speaker is connected, each of them is driven with priority over the built-in microphone 414 or the built-in speaker 415 according to the control of the CPU 401.

  The recording medium 406 is detachable from the transmission terminal 40. Further, as long as it is a non-volatile memory that reads or writes data according to the control of the CPU 401, not only the flash memory 404 but also an EEPROM (Electrically Erasable Programmable Read-Only Memory) or the like may be used.

FIG. 6 is a diagram illustrating an example of a hardware configuration of the communication management apparatus according to the first embodiment. The communication management device 90, the external input device 50, the administrator terminal 60, and the relay device 70 basically have the same hardware configuration. Therefore, in the following description, the hardware configuration of the external input device 50, the administrator terminal 60, and the relay device 70 will be described using each configuration shown in FIG.

  The communication management apparatus 90 is constructed by a computer, and as shown in FIG. 6, a CPU 901, ROM 902, RAM 903, HD 904, HDD 905, recording medium 906, media I / F 907, display 908, network I / F 909, keyboard 911, A mouse 912, a CD-ROM (Compact Disc-Read Only Memory) drive 914, and a bus line 910 are provided.

  The CPU 901 controls the overall operation of the communication management device 90. The ROM 902 stores a program used for driving the CPU 901 such as IPL. The RAM 903 is used as a work area for the CPU 901. The HD 904 stores various data such as programs. The HDD 905 controls reading or writing of various data with respect to the HD 904 according to the control of the CPU 901. A media I / F 907 controls reading or writing (storage) of data with respect to a recording medium 906 such as a flash memory.

  The display 908 displays various types of information such as a cursor, menu, window, character, or image. The network I / F 909 is an interface for performing data communication using the communication network 2. The keyboard 911 is a kind of input means having a plurality of keys for inputting characters, numerical values, various instructions, and the like. The mouse 912 is a kind of input means for selecting or executing various instructions, selecting a processing target, moving a cursor, or the like. The CD-ROM drive 914 controls reading or writing of various data with respect to a CD-ROM 913 as an example of a removable recording medium.

  Further, the communication management device 90 includes a bus line 910. The bus line 910 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 901 shown in FIG.

Functional Configuration Next, the functional configuration of the image sharing system according to the first embodiment will be described. FIG. 7 is a diagram illustrating an example of a functional configuration of the image sharing system according to the first embodiment. FIG. 7 shows a state in which the information processing apparatus 10 to which the external input apparatus 50 is connected can communicate with the communication management apparatus 90 via the transmission terminal 40.

  The functions realized by the information processing apparatus 10 shown in FIG. 7 include a reception unit 11, a transmission unit 12, an input reception unit 13, a generation unit 14, a display control unit 15, a storage / reading unit 16, and a storage unit 1000.

  The receiving unit 11 has a function of receiving various data transmitted from an external device or terminal. For example, the reception unit 11 receives image data transmitted from another terminal system 3 via the transmission terminal 40. Further, the receiving unit 11 receives the drawing authority information 5050 transmitted from the communication management device 90 via the transmission terminal 40. Further, the receiving unit 11 receives image data transmitted from the external input device 50.

  The transmission unit 12 has a function of transmitting image data such as a display image processed in the information processing apparatus 10 to an external apparatus or terminal. For example, the transmission unit 12 transmits image data including drawing information input (handwritten input) to the connected transmission terminal 40. The reception unit 11 and the transmission unit 12 are realized by, for example, the external device connection I / F 106 illustrated in FIG.

  The input receiving unit 13 has a function of receiving drawing information input (handwriting input) on the display 115 shown in FIG. The input receiving unit 13 is realized by, for example, a program executed by the sensor controller 112, the contact sensor 113, the electronic pen controller 114, and the CPU 101 shown in FIG. The input receiving unit 13 is an example of a receiving unit.

  The generation unit 14 has a function of generating a display image to be displayed on the display 115 illustrated in FIG. The generation unit 14 generates, for example, an input screen (UI image (A) shown in FIG. 19 described later) that accepts input of drawing information corresponding to drawing authority information 5050 described later. The generation unit 14 is realized by, for example, a program executed by the CPU 101 illustrated in FIG. The generation unit 14 is an example of a generation unit.

  The display control unit 15 has a function of causing the display 115 shown in FIG. 4 to display an operation screen for accepting an input operation by the user, an input screen for accepting input of image data output from the external input device 50 and drawing information by the user. is there. The display control unit 15 is realized by, for example, a program executed by the display controller 111 and the CPU 101 shown in FIG. The display control unit 15 is an example of a display control unit.

  The storage / reading unit 16 has a function of storing various data in the storage unit 1000 and reading out various data from the storage unit 1000. The storage unit 1000 is realized by the storage / reading unit 16 and the storage unit 1000, for example, by a program executed by the ROM 102, the SSD 104, and the CPU 101 shown in FIG. Further, the storage unit 1000 constructs a drawing authority management DB 1001 and an image data management DB 1002.

  The drawing authority management DB 1001 stores and manages drawing authority information 5050 for displaying input (handwritten input) drawing information on the display 115. The information processing apparatus 10 acquires drawing authority information 5050 stored in the drawing authority management DB 1001 from the communication management apparatus 90 via the transmission terminal 40. Details of the drawing authority information 5050 will be described later.

  The image data management DB 1002 stores and manages image data to be displayed on the display 115 shown in FIG. The image data management DB 1002 stores and manages image data received by the receiving unit 11. Further, the image data management DB 1002 stores drawing data such as page data (see FIG. 20), stroke data (see FIG. 21), coordinate arrangement data (see FIG. 22), and media data (see FIG. 23), which will be described later. I manage.

  Next, the functional configuration of the transmission terminal 40 will be described. 7 includes a transmission / reception unit 41, an input / output unit 42, a login request unit 43, a control unit 44, a storage / reading unit 45, and a storage unit 4000.

  The transmission / reception unit 41 is a function for exchanging data with other devices via the communication network 2. The transmission / reception unit 41 is realized by, for example, the network I / F 411 illustrated in FIG. 5 and transmits / receives various data (information) to / from other terminals, devices, or systems via the communication network 2.

  The input / output unit 42 has a function of accepting various inputs from the outside and outputting various data to the outside. The input / output unit 42 is realized by, for example, the operation button 408 and the power switch 409 illustrated in FIG. 5 and receives various inputs from the user. For example, when the user turns on the power switch 409 shown in FIG. 5, the input / output unit 42 receives the power on and turns on the power. The input / output unit 42 is realized by a command from the CPU 401 shown in FIG. 5 and an external device connection I / F 418, and inputs / outputs content data to / from the information processing apparatus 10.

  The login request unit 43 is realized by a command from the CPU 401 shown in FIG. 5, and requests login from the transmission / reception unit 41 to the communication management device 90 via the communication network 2 when receiving the power ON. And the current IP address of the transmission terminal 40 are automatically transmitted.

  The control unit 44 is realized by a command from the CPU 401 illustrated in FIG. 5 and has a function of controlling operations and processes executed by the transmission terminal 40.

  The storage / reading unit 45 has a function of storing various data in the storage unit 4000 and reading out various data from the storage unit 4000. The storage unit 4000 stores, for example, authentication information (such as a communication ID and password, which will be described later) used for authentication processing for performing communication with another transmission terminal 40. The storage / reading unit 45 and the storage unit 4000 are realized by, for example, the programs executed by the ROM 402, the flash memory 404, the SSD 405, and the CPU 101 shown in FIG.

  Next, the functional configuration of the communication management device 90 will be described. 7 includes a transmission / reception unit 91, an authentication unit 92, a drawing authority management unit 93, a control unit 94, a storage / reading unit 95, and a storage unit 9000.

  The transmission / reception unit 91 is a function for exchanging data with other devices via the communication network 2. The transmission / reception unit 91 transmits / receives various data (information) to / from other terminals, devices, or systems via the communication network 2 in accordance with, for example, a command from the CPU 901 and the network I / F 909 illustrated in FIG.

  The authentication unit 92 has a function of performing authentication of the login request source by a command from the CPU 901 shown in FIG. When the log-in request information is received by the transmission / reception unit 91, the authentication unit 92 executes authentication processing of the log-in request source using an authentication management table 501 described later.

  The drawing authority management unit 93 is a function that manages the display authority of the drawing information on the input side that has input the drawing information to the information processing apparatus 10 in accordance with a command from the CPU 901 illustrated in FIG. 6. For example, the drawing authority management unit 93 registers the drawing authority information 5050 in a drawing authority management table 505 described later. For example, when a session between the transmission terminals 40 is established, the drawing authority management unit 93 reads the drawing authority information 5050 included in the drawing authority management table 505. The read drawing authority information 5050 is transmitted to the corresponding information processing apparatus 10 via the transmission terminal 40. The information processing apparatus 10 stores the received drawing authority information 5050 in the drawing authority management DB 1001.

  The control unit 94 is realized by a command from the CPU 901 illustrated in FIG. 6 and has a function of controlling operations and processes executed by the communication management device 90.

  The storage / reading unit 95 has a function of storing various data in the storage unit 9000 and reading various data stored in the storage unit 9000 in accordance with an instruction from the CPU 901 illustrated in FIG. 6. The storage / reading unit 95 and the storage unit 9000 are realized by, for example, programs executed by the ROM 902, the HD 904, the HDD 905, and the CPU 901 shown in FIG. The storage unit 9000 is an example of a storage unit. The storage unit 9000 includes an authentication management DB 9001, a status management DB 9002, a destination list management DB 9003, a session management DB 9004, and a drawing authority management DB 9005.

  Note that although FIG. 7 illustrates an example of a device or a terminal that constitutes one terminal system 3 of the image sharing system, the devices and terminals that constitute the other terminal system 3 included in the image sharing system are similar to each other. It has a function. In the image sharing system illustrated in FIG. 7, the example in which the information processing apparatus 10 and the transmission terminal 40 are separately provided has been described. For example, even if the information processing apparatus 10 includes the function of the transmission terminal 40. Good.

Authentication management table FIG. 8 is a diagram illustrating an example of the authentication management table according to the first embodiment. The storage unit 9000 constructs an authentication management DB 9001 configured by the authentication management table 501 shown in FIG. The authentication management table 501 stores an authentication password in association with the communication ID of the transmission terminal 40 managed by the communication management apparatus 90.

  The communication ID is information for specifying a communication destination in the image sharing system. The communication ID is, for example, identification information (terminal ID) of the transmission terminal 40, identification information (user ID) of the user of the transmission terminal 40, and an account name. In the authentication management table 501 illustrated in FIG. 8, the example in which the terminal ID, the user ID, and the account name are managed as the communication ID has been described. However, at least one of them may be included. Further, the terminal ID may be a terminal ID for identifying the information processing apparatus 10 connected to the transmission terminal 40. Hereinafter, the communication ID will be described assuming that the identification information (terminal ID) of the transmission terminal 40 is used as information for specifying the communication destination. A case will be described in which the communication ID corresponding to the transmission terminal 40a is the terminal ID “01aa” and the communication ID corresponding to the transmission terminal 40b is the terminal ID “01bb”.

State management table FIG. 9 is a diagram showing an example of a state management table according to the first embodiment. The storage unit 9000 constructs a state management DB 9002 configured by the state management table 502 shown in FIG. The state management table 502 stores, for each communication ID of the transmission terminal 40, the operation state of the terminal, the reception date and time when login request information described later is received by the communication management apparatus 90, and the IP address of the terminal. The communication ID is stored when the transmission terminal 40 is registered in the communication management apparatus 90 so that the transmission terminal 40 performs communication using the communication management apparatus 90.

Destination List Management Table FIG. 10 is a diagram showing an example of the destination list management table according to the first embodiment. The storage unit 9000 constructs a destination list management DB 9003 configured by the destination list management table 503 shown in FIG. The destination list management table 503 stores the communication IDs of all the destinations registered as communication partner candidates in association with the communication ID of the request source that requests the start of communication. The communication partner candidate is updated by being added or deleted by a request for addition or deletion to the communication management apparatus 90 from an arbitrary request source.

Session management table FIG. 11 is a diagram showing an example of a session management table according to the first embodiment. The storage unit 9000 constructs a session management DB 9004 configured by the session management table 504 shown in FIG. The session management table 504 includes a relay device ID of the relay device 70 used for relaying communication data (image data and audio data), a request source communication ID, a destination communication ID, and image data received at the destination. The reception delay time (ms) and delay information indicating the delay time transmitted from the destination are stored in association with the reception date and time (delay information reception date and time) received by the communication management device 90.

  When communication is performed between the two transmission terminals 40, the reception date and time of the delay information may be managed based on the delay information transmitted from the request source instead of the destination. However, when communication is performed between three or more transmission terminals 40, the reception date and time of the delay information is managed based on the delay information transmitted from the transmission terminal 40 on the image data and audio data reception side.

Drawing authority management table FIG. 12 is a diagram showing an example of a drawing authority management table according to the first embodiment. The storage unit 9000 constructs a drawing authority management DB 9005 configured by the drawing authority management table 505 shown in FIG. The drawing authority management table 505 stores a name and drawing authority information 5050 in association with each communication ID.

  The communication ID is the same as the communication ID included in the authentication information shown in FIG. The name is a name of a communication destination corresponding to the communication ID. The name is registered by the administrator terminal 60. The name may be registered by the user when registering the destination list.

  The drawing authority information 5050 is authority information indicating the display authority of the input drawing information. The display authority is an authority for causing the display 115 to display the input drawing information. As for the authority information, for example, the display authority of the input drawing information differs depending on the input side user or the information processing apparatus 10 to which the drawing information is input. In other words, the authority information indicates a drawing type to which the user corresponding to the communication ID or the information processing apparatus 10 can input drawing information. The drawing type includes, for example, normal drawing that displays input drawing information until it is deleted by the user, or annotation drawing that is automatically deleted after a certain period of time has passed.

  The drawing authority information 5050 includes information on whether normal drawing and temporary drawing are possible. Normal drawing is a drawing type in which drawing information other than a user who has input drawing information as handwritten content cannot be erased. That is, the display authority for normal drawing is a display authority that does not have the authority to delete drawing information drawn by another device.

  On the other hand, temporary drawing is a drawing type in which drawing information that is input handwritten content is automatically deleted based on a predetermined condition. The temporary drawing is, for example, annotation drawing. That is, the display authority for temporary drawing is a display authority for deleting the displayed drawing information based on a predetermined condition.

  The predetermined condition is, for example, a condition indicating that a predetermined time has elapsed since the drawing information was input. The predetermined condition may be, for example, a condition indicating that drawing information is input by a user (information processing apparatus 10) different from the input side on which the drawing information is input. Note that the drawing authority management table 505 may be configured to include the contents of conditions under which drawing information by temporary drawing is deleted. In this case, the condition for deleting the drawing information by temporary drawing may be different for each communication ID.

  In FIG. 12, for example, the communication ID “01aa” and the name “X Tourist A store” can be drawn normally (possible) and can be temporarily drawn (possible). On the other hand, the terminal having the communication ID “01bb” and the name “Concierge B” cannot perform normal rendering (impossible) and can temporarily render (possible). In addition, the terminal having the communication ID “01ba” and the name “Concierge C” cannot perform normal rendering (impossible), and can temporarily render (possible). Here, the normal drawing permission information is an example of a first authority, and the temporary drawing permission information is an example of a second authority. The communication ID or name is an example of input side information indicating the input side on which drawing information is input.

  The drawing authority information 5050 included in the drawing authority management table 505 is transmitted to the transmission terminal 40 corresponding to the associated communication ID. The information processing apparatus 10 connected to the transmission terminal 40 that has received the drawing authority information 5050 stores and manages the drawing authority information 5050 in the drawing authority management DB 1001 described above. The user can input drawing information (handwriting input) based on the drawing type corresponding to the display authority of the information processing apparatus 10.

  The drawing authority information 5050 included in the drawing authority management table 505 is not limited to this, and an authority indicating that the drawing information cannot be input may be given. Further, the drawing authority management table 505 may include a destination list management table 503 and may be provided as one table.

Image Sharing Method Next, an image sharing method in the image sharing system will be described. FIG. 13 is a flowchart illustrating an example of image sharing processing in the image sharing system according to the first embodiment. Note that FIG. 13 simply illustrates a process of sharing drawing information (handwritten content) in a plurality of information processing apparatuses 10. Details of the processing of each step will be described with reference to the drawings described later.

  First, in step S101, the transmission terminal 40a connected to the information processing apparatus 10a executes processing for starting communication with another transmission terminal. Specifically, the transmission terminal 40a starts communication with, for example, the transmission terminal 40b connected to the information processing apparatus 10b that is a sharing destination of image data such as conference materials. Establish a session with.

  In step S102, the information processing apparatus 10a connected to the transmission terminal 40a with which a session with another transmission terminal 40 has been established selects an input method that is a drawing type based on its own drawing authority information 5050. Specifically, the information processing apparatus 10 a acquires drawing authority information 5050 included in the drawing authority management table 505 stored in the storage unit 9000 of the communication management apparatus 90. Then, the information processing apparatus 10a selects an input method that is a drawing type for inputting drawing information based on the acquired drawing authority information 5050. The drawing type is, for example, normal drawing or temporary drawing shown in FIG.

  In step S103, the information processing apparatus 10a receives input of drawing information from the user based on the input method selected in the process of step S102.

  In step S104, the transmission terminal 40a connected to the information processing apparatus 10a transmits the image data of the accepted drawing information to the transmission terminal 40b that is the session partner. Then, the information processing apparatus 10b connected to the transmission terminal 40b displays a drawing screen drawn on the information processing apparatus 10a output from the transmission terminal 40b.

  Thus, the image sharing system converts the input drawing information into the information processing apparatus 10a and the information processing apparatus 10b according to an input method for which the input side user (information processing apparatus 10) to which the drawing information is input has authority. Can be shared and displayed.

Here, the details of the session establishment process between the transmission terminals 40 in step 101 shown in FIG. 13 will be described. FIG. 14 is a sequence diagram illustrating an example of processing for preparing a communication between transmission terminals and establishing a session in the image sharing system according to the first embodiment. FIG. 14 illustrates an example in which a communication start request is made from the transmission terminal 40a to the transmission terminal 40b.

  In step S201, when the user of the transmission terminal 40a turns on the power switch 409, the input / output unit 42 accepts power-on and turns on the power of the transmission terminal 40a.

  In step S202, when power-on is accepted, the login request unit 43 of the transmission terminal 40a transmits login request information indicating a login request to the communication management apparatus 90 via the communication network 2. The login request information includes a terminal ID and a password for identifying the transmission terminal 40a that is a request source terminal. The terminal ID and password are data read from the storage unit 4000 via the storage / reading unit 45 and sent to the transmission / reception unit 41. The terminal ID is an example of a communication ID for identifying the request source, and may be a user ID or an account name of a user who uses the request source terminal (transmission terminal 40a).

  When the log-in request information is transmitted from the transmission terminal 40a to the communication management apparatus 90, the communication management apparatus 90 on the receiving side can grasp the IP address of the transmission terminal 40a on the transmission side. In addition, as described above, the login request may be triggered by a user instruction input instead of turning on the power. Further, the terminal ID and password may be input to the request source terminal (transmission terminal 40a) by the user.

  In step S203, the authentication unit 92 of the communication management apparatus 90 searches the authentication management table 501 using the terminal ID and password included in the login request information received via the transmission / reception unit 91 as search keys. Then, the authentication unit 92 performs authentication processing by determining whether the same terminal ID and the same password are managed in the authentication management table 501. That is, the authentication unit 92 manages the same terminal ID and the same password in the authentication management table 501, and performs authentication processing when determining that the request is a login request from the transmission terminal 40 having a valid usage right. .

  In step S204, when it is determined that the same terminal ID and the same password are managed by the authentication unit 92, the storage / reading unit 95 stores the terminal ID of the transmission terminal 40a, the terminal type, and the like in the state management table 502. For each record indicated by the destination name, the operation status, the reception date and time when the login request information is received, and the IP address of the transmission terminal 40a are stored in association with each other.

  In step S205, the transmission / reception unit 91 of the communication management device 90 sends the authentication result information indicating the authentication result obtained by the authentication unit 92 to the request source terminal (transmission terminal 40a) that has made a login request via the communication network 2. ).

  In step S206, the storage / reading unit 95 of the communication management device 90 searches the destination list management table 503 based on the terminal ID “01aa” of the request source terminal (transmission terminal 40a) that has requested the login, thereby The terminal IDs of other requesting terminals that register the terminal ID “01aa” of the requesting terminal (transmission terminal 40a) as candidates for the communication partner are extracted. Hereinafter, a case where the terminal ID extracted in step S206 is the terminal ID “01bb” of the transmission terminal 40b will be described.

  In step S207, the transmission / reception unit 91 includes, to the transmission terminal 40b, the terminal ID “01aa” of the request source terminal (transmission terminal 40a) and the operation state information indicating the operation state of the request source terminal (transmission terminal 40a). "Terminal status information" is transmitted. Thereby, the transmission / reception part 41 of the transmission terminal 40b receives the status information of the transmission terminal 40a.

  Thereafter, the transmission terminal 40a requests a destination terminal ID registered in the destination list management table 503 of the communication management apparatus 90, and acquires destination list information (terminal ID, destination name) and an operating state of each terminal. The transmission terminal 40a displays a destination list screen for displaying a list of destination lists on the display 420. In step S208, when the user selects a destination terminal to start communication from the destination list list, the input / output unit 42 receives a request to start communication with the destination terminal (transmission terminal 40b).

  In step S209, the transmission / reception unit 41 of the request source terminal (transmission terminal 40a) includes the terminal ID “01aa” of the request source terminal (transmission terminal 40a) and the terminal ID “01bb” of the destination terminal (transmission terminal 40b), Start request information indicating that communication is to be started is transmitted to the communication management device 90. Accordingly, the transmission / reception unit 91 of the communication management device 90 receives the start request information and receives the IP address “1.2.1.3” of the request source terminal (transmission terminal 40a) that is the transmission source. Can do.

  In step S210, the storage / reading unit 95 in the state management table 502 includes the terminal ID “01aa” of the request source terminal (transmission terminal 40a) and the terminal ID “of the destination terminal (transmission terminal 40b) included in the start request information. The field portion of the operation state of the record corresponding to each of “01bb” is changed from “online (communicable)” to “online (during communication)”.

  In step S211, the storage / reading unit 95 adds the relay device ID “111a” of the relay device 70 to be used, the terminal ID “01aa” of the request source terminal (transmission terminal 40a) to the session management table 504 of the storage unit 9000. The terminal ID “01bb” of the destination terminal (transmission terminal 40b) is associated and stored. In this case, for example, a relay device having an IP address close to the IP address of the request source terminal (transmission terminal 40a) is selected as the relay device 70 to be used.

  In step S212, the drawing authority management unit 93 stores the terminal ID “01aa” and the destination terminal (transmission) of the request source terminal (transmission terminal 40a) included in the start request information stored in the drawing authority management table 505 of the storage unit 9000. The authority information corresponding to each terminal ID “01bb” of the terminal 40b) is read.

  In step S <b> 213, the transmission / reception unit 91 of the communication management device 90 transmits session initialization request information to the relay device 70. Thereby, the relay apparatus 70 receives session initialization request information. This session initialization request information is a command for initializing the communication session of the relay device 70. The session initialization request information includes the IP address “1.2.1.3” of the request source terminal (transmission terminal 40a), the IP address “1.3.2.3” of the destination terminal (transmission terminal 40b), and the request The drawing authority information 5050 of the original terminal (transmission terminal 40a) and the destination terminal (transmission terminal 40b) is included. Each IP address is an IP address corresponding to the terminal ID of the request source terminal (transmission terminal 40a) and the terminal ID of the destination terminal (transmission terminal 40b) received in step S209 in the state management table 502, respectively.

  In step S214, the relay device 70 instructs the request source terminal (transmission terminal 40a) to start a session based on the IP address “1.2.1.3” of the request source terminal (transmission terminal 40a) received in step S213. The information and the drawing authority information 5050 of the request source terminal (transmission terminal 40a) are transmitted. This session start instruction information is an instruction to start a communication session to the request source terminal (transmission terminal 40a). The transmission terminal 40a outputs the received drawing authority information 5050 to the information processing apparatus 10a. The information processing apparatus 10a stores and manages the drawing authority information 5050 output from the transmission terminal 40a in the drawing authority management DB 1001. The relay device 70 also transmits the IP address “1.2.1.2” of the relay device 70 to the destination terminal (transmission terminal 40b).

  In step S215, based on the IP address “1.3.2.3” of the destination terminal (transmission terminal 40b) received in step S213, the relay device 70 sends the session start instruction information and the destination terminal (transmission terminal 40b) to the session start instruction information. The drawing authority information 5050 of the destination terminal (transmission terminal 40b) is transmitted. This session start instruction information is an instruction to start a communication session with the destination terminal (transmission terminal 40b). The transmission terminal 40b outputs the received drawing authority information 5050 to the information processing apparatus 10b. The information processing apparatus 10b stores the drawing authority information 5050 output from the transmission terminal 40b in the drawing authority management DB 1001 for management. The relay device 70 also transmits the IP address “1.2.1.2” of the relay device 70 to the destination terminal (transmission terminal 40b).

In step S216, the request source terminal (transmission terminal 40a) establishes the first session sed1 with the relay device 70. In step S217, the destination terminal (transmission terminal 40b) establishes the second session sed2 with the relay device 70. Thereby, communication is started between the request source terminal (transmission terminal 40a) and the destination terminal (transmission terminal 40b), and the communication screen is connected to the request source terminal (transmission terminal 40a) side and the destination terminal (transmission terminal 40b). The information is displayed on the display 115 of the information processing apparatus 10.
The

  As a result, the transmission terminal 40a as the request source terminal and the transmission terminal 40b as the destination terminal can establish communication via the relay device 70. When the communication management device 90 includes the function of the relay device 70, the transmission terminal 40a and the transmission terminal 40b establish communication via the communication management device 90.

Display Image Sharing Process FIG. 15 is a sequence diagram illustrating an example of a process of sharing a display image among a plurality of information processing apparatuses in the image sharing system according to the first embodiment. FIG. 15 illustrates an example in which the display screen displayed by the information processing apparatus 10a connected to the transmission terminal 40a is displayed on the information processing apparatus 10b connected to the transmission terminal 40b.

  As illustrated in FIG. 14, when the relay device 70 is determined, in step S301, the transmission / reception unit 91 of the communication management device 90 determines the relay device ID “111a” and the IP address “1” of the destination terminal (transmission terminal 40b). ..3.2.4 "is transmitted to the transmission / reception unit 41 of the transmission terminal 40a. In step S302, the storage / reading unit 45 of the transmission terminal 40a receives the relay device ID “111a” received by the transmission / reception unit 41 and the IP address “1.3.2.4” of the destination terminal (transmission terminal 40b). The data is stored in the storage unit 4000.

  In step S303, the external input device 50a outputs the stored image data such as conference materials to the information processing device 10a. In step S304, the generation unit 14 of the information processing apparatus 10a generates a display image using the output image data. In step S305, the display control unit 15 of the information processing device 10a causes the display 115 to display the generated generated image.

  In step S306, when the image data transmitted from the external input device 50a is received by the receiving unit 11, the transmitting unit 12 of the information processing device 10a transmits the received output image to the transmission terminal 40a. In addition, the order of the process of step S304-step S305 and the process of step S306 in the information processing apparatus 10a may be changed before and after, or may be performed in parallel.

  In step S307, when the input / output unit 42 detects the input of the image data output from the information processing apparatus 10a, the storage / reading unit 45 of the transmission terminal 40a detects the relay device ID “stored in the storage unit 4000. 111a ”and the IP address“ 1.3.2.4 ”of the destination transmission terminal 40b.

  In step S308, the transmission / reception unit 41 of the transmission terminal 40a sends the image data and the IP address “1.3 of the destination terminal (transmission terminal 40b) to the relay device 70 indicated by the relay device ID“ 111a ”acquired in step S307. .2.4 ".

  In step S309, the relay device 70 transmits the received image data to the destination terminal (transmission terminal 40b). In step S310, the transmission terminal 40b outputs the received image data to the information processing apparatus 10b.

  In step S <b> 311, the generation unit 14 of the information processing device 10 b generates a display image to be displayed on the display 115 using the image data received by the reception unit 11. In step S312, the display control unit 15 of the information processing device 10b displays the generated image generated by the generation unit 14 on the display 115.

  As a result, the information processing apparatus 10a and the information processing apparatus 10b can share display images displayed by transmitting and receiving image data between the transmission terminal 40a and the transmission terminal 40b connected to the information processing apparatus 10a and the information processing apparatus 10b, respectively. it can.

Drawing Information Display Control Next, drawing information display control shared and displayed among the information processing apparatuses 10 set at a plurality of bases will be described with reference to FIGS. 16 to 25. FIG. 16 is a flowchart illustrating an example of an input screen generation process for receiving drawing information input in the information processing apparatus according to the first embodiment.

  In step S401, when the reception unit 11 receives the image data, the generation unit 14 of the information processing device 10 shifts the processing to step S402.

  In step S <b> 402, the generation unit 14 of the information processing apparatus 10 reads the drawing authority management table 505 stored in the storage unit 1000. Specifically, the generation unit 14 outputs a read request for the drawing authority information 5050 to the storage / readout unit 16. When detecting the output read request, the storage / reading unit 16 reads the drawing authority information 5050 stored in the drawing authority management DB 9005 included in the storage unit 9000. Then, the storage / reading unit 16 outputs the read drawing authority management table 505 to the generation unit 14.

  In step S403, when the generation unit 14 determines that normal drawing is possible based on the drawing authority information 5050 included in the read drawing authority management table 505, the process proceeds to step S404. In step S404, the generation unit 14 sets a normal drawing input enable icon (a state in which an operation icon 603 shown in FIG. 17 described later can be selected) for the display image. On the other hand, when the generation unit 14 determines in step S403 that normal drawing is impossible based on the drawing authority information 5050 included in the read drawing authority management table 505, the process proceeds to step S405. In step S405, the generation unit 14 sets a normal drawing input disabled icon (a state in which an operation icon 603 shown in FIG. 17 described later cannot be selected) for the display image.

  In step S406, when the generation unit 14 determines that temporary drawing is possible based on the drawing authority information 5050 included in the read drawing authority management table 505, the process proceeds to step S407. In step S407, the generation unit 14 sets a temporary drawing input enable icon (a state in which an operation icon 602 shown in FIG. 17 described later can be selected) for the display image. On the other hand, when the generation unit 14 determines in step S406 that temporary drawing is impossible based on the drawing authority information 5050 included in the read drawing authority management table 505, the process proceeds to step S408. . In step S408, the generation unit 14 sets an icon that disables temporary drawing input (a state in which an operation icon 603 shown in FIG. 17 described later cannot be selected) for the display image. In step S409, the generation unit 14 generates an input screen based on the setting content.

  The input screen may be stored in advance in the storage unit 9000 as image data corresponding to each drawing authority information 5050. In this case, the generation unit 14 selects image data corresponding to the drawing authority information 5050 included in the drawing authority management table 505 read out in step S <b> 402 and reads out from the storage unit 9000.

  The example of the display image displayed on the information processing apparatus 10 of each base is demonstrated using FIG. 17 and FIG. FIG. 17 is a diagram illustrating an example of a display screen displayed on the information processing apparatus having the normal drawing authority and the temporary drawing authority according to the first embodiment. The display screen shown in FIG. 17 is, for example, a display screen displayed on the information processing apparatus 10a installed in a customer environment that receives service provision.

  FIG. 17A shows an example of a display image generated by the process of step S409 shown in FIG. In the display image shown in FIG. 17A, an operation icon for allowing the user to select a drawing type is added to the image data 601 to be drawn. The operation icon 602 is an icon for inputting temporary drawing information, and the operation icon 603 is an icon for inputting normal drawing information. The display image shown in FIG. 17A is in a state where both the operation icon 602 and the operation icon 603 can be selected.

  FIG. 17B is a display image when drawing information is input at the partner site. The drawing information 605 included in the display image shown in FIG. 17B is drawing information input by handwriting at the partner site. In addition, the display screen shown in FIG. 17B displays the name 604 of the partner site. In the display screen shown in FIG. 17B, for example, “Concierge B” is displayed as the name 604 of the partner site.

  FIG. 17C is a display screen when drawing information is input at the local site. The display image shown in FIG. 17C is a state in which an operation icon 603 for performing normal drawing input is selected by the user. In the display screen shown in FIG. 17C, the display of the operation icon 603 is changed when the operation icon 603 is selected by the user. The drawing information 606 that is input by the user at the base is reflected in the information processing apparatus 10. The drawing information 606 is drawing information having normal drawing authority.

  Since the drawing information 605 that is handwritten by the partner site is a temporary handwriting authority, the drawing information 605 is erased when a predetermined time elapses. The drawing information 605 may be erased after gradually becoming thinner as shown in FIG.

  Next, a display screen displayed on the information processing apparatus 10b installed in the environment of the service provider that provides the service will be described. FIG. 18 is a diagram illustrating an example of a display screen displayed on an information processing apparatus that does not have normal drawing authority but has temporary drawing authority.

  FIG. 18A shows an example of a display image generated by the process of step S409 shown in FIG. The display image shown in FIG. 18A is a state where the operation icon 602 can be selected, and the operation icon 603 cannot be selected. This is because the information processing apparatus 10b has temporary drawing authority but does not have normal drawing authority. 18A is a display image generated by the generation unit 14 through the processing of step S405 illustrated in FIG. 16 and the display screen illustrated in FIG.

  FIG. 18B is a display image when drawing information is input at the local site. The display image shown in FIG. 18B is a state in which an operation icon 602 for inputting temporary drawing information is selected by the user. The drawing information which is the handwritten content input in this state has the authority for temporary drawing. The display screen in FIG. 18B includes drawing information 605 input by the user of the information processing apparatus 10b as temporary drawing. The drawing information 605 shown in FIG. 18B corresponds to the display screen shown in FIG.

  FIG. 18C is a display screen when drawing information is input at the partner site. In the display screen of FIG. 18C, the drawing information 606 on which drawing information is input by the user at the partner site is reflected in the information processing apparatus 10 a. The drawing information 606 is drawing information having normal drawing authority. Further, in the display screen shown in FIG. 18C, the drawing information 605 that is handwritten content by the own base has a temporary drawing authority, and thus is erased after a predetermined time has elapsed. The drawing information 605 may be erased gradually as shown in FIG. In addition, the display screen shown in FIG. 18C displays the name 604 of the partner site. In the display screen shown in FIG. 18C, for example, “X Tourist A Store” is displayed as the name 604 of the partner site. Each drawing information shown in FIG. 18C corresponds to the display screen shown in FIG.

  Note that, when no operation icon is selected on the display screens shown in FIGS. 17 and 18, the information processing apparatus 10 may set a drawing authority to be preferentially applied in advance. . For example, as illustrated in FIG. 18, the information processing apparatus 10 b has only temporary drawing authority. Therefore, when an operation icon is not selected, the temporary drawing drawing authority is automatically applied. On the other hand, as shown in FIG. 17, the information processing apparatus 10a has a normal drawing authority and a temporary drawing authority. Therefore, when any operation icon is not selected, a preset drawing authority is preferentially applied. Is done.

  If no operation icon is selected on the display screens shown in FIGS. 17 and 18, the information processing apparatus 10 displays a message requesting the user to select one of the drawing types. May be displayed.

  Next, FIG. 19 to FIG. 23 describe display image generation processing by the generation unit 14 of the information processing apparatus 10. FIG. 19 is a diagram for explaining an example of superposition of a plurality of images in a display image displayed on the information processing apparatus according to the first embodiment. As shown in FIG. 19, the display image displayed on the information processing apparatus 10 includes a layer for the UI image (A), a layer for the drawn image (B), and a layer for the PC output image (C). A layer and a layer for the background image (D) are provided. When viewed from the user side, the display image is the first layer of the UI image (A), the second layer of the drawing image (B), the third layer of the PC output image (C), and the fourth layer of the background image (D). It is superimposed so that it becomes eyes.

  The UI image (A) is a UI image including the operation icon (operation icon 602 or operation icon 603) illustrated in FIGS. 17 and 18, for example. The UI image (A) is image data of an input screen generated by the generation unit 14 by the processing shown in FIG. The drawing image (B) is an image including drawing information received by the input receiving unit 13 and drawing information input to another information processing apparatus 10 that is a display data sharing destination, for example. The PC output image (C) is, for example, an image including image data output from the external input device 50 and image data transmitted from another information processing apparatus 10 that is a display data sharing destination. The background image (D) is an image arranged on the backmost among the superimposed images.

  The generation unit 14 displays a PC output image (C) acquired from the reception unit 11, a drawing image (B) acquired from the input reception unit 13, and a display image on which the UI image (A) and the background image (D) are superimposed. Generate. The display control unit 15 can also switch between the PC output image (C) and the background image (D) and display the image superimposed on the UI image (A) and the drawing image (B) exclusively. For example, when the UI image (A), the drawn image (B), and the PC output image (C) are initially displayed and the cable between the information processing device 10 and the external input device 50 is disconnected, display control is performed. Based on the instruction from the generation unit 14, the unit 15 can remove the PC output image (C) from the superimposition target and display the background image (D). The display control unit 15 also performs display enlargement, display reduction, and display area movement processing.

  When the video data for video conference is transmitted from the transmission terminal 40, the generation unit 14 superimposes the video data for video conference by the picture-in-picture on the superimposed image (A, B, C), and You may output to the display 115. FIG.

  Next, drawing data stored in the information processing apparatus 10 in which drawing information has been input (handwritten input) will be described. FIG. 20 is a diagram for explaining an example of page data. The page data includes a page data ID, a disclosure time, an end time, a stroke arrangement data ID, and a media data ID. The page data ID is an ID for identifying a page. The disclosure time is the time when the display of the page is started. The end time is the time when the update of the page data ends.

  The stroke arrangement data ID is an ID for identifying the stroke arrangement data generated by the “stroke drawing” event. “Stroke drawing” indicates a drawing information input process by the user. “Stroke drawing” is, for example, an event from when the user presses the electronic pen 2400 against the display 115, moves the electronic pen 2400 in this state, and releases the electronic pen 2400 from the display 115.

  The media data ID is an ID for identifying media data. The stroke arrangement data is data for displaying a stroke image on the display 115. The media data is data for displaying the background image (D) on the display 115.

  Data relating to the stroke image constitutes part of page data as stroke arrangement data associated with the stroke arrangement data ID. Data relating to the PC output image (C) forms part of page data as media data associated with the media data ID. The media data is handled as background image (D) data.

  The generation unit 14 causes the display 115 to display the media data in the page data stored in the image data management DB 1002 as a background image (D). Further, the generation unit 14 can make the stroke image re-editable using the stroke arrangement data in the page data stored in the image data management DB 1002. Further, the generation unit 14 can delete or duplicate page data. That is, the data of the PC output image (C) displayed on the display 115 when the generation unit 14 stores the page data in the image data management DB 1002 is stored in the image data management DB 1002. Then, when data of the PC output image (C) is read from the image data management DB 1002, it is read as media data indicating the background image (D).

  FIG. 21 is a diagram for explaining an example of stroke arrangement data. One stroke arrangement data is composed of a plurality of stroke data. Each stroke data is generated for each “stroke drawing” event.

  For example, when the user draws an alphabet “S” with the electronic pen 2400, the stroke data is written in a single stroke, and therefore, the stroke data indicates one alphabet of alphabet [S] with one stroke data ID. For example, when the user draws an alphabet “T” with the electronic pen 2400, the stroke data is written in two strokes. Therefore, the stroke data indicates two letters “T” of the alphabet with two stroke data IDs. .

Each stroke data includes a stroke data ID, start time, end time, color, width, and coordinate array data ID. The stroke data ID is an ID for identifying the stroke data. The start time is the start time of writing the stroke. The end time is the time when the stroke is written. The color is the color of the stroke. The width is the width of the stroke. The coordinate array data ID is an ID for identifying coordinate array data including information related to a passing point of the stroke.

  FIG. 22 is a diagram for explaining an example of coordinate array data. The coordinate array data includes the position (X coordinate value, Y coordinate value) on the display 115 for each passing point, and the disclosure time of the stroke when passing the position, for a plurality of passing points (passing points). The information includes the time (m seconds) of the difference from the time and the writing pressure of the electronic pen 2400 at the position. For example, when the user draws the alphabet “S” with the electronic pen 2400, the stroke is drawn with a single stroke, but passes through a plurality of passing points until the drawing of “S” is completed. Therefore, the coordinate array data includes information on the plurality of passing points.

  FIG. 23 is a diagram for explaining an example of media data. Each media data includes media data ID, data type, recording time, X coordinate value, Y coordinate value, width, height and data.

  The media data ID is an ID for identifying media data. The data type is the type of media data. The recording time is the time when the page data is stored in the storage unit 1000. The X coordinate value and the Y coordinate value are the positions of images displayed on the display 115 based on the page data. Width and height are image sizes. Data indicates the contents of the media data. Among these, the position of the image displayed on the display 115 based on the page data is the image when the coordinates of the upper left corner of the display 115 are (X coordinate value, Y coordinate value) = (0, 0). The position of the upper left corner of is shown.

  FIG. 24 is a sequence diagram for sharing a drawn image in the image sharing system according to the first embodiment. FIG. 24 illustrates an example in which drawing information input to the information processing apparatus 10a is shared by the information processing apparatus 10b.

  In step S501, the display control unit 15 of the information processing device 10a causes the display 115 to display the display image generated by the generation unit 14. In step S502, the input receiving unit 13 of the information processing apparatus 10a receives an input of drawing information from the user (an example of a receiving step).

  In step S503, the transmission unit 12 of the information processing apparatus 10a transmits image data of a drawing image to the transmission terminal 40a. The image data of the drawing image is the drawing data shown in FIGS. 20 to 23. In step S504, the transmission / reception unit 41 of the transmission terminal 40a relays the image data of the drawing image output from the information processing apparatus 10a. Transmit to device 70. In step S505, when receiving the image data of the drawn image transmitted from the transmission terminal 40a, the relay device 70 transmits the received image data of the drawn image to the transmission terminal 40b.

  In step S506, when the input / output unit 42 of the transmission terminal 40b receives the image data of the drawn image transmitted from the relay device 70 by the transmission / reception unit 41, the input / output unit 42 outputs the received image data of the drawn image to the information processing device 10b. To do. In step S507, the generation unit 14 of the information processing device 10b generates a display image to be displayed on the display 115 using the output image data of the drawn image. Specifically, as illustrated in FIG. 19, the generation unit 14 superimposes the output drawing image, the UI image (A), the PC output image (C), and the background image (D). Generate a display screen. In step S508, the display control unit 15 of the information processing apparatus 10b causes the display 115 to display the display image including the drawing image generated by the generation unit 14.

  FIG. 25 is a flowchart illustrating an example of display control processing of drawing information drawn on display data displayed on the information processing apparatus according to the first embodiment. The drawing information display control process shown in FIG. 25 is an example of a display control step.

  In step S <b> 601, the display control unit 15 of the information processing apparatus 10 causes the display 115 to display a display image including a drawing image. In step S602, when the drawing type of the displayed drawing image is temporary drawing, the display control unit 15 shifts the processing to step S603. On the other hand, the display control unit 15 ends the process when the drawing type of the displayed drawing image is not temporary drawing.

  In step S603, the display control unit 15 shifts the processing to step S604 when a predetermined condition is satisfied after drawing information that is temporary drawing is input. Specifically, the display control unit 15 shifts the process to step S604 when, for example, a predetermined time has elapsed since the input of drawing information that is temporary drawing. On the other hand, the display control part 15 repeats the process of step S603, when predetermined conditions are not satisfy | filled.

  In step S604, the display control unit 15 erases the drawing information from the display screen because the predetermined condition is satisfied. Note that the drawing image may be erased step by step when the condition is satisfied.

  Thereby, the information processing apparatus 10 can display only the drawing information input as the normal drawing because the drawing information input as the temporary drawing is deleted based on the predetermined condition.

Effects of First Embodiment As described above, the image sharing system according to the first embodiment is an image sharing system that shares display images displayed on a plurality of information processing apparatuses 10. The drawing information is input to the display 115 of the apparatus 10. The image sharing system stores and manages drawing authority information 5050 in which the display authority of the input drawing information is associated with the input side information indicating the input side user (or the information processing apparatus 10) to which the drawing information is input. To do. Then, the information processing apparatus 10 controls the display of the drawing information based on the stored drawing authority information 5050. Therefore, in the image sharing system according to the first embodiment, when the drawing information input to the information processing apparatus 10 is shared between the plurality of information processing apparatuses 10, the drawing information of the input side that has input the drawing information is included. Convenience can be improved by controlling the display of the drawing information displayed on each information processing apparatus 10 according to the display authority.

● Modification 1 of the first embodiment ●
Next, Modification 1 of the first embodiment will be described. In the image sharing system according to the first modification of the first embodiment, the drawing authority information 5050a is managed as the drawing sharing information 5051 in association with each of the input side on which the drawing information is input and the drawing information sharing destination. Thus, the image sharing system according to the first modification of the first embodiment uses different display authorities when, for example, the user on the input side to which the drawing information is input is the same but the user at the sharing destination is different. The display of the drawing information can be controlled.

  FIG. 26 is a diagram illustrating an example of a drawing authority management table according to the first modification of the first embodiment. The drawing authority management table 505a shown in FIG. 26 includes a communication ID and name indicating a request source and a communication ID and name indicating a destination (communication No.) as a set (communication No.) of communication requests between a plurality of bases. The drawing sharing information 5051) is stored and managed in association with drawing authority information 5050a indicating the display authority of the input drawing information. The drawing type (normal drawing and temporary drawing) included in the drawing authority information 5050a is the same as that of the drawing authority management table 505 shown in FIG.

  The drawing sharing information 5051 includes information on the communication ID of the communication side corresponding to the communication ID of the input side to which the drawing information is input and the input drawing information sharing destination. The communication ID is information for specifying an input side to which drawing information is input and a sharing destination of the input drawing information in the image sharing system. Each communication ID is, for example, identification information (terminal ID) of the transmission terminal 40, identification information (user ID) of the user of the transmission terminal 40, and an account name. The terminal ID may be a terminal ID for identifying the information processing apparatus 10 connected to the transmission terminal 40.

  For example, the input side where the drawing information is input is the communication ID “01bb” and the name “concierge B”, and the sharing destination of the drawing information is the communication ID “01ab” and the name “concierge C” (communication No. 4). The user corresponding to the communication ID “01bb” on the input side cannot perform normal rendering (impossible) and can temporarily render (possible). In addition, the user corresponding to the communication ID “01ab” that is the sharing destination can perform normal drawing (permitted) and can also perform temporary rendering (permitted).

  On the other hand, when the drawing information is input is the communication ID “01ab” and the name “Concierge C”, and the drawing information sharing destination is the communication ID “01bb” and the name “Concierge B” (communication No. 6). ), The user corresponding to the communication ID “01ab” on the input side cannot perform normal rendering (impossible) and can temporarily render (possible). Further, the user corresponding to the communication ID “01bb” that is the sharing destination can perform normal drawing (possible), and can also temporarily draw (possible).

  As described above, the image sharing system according to the first modification of the first embodiment draws using different display authorities when the communication partner is different even for the same user (user having the same communication ID). Control the display of information. Therefore, the image sharing system according to the first modification of the first embodiment can flexibly control the display of the drawing information according to the input drawing information sharing destination.

● Modification 2 of the first embodiment ●
Next, Modification 2 of the first embodiment will be described. In the image sharing system according to the second modification of the first embodiment, a display image such as conference material shared and displayed in a plurality of information processing apparatuses 10 is divided into a plurality of areas, and is different for each divided area. Has a drawing type. Therefore, the image sharing system according to the second modification of the first embodiment can restrict the display of drawing information by designating an area in the shared display image where the input of drawing information is to be restricted.

  FIG. 27 is a diagram illustrating an example of a drawing authority management table according to the second modification of the first embodiment. The drawing authority management table 505b shown in FIG. 27 includes information on the drawing area 5052 in addition to the items included in the drawing authority management table 505 shown in FIG.

  In the drawing authority management table 505b, drawing authority information 5050 for each drawing area 5052 is associated with each communication ID. The drawing area 5052 is defined by the X coordinate value and the Y coordinate value. The X coordinate value and the Y coordinate value indicate position information on the display 115, and are detected and calculated by the sensor controller 112 shown in FIG.

  For example, the user corresponding to the communication ID “01aa” and the name “X Tourist A store” can perform normal drawing in the drawing area “X coordinate value; 0-200, Y coordinate value; 76-150”. Yes, temporary drawing is also possible. The user corresponding to the communication ID “01aa” and the name “X Tourist A store” cannot (not) normally draw in the drawing area “X coordinate value; 0-200, Y coordinate value; 0-75”. Temporary drawing is possible (possible).

  FIG. 28 is a diagram illustrating an example of a display screen displayed on the information processing apparatus according to the second modification of the first embodiment. The display image shown in FIG. 28 is the information processing apparatus 10a when the display image is shared between the information processing apparatus 10a corresponding to the communication ID “01aa” and the information processing apparatus 10b corresponding to the communication ID “01bb”. It is a display image displayed on the screen.

  FIG. 28A shows an example of a display image generated by the process of step S409 shown in FIG. The display image shown in FIG. 18A has an operation icon 602 and an operation icon 603 for each of the area 801 and the area 802. The area 801 corresponds to, for example, the drawing area “X coordinate value; 0-200, Y coordinate value; 76-150” associated with the communication ID “01aa” in the drawing authority management table 505b illustrated in FIG. It is an area. In the area 801, as shown in the drawing authority management table 505b, normal drawing is possible (possible) and temporary drawing is also possible (possible).

  On the other hand, the area 802 includes, for example, a drawing area “X coordinate value: 0-200, Y coordinate value: 0-75” associated with the communication ID “01aa” in the drawing authority management table 505b illustrated in FIG. Is an area corresponding to. In the area 802, as shown in the drawing authority management table 505b, normal drawing is not possible (impossible), and temporary drawing is possible (possible).

  FIG. 28B is a display image when drawing information is input at the local site. The display image shown in FIG. 28B is a state in which an operation icon 602 for performing temporary drawing input is selected by the user in the area 802. The drawing information which is the handwritten content input in this state has the authority for temporary drawing. The display screen in FIG. 28B includes drawing information 605 input by the user of the information processing apparatus 10b as temporary drawing, as in FIG. 18B.

  FIG. 28C shows a display screen when drawing information is input at the partner site. In the display screen of FIG. 28C, the drawing information 606 that the user at the other party has input the drawing information in the area 802 is reflected. The drawing information 606 is drawing information having normal drawing authority. In addition, in the display screen shown in FIG. 28C, the drawing information 605 that is handwritten content by the own base has temporary drawing authority, and therefore, as in FIG. Erased. The drawing information 605 may be erased gradually as shown in FIG.

  As described above, the image sharing system according to the second modification of the first embodiment can restrict the display of the drawing information by designating the area where the input of the drawing information is to be restricted in the shared image data. . As shown in FIG. 28, in the image sharing system according to the second modification of the first embodiment, for example, the customer signs in image data such as a contract shared between the service provider and the customer. The need to restrict the input of drawing information of the service provider only to the area can be realized.

● Second embodiment ●
Next, an image sharing system according to the second embodiment will be described. The same configurations and functions as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted. Unlike the image sharing system according to the first embodiment, the image sharing system according to the second embodiment allows the plurality of information processing apparatuses 20 to communicate with each other without using a communication session using the transmission terminal 40. Communication via is realized.

System Configuration FIG. 29 is a diagram illustrating an example of a system configuration of an image sharing system according to the second embodiment. The image sharing system shown in FIG. 29 includes an information processing device 20a, an external input device 50a connected to the information processing device 20a, an information processing device 20b, an external input device 50b connected to the information processing device 20b, and an administrator terminal 60. Composed.

  The information processing apparatus 20a and the information processing apparatus 20b transmit and receive image data via the communication network 2. In this case, for example, when one information processing device 20 (for example, the information processing device 20a) is a host device (requesting terminal), the information processing device 20a functions as a server, and the other information processing device 20b ( Communication with the destination terminal.

  Similar to the information processing apparatus 10 in the first embodiment, the information processing apparatus 20 is a white board (electronic blackboard; IWB) having an electronic blackboard function capable of mutual communication with other information processing apparatuses 20. The information processing apparatus 20 may be not only the above-described electronic blackboard but also a tablet terminal, a smartphone, a notebook PC, or the like having a handwriting input function.

  The administrator terminal 60 is a communication terminal such as a PC that is connected to the communication network 2 and uses the administrator of the image sharing system. The administrator terminal 60 registers in the information processing apparatus 20 the drawing authority information illustrated in FIG. 12 and sets connection information for performing communication with other information processing apparatuses 20. In addition, although the example in which the administrator terminal 60 is provided as one terminal has been described in FIG. 29, any one of the information processing apparatuses 20 may serve as the administrator terminal 60.

  In the image sharing system shown in FIG. 29, the case where the plurality of information processing apparatuses are two information processing apparatuses (20a, 20b) has been described. However, the present invention is not limited to this. In the image sharing system, the information processing apparatus 20 may be provided at three or more different locations.

Functional Configuration FIG. 30 is a diagram illustrating an example of a functional configuration of the image sharing system according to the second embodiment. The functions of the information processing apparatus 20 illustrated in FIG. 30 are roughly divided into a server unit 300 and a client unit 200.

  When the information processing apparatus 20 becomes a sponsor apparatus (request source terminal), both the client unit 200 and the server unit 300 operate in the information processing apparatus 20. On the other hand, when the information processing device 20 is a participating device (destination terminal), the information processing device 20 operates the client unit 200 but does not operate the server unit 300. For example, when the information processing apparatus 20a is a sponsor apparatus (requesting terminal) and the information processing apparatus 20b is a participating apparatus (destination terminal), the client unit 200 of the information processing apparatus 20a uses the server unit 300 of the information processing apparatus 20a. Via the client unit 200 of the information processing apparatus 20b. On the other hand, the client unit 200 of the information processing device 20b communicates with the client unit 200 of the information processing device 20a via the server unit 300 of the information processing device 20a.

  First, the function of the client unit 200 will be described. As illustrated in FIG. 30, the client unit 200 includes a reception unit 11, a transmission unit 12, an input reception unit 13, a generation unit 14, a display control unit 15, a transmission / reception unit 25, and a data management unit 26. The reception unit 11, the transmission unit 12, the input reception unit 13, the generation unit 14, and the display control unit 15 are the reception unit 11, the transmission unit 12, the input reception unit 13, the generation unit 14, and the display control unit illustrated in FIG. Description is omitted because it has the same function as.

  The transmission / reception unit 25 has a function of transmitting / receiving various types of information to / from another information processing apparatus 20 via the communication network 2. The transmission / reception unit 25 transmits / receives various information to / from the transmission / reception unit 21 of the server unit 300. The transmission / reception unit 25 is realized by, for example, a program executed by the network I / F 105 and the CPU 101 shown in FIG.

  The data management unit 26 has a function of storing and managing information for communicating with the other information processing apparatus 20, image data of a display image displayed on the display 115, drawing authority information shown in FIG. . The data management unit 26 is realized by, for example, a program executed by the ROM 102, the SSD 104, and the CPU 101 shown in FIG.

  Next, functions of the server unit 300 will be described. As shown in FIG. 30, the server unit 300 includes a transmission / reception unit 21, an authentication unit 22, a data processing unit 23, and a data management unit 24.

  The transmission / reception unit 21 has a function of performing transmission / reception of various information with the other information processing apparatus 20 via the communication network 2. The transmission / reception unit 21 transmits / receives various information to / from the transmission / reception unit 25 of the client unit 200, for example. In addition, the transmission / reception unit 21 receives, for example, a request for participation in remote sharing processing from another information processing apparatus 20. Furthermore, the transmission / reception unit 21 transmits / receives image data shared with other information processing apparatuses 20 to the transmission / reception unit 25 of the client unit 200, for example. The transmission / reception unit 21 is realized by, for example, a program executed by the network I / F 105 and the CPU 101 shown in FIG.

  The authentication unit 22 is a function that performs authentication processing of the other information processing apparatus 20 based on connection information included in the remote sharing process participation request transmitted from the other information processing apparatus 20. The authentication unit 22 is realized by, for example, a program executed by the CPU 101 illustrated in FIG.

  The data processing unit 23 has a function of processing image data transmitted from another information processing apparatus 20. The data processing unit 23 performs, for example, a synthesis process of stroke image data (see FIG. 21) that is drawing information transmitted from another information processing apparatus 20. The data processing unit 23 is realized by, for example, a program executed by the CPU 101 illustrated in FIG.

  The data management unit 24 has a function of storing and managing information for communicating with the other information processing apparatus 20 and image data transmitted from the other information processing apparatus 20. The data management unit 24 is realized by, for example, a program executed by the ROM 102, the SSD 104, and the CPU 101 shown in FIG.

Image Sharing Method Next, an image sharing method in the image sharing system according to the second embodiment will be described using FIG. 31 and FIG. In the processing shown in FIGS. 31 and 32, the information processing device 20a plays a role as a hosting device (server unit 300 and client unit 200) that hosts remote sharing processing. Further, the information processing apparatus 20b plays a role as a participating apparatus (client unit 200) that participates in the remote sharing process.

  FIG. 31 is a sequence diagram illustrating an example of a process for displaying the display data displayed by the information processing apparatus on the information processing apparatus that is the sharing destination in the image sharing system according to the second embodiment. First, when the user turns on the power switch of the information processing apparatus 20a, the information processing apparatus 20a activates the client unit 200. When the user performs an operation to activate the server unit 300 using an input device such as a touch panel, the client unit 200 outputs an instruction to start processing of the server unit 300 to the server unit 300 of the same information processing apparatus 20a. Thereby, the information processing apparatus 20a can start various processes not only by the client unit 200 but also by the server unit 300 (step S701).

  Next, the data management unit 26 in the client unit 200 of the information processing apparatus 20a generates connection information for establishing a connection with the information processing apparatus 20b. The display control unit 15 displays the connection information obtained from the generation unit 14 on the display 115 (step S702). This connection information includes the IP address of the host device (information processing device 20a) and the passcode generated for the current remote sharing process. In this case, the passcode stored in the data management unit 26 is read by the transmission / reception unit 25 and transmitted to the transmission / reception unit 21. Further, the pass code is transmitted from the transmission / reception unit 21 to the data management unit 24. The connection information is transmitted to the user of the information processing device 20b by telephone or e-mail by the user of the information processing device 20a.

  Next, when the client unit 200 of the information processing device 20b receives an input of connection information by an input operation by the user, the information processing device via the communication network 2 based on the IP address included in the input connection information. A passcode is transmitted to the server unit 300 of 20a to make a participation request (step S703). Thereby, the information processing apparatus 20a receives a participation request (including a passcode) from the information processing apparatus 20b.

  In step S704, the authentication unit 22 of the information processing apparatus 20a performs an authentication process on the received passcode using the passcode managed by the data management unit 24. In step S705, the transmission / reception unit 21 of the information processing device 20a transmits the authentication result to the client unit 200 of the information processing device 20b.

  If the authentication unit 22 of the information processing device 20a determines that the information processing device 20b is a legitimate information processing device, the information processing device 20a that is the host device is remotely shared with the information processing device 20b that is the participating device. Establish processing communication. As a result, the client unit 200 of the information processing apparatus 20b enables the start of remote sharing processing with another information processing apparatus (step S706).

  The following steps describe the process for displaying the output image in the remote sharing process. In step S707, the display control unit 15 of the information processing device 20b causes the display 115 to display an output image that is image data output from the external input device 50b. In step S708, the transmission / reception unit 25 of the information processing device 20b transmits the image data of the output image displayed on the display 115 by the display control unit 15 to the information processing device 20a.

  In step S <b> 709, the information processing apparatus 20 a that is the host apparatus displays an output image on the display 115. Specifically, the transmission / reception unit 21 of the information processing device 20a outputs the received image data of the output image to the client unit 200 of the information processing device 20a that is the same host device. The transmission / reception unit 25 of the client unit 200 outputs the image data of the output image to the generation unit 14. The generation unit 14 generates a display image to be displayed on the display 115 using the image data of the output image.

  Note that the generation unit 14 generates not only the image data of the output image but also each drawing data of the UI image and the stroke image as the superimposed image (A, B, C), similarly to the content shown in FIG. Then, the display control unit 15 causes the display 115 to display the superimposed image (A, B, C) generated by the generation unit 14 as a display image.

  FIG. 32 is a sequence diagram for sharing a drawn image in the image sharing system according to the second embodiment. FIG. 32 illustrates an example in which drawing information input to the information processing apparatus 20b is shared by the information processing apparatus 20a.

  In step S801, the input receiving unit 13 of the information processing apparatus 20b receives an input of drawing information by the user. The user of the information processing apparatus 20b draws a stroke image using the electronic pen 2400.

  Next, in step S <b> 802, the generation unit 14 of the information processing device 20 b generates a display image to be displayed on the display 115 using the drawing information received by the input reception unit 13. Specifically, for example, the generation unit 14 superimposes a drawing image (B) that is a stroke image received by the input reception unit 13 on the UI image (A) and the PC output image (C) illustrated in FIG. To do. Then, the display control unit 15 displays the superimposed image generated by the generation unit 14 on the display 115 of the information processing apparatus 20b.

  In step S803, the transmission / reception unit 25 of the information processing device 20b transmits the image data of the drawn image (B) to the information processing device 20a that is the hosting device via the communication network 2. Thereby, the transmission / reception unit 21 of the information processing device 20a receives the image data of the drawn image (B) drawn by the information processing device 20b. In this way, the image data of the drawn image (B) drawn by the information processing device 20b is sequentially transmitted to the information processing device 20a that is the hosting device every time it is drawn.

  The drawing image data is, for example, data shown for each stroke data ID shown in FIG. Accordingly, for example, as described above, when the user draws the alphabet “T” with the electronic pen 2400, the stroke image data indicated by each of the two stroke data IDs is sequentially transmitted.

  In step S804, the generation unit 14 of the information processing apparatus 20a that is the host apparatus generates a display image based on the image data of the drawn image (B) transmitted from the information processing apparatus 20b. Specifically, the data processing unit 23 of the information processing apparatus 20a combines the image data of a plurality of drawing images (B) that are sequentially transmitted and stores them in the data management unit 24. In addition, the transmission / reception unit 21 transmits the image data of the combined drawn image (B) combined by the data processing unit 23 to the transmission / reception unit 25 in the client unit 200 of the information processing apparatus 20a that is the same hosting apparatus. And the production | generation part 14 superimposes the image data of the drawing image (B) after the synthesis | combination received by the transmission / reception part 25 on UI image (A) and PC output image (C) which were shown in FIG. Generate a display image.

  In step S805, the display control unit 15 of the information processing device 20a causes the display 115 to display the display image generated by the generation unit 14.

  In the above process, the PC output image (C) is displayed on the display 115, but a background image (D) may be displayed instead of the PC output image (C). Alternatively, the exclusive relationship between the PC output image (C) and the background image (D) may be stopped, and both the PC output image (C) and the background image (D) may be displayed on the display 115 at the same time.

  As described above, the image sharing system according to the second embodiment can be used even when the plurality of information processing apparatuses 20 perform communication via the communication network 2 without using a communication session using the transmission terminal 40, respectively. The function according to the present invention can be realized.

● Third embodiment ●
Next, an image sharing system according to the third embodiment will be described. In addition, the same code | symbol is attached | subjected to the same structure and the same function as 1st Embodiment or 2nd Embodiment, and the description is abbreviate | omitted. The image sharing system according to the third embodiment is a system when each information processing apparatus 10 realizes a remote conference using a WEB browser.

  FIG. 33 describes the system configuration of an image sharing system according to the third embodiment. The image sharing system shown in FIG. 33 includes a plurality of information processing apparatuses 30 (30a and 30b), a communication management apparatus 90, and a WEB server 80.

  The information processing device 30 is a tablet terminal having drawing information input (handwriting input) means such as a touch panel. The information processing apparatus 30 shares a display image and input drawing information using a WEB browser.

  The information processing apparatus 30a functions as, for example, an HTTP server, and transmits image data displayed on the WEB browser to the information processing apparatus 30b. In this case, the information processing apparatus 30b functions as a general web browser that operates as an HTTP client and draws HTML (HyperText Markup Language).

  The WEB server 80 is a server device that manages communication between the information processing devices 30 via the communication network 2. The WEB server 80 and the communication management device 90 constitute a management system 5b. The management system 5b may be configured to realize the functions of the WEB server 80 and the communication management device 90 as one server device.

  The drawing information input method and the image sharing method according to the third embodiment are realized by the same method as that of the first embodiment or the second embodiment, using the system configuration shown in FIG. . Thus, the image sharing system according to the third embodiment can realize a remote conference using a WEB browser without using a dedicated terminal (transmission terminal 40) or a dedicated application. Moreover, the drawing information input (handwritten input) to the information processing apparatus 30 can be shared and displayed among the plurality of information processing apparatuses 30 using a WEB browser.

● Summary ●
As described above, the information processing apparatus according to the embodiment of the present invention includes the display 115 (an example of a display unit) that receives and displays the display information displayed on the external apparatus via the communication network 2. The apparatus 10 includes an input receiving unit 13 (an example of a receiving unit) that receives input of drawing information on the display 115, and drawing authority information 5050 (an example of authority information) indicating display authority of the received drawing information on the display 115. And a display control unit 15 (an example of display control means) for controlling the display of the drawing information. Therefore, the information processing apparatus 10 improves the convenience by controlling the display of the drawing information displayed on each information processing apparatus 10 according to the display authority of the drawing information that the input side that has input the drawing information has. be able to.

  In addition, the information processing apparatus according to an embodiment of the present invention includes a drawing authority that does not have an authority to erase drawing information drawn by another apparatus included in the acquired drawing authority information 5050 (an example of authority information). The display of the drawing information is controlled based on the drawing authority (an example of the second authority) in which the displayed drawing information is erased based on a predetermined condition (an example of the first authority). Therefore, since the information processing apparatus 10 can display the input drawing information using different display forms, the drawing information displayed on each information processing apparatus 10 according to the sharing destination and the use scene can be displayed. The display can be controlled.

  Furthermore, the information processing apparatus according to the embodiment of the present invention can select operation icons 602 and 603 (an example of a selection unit) that can select a display authority for drawing information according to the acquired drawing authority information 5050 (an example of authority information). ) Is generated, and the display of the drawing information input on the input screen is controlled based on the selected display authority. Therefore, the information processing apparatus 10 can select a drawing type according to a sharing destination and a use scene for a user who inputs drawing information.

  The information processing apparatus according to the embodiment of the present invention displays the drawing information input to the area based on the display authority for the drawing information assigned to each of the divided areas 801 and 802 in the display image. To control. Therefore, the information processing apparatus 10 can restrict the display of the drawing information by designating an area in the image data to be shared where the input of the drawing information is desired to be restricted.

  Furthermore, the management system according to the embodiment of the present invention includes a communication management device 90 (management) that manages communication among a plurality of information processing devices 10 that share a display image displayed on the display 115 (an example of a display unit). A drawing authority management DB 9005 (an example of a system) that stores drawing authority information 5050 (an example of authority information) in which drawing information display authority is associated with input side information indicating an input side on which drawing information is input. An example of a storage unit) and a transmission / reception unit 91 (an example of a transmission unit) that transmits drawing authority information associated with input-side information to the information processing apparatus 10. Therefore, the communication management apparatus 90 can provide the information processing apparatus 10 with the authority to display the drawing information according to the input side on which the drawing information is input.

  In the management system according to an embodiment of the present invention, the drawing information display authority for each input side and sharing destination is associated with the drawing sharing information 5051 including the drawing information sharing destination in addition to the drawing information input side. The drawing authority information 5050a (an example of authority information) is stored in the drawing authority management DB 9005 (an example of a storage unit), and the drawing information associated with the drawing sharing information is stored in each information processing apparatus 10 that is the input source and the sharing destination. Send authority information. Therefore, the communication management apparatus 90 can flexibly control the display of the drawing information on the information processing apparatus 10 according to the input drawing information sharing destination.

  Furthermore, an image sharing system according to an embodiment of the present invention is an image sharing system that shares display images displayed on a plurality of information processing apparatuses 10, and includes a display 115 (an example of a display unit) of the information processing apparatus 10. An input receiving unit 13 (an example of a receiving unit) that receives input of drawing information with respect to the drawing authority information 5050 (authorization information A drawing authority management DB 9005 (1001) (an example of a storage unit) that stores an example), a display control unit 15 (an example of a display control unit) that controls display of drawing information based on the stored drawing authority information, Is provided. Therefore, the image sharing system according to the embodiment of the present invention controls the display of the drawing information displayed on each information processing apparatus 10 according to the drawing information display authority of the input side that has input the drawing information. Can do.

  In addition, the image sharing method according to an embodiment of the present invention is executed by the information processing apparatus 10 including the display 115 (an example of a display unit) that receives and displays the display information displayed on the external device via the communication network 2. The drawing information is based on a reception step of receiving input of drawing information to the display 115 and drawing authority information 5050 (an example of authority information) indicating display authority of the received drawing information to the display 115. And a display control step for controlling the display. Therefore, the image sharing method according to an embodiment of the present invention controls the display of the drawing information displayed on each information processing apparatus 10 according to the drawing information display authority of the input side that has input the drawing information. Thus, convenience can be improved.

  Note that the functions of the embodiments can be realized by a computer-executable program written in a legacy programming language such as assembler, C, C ++, C #, Java (registered trademark), an object-oriented programming language, or the like. ROM, EEPROM EPROM (Erasable Programmable Read-Only Memory), flash memory, flexible disk, CD (Compact Disc) -ROM, CD-RW (Re-Writable), DVD-ROM, DVD-RAM, DVD-RW, Blu-ray Disc, SD It can be stored in a device-readable recording medium such as a card, MO (Magneto-Optical disc), or distributed through a telecommunication line.

  Also, some or all of the functions of each embodiment can be mounted on a programmable device (PD) such as an FPGA (Field Programmable Gate Array), or can be mounted as an ASIC. Circuit configuration data (bitstream data) downloaded to the PD in order to realize the above functions on the PD, HDL (Hardware Description Language) for generating the circuit configuration data, VHDL (Very High Speed Integrated Circuits Hardware Description Language), It can be distributed on a recording medium as data described in Verilog-HDL or the like.

  The information processing apparatus, management system, image sharing system, image sharing method, and program according to an embodiment of the present invention have been described so far. However, the present invention is not limited to the above-described embodiment, and other implementations. Additions, changes, or deletions of forms can be made within the scope that can be conceived by those skilled in the art, and any aspect is included in the scope of the present invention as long as the effects and effects of the present invention are exhibited. is there.

2 Communication network 3 Terminal system 5 Management systems 10, 20, 30 Information processing device 13 Input reception unit (an example of reception means)
14 Generation Unit (Example of Generation Unit)
15 Display control unit (an example of display control means)
40 transmission terminal 50 external input device 60 administrator terminal 70 relay device 90 communication management device 91 transmission / reception unit (an example of transmission means)
9000 storage unit (an example of storage means)

JP 2010-239469 A

Claims (11)

An information processing apparatus including a display unit that receives and displays display information displayed on an external device via a network,
Receiving means for receiving input of drawing information to the display unit;
Display control means for controlling display of the drawing information based on authority information indicating display authority of the accepted drawing information to the display unit;
An information processing apparatus comprising: The authority information includes a first authority that does not have an authority to delete drawing information drawn by the other device, and a second authority that deletes the displayed drawing information based on a predetermined condition. Have
The information processing apparatus according to claim 1, wherein the display control unit controls display of the drawing information based on the first authority or the second authority included in the authority information. The condition is a condition indicating that a predetermined time has elapsed,
The information processing apparatus according to claim 2, wherein the display control unit automatically deletes drawing information corresponding to the second authority when the predetermined time has elapsed. The information processing apparatus according to any one of claims 1 to 3, further comprising:
Generating means for generating an input screen for accepting input of the drawing information according to the authority information;
The information processing apparatus, wherein the display control unit controls display of the drawing information input on the input screen. The input screen includes a selection unit capable of selecting the display authority of the drawing information according to the acquired authority information,
The information processing apparatus according to claim 4, wherein the display control unit controls display of the drawing information based on the selected display authority. The authority information is given display authority for the drawing information for each divided area in the display image.
The display control means controls the display of the drawing information input to the area based on the display authority given to each area.
The information processing apparatus according to any one of claims 1 to 5. A management system for managing communication between a plurality of information processing apparatuses sharing a display image displayed on a display unit,
Storage means for storing authority information associated with display authority of the drawing information to input side information indicating the input side on which the drawing information is input;
Transmitting means for transmitting the authority information associated with the input side information to the information processing apparatus;
A management system comprising: The storage means stores, in addition to the input side, authority information in which display authority of the drawing information for each of the input side and the sharing destination is associated with drawing sharing information including a sharing destination of the drawing information,
The transmission means transmits the authority information associated with the drawing sharing information to each information processing apparatus that is an input side and a sharing destination.
The management system according to claim 7. An image sharing system for sharing display images displayed on a plurality of information processing devices,
Receiving means for receiving input of drawing information to the display unit of the information processing apparatus;
Storage means for storing authority information in which display authority of the drawing information is associated with input side information indicating an input side that has input the drawing information;
Display control means for controlling display of the drawing information based on the stored authority information;
An image sharing system comprising: An image sharing method executed by an information processing apparatus including a display unit that receives and displays display information displayed on an external device via a network,
An accepting step for accepting input of drawing information to the display unit;
A display control step for controlling display of the drawing information based on authority information indicating display authority for the display unit of the accepted drawing information;
Image sharing method to execute.   A program for causing a computer to execute the image sharing method according to claim 10.